From the Hibernate documentation:
Set this property to true if your JDBC driver returns correct row counts from executeBatch() (it is usually safe to turn this option on). Hibernate will then use batched DML for automatically versioned data. Defaults to false.
So if it doesn't appear to be working I'd investigate your Driver.