• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Expected speed from a load through Hibernate?

 
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

We're looping over an Excel sheet, pulling emails out of a few columns, and modifying a parent-child table where the child is the email address and the parent is in the row.

Roughly, how many rows per second should I expect? The tables aren't too large, there aren't any triggers, the indexes are typical.

I know this is real general, I'm looking for ballpark.

 
author & internet detective
Posts: 41860
908
Eclipse IDE VI Editor Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Tony,
It is going to depend on the machine running it and the size of each row (and memory and physical db layout and # indexes and many other things.) I think the best thing to do is try it.
 
Tony Ennis
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Oh, we have been. It runs at about 7 (spreadsheet) rows per second on our local boxes and 1.9/sec on a VM which is the test server. Our users are rejecting the facility because it is too slow. I was trying to figure out what 'reasonable' means in this case. Basically, we didn't know when we should give up and try something else.

Since I posted we got some political pull and were able to get the code onto a production server. It runs at about 17/sec there which is very acceptable.
 
Bartender
Posts: 10336
Hibernate Eclipse IDE Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
In the past where we've done simmilar stuff the bottleneck we observed was Excel, not the DB. Large data sets were exponentially slower from Excel than they were from a plain old loader file. Do you know it is the DB that is causing the slowness?
 
Tony Ennis
Ranch Hand
Posts: 86
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Yah, pretty sure of it. My guess is that we had VMs fighting over network access.
 
Don't get me started about those stupid light bulbs.
reply
    Bookmark Topic Watch Topic
  • New Topic