wood burning stoves 2.0*
The moose likes JDBC and the fly likes Suitable java databse fromework for accessing large database Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Android Security Essentials Live Lessons this week in the Android forum!
JavaRanch » Java Forums » Databases » JDBC
Bookmark "Suitable java databse fromework for accessing large database" Watch "Suitable java databse fromework for accessing large database" New topic
Author

Suitable java databse fromework for accessing large database

Ashish Agr
Greenhorn

Joined: May 13, 2011
Posts: 6
Hi,

I have a requirement that needs to access database with millions of records process them and then write them back to the database. Kind of data enrichment process.

I am searching for the suitable framework I can use for this scenario. Hibernates seems not a good performer for large no of transactions.

So should I stick to plain old SQL queries and JDBC or any one can recommend for some framework with better performance with large transactions(millions).


Thanks in advance,
Ashish
Jayesh A Lalwani
Bartender

Joined: Jan 17, 2008
Posts: 2277
    
  28

Hibernate can process millions of records. However, I would first investigate OTS ETL tools to implement large scale transformation of data before building something in Java. I have used Talend before, and it's pretty good, and my employer uses Informatica, which I hear is good too, but I don't have direct experience with it.
Saif Asif
Ranch Hand

Joined: Aug 11, 2011
Posts: 440

I would suggest using Hibernate since it is best to handle extremely large databases although I would agree to the fact ( and also from my experience ) that hibernate does have a performance drawback


Muhammad Saif Asif Mirza
OCJA(5/6) OCJP(6) OCJWCD(6)
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Suitable java databse fromework for accessing large database
 
Similar Threads
What is Jess?
Ordering Search Results
Need help regarding multiple JVM in a single server
How efficient JESS is?
Passed IBM RUP v7 (839) with 86%