This week's book giveaway is in the JavaFX forum.
We're giving away four copies of Introducing JavaFX 8 Programming and have Herbert Schildt on-line!
See this thread for details.
The moose likes JDBC and Relational Databases and the fly likes Bulk Data Processing Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Introducing JavaFX 8 Programming this week in the JavaFX forum!
JavaRanch » Java Forums » Databases » JDBC and Relational Databases
Bookmark "Bulk Data Processing" Watch "Bulk Data Processing" New topic
Author

Bulk Data Processing

Prateek Jauhari
Greenhorn

Joined: Mar 07, 2011
Posts: 26

I am trying to process bulk amount of data....
I am using IBM DB2.

I am reading a list of Item from an Excel using POI interface and for each Item there is a particular set of queries that has to be fired.
The problem is that the if I am running the same set of query for each item then result processing is taking to much of time
(i.e. if the items increases to 50 or above) and ultimately causing the browser to display Request time out error.


Is there to any other way to implement the same with procedure or something ?

Thanks & Regards
Prateek
Jeanne Boyarsky
author & internet detective
Marshal

Joined: May 26, 2003
Posts: 32604
    
215

Do you have to process one at a time? If not, you can batch the queries so there are less server round trips (and less work for the database.)


[OCA 8 book] [Blog] [JavaRanch FAQ] [How To Ask Questions The Smart Way] [Book Promos]
Other Certs: SCEA Part 1, Part 2 & 3, Core Spring 3, TOGAF part 1 and part 2
Prateek Jauhari
Greenhorn

Joined: Mar 07, 2011
Posts: 26

Like I have a List
Such as
1001
1002
1003
and so on
now after reading 1001 we fire a set of queries,
and then for 1002 the same set of queries,
and then for 1003..
and so on...
Mayank Pande
Greenhorn

Joined: Apr 03, 2013
Posts: 1
The reason I raised this here because I'm using hibernate and wanted to check if there is a better option in Spring to do so.

--------------------------
Data Entry
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Bulk Data Processing
 
It's not a secret anymore!