Win a copy of Mesos in Action this week in the Cloud/Virtualizaton forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

data retrival in spring batch framework

 
Hitesh Gupta
Greenhorn
Posts: 15
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi

We have a Java process that pings the DB (mainframe DB2) at a predefined frequency. If Java process finds some data in DB it reads and processes that data and inserts the data in IBM MQ using JMS.

We are now planning to migrate it to WAS with support for Load Balancing and Clustering environments. We have decided to use Spring Batch Framework.

Problem:-

Now in a multi clustered environment, suppose if some data is there in DB2 and is updated in MQ by java program running in one cluster. How can we ensure that once data is retrieved from one cluster, it should not be repeated by other java program running in differnet cluster. Otheriwse it will lead to duplicate data in MQ by differnet clusters.

May be if we put some flag checks in java to comply to it. But in a multi clustered environment, how we can achieve this.

Regards,
Hitesh.
 
Rajah Nagur
Ranch Hand
Posts: 239
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
How about using "Select for Update" sql construct?
The Java process will read the rows , process and delete the records (or update a flag) in one atomic transaction.
 
puneet dhiman
Greenhorn
Posts: 5
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hitesh,

We are stucked in similar situation, how you achieved this?

Thanks
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic