Wim Vanni wrote:Welcome to the Ranch, Zahid.
Your design question is quite a challenge and I'm letting it sink in and have it run in a background thread for a while. I'll get back to you as soon as that thread comes up with some conclusions
Wim
There are only two hard things in computer science: cache invalidation, naming things, and off-by-one errors
fred rosenberger wrote:
How fault-tolerant do you need to be? In other words, if you send 150 of the 300, and your program bombs, how bad is it if you re-send the same 150 again?
Wim Vanni wrote:
I wanted to add that I'm puzzled by the "max 300 at a time" and "percentage-wise spread over available csv's" requirements. The first seems unnecessary if you push data to the app with a webservice or MQ; or is it that 300 records in one batch get sent? The second must have something to do with not using a first-in-first-out (FIFO) system to comply with some functional requirement.
Anyway, hope this helps.
Cheers,
Wim
SCJP 1.4, SCWCD 1.4
She still doesn't approve of my superhero lifestyle. Or this shameless plug:
a bit of art, as a gift, the permaculture playing cards
https://gardener-gift.com
|