Thanks Ulf Dittmer,
For a typical scenario of 43 urls, the application with 5 threads takes little more time than the single threaded version of the application.
Am I going wrong somewhere in the selection of number of threads to process.
Also please tell me which one to choose from the following scenarios:
1. A
thread fetches the url, downloads it and then updates in the database. Similarly many threads deal with different urls simultaneously.
or
2. Separate thread for downloading and separate thread for updating (following producer consumer)
I am presently following the scenario no.1.
-Muthu