I have created a spring mvc project with maven build.
I am trying to read an xml file with 300K records to insert if not exists else update into mysql database,
i have written a scheduler which does following steps
1. parse xml file
2. validates each record
3. executes select query to find if record exists then update else insert
i have kept scheduler pool-size =1 in XML job-scheduler and Executors.newScheduledThreadPool(1)
in scheduler configuration class.
whenever shedular runs , it creates lots of threads which access database connection
which gives address already in use exception which causes sheduler to freeze.
I have even used batchUpdate() method of JdbcTemplate for insert / update but still problem persists.