posted 10 years ago
one of my steps in a job has a chunk(reader,processor& writer) whose commit-interval is 10 and skip-limit is 200.
Flat file from which the data is read has got 10 records out of which 9 are valid.5th record is invalid.
when reader completes reading 10 records , processor processes the 9 valid records and sends it to writer.
once the writer writes the 9 records to the DB, instead of terminating processor is called for each of the 9 records and then writer.
processor --> writer flow is executed for 9 times like this.
If the Flat file has got all valid records, it executes in the normal way reads 10 records and writes to the DB.
Please suggest me where its going wrong.
Thanks in advance.