• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Jeanne Boyarsky
  • Ron McLeod
  • Paul Clapham
  • Liutauras Vilda
Sheriffs:
  • paul wheaton
  • Rob Spoor
  • Devaka Cooray
Saloon Keepers:
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
  • Frits Walraven
  • Tim Moores
Bartenders:
  • Mikalai Zaikin

Reading large text files with multiple data types and items.

 
Ranch Hand
Posts: 176
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I am working on a project that reads data from text files. Every line in a the file corresponds to different data items. Data is pipe delimited.
I need to read each line and find out which table it maps to and then insert records into that table. I need to automatically pick the files from a particular directory(whenever the file is placed there).
Do you have any ideas how to get started, any sample code from any other project or links.
My data sample is like this.
00|05298258|20020828|20020920|0|7458.63|0.00|0|0.00|0|7458.63|0.00|9140.62|16599.25|20020728|20020928|20020829|||||||||||
01|05298258|TERMS: The past due amount is due immediately.|||
03|05298258| service.|||
10|05298258|| FULTONCOUNTY |ATTN: JO AVELLE|141 SW POR ST #9039||ATLANTA|GA|303033455|111210080|I|R|1||128||||||||||||
11|05298258|0|0|0|5431.06|1850|129.76|101|70.40|128|2066880|417060|2532.67|112440|3840|21.27|161100|2340|12.12|2340420|423240|2566.06|65.04|71580|808.93|51.07|0.00|7.00|18.30|183|0.00|0|0.00|0.00|0.00|0.00|0.00|0|0|0.00|0|0|0|0.00|0||||
20|05298258|4045160216|FUlton OFFICE|141 POR ST|9039|ATLANTA|GA|303033444|111210080|I|FEDSSGOSGISG|99999999|2|||||||||||
21|05298258|4045160216|60.75|0|0|0|58.96|18|1.24|1|0.55|1|8400|0|0.00|0|0|0.00|0|0|0.00|8400|0|0.00|0.00|0|0.00|0.00|0.00|0.00|0.00|0|0.00|0|0.00|0.00|0.00|0.00|0.00|0|0|0.00|0|0|0|0|0|0|0|0|0.00|0|
30|05298258|4045160216|2|5|/HOME 700|49.99|0|20020829|20020928|0|||||||||||
30|05298258|4045160216|3|5|/text BASIC VOICE MAIL NC|0.00|0|20020829|20020928|0|||||||||||
30|05298258|4045160216|3|5|text BASICS|2.99|0|20020829|20020928|0|||||||||||
30|05298258|4045160216|28|6|/HOME 700|16.66|1|20020819|20020828|0|||||||||||
30|05298258|4045160216|45|6|CONNECTION CHARGE|1.24|0|20020829|20020928|0|||||||||||
30|05298258|4045160216|43|10|UNIVERSAL SVC CHARGE|0.55|0|20020829|20020928|0|||||||||||
50|05298258|4045160216|20020729|105508|4045160216||INCOMING|CL||P|240|0.00|1|0|0|0000000000|1||||||||||
50|05298258|4045160216|20020729|142555|4045160216||INCOMING|CL||P|120|0.00|1|0|0|0000000000|2||||||||||
50|05298258|4045160216|20020729|151445|4045160216||INCOMING|CL||P|240|0.00|1|0|0|0000000000|3||||||||||
50|05298258|4045160216|20020828|092024|0000000099||VOICE MAIL|CL||P|180|0.00|0|0|0|0000000000|43||||||||||
50|05298258|4045160216|20020828|092724|0000000099||VOICE MAIL|CL||P|420|0.00|0|0|0|0000000000|44||||||||||
50|05298258|4045160216|20020828|180714|6784858361||ATLANTA NE|GA||P|60|0.00|0|0|0|0000000000|45||||||||||
the first record in every line maps to a particular table in our database.
Any ideas will be appreciated.
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
reply
    Bookmark Topic Watch Topic
  • New Topic