Parsing a non XML text document

[Sudarshan Chakrabarty]

Hi,

I need to parse the following content which I am getting after parsing a webpage using HtmlParser. I can store the content in a text document or a String object. I need to extract the words in bold and store it in some Value Objects i.e. basically I need the " Link to" and "titled" data.

 
Link to : [B]http://www.rockymountainnews.com/news/2008/nov/28/man-ejected-killed-in-morning-rollover/[/B]; titled :[B] Longmont police say thieves may have used up to 100 stolen credit- or debit-card numbers to rack up more than $100,000 of fraudulent charges.[/B]   ; begins at : 24845; ends at : 24961, AccessKey=null
   0 Txt (24961[512,121],25105[512,265]): 
Link to : [B]http://www.rockymountainnews.com/news/2008/nov/28/group-tries-to-find-home-for-museum/[/B]; titled :[B] Group tries to find home for museum; [/B]begins at : 25162; ends at : 25271, AccessKey=null
   0 Txt (25271[518,115],25306[518,150]): Group tries to find home for museum
Link to :[B] <a href="http://www.rockymountainnews.com/news/2008/nov/28/group-tries-to-find-home-for-museum/[/b" target="_blank" rel="nofollow">;]http://www.rockymountainnews.com/news/2008/nov/28/group-tries-to-find-home-for-museum/[/B];</a> titled : [B]Denver police technician Dean Christopherson has dreamed of a city police museum for years.[/B]  ; begins at : 25353; ends at : 25462, AccessKey=null
   0 Txt (25462[521,114],25555[521,207]): Denver police technician Dean Christophe...
Link to : [B]http://www.rockymountainnews.com/news/2008/nov/28/food-and-fellowship/;[/B] titled : [B]Food and Fellowship; begins at[/B] : 25612; ends at : 25689, AccessKey=null
   0 Txt (25689[527,83],25708[527,102]): Food and Fellowship
Link to : [B]http://www.rockymountainnews.com/news/2008/nov/28/food-and-fellowship/;[/B] 
titled : [B]Vignettes from Thanksgiving celebrations across the metro area.[/B]  ; begins at : 25755; ends at : 25832, AccessKey=null
 
  

I tried using StringTokenizer, Pattern etc but it's not working

Can someone please help me out?

[ November 28, 2008: Message edited by: Sudarshan Chakrabarty ]
[ November 28, 2008: Message edited by: Sudarshan Chakrabarty ]

[Joanne Neal]

Originally posted by Sudarshan Chakrabarty:
I tried using StringTokenizer, Pattern etc but it's not working

In what way is it not working ? What results do you get and how do they differ from what you want ?

[Sudarshan Chakrabarty]

Hi Joanne,
Thanks for the reply.
Using StringTokenizer doesn't work as my requirement is to be able to give both the start and end string, say if I can give "Link to " and ";" then I will get all data between them, which is what I need.
But StringTokenizer takes only one delimiter, so if I code something like

    
StringTokenizer tokenizer = new StringTokenizer(text, "Link to");

 while (tokenizer.hasMoreTokens()) {
         System.out.println(tokenizer.nextToken());
     }

It's obviously not going to help me .

I would want to be able to select all data between
i) "Link to" and the next ";"
and
ii) "titled" and the next ";".
And so I would need to iterate through the whole content and store the above relevant data in some collection.

[Joanne Neal]

You could try String.split() which uses a regular expression to split the string.

Or maybe just use String.indexOf and String.substring.