StreamTokenizer and EOL problem

[Larry Frissell]

I am having a problem with this code. When I run it , can get the numbers fine, but I am not reading the StreamTokenizer.TT_EOL so I am stuck in the while loop forever.

  public class ReadingNumbersMain {
 
    public static void main(String[] args)throws IOException {
            readfile("puzzle1.txt");    
  }
 
  static void readfile(String filename) throws IOException {
      int count =0;
     int[] intArray;
      ArrayList<int[]> lineArrays = new ArrayList<int[]>() ;
     ArrayList<Integer> inputLine=new ArrayList<Integer>();
 
    Reader r = new BufferedReader(new FileReader(filename));
    StreamTokenizer intToken = new StreamTokenizer(r);
            System.out.println( " EOLToken type is " + StreamTokenizer.TT_EOL);
    while(intToken.ttype != StreamTokenizer.TT_EOF){
    intToken.nextToken();
    while (intToken.ttype != StreamTokenizer.TT_EOL) {
      if (intToken.ttype == StreamTokenizer.TT_NUMBER){
        inputLine.add((new Double(intToken.nval).intValue()));
        System.out.println( " Reading number " +intToken.nval);
      } else { System.out.println( " Reading non-number " +intToken.nval);}
              intToken.nextToken();
              System.out.println( " Token type is " +intToken.ttype);
    }
 
    System.out.println( " end of Line " +  ++count );
    int i = 0;
    intArray = new int[inputLine.size()];
           for(Integer e : inputLine)
               intArray[i++] = e;
       lineArrays.add(intArray);  
       
  }// end of  EOF while loop
       System.out.println( " File closed ");
r.close();
  }  

My txt file looks like this:

// Puzzle 1 for MazePuzzle
20 20 1650 1650 80
20 950 950 20 20
60 60 200
60 910 910    

Any ideas would be appreciated.

[Thomas Thevis]

Actually, I don't know what's going wrong, but I would use the BufferedReader.readLine() method tor read the file line by line and parse each single line with the Scanner class.

Regards,
thomas

[Gamini Sirisena]

There are two while loops checking for TT_EOF
Could it be due to the outer while construct?

[Larry Frissell]

I have worked around the problem, but I really do not understand the problem I was having with TT_EOL. For the program I am making, it was important to know when I reached the end of the line on the text file. By printing each of the inttoken.ttype I determined that at the end of each line I got an integer constant (-3) which is the constant for TT_WORD.

So I changed my inner while loop to

           while (intToken.ttype != StreamTokenizer.TT_WORD) {   

and I am no longer stuck in the loop.