read words from file into array

[James Stanford]

I'm trying to read in words from a file and then put those words into and array and sort the array, I kinda have a program but it isn't working can some one help me out with it, It would be nice to see some source code. I'm new to java and am having problems with the syntax and object orintation of the language. Anyways some help would be nice

[Sam Moran]

Do you mean something like this:

public void getAccounts() {
/*********************************************************************
Read the file with Account data in it and assign the data to the accts data array.
 ********************************************************************/
StringTokenizer t;
int cnt = 0, size = 0;
size = GetFileLineCount();
account[] readArray = new account[size];
  try {
    BufferedReader in = new BufferedReader(new FileReader(file));
    line = in.readLine();
    while (line != null) 
      t = new StringTokenizer (line, "\t");
      username = t.nextToken();
      password = Integer.parseInt (t.nextToken());
      accttype = t.nextToken();
      name = t.nextToken();
      acctnum = Integer.parseInt (t.nextToken());
      double tempdbl = new Double(t.nextToken)).doubleValue();
      balance = tempdbl;
      readArray[cnt++] = new account (username,password,accttype,name,acctnum,balance);
      line = in.readLine();
  }
  in.close();
} catch (IOException exception) {System.out.println(exception);}
  accts = readArray;
}

I hope this helps!

[James Stanford]

Yes thanks thats what I was looking for.
This is what I did to it but I'm getting compiler errors:

import java.io.*;
import java.lang.*;
class a2{
    public static void main(String[] args){
getData();
public void getData() {
/*********************************************************************
Read the file with the text data in it and assign the data to the  
data array.
 ********************************************************************/
    StringTokenizer t;
    int cnt = 0, size = 0;
    size = GetFileLineCount();
    array[] readArray = new array[size];
    try {
BufferedReader in = new BufferedReader(new FileReader(args[0]));
line = in.readLine();
while (line != null){ 
    t = new StringTokenizer (line, " \t\n.!?");
    word = t.nextToken();
    readArray[cnt++] = new array (word);
    line = in.readLine();
}
in.close();
    } catch (IOException exception) {System.out.println(exception);}
    accts = readArray;
}
    }
}

After I create I get to figure out how to put this info into a minimum hieght binary tree
I'll be having fun...hmmmm
[ March 01, 2003: Message edited by: James Stanford ]

[Layne Lund]

What are the errors and which lines do they refer to?

[Peter den Haan]

So all you need is read a text file, split it in words, and end up with a sorted array of words?

    public String[] extractWords(String file) throws IOException {
        byte[] buffer = new byte[(int)new File(file).length()];
        FileInputStream fis = new FileInputStream(file);
        try {
            fis.read(buffer);
            String[] words = new String(buffer).split("[^\\w]+");
            Arrays.sort(words);
            return words;
        } finally {
            fis.close();
        }
    }

Or perhaps you are interested in the unique words in your document? In that case, a Set is more appropriate.

    public SortedSet extractWords(String file) throws IOException {
        byte[] buffer = new byte[(int)new File(file).length()];
        FileInputStream fis = new FileInputStream(file);
        try {
            fis.read(buffer);
            String[] words = new String(buffer).split("[^\\w]+");
            return new TreeSet(Arrays.asList(words));
        } finally {
            fis.close();
        }
    }

If you do want unique words, but not a Set, try

    public String[] extractWords(String file) throws IOException {
        byte[] buffer = new byte[(int)new File(file).length()];
        FileInputStream fis = new FileInputStream(file);
        try {
            fis.read(buffer);
            String[] words = new String(buffer).split("[^\\w]+");
            List wordList = new ArrayList(new HashSet(Arrays.asList(words)));
            Collections.sort(wordList);
            return (String[])wordList.toArray(new String[0]);
        } finally {
            fis.close();
        }
    }

And so forth. The combination of regular expressions and the Collections framework is good fun although still not as much as Perl.
- Peter

[Peter den Haan]

I realised you may want to know the frequency of the words as well. The following code is a bit dirty, so don't show it to anyone as-is -- it will return a sorted list of words, each stating how many times it occurred in the source text:

    public Collection extractWords(String file) throws IOException {
        class Count {
            String word;
            int times;
            public String toString() {
                return word + "=" + times;
            }
        }
        
        byte[] buffer = new byte[(int)new File(file).length()];
        FileInputStream fis = new FileInputStream(file);
        try {
            fis.read(buffer);
            String[] words = new String(buffer).split("[^\\w]+");
            SortedMap wordCount = new TreeMap();
            for (int i = 0; i < words.length; i++) {
                Count count = (Count)wordCount.get(words[i]);
                if (count == null) {
                    count = new Count();
                    count.word = words[i];
                    wordCount.put(words[i], count);
                }
                count.times++;
            }
            return wordCount.values();
        } finally {
            fis.close();
        }
    }

It doesn't return an array, it actually returns a Collection of Count objects. If you print them (which calls toString() on the objects) you'll get the promised list.

        for (Iterator i = extractWords(file).iterator(); i.hasNext(); ) {
            System.out.println(i.next());
        }

HTH
- Peter
[ March 03, 2003: Message edited by: Peter den Haan ]