question about lucene index creating

[jonathan ford]

the two arguments are: c:\index; c:\data, there is one text file in c:\data, I run the program, it turns out nothing in c:\index, the codes are following:


package indexer;

import java.io.*;
import java.util.*;
import org.apache.lucene.index.*;
import org.apache.lucene.analysis.standard.*;
import org.apache.lucene.document.*;
import java.lang.Object;

public class Indexer {

/**
* @param args
*/
public static void main(String[] args) throws Exception {
// TODO Auto-generated method stub
if (args.length !=2) {
throw new Exception("Usage: java" +Indexer.class.getName()
+ " <index dir> <data dir>");
}
File indexDir = new File (args[0]);
File dataDir = new File(args[1]);
long start = new Date().getTime();
int numIndexed = index (indexDir, dataDir);
long end = new Date().getTime();
System.out.println("Indexing " + numIndexed + " files took "
+ (end - start) + " milliseconds");
}
// open an index and start file directory traversal
public static int index(File indexDir, File dataDir) throws IOException {
if (!dataDir.exists() || !dataDir.isDirectory()) {
throw new IOException(dataDir
+ " does not exist or is not a directory");
}
//IndexWriter writer = new IndexWriter(indexDir, new StandardAnalyzer(), true);
IndexWriter writer = new IndexWriter(indexDir, new StandardAnalyzer());
writer.setUseCompoundFile(false);
indexDirectory(writer, dataDir);
int numIndexed = writer.docCount();
writer.optimize();
writer.close();
return numIndexed;
}
// recursive method that calls itself when it finds a directory
private static void indexDirectory(IndexWriter writer, File dir) throws IOException {
File[] files = dir.listFiles();
for (int i = 0; i < files.length; i++) {
File f = files[i];
if (f.isDirectory()) {
indexDirectory(writer, f);
}
else if (f.getName().endsWith(".txt")) {
indexFile(writer, f);
}
}
}

// method to actually index a file using Lucene
private static void indexFile(IndexWriter writer, File f) throws IOException {
if (f.isHidden() || !f.exists() || !f.canRead()) {
return;
}
System.out.println("Indexing " + f.getCanonicalPath());
Document doc = new Document();
//doc.add(Field.Text("contents", new FileReader(f)));
doc.add(new Field("contents", new FileReader(f)));

doc.add(new Field("filename", f.getCanonicalPath(), Field.Store.YES, Field.Index.UN_TOKENIZED));
writer.addDocument(doc);
}
}

[Stan James]

Hi, welcome to the ranch! For future reference, see the CODE button below the post editor when posting code. That preserves your formatting and makes things much easier to read.

I don't see anything that jumps out at me here. I guess you confirmed you're actually getting to the file via the System.out. I've never used the Field constructor with the reader. For what it's worth, here's part of my code:

some other method ...
{
    IndexWriter writer = new IndexWriter( indexPath, new StandardAnalyzer(), create );
    writer.setMaxBufferedDocs( factor );
    writer.setMergeFactor( factor );
    for (WikiProperties props : pages)
    {
        WikiPage page = (WikiPage) Repository.getFile( props.getName() );
        writer.addDocument( createDocument( props, page ) );
    }
    writer.optimize();
    writer.close();
}
 
private Document createDocument(WikiProperties props, WikiPage page)
{
    Document doc = new Document();
    String name = props.getName();
    doc.add( new Field( UID, name, Field.Store.NO, Field.Index.UN_TOKENIZED ) );
    name = name.substring( 1 );
    doc.add( new Field( "space", page.nameSpace(), Field.Store.YES, Field.Index.TOKENIZED ) );
    doc.add( new Field( "title", name, Field.Store.YES, Field.Index.TOKENIZED ) );
    doc.add( new Field( "path", name, Field.Store.YES, Field.Index.NO ) );
    doc.add( new Field( CONTENT_FIELD, name + " " + page.getContent(), Field.Store.YES, Field.Index.TOKENIZED ) );
    return doc;
}

[ November 08, 2007: Message edited by: Stan James ]