This week's book giveaway is in the Clojure forum.
We're giving away four copies of Clojure in Action and have Amit Rathore and Francis Avila on-line!
See this thread for details.
Win a copy of Clojure in Action this week in the Clojure forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop problem with Custom RecordReader

 
marcin biczak
Greenhorn
Posts: 1
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi all

I am using Hadoop version 0.20.2003. I wanted to create my own InputFormat and Reader. I wanted to do it with the use of new org.apache.hadoop.mapreduce.* classes. Unfortunately I have encountered some problems.



Inside the visible line I have 3 strange problems:
1. cannot find symbol : variable COUNTER_GROUP
2 cannot find symbol : variable BYTES_READ
3. cannot find symbol : method getCounter(java.lang.String,java.lang.String)

I've checked the sources and all 3 "symbols" are there. Does anyone know what is the problem? Also I have came across interesting thing. Mainly according to hadoop javadoc org.apache.hadoop.mapreduce.TaskAttemptContext is:


While the src file defines it as:


For the record my "amazing" PatentLineRecordReder class is just a copy/paste from the org.apache.hadoop.mapreduce.lib.input.LineRecordReader, with minor changes in the initialize() method.

Does anyone came across similar problems, or rather should I ask "What am I doing wrong?".

For any help I will be grateful.
 
I agree. Here's the link: http://aspose.com/file-tools
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic