This week's book giveaways are in the Refactoring and Agile forums.
We're giving away four copies each of Re-engineering Legacy Software and Docker in Action and have the authors on-line!
See this thread and this one for details.
Win a copy of Re-engineering Legacy Software this week in the Refactoring forum
or Docker in Action in the Agile forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop problem with Custom RecordReader

 
marcin biczak
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi all

I am using Hadoop version 0.20.2003. I wanted to create my own InputFormat and Reader. I wanted to do it with the use of new org.apache.hadoop.mapreduce.* classes. Unfortunately I have encountered some problems.



Inside the visible line I have 3 strange problems:
1. cannot find symbol : variable COUNTER_GROUP
2 cannot find symbol : variable BYTES_READ
3. cannot find symbol : method getCounter(java.lang.String,java.lang.String)

I've checked the sources and all 3 "symbols" are there. Does anyone know what is the problem? Also I have came across interesting thing. Mainly according to hadoop javadoc org.apache.hadoop.mapreduce.TaskAttemptContext is:


While the src file defines it as:


For the record my "amazing" PatentLineRecordReder class is just a copy/paste from the org.apache.hadoop.mapreduce.lib.input.LineRecordReader, with minor changes in the initialize() method.

Does anyone came across similar problems, or rather should I ask "What am I doing wrong?".

For any help I will be grateful.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic