File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes Hadoop and the fly likes Hadoop problem with Custom RecordReader Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Java Interview Guide this week in the Jobs Discussion forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop problem with Custom RecordReader " Watch "Hadoop problem with Custom RecordReader " New topic

Hadoop problem with Custom RecordReader

marcin biczak

Joined: Sep 30, 2011
Posts: 1
Hi all

I am using Hadoop version 0.20.2003. I wanted to create my own InputFormat and Reader. I wanted to do it with the use of new org.apache.hadoop.mapreduce.* classes. Unfortunately I have encountered some problems.

Inside the visible line I have 3 strange problems:
1. cannot find symbol : variable COUNTER_GROUP
2 cannot find symbol : variable BYTES_READ
3. cannot find symbol : method getCounter(java.lang.String,java.lang.String)

I've checked the sources and all 3 "symbols" are there. Does anyone know what is the problem? Also I have came across interesting thing. Mainly according to hadoop javadoc org.apache.hadoop.mapreduce.TaskAttemptContext is:

While the src file defines it as:

For the record my "amazing" PatentLineRecordReder class is just a copy/paste from the org.apache.hadoop.mapreduce.lib.input.LineRecordReader, with minor changes in the initialize() method.

Does anyone came across similar problems, or rather should I ask "What am I doing wrong?".

For any help I will be grateful.
I agree. Here's the link:
subject: Hadoop problem with Custom RecordReader
It's not a secret anymore!