File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes Hadoop and the fly likes mapReduce job output Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "mapReduce job output" Watch "mapReduce job output" New topic

mapReduce job output

jain Shasha

Joined: Mar 20, 2013
Posts: 3

I have a query regarding MapReduce Job Output
Let say i have multiple reducers (24) for my job. While after completion of 15 reducers my job get failed and the rest 9 reducers wont able to write data in hdfs.
So the output created by the rest 15 reducers would remain in my output directory path of hdfs or they get also removed as my all reducers not able to process and job get failed in between.

sreekanth jella

Joined: Aug 21, 2008
Posts: 10

Ideally output of 15 reducers should be availalable in HDFS.
It is sorta covered in the JavaRanch Style Guide.
subject: mapReduce job output
It's not a secret anymore!