File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
The moose likes Hadoop and the fly likes Retrieving map reduce results Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Retrieving map reduce results" Watch "Retrieving map reduce results" New topic

Retrieving map reduce results

Andrew Mcmurray
Ranch Hand

Joined: Sep 24, 2005
Posts: 188
Hi all

Kinda to new to hadoop and running map reduce jobs. I have successfully inserted files into hdfs, ran a map reduce job, and stored the results in an output directory on hdfs. My questions is now that the results are their what is the best way to retrieve them for display? I saw I can connect to the FSFileSystem. Do I do that get a handle to the output dir and then loop through the results? Am I way off or is there better ways? I am looking to either have a Grails app or maybe just a jsp display the results.


Srinivas Mupparapu

Joined: Feb 12, 2004
Posts: 14

There are coulple of options depending on your file format:
- As you mentioned, you can use FSFileSystem in a Servlet to read and process the data and display it in your JSP.
- You could create a Hive external table and use HiveQL with JDBC to retrieve your data into your JSP. Keep in mind that HiveQL is similar to SQL but with limited features.
I agree. Here's the link:
subject: Retrieving map reduce results
It's not a secret anymore!