• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Tim Cooke
  • Campbell Ritchie
  • Ron McLeod
  • Junilu Lacar
  • Liutauras Vilda
Sheriffs:
  • Paul Clapham
  • Jeanne Boyarsky
  • Henry Wong
Saloon Keepers:
  • Tim Moores
  • Tim Holloway
  • Stephan van Hulst
  • Piet Souris
  • Carey Brown
Bartenders:
  • Jesse Duncan
  • Frits Walraven
  • Mikalai Zaikin

EMR and Hadoop

 
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi,
is there any area of the book that talks about Amazon EMR and Hadoop?

Regards,
Mohamed
 
author
Posts: 2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hi Mohamed,
Cloud Deployments: Using Hadoop on Cloud (Chapter 10) of Hadoop MapReduce Cookbook talks about using EMR for Hadoop/Pig/Hive/HBase computations. It also talks about using Apache Whirr to deploy your own Hadoop or HBase cluster on EC2. You can find an extract of that chapter in the following DZone article. http://architects.dzone.com/articles/cloud-deployments-using-hadoop

thanks,
Thilina
 
author
Posts: 15
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I also talk about EMR in the Hadoop Beginners Guide, particularly in the earlier chapters where there are examples of running code on a local cluster then doing the same on EMR.

My later chapters on topics such as cluster management, Sqoop and Flume don't really touch on EMR so if that is your interest look elsewhere.

Garry
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Ohh wonderful guys thanks for the references ! So the two books are covering it ...

Regards,
Mohamed
 
Ranch Hand
Posts: 221
Scala Python Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
You can also watch this video about how to use it.

http://youtu.be/kNsS9aDf6uE


There is also an extensive PDF in the AWS about how to use the EMR including the EMR through the CLI.

HTH,


Carlos
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Simple and very illustrative video! Thanks Carlos ...
 
Consider Paul's rocket mass heater.
reply
    Bookmark Topic Watch Topic
  • New Topic