Win a copy of Spark in Action this week in the Open Source Projects forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Bear Bibeault
  • Ron McLeod
  • Jeanne Boyarsky
  • Paul Clapham
Sheriffs:
  • Tim Cooke
  • Liutauras Vilda
  • Junilu Lacar
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Tim Holloway
  • fred rosenberger
  • salvin francis
Bartenders:
  • Piet Souris
  • Frits Walraven
  • Carey Brown

EMR and Hadoop

 
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi,
is there any area of the book that talks about Amazon EMR and Hadoop?

Regards,
Mohamed
 
author
Posts: 2
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Mohamed,
Cloud Deployments: Using Hadoop on Cloud (Chapter 10) of Hadoop MapReduce Cookbook talks about using EMR for Hadoop/Pig/Hive/HBase computations. It also talks about using Apache Whirr to deploy your own Hadoop or HBase cluster on EC2. You can find an extract of that chapter in the following DZone article. http://architects.dzone.com/articles/cloud-deployments-using-hadoop

thanks,
Thilina
 
author
Posts: 15
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I also talk about EMR in the Hadoop Beginners Guide, particularly in the earlier chapters where there are examples of running code on a local cluster then doing the same on EMR.

My later chapters on topics such as cluster management, Sqoop and Flume don't really touch on EMR so if that is your interest look elsewhere.

Garry
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Ohh wonderful guys thanks for the references ! So the two books are covering it ...

Regards,
Mohamed
 
Ranch Hand
Posts: 221
Scala Python Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
You can also watch this video about how to use it.

http://youtu.be/kNsS9aDf6uE


There is also an extensive PDF in the AWS about how to use the EMR including the EMR through the CLI.

HTH,


Carlos
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Simple and very illustrative video! Thanks Carlos ...
 
Don't get me started about those stupid light bulbs.
    Bookmark Topic Watch Topic
  • New Topic