• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Bear Bibeault
  • Paul Clapham
  • Jeanne Boyarsky
  • Knute Snortum
Sheriffs:
  • Liutauras Vilda
  • Tim Cooke
  • Junilu Lacar
Saloon Keepers:
  • Ron McLeod
  • Stephan van Hulst
  • Tim Moores
  • Tim Holloway
  • Carey Brown
Bartenders:
  • Joe Ess
  • salvin francis
  • fred rosenberger

Hadoop and Python

 
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Alex,

Currently, I am using python for some projects, and I am wondering if Python has its coverage part in your contents. Do you think using Hadoop with Python a good match?

Regards,
Mohamed
 
Author
Posts: 21
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Alex Holmes wrote:Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex



I got it thanks. actually after I asked you the question, I searched google and found 'boto', an API that enable me to invoke the job workflow and mappers/reducers scripts ... it is wonderful and easy to use!

Regards,
Mohamed
 
You would be much easier to understand if you took that bucket off of your head. And that goes for the tiny ad too!
Java file APIs (DOC, XLS, PDF, and many more)
https://products.aspose.com/total/java
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!