Hadoop and Python

Hi Alex,

Currently, I am using python for some projects, and I am wondering if Python has its coverage part in your contents. Do you think using Hadoop with Python a good match?

Regards,
Mohamed

Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex

Alex Holmes wrote:Hi Mohamed,

The "Hadoop in Action" book covers streaming, which is how you'd integrate Python with MapReduce. This is actually a pretty common usage of Hadoop, and is a good way for Python programmers to work with Hadoop. Other tools worth considering would be Pig and Hive, which would be higher-level ways to work with Hadoop.

Thanks,
Alex

I got it thanks. actually after I asked you the question, I searched google and found 'boto', an API that enable me to invoke the job workflow and mappers/reducers scripts ... it is wonderful and easy to use!

Regards,
Mohamed