my dog learned polymorphism*
The moose likes Hadoop and the fly likes Hadoop and multicore Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of Android Security Essentials Live Lessons this week in the Android forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop and multicore" Watch "Hadoop and multicore" New topic
Author

Hadoop and multicore

Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
is there a tuning parameters or configurations for Hadoop to utilize the underlying hardware capabilities (like multicore, processing threading etc ) or it is totally agnostic and abstracted from the underlying hardware?

Regards,
Mohamed


Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com
Srinath Hperera
author
Greenhorn

Joined: Mar 19, 2013
Posts: 3
You can control the number of tasks per task tracker via mapred.tasktracker.map.tasks.maximum property and mapred.tasktracker.reduce.tasks.maximum . If your machines has more core, you can give a happy number. Recommendation is to give number between 1XCores and 2XCores.
Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Thanks a lot Srinath!
 
It is sorta covered in the JavaRanch Style Guide.
 
subject: Hadoop and multicore
 
Similar Threads
parallelism in a for loop and using java 5 concurrency
JBoss In Action - JBoss multicore scalability
WA #1.....word association
Integrating Erlang with other languages
Many Threads