This week's book giveaway is in the Servlets forum.
We're giving away four copies of Murach's Java Servlets and JSP and have Joel Murach on-line!
See this thread for details.
The moose likes Hadoop and the fly likes Hadoop and multicore Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of Murach's Java Servlets and JSP this week in the Servlets forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Hadoop and multicore" Watch "Hadoop and multicore" New topic

Hadoop and multicore

Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
is there a tuning parameters or configurations for Hadoop to utilize the underlying hardware capabilities (like multicore, processing threading etc ) or it is totally agnostic and abstracted from the underlying hardware?


Best Regards, Mohamed El-Refaey
Srinath Hperera

Joined: Mar 19, 2013
Posts: 3
You can control the number of tasks per task tracker via property and mapred.tasktracker.reduce.tasks.maximum . If your machines has more core, you can give a happy number. Recommendation is to give number between 1XCores and 2XCores.
Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Thanks a lot Srinath!
subject: Hadoop and multicore
Similar Threads
Integrating Erlang with other languages
JBoss In Action - JBoss multicore scalability
parallelism in a for loop and using java 5 concurrency
WA #1.....word association
Many Threads