File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop and multicore

 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
is there a tuning parameters or configurations for Hadoop to utilize the underlying hardware capabilities (like multicore, processing threading etc ) or it is totally agnostic and abstracted from the underlying hardware?

Regards,
Mohamed
 
Srinath Hperera
author
Greenhorn
Posts: 3
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
You can control the number of tasks per task tracker via mapred.tasktracker.map.tasks.maximum property and mapred.tasktracker.reduce.tasks.maximum . If your machines has more core, you can give a happy number. Recommendation is to give number between 1XCores and 2XCores.
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks a lot Srinath!
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic