This week's book giveaway is in the OO, Patterns, UML and Refactoring forum.
We're giving away four copies of Refactoring for Software Design Smells: Managing Technical Debt and have Girish Suryanarayana, Ganesh Samarthyam & Tushar Sharma on-line!
See this thread for details.
The moose likes Hadoop and the fly likes Number of Reducers Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Number of Reducers" Watch "Number of Reducers" New topic
Author

Number of Reducers

Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Are there any limits to number of Reducers in Hadoop? and what are the best practice to design the mappers and reducers in Hadoop environments?

Regards,
Mohamed


Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com
Arun Vasu
Greenhorn

Joined: Oct 05, 2010
Posts: 24

The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki
Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
Arun Vasu wrote:The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki


Thanks Arun, I got it!
 
I’ve looked at a lot of different solutions, and in my humble opinion Aspose is the way to go. Here’s the link: http://aspose.com
 
subject: Number of Reducers
 
It's not a secret anymore!