aspose file tools
The moose likes Hadoop and the fly likes Number of Reducers Big Moose Saloon
  Search | Java FAQ | Recent Topics
Register / Login


Win a copy of The Mikado Method this week in the Agile and other Processes forum!
JavaRanch » Java Forums » Databases » Hadoop
Reply Bookmark "Number of Reducers" Watch "Number of Reducers" New topic
Author

Number of Reducers

Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
posted private message
0
Quote
Are there any limits to number of Reducers in Hadoop? and what are the best practice to design the mappers and reducers in Hadoop environments?

Regards,
Mohamed

Best Regards, Mohamed El-Refaey
www.egyptcloudforum.com
Arun Vasu
Greenhorn

Joined: Oct 05, 2010
Posts: 22

I like...
Android Java MyEclipse IDE
posted private message
0
Quote
The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki
Mohamed El-Refaey
Ranch Hand

Joined: Dec 08, 2009
Posts: 119
posted private message
0
Quote
Arun Vasu wrote:The best practise is to keep the number of redulers slightly less than the number of available reduce slots in your cluster.
Get more info from Hadoop wiki


Thanks Arun, I got it!
 
I agree. Here's the link: http://ej-technologies/jprofiler - if it wasn't for jprofiler, we would need to run our stuff on 16 servers instead of 3.
 
subject: Number of Reducers
 
Similar Threads
Beyond Hello World
What is the best way to access final result?
setting number of reducers in the map reduce jobs converted from PIG script
Hadoop MapReduce
How I can retrive 40 million records from Database?