wood burning stoves 2.0*
The moose likes Distributed Java and the fly likes Map-Reduce Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login

Win a copy of The Java EE 7 Tutorial Volume 1 or Volume 2 this week in the Java EE forum
or jQuery UI in Action in the JavaScript forum!
JavaRanch » Java Forums » Java » Distributed Java
Bookmark "Map-Reduce" Watch "Map-Reduce" New topic


Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132


Can someone explain what is the concept behind Map-Reduce mechanism? I have heard that Google uses this as the base of distributing the load across servers.

Yohan Liyanage
Garrett Rowe
Ranch Hand

Joined: Jan 17, 2006
Posts: 1296
Here is a whitepaper they wrote on the topic. I believe the example in the paper are in Haskell, but for the most part its easy enough to follow.

And here is a critique of the google paper thats an interesting read. I know those examples are in Haskell, but again I think Haskell is easy enough to pick up.

If you have any specific questions post back, I think this a rather interesting topic. It certainly shows how functional languages, or a functional programming model, have some real-world value.

Some problems are so complex that you have to be highly intelligent and well informed just to be undecided about them. - Laurence J. Peter
Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132

Thanks Garrett!
Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132

What are the alternatives for Map-Reduce, which can be employed for same purpose of data/computation distribution?
William Brogden
Author and all-around good cowpoke

Joined: Mar 22, 2000
Posts: 12769
Data and computation distribution - sometimes referred to as "Grid" computing - is a HUGE area with lots of interest right now.

I wrote this article in an attempt to summarize the field.

I agree. Here's the link: http://aspose.com/file-tools
subject: Map-Reduce