Granny's Programming Pearls
"inside of every large program is a small program struggling to get out"
JavaRanch.com/granny.jsp
The moose likes Distributed Java and the fly likes Map-Reduce Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of OCA/OCP Java SE 7 Programmer I & II Study Guide this week in the OCPJP forum!
JavaRanch » Java Forums » Java » Distributed Java
Bookmark "Map-Reduce" Watch "Map-Reduce" New topic
Author

Map-Reduce

Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132

Hi,

Can someone explain what is the concept behind Map-Reduce mechanism? I have heard that Google uses this as the base of distributing the load across servers.


Yohan Liyanage
http://blog.yohanliyanage.com
Garrett Rowe
Ranch Hand

Joined: Jan 17, 2006
Posts: 1296
Here is a whitepaper they wrote on the topic. I believe the example in the paper are in Haskell, but for the most part its easy enough to follow.

And here is a critique of the google paper thats an interesting read. I know those examples are in Haskell, but again I think Haskell is easy enough to pick up.

If you have any specific questions post back, I think this a rather interesting topic. It certainly shows how functional languages, or a functional programming model, have some real-world value.


Some problems are so complex that you have to be highly intelligent and well informed just to be undecided about them. - Laurence J. Peter
Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132

Thanks Garrett!
Yohan Liyanage
Ranch Hand

Joined: Aug 17, 2007
Posts: 132

What are the alternatives for Map-Reduce, which can be employed for same purpose of data/computation distribution?
William Brogden
Author and all-around good cowpoke
Rancher

Joined: Mar 22, 2000
Posts: 12809
    
    5
Data and computation distribution - sometimes referred to as "Grid" computing - is a HUGE area with lots of interest right now.

I wrote this article in an attempt to summarize the field.

Bill
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Map-Reduce