Two Laptop Bag*
The moose likes Java in General and the fly likes Why MapReduce algorithm is considered a Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of EJB 3 in Action this week in the EJB and other Java EE Technologies forum!
JavaRanch » Java Forums » Java » Java in General
Bookmark "Why MapReduce algorithm is considered a "Google invention"? " Watch "Why MapReduce algorithm is considered a "Google invention"? " New topic
Author

Why MapReduce algorithm is considered a "Google invention"?

Hussein Baghdadi
clojure forum advocate
Bartender

Joined: Nov 08, 2003
Posts: 3476

Hey,
Map and reduce functions are old, well know in Functional programming languages.
Why MapReduce algorithm is considered a "Google invention"?
Did they introduce anything new in it?
Thanks.
David Newton
Author
Rancher

Joined: Sep 29, 2008
Posts: 12617

It's not considered a Google invention. MapReduce (note no spaces and camel-casing), on the other hand, *is* a Google framework. The wikipedia article sums it up nicely.
David Newton
Author
Rancher

Joined: Sep 29, 2008
Posts: 12617

I'm not sure I'm happy with my statement saying people don't consider it a google invention: clearly map and reduce have been around for a *long* time... But MapReduce really isn't just map and reduce concatenated.

The following paper might help you to understand:

http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.104.5859&rep=rep1&type=pdf
Chuck Lam
author
Greenhorn

Joined: Aug 09, 2010
Posts: 12
The word "invention" is a bit loaded so I'll sidestep it a little bit. Certainly the concept of map and reduce functions have been around for a long time, but MapReduce is a new framework for processing data sets in a scalable way. It's not just putting map and reduce function together.

Similarly you can argue that Google did not invent link analysis, but that misses the point. Their PageRank algorithm had applied link analysis in a scalable way to a new problem domain (Web) that it certainly stands on its own as a useful invention.
Tibi Kiss
Ranch Hand

Joined: Jun 11, 2009
Posts: 47
Some developmental psychology researcher even 30 years ago were mentioned the fact that a kind of map and reduce (very similar to MapReduce) decomposition take place naturally while the human mind is thinking. (of course this is a short summary only). Therefore childrens learning to think in a more map-reduce way to solve problems, are getting much more creative.
If this is so, then my conclusion is that we have to expect a huge move forward to the success of MapReduce itself... because it's a natural approach to many problems.
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Why MapReduce algorithm is considered a "Google invention"?
 
Similar Threads
Hadoop and distributed transactional cache
why functional languages? (here's why)
MapReduce model used in Hadoop & google
Implementation language for Google search engine?
WA #1.....word association