File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
The moose likes Hadoop and the fly likes Algorithms not suited for mapreduce Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login


Win a copy of EJB 3 in Action this week in the EJB and other Java EE Technologies forum!
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Algorithms not suited for mapreduce" Watch "Algorithms not suited for mapreduce" New topic
Author

Algorithms not suited for mapreduce

andre mantei
Greenhorn

Joined: Sep 12, 2013
Posts: 5
Hi there,

I would like to know a few algorithms that are not well suited for mapreduce and why they are not suited. I read, that svm is one of those algorithms but I don't know why.

Greetings, Andre
chris webster
Bartender

Joined: Mar 01, 2009
Posts: 1476
    
  11

Not sure about specific algorithms, but map-reduce is probably most useful when you can run the map tasks independently in parallel. But if each task depends on output from another task, then you can't run them in parallel. So it will depend on how far you can break your job up into these parallel tasks or successive map-reduce steps. But you could explore ways to use higher-level tools - Hive, Cascading etc - which might allow you to define your task at a higher level and let the tools work out how to map-reduce it.


No more Blub for me, thank you, Vicar.
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Algorithms not suited for mapreduce
 
Similar Threads
Hadoop and distributed transactional cache
new in hadoop
What is the best way to access final result?
Why MapReduce algorithm is considered a "Google invention"?
Implementation language for Google search engine?