File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
Win a copy of Clojure in Action this week in the Clojure forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Hadoop Open Source alternatives

 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
May I ask what are the alternatives in the open source community for Hadoop, and if you encourage to use any of them either in addition to hadoop or in replacement to it in some cases and situations?

Regards,
Mohamed El-Refaey
 
Azana Baksh
Greenhorn
Posts: 2
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Mohamed, as an alternative to Hadoop, take a look at the HPCC Systems platform. Designed by data scientists, it provides for a single architecture, a consistent data-centric programming language (ECL), and two data processing clusters. Their built-in analytics libraries for Machine Learning and BI integration provide a complete integrated solution from data ingestion and data processing to data delivery. This all in one platform means only one thing to support and from a significant lower number of resources. In contrast, the complexity of the Hadoop ecosystem requires a huge investment in technology and resources up front and throughout. The inherent parallelism and data flow nature of the ECL language removes the worry about trying to parallelize my jobs, as was the case in my experience with Hadoop MapReduce. In fact, I have to say ECL is somewhat similar to SQL from the perspective both are declarative data programming languages. So if you are a good SQL developer, ECL should be a breeze to understand and use. More at http://hpccsystems.com. HPCC also has a connector for Hadoop data. In fact, a webhdfs implementation, (web based API provided by Hadoop) was recently released. Specific info at http://hpccsystems.com/h2h
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks Azana. It looks that HPCC worth to look at ...

Regards,
Mohamed
 
Garry Turkington
author
Greenhorn
Posts: 15
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Another interesting project is Storm -- often viewed as an alternative but there's a compelling argument that it can be effectively used as a streaming front-end to Hadoop.

http://stormproject.org
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks Garry. The link is not working, I think this is the correct link: http://storm-project.net/

Regards,
Mohamed
 
Azana Baksh
Greenhorn
Posts: 2
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Sure Mohamed. There is free online training for learning ECL and an overview of HPCC for anyone wanting to take a further look: http://hpccsystems.com/community/training-events/training
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • 0
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Interesting training. Thanks for sharing!
 
I agree. Here's the link: http://aspose.com/file-tools
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic