• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Tim Cooke
  • Liutauras Vilda
  • Jeanne Boyarsky
  • paul wheaton
Sheriffs:
  • Ron McLeod
  • Devaka Cooray
  • Henry Wong
Saloon Keepers:
  • Tim Holloway
  • Stephan van Hulst
  • Carey Brown
  • Tim Moores
  • Mikalai Zaikin
Bartenders:
  • Frits Walraven

Does any big data technology belong to hadoop ecosystem if it uses hdfs?

 
Ranch Hand
Posts: 2949
13
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hadoop ecosystem comprises of technologies like hdfs, map reduce , hbase ,hive etc . It also has technologies such as mahoot ,oozie ,impala,zookeeper.

How are big data technologies classified into belonging to hadoop ecosystem or not ? I can see one common factor that map reduce ,hive and hbase all use hdfs .Does that mean whichever big data technology uses hdfs comes under hadoop ecosystem ?
 
Ranch Hand
Posts: 45
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Both the words Hadoop ecosystem and Big data Technologies are quite interlinked and depend on each other for existence !

Theoretically, as you mentioned Hadoop ecosystem is an environment comprising of all technologies used in it, its a package all together like HDFS is way of how file can be stored, different than map-reduce which is how the processing can be done, and hive for query to HDFS and so on......

Big Data technology is anything that can store, retrieve and process volumetric data in speed, so at the moment Hadoop ecosystem is what can do it and thereby two are used interchangeably !  In future you may have some technology not Hadoop ecosystem which can deal with volumes of data then that would come under Big data although not Hadoop !!
 
Monica Shiralkar
Ranch Hand
Posts: 2949
13
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

mayank jamindar wrote:Both the words Hadoop ecosystem and Big data Technologies are quite interlinked and depend on each other for existence !

Theoretically, as you mentioned Hadoop ecosystem is an environment comprising of all technologies used in it, its a package all together like HDFS is way of how file can be stored, different than map-reduce which is how the processing can be done, and hive for query to HDFS and so on......

Big Data technology is anything that can store, retrieve and process volumetric data in speed, so at the moment Hadoop ecosystem is what can do it and thereby two are used interchangeably !  In future you may have some technology not Hadoop ecosystem which can deal with volumes of data then that would come under Big data although not Hadoop !!


Thanks.
And What is the criteria for classifying whether any technology is under hadoop ecosystem.?

E.g Spark does not come under Hadoop.
Hbase comes under hadoop, so does  mahoot,kafka etc.

Is the criteria that if a technology uses HDFS then it comes under hadoop ?
 
Don't play dumb with me! But you can try this tiny ad:
Gift giving made easy with the permaculture playing cards
https://coderanch.com/t/777758/Gift-giving-easy-permaculture-playing
reply
    Bookmark Topic Watch Topic
  • New Topic