• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Tim Cooke
  • Liutauras Vilda
  • Jeanne Boyarsky
  • paul wheaton
Sheriffs:
  • Ron McLeod
  • Devaka Cooray
  • Henry Wong
Saloon Keepers:
  • Tim Holloway
  • Stephan van Hulst
  • Carey Brown
  • Tim Moores
  • Mikalai Zaikin
Bartenders:
  • Frits Walraven

Which one of these is a more commonly accepted approach for hadoop cluster on cloud

 
Ranch Hand
Posts: 2951
13
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I have seen the below two approaches regarding hadoop cluster on cloud:

Approach 1: Create Virtual Machines on cloud depending on the number of nodes you want. On those nodes ,install hadoop and create a hadoop cluster. Keep these Virtual machines up and running and thus keep paying the cost continously.


Approach 2: Create a Unix script having all the commands from creating Virtual machines to creating the hadoop cluster. Run this script to create the virtual machines and then the hadoop cluster.Use cluster to do your processing. After your work is done, shut down the virtual machines and delete them. Next,time you have to do work, run the script which will create the virtual machines and cluster ,and then do your processing.And so on.

This approach is cheaper because,cluster will be up and running only when required .

Which of the above approaches is more commonly accepted in the industry ?thanks .
 
Doe, a deer, a female deer. Ray, a pockeful of sun. Me, a name, I call my tiny ad ...
Gift giving made easy with the permaculture playing cards
https://coderanch.com/t/777758/Gift-giving-easy-permaculture-playing
reply
    Bookmark Topic Watch Topic
  • New Topic