• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Tim Cooke
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • Liutauras Vilda
Sheriffs:
  • Jeanne Boyarsky
  • Rob Spoor
  • Bear Bibeault
Saloon Keepers:
  • Jesse Silverman
  • Tim Moores
  • Stephan van Hulst
  • Tim Holloway
  • Carey Brown
Bartenders:
  • Piet Souris
  • Al Hobbs
  • salvin francis

Should the Cloud Virtual Machines with Hadoop cluster be stopped after use or deleted and created

 
Ranch Hand
Posts: 2550
13
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
I have created a Hadoop cluster with 3 nodes. When the cluster is not in use (no hadoop or spark jobs running) , there are 3 ways. Keep the Virtual machines running all the time which will be and expensive option or shut down the Virtual Machines when not being used or to delete the virtual machines and create new machines and setup the cluster each time. The first option is the most expensive while the last one is cheapest one but difficult one. What is the recommended way?
thanks
 
Greenhorn
Posts: 23
2
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Thanks for posting a question for something I am currently taking a class on. Ha ha.  I think this person explains things better than I can.  See below link.  

https://read.acloud.guru/there-are-four-reasons-to-explain-how-using-aws-can-change-the-economic-model-of-the-it-services-850dcc8ea1aa

Also, here is an article from Amazon that seems to answer almost exactly what you are asking.

https://aws.amazon.com/emr/features/hadoop/
 
Monica Shiralkar
Ranch Hand
Posts: 2550
13
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Matthew Keller wrote:
Also, here is an article from Amazon that seems to answer almost exactly what you are asking.

https://aws.amazon.com/emr/features/hadoop/



This talks about EMR , the managed service (PaaS). My question instead was on creating own cluster (IaaS - over EC2 machines).
reply
    Bookmark Topic Watch Topic
  • New Topic