Win a copy of Svelte and Sapper in Action this week in the JavaScript forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Ron McLeod
  • Paul Clapham
  • Bear Bibeault
  • Junilu Lacar
Sheriffs:
  • Jeanne Boyarsky
  • Tim Cooke
  • Henry Wong
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Tim Holloway
  • salvin francis
  • Frits Walraven
Bartenders:
  • Scott Selikoff
  • Piet Souris
  • Carey Brown

Hadoop Clustering on Single machine

 
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Can I install a Hadoop cluster on a single machine? and How I can try its scalability features?

Regards,
Mohamed
 
Greenhorn
Posts: 24
Android MyEclipse IDE Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Yes, you can try a cluster on single machine. The good way to try out this is by using virtual machines.
I have tried it with VM of Centos O/S. The configuration I tried on my Windows 7 system is

Hardware: 4 gb ram @ 1600mhz, Interl i5 processor and 5400 prm hdd.

Software: Cloudera cdhv3, VMWare player v5, the virtual machine files for Centos O/S

Hadoop configuration: One Master node( Holds namenode, secondary name node and jobtracker), Three slave nodes (runs datanode and tasktracker on each)

This set up will help you to learn all the aspects of Hadoop technology.

Share if you find any difficuilties to try out it, am happy to help you!
 
Mohamed El-Refaey
Ranch Hand
Posts: 119
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator

Arun Vasu wrote:Yes, you can try a cluster on single machine. The good way to try out this is by using virtual machines.
I have tried it with VM of Centos O/S. The configuration I tried on my Windows 7 system is

Hardware: 4 gb ram @ 1600mhz, Interl i5 processor and 5400 prm hdd.

Software: Cloudera cdhv3, VMWare player v5, the virtual machine files for Centos O/S

Hadoop configuration: One Master node( Holds namenode, secondary name node and jobtracker), Three slave nodes (runs datanode and tasktracker on each)

This set up will help you to learn all the aspects of Hadoop technology.

Share if you find any difficuilties to try out it, am happy to help you!



Thank you for sharing this, did you face any difficulties in network configurations for this cluster of VMs?
 
Arun Vasu
Greenhorn
Posts: 24
Android MyEclipse IDE Java
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Make sure you have given proper entries in /etc/hosts file in the form of "ip address<tab>host_name".
Edit /etc/sysconfig/network and change the HOSTNAME= line to reflect your machine’s name. And your machine has an internet connection.

These are the only necessary network configuration you needs.
 
Today you are you, that is turer than true. There is no one alive who is youer than you! - Seuss. Tiny ad:
the value of filler advertising in 2020
https://coderanch.com/t/730886/filler-advertising
    Bookmark Topic Watch Topic
  • New Topic