File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
The moose likes Hadoop and the fly likes Setting up multiple clusters Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Databases » Hadoop
Bookmark "Setting up multiple clusters" Watch "Setting up multiple clusters" New topic
Author

Setting up multiple clusters

Andrew Martin
Greenhorn

Joined: Aug 04, 2013
Posts: 3
Hi all,

I've followed Michael Noll's excellent guide to get Hadoop set up on a single cluster: http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/

I'd now like to get a second node set up to do some processing. In this guide, and all others I've seen, these other clusters are all on the same LAN. However, I am doing my project using a Virtual Machine that I was given by my university that I access using PuTTY by connecting to its IP address. Can I connect this machine, across Hadoop, to a different machine on an entirely different IP address? Is this even possible? I tried editing the /etc/hosts of both computers and storing the IP address like this:

117.118.45.205:127.0.0.1 localhost

With the real IP address first, then the "local" IP address after, but that didn't work. Does anybody have any suggestions, or is this simply not possible?
 
 
subject: Setting up multiple clusters