This week's book giveaway is in the OCAJP 8 forum. We're giving away four copies of OCA Java SE 8 Programmer I Study Guide and have Edward Finegan & Robert Liguori on-line! See this thread for details.
I am very new to Hadoop. I am trying to run few sample prog. in Standalone (or local) mode. I have installed Cygwin in my windows machine. I am trying to run the command “hadoop version” to verify whether hadoop installed successfully or not. I have downloaded hadoop-2.2.0 version.
I have downloaded hadoop : C:\Users\Pavan\Downloads\
I tried to setup the PATH variable in Cygwin as below
I am trying to run the command “hadoop version” and end up with the following error. Please help me in resolving this error.
$ hadoop version
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.util.VersionInfo
at java.security.AccessController.doPrivileged(Native Method)
Could not find the main class: org.apache.hadoop.util.VersionInfo. Program will exit.
Exception in thread "main"
If you are a complete beginner, I would strongly recommend you try one of the pre-configured Hadoop virtual machines (VMs) available from various suppliers. Hadoop is really horrible to install and configure, especially if you want to try using some of the related tools like Pig, Hive, etc. There are lots of compatibility problems between different versions of the various libraries, and it's generally a huge PITA to get working the first time you try it.
If your main goal is to learn how to install/administer Hadoop, then fine, install it yourself. But if your initial aim is to find out how to use Hadoop to do interesting things with Big Data, make life easy on yourself by using a pre-configured installation.
Cloudera has a Quickstart VM and Hortonworks has its developer sandbox. Both of these are Linux-based VMs with all the main Hadoop-related tools pre-installed and configured correctly, and the VMs can be downloaded for free (the files are pretty big) and run inside the (free) VirtualBox virtualisation environment.
Hortonworks sandbox comes with a lot of built-in tutorials and gives you a browser-based interface to upload files to HDFS, try out Hadoop processing with Pig, Hive etc.
Cloudera's VM is used as the basis for the free Udacity course Introduction to Hadoop and MapReduce, which is aimed at complete beginners and will take you through the basics of what Hadoop does. Choose the "free courseware" option when you sign up for the course.
No more Blub for me, thank you, Vicar.
danthuluri pavan kumar
Joined: Sep 25, 2008
Thanks all for you response. I recently found the below information and thought might be useful to other hadoop Enthusiasts.
As of the last release, Hadoop 2.2 supports Windows natively. Thus, old workarounds like Cygwin are now un-supported. Please refer to the new documentation mentioned below (and copied here) for latest instructions for Hadoop on Windows.