• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Ron McLeod
  • Paul Clapham
  • Bear Bibeault
  • Junilu Lacar
Sheriffs:
  • Jeanne Boyarsky
  • Tim Cooke
  • Henry Wong
Saloon Keepers:
  • Tim Moores
  • Stephan van Hulst
  • Tim Holloway
  • salvin francis
  • Frits Walraven
Bartenders:
  • Scott Selikoff
  • Piet Souris
  • Carey Brown

PIG - Is there online reference/shell?

 
Ranch Hand
Posts: 1609
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I am not able to understand the working of many pig operators like how they operate on data-set, is there any online material that discusses on this.
Also is there any place where I can create tuples/data-set and try running PIG commands/operators online?
 
Bartender
Posts: 1210
25
Android Python PHP C++ Java Linux
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Regarding trying out pig online, one option I can think of is Amazon's AWS EMR (Elastic Map Reduce). It's a pay-as-you-go web service.
There are public datasets available on their AWS S3 storage service, such as this one.

If you have never tried pig at all, then start off by running pig locally in a VM on your machine. Just download, extract and run in local mode with "pig -x local". Other than Java, nothing else is required (it already has hadoop embedded, so you don't even have to install hadoop in this mode).
Under the extracted directory, there's a /tutorial subdirectory with a simple dataset named excite.log. You can learn pig by trying it out on that dataset.

You can also find many CSV format datasets on the UCI ML Repository site.

 
Akhilesh Trivedi
Ranch Hand
Posts: 1609
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Thanks Karthik. I shall look at them.
 
My pie came with a little toothpic holding up this tiny ad:
Thread Boost feature
https://coderanch.com/t/674455/Thread-Boost-feature
    Bookmark Topic Watch Topic
  • New Topic