• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Liutauras Vilda
  • Junilu Lacar
  • Jeanne Boyarsky
  • Bear Bibeault
Sheriffs:
  • Knute Snortum
  • Tim Cooke
  • Devaka Cooray
Saloon Keepers:
  • Ron McLeod
  • Stephan van Hulst
  • Tim Moores
  • Tim Holloway
  • Carey Brown
Bartenders:
  • Piet Souris
  • Frits Walraven
  • Ganesh Patekar

Retrieve Apache Spark Shell output from a VM onto a local Java Project

 
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm running a Spark Shell connected to a Kafka Broker that retrieves lines printed on it and periodically prints out the word count. This is a slightly modified version of the WordCount example posted at http://spark.apache.org/docs/latest/streaming-programming-guide.html#a-quick-example.

The Spark Shell and the Kafka Broker are running on a Hortonworks Sandbox(HDP 2.4) VM and I want to retrieve the output from the Spark Shell onto a Java Play Framework application's console output running locally on my Mac.

Is there any proper way to do this? Any help is really reallyyy appreciated.

My Code:
 
Paper jam tastes about as you would expect. Try some on this tiny ad:
Building a Better World in your Backyard by Paul Wheaton and Shawn Klassen-Koop
https://coderanch.com/wiki/718759/books/Building-World-Backyard-Paul-Wheaton
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!