• Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Liutauras Vilda
  • Jeanne Boyarsky
  • Devaka Cooray
  • Paul Clapham
Sheriffs:
  • Tim Cooke
  • Knute Snortum
  • Bear Bibeault
Saloon Keepers:
  • Ron McLeod
  • Tim Moores
  • Stephan van Hulst
  • Piet Souris
  • Ganesh Patekar
Bartenders:
  • Frits Walraven
  • Carey Brown
  • Tim Holloway

Retrieve Apache Spark Shell output from a VM onto a local Java Project

 
Greenhorn
Posts: 1
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
I'm running a Spark Shell connected to a Kafka Broker that retrieves lines printed on it and periodically prints out the word count. This is a slightly modified version of the WordCount example posted at http://spark.apache.org/docs/latest/streaming-programming-guide.html#a-quick-example.

The Spark Shell and the Kafka Broker are running on a Hortonworks Sandbox(HDP 2.4) VM and I want to retrieve the output from the Spark Shell onto a Java Play Framework application's console output running locally on my Mac.

Is there any proper way to do this? Any help is really reallyyy appreciated.

My Code:
 
With a little knowledge, a cast iron skillet is non-stick and lasts a lifetime.
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
Boost this thread!