Win a copy of Java Challengers this week in the Java in General forum!
  • Post Reply Bookmark Topic Watch Topic
  • New Topic
programming forums Java Mobile Certification Databases Caching Books Engineering Micro Controllers OS Languages Paradigms IDEs Build Tools Frameworks Application Servers Open Source This Site Careers Other Pie Elite all forums
this forum made possible by our volunteer staff, including ...
Marshals:
  • Campbell Ritchie
  • Paul Clapham
  • Ron McLeod
  • paul wheaton
  • Devaka Cooray
Sheriffs:
  • Jeanne Boyarsky
  • Tim Cooke
  • Liutauras Vilda
Saloon Keepers:
  • Tim Moores
  • Tim Holloway
  • Stephan van Hulst
  • Carey Brown
  • Piet Souris
Bartenders:
  • salvin francis
  • Mikalai Zaikin
  • Himai Minh

Event Streams question: Use of Amazon Kinesis vs Kafka

 
Greenhorn
Posts: 25
Scala Spring Java
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator
Hello,

I spent some time and looked through the chapters (in Contents section and those available in abridged form).
I noticed you start from Kafka event stream processing and then proceed with Amazon Kinesis event stream processing.

Question: is Kinesis better platform than Kafka?

I guess the probable answer is - Kinesis is one of the AWS services and thus can easily
use the rich functionality of AWS as a whole, smooth, with no or minor integration efforts, such as:
- Amazon Redshift (used in Ch 10, Analytics-on-read)
- AWS Lambda and Dynamo DB for building Lambda functions  (Ch 11, Analytics-on-write)

Just trying to better understand a place / role for Kafka.

Thank you.
 
Author & Gold Digger
Posts: 7617
6
IntelliJ IDE Java
  • Likes 1
  • Mark post as helpful
  • send pies
    Number of slices to send:
    Optional 'thank-you' note:
  • Quote
  • Report post to moderator

Yury Nebieridze wrote:Question: is Kinesis better platform than Kafka?



The quick answer is: neither one is better, each has its pros and cons. For instance, one of the biggest difference is that Kafka provides eternal retention, while Kinesis (only) at most one week.

Kinesis is better connected to all the other AWS services, even though it is now possible to easily spin up a Kafka cluster in AWS using AWS Managed Streaming for Kafka instead of having to install a vanilla Kafka on EC2 all by yourself.

You can find plenty of good comparisons between both technologies, for instance http://cloudurable.com/blog/kinesis-vs-kafka/index.html
 
I don't even know how to spell CIA. But this tiny ad does:
Thread Boost feature
https://coderanch.com/t/674455/Thread-Boost-feature
reply
    Bookmark Topic Watch Topic
  • New Topic