Excited to see your upcoming book on latest sensation in enterprise technology area.
I attended an overview session on Kafka recently and I have couple of questions on which I want to request your opinion -
How do you differentiate the traditional Enterprise service buses with ETL combined with Kafka. As an introduction, Kafka is doing real time fast processing of streams but we have other systems like Tibco FTL and IBM MQ which have achieved lightening speed of millions transactions per second. How does kafka provides upper-hand with existing products ?
Another question is do you think that kafka will be able to replace existing batch systems. With scenarios with high availability , kafka may process transactional data quickly but overnight batch may still become bottle neck. What are the few practices you want to share with audiences here about integrating kafka with exiting systems.
Thank You again for bringing the detailed book.
SCJP SCWCD AIX SOA AWS GA
The significant problems we face cannot be solved by the same level of thinking that created them -- Albert Einstein
Tim Holloway wrote:I just installed the latest version of Hitachi Pentaho.
You may be interested to know that the Pentaho DI engine (Kettle) now runs under Kafka.
Pentaho DI does run Kafka out of the box, but it's far from perfect (It really only works for generic AVRO messages + it doesn't have Kerberos support). I had to write my own custom step to successfully solve the requirements we had in our project.
You showed up just in time for the waffles! And this tiny ad:
Building a Better World in your Backyard by Paul Wheaton and Shawn Klassen-Koop