Re: Is AWS Kinesis Kafka?

2014-11-17 Thread Joseph Lawson
...@gmail.com Sent: Thursday, November 13, 2014 6:28 PM To: users@kafka.apache.org Subject: Re: Is AWS Kinesis Kafka? Yeah the real question is really are the products built on top of Kafka (Kafka with a hat on). The last place I worked we ended up using Kinesis rather than Kafka basically for the

Re: Is AWS Kinesis Kafka?

2014-11-13 Thread Jagat Singh
Do you think things will change now , with Kafta makers setting up own company and will provide commercial support? On Fri, Nov 14, 2014 at 10:28 AM, cac...@gmail.com wrote: > Yeah the real question is really are the products built on top of Kafka > (Kafka with a hat on). The last place I worke

Re: Is AWS Kinesis Kafka?

2014-11-13 Thread cac...@gmail.com
Yeah the real question is really are the products built on top of Kafka (Kafka with a hat on). The last place I worked we ended up using Kinesis rather than Kafka basically for the reason Niek mentions, it seemed easier to accept the limitations and pay Amazon rather than run Kafka (small company <

Re: Is AWS Kinesis Kafka?

2014-11-13 Thread Niek Sanders
Many similarities. For Kinesis right now: * only a 1 day max retention * max 50KB message size * guaranteed throughput based on MB/sec in and out. * servers hosting the shards abstracted away by SaaS For collaborative consumption, Kinesis uses DynamoDB whereas Kafka uses Zookeeper. Until recent

Re: Is AWS Kinesis Kafka?

2014-11-13 Thread Joseph Lawson
: users@kafka.apache.org Subject: Re: Is AWS Kinesis Kafka? I've wondered that about Azure Event Hubs as well. They both use a different consumer offset tracking mechanism than the one in 0.8 for their higher level consumers. Christian On Thu, Nov 13, 2014 at 2:32 PM, Joseph Lawson wrote:

Re: Is AWS Kinesis Kafka?

2014-11-13 Thread cac...@gmail.com
I've wondered that about Azure Event Hubs as well. They both use a different consumer offset tracking mechanism than the one in 0.8 for their higher level consumers. Christian On Thu, Nov 13, 2014 at 2:32 PM, Joseph Lawson wrote: > Oh man they look similar. Any comments? >

Is AWS Kinesis Kafka?

2014-11-13 Thread Joseph Lawson
Oh man they look similar. Any comments?