Re: Http Kafka producer

2015-08-27 Thread Helleren, Erik
[mailto:e...@confluent.io] Sent: Thursday, August 27, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have control over the format of the request bodies that reach HAProxy or not? If you do

Re: Http Kafka producer

2015-08-27 Thread Ewen Cheslack-Postava
- From: Ewen Cheslack-Postava [mailto:e...@confluent.io] Sent: Thursday, August 27, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have control over the format of the request bodies

Http Kafka producer

2015-08-26 Thread Hemanth Abbina
Hi, Our application receives events through a HAProxy server on HTTPs, which should be forwarded and stored to Kafka cluster. What should be the best option for this ? This layer should receive events from HAProxy produce them to Kafka cluster, in a reliable and efficient way (and should

Re: Http Kafka producer

2015-08-26 Thread Marc Bollinger
I'm actually also really interested in this...I had a chat about this on the distributed systems slack's http://dist-sys.slack.com Kafka channel a few days ago, but we're not much further than griping about the problem. We're basically migrating an existing event system, one which packed messages

RE: Http Kafka producer

2015-08-26 Thread Hemanth Abbina
] Sent: Thursday, August 27, 2015 4:39 AM To: users@kafka.apache.org Cc: dev-subscr...@kafka.apache.org Subject: Re: Http Kafka producer I'm actually also really interested in this...I had a chat about this on the distributed systems slack's http://dist-sys.slack.com Kafka channel a few days ago

Re: Http Kafka producer

2015-08-26 Thread Marc Bollinger
[mailto:e...@confluent.io] Sent: Thursday, August 27, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have control over the format of the request bodies that reach HAProxy or not? If you do

RE: Http Kafka producer

2015-08-26 Thread Hemanth Abbina
proxy, without using schema registry ? --regards Hemanth -Original Message- From: Ewen Cheslack-Postava [mailto:e...@confluent.io] Sent: Thursday, August 27, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about

Re: Http Kafka producer

2015-08-26 Thread Ewen Cheslack-Postava
-Original Message- From: Marc Bollinger [mailto:m...@lumoslabs.com] Sent: Thursday, August 27, 2015 4:39 AM To: users@kafka.apache.org Cc: dev-subscr...@kafka.apache.org Subject: Re: Http Kafka producer I'm actually also really interested in this...I had a chat about this on the distributed

RE: Http Kafka producer

2015-08-26 Thread Hemanth Abbina
, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have control over the format of the request bodies that reach HAProxy or not? If you do, Confluent's REST proxy should work fine and does not require

Re: Http Kafka producer

2015-08-26 Thread Ewen Cheslack-Postava
schema registry ? --regards Hemanth -Original Message- From: Ewen Cheslack-Postava [mailto:e...@confluent.io] Sent: Thursday, August 27, 2015 9:14 AM To: users@kafka.apache.org Subject: Re: Http Kafka producer Hemanth, Can you be a bit more specific about your setup? Do you have