Re: Fail fast a broker

What do you mean by "The issue appears when one of the brokers starts being impacted by environmental issues within the server it's running into (for whatever reason)"? You should consider Kafka to be a first tier service, it shouldn't be deployed on shared resources. There are a lot of opinions

Re: Pet Project - Web based consumer for Kafka

Is this tool similar to this: https://github.com/Landoop/kafka-topics-ui ? On Mon, Jan 8, 2018 at 7:09 AM Stephen P wrote: > Hello all! > > I've been working on a pet project over the last couple of months building > out a web based interface for consuming from Kafka

Re: what are common ways to convert info on a web site into a log entry?

You will need to find or create something to accomplish this. Topics in Kafka primarily act as queues. If you search the web for more information about "kafka connector http" you will find a few projects that do this. You could also take a look at the Confluent S3 Connector as an example of how

Re: Kafka on Windows

While I agree that it is less frustrating to run Kafka on Linux, I am interested to hear what specific issues you are running into on windows? On Tue, Aug 7, 2018 at 9:42 AM jan wrote: > This is an excellent suggestion and I intend to do so henceforth > (thanks!), but it would be an adjunct to

Re: Certification

https://www.confluent.io/certification/ On Fri, Aug 24, 2018 at 12:09 PM chinchu chinchu wrote: > Does any companies provide kafka certification ? >

Re: Is Kafka Streams right for me ?

Sameer when you say that you need to "consume from and produce to a topic" to me that seems like a good fit for Kafka Streams. Streaming your data out of Kafka for a transform and back in has some fundamental costs and operational challenges involved. Are the events in your stream stateless? If

Re: Is Kafka Streams right for me ?

d output stream. Basically the source of > this pipeline can be anything and the output can be anything to. > > On Tue, Mar 13, 2018 at 1:27 PM, Jacob Sheck <shec0...@gmail.com> wrote: > > > Sameer when you say that you need to "consume from and produce to a > topic&

Re: delivery semantics?

Your question seems to be confusing the producer and consumer responsibilities in message delivery durability. Neha from Confluent wrote a blog post about this which should help your understanding of the how the Kafka clients handle this.

Re: Closing a KafkaConsumer triggers a rebalance in KafkaConsumers subscribed to other topics. Is this the expected behavior?

I believe you have answered your own question. Having the system enforce which topics each consumer in a consumer group needs to consume messages from may be restricting, and possibly expensive. I have seen this brought up a few times and discussed it with a colleague. I am not clear as to what

Re: zookeeper connection issue

Does the container system used in your Rancher environment have persistence configured for the brokers? Are you are using ephemeral storage? On Thu, Jun 28, 2018 at 7:39 AM Karthick Kumar wrote: > Hi, > > I'm using Kafka cluster on three different servers, Recently my servers > went down when

Re: AVRO Schema with optional field ("type": "record")

"type" : "record", "name" : "Employee", "fields" : [ { "name" : "name", "type" : "string" }, { "name" : "employeeId", "type" : "lon

Re: AVRO Schema with optional field ("type": "record")

Can you use a union with null? This would be the IDL exmple. record RecordConfig { ... } union {null, RecordConfig} record = null; On Fri, Oct 19, 2018 at 2:44 PM Mina Aslani wrote: > Hi, > > I am adding AVRO schema to the kafka messages, however, I would like to > know how I can make a