Cost - Enterprise version of Apache Kafka, zookeeper

Hi, Please let me know the cost for procuring an enterprise Kafka and zookeeper . This is required for one of the projects. Thanks This e-mail and any attachment may contain confidential, proprietary or legally privileged information. If you are not the original intended recipient and have

Issues with Kafka with High Volume of Data

Hello, During my Internship at KLA Inc, we were using Kafka as a streaming platform. We were using it to transfer text and image data from a Linux Machine to a Windows machine. The data is in the form of discrete non serialized records that contain text and image data in the form of blobs. We

Error persisting into KeyValueStore

) at org.apache.kafka.streams.state.internals.MeteredKeyValueBytesStore.flush(MeteredKeyValueBytesStore.java:153) at org.apache.kafka.streams.processor.internals.ProcessorStateManager.flush(ProcessorStateManager.java:242) Thanks, Siva

Re: Kafka stream application load balancing

(1min) Regards, Ashok On Mon, Jul 30, 2018 at 12:27 PM, Guozhang Wang wrote: > Hello Siva, > > To better understand your situation, I'd need to ask a few more questions: > > 1) What triggers your REBALANCING event? > > 2) Does your application contain any states? If yes, how

Kafka stream application load balancing

INFO StreamStateListener22 - Stream application moved from RUNNING to REBALANCING 2018-07-29 05:54:14 INFO StreamStateListener22 - Stream application moved from REBALANCING to RUNNING Thanks, Siva

Kafka Streams throughput performance overtime

. Any suggestions on this to identify the delay and to increase the throughput would be of great help? We are on Kafka 1.0.0 Thanks Siva

Re: Kafka Mirrormaker issue

Any other update on this? On Mon, Mar 26, 2018, 7:42 PM Andrew Otto <o...@wikimedia.org> wrote: > I’ve had similar problems, but I don’t have an explanation for ya :/ > > On Sun, Mar 25, 2018 at 12:19 PM, Siva A <siva9940261...@gmail.com> wrote: > > > Hi, > &g

Kafka Mirrormaker issue

, the mirrormaker stops functioning(Doesn't mirror the data) but the process is still running. If we restart the service then it works fine for a day or so. I don't see any error on the Kafka logs as well. Is there anyone seen this kind of issue? Thanks Siva

Re: Consumer group intermittently can not read any records from a cluster with 3 nodes that has one node down

Hi Check the __consumer_offsets topics replication. If it's set to one that's the issue. Increase the replication of the topic. Thanks Siva On Feb 21, 2018 1:35 PM, "Sandor Murakozi" <smurak...@gmail.com> wrote: > hi Behrang, > I recommend you to check out some docs that

Re: Message throughput per day - Kafka

Thanks Sharat. Working with offsets is my last option. Checking if we have any other option available. Cheers, Siva On Tue, Feb 20, 2018 at 12:54 PM, Sharath Gururaj <e2718...@gmail.com> wrote: > There are no statistics on a per-day basis. Kafka exposes metrics for > producer th

Re: Message throughput per day - Kafka

Kafka clusters and enable all functionalities for clients to make use of it. Cheers, Siva On Tue, Feb 20, 2018 at 12:55 PM, Sharninder <sharnin...@gmail.com> wrote: > > > > > > > > I am wondering if there is way to get messages through put of Kafka > > > b

Re: Message throughput per day - Kafka

Guys, You have any details on queried ? Cheers, Siva On Fri, Feb 16, 2018 at 4:56 PM, siva prasad <sivaprasad@gmail.com> wrote: > Hey Guys, > > > I am wondering if there is way to get messages through put of Kafka > brokers. > > Ex: > 1) Number of messages se

Fwd: Message throughput per day - Kafka

replication. Ex: If a single message sent to a topic with replication factor of 3 then message count should be 1. These statistics will be helpful to business. -- Cheers, Siva

Re: Kafka Consumer Issue

Kafka version i am using is 0.10.0.1 On Thu, Jan 25, 2018 at 12:23 PM, Siva A <siva9940261...@gmail.com> wrote: > Hi All, > > I have a 3 node Kafka cluster. > I am trying to consume data from logstash(version 5.5.2) using the new > consumer API. > > When Kafka2 and Kaf

Kafka Consumer Issue

faced this kind of issue in any consumer(logstash or java or anything)? Thanks in advance. Thanks Siva