Re: Kafka capabilities

2024-04-04 Thread Kafka Life
Dear Kafka experts , Could anyone having this data share the details please On Wed, Apr 3, 2024 at 3:42 PM Kafka Life wrote: > Hi Kafka users > > Does any one have a document or ppt that showcases the capabilities of > Kafka along with any cost management capability? > i have

Kafka capabilities

2024-04-03 Thread Kafka Life
Hi Kafka users Does any one have a document or ppt that showcases the capabilities of Kafka along with any cost management capability? i have a customer who is still using IBM MQM and rabbit MQ. I want the client to consider kafka for messaging and data streaming. I wanted to seek your expert

Consumer offset value -Apache kafka 3.2.3

2023-04-26 Thread Kafka Life
Dear Kafka Experts How can we check for a particular offset number in Apache kafka 3.2.3 version.Could you please share some light. The kafka_console_consumer tool is throwing class not found error. ./kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic your-topic --group

Re: Consumer Lag Metrics/ Topic level metrics

2023-04-26 Thread Kafka Life
r (https://github.com/danielqsj/kafka_exporter). > The consumer lag metrics come from the latter. > > I can then output the data in Grafana > > > Regards, > > Sam. > > > > On 25 Apr 2023, at 16:26, Kafka Life wrote: > > Dear Kafka Experts > > Coul

Consumer Lag Metrics/ Topic level metrics

2023-04-25 Thread Kafka Life
Dear Kafka Experts Could you please suggest good metrics exporter for consumer lag and topic level metrics apart from Linkedin kafka burrow for the kafka broker cluster.

Zookeeper upgrade 3.4.14 to 3.5.7

2023-04-12 Thread Kafka Life
Hi Kafka , zookeeper experts Is it possible to upgrade the 3.4.14 version of zookeeper cluster in a rolling fashion (one by one node) to 3.5.7 zookeeper version. Would the cluster work with a possible combination of 3.4.14 and 3.5.7 . Please advise .

Re: Kafka Metrics to Grafana Labs

2023-04-08 Thread Kafka Life
Any help from these experts ? On Sat, Apr 8, 2023 at 2:23 PM Kafka Life wrote: > Hello Kafka Experts > > Need a help . Currently the grafana agent > triggering kafka/3.2.3/config/kafka_metrics.yml is sending over 5 thousand > metrics. Is there a way to limit these many met

Kafka Metrics to Grafana Labs

2023-04-08 Thread Kafka Life
Hello Kafka Experts Need a help . Currently the grafana agent triggering kafka/3.2.3/config/kafka_metrics.yml is sending over 5 thousand metrics. Is there a way to limit these many metrics to be sent and send only what is required .Any pointers or such customized script is much

Re: Kafka (apache or confluent) - Subject of Work (SOW)

2023-04-06 Thread Kafka Life
Hi experts.. any pointers or guidance for this On Wed, Apr 5, 2023 at 8:35 PM Kafka Life wrote: > Respected Kafka experts/managers > > Do anyone have Subject of work -Activities related to Kafka cluster > management for Apache or Confluent kafka . Something to assess

Kafka (apache or confluent) - Subject of Work (SOW)

2023-04-05 Thread Kafka Life
Respected Kafka experts/managers Do anyone have Subject of work -Activities related to Kafka cluster management for Apache or Confluent kafka . Something to assess and propose to an enterprise for kafka cluster management. Request you to kindly share any such documentation please.

Re: Kafka Cluster WITHOUT Zookeeper

2023-03-28 Thread Kafka Life
per > <https://developer.confluent.io/learn/kraft/> > > developer.confluent.io <https://developer.confluent.io/learn/kraft/> > > > > > > QuickStart: > > Apache Kafka <https://kafka.apache.org/quickstart> > > kafka.apache.org <https://kafka.ap

Re: Apache Kafka version - End of support

2023-03-27 Thread Kafka Life
> Hope this helps, > > On Mon, Mar 27, 2023 at 12:44 PM Kafka Life > wrote: > > > > > > > > > > Hello Kafka experts > > > > > > where can i see the end of support for apache kafka versions? i would > > like > > >

Apache Kafka version - End of support

2023-03-27 Thread Kafka Life
> > > Hello Kafka experts > > where can i see the end of support for apache kafka versions? i would like > to know about 0.11 Kafka version on when was this deprecated >

Apache Kafka version - End of support

2023-03-27 Thread Kafka Life
Hello Kafka experts where can i see the end of support for apache kafka versions? i would like to know about 0.11 Kafka version on when was this deprecated

Kafka Cluster WITHOUT Zookeeper

2023-03-26 Thread Kafka Life
Hello Kafka experts Is there a way where we can have Kafka Cluster be functional serving producers and consumers without having Zookeeper cluster manage the instance . Any particular version of kafka for this or how can we achieve this please

Re: Consumer Lag-Apache_kafka_JMX metrics

2022-08-17 Thread Kafka Life
JMX. This is why tools like Burrow were written. The java kafka consumer > > published consumer lag metrics, and perhaps some other third-party > clients > > do, as well. > > > > > On Aug 16, 2022, at 12:05 PM, Kafka Life > wrote: > > > > > > Hello E

Re: Consumer Lag-Apache_kafka_JMX metrics

2022-08-16 Thread Kafka Life
Hello Experts, Any info or pointers on my query please. On Mon, Aug 15, 2022 at 11:36 PM Kafka Life wrote: > Dear Kafka Experts > we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0 > versions of kafka in Grafana. > > 1/ What is the correct path for JMX metr

Consumer Lag-Apache_kafka_JMX metrics

2022-08-15 Thread Kafka Life
Dear Kafka Experts we need to monitor the consumer lag in kafka clusters 2.5.1 and 2.8.0 versions of kafka in Grafana. 1/ What is the correct path for JMX metrics to evaluate Consumer Lag in kafka cluster. 2/ I had thought it is FetcherLag but it looks like it is not as per the link below.

Re: HACKING vulnerability is SpringBoot (Java) for apache kafka

2022-04-04 Thread Kafka Life
is very clear: > https://spring.io/blog/2022/03/31/spring-framework-rce-early-announcement > > Thank you. > Luke > > On Mon, Apr 4, 2022 at 3:32 PM Kafka Life wrote: > > > Hi Kafka Experts > > > > Regarding the recent threat of vulnerability in spring fram

HACKING vulnerability is SpringBoot (Java) for apache kafka

2022-04-04 Thread Kafka Life
Hi Kafka Experts Regarding the recent threat of vulnerability in spring framework , CVE-2022-22965 vulnerability is SpringBoot (Java) for apache kafka and Zookeeper. Could one of you suggest how Apache kafka and zk are impacted and what should be the ideal fix for this . Vulnerability in the

Re: KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

2022-02-27 Thread Kafka Life
Thank you Malcolm. Will go through this. On Sat, Feb 26, 2022 at 2:22 AM Malcolm McFarland wrote: > Maybe this could help? > https://github.com/dimas/kafka-reassign-tool > > Cheers, > Malcolm McFarland > Cavulus > > > On Fri, Feb 25, 2022 at 9:00 AM Kafka Life

Re: KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

2022-02-25 Thread Kafka Life
Dear Experts do you have any solution for this please On Tue, Feb 22, 2022 at 8:31 PM Kafka Life wrote: > Dear Kafka Experts > > Does anyone have a dynamically generated Json file based on the Under > replicated partition in the kafka cluster. > Everytime when the URP is increa

KAFKA- UNDER_REPLICATED_PARTIONS - AUTOMATE

2022-02-22 Thread Kafka Life
Dear Kafka Experts Does anyone have a dynamically generated Json file based on the Under replicated partition in the kafka cluster. Everytime when the URP is increased to over 500 , it is a tedious job to manually create a Json file . I request you to share any such dynamically generated script

Mirror Maker Issue : Huge difference in topic size on disk

2022-02-06 Thread Kafka Life
Dear Kafka Experts , Need your advice please I am running a mirror maker in kafka 2.8 to replicate a topic from kafka 0.11 instance. The size of each partition for a topic on 0.11 is always in 5 to 6 GB but the replicated topic in 2.8 instances is in 40 GB for the same partition. The topic

Kafka : High avaialability settings

2021-11-08 Thread Kafka Life
Dear Kafka experts i have a 10 broker kafka cluster with all topics having replication factor as 3 and partition 50 min.in.synch replicas is 2. One broker went down for a hardware failure, but many applications complained they are not able to produce /consume messages. I request you to please

Re: Automation Script : Kafka topic creation

2021-11-08 Thread Kafka Life
Thank you Men and Ran On Sat, Nov 6, 2021 at 7:23 PM Men Lim wrote: > I'm currently using Kafka-gitops. > > On Sat, Nov 6, 2021 at 3:35 AM Kafka Life wrote: > > > Dear Kafka experts > > > > does anyone have ready /automated script to create /delete /a

Automation Script : Kafka topic creation

2021-11-06 Thread Kafka Life
Dear Kafka experts does anyone have ready /automated script to create /delete /alter topics in different environments? taking Configuration parameter as input . if yes i request you to kindly share it with me .. please

Re: New Kafka Consumer : unknown member id

2021-11-05 Thread Kafka Life
hen googling this error message, it showed the error is in Kafka v0.9. > > Could you try to use the V3.0.0 and see if that issue still exist? > > Thank you. > Luke > > On Thu, Oct 28, 2021 at 11:15 PM Kafka Life > wrote: > > > Dear Kafka Experts > >

New Kafka Consumer : unknown member id

2021-10-28 Thread Kafka Life
Dear Kafka Experts We have set up a group.id (consumer ) = YYY But when tried to connect to kafka instance : i get this error message. I am sure this consumer (group id does not exist in kafka) .We user plain text protocol to connect to kafka 2.8.0. Please suggest how to resolve this issue.

Apache Kafka : start up scripts

2021-10-27 Thread Kafka Life
Dear Kafka experts when an broker is started using start script , could any of you please let me know the sequence of steps that happens in the back ground when the node UP like : when the script is initiated to start , 1/ is it checking indexes .. ? 2/ is it checking isr ? 3/ is URP being made

Re: Zookeeper : Throttling connections

2021-07-16 Thread Kafka Life
> that there is no more than globalOutstandingLimit outstanding requests in > the system. The default limit is 1,000. > > I hope this gets you started > > Feel free to reach out if you have additional questions > > Have a great day > > > On Fri, Jul 16, 2021 at 7:44

Zookeeper : Throttling connections

2021-07-16 Thread Kafka Life
Dear KAFKA & Zookeeper experts. 1/ What is zookeeper Throttling ? Is it done at zookeepr ? How is it set configured ? 2/ Is it helpful ?

consumer group exit :explanation

2021-07-04 Thread Kafka Life
Dear kafka Experts Could one of you please help to explain what this below log in broker instance mean..and what scenarios it would occur when there is no change done . INFO [GroupCoordinator 9610]: Member

Consumer Reporting error

2021-06-16 Thread Kafka Life
Hello Kafka experts The consumer team is reporting issue while consuming the data from the topic as Singularity Header issue. Can some one please tell on how to resolve this issue. Error looks like ; Starting offset: 1226716 offset: 1226716 position: 0 CreateTime: 1583780622665 isvalid: true

Re: Zookeeper issue : production

2021-06-09 Thread Kafka Life
Reddy wrote: > It’s better to mention which version you are using. > > > Hope the following link will help you. > https://www.programmersought.com/article/5376340/ > > > From: Kafka Life > Date: Wednesday, 9 June 2021 at 4:12 PM > To: users@kafka.apache.o

Zookeeper issue : production

2021-06-09 Thread Kafka Life
Dear Experts.. the zookeeper ensemble is creating issues in production.. zookeeper logs print as below.. can any one please suggest why this error occurs and wht is the solution for the same. - ERROR [CommitProcessor:1:NIOServerCnxn@178] - Unexpected Exception:

Re: Kafka : Version Upgrade

2021-06-08 Thread Kafka Life
B8-4E2AA1F9FDF2> On Tue, Jun 8, 2021 at 3:41 PM Luke Chen wrote: > Hi, > About the upgrade documentation, please read here: > https://kafka.apache.org/documentation/#upgrade > > It should answer your 2 questions. > > Thanks. > Luke > > On Tue, Jun 8, 2021 at 6:0

Kafka : Version Upgrade

2021-06-08 Thread Kafka Life
Dear Kafka Experts 1- Can any one share the upgrade plan with steps /Plan /tracker or any useful documentation please. 2- upgrading kafka from old version of 0.11 to 2.5 .Any suggestions/directions is highly appreciated. Thanks