How to measure/monitor lag for Mirror Maker 2

What is the best way to monitor the lag for Mirror Maker 2? so that I can know if I need to add more nodes to the Mirror Maker 2 if it is falling behind.

RE: [EXTERNAL] Re: Security vulnerabilities in kafka:2.13-2.6.0/2.7.0 docker image

Hi Team I tried upgrading it to 2.13_2.8.0 but still have these vulnerabilities. [cid:image003.jpg@01D79F3D.5BA06A20] What is your suggestion on this? Thanks Ashish From: Jake Murphy Smith Sent: 01 September 2021 09:31 To: Ashish Patil Subject: RE: [EXTERNAL] Re: Security vulnerabilities

Security vulnerabilities in kafka:2.13-2.6.0/2.7.0 docker image

we have any plan to fix this in the coming version or any suggestions around this? Thanks Ashish

Latency requirements for Kafka connect workers

. Regards Ashish

Re: Using encrypted distributed worker file

Hi Team, Any help would be greatly appreciated. I am looking forward to a way where I can store the passwords in encrypted/hashed format on the distributed worker properties file. Regards Ashish Sood On Tue, Jun 2, 2020 at 12:42 AM ashish sood wrote: > Hi All, > > I am running a di

Basic Auth validation for Kafka Connect REST Interface - credentials caching

* KafkaConnect { org.apache.kafka.connect.rest.basic.auth.extension.PropertyFileLoginModule required file="connect.password"; }; *Updating userid password in the file connect.password * Regards Ashish

Using encrypted distributed worker file

worker while ensuring the distributed worker config file does not expose the sensitive passwords Regards Ashish Sood

Re: User ID / Password based authentication for Kafka Connect Source connector REST Interface

ser-id/password based authentication for this so > > that users must give the user-id & password to issue curl commands. Could > > you please help on this on how to achieve this. > > > > Regards > > Ashish Sood > > +44 (0) 7440258835 > > > &

User ID / Password based authentication for Kafka Connect Source connector REST Interface

Hi Team, I have configured a Kafka Connect source connector on Distributed worker and I am using the REST Interface for administering it like for starring/stopping/querying etc [curl https://host:port/connectors , curl https://host:port/connectors/https://host:port/connectors/%3cname>> etc].

Query on use of Glassfish application server

run the worker process ? Regards Ashish Sood +44 (0) 7440258835

Replica assignment with rack awareness

thanks, ashish

Re: Broker continuously expand and shrinks to itself

Thanks Harsha, I will play with these settings. -Ashish Sent from Yahoo Mail for iPhone On Monday, January 28, 2019, 2:13 PM, Harsha Chintalapani wrote: We’ve seen this similar in our setup and as you noticed it does happen infrequently. Based on my debugging there are few things

Re: Broker continuously expand and shrinks to itself

Hi Harsha, Thanks for the reply. Issue is resolved as of now and the root cause was a runaway application spawning many instances of kafkacat and hammering kafka brokers. I am still wondering that what could be reason for shrink and expand is a client hammers a broker  . --Ashish

Broker continuously expand and shrinks to itself

Hi All, We just upgraded from 0.10.x to 1.1 and enabled rack awareness on an existing clusters which has about 20 nodes in 4 rack . After this we see that few brokers goes on continuous expand and shrink ISR to itself  cycle , it is also causing high time for serving meta data requests. What is

Broker continuously expand and shrinks to itself

Hi All, We just upgraded from 0.10.x to 1.1 and enabled rack awareness on an existing clusters which has about 20 nodes in 4 rack . After this we see that few brokers goes on continuous expand and shrink ISR to itself  cycle , it is also causing high time for serving meta data requests. What

Error while creating ephemeral at /brokers/ids/BROKER_ID

uggest any workaround or alternative solution for the above issue with Kafka 2.12.2.1.0. -- Thanks & Regards, Ashish Choudhary

Making a Window services for kafka having sasl and ssl configuration

s --entity-name alice kafka-configs.bat --zookeeper localhost:2181 --alter --add-config "SCRAM-SHA-256=[iterations=8192,password=admin-secret],SCRAM-SHA-512=[password=admin-secret]" --entity-type users --entity-name admin Need some guidance in making such window service. Thanks and Regards Ashish

ZK disconnect caused ISR Shrink and Expand in the cluster

Hi, We have a setup of 10 node Kafka cluster + 5 node ZK cluster . Kafka version is 0.10.2.1 . We had an issue where a ZK follower lost connection from the ZK leader which triggered a series of ISR Shrink and ISR Expands . This caused some of the partitions to have less number of

KafkaProducer error

Hello , I am trying to run a kafka producer through Scala client ( lntellij ID) and i have included the kafka client jar files. When i run i get error as class not found :kafkaProducer Www.github.com/axeish/kafkawatcher Thanks

ACLs for regular expression

Hi, Is it possible to give ACLs for a regular expression for group names ? For example ..I want to give Read access for all group names with prefix DNS* Thanks

Re: Kerberos/SASL Enabled Kafka - broker fails NoAuth due ACL

Any help ? On 09-Feb-2017 1:13 PM, "Ashish Bhushan" <ashish6...@gmail.com> wrote: > Hi, > > I used same principal and keytab across all brokers jass file ( Client > section ) > > Still not working , now the second broker that starts is throwing > 'Authentica

Re: Kerberos/SASL Enabled Kafka - broker fails NoAuth due ACL

PM, "Manikumar" <manikumar.re...@gmail.com> wrote: > It is necessary to have the same principal name (in Client Section of > jaas.config) across all brokers. > Not sure why we need to modify kerberos.principal.to.local.rules in this > case > > > On Wed, Fe

Re: Kerberos/SASL Enabled Kafka - broker fails NoAuth due ACL

Hi , Were you able to resolve this problem ? On Fri, Jan 20, 2017 at 6:06 AM, amir masood khezrain < amir_li...@yahoo.com.invalid> wrote: > Hi > I am planning to setup a Kerberos/SASL enabled kafka cluster with three > brokers. Since “zookeeper.set.acl=true” is set, when running the first >

How to use a DNS alias name in bootstrap.servers property

ocol", "SASL_PLAINTEXT"); props.put("sasl.kerberos.service.name", "kafka"); props.put("group.id", "ashish-group"); props.put("key.deserializer", "org.apache.kafka.common.serialization.StringDeserializer"); props.put("valu

Re: [ANNOUNCE] New committer: Jason Gustafson

gt; > > > > > > > > > > > The PMC for Apache Kafka has invited Jason Gustafson to join as a > > > > > committer and > > > > > we are pleased to announce that he has accepted! > > > > > > > > > > Jason has contributed numerous patches to a wide range of areas, > > > notably > > > > > within the new consumer and the Kafka Connect layers. He has > > displayed > > > > > great taste and judgement which has been apparent through his > > > involvement > > > > > across the board from mailing lists, JIRA, code reviews to > > contributing > > > > > features, bug fixes and code and documentation improvements. > > > > > > > > > > Thank you for your contribution and welcome to Apache Kafka, Jason! > > > > > -- > > > > > Thanks, > > > > > Neha > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- Ashish h

Kafka Manager - Multiple users with different ACLs

Hi, Is it possible to configure Kafka Manager with multiple users with different access control ? https://github.com/yahoo/kafka-manager For example : User1 has below features application.features=["KMClusterManagerFeature","KMTopicManagerFeature"] User2 has below features

Re: test-log4j.properties purpose

it make > sense to remove it from binary distribution archive? It's in > kafka_2.11-0.9.0.1.tgz > > Kind regards, > Stevo Slavic. > -- Regards, Ashish

Re: How to get group list in kafka?

. Using this we can list all > groups. But i am not able to find this script in my kafka tar file. > > In which version this script was introduced ? > > Thanks and Regards > -- Regards, Ashish

Re: Thread safety when committing from multiple threads

Hi, Can anyone please shed some light on this ? I couldn't find any pointers online other than this: http://stackoverflow.com/questions/26477585/when-calling-commitoffsets-on-kafka-high-level-consumerconnector-what-value-get Thanks, Ashish On Mon, Sep 14, 2015 at 2:06 PM, Ashish Shenoy <a

Re: New to Apache Kafka

reading them for more information. TLDR: http://stackoverflow.com/questions/23751708/kafka-is-zookeeper-a-must Thanks, Ashish On Tue, Sep 15, 2015 at 1:45 PM, Joe San <codeintheo...@gmail.com> wrote: > Hi Apache Kafka, > > I'm evaluating Apache Kafka for one of the projects that I

Thread safety when committing from multiple threads

ensure that the call to commitOffsets() is synchronized across multiple threads ? Thanks, Ashish

Re: [VOTE] 0.8.2.2 Candidate 1

ch) is the 0.8.2.2 tag > https://git-wip-us.apache.org/repos/asf?p=kafka.git;a=tag;h=d01226cfdcb3d9daad8465234750fa515a1e7e4a > > /*** > > Thanks, > > Jun -- thanks ashish Blog: http://www.ashishpaliwal.com/blog My Photo Galleries: http://www.pbase.com/ashishpaliwal

Re: Reg Leader re-election when leader crashes

:2181 --topic RTL_RESERVATION_UPDATES --unavailable-partitions Regards Amar -- Regards, Ashish

Re: Mirror a partition of a topic

. Thanks -Binh -- Regards, Ashish

Re: [DISCUSSION] Kafka 0.8.2.2 release?

is to cherrypick low-risk bug-fixes into the 0.8.2 branch and once enough bug fixes happened (or if sufficiently critical fixes happened) to roll out a new maintenance release (with every 3 month as a reasonable bugfix release target). -- Regards, Ashish

Re: kafka-topics.sh - Include topic deletion information?

way I know off). It would be far more easier to just have this info via the Kafka scripts. -Jaikiran -- Regards, Ashish

Re: kafka-topics.sh - Include topic deletion information?

at 3:11 PM, Ashish Singh asi...@cloudera.com wrote: Hey Jaikiran, I think that is a fair ask. However, I am curious in which scenario would you want to know the topics that should not exist anymore, deleted topics? On Mon, Jul 20, 2015 at 8:58 PM, Jaikiran Pai jai.forums2

NULL Record Error. Unable to append a new message to a topic in Camus.

com.linkedin.camus.etl.kafka.CamusJob -P /opt/camus/camus.properties Please can anyone point me to the solution to how to fix it. Thank you, Ashish

Re: How to get size (metadata) of a message without fetch request in Kafka through SimpleConsumer?

request/response in kafka api. Thanks, Hutashan Chandrakar -- Regards, Ashish

Re: Delete topic using kafka-topics.sh also not working (or takes forever)

(org.apache.zookeeper.server.PrepRequestProcessor) Could someone please let me know if I am missing anything? Thank you, Siva. -- Regards, Ashish

java.lang.NumberFormatException: null - when producer tries to send message to Kafka queue

) at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197) Any idea why would this happen. Thanks Ashish