Re: Supported Kafka/Zookeeper Version with ELK 8.4.3

2022-12-05 Thread Colin McCabe
Hi, Sorry, we do not develop ELK. In fact, I'm not sure what that acronym refers to. I would suggest checking in with support for that product / project, since it is not part of Apache Kafka. best, Colin On Fri, Oct 28, 2022, at 06:23, Kumar, Sudip wrote: > Hi Team, > > We are still

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Colin McCabe
Thanks, David, for running this release. C. On Tue, Aug 2, 2022, at 12:09, Matthew Benedict de Detrich wrote: > Thanks for organising the release! > > -- > Matthew de Detrich > Aiven Deutschland GmbH > Immanuelkirchstraße 26, 10405 Berlin > Amtsgericht Charlottenburg, HRB 209739 B > >

Re: [EXTERNAL] Re: Security vulnerabilities in kafka:2.13-2.6.0/2.7.0 docker image

2021-11-01 Thread Colin McCabe
It seems like your image does not show up on the mailing list. best, Colin On Wed, Sep 1, 2021, at 06:26, Ashish Patil wrote: > Hi Team > > I tried upgrading it to 2.13_2.8.0 but still have these vulnerabilities. > > > > What is your suggestion on this? > > Thanks > Ashish > > *From:*

Re: [ANNOUNCE] New Kafka PMC Member: Randall Hauch

2021-04-22 Thread Colin McCabe
Congratulations, Randall! best, Colin On Wed, Apr 21, 2021, at 09:51, Mickael Maison wrote: > Congratulations Randall, well deserved! > > On Mon, Apr 19, 2021 at 10:55 PM Konstantine Karantasis > wrote: > > > > Congratulations Randall! > > > > Konstantine > > > > On Mon, Apr 19, 2021 at 1:14

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 2.8.0

2021-04-22 Thread Colin McCabe
Hi Ran, As part of the KRaft work outlined in KIP-500, we are planning on creating an authorizer that does not rely on ZooKeeper. This work is not included in the 2.8 release, however. regards, Colin On Mon, Apr 19, 2021, at 13:02, Ran Lupovich wrote: > Hello, Maybe I missed it in the

Re: [ANNOUNCE] New committer: Boyang Chen

2020-06-22 Thread Colin McCabe
Congratulations, Boyang! cheers, Colin On Mon, Jun 22, 2020, at 16:26, Guozhang Wang wrote: > The PMC for Apache Kafka has invited Boyang Chen as a committer and we are > pleased to announce that he has accepted! > > Boyang has been active in the Kafka community more than two years ago. > Since

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Colin McCabe
+1 (binding) verified checksums ran unitTest ran check best, Colin On Tue, Apr 7, 2020, at 21:03, David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 support (1.2 is now the default) > *

Re: Kafka trunk vs master branch

2019-12-30 Thread Colin McCabe
+1. Colin On Fri, Dec 27, 2019 at 12:29 PM Guozhang Wang wrote: > Hmm, I think that's pushed by someone by mistake, we can delete it. > > > Guozhang > > > On Thu, Dec 26, 2019 at 12:18 PM Matthias J. Sax > wrote: > >> Should we delete `master` ? (Was not even aware it exists...) >> >> >>

Re: [ANNOUNCE] New committer: Mickael Maison

2019-11-07 Thread Colin McCabe
Congratulations, Mickael! cheers, Colin On Thu, Nov 7, 2019, at 13:53, Bill Bejeck wrote: > Congratulations Mickael! Well deserved! > > -Bill > > On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer >

Re: [VOTE] 2.3.1 RC2

2019-10-23 Thread Colin McCabe
+ d...@kafka.apache.org On Tue, Oct 22, 2019, at 15:48, Colin McCabe wrote: > +1. I ran the broker, producer, consumer, etc. > > best, > Colin > > On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > > +1. I've ran the quick start and unit tests. > > > >

Re: [VOTE] 2.3.1 RC2

2019-10-22 Thread Colin McCabe
+1. I ran the broker, producer, consumer, etc. best, Colin On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > +1. I've ran the quick start and unit tests. > > > Guozhang > > On Tue, Oct 22, 2019 at 12:57 PM David Arthur wrote: > > > Thanks, Jonathon and Jason. I've updated the release

Re: PR review

2019-07-08 Thread Colin McCabe
Hi M. Manna, I left a review. Take a look. Sorry for the delays. best, Colin On Mon, Jul 8, 2019, at 14:38, M. Manna wrote: > Hello, > > A few requests have been sent already. Could this please be reviewed ? Our > business implementation is holding due to this change. > > > > On Thu, 4

Re: [ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
here: https://www.youtube.com/watch?v=YutjYKSGd64 cheers, Colin On Tue, Jun 25, 2019, at 09:40, Colin McCabe wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 2.3.0. > This release includes several new features, including: > > - There ha

[ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
The Apache Kafka community is pleased to announce the release for Apache Kafka 2.3.0. This release includes several new features, including: - There have been several improvements to the Kafka Connect REST API. - Kafka Connect now supports incremental cooperative rebalancing. - Kafka Streams

[RESULT] [VOTE] 2.3.0 RC3

2019-06-24 Thread Colin McCabe
y and ran quickstart on the 2.11 binary. > > > > Looks good! > > > > On Sun, Jun 23, 2019 at 3:06 PM Jakub Scholz wrote: > > > > > > +1 (non-binding). I used the binaries and run some of my tests against > > > them. > > > > > > On Thu, Jun

[VOTE] 2.3.0 RC3

2019-06-19 Thread Colin McCabe
Hi all, We discovered some problems with the second release candidate (RC2) of 2.3.0. Specifically, KAFKA-8564. I've created a new RC which includes the fix for this issue. Check out the release notes for the 2.3.0 release here:

Re: [kafka-clients] [VOTE] 2.3.0 RC1

2019-06-05 Thread Colin McCabe
On Tue, Jun 4, 2019, at 23:17, Colin McCabe wrote: > Hi all, > > This is the first candidate for the release of Apache Kafka 2.3.0. > > This release includes many new features, including: > * Support for incremental cooperative rebalancing > * An in-memory session s

[VOTE] 2.3.0 RC1

2019-06-05 Thread Colin McCabe
Hi all, This is the first candidate for the release of Apache Kafka 2.3.0. This release includes many new features, including: * Support for incremental cooperative rebalancing * An in-memory session store and window store for Kafka Streams * An API for allowing users to determine what

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-19 Thread Colin McCabe
Congratulations, Matthias! best, Colin On Fri, Apr 19, 2019, at 14:55, James Cheng wrote: > Congrats!! > > -James > > Sent from my iPhone > > > On Apr 18, 2019, at 2:35 PM, Guozhang Wang wrote: > > > > Hello Everyone, > > > > I'm glad to announce that Matthias J. Sax is now a member of

[ANNOUNCE] Apache Kafka 2.1.1

2019-02-19 Thread Colin McCabe
Dagostino, slim, Stig Rohde Døssing, Vahid Hashemian, and Xi Yang. We welcome your help and feedback. For more information on how to report problems, and to get involved, visit the project website at https://kafka.apache.org/ Thank you! Regards, Colin McCabe

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
P.S. I have added KAFKA-7897 to the release notes. Good catch, Jason. best, Colin On Fri, Feb 15, 2019, at 00:49, Colin McCabe wrote: > Hi all, > > With 7 non-binding +1 votes, 3 binding +1 votes, no +0 votes, and no -1 > votes, the vote passes. > > Thanks, all! &g

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
me. >> >> Thanks Colin! >> >> On Thu, Feb 14, 2019 at 3:32 PM Jun Rao wrote: >> >> > Hi, Colin, >> > >> > Thanks for running the release. Verified the quickstart for 2.12 binary. +1 >> > from me. >> > >> &g

Re: [VOTE] 2.1.1 RC2

2019-02-11 Thread Colin McCabe
gt; > > > > +1 (non-binding). I built it from source and run my tests. Everything > > > > seems > > > > to be fine. > > > > > > > > On Sat, Feb 9, 2019 at 12:10 AM Magnus Edenhill > > > > wrote: > > > > > > > >

[VOTE] 2.1.1 RC2

2019-02-08 Thread Colin McCabe
Hi all, This is the third candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Compared to rc1, this release includes the following changes: * MINOR: release.py: fix some compatibility problems. * KAFKA-7897; Disable leader epoch cache when

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
ions FAILED > kafka.server.ReplicaManagerQuotasTest > > shouldIncludeInSyncThrottledReplicas FAILED > > Thanks > Eno > > On Sun, Jan 27, 2019 at 9:46 PM Colin McCabe wrote: > > > Hi all, > > > > This is the second candidate for release of Apache Kafka 2.1.1. This > >

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
ions FAILED > kafka.server.ReplicaManagerQuotasTest > > shouldIncludeInSyncThrottledReplicas FAILED > > Thanks > Eno > > On Sun, Jan 27, 2019 at 9:46 PM Colin McCabe wrote: > > > Hi all, > > > > This is the second candidate for release of Apache Kafka 2.1.1. This > > release incl

[VOTE] 2.1.1 RC1

2019-01-27 Thread Colin McCabe
Hi all, This is the second candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Compared to rc0, this release includes the following changes: * MINOR: Upgrade ducktape to 0.7.5 (#6197) * KAFKA-7837: Ensure offline partitions are picked up as

[VOTE] 2.1.1 RC0

2019-01-25 Thread Colin McCabe
Hi all, This is the first candidate for release of Apache Kafka 2.1.1. This release includes many bug fixes for Apache Kafka 2.1. Check out the release notes here: http://home.apache.org/~cmccabe/kafka-2.1.1-rc0/RELEASE_NOTES.html The vote will go until Wednesday, January 30th. * Release

Re: ConsumerGroupCommand tool improvement?

2018-08-06 Thread Colin McCabe
am pushing back on this is that regular expressions add a lot of complexity to the API and make it harder for us to meet our backwards compatibility guarantees. For example, Java regular expressions changed slightly between Java 7 and Java 8 best, Colin > > Thanks again! > --Vahid

Re: ConsumerGroupCommand tool improvement?

2018-08-03 Thread Colin McCabe
Hi Vahid, Interesting idea. It seems like if you're using the AdminClient APIs programmatically, you can just do the filtering yourself in a more flexible way than what we could provide. On the other hand, if you're using the ./bin/consumer-groups.sh command-line tool, why not use grep or a

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-16 Thread Colin McCabe
Thanks, Matthias, this looks great. It seems like these APIs could either be used against mock objects, or against real brokers running in the same process. Is there a way for the user to select which they want when using the API? Sorry if it's in the KIP and I missed it. cheers, Colin On

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-19 Thread Colin McCabe
or the member and adds a new object to the > >> heartbeatPurgatory, see completeAndScheduleNextHeartbeatExpiration() > >> called from handleHeartbeat() > >> > >> NB added dev mailing list back into CC as it seems to have been lost along > >> the way.

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-12 Thread Colin McCabe
Hi Vahid, I think you make a valid point that the ACLs controlling group operations are not very intuitive. This is probably a dumb question, but why are we using Read for mutating APIs? Shouldn't that be Write? The distinction between Describe and Read makes a lot of sense for Topics. A

Re: Kafka exception

2017-02-17 Thread Colin McCabe
Can you reproduce this with the latest version of Kafka? best, Colin On Wed, Feb 15, 2017, at 22:29, 揣立武 wrote: > > Hi,all! Our program uses the high level consumer api(the version is > 0.8.x). Sometimes the program will throw an exception in the 42th row in > kafka.utils.IteratorTemplate

Re: Reg: Kafka HDFS Connector with (HDFS SSL enabled)

2017-02-17 Thread Colin McCabe
Hi, Just to be clear, HDFS doesn't use HTTP or HTTPS as its primary transport mechanism. Instead, HDFS uses the Hadoop RPC transport mechanism. So in general, it should not be necessary to configure SSL to connect a client to HDFS. HDFS does "support SSL" in the sense that the HDFS web UI can

Re: log.flush.interval.messages setting of Kafka 0.9.0.0

2017-02-17 Thread Colin McCabe
Hi, Based on a quick look at the code, the log.flush.interval.messages setting affects how frequently we call fsync on the underlying filesystem. As you mentioned, by default this is set to Long.MAX_VALUE, which effectively disables it. Keep in mind that the underlying operating system will

Re: KIP-119: Drop Support for Scala 2.10 in Kafka 0.11

2017-02-06 Thread Colin McCabe
+1 (non-binding) for KIP-119 I agree that supporting the 2 most recently release versions of Java and Scala is a reasonable guideline. However, I think it makes sense to have a brief discussion when dropping support for an old Java or Scala version. It's a fairly infrequent event, and it's