Re: Supported Kafka/Zookeeper Version with ELK 8.4.3

2022-12-05 Thread Colin McCabe
Hi, Sorry, we do not develop ELK. In fact, I'm not sure what that acronym refers to. I would suggest checking in with support for that product / project, since it is not part of Apache Kafka. best, Colin On Fri, Oct 28, 2022, at 06:23, Kumar, Sudip wrote: > Hi Team, > > We

Re: [ANNOUNCE] Apache Kafka 3.2.1

2022-08-02 Thread Colin McCabe
Thanks, David, for running this release. C. On Tue, Aug 2, 2022, at 12:09, Matthew Benedict de Detrich wrote: > Thanks for organising the release! > > -- > Matthew de Detrich > Aiven Deutschland GmbH > Immanuelkirchstraße 26, 10405 Berlin > Amtsgericht Charlottenburg, HRB 209739 B > >

Re: [EXTERNAL] Re: Security vulnerabilities in kafka:2.13-2.6.0/2.7.0 docker image

2021-11-01 Thread Colin McCabe
It seems like your image does not show up on the mailing list. best, Colin On Wed, Sep 1, 2021, at 06:26, Ashish Patil wrote: > Hi Team > > I tried upgrading it to 2.13_2.8.0 but still have these vulnerabilities. > > > > What is your suggestion on this? > >

Re: [ANNOUNCE] New Kafka PMC Member: Randall Hauch

2021-04-22 Thread Colin McCabe
Congratulations, Randall! best, Colin On Wed, Apr 21, 2021, at 09:51, Mickael Maison wrote: > Congratulations Randall, well deserved! > > On Mon, Apr 19, 2021 at 10:55 PM Konstantine Karantasis > wrote: > > > > Congratulations Randall! > > > > Konstantine

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 2.8.0

2021-04-22 Thread Colin McCabe
Hi Ran, As part of the KRaft work outlined in KIP-500, we are planning on creating an authorizer that does not rely on ZooKeeper. This work is not included in the 2.8 release, however. regards, Colin On Mon, Apr 19, 2021, at 13:02, Ran Lupovich wrote: > Hello, Maybe I mis

Re: [ANNOUNCE] New committer: Boyang Chen

2020-06-22 Thread Colin McCabe
Congratulations, Boyang! cheers, Colin On Mon, Jun 22, 2020, at 16:26, Guozhang Wang wrote: > The PMC for Apache Kafka has invited Boyang Chen as a committer and we are > pleased to announce that he has accepted! > > Boyang has been active in the Kafka community more than two years

Re: [kafka-clients] [VOTE] 2.5.0 RC3

2020-04-13 Thread Colin McCabe
+1 (binding) verified checksums ran unitTest ran check best, Colin On Tue, Apr 7, 2020, at 21:03, David Arthur wrote: > Hello Kafka users, developers and client-developers, > > This is the forth candidate for release of Apache Kafka 2.5.0. > > * TLS 1.3 support (1.2 is now the

Re: Newbie Question

2020-03-28 Thread Colin Ross
roducers and consumers) and brokers (all of them as they act as a > cluster) and aggregate all the data to see the full flow of messages in the > system. Thats why the logs may seem overwelming and you need to look at the > logs of all the broker (and perhaps all the clients as well) to ge

Newbie Question

2020-03-28 Thread Colin Ross
Hi All - just started to use Kafka. Just one thing driving me nuts. I want to get logs of each time a publisher or subscriber connects. I am trying to just get the IP that they connected from and the topic to which they connected. I have managed to do this through enabling debug in the

Re: Kafka trunk vs master branch

2019-12-30 Thread Colin McCabe
+1. Colin On Fri, Dec 27, 2019 at 12:29 PM Guozhang Wang wrote: > Hmm, I think that's pushed by someone by mistake, we can delete it. > > > Guozhang > > > On Thu, Dec 26, 2019 at 12:18 PM Matthias J. Sax > wrote: > >> Should we delete `master

Re: [ANNOUNCE] New committer: Mickael Maison

2019-11-07 Thread Colin McCabe
Congratulations, Mickael! cheers, Colin On Thu, Nov 7, 2019, at 13:53, Bill Bejeck wrote: > Congratulations Mickael! Well deserved! > > -Bill > > On Thu, Nov 7, 2019 at 4:38 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleas

Re: [VOTE] 2.3.1 RC2

2019-10-23 Thread Colin McCabe
+ d...@kafka.apache.org On Tue, Oct 22, 2019, at 15:48, Colin McCabe wrote: > +1. I ran the broker, producer, consumer, etc. > > best, > Colin > > On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > > +1. I've ran the quick start and unit tests. > > > >

Re: [VOTE] 2.3.1 RC2

2019-10-22 Thread Colin McCabe
+1. I ran the broker, producer, consumer, etc. best, Colin On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > +1. I've ran the quick start and unit tests. > > > Guozhang > > On Tue, Oct 22, 2019 at 12:57 PM David Arthur wrote: > > > Thanks, Jonathon and Jaso

Re: PR review

2019-07-08 Thread Colin McCabe
Hi M. Manna, I left a review. Take a look. Sorry for the delays. best, Colin On Mon, Jul 8, 2019, at 14:38, M. Manna wrote: > Hello, > > A few requests have been sent already. Could this please be reviewed ? Our > business implementation is holding due to this change. > &g

Re: [ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
here: https://www.youtube.com/watch?v=YutjYKSGd64 cheers, Colin On Tue, Jun 25, 2019, at 09:40, Colin McCabe wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 2.3.0. > This release includes several new features, including: > > - There ha

[ANNOUNCE] Apache Kafka 2.3.0

2019-06-25 Thread Colin McCabe
Satish, A. Sophie Blee-Goldman, asutosh936, Bill Bejeck, Bob Barrett, Boyang Chen, Brian Bushree, cadonna, Casey Green, Chase Walden, Chia-Ping Tsai, Chris Egerton, Chris Steingen, Colin Hicks, Colin Patrick McCabe, commandini, cwildman, Cyrus Vafadari, Dan Norwood, David Arthur, Dejan

[RESULT] [VOTE] 2.3.0 RC3

2019-06-24 Thread Colin McCabe
Vote thread: https://www.mail-archive.com/dev@kafka.apache.org/msg98814.html I'll continue with the release process and the release announcement will follow in the next few days. thanks, Colin On Mon, Jun 24, 2019, at 01:17, Mickael Maison wrote: > Thanks Colin for making a new RC for KA

[VOTE] 2.3.0 RC3

2019-06-19 Thread Colin McCabe
/releases/tag/2.3.0-rc3 best, Colin C.

Re: [kafka-clients] [VOTE] 2.3.0 RC1

2019-06-05 Thread Colin McCabe
On Tue, Jun 4, 2019, at 23:17, Colin McCabe wrote: > Hi all, > > This is the first candidate for the release of Apache Kafka 2.3.0. > > This release includes many new features, including: > * Support for incremental cooperative rebalancing > * An in-memory session s

[VOTE] 2.3.0 RC1

2019-06-05 Thread Colin McCabe
upon (off the 2.3 branch) is the 2.3.0 tag: https://github.com/apache/kafka/releases/tag/2.3.0-rc1 thanks, Colin

Re: [ANNOUNCE] New Kafka PMC member: Matthias J. Sax

2019-04-19 Thread Colin McCabe
Congratulations, Matthias! best, Colin On Fri, Apr 19, 2019, at 14:55, James Cheng wrote: > Congrats!! > > -James > > Sent from my iPhone > > > On Apr 18, 2019, at 2:35 PM, Guozhang Wang wrote: > > > > Hello Everyone, > > > > I'm glad

[ANNOUNCE] Apache Kafka 2.1.1

2019-02-19 Thread Colin McCabe
to this release! Alex Diachenko, Andras Katona, Anna Povzner, Arjun Satish, Bill Bejeck, Bob Barrett, cadonna, Chia-Ping Tsai, Chris Egerton, Colin P. McCabe, cwildman, Cyrus Vafadari, Dhruvil Shah, Dong Lin, Flavien Raynaud, Guozhang Wang, hackerwin7, huxi, Ismael Juma, Jacek Laskowski, Jakub Scholz

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
P.S. I have added KAFKA-7897 to the release notes. Good catch, Jason. best, Colin On Fri, Feb 15, 2019, at 00:49, Colin McCabe wrote: > Hi all, > > With 7 non-binding +1 votes, 3 binding +1 votes, no +0 votes, and no -1 > votes, the vote passes. > > Thanks, all! &g

Re: [kafka-clients] [VOTE] 2.1.1 RC2

2019-02-15 Thread Colin McCabe
Hi all, With 7 non-binding +1 votes, 3 binding +1 votes, no +0 votes, and no -1 votes, the vote passes. Thanks, all! cheers, Colin On Fri, Feb 15, 2019, at 00:07, Jonathan Santilli wrote: > > > Hello, > > I have downloaded the source and executed integration and unit tests

Re: [VOTE] 2.1.1 RC2

2019-02-11 Thread Colin McCabe
Thanks, everyone, for taking a look! Just as a reminder, the vote will run until Wednesday. best, Colin On Mon, Feb 11, 2019, at 05:17, Satish Duggana wrote: > +1 (non-binding) > > - Ran testAll/releaseTarGzAll successfully with NO failures. > - Ran through quickstart of

[VOTE] 2.1.1 RC2

2019-02-08 Thread Colin McCabe
tps://github.com/apache/kafka/releases/tag/2.1.1-rc2 * Jenkins builds for the 2.1 branch: Unit/integration tests: https://builds.apache.org/job/kafka-2.1-jdk8/ Thanks to everyone who tested the earlier RCs. cheers, Colin

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
(+all lists) Hi Eno, Thanks for testing this. Those tests passed in the Jenkins build we did here: https://builds.apache.org/job/kafka-2.1-jdk8/118/ Perhaps there is an environment issue at play here? Do you get the same failures running those tests on the 2.1 release? Best, Colin On Wed

Re: [VOTE] 2.1.1 RC1

2019-01-30 Thread Colin McCabe
Hi Eno, Thanks for testing this. Those tests passed in the Jenkins build we did here: https://builds.apache.org/job/kafka-2.1-jdk8/118/ Perhaps there is an environment issue at play here? Do you get the same failures running those tests on the 2.1 release? Best, Colin On Wed, Jan 30, 2019

[VOTE] 2.1.1 RC1

2019-01-27 Thread Colin McCabe
, Colin

[VOTE] 2.1.1 RC0

2019-01-25 Thread Colin McCabe
, and another in TestUpgrade. We believe that the failures are spurious, and are re-running the tests. Also, I am working on getting my PGP key added to http://kafka.apache.org/KEYS. thanks, Colin

Packaging jks certificates into an uber jar and accessing them for kafka client or otherwise?

2018-12-24 Thread Colin Williams
I've been trying to read from kafka via a spark streaming client. I found out spark cluster doesn't have certificates deployed. Then I tried using the same local certificates I've been testing with by packing them in an uber jar and getting a File handle from the Classloader resource. But I'm

Re: ConsumerGroupCommand tool improvement?

2018-08-06 Thread Colin McCabe
On Mon, Aug 6, 2018, at 12:04, Vahid S Hashemian wrote: > Hi Colin, > > Thanks for considering the idea and sharing your feedback. > > The improvements I proposed can be achieved, to some extend, using the > AdminClient API and the Consumer Group CLI tool. But they won'

Re: ConsumerGroupCommand tool improvement?

2018-08-03 Thread Colin McCabe
the traditional way of piping the output to grep, awk, and sed? best, Colin On Thu, Aug 2, 2018, at 14:23, Vahid S Hashemian wrote: > Hi all, > > A requirement has been raised by a colleague and I wanted to see if there > is any interest in the community in adding the functionality to Apa

Re: [DISCUSS] KIP-247: Add public test utils for Kafka Streams

2018-01-16 Thread Colin McCabe
Thanks, Matthias, this looks great. It seems like these APIs could either be used against mock objects, or against real brokers running in the same process. Is there a way for the user to select which they want when using the API? Sorry if it's in the KIP and I missed it. cheers, Colin

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-19 Thread Colin McCabe
on the incremental improvement discussed in KIP-163. cheers, Colin On Sat, Jun 17, 2017, at 11:11, Hans Jespersen wrote: > > Offset commit is something that is done in the act of consuming (or > reading) Kafka messages. > Yes technically it is a write to the Kafka consumer

Re: [DISCUSS] KIP-163: Lower the Minimum Required ACL Permission of OffsetFetch

2017-06-12 Thread Colin McCabe
. A group isn't really something that you "read" from in the same way as a topic, so it always felt kind of weird there. best, Colin On Thu, Jun 8, 2017, at 11:29, Vahid S Hashemian wrote: > Hi all, > > I'm resending my earlier note hoping it would spark some conversation &g

Re: Kafka exception

2017-02-17 Thread Colin McCabe
Can you reproduce this with the latest version of Kafka? best, Colin On Wed, Feb 15, 2017, at 22:29, 揣立武 wrote: > > Hi,all! Our program uses the high level consumer api(the version is > 0.8.x). Sometimes the program will throw an exception in the 42th row in > kafka.utils.Iter

Re: Reg: Kafka HDFS Connector with (HDFS SSL enabled)

2017-02-17 Thread Colin McCabe
web UI can be configured to use it. You can also use HttpFS or WebHDFS to access HDFS, which might motivate you to configure SSL. Are you trying to configure one of these? best, Colin On Wed, Feb 15, 2017, at 11:03, BigData dev wrote: > Hi, > > Does Kafka HDFS Connect work with HDFS (

Re: log.flush.interval.messages setting of Kafka 0.9.0.0

2017-02-17 Thread Colin McCabe
replication. This is one reason why users who require the highest level of data durability run with battery backup for their clusters. Another reason is because some hard drives on the market are not totally reliable about flushing the data to the platter when they claim to have done so. best, Colin

Re: KIP-119: Drop Support for Scala 2.10 in Kafka 0.11

2017-02-06 Thread Colin McCabe
release cadences speed up enough, we might want to support more than 2 versions. And so forth. best, Colin On Fri, Feb 3, 2017, at 08:10, Ismael Juma wrote: > Hi Grant, > > That's an interesting point. It would be good to hear what others' think > of > making that the official

Re: If you run Kafka in AWS or Docker, how do you persist data?

2015-03-04 Thread Colin
Hello, We use docker for kafka on vm's with both nas and local disk. We mount the volumes externally. We havent had many problems at all, and a restart has cleared any issue. We are on .8.1 We are also started to deploy to aws. -- Colin +1 612 859 6129 Skype colin.p.clark On Mar 4, 2015

Re: Poll RESULTS: Producer/Consumer languages

2015-02-11 Thread Colin
Digital River will be releasing one soon as well that is integrated with the netflix stack for discovery, load balancing, metrics,etc. -- Colin Clark +1 612 859 6129 Skype colin.p.clark On Feb 11, 2015, at 7:20 PM, Jay Kreps jay.kr...@gmail.com wrote: Hey Justin, I don't think LinkedIn

Re: Resilient Producer

2015-01-28 Thread Colin
Logstash -- Colin Clark +1 612 859 6129 Skype colin.p.clark On Jan 28, 2015, at 10:47 AM, Gwen Shapira gshap...@cloudera.com wrote: It sounds like you are describing Flume, with SpoolingDirectory source (or exec source running tail) and Kafka channel. On Wed, Jan 28, 2015 at 10:39 AM

Re: Stale TopicMetadata

2013-07-11 Thread Colin Blower
, but in that case couldn't we at least have a flag indicating wether that broker is online or not? Regards -- The intuitive mind is a sacred gift and the rational mind is a faithful servant. We have created a society that honors the servant and has forgotten the gift. -- *Colin Blower

Re: 0.8 protocol exception

2013-07-08 Thread Colin Blower
the gift. -- *Colin Blower* /Software Engineer/ Barracuda Networks Inc. +1 408-342-5576 (o)

Re: 0.8 protocol exception

2013-07-08 Thread Colin Blower
would love to see the final product. On 07/08/2013 02:44 PM, Vinicius Carvalho wrote: Thanks Colin, yep you are right I was missing the ShortString way to represent arrays. All is fine now, I'm able to connect and execute MetadataRequest/Responses. Moving to ProducerRequest/Responses now

Re: 0.8.0 HEAD 3/4/2013 performance jump?

2013-03-05 Thread Colin Blower
fastest in this mode. The argument for making the default ack 1 or -1 is that they gave you better reliability. I am not sure what's the best thing to do that here since correct setting really depends on the application. What do people feel? Thanks, Jun -- *Colin Blower* /Software Engineer