Re: [DISCUSS] KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

For record purpose, this KIP is closed as its design has been merged into KIP-320. See https://cwiki.apache.org/confluence/display/KAFKA/KIP-320%3A+Allow+fetchers+to+detect+and+handle+log+truncation . On Wed, Jan 31, 2018 at 12:16 AM Dong Lin wrote: > Hey Jun, Jason, > > Thanks for all the

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

Hi, Ron, Thanks for the explanation. That makes sense. So, this is not an issue. Jun On Tue, Sep 25, 2018 at 11:53 AM, Ron Dagostino wrote: > Hi Jun. I see now what you were getting at. This is actually not a > problem because the authentication code path does not leverage the >

Build failed in Jenkins: kafka-trunk-jdk10 #520

See Changes: [jason] KAFKA-7403; Use default timestamp if no expire timestamp set in offset -- [...truncated 2.44 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! The was over due for some time :) -Matthias On 9/25/18 1:51 AM, Edoardo Comar wrote: > Congratulations Colin ! > -- > > Edoardo Comar > > IBM Event Streams > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > From: Ismael Juma >

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Will that work? I expected it to blow up with ClassCastException or similar. You either would have to specify the window you fetch/put or iterate across all windows the key was found in right? I just hope the window-store doesn't check stream-time under the hoods that would be a questionable

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

Hi Jun. I see now what you were getting at. This is actually not a problem because the authentication code path does not leverage the NetworkClient instance -- it reads to/writes from the TransportLayer directly and sets its own API version numbers manually. Re-authentication leverages the same

Re: [VOTE] KIP-232: Detect outdated metadata using leaderEpoch and partitionEpoch

For record purpose, this KIP is closed as its design has been merged into KIP-320. See https://cwiki.apache.org/confluence/display/KAFKA/KIP-320%3A+Allow+fetchers+to+detect+and+handle+log+truncation .

Re: Accessing Topology Builder

Just for clarification: `peek()` would run on the same thread and the previous operator. Even if---strictly speaking---there is no public contract to guarantee this, it would be the case in the current implementation, and I also don't see any reason why this would change at any point in the

Build failed in Jenkins: kafka-trunk-jdk8 #2990

See Changes: [jason] KAFKA-7403; Use default timestamp if no expire timestamp set in offset -- [...truncated 2.69 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

Hey everyone, According to the previously discussed schedule, I have updated https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=91554044 to include all the KIPs that have passed vote at this moment to be included in Apache Kafka 2.1.0 release. Other KIPs that have not passed vote

[ANNOUNCE] New committer: Colin McCabe

Hi all, The PMC for Apache Kafka has invited Colin McCabe as a committer and we are pleased to announce that he has accepted! Colin has contributed 101 commits and 8 KIPs including significant improvements to replication, clients, code quality and testing. A few highlights were KIP-97 (Improved

Build failed in Jenkins: kafka-trunk-jdk8 #2988

See Changes: [lindong28] KAFKA-5066; Add KafkaMetricsConfig (Yammer metrics reporters) props to -- [...truncated 10.19 MB...] at

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: > Congratulations Colin ! > -- > > Edoardo Comar > > IBM Event Streams > IBM UK Ltd, Hursley Park, SO21 2JN > > > > > From: Ismael Juma > To: Kafka Users , dev > Date:

Re: [DISCUSS] KIP-375: TopicCommand to use AdminClient

Hi Eno, Thanks for the question. Basically KAFKA-5561 aims for a bigger task: not to add functionality to the existing TopicCommand but rewrite it in the tools module in Java. KIP-375 only aims for extending the existing TopicCommand's capability, so it is a smaller and backward compatible step

Build failed in Jenkins: kafka-trunk-jdk10 #518

See Changes: [lindong28] KAFKA-5066; Add KafkaMetricsConfig (Yammer metrics reporters) props to -- [...truncated 2.22 MB...]

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

cc us...@kafka.apache.org and kafka-clie...@googlegroups.com On Sun, Sep 9, 2018 at 5:31 PM Dong Lin wrote: > Hi all, > > I would like to be the release manager for our next time-based feature > release 2.1.0. > > The recent Kafka release history can be found at >

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin, well deserved! :) On Tue, Sep 25, 2018 at 10:58 AM Stanislav Kozlovski wrote: > Congrats Colin! > > On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: > > > Congratulations Colin ! > > -- > > > > Edoardo Comar > > > > IBM Event

Build failed in Jenkins: kafka-trunk-jdk8 #2987

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [VOTE] KIP-302 - Enable Kafka clients to use all DNS resolved IP addresses

Many thanks to all that voted, This KIP has passed the vote - within the COB of 24/09/2018 - with 3 binding votes (Rajini, Damian, Gwen) and 4 non-binding votes (Eno, Jonathan and implicitly :-) Mickael and me) Edo -- Edoardo Comar IBM Event

[STREAMS] Qs on code of State Managers (AbstractStateManager, ProcessorStateManager and GlobalStateManagerImpl)

Hi Devs, I'm reviewing state managers and noticed that ProcessorStateManager has registerGlobalStateStores method that is used exclusively when StreamTask is created [1] (that seems a bit weird given global state stores are GlobalStateManagerImpl's actually). That leads to another question about

Build failed in Jenkins: kafka-2.0-jdk8 #148

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Re: [DISCUSS] KIP-375: TopicCommand to use AdminClient

This would be very useful. Could you clarify a bit the difference to https://issues.apache.org/jira/browse/KAFKA-5561 since I didn't get it from the JIRA notes. It's fine if you pick up that work but wanted to make sure we're not duplicating efforts. Thanks Eno On Mon, Sep 24, 2018 at 8:26 PM,

Build failed in Jenkins: kafka-2.0-jdk8 #147

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-trunk-jdk10 #517

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on ubuntu-eu2 (ubuntu trusty) in workspace

Re: [VOTE] KIP-331 Add default implementation to close() and configure() for Serializer, Deserializer and Serde

Thanks, +1 (binding). Ismael On Thu, Sep 20, 2018 at 8:12 PM Chia-Ping Tsai wrote: > KIP-336[1] has been merged so it is time to activate this thread > (KIP-331[2]). Last discussion is about "Should we add FunctionalInterface > annotation to Serializer and Deserializer". In discussion of

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin ! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Ismael Juma To: Kafka Users , dev Date: 25/09/2018 09:40 Subject:[ANNOUNCE] New committer: Colin McCabe Hi all, The PMC

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

Hi Dong many thanks for driving the release! KIP-81 previously voted as adopted has a ready-to-review JIRA and PR. Shall we just amend the wiki ? -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From: Dong Lin To:

Build failed in Jenkins: kafka-1.1-jdk7 #201

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Build failed in Jenkins: kafka-2.0-jdk8 #149

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

Hi Jan Check for " highwaterMat " in the PR. I only changed the state store, not the ProcessorSupplier. Thanks, Adam On Mon, Sep 24, 2018 at 2:47 PM, Jan Filipiak wrote: > > > On 24.09.2018 16:26, Adam Bellemare wrote: > >> @Guozhang >> >> Thanks for the information. This is indeed something

Build failed in Jenkins: kafka-2.0-jdk8 #150

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! On Tue, Sep 25, 2018 at 4:39 PM Mickael Maison wrote: > Congratulations Colin! > > On Tue, Sep 25, 2018, 11:17 Viktor Somogyi-Vass > wrote: > > > Congrats Colin, well deserved! :) > > > > On Tue, Sep 25, 2018 at 10:58 AM Stanislav Kozlovski < > > stanis...@confluent.io> > >

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations, Colin! Well deserved! Regards, Rajini On Tue, Sep 25, 2018 at 9:39 AM, Ismael Juma wrote: > Hi all, > > The PMC for Apache Kafka has invited Colin McCabe as a committer and we are > pleased to announce that he has accepted! > > Colin has contributed 101 commits and 8 KIPs

Build failed in Jenkins: kafka-1.1-jdk7 #200

See -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H33 (ubuntu xenial) in workspace

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Tue, Sep 25, 2018 at 1:51 PM Matthias J. Sax wrote: > Congrats Colin! The was over due for some time :) > > -Matthias > > On 9/25/18 1:51 AM, Edoardo Comar wrote: > > Congratulations Colin ! > > -- > > > > Edoardo Comar >

Build failed in Jenkins: kafka-trunk-jdk10 #521

See Changes: [wangguoz] KAFKA-7223: add tests in preparation for suppression (#5687) -- [...truncated 2.08 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

Re: [ANNOUNCE] New committer: Colin McCabe

Thanks, everyone! best, Colin On Tue, Sep 25, 2018, at 15:26, Robert Barrett wrote: > Congratulations Colin! > > On Tue, Sep 25, 2018 at 1:51 PM Matthias J. Sax > wrote: > > > Congrats Colin! The was over due for some time :) > > > > -Matthias > > > > On 9/25/18 1:51 AM, Edoardo Comar wrote:

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! Regards. --Vahid On Tue, Sep 25, 2018 at 3:43 PM Colin McCabe wrote: > Thanks, everyone! > > best, > Colin > > > On Tue, Sep 25, 2018, at 15:26, Robert Barrett wrote: > > Congratulations Colin! > > > > On Tue, Sep 25, 2018 at 1:51 PM Matthias J. Sax > > wrote: > > > > >

[jira] [Resolved] (KAFKA-7216) Exception while running kafka-acls.sh from 1.0 env on target Kafka env with 1.1.1

[ https://issues.apache.org/jira/browse/KAFKA-7216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-7216. Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 1.1.2

[jira] [Created] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

Dong Lin created KAFKA-7441: --- Summary: Allow LogCleanerManager.resumeCleaning() to be used concurrently Key: KAFKA-7441 URL: https://issues.apache.org/jira/browse/KAFKA-7441 Project: Kafka Issue

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! On Tue, Sep 25, 2018 at 7:46 PM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Congratulations Colin! > > On Tue, Sep 25, 2018 at 7:42 PM Dhruvil Shah wrote: > > > Congratulations Colin! > > > > On Tue, Sep 25, 2018 at 6:47 AM Stephane Maarek < > >

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Tue, Sep 25, 2018, 11:17 Viktor Somogyi-Vass wrote: > Congrats Colin, well deserved! :) > > On Tue, Sep 25, 2018 at 10:58 AM Stanislav Kozlovski < > stanis...@confluent.io> > wrote: > > > Congrats Colin! > > > > On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: > >

Jenkins build is back to normal : kafka-trunk-jdk10 #519

See

Build failed in Jenkins: kafka-1.1-jdk7 #202

See Changes: [ismael] MINOR: Upgrade to Jackson 2.9.7 (#5662) -- [...truncated 894.35 KB...] at

Jenkins build is back to normal : kafka-trunk-jdk8 #2989

See

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations!! Best, Dongjin On Wed, Sep 26, 2018 at 11:56 AM Satish Duggana wrote: > Congratulations Colin! > > > > On Wed, Sep 26, 2018 at 5:52 AM, Vahid Hashemian > wrote: > > Congratulations Colin! > > > > Regards. > > --Vahid > > > > On Tue, Sep 25, 2018 at 3:43 PM Colin McCabe

Jenkins build is back to normal : kafka-trunk-jdk8 #2991

See

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Wed, Sep 26, 2018 at 5:52 AM, Vahid Hashemian wrote: > Congratulations Colin! > > Regards. > --Vahid > > On Tue, Sep 25, 2018 at 3:43 PM Colin McCabe wrote: > >> Thanks, everyone! >> >> best, >> Colin >> >> >> On Tue, Sep 25, 2018, at 15:26, Robert Barrett wrote: >>

Jenkins build is back to normal : kafka-1.1-jdk7 #203

See

[jira] [Resolved] (KAFKA-5066) KafkaMetricsConfig properties and description notably missing from documentation

[ https://issues.apache.org/jira/browse/KAFKA-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-5066. -- Resolution: Fixed > KafkaMetricsConfig properties and description notably missing from >

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin ! On Tue., 25 Sep. 2018, 3:33 pm Bill Bejeck, wrote: > Congrats Colin! > > On Tue, Sep 25, 2018 at 8:11 AM Manikumar > wrote: > > > Congrats Colin! > > > > On Tue, Sep 25, 2018 at 4:39 PM Mickael Maison > > > wrote: > > > > > Congratulations Colin! > > > > > > On Tue, Sep 25,

Jenkins build is back to normal : kafka-2.0-jdk8 #151

See

Re: [VOTE] KIP 368: Allow SASL Connections to Periodically Re-Authenticate

Hi, Ron, 103. I was referring to the following code in ReplicaFetcherBlockingSend. As you can see, when instantiating NetworkClient, we disable the discoverBrokerVersions flag. So the network client won't know the version that the destination broker supports. Instead, the source broker is

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin!! Very well deserved! On Tue, Sep 25, 2018 at 1:39 AM Ismael Juma wrote: > Hi all, > > The PMC for Apache Kafka has invited Colin McCabe as a committer and we are > pleased to announce that he has accepted! > > Colin has contributed 101 commits and 8 KIPs including

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

Hey Edoardo, Certainly, let's add it to this release since it has passed vote. KIP-81 was previously marked as WIP for 2.0.0 release. I updated to be WIP for 2.1.0 release in https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Improvement+Proposals and added it to

[jira] [Resolved] (KAFKA-3532) add principal.builder.class that can extract user from a field

[ https://issues.apache.org/jira/browse/KAFKA-3532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-3532. -- Resolution: Duplicate This will be fixed be part of KAFKA-5462/KIP-371 > add principal.builder.class

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! On Tue, Sep 25, 2018 at 8:11 AM Manikumar wrote: > Congrats Colin! > > On Tue, Sep 25, 2018 at 4:39 PM Mickael Maison > wrote: > > > Congratulations Colin! > > > > On Tue, Sep 25, 2018, 11:17 Viktor Somogyi-Vass > > > wrote: > > > > > Congrats Colin, well deserved! :) > > > >

Re: [DISCUSS] KIP-308: GetOffsetShell: new KafkaConsumer API, support for multiple topics, minimize the number of requests to server

Hi Arseniy, It is good have GetOffsetShell tool to work on secure clusters. Passing additional configuration to the underlying KafkaConsumer is sufficient for the requirement. Can you revive this discussion thread? Let us know if you need any help. Thanks, On Mon, Jun 4, 2018 at 3:27 PM

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Tue, Sep 25, 2018 at 6:47 AM Stephane Maarek < steph...@simplemachines.com.au> wrote: > Congrats Colin ! > > On Tue., 25 Sep. 2018, 3:33 pm Bill Bejeck, wrote: > > > Congrats Colin! > > > > On Tue, Sep 25, 2018 at 8:11 AM Manikumar > > wrote: > > > > > Congrats Colin!

Re: [ANNOUNCE] New committer: Colin McCabe

Congratulations Colin! On Tue, Sep 25, 2018 at 7:42 PM Dhruvil Shah wrote: > Congratulations Colin! > > On Tue, Sep 25, 2018 at 6:47 AM Stephane Maarek < > steph...@simplemachines.com.au> wrote: > > > Congrats Colin ! > > > > On Tue., 25 Sep. 2018, 3:33 pm Bill Bejeck, wrote: > > > > >

[jira] [Created] (KAFKA-7438) Replace EasyMock and PowerMock with Mockito

Ismael Juma created KAFKA-7438: -- Summary: Replace EasyMock and PowerMock with Mockito Key: KAFKA-7438 URL: https://issues.apache.org/jira/browse/KAFKA-7438 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-7439) Replace EasyMock and PowerMock with Mockito in clients module

Ismael Juma created KAFKA-7439: -- Summary: Replace EasyMock and PowerMock with Mockito in clients module Key: KAFKA-7439 URL: https://issues.apache.org/jira/browse/KAFKA-7439 Project: Kafka

Re: [ANNOUNCE] New committer: Colin McCabe

Nice job Colin! -Ray On 9/25/18 1:58 AM, Stanislav Kozlovski wrote: Congrats Colin! On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: Congratulations Colin ! -- Edoardo Comar IBM Event Streams IBM UK Ltd, Hursley Park, SO21 2JN From:

[jira] [Resolved] (KAFKA-7403) Offset commit failure after upgrading brokers past KIP-211/KAFKA-4682

[ https://issues.apache.org/jira/browse/KAFKA-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-7403. Resolution: Fixed > Offset commit failure after upgrading brokers past KIP-211/KAFKA-4682

[jira] [Created] (KAFKA-7440) Use leader epoch in consumer fetch requests

Jason Gustafson created KAFKA-7440: -- Summary: Use leader epoch in consumer fetch requests Key: KAFKA-7440 URL: https://issues.apache.org/jira/browse/KAFKA-7440 Project: Kafka Issue Type:

Re: [ANNOUNCE] New committer: Colin McCabe

Congrats Colin! Guozhang On Tue, Sep 25, 2018 at 8:39 AM, Ray Chiang wrote: > Nice job Colin! > > -Ray > > > On 9/25/18 1:58 AM, Stanislav Kozlovski wrote: > >> Congrats Colin! >> >> On Tue, Sep 25, 2018 at 9:51 AM Edoardo Comar wrote: >> >> Congratulations Colin ! >>>

[DISCUSS] KIP-373: Allow users to create delegation tokens for other users

Hi all, I have created a KIP that proposes to allow users to create delegation tokens for other users. https://cwiki.apache.org/confluence/display/KAFKA/KIP-373%3A+Allow+users+to+create+delegation+tokens+for+other+users Please take a look when you get a chance. Thanks, Manikumar