Build failed in Jenkins: kafka-trunk-jdk8 #2508

See Changes: [jason] MINOR: Update Jackson to 2.9.5 (#4776) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32 (ubuntu

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hey John, Great! Thanks for all the comment. It seems that we agree that the current KIP is in good shape for core Kafka. IMO, what we have been discussing in the recent email exchanges is mostly about the second step, i.e. how to address problem for the stream use-case (or stateful processing in

Build failed in Jenkins: kafka-trunk-jdk7 #3294

See Changes: [jason] MINOR: Update Jackson to 2.9.5 (#4776) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H20 (ubuntu

Re: [VOTE] 1.1.0 RC4

This vote passes with 9 +1 votes (4 bindings) and no 0 or -1 votes. +1 votes PMC Members: * Jason Gustafson * Jun Rao * Gwen Shapira * Rajini Sivaram Committers: * No votes Community: * Ted Yu * Manikumar * Jeff Chao * Vahid Hashemian * Brett Rann 0 votes * No votes -1 votes * No votes

[jira] [Created] (KAFKA-6724) ConsumerPerformance resets offsets on every startup

Alex Dunayevsky created KAFKA-6724: -- Summary: ConsumerPerformance resets offsets on every startup Key: KAFKA-6724 URL: https://issues.apache.org/jira/browse/KAFKA-6724 Project: Kafka Issue

[ANNOUNCE] New Committer: Dong Lin

Hello everyone, The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted our invitation to be a new Kafka committer. Dong started working on Kafka about four years ago, since which he has contributed numerous features and patches. His work on Kafka core has been consistent and

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong! Well deserved. From: Bill Bejeck To: dev@kafka.apache.org Date: 03/28/2018 11:04 AM Subject:Re: [ANNOUNCE] New Committer: Dong Lin Congrats Dong! On Wed, Mar 28, 2018 at 1:58 PM, Ted Yu wrote: >

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations, Dong! Thanks for all your contributions to Kafka. Jun On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > >

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong! On Wed, Mar 28, 2018 at 7:31 PM, Ismael Juma wrote: > Congratulations Dong! Thanks for your contributions so far and looking > forward to future ones. > > Ismael > > On Wed, 28 Mar 2018, 10:58 Becket Qin, wrote: > >> Hello everyone,

Re: [VOTE] KIP-272: Add API version tag to broker's RequestsPerSec metric

+1 (non binding) Thanks for the KIP On Wed, Mar 28, 2018 at 6:25 PM, Gwen Shapira wrote: > +1 (binding) > > On Wed, Mar 28, 2018 at 9:55 AM, Allen Wang wrote: > >> Hi All, >> >> I would like to start voting for KIP-272: Add API version tag to broker's

Re: [DISCUSS] KIP-253: Support in-order message delivery with partition expansion

Hi, John, I actually think it's important to think through how KStreams handles partition expansion in this KIP. If we do decide that we truly need backfilling, it's much better to think through how to add it now, instead of retrofitting it later. It would be useful to outline how both existing

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong! On Wed, Mar 28, 2018 at 11:19 AM, Jun Rao wrote: > Congratulations, Dong! Thanks for all your contributions to Kafka. > > Jun > > On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin wrote: > > > Hello everyone, > > > > The PMC of Apache

Re: [DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

While I'm not in favor of the proposal, I want to point out that the ecosystem changed quite a bit since KIP-30 was first proposed. Kubernetes deployments are far more common now and are growing in popularity, and the problem in deployment, discovery and management that ZK poses is therefore more

[VOTE] KIP-272: Add API version tag to broker's RequestsPerSec metric

Hi All, I would like to start voting for KIP-272: Add API version tag to broker's RequestsPerSec metric. https://cwiki.apache.org/confluence/display/KAFKA/KIP-272%3A+Add+API+version+tag+to+broker%27s+RequestsPerSec+metric Thanks, Allen

Build failed in Jenkins: kafka-trunk-jdk7 #3296

See Changes: [jason] KAFKA-6724; ConsumerPerformance should not always reset to earliest [wangguoz] MINOR: Depend on streams:test-utils for streams and examples tests --

Re: [ANNOUNCE] New Committer: Dong Lin

Congrats Dong! On Wed, Mar 28, 2018 at 1:58 PM, Ted Yu wrote: > Congratulations, Dong. > > On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin wrote: > > > Hello everyone, > > > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > >

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations, Dong! On Wed, Mar 28, 2018 at 7:06 PM, Vahid S Hashemian < vahidhashem...@us.ibm.com> wrote: > Congratulations Dong! Well deserved. > > > > From: Bill Bejeck > To: dev@kafka.apache.org > Date: 03/28/2018 11:04 AM > Subject:Re: [ANNOUNCE] New

Re: [VOTE] KIP-257 - Configurable Quota Management

+1 On Thu, Mar 22, 2018 at 2:56 PM, Rajini Sivaram wrote: > Hi all, > > I would like to start vote on KIP-257 to enable customisation of client > quota computation: > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 257+-+Configurable+Quota+Management > > The

Re: [DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

Hi Gwen, I don't think the reasons why a pluggable metastore is not desirable have changed. My suggestion is that the KIP should try to address the concerns raised previously as part of the proposal. Ismael On Wed, Mar 28, 2018 at 10:24 AM, Gwen Shapira wrote: > While I'm

Re: [ANNOUNCE] New Committer: Dong Lin

congratulation！ | | zhenya Sun 邮箱：toke...@126.com | 签名由 网易邮箱大师 定制 On 03/29/2018 02:03, Bill Bejeck wrote: Congrats Dong! On Wed, Mar 28, 2018 at 1:58 PM, Ted Yu wrote: > Congratulations, Dong. > > On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations, Dong. On Wed, Mar 28, 2018 at 10:58 AM, Becket Qin wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > Dong started working on Kafka about four years ago,

Re: [ANNOUNCE] New Committer: Dong Lin

Congratulations Dong! Thanks for your contributions so far and looking forward to future ones. Ismael On Wed, 28 Mar 2018, 10:58 Becket Qin, wrote: > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new

Re: [ANNOUNCE] New Committer: Dong Lin

Congrats Dong! On Wed, Mar 28, 2018 at 12:04 PM, Mickael Maison wrote: > Congratulations Dong! > > On Wed, Mar 28, 2018 at 7:31 PM, Ismael Juma wrote: > > Congratulations Dong! Thanks for your contributions so far and looking > > forward to future

Re: [DISCUSS] KIP-255: OAuth Authentication via SASL/OAUTHBEARER

Hi Rajini. I have adjusted the KIP to use callbacks and callback handlers throughout. I also clarified that production implementations of the retrieval and validation callback handlers will require the use of an open source JWT library, and the unsecured implementations are as far as

Re: [DISCUSS] KIP-269: Substitution Within Configuration Values

Hi everyone. There have been no comments on this KIP, so I intend to put it to a vote next week if there are no comments that might entail changes between now and then. Please take a look in the meantime if you wish. Ron On Thu, Mar 15, 2018 at 2:36 PM, Ron Dagostino wrote:

Re: [DISCUSS] KIP-275 - Indicate "isClosing" in the SinkTaskContext

Hey Ted, I have not, actually! Do you think that we're likely to add multiple states here soon? My instinct is to keep it simple until there are multiple states that we would want to consider. I really like the simplicity of just getting a boolean and the implementation of WorkerSinkTask

Re: [DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

Thanks for the KIP. This was proposed previously via "KIP-30 Allow for brokers to have plug-able consensus and meta data storage sub systems" and the community was not in favour. Have you considered the points discussed then? Ismael On Wed, Mar 28, 2018 at 9:18 AM, Molnár Bálint

Re: [VOTE] KIP-272: Add API version tag to broker's RequestsPerSec metric

+1 (binding) On Wed, Mar 28, 2018 at 9:55 AM, Allen Wang wrote: > Hi All, > > I would like to start voting for KIP-272: Add API version tag to broker's > RequestsPerSec metric. > > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

RE: [VOTE] KIP-257 - Configurable Quota Management

+1 . Thanks for the KIP. -Original Message- From: Rajini Sivaram Sent: Thursday, March 22, 2018 2:57 PM To: dev Subject: [VOTE] KIP-257 - Configurable Quota Management Hi all, I would like to start vote on KIP-257 to enable customisation

[VOTE] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

Hi all, As I believe the feedback and suggestions on this KIP have been addressed so far, I'd like to start a vote. The KIP can be found at https://cwiki.apache.org/confluence/display/KAFKA/KIP-211%3A+Revise+Expiration+Semantics+of+Consumer+Group+Offsets Thanks in advance for voting :)

[jira] [Resolved] (KAFKA-6724) ConsumerPerformance resets offsets on every startup

[ https://issues.apache.org/jira/browse/KAFKA-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-6724. Resolution: Fixed Fix Version/s: 1.2.0 > ConsumerPerformance resets offsets on every

Build failed in Jenkins: kafka-trunk-jdk8 #2510

See Changes: [jason] KAFKA-6724; ConsumerPerformance should not always reset to earliest [wangguoz] MINOR: Depend on streams:test-utils for streams and examples tests --

Re: [ANNOUNCE] New Committer: Dong Lin

Congrats Dong !! From: Becket Qin Sent: Wednesday, March 28, 2018 7:58:07 PM To: dev; us...@kafka.apache.org Subject: [ANNOUNCE] New Committer: Dong Lin Hello everyone, The PMC of Apache Kafka is pleased to announce that Dong Lin has

Re: [VOTE] KIP-272: Add API version tag to broker's RequestsPerSec metric

+1 On Wed, Mar 28, 2018 at 12:05 PM, Mickael Maison wrote: > +1 (non binding) > Thanks for the KIP > > On Wed, Mar 28, 2018 at 6:25 PM, Gwen Shapira wrote: > > +1 (binding) > > > > On Wed, Mar 28, 2018 at 9:55 AM, Allen Wang >

Re: [ANNOUNCE] New Committer: Dong Lin

Congrats, Dong! -James > On Mar 28, 2018, at 10:58 AM, Becket Qin wrote: > > Hello everyone, > > The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted > our invitation to be a new Kafka committer. > > Dong started working on Kafka about four years

Build failed in Jenkins: kafka-trunk-jdk9 #516

See Changes: [github] MINOR: Downgrade to Gradle 4.5.1 (#4791) -- [...truncated 1.48 MB...] kafka.admin.ResetConsumerGroupOffsetTest > testResetOffsetsToSpecificOffset

[DISCUSS] KIP-275 - Indicate "isClosing" in the SinkTaskContext

Hello all, I am proposing KIP-275 to improve Connect's SinkTaskContext so that Sinks can be informed in their preCommit hook if the hook is being invoked as a part of a rebalance or Connect shutdown. The KIP is here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=75977607

Re: [VOTE] KIP-211: Revise Expiration Semantics of Consumer Group Offsets

+1 (non-binding) Thanks for all the hard work on this, Vahid! -James > On Mar 28, 2018, at 10:34 AM, Vahid S Hashemian > wrote: > > Hi all, > > As I believe the feedback and suggestions on this KIP have been addressed > so far, I'd like to start a vote. > The KIP

Re: [DISCUSS] KIP-275 - Indicate "isClosing" in the SinkTaskContext

The enhancement gives SinkTaskContext state information. Have you thought of exposing the state retrieval as an enum (initially with two values) ? Thanks On Wed, Mar 28, 2018 at 6:55 PM, Matt Farmer wrote: > Hello all, > > I am proposing KIP-275 to improve Connect's

Build failed in Jenkins: kafka-trunk-jdk9 #517

See Changes: [wangguoz] HOTFIX: ignoring tests using old versions of Streams until KIP-268 is -- [...truncated 1.48 MB...] kafka.admin.ResetConsumerGroupOffsetTest >

Re: [DISCUSS] KIP-275 - Indicate "isClosing" in the SinkTaskContext

I looked at WorkerSinkTask and it seems using a boolean for KIP-275 should suffice for now. Thanks On Wed, Mar 28, 2018 at 7:20 PM, Matt Farmer wrote: > Hey Ted, > > I have not, actually! > > Do you think that we're likely to add multiple states here soon? > > My instinct is to

Jenkins build is back to normal : kafka-trunk-jdk8 #2512

See

Re: [DISCUSS] KIP-274: Kafka Streams Skipped Records Metrics

Looks good to me. On Wed, Mar 28, 2018 at 3:11 PM, John Roesler wrote: > Hello all, > > I am proposing KIP-274 to improve the metrics around skipped records in > Streams. > > Please find the details here: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- >

[jira] [Created] (KAFKA-6725) Indicate "isClosing" in the SinkTaskContext

Matt Farmer created KAFKA-6725: -- Summary: Indicate "isClosing" in the SinkTaskContext Key: KAFKA-6725 URL: https://issues.apache.org/jira/browse/KAFKA-6725 Project: Kafka Issue Type: New

Jenkins build is back to normal : kafka-trunk-jdk7 #3298

See

[jira] [Resolved] (KAFKA-6723) Separate "max.poll.record" for restore consumer and common consumer

[ https://issues.apache.org/jira/browse/KAFKA-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6723. -- Resolution: Duplicate > Separate "max.poll.record" for restore consumer and common consumer >

Re: [DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

Not sure if this is entirely relevant, but figure folks might be interested: it's early days for us, but we're currently running Kafka+ZK in AWS on Kubernetes StatefulSets with the magic annotation to publish "not ready" addresses (can't recall what it is off the top of my head). It seems stable

[DISCUSS] KIP-274: Kafka Streams Skipped Records Metrics

Hello all, I am proposing KIP-274 to improve the metrics around skipped records in Streams. Please find the details here: https://cwiki.apache.org/confluence/display/KAFKA/KIP-274%3A+Kafka+Streams+Skipped+Records+Metrics Please let me know what you think! Thanks, -John

答复: [ANNOUNCE] New Committer: Dong Lin

Congrats, Dong Lin! 发件人: Matthias J. Sax 发送时间: 2018年3月29日 6:37 收件人: us...@kafka.apache.org; dev@kafka.apache.org 主题: Re: [ANNOUNCE] New Committer: Dong Lin Congrats! On 3/28/18 1:16 PM, James Cheng wrote: > Congrats, Dong! > > -James >

Re: [ANNOUNCE] New Committer: Dong Lin

Congrats! On 3/28/18 1:16 PM, James Cheng wrote: > Congrats, Dong! > > -James > >> On Mar 28, 2018, at 10:58 AM, Becket Qin wrote: >> >> Hello everyone, >> >> The PMC of Apache Kafka is pleased to announce that Dong Lin has accepted >> our invitation to be a new Kafka

Build failed in Jenkins: kafka-trunk-jdk8 #2511

See Changes: [github] MINOR: Change getMessage to toString (#4790) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H32

Re: [DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

Here's a link to the previous discussion: https://lists.apache.org/thread.html/2bc187040051008452b40b313db06b476c248ef7a5ed7529afe7b118@1448997154@%3Cdev.kafka.apache.org%3E Ismael On Wed, Mar 28, 2018 at 10:40 AM, Ismael Juma wrote: > Hi Gwen, > > I don't think the reasons

Build failed in Jenkins: kafka-trunk-jdk7 #3297

See Changes: [github] MINOR: Change getMessage to toString (#4790) -- Started by an SCM change [EnvInject] - Loading node environment variables. Building remotely on H21

Build failed in Jenkins: kafka-trunk-jdk8 #2509

See Changes: [rajinisivaram] KAFKA-6716: Should close the `discardChannel` in -- Started by an SCM change [EnvInject] - Loading node environment variables. Building

Build failed in Jenkins: kafka-trunk-jdk7 #3295

See Changes: [rajinisivaram] KAFKA-6716: Should close the `discardChannel` in -- Started by an SCM change [EnvInject] - Loading node environment variables. Building

[DISCUSS] KIP-273 Kafka to support using ETCD beside Zookeeper

Hi all, I have created KIP-273: Kafka to support using ETCD beside Zookeeper Here is the link to the KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-273+-+Kafka+to+support+using+ETCD+beside+Zookeeper Looking forward to the discussion. Thanks, Balint