Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #464

See Changes: [github] KAFKA-10866: Add metadata to ConsumerRecords (#9836) [github] MINOR: Upgrade to Scala 2.12.13 (#9981) -- [...truncated 3.57 MB...]

[jira] [Resolved] (KAFKA-10658) ErrantRecordReporter.report always return completed future even though the record is not sent to DLQ topic yet

[ https://issues.apache.org/jira/browse/KAFKA-10658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10658. Fix Version/s: 2.6.2 2.7.1 2.8.0 Resolution:

Re: Requesting review of a long pending Kafka Connect balanced task distribution PR

I'm on it Ramesh. Thanks for the contribution and the notification. Expect my second round of comments within the next few days. Konstantine On Tue, Jan 19, 2021 at 8:44 AM ramesh krishnan muthusamy < ramkrish1...@gmail.com> wrote: > Hi Team, > > This is a major fix required to use consumer

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

Thanks Jason for the thoughts. On Wed, Jan 27, 2021 at 11:52 AM Jason Gustafson wrote: > Hi Boyang, > > Thanks for the iterations here. I think this is something we should have > done a long time ago. It sounds like there are two API changes here: > > 1. We are introducing the

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #415

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #446

See Changes: [github] KAFKA-10866: Add metadata to ConsumerRecords (#9836) -- [...truncated 3.58 MB...] TestTopicsTest > testKeyValue() STARTED

Re: Impact of setting max.inflight.requests.per.connection > 1 in Kafka connect

There should not be any data loss. However, if a request fails and is retried, it may lead to reordering of sends. Thus, records would not be ordered based on the `send()` calls any longer. If you would enable idempotent writes, ordering is guaranteed even with multiple in-flight requests per

Re: [DISCUSS] Apache Kafka 2.6.2 release

Thanks for taking this on Sophie. +1 Bill On Wed, Jan 27, 2021 at 5:59 PM Ismael Juma wrote: > Thanks Sophie! +1 > > Ismael > > On Wed, Jan 27, 2021 at 2:45 PM Sophie Blee-Goldman > wrote: > > > Hi all, > > > > I'd like to volunteer as release manager for a 2.6.2 release. This is > being > >

Re: [DISCUSS] Apache Kafka 2.6.2 release

Thanks Sophie! +1 Ismael On Wed, Jan 27, 2021 at 2:45 PM Sophie Blee-Goldman wrote: > Hi all, > > I'd like to volunteer as release manager for a 2.6.2 release. This is being > accelerated > to address a critical regression in Kafka Streams for Windows users. > > You can find the release plan

Re: 2.6.1 Critical Regression

Thanks Sophie! Ismael On Wed, Jan 27, 2021 at 2:45 PM Sophie Blee-Goldman wrote: > Yes, the change is in Kafka Streams, so the kafka-clients jar would not be > sufficient. > > I've just sent out a note to the mailing list volunteering to be the > release manager for a > 2.6.2 release. I think

Re: 2.6.1 Critical Regression

My apologies; I blame keyboard memory - I mostly work with kafka-clients. Sophie, many thanks for stepping up to the plate on this one. From: Sophie Blee-Goldman Sent: Wednesday, January 27, 2021 5:45 PM To: dev Subject: Re: 2.6.1 Critical Regression Yes, the

Re: 2.6.1 Critical Regression

Yes, the change is in Kafka Streams, so the kafka-clients jar would not be sufficient. I've just sent out a note to the mailing list volunteering to be the release manager for a 2.6.2 release. I think we can get this out in a timely manner Thanks Gary On Tue, Jan 26, 2021 at 12:43 PM Ismael

[DISCUSS] Apache Kafka 2.6.2 release

Hi all, I'd like to volunteer as release manager for a 2.6.2 release. This is being accelerated to address a critical regression in Kafka Streams for Windows users. You can find the release plan on the wiki: https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+2.6.2 Thanks, Sophie

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #414

See Changes: [github] KAFKA-8930: MirrorMaker v2 documentation (#324) (#9983) -- [...truncated 3.57 MB...] MockProcessorContextStateStoreTest > builder =

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Thanks Bruno, that sounds like a good addition. +1 On Wed, Jan 27, 2021 at 12:34 PM Bruno Cadonna wrote: > Hi all, > > During the implementation, we notices that method removeStreamThread() > may block indefinitely when the stream thread chosen for removal is > blocked and cannot be shut down.

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #445

See Changes: [github] KAFKA-8930: MirrorMaker v2 documentation (#324) (#9983) -- [...truncated 3.57 MB...] OutputVerifierTest >

Re: [VOTE] KIP-663: API to Start and Shut Down Stream Threads and to Request Closing of Kafka Streams Clients

Hi all, During the implementation, we notices that method removeStreamThread() may block indefinitely when the stream thread chosen for removal is blocked and cannot be shut down. Thus, we will add an overload that takes a timeout. The newly added method will throw a TimeoutException, when

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Hi Bruno, I'm still +1, non-binding. Thanks for the updates! Leah On Wed, Jan 27, 2021 at 1:56 PM Matthias J. Sax wrote: > Thanks for updating the KIP. > > +1 (binding) > > > -Matthias > > On 1/27/21 10:19 AM, Bruno Cadonna wrote: > > Hi all, > > > > Thanks for voting! > > > > I updated the

Build failed in Jenkins: Kafka » kafka-2.7-jdk8 #108

See Changes: [Bill Bejeck] KAFKA-8930: MirrorMaker v2 documentation (#324) (#9983) -- [...truncated 3.44 MB...]

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Thanks for updating the KIP. +1 (binding) -Matthias On 1/27/21 10:19 AM, Bruno Cadonna wrote: > Hi all, > > Thanks for voting! > > I updated the KIP with some additional feedback I got. > > If I do not hear anything from folks that have already voted in the next > couple of days, I will

Re: [DISCUSS] KIP-691: Transactional Producer Exception Handling

Hi Boyang, Thanks for the iterations here. I think this is something we should have done a long time ago. It sounds like there are two API changes here: 1. We are introducing the `CommitFailedException` to wrap abortable errors that are raised from `commitTransaction`. This sounds fine to me. As

Impact of setting max.inflight.requests.per.connection > 1 in Kafka connect

Hi All, I see that max.inflight.requests.per.connection is set to 1 explicitly in Kafka Connect but there is a way to override it. I want to understand the impact of setting its value > 1. As per my understanding, it will lead to data loss in some cases. Is it correct ? Thank you, Nitin

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #462

See Changes: [github] MINOR: Update zookeeper to 3.5.9 (#9977) -- [...truncated 3.59 MB...] TestTopicsTest > shouldNotAllowToCreateWithNullDriver() PASSED

[GitHub] [kafka-site] bbejeck merged pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

bbejeck merged pull request #326: URL: https://github.com/apache/kafka-site/pull/326 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [kafka-site] bbejeck edited a comment on pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

bbejeck edited a comment on pull request #326: URL: https://github.com/apache/kafka-site/pull/326#issuecomment-768481852 > I didn't test this PR locally myself to ensure proper HTML rendering etc. FWIW I rendered it locally and it seemed fine

[GitHub] [kafka-site] bbejeck commented on pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

bbejeck commented on pull request #326: URL: https://github.com/apache/kafka-site/pull/326#issuecomment-768481852 > I didn't test this PR locally myself to ensure proper HTML rendering etc. FWIW I rendered it locally and it seemed fine

Re: [VOTE] KIP-698: Add Explicit User Initialization of Broker-side State to Kafka Streams

Hi all, Thanks for voting! I updated the KIP with some additional feedback I got. If I do not hear anything from folks that have already voted in the next couple of days, I will assume their vote is still valid. You can also confirm your vote if you want. KIP:

Re: [DISCUSS] Apache Kafka 2.8.0 release

Hello again, all. This is a reminder that *today* is the KIP freeze for Apache Kafka 2.8.0. The next checkpoint is the Feature Freeze on Feb 3rd. When considering any last-minute KIPs today, please be mindful of the scope, since we have only one week to merge a stable implementation of the KIP.

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #413

See Changes: [github] MINOR: Update zookeeper to 3.5.9 (#9977) -- [...truncated 3.56 MB...] MockProcessorContextStateStoreTest > builder =

[GitHub] [kafka-site] mimaison merged pull request #322: KAFKA-6223: Use archive.apache.org for older releases

mimaison merged pull request #322: URL: https://github.com/apache/kafka-site/pull/322 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #444

See Changes: [github] MINOR: Update zookeeper to 3.5.9 (#9977) -- [...truncated 3.57 MB...] TopologyTestDriverEosTest > shouldFlushStoreForFirstInput()

[GitHub] [kafka-site] miguno commented on pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

miguno commented on pull request #326: URL: https://github.com/apache/kafka-site/pull/326#issuecomment-768466468 This LGTM, though (1) there were some minor HTML changes not directly related to the original PR and (2) I didn't test this PR locally myself to ensure proper HTML rendering

[GitHub] [kafka-site] bbejeck commented on pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

bbejeck commented on pull request #326: URL: https://github.com/apache/kafka-site/pull/326#issuecomment-768461055 ping @miguno for a +1 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka-site] bbejeck opened a new pull request #326: KAFKA-8930: Port changes for MM2 docs to 2.6 docs

bbejeck opened a new pull request #326: URL: https://github.com/apache/kafka-site/pull/326 The MM2 docs are already in for 2.7 via https://github.com/apache/kafka-site/pull/324, this PR adds them to 2.6 This is an automated

[GitHub] [kafka-site] miguno commented on pull request #324: KAFKA-8930: MirrorMaker v2 documentation

miguno commented on pull request #324: URL: https://github.com/apache/kafka-site/pull/324#issuecomment-768416513 kafka/docs PR is up at https://github.com/apache/kafka/pull/9983 This is an automated message from the Apache

[GitHub] [kafka-site] bbejeck commented on pull request #324: KAFKA-8930: MirrorMaker v2 documentation

bbejeck commented on pull request #324: URL: https://github.com/apache/kafka-site/pull/324#issuecomment-768404929 > We should also add these docs to kafka/docs repo @omkreddy, yes a PR for kafka/docs is coming soon

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #461

See Changes: [github] KAFKA-12233: Align the length passed to FileChannel by `FileRecords.writeTo` (#9970) [github] MINOR: Remove redundant apostrophe in doc (#9976) [github] MINOR: Remove

[GitHub] [kafka-site] omkreddy commented on pull request #324: KAFKA-8930: MirrorMaker v2 documentation

omkreddy commented on pull request #324: URL: https://github.com/apache/kafka-site/pull/324#issuecomment-768372236 We should also add these docs to `kafka/docs` repo This is an automated message from the Apache Git Service.

[GitHub] [kafka-site] bbejeck merged pull request #324: KAFKA-8930: MirrorMaker v2 documentation

bbejeck merged pull request #324: URL: https://github.com/apache/kafka-site/pull/324 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #412

See

Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

Hi Levani, Thanks for this KIP! I think this is really high value; it was something I was disappointed I didn’t get to do as part of KIP-441. Rack awareness is a feature provided by other distributed systems as well. I wonder if your KIP could devote a section to summarizing what rack

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #443

See

Re: [DISCUSS] KIP-709: Extend OffsetFetch requests to accept multiple group ids

Hi Magnus, Thanks for the review, I've added //moved and explanation as requested. Thanks Tom On Wed, Jan 27, 2021 at 12:05 PM Magnus Edenhill wrote: > Hey Thomas, > > I'm late to the game. > > It looks like the "top level" ErrorCode moved from the top-level to the > Group array, which

Re: [VOTE] KIP-709: Extend OffsetFetch requests to accept multiple group ids.

+1 (non-binding), Thanks for the KIP. On Wed, Jan 27, 2021 at 10:33 AM David Jacot wrote: > Thanks for the KIP, Tom. > > +1 (binding) > > Best, > David > > On Wed, Jan 27, 2021 at 11:12 AM Rajini Sivaram > wrote: > > > +1 (binding) > > > > Thanks for the KIP, Tom. > > > > Regards, > > > >

Re: [DISCUSS] KIP-709: Extend OffsetFetch requests to accept multiple group ids

Hey Thomas, I'm late to the game. It looks like the "top level" ErrorCode moved from the top-level to the Group array, which makes sense, but it would be good if it was marked as // MOVED in the KIP and also a note that top level errors that are unrelated to the group will be returned as

Re: [VOTE] KIP-709: Extend OffsetFetch requests to accept multiple group ids.

Thanks for the KIP, Tom. +1 (binding) Best, David On Wed, Jan 27, 2021 at 11:12 AM Rajini Sivaram wrote: > +1 (binding) > > Thanks for the KIP, Tom. > > Regards, > > Rajini > > > On Tue, Jan 26, 2021 at 9:51 AM Thomas Scott wrote: > > > Hey all, > > > > I'd like to start the vote for > > >

Re: [VOTE] KIP-709: Extend OffsetFetch requests to accept multiple group ids.

+1 (binding) Thanks for the KIP, Tom. Regards, Rajini On Tue, Jan 26, 2021 at 9:51 AM Thomas Scott wrote: > Hey all, > > I'd like to start the vote for > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=173084258 > > Thanks > > Tom >

[jira] [Created] (KAFKA-12244) Deleting a topic within metadata.max.idle after last message floods log with warnings

Bart van Deenen created KAFKA-12244: --- Summary: Deleting a topic within metadata.max.idle after last message floods log with warnings Key: KAFKA-12244 URL: https://issues.apache.org/jira/browse/KAFKA-12244

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #442

See Changes: [github] MINOR: Call logSegments.toBuffer only when required (#9971) [github] KAFKA-12233: Align the length passed to FileChannel by `FileRecords.writeTo` (#9970)

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #411

See Changes: [github] KAFKA-10793: move handling of FindCoordinatorFuture to fix race condition (#9671) [github] MINOR: Fix meaningless message in assertNull validation (#9965)