Re: MirrorMaker 2.0 - Offset Sync - Questions/Improvements

Georg, sorry for the delay, but hopefully I can still help. 1) I think the detail you're missing is that the offset syncs are very sparse. Normally, you only get a new sync when the Connector first starts running. You are right that it is possible for a consumer to lag behind the most recent

Re: [DISCUSS] KIP-722: Enable connector client overrides by default

Thanks Randall, makes sense to me. Ryanne On Tue, Mar 16, 2021, 4:31 PM Randall Hauch wrote: > Hello all, > > I'd like to propose KIP-722 to change the default value of the existing > `connector.client.config.override.policy` Connect worker configuration, so > that by default connectors can

Re: [ANNOUNCE] New Kafka PMC Member: Chia-Ping Tsai

Best, Dongjin On Tue, Mar 16, 2021 at 2:20 PM Konstantine Karantasis wrote: > Congratulations Chia-Ping! > > Konstantine > > On Mon, Mar 15, 2021 at 4:31 AM Rajini Sivaram > wrote: > > > Congratulations, Chia-Ping, well deserved! > > > > Regards, > > > > Rajini > > > > On Mon, Mar 15,

Re: [ANNOUNCE] New committer: Tom Bentley

Congratulations, Tom! Your contributions are always great!! +1. Thanks for supporting KIP-653: Upgrade log4j to log4j2 again. Best, Dongjin On Tue, Mar 16, 2021 at 8:24 PM Rajini Sivaram wrote: > Congratulations, Tom! > > Regards, > > Rajini > > On Tue, Mar 16, 2021 at 10:39 AM Satish Duggana

request permission to create KIP

Hello! I create improvement task https://issues.apache.org/jira/browse/KAFKA-12481 and offered pull request https://github.com/apache/kafka/pull/10333 that solves it. ijuma

Kafka logos and branding

Hi, As I mentioned on the dev list I can see the logos for the Kafka project are out of date. [1] Just a suggestion - which you are free to ignore. From a branding and trademark perspective it's going to help the project if 3rd parties have access to the correct logos. Having something on your

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #66

See Changes: [Ismael Juma] KAFKA-12455: Fix OffsetValidationTest.test_broker_rolling_bounce failure with Raft (#10322) -- [...truncated 7.25 MB...]

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #576

See

Jenkins build is back to normal : Kafka » kafka-trunk-jdk11 #605

See

[jira] [Created] (KAFKA-12487) Sink connectors do not work with the cooperative consumer rebalance protocol

Chris Egerton created KAFKA-12487: - Summary: Sink connectors do not work with the cooperative consumer rebalance protocol Key: KAFKA-12487 URL: https://issues.apache.org/jira/browse/KAFKA-12487

[jira] [Created] (KAFKA-12488) Be more specific about enabled SASL mechnanisms in system tests

Ron Dagostino created KAFKA-12488: - Summary: Be more specific about enabled SASL mechnanisms in system tests Key: KAFKA-12488 URL: https://issues.apache.org/jira/browse/KAFKA-12488 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #634

See Changes: [github] MINOR: Add toString to various Kafka Metrics classes (#10330) [github] KAFKA-12455: Fix OffsetValidationTest.test_broker_rolling_bounce failure with Raft (#10322)

[jira] [Created] (KAFKA-12486) Utilize HighAvailabilityTaskAssignor to avoid downtime on corrupted task

A. Sophie Blee-Goldman created KAFKA-12486: -- Summary: Utilize HighAvailabilityTaskAssignor to avoid downtime on corrupted task Key: KAFKA-12486 URL: https://issues.apache.org/jira/browse/KAFKA-12486

[DISCUSS] KIP-722: Enable connector client overrides by default

Hello all, I'd like to propose KIP-722 to change the default value of the existing `connector.client.config.override.policy` Connect worker configuration, so that by default connectors can override client properties.The details are here:

[DISCUSS] KIP-721: Enable connector log contexts in Connect Log4j configuration

Hello all, I'd like to propose KIP-721 to change Connect's Log4J configuration that we ship with AK. This KIP will enable by default Connect's valuable connector log contexts, which was added as part of KIP-449 to include connector- and task-specific information to every log message output by the

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

Hi Sophie, Thank you for the explanation regarding "ClientTagsVersion". Now I got it! After this discussion, for the sake of robustness I am in favor of just writing the strings into the subscription info. Maybe, we can limit the maximum length of a tag and the maximum amount of tags. The

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #633

See Changes: [github] KAFKA-12427: Don't update connection idle time for muted connections (#10267) [github] KAFKA-12330; FetchSessionCache may cause starvation for partitions when FetchResponse

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #575

See Changes: [github] KAFKA-12427: Don't update connection idle time for muted connections (#10267) [github] KAFKA-12330; FetchSessionCache may cause starvation for partitions when FetchResponse

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #604

See Changes: [github] KAFKA-12427: Don't update connection idle time for muted connections (#10267) [github] KAFKA-12330; FetchSessionCache may cause starvation for partitions when FetchResponse

Re: Proposed breaking changes for Connect in AK 3.0.0

Thanks Randall for kicking this off. Are there similar pages for the other ecosystem components and APIs that is part of the 3.0.0 release? It will be great to have a central page and then have this page as a subset of that collection On Tue, Mar 16, 2021 at 4:38 PM Randall Hauch wrote: > The

Proposed breaking changes for Connect in AK 3.0.0

The next release of AK will be 3.0.0. Since this is a major release, we have an opportunity to: - remove previously deprecated worker configuration properties; and - change some of Connect's defaults that were chosen previously to maintain backward compatibility, but for which there are

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #65

See Changes: [A. Sophie Blee-Goldman] HOTFIX: timeout issue in removeStreamThread() (#10321) -- [...truncated 3.60 MB...] SocketServerTest >

Request permission to create KIP

Hello! I create improvement task https://issues.apache.org/jira/browse/KAFKA-12481 and offered pull request https://github.com/apache/kafka/pull/10333 that solves it. ijuma

[jira] [Created] (KAFKA-12485) Speed up Consumer#committed by returning cached offsets for owned partitions

A. Sophie Blee-Goldman created KAFKA-12485: -- Summary: Speed up Consumer#committed by returning cached offsets for owned partitions Key: KAFKA-12485 URL: https://issues.apache.org/jira/browse/KAFKA-12485

Jenkins build is back to normal : Kafka » kafka-trunk-jdk15 #632

See

[jira] [Created] (KAFKA-12484) Enable Connect's connector log contexts by default

Randall Hauch created KAFKA-12484: - Summary: Enable Connect's connector log contexts by default Key: KAFKA-12484 URL: https://issues.apache.org/jira/browse/KAFKA-12484 Project: Kafka Issue

[jira] [Created] (KAFKA-12483) Enable client overrides in connector configs by default

Randall Hauch created KAFKA-12483: - Summary: Enable client overrides in connector configs by default Key: KAFKA-12483 URL: https://issues.apache.org/jira/browse/KAFKA-12483 Project: Kafka

[jira] [Created] (KAFKA-12482) Remove deprecated Connect worker configs

Randall Hauch created KAFKA-12482: - Summary: Remove deprecated Connect worker configs Key: KAFKA-12482 URL: https://issues.apache.org/jira/browse/KAFKA-12482 Project: Kafka Issue Type:

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

> > Could we not reuse the version of the subscription > data? What are the main benefits of introducing "ClientTagsVersion"? No, this version would have to be distinct from the protocol version that we use for the subscription itself. The reason being that the SubscriptionInfo version is only

[jira] [Resolved] (KAFKA-12330) FetchSessionCache may cause starvation for partitions when FetchResponse is full

[ https://issues.apache.org/jira/browse/KAFKA-12330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-12330. Fix Version/s: 3.0.0 Resolution: Fixed > FetchSessionCache may cause starvation

[jira] [Resolved] (KAFKA-12427) Broker does not close muted idle connections with buffered data

[ https://issues.apache.org/jira/browse/KAFKA-12427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-12427. Fix Version/s: 3.0.0 Reviewer: Rajini Sivaram Resolution: Fixed > Broker

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #603

See Changes: [github] MINOR; Various code cleanups (#10319) -- [...truncated 7.38 MB...] BrokerEndPointTest > testFromJsonV5() PASSED PartitionLockTest >

[jira] [Created] (KAFKA-12481) Add socket.nagle.disable config to reduce number of packets

Andrei Iatsuk created KAFKA-12481: - Summary: Add socket.nagle.disable config to reduce number of packets Key: KAFKA-12481 URL: https://issues.apache.org/jira/browse/KAFKA-12481 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #574

See Changes: [github] MINOR; Various code cleanups (#10319) -- [...truncated 3.67 MB...] LogValidatorTest > testUncompressedBatchWithoutRecordsNotAllowed()

[jira] [Created] (KAFKA-12480) Reuse bootstrap servers in clients when last alive broker in cluster metadata is unavailable

Ron Dagostino created KAFKA-12480: - Summary: Reuse bootstrap servers in clients when last alive broker in cluster metadata is unavailable Key: KAFKA-12480 URL: https://issues.apache.org/jira/browse/KAFKA-12480

[GitHub] [kafka-site] tombentley commented on pull request #337: Add tombentley to committers

tombentley commented on pull request #337: URL: https://github.com/apache/kafka-site/pull/337#issuecomment-800299348 Thanks @guozhangwang! This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [kafka-site] tombentley merged pull request #337: Add tombentley to committers

tombentley merged pull request #337: URL: https://github.com/apache/kafka-site/pull/337 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

Forgot to say ... I am fine with the rest of the name you proposed, i.e., "task.rack.aware.assignment.tags". Best, Bruno On 16.03.21 09:30, Bruno Cadonna wrote: Hi Sophie, I am +1, for explicitly documenting that this list must be identical in contents and order across all clients in the

[jira] [Created] (KAFKA-12479) Combine partition offset requests into single request in ConsumerGroupCommand

Rajini Sivaram created KAFKA-12479: -- Summary: Combine partition offset requests into single request in ConsumerGroupCommand Key: KAFKA-12479 URL: https://issues.apache.org/jira/browse/KAFKA-12479

Re: [ANNOUNCE] New committer: Tom Bentley

Congratulations, Tom! Regards, Rajini On Tue, Mar 16, 2021 at 10:39 AM Satish Duggana wrote: > Congratulations Tom!! > > On Tue, 16 Mar 2021 at 13:30, David Jacot > wrote: > > > Congrats, Tom! > > > > On Tue, Mar 16, 2021 at 7:40 AM Kamal Chandraprakash < > > kamal.chandraprak...@gmail.com>

Re: [ANNOUNCE] New committer: Tom Bentley

Congratulations Tom!! On Tue, 16 Mar 2021 at 13:30, David Jacot wrote: > Congrats, Tom! > > On Tue, Mar 16, 2021 at 7:40 AM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > Congrats, Tom! > > > > On Tue, Mar 16, 2021 at 8:32 AM Konstantine Karantasis > > wrote: > > > > >

Re: [VOTE] KIP-708: Rack awareness for Kafka Streams

Hi Sophie, I am +1, for explicitly documenting that this list must be identical in contents and order across all clients in the application in the KIP. And later in the docs of the config. If we are too much concerned about this and we think that we should explicitly check the order and

Re: [ANNOUNCE] New committer: Tom Bentley

Congrats, Tom! On Tue, Mar 16, 2021 at 7:40 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Congrats, Tom! > > On Tue, Mar 16, 2021 at 8:32 AM Konstantine Karantasis > wrote: > > > Congratulations Tom! > > Well deserved. > > > > Konstantine > > > > On Mon, Mar 15, 2021 at

[jira] [Created] (KAFKA-12478) Consumer group may lose data for newly expanded partitions when add partitions for topic if the group is set to consume from the latest

hudeqi created KAFKA-12478: -- Summary: Consumer group may lose data for newly expanded partitions when add partitions for topic if the group is set to consume from the latest Key: KAFKA-12478 URL:

Re: [ANNOUNCE] New committer: Tom Bentley

Congrats, Tom! On Tue, Mar 16, 2021 at 8:32 AM Konstantine Karantasis wrote: > Congratulations Tom! > Well deserved. > > Konstantine > > On Mon, Mar 15, 2021 at 4:52 PM Luke Chen wrote: > > > Congratulations! > > > > Federico Valeri 於 2021年3月16日 週二 上午4:11 寫道： > > > > > Congrats, Tom! > > > >