Re: [DISCUSS] KIP-708: Rack aware Kafka Streams with pluggable StandbyTask assignor

Hi Levani, I discussed your KIP with John the other day and we both think it is a really interesting KIP and you did a good job in writing it. However, we think that the KIP exposes to many implementation details. That makes future changes to the implementation of the distribution algorithm

Re: Contributor Permissions Request

Hi Brian, I've granted you Contributor permissions. Thanks for your interest in Kafka On Thu, Feb 25, 2021 at 1:39 PM Brian Meehan wrote: > > Dear Kafka Contributor/PMC Member, > > I would like to request Kafka contributor permissions. My JIRA username is > *brianmeehan* - please let me know if

Contributor Permissions Request

Dear Kafka Contributor/PMC Member, I would like to request Kafka contributor permissions. My JIRA username is *brianmeehan* - please let me know if you need additional info. Thank you for your help! Brian Meehan

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

Thanks for the updates Walker. Some replies and follow-up questions: 1. I agree one task could have multiple partitions, but when we hit a delay in terms of offset progress, do we have a convenient way to reverse mapping TopicPartition to the problematic task? In production, I believe it would be

[jira] [Created] (KAFKA-12375) ReplaceStreamThread creates a new consumer with the same name as the one it's replacing

Tomasz Nguyen created KAFKA-12375: - Summary: ReplaceStreamThread creates a new consumer with the same name as the one it's replacing Key: KAFKA-12375 URL: https://issues.apache.org/jira/browse/KAFKA-12375

[VOTE] KIP-699: Update FindCoordinator to resolve multiple Coordinators at a time

Hi, I'd like to start a vote on KIP-699 to support resolving multiple coordinators at a time: https://cwiki.apache.org/confluence/display/KAFKA/KIP-699%3A+Update+FindCoordinator+to+resolve+multiple+Coordinators+at+a+time Thanks

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

Regarding the second API and the `TaskStatus` class: I'd suggest we consolidate on the existing `TaskMetadata` since we have already accumulated a bunch of such classes, and its better to keep them small as public APIs. You can see https://issues.apache.org/jira/browse/KAFKA-12370 for a reference

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

Thanks for the follow up Boyang and Guozhang, I have updated the kip to include these ideas. Guozhang, that is a good idea about using the TaskMetadata. We can get it through the ThreadMetadata with a minor change to `localThreadMetadata` in kafkaStreams. This means that we will only need to

Re: [DISCUSS] KIP-715: Expose Committed offset in streams

For the 3rd point, yes, what I'm proposing is an edge case. For example, when we have 4 tasks [0_0, 0_1, 1_0, 1_1], and a bug in rebalancing logic causing no one gets 1_1 assigned. Then the health check service will only see 3 tasks [0_0, 0_1, 1_0] reporting progress normally while not paying

[jira] [Resolved] (KAFKA-12365) Block APIs not supported by kip-500 broker/controller (for now)

[ https://issues.apache.org/jira/browse/KAFKA-12365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-12365. - Resolution: Fixed > Block APIs not supported by kip-500 broker/controller (for now) >

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #41

See Changes: [Jason Gustafson] KAFKA-12365; Disable APIs not supported by KIP-500 broker/controller (#10194) -- [...truncated 3.60 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #572

See Changes: [github] KAFKA-12365; Disable APIs not supported by KIP-500 broker/controller (#10194) -- [...truncated 3.66 MB...] AclAuthorizerTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #515

See Changes: [github] DOCS: Update protocol doc for missing data type (#10162) -- Started by an SCM change Running as SYSTEM [EnvInject] - Loading node

[jira] [Resolved] (KAFKA-7188) Avoid reverse DNS lookup in SASL channel builder

[ https://issues.apache.org/jira/browse/KAFKA-7188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-7188. -- Assignee: (was: Rajini Sivaram) Resolution: Duplicate > Avoid reverse DNS lookup in SASL

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #514

See Changes: [github] KAFKA-12365; Disable APIs not supported by KIP-500 broker/controller (#10194) -- [...truncated 7.29 MB...] ReplicaStateMachineTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #571

See Changes: [github] KAFKA-8562; SaslChannelBuilder - Avoid (reverse) DNS lookup while building SslTransportLayer (#10059) [github] MINOR: tune KIP-631 configurations (#10179)

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #40

See Changes: [Colin McCabe] MINOR: tune KIP-631 configurations (#10179) -- [...truncated 3.61 MB...] SocketServerTest > testMaxConnectionsPerIp() PASSED

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #542

See Changes: [github] MINOR: fix syntax error in upgrade_test.py (#10210) -- [...truncated 3.68 MB...] KafkaZkClientTest >

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #570

See Changes: [github] KAFKA-12367; Ensure partition epoch is propagated to `Partition` state (#10200) -- [...truncated 3.67 MB...] ConsumerPerformanceTest

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #544

See Changes: [github] KAFKA-8562; SaslChannelBuilder - Avoid (reverse) DNS lookup while building SslTransportLayer (#10059) [github] MINOR: tune KIP-631 configurations (#10179)

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #545

See Changes: [github] KAFKA-12365; Disable APIs not supported by KIP-500 broker/controller (#10194) -- [...truncated 3.65 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #513

See Changes: [github] KAFKA-8562; SaslChannelBuilder - Avoid (reverse) DNS lookup while building SslTransportLayer (#10059) [github] MINOR: tune KIP-631 configurations (#10179)

[GitHub] [kafka-site] chia7712 commented on pull request #332: KAFKA-12350: correct the wrong default value in doc

chia7712 commented on pull request #332: URL: https://github.com/apache/kafka-site/pull/332#issuecomment-786457377 @showuon Thanks for this patch :) This is an automated message from the Apache Git Service. To respond to the

[GitHub] [kafka-site] chia7712 merged pull request #332: KAFKA-12350: correct the wrong default value in doc

chia7712 merged pull request #332: URL: https://github.com/apache/kafka-site/pull/332 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Created] (KAFKA-12376) Use scheduleAtomicAppend for records that need to be atomic

Jose Armando Garcia Sancio created KAFKA-12376: -- Summary: Use scheduleAtomicAppend for records that need to be atomic Key: KAFKA-12376 URL: https://issues.apache.org/jira/browse/KAFKA-12376

Jenkins build is back to normal : Kafka » kafka-2.8-jdk8 #39

See

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #511

See Changes: [github] MINOR: fix syntax error in upgrade_test.py (#10210) -- [...truncated 3.65 MB...] TransactionsTest >

Build failed in Jenkins: Kafka » kafka-2.8-jdk8 #38

See Changes: [Colin McCabe] MINOR: fix syntax error in upgrade_test.py (#10210) -- [...truncated 7.22 MB...] SocketServerTest > testConnectionId() PASSED

[jira] [Resolved] (KAFKA-8562) SASL_SSL still performs reverse DNS lookup despite KAFKA-5051

[ https://issues.apache.org/jira/browse/KAFKA-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-8562. Fix Version/s: 3.0.0 Resolution: Fixed > SASL_SSL still performs reverse DNS lookup

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #569

See Changes: [github] MINOR: fix syntax error in upgrade_test.py (#10210) -- [...truncated 3.66 MB...] AclAuthorizerTest > testEmptyAclThrowsException()

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #543

See Changes: [github] KAFKA-12367; Ensure partition epoch is propagated to `Partition` state (#10200) -- [...truncated 7.33 MB...]

[GitHub] [kafka-site] showuon commented on pull request #332: KAFKA-12350: correct the wrong default value in doc

showuon commented on pull request #332: URL: https://github.com/apache/kafka-site/pull/332#issuecomment-786370398 @chia7712 , could you also review this PR? Same as this one: apache/kafka#10165, Just in kafka-site repo. Thanks.

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #512

See Changes: [github] KAFKA-12367; Ensure partition epoch is propagated to `Partition` state (#10200) -- [...truncated 3.63 MB...] LogCleanerTest >

[GitHub] [kafka-site] nicodds commented on pull request #333: Added documentation fix for KAFKA-12360

nicodds commented on pull request #333: URL: https://github.com/apache/kafka-site/pull/333#issuecomment-785721349 ehy @mjsax, thank you for you reply. I've made a PR also to the source code, here it is: https://github.com/apache/kafka/pull/10207