[jira] [Commented] (KAFKA-7739) Kafka Tiered Storage

[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765500#comment-17765500 ] Evan Williams commented on KAFKA-7739: -- Great work [~satish.duggana] . However, will this make 3.6.0

[jira] [Commented] (KAFKA-7739) Kafka Tiered Storage

[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17616235#comment-17616235 ] Evan Williams commented on KAFKA-7739: -- [~satish.duggana] How is this KIP moving along? 3.3.1 is

[jira] [Commented] (KAFKA-9119) KIP-500: Replace ZooKeeper with a Metadata Quorum

[ https://issues.apache.org/jira/browse/KAFKA-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17435296#comment-17435296 ] Evan Williams commented on KAFKA-9119: -- What is the plan/goal for KRaft to come out of early access

[jira] [Comment Edited] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105612#comment-17105612 ] Evan Williams edited comment on KAFKA-9963 at 5/12/20, 5:09 PM:

[jira] [Commented] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105612#comment-17105612 ] Evan Williams commented on KAFKA-9963: -- [~ishworgurung] Essentially on a 4vcpu (EC2 R5) instance, we

[jira] [Resolved] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams resolved KAFKA-9963. -- Resolution: Abandoned > High CPU during replication of replaced (empty) broker >

[jira] [Updated] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU during replication of replaced (empty) broker

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Summary: High CPU during replication of replaced (empty) broker (was: High CPU) > High CPU

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Updated] (KAFKA-9963) High CPU

[ https://issues.apache.org/jira/browse/KAFKA-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Williams updated KAFKA-9963: - Description: When replacing a broker, with an empty data dir, and the same broker ID - we are

[jira] [Created] (KAFKA-9963) High CPU

Evan Williams created KAFKA-9963: Summary: High CPU Key: KAFKA-9963 URL: https://issues.apache.org/jira/browse/KAFKA-9963 Project: Kafka Issue Type: Bug Components: core

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099550#comment-17099550 ] Evan Williams edited comment on KAFKA-4084 at 5/5/20, 6:08 AM: --- Apologies

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099550#comment-17099550 ] Evan Williams commented on KAFKA-4084: -- Apologies for the delayed response [~sql_consulting]. Have

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085948#comment-17085948 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting]  Many thanks for that! I've just started

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076167#comment-17076167 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] Many thanks for that details info. Sounds

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076092#comment-17076092 ] Evan Williams edited comment on KAFKA-4084 at 4/6/20, 7:35 AM: ---

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076092#comment-17076092 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] Thanks. Yes, I already have that logic

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076064#comment-17076064 ] Evan Williams edited comment on KAFKA-4084 at 4/6/20, 7:29 AM: --- Much

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076064#comment-17076064 ] Evan Williams edited comment on KAFKA-4084 at 4/6/20, 7:24 AM: --- Much

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17076064#comment-17076064 ] Evan Williams commented on KAFKA-4084: -- Much appreciated [~sql_consulting].  I've requested access

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073581#comment-17073581 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] Thanks! No stress at all. :) > automated

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17070032#comment-17070032 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] No pressure from my side, but how's

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049088#comment-17049088 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] No problem! Thanks for your help here.

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042554#comment-17042554 ] Evan Williams commented on KAFKA-4084: -- [~wushujames] Yes, I've now decided to set 

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039861#comment-17039861 ] Evan Williams commented on KAFKA-4084: -- [~sriharsha] That would be great. We are using Confluent

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035517#comment-17035517 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] [~junrao] FYI, I implemented separation

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17035517#comment-17035517 ] Evan Williams edited comment on KAFKA-4084 at 2/12/20 5:08 PM: ---

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032604#comment-17032604 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] That would be great! We are running the

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032285#comment-17032285 ] Evan Williams edited comment on KAFKA-4084 at 2/7/20 1:07 PM: --

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032285#comment-17032285 ] Evan Williams edited comment on KAFKA-4084 at 2/7/20 11:58 AM: ---

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032285#comment-17032285 ] Evan Williams edited comment on KAFKA-4084 at 2/7/20 10:57 AM: ---

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032285#comment-17032285 ] Evan Williams edited comment on KAFKA-4084 at 2/7/20 10:44 AM: ---

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032285#comment-17032285 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] We are using min.insync.replicas=1.  And

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17032200#comment-17032200 ] Evan Williams commented on KAFKA-4084: -- [~junrao] Yes, I can see that it's been throttled to

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031971#comment-17031971 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 10:00 PM: --- [~junrao]

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031971#comment-17031971 ] Evan Williams commented on KAFKA-4084: -- [~junrao] My monitoring (datadog) isn't set up for that

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031971#comment-17031971 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 9:54 PM: -- [~junrao] My

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 9:10 PM: -- [~junrao] 

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 9:07 PM: -- [~junrao] 

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 9:07 PM: -- [~junrao] 

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 9:04 PM: -- [~junrao] 

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 8:58 PM: -- [~junrao] 

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams edited comment on KAFKA-4084 at 2/6/20 8:39 PM: -- [~junrao] 

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17031916#comment-17031916 ] Evan Williams commented on KAFKA-4084: -- [~junrao] I've implemented throttling now. Even on quite a

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030825#comment-17030825 ] Evan Williams commented on KAFKA-4084: -- Thanks [~junrao] Totally agree.  # Set dynamic cluster

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:27 AM: -- Thanks a lot

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:22 AM: -- Thanks a lot

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:21 AM: -- Thanks a lot

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030379#comment-17030379 ] Evan Williams edited comment on KAFKA-4084 at 2/5/20 6:13 AM: -- Thanks a lot

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17030379#comment-17030379 ] Evan Williams commented on KAFKA-4084: -- Thanks a lot guys. [~sql_consulting] I have actually

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 5:16 PM: --

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 5:15 PM: --

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029638#comment-17029638 ] Evan Williams edited comment on KAFKA-4084 at 2/4/20 8:27 AM: --

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029638#comment-17029638 ] Evan Williams commented on KAFKA-4084: -- [~sql_consulting] Many thanks for the explanation. Is there

[jira] [Comment Edited] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029058#comment-17029058 ] Evan Williams edited comment on KAFKA-4084 at 2/3/20 4:40 PM: --  We are

[jira] [Comment Edited] (KAFKA-8796) A broker joining the cluster should be able to replicate without impacting the cluster

[ https://issues.apache.org/jira/browse/KAFKA-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029073#comment-17029073 ] Evan Williams edited comment on KAFKA-8796 at 2/3/20 4:29 PM: -- [~dajac] Must

[jira] [Commented] (KAFKA-8796) A broker joining the cluster should be able to replicate without impacting the cluster

[ https://issues.apache.org/jira/browse/KAFKA-8796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029073#comment-17029073 ] Evan Williams commented on KAFKA-8796: -- [~dajac] Must you enforce throttling at both the topic and

[jira] [Commented] (KAFKA-4084) automated leader rebalance causes replication downtime for clusters with too many partitions

[ https://issues.apache.org/jira/browse/KAFKA-4084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17029058#comment-17029058 ] Evan Williams commented on KAFKA-4084: --  We are seeing the same (or at least similar) issues. When