[jira] [Updated] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

2018-09-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7441: Fix Version/s: 2.1.0 > Allow LogCleanerManager.resumeCleaning() to be used concurrently >

[jira] [Updated] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

2018-09-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7441: Reporter: xiongqi wu (was: Dong Lin) > Allow LogCleanerManager.resumeCleaning() to be used concurrently >

[jira] [Created] (KAFKA-7441) Allow LogCleanerManager.resumeCleaning() to be used concurrently

2018-09-25 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7441: --- Summary: Allow LogCleanerManager.resumeCleaning() to be used concurrently Key: KAFKA-7441 URL: https://issues.apache.org/jira/browse/KAFKA-7441 Project: Kafka Issue

[jira] [Updated] (KAFKA-3190) KafkaProducer should not invoke callback in send()

2018-09-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3190: Fix Version/s: (was: 2.1.0) 2.2.0 > KafkaProducer should not invoke callback in

[jira] [Commented] (KAFKA-3190) KafkaProducer should not invoke callback in send()

2018-09-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16627813#comment-16627813 ] Dong Lin commented on KAFKA-3190: - Since there has been no activity on the PR for several months, moving

[jira] [Updated] (KAFKA-5066) KafkaMetricsConfig properties and description notably missing from documentation

2018-09-24 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5066: Fix Version/s: 2.1.0 > KafkaMetricsConfig properties and description notably missing from > documentation

[jira] [Commented] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621050#comment-16621050 ] Dong Lin commented on KAFKA-7332: - [~wushujames] The problem described in KAFKA-4808 says that user today

[jira] [Assigned] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-7332: --- Assignee: Manikumar > Improve error message when trying to produce message without key for >

[jira] [Resolved] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7332. - Resolution: Fixed > Improve error message when trying to produce message without key for > compacted

[jira] [Updated] (KAFKA-7332) Improve error message when trying to produce message without key for compacted topic

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7332: Fix Version/s: 2.1.0 > Improve error message when trying to produce message without key for > compacted

[jira] [Updated] (KAFKA-7322) Fix race condition between log cleaner thread and log retention thread when topic cleanup policy is updated

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7322: Fix Version/s: 2.1.0 > Fix race condition between log cleaner thread and log retention thread when >

[jira] [Resolved] (KAFKA-7322) Fix race condition between log cleaner thread and log retention thread when topic cleanup policy is updated

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7322. - Resolution: Fixed > Fix race condition between log cleaner thread and log retention thread when > topic

[jira] [Updated] (KAFKA-7322) Fix race condition between compaction thread and retention thread when topic cleanup policy is updated

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7322: Summary: Fix race condition between compaction thread and retention thread when topic cleanup policy is

[jira] [Updated] (KAFKA-7322) Fix race condition between log cleaner thread and log retention thread when topic cleanup policy is updated

2018-09-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7322: Summary: Fix race condition between log cleaner thread and log retention thread when topic cleanup policy

[jira] [Resolved] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-17 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5690. - Resolution: Fixed > kafka-acls command should be able to list per principal >

[jira] [Reopened] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-5690: - > kafka-acls command should be able to list per principal >

[jira] [Updated] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5690: Fix Version/s: 2.1.0 > kafka-acls command should be able to list per principal >

[jira] [Resolved] (KAFKA-5690) kafka-acls command should be able to list per principal

2018-09-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5690. - Resolution: Fixed > kafka-acls command should be able to list per principal >

[jira] [Updated] (KAFKA-7096) Consumer should drop the data for unassigned topic partitions

2018-09-10 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7096: Fix Version/s: 2.1.0 > Consumer should drop the data for unassigned topic partitions >

[jira] [Updated] (KAFKA-7383) Verify leader epoch in produce requests (KIP-359)

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7383: Fix Version/s: 2.1.0 > Verify leader epoch in produce requests (KIP-359) >

[jira] [Updated] (KAFKA-3514) Stream timestamp computation needs some further thoughts

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3514: Fix Version/s: 2.1.0 > Stream timestamp computation needs some further thoughts >

[jira] [Updated] (KAFKA-4587) Rethink Unification of Caching with Dedupping

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-4587: Fix Version/s: 2.1.0 > Rethink Unification of Caching with Dedupping >

[jira] [Updated] (KAFKA-6556) allow to attach callbacks in kafka streams, to be triggered when a window is expired

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6556: Fix Version/s: 2.1.0 > allow to attach callbacks in kafka streams, to be triggered when a window is >

[jira] [Updated] (KAFKA-6443) KTable involved in multiple joins could result in duplicate results

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6443: Fix Version/s: 2.1.0 > KTable involved in multiple joins could result in duplicate results >

[jira] [Updated] (KAFKA-4690) IllegalStateException using DeleteTopicsRequest when delete.topic.enable=false

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-4690: Fix Version/s: 2.1.0 > IllegalStateException using DeleteTopicsRequest when delete.topic.enable=false >

[jira] [Updated] (KAFKA-6880) Zombie replicas must be fenced

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6880: Fix Version/s: 2.1.0 > Zombie replicas must be fenced > -- > >

[jira] [Updated] (KAFKA-6774) Improve default groupId behavior in consumer

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6774: Fix Version/s: 2.1.0 > Improve default groupId behavior in consumer >

[jira] [Updated] (KAFKA-4932) Add UUID Serde

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-4932: Fix Version/s: 2.1.0 > Add UUID Serde > -- > > Key: KAFKA-4932 >

[jira] [Updated] (KAFKA-6049) Kafka Streams: Add Cogroup in the DSL

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6049: Fix Version/s: 2.1.0 > Kafka Streams: Add Cogroup in the DSL > - > >

[jira] [Resolved] (KAFKA-7333) Protocol changes for KIP-320

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7333. - Resolution: Fixed > Protocol changes for KIP-320 > > > Key:

[jira] [Updated] (KAFKA-7333) Protocol changes for KIP-320

2018-09-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7333: Fix Version/s: 2.1.0 > Protocol changes for KIP-320 > > >

[jira] [Resolved] (KAFKA-6082) consider fencing zookeeper updates with controller epoch zkVersion

2018-09-07 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6082. - Resolution: Fixed > consider fencing zookeeper updates with controller epoch zkVersion >

[jira] [Updated] (KAFKA-7211) MM should handle timeouts in commitSync

2018-09-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7211: Fix Version/s: 2.1.0 > MM should handle timeouts in commitSync > --- >

[jira] [Resolved] (KAFKA-7211) MM should handle timeouts in commitSync

2018-09-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7211. - Resolution: Fixed > MM should handle timeouts in commitSync > --- >

[jira] [Commented] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-31 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16598948#comment-16598948 ] Dong Lin commented on KAFKA-7278: - [~niob] The stacktrace in that Jira seems similar to the issue fixed

[jira] [Issue Comment Deleted] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7295: Comment: was deleted (was: The issue is mitigated in https://issues.apache.org/jira/browse/KAFKA-7354) >

[jira] [Reopened] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-7295: - > Fix RequestHandlerAvgIdlePercent metric calculation > ---

[jira] [Updated] (KAFKA-7354) Fix IdlePercent and NetworkProcessorAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7354: Fix Version/s: 2.1.0 2.0.1 1.1.2 > Fix IdlePercent and

[jira] [Resolved] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7295. - Resolution: Fixed The issue is mitigated in https://issues.apache.org/jira/browse/KAFKA-7354 > Fix

[jira] [Commented] (KAFKA-7040) The replica fetcher thread may truncate accepted messages during multiple fast leadership transitions

2018-08-23 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16590545#comment-16590545 ] Dong Lin commented on KAFKA-7040: - [~luwang] It looks like we need to fix this in Kafka to further reduce

[jira] [Commented] (KAFKA-7128) Lagging high watermark can lead to committed data loss after ISR expansion

2018-08-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589533#comment-16589533 ] Dong Lin commented on KAFKA-7128: - [~apovzner] Yes you are right. Previously I stopped at the first issue

[jira] [Commented] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16587596#comment-16587596 ] Dong Lin commented on KAFKA-6188: - [~TeilaRei] I think the discussion for the fix is in

[jira] [Resolved] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6188. - Resolution: Fixed Likely fixed in https://issues.apache.org/jira/browse/KAFKA-7278. > Broker fails with

[jira] [Updated] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-20 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7278: Fix Version/s: 2.1.0 1.1.2 > replaceSegments() should not call asyncDeleteSegment() for

[jira] [Updated] (KAFKA-7313) KAFKA-7313; StopReplicaRequest should attempt to remove future replica for the partition only if future replica exists

2018-08-20 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7313: Description: This patch fixes two issues: 1) Currently if a broker received StopReplicaRequest with

[jira] [Updated] (KAFKA-7313) KAFKA-7313; StopReplicaRequest should attempt to remove future replica for the partition only if future replica exists

2018-08-20 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7313: Description: This patch fixes two issues:   1) Currently if a broker received StopReplicaRequest with

[jira] [Updated] (KAFKA-7313) KAFKA-7313; StopReplicaRequest should attempt to remove future replica for the partition only if future replica exists

2018-08-20 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7313: Summary: KAFKA-7313; StopReplicaRequest should attempt to remove future replica for the partition only if

[jira] [Updated] (KAFKA-7313) StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if the replica is offline

2018-08-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7313: Description: Currently if a broker received StopReplicaRequest with delete=true for the same offline

[jira] [Updated] (KAFKA-7313) StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if the replica is offline

2018-08-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7313: Summary: StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if the replica

[jira] [Assigned] (KAFKA-7313) StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if partition is offline

2018-08-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-7313: --- Assignee: Dong Lin > StopReplicaRequest should not remove partition from >

[jira] [Created] (KAFKA-7313) StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if partition is offline

2018-08-19 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7313: --- Summary: StopReplicaRequest should not remove partition from ReplicaManager.allPartitions if partition is offline Key: KAFKA-7313 URL: https://issues.apache.org/jira/browse/KAFKA-7313

[jira] [Created] (KAFKA-7297) Both read/write access to Log.segments should be protected by lock

2018-08-15 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7297: --- Summary: Both read/write access to Log.segments should be protected by lock Key: KAFKA-7297 URL: https://issues.apache.org/jira/browse/KAFKA-7297 Project: Kafka

[jira] [Created] (KAFKA-7295) Fix RequestHandlerAvgIdlePercent metric calculation

2018-08-14 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7295: --- Summary: Fix RequestHandlerAvgIdlePercent metric calculation Key: KAFKA-7295 URL: https://issues.apache.org/jira/browse/KAFKA-7295 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-12 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577707#comment-16577707 ] Dong Lin commented on KAFKA-7278: - Yes `segment.changeFileSuffixes("", Log.DeletedFileSuffix)` is

[jira] [Commented] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-12 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577706#comment-16577706 ] Dong Lin commented on KAFKA-7278: - [~ijuma] The exception is probably thrown from

[jira] [Comment Edited] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577335#comment-16577335 ] Dong Lin edited comment on KAFKA-7278 at 8/11/18 9:54 PM: -- [~ijuma] Yeah the

[jira] [Commented] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577335#comment-16577335 ] Dong Lin commented on KAFKA-7278: - [~ijuma] Yeah the latest code in trunk seems to have this issue. The

[jira] [Assigned] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-6188: --- Assignee: Dong Lin > Broker fails with FATAL Shutdown - log dirs have failed >

[jira] [Commented] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577252#comment-16577252 ] Dong Lin commented on KAFKA-6188: - [~manme...@gmail.com] It seems rare to explicitly document what we

[jira] [Commented] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577251#comment-16577251 ] Dong Lin commented on KAFKA-6188: - [~ijuma] [~manme...@gmail.com] [~TeilaRei] I found that problem that

[jira] [Comment Edited] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577251#comment-16577251 ] Dong Lin edited comment on KAFKA-6188 at 8/11/18 5:27 PM: -- [~ijuma]

[jira] [Updated] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7278: Description: Currently Log.replaceSegments() will call `asyncDeleteSegment(...)` for every segment listed

[jira] [Created] (KAFKA-7278) replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list

2018-08-11 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7278: --- Summary: replaceSegments() should not call asyncDeleteSegment() for segments which have been removed from segments list Key: KAFKA-7278 URL:

[jira] [Commented] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577240#comment-16577240 ] Dong Lin commented on KAFKA-6188: - [~xmar] The log you provided does not seem to contain any IOException

[jira] [Commented] (KAFKA-6188) Broker fails with FATAL Shutdown - log dirs have failed

2018-08-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577239#comment-16577239 ] Dong Lin commented on KAFKA-6188: - [~manme...@gmail.com] Thanks for your detailed information. Sorry for

[jira] [Resolved] (KAFKA-7147) Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client property file

2018-08-10 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7147. - Resolution: Fixed > Allow kafka-reassign-partitions.sh and kafka-log-dirs.sh to take admin client >

[jira] [Resolved] (KAFKA-6701) synchronize Log modification between delete cleanup and async delete

2018-08-10 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6701. - Resolution: Fixed The issue appears to have been fixed in

[jira] [Assigned] (KAFKA-5928) Avoid redundant requests to zookeeper when reassign topic partition

2018-08-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-5928: --- Assignee: Genmao Yu > Avoid redundant requests to zookeeper when reassign topic partition >

[jira] [Updated] (KAFKA-5928) Avoid redundant requests to zookeeper when reassign topic partition

2018-08-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5928: Fix Version/s: 2.1.0 > Avoid redundant requests to zookeeper when reassign topic partition >

[jira] [Updated] (KAFKA-6648) Fetcher.getTopicMetadata() should return all partitions for each requested topic

2018-08-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6648: Fix Version/s: 2.0.1 > Fetcher.getTopicMetadata() should return all partitions for each requested > topic

[jira] [Updated] (KAFKA-6648) Fetcher.getTopicMetadata() should return all partitions for each requested topic

2018-08-03 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6648: Summary: Fetcher.getTopicMetadata() should return all partitions for each requested topic (was:

[jira] [Created] (KAFKA-7235) Use brokerZkNodeVersion to prevent broker from processing outdated controller request

2018-08-02 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7235: --- Summary: Use brokerZkNodeVersion to prevent broker from processing outdated controller request Key: KAFKA-7235 URL: https://issues.apache.org/jira/browse/KAFKA-7235 Project:

[jira] [Updated] (KAFKA-7235) Use brokerZkNodeVersion to prevent broker from processing outdated controller request

2018-08-02 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7235: Description: Currently a broker can process controller requests that are sent before the broker is

[jira] [Resolved] (KAFKA-7180) In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has joined the ISR before shutting down server2

2018-07-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7180. - Resolution: Fixed > In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has > joined

[jira] [Updated] (KAFKA-7180) In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has joined the ISR before shutting down server2

2018-07-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7180: Fix Version/s: 2.1.0 > In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has > joined

[jira] [Updated] (KAFKA-7180) In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has joined the ISR before shutting down server2

2018-07-29 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7180: Fix Version/s: 2.0.0 > In testHWCheckpointWithFailuresSingleLogSegment, wait until server1 has > joined

[jira] [Resolved] (KAFKA-7126) Reduce number of rebalance for large consumer groups after a topic is created

2018-07-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7126. - Resolution: Fixed > Reduce number of rebalance for large consumer groups after a topic is created >

[jira] [Updated] (KAFKA-7126) Reduce number of rebalance for large consumer groups after a topic is created

2018-07-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7126: Summary: Reduce number of rebalance for large consumer groups after a topic is created (was: Reduce

[jira] [Updated] (KAFKA-7126) Reduce number of rebalance period for large consumer groups after a topic is created

2018-07-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7126: Fix Version/s: 2.1.0 2.0.0 > Reduce number of rebalance period for large consumer

[jira] [Commented] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556289#comment-16556289 ] Dong Lin commented on KAFKA-7190: - Thanks you [~mjsax] [~guozhang] for the discussion. > Under low

[jira] [Commented] (KAFKA-7128) Lagging high watermark can lead to committed data loss after ISR expansion

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556277#comment-16556277 ] Dong Lin commented on KAFKA-7128: - BTW, if we want to make sure there is no message loss, it may be

[jira] [Commented] (KAFKA-7128) Lagging high watermark can lead to committed data loss after ISR expansion

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556274#comment-16556274 ] Dong Lin commented on KAFKA-7128: - Thanks for the explanation [~hachikuji]. I slightly modified the

[jira] [Updated] (KAFKA-7128) Lagging high watermark can lead to committed data loss after ISR expansion

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7128: Description: Some model checking exposed a weakness in the ISR expansion logic. We know that the high

[jira] [Comment Edited] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556053#comment-16556053 ] Dong Lin edited comment on KAFKA-7190 at 7/25/18 5:53 PM: -- [~mjsax] I guess one

[jira] [Commented] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556053#comment-16556053 ] Dong Lin commented on KAFKA-7190: -     [~mjsax] I guess one question is, if LSO is defined for a

[jira] [Comment Edited] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556053#comment-16556053 ] Dong Lin edited comment on KAFKA-7190 at 7/25/18 5:52 PM: -- [~mjsax] I guess one

[jira] [Commented] (KAFKA-7190) Under low traffic conditions purging repartition topics cause WARN statements about UNKNOWN_PRODUCER_ID

2018-07-25 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556011#comment-16556011 ] Dong Lin commented on KAFKA-7190: - [~guozhang] Certainly, I am happy to make the modification after we

[jira] [Updated] (KAFKA-7196) Remove heartbeat delayed operation for those removed consumers at the end of each rebalance

2018-07-23 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7196: Fix Version/s: 2.1.0 > Remove heartbeat delayed operation for those removed consumers at the end of >

[jira] [Assigned] (KAFKA-7196) Remove heartbeat delayed operation for those removed consumers at the end of each rebalance

2018-07-23 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-7196: --- Assignee: Lincong Li > Remove heartbeat delayed operation for those removed consumers at the end of

[jira] [Created] (KAFKA-7191) Add sensors for NumOfflineThread, FetchRequestRate and FetchRequestLocalTime in the follower broker

2018-07-22 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-7191: --- Summary: Add sensors for NumOfflineThread, FetchRequestRate and FetchRequestLocalTime in the follower broker Key: KAFKA-7191 URL: https://issues.apache.org/jira/browse/KAFKA-7191

[jira] [Commented] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552112#comment-16552112 ] Dong Lin commented on KAFKA-7152: - I realized one more point. In the common case, if replica fetcher

[jira] [Comment Edited] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552105#comment-16552105 ] Dong Lin edited comment on KAFKA-7152 at 7/22/18 6:06 PM: -- Thanks for the

[jira] [Commented] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552110#comment-16552110 ] Dong Lin commented on KAFKA-7152: - Hey [~junrao], I forgot to reply to the 2nd part of the point 3

[jira] [Commented] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16552105#comment-16552105 ] Dong Lin commented on KAFKA-7152: - Thanks for the clarification [~ijuma]. Yeah I understand immediate

[jira] [Commented] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551868#comment-16551868 ] Dong Lin commented on KAFKA-7152: - Thanks for your detailed comment Jun. Regarding the 2nd part of 1, in

[jira] [Commented] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551851#comment-16551851 ] Dong Lin commented on KAFKA-7152: - [~ijuma] Kafka at LinkedIn is not using asynchronous zookeeper client

[jira] [Resolved] (KAFKA-7152) replica should be in-sync if its LEO equals leader's LEO

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7152. - Resolution: Fixed > replica should be in-sync if its LEO equals leader's LEO >

[jira] [Updated] (KAFKA-7177) Update 2.0 documentation to reflect changed quota behaviors by KIP-219

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7177: Priority: Minor (was: Major) > Update 2.0 documentation to reflect changed quota behaviors by KIP-219 >

[jira] [Updated] (KAFKA-7177) Update 2.0 documentation to reflect changed quota behaviors by KIP-219

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-7177: Fix Version/s: 2.1.0 > Update 2.0 documentation to reflect changed quota behaviors by KIP-219 >

[jira] [Resolved] (KAFKA-7177) Update 2.0 documentation to reflect changed quota behaviors by KIP-219

2018-07-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-7177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-7177. - Resolution: Fixed > Update 2.0 documentation to reflect changed quota behaviors by KIP-219 >

<    1   2   3   4   5   6   7   >