[jira] [Created] (KAFKA-6618) Prevent two controllers from updating znodes concurrently

2018-03-06 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6618: --- Summary: Prevent two controllers from updating znodes concurrently Key: KAFKA-6618 URL: https://issues.apache.org/jira/browse/KAFKA-6618 Project: Kafka Issue Type:

[jira] [Commented] (KAFKA-5626) Producer should be able to negotiate ProduceRequest version with broker

2018-03-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389115#comment-16389115 ] Dong Lin commented on KAFKA-5626: - [~ijuma] Thanks. I will close the ticket since it has been fixed. >

[jira] [Resolved] (KAFKA-5626) Producer should be able to negotiate ProduceRequest version with broker

2018-03-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5626. - Resolution: Duplicate Fixed in https://issues.apache.org/jira/browse/KAFKA-5960 > Producer should be

[jira] [Created] (KAFKA-6617) Improve controller performance by batching reassignment znode write operation

2018-03-06 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6617: --- Summary: Improve controller performance by batching reassignment znode write operation Key: KAFKA-6617 URL: https://issues.apache.org/jira/browse/KAFKA-6617 Project: Kafka

[jira] [Commented] (KAFKA-5626) Producer should be able to negotiate ProduceRequest version with broker

2018-03-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387325#comment-16387325 ] Dong Lin commented on KAFKA-5626: - [~ewencp] As of July 2017, when I was writing patch for

[jira] [Created] (KAFKA-6604) ReplicaManager should not remove partitions on the log dirctory from high watermark checkpoint file

2018-03-01 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6604: --- Summary: ReplicaManager should not remove partitions on the log dirctory from high watermark checkpoint file Key: KAFKA-6604 URL: https://issues.apache.org/jira/browse/KAFKA-6604

[jira] [Created] (KAFKA-6571) KafkaProducer.close(0) should be non-blocking

2018-02-18 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6571: --- Summary: KafkaProducer.close(0) should be non-blocking Key: KAFKA-6571 URL: https://issues.apache.org/jira/browse/KAFKA-6571 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-6488) Prevent log corruption in case of OOM

2018-01-25 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6488: --- Summary: Prevent log corruption in case of OOM Key: KAFKA-6488 URL: https://issues.apache.org/jira/browse/KAFKA-6488 Project: Kafka Issue Type: Bug

[jira] [Assigned] (KAFKA-6331) Transient failure in kafka.api.AdminClientIntegrationTest.testLogStartOffsetCheckpointkafka.api.AdminClientIntegrationTest.testAlterReplicaLogDirs

2017-12-18 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned KAFKA-6331: --- Assignee: Dong Lin > Transient failure in >

[jira] [Resolved] (KAFKA-5878) Add sensor for queue size of the controller-event-thread

2017-12-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5878. - Resolution: Duplicate This metric will be added in https://issues.apache.org/jira/browse/KAFKA-3473. >

[jira] [Updated] (KAFKA-3473) KIP-237: More Controller Health Metrics

2017-12-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3473: Description: Currently controller appends the requests to brokers into controller channel manager queue

[jira] [Updated] (KAFKA-3473) KIP-237: More Controller Health Metrics

2017-12-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3473: Description: Currently controller appends the requests to brokers into controller channel manager queue

[jira] [Updated] (KAFKA-3473) KIP-237: More Controller Health Metrics

2017-12-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3473: Affects Version/s: (was: 0.10.0.0) 1.0.1 > KIP-237: More Controller Health

[jira] [Updated] (KAFKA-3473) KIP-237: More Controller Health Metrics

2017-12-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-3473: Summary: KIP-237: More Controller Health Metrics (was: Add controller channel manager request queue time

[jira] [Reopened] (KAFKA-5878) Add sensor for queue size of the controller-event-thread

2017-12-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reopened KAFKA-5878: - > Add sensor for queue size of the controller-event-thread >

[jira] [Resolved] (KAFKA-5878) Add sensor for queue size of the controller-event-thread

2017-12-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5878. - Resolution: Won't Fix > Add sensor for queue size of the controller-event-thread >

[jira] [Resolved] (KAFKA-6285) OffsetCommitRequest should have read-after-write logic

2017-12-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6285. - Resolution: Duplicate Duplicate of KAFKA-6285 > OffsetCommitRequest should have read-after-write logic >

[jira] [Updated] (KAFKA-6262) KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field

2017-12-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6262: Summary: KIP-232: Detect outdated metadata by adding ControllerMetadataEpoch field (was: Consumer should

[jira] [Created] (KAFKA-6285) OffsetCommitRequest should have read-after-write logic

2017-11-29 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6285: --- Summary: OffsetCommitRequest should have read-after-write logic Key: KAFKA-6285 URL: https://issues.apache.org/jira/browse/KAFKA-6285 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-6262) Consumer should not use metadata that is older than the existing metadata

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263923#comment-16263923 ] Dong Lin commented on KAFKA-6262: - [~ijuma] Thanks much for the prompt reply! This makes sense. Sure, I

[jira] [Updated] (KAFKA-6174) Add methods in Options classes to keep binary compatibility with 0.11

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6174: Summary: Add methods in Options classes to keep binary compatibility with 0.11 (was: Add methods in

[jira] [Commented] (KAFKA-6262) Consumer should not uses metadata that is older than the existing metadata

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16263374#comment-16263374 ] Dong Lin commented on KAFKA-6262: - [~junrao] [~ijuma] Can you comment on the solution of this problem?

[jira] [Updated] (KAFKA-6262) Consumer should not use metadata that is older than the existing metadata

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6262: Summary: Consumer should not use metadata that is older than the existing metadata (was: Consumer should

[jira] [Updated] (KAFKA-6262) Consumer should not use metadata that is older than the existing metadata

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6262: Issue Type: Bug (was: Improvement) > Consumer should not use metadata that is older than the existing

[jira] [Created] (KAFKA-6262) Consumer should not uses metadata that is older than the existing metadata

2017-11-22 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6262: --- Summary: Consumer should not uses metadata that is older than the existing metadata Key: KAFKA-6262 URL: https://issues.apache.org/jira/browse/KAFKA-6262 Project: Kafka

[jira] [Updated] (KAFKA-6258) SSLTransportLayer should keep reading from socket until either the buffer is full or the socket has no more data

2017-11-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6258: Description: When consumer uses plaintext and there is remaining data in consumer's buffer, consumer.poll()

[jira] [Created] (KAFKA-6258) SSLTransportLayer should keep reading from socket until either the buffer is full or the socket has no more data

2017-11-21 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6258: --- Summary: SSLTransportLayer should keep reading from socket until either the buffer is full or the socket has no more data Key: KAFKA-6258 URL:

[jira] [Created] (KAFKA-6230) KafkaConsumer.poll(0) should not block forever if coordinator is not available

2017-11-17 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6230: --- Summary: KafkaConsumer.poll(0) should not block forever if coordinator is not available Key: KAFKA-6230 URL: https://issues.apache.org/jira/browse/KAFKA-6230 Project: Kafka

[jira] [Comment Edited] (KAFKA-6194) Server crash while deleting segments

2017-11-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246902#comment-16246902 ] Dong Lin edited comment on KAFKA-6194 at 11/10/17 2:04 AM: --- [~ijuma] Yes, there

[jira] [Commented] (KAFKA-6194) Server crash while deleting segments

2017-11-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246902#comment-16246902 ] Dong Lin commented on KAFKA-6194: - [~ijuma] Yes, there is behavior change in the sense that file deletion

[jira] [Commented] (KAFKA-6194) Server crash while deleting segments

2017-11-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246168#comment-16246168 ] Dong Lin commented on KAFKA-6194: - [~corlettb] Is this problem reproducible if you restart the broker? >

[jira] [Created] (KAFKA-6183) Broker should send OffsetCommitResponse only after it has written offset to cache

2017-11-07 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6183: --- Summary: Broker should send OffsetCommitResponse only after it has written offset to cache Key: KAFKA-6183 URL: https://issues.apache.org/jira/browse/KAFKA-6183 Project: Kafka

[jira] [Resolved] (KAFKA-6172) Cache lastEntry in TimeIndex to avoid unnecessary disk access

2017-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6172. - Resolution: Fixed > Cache lastEntry in TimeIndex to avoid unnecessary disk access >

[jira] [Commented] (KAFKA-6175) AbstractIndex should cache index file to avoid unnecessary disk access during resize()

2017-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16240672#comment-16240672 ] Dong Lin commented on KAFKA-6175: - [~wushujames] I have updated the JIRA with the performance number. >

[jira] [Updated] (KAFKA-6175) AbstractIndex should cache index file to avoid unnecessary disk access during resize()

2017-11-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6175: Description: Currently when we shutdown a broker, we will call AbstractIndex.resize() for all segments on

[jira] [Commented] (KAFKA-6175) AbstractIndex should cache index file to avoid unnecessary disk access during resize()

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239900#comment-16239900 ] Dong Lin commented on KAFKA-6175: - [~wushujames] I don't have number yet. I will provide numbers later. >

[jira] [Resolved] (KAFKA-6078) Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-6078. - Resolution: Cannot Reproduce > Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster >

[jira] [Resolved] (KAFKA-5759) Allow user to specify relative path as log directory

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5759. - Resolution: Fixed > Allow user to specify relative path as log directory >

[jira] [Updated] (KAFKA-6174) Add methods in Options classes to keep binary compatibility between 0.11 and 1.0

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6174: Summary: Add methods in Options classes to keep binary compatibility between 0.11 and 1.0 (was:

[jira] [Updated] (KAFKA-6172) Cache lastEntry in TimeIndex to avoid unnecessary disk access

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6172: Fix Version/s: 1.0.1 > Cache lastEntry in TimeIndex to avoid unnecessary disk access >

[jira] [Updated] (KAFKA-6174) Investigate binary incompatibility issued in DescribeClusterOptions between 0.11 and 1.0

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6174: Fix Version/s: 1.0.1 > Investigate binary incompatibility issued in DescribeClusterOptions between > 0.11

[jira] [Updated] (KAFKA-6175) AbstractIndex should cache index file to avoid unnecessary disk access during resize()

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6175: Fix Version/s: 1.0.1 > AbstractIndex should cache index file to avoid unnecessary disk access during >

[jira] [Created] (KAFKA-6175) AbstractIndex should cache index file to avoid unnecessary disk access during resize()

2017-11-05 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6175: --- Summary: AbstractIndex should cache index file to avoid unnecessary disk access during resize() Key: KAFKA-6175 URL: https://issues.apache.org/jira/browse/KAFKA-6175 Project:

[jira] [Commented] (KAFKA-6174) Investigate binary incompatibility issued in DescribeClusterOptions between 0.11 and 1.0

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16239730#comment-16239730 ] Dong Lin commented on KAFKA-6174: - [~ijuma] I am still now sure why this change breaks binary

[jira] [Created] (KAFKA-6174) Investigate binary incompatibility issued in DescribeClusterOptions between 0.11 and 1.0

2017-11-05 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6174: --- Summary: Investigate binary incompatibility issued in DescribeClusterOptions between 0.11 and 1.0 Key: KAFKA-6174 URL: https://issues.apache.org/jira/browse/KAFKA-6174

[jira] [Updated] (KAFKA-6172) Cache lastEntry in TimeIndex to avoid unnecessary disk access

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6172: Description: LogSegment.close() calls timeIndex.maybeAppend(...), which in turns make a number of calls to

[jira] [Updated] (KAFKA-6172) Cache lastEntry in TimeIndex to avoid unnecessary disk access

2017-11-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-6172: Description: LogSegment.close() calls timeIndex.maybeAppend(...), which in turns make a number of calls to

[jira] [Created] (KAFKA-6172) Cache lastEntry in TimeIndex to avoid unnecessary disk access

2017-11-05 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6172: --- Summary: Cache lastEntry in TimeIndex to avoid unnecessary disk access Key: KAFKA-6172 URL: https://issues.apache.org/jira/browse/KAFKA-6172 Project: Kafka Issue

[jira] [Commented] (KAFKA-6093) replica dir not deleted after topic deletion

2017-10-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16212078#comment-16212078 ] Dong Lin commented on KAFKA-6093: - [~junrao] Yes, your explanation is correct. This issue is introduced in

[jira] [Created] (KAFKA-6078) Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

2017-10-18 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6078: --- Summary: Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster Key: KAFKA-6078 URL: https://issues.apache.org/jira/browse/KAFKA-6078 Project: Kafka

[jira] [Commented] (KAFKA-5871) bound the throttle time in byte rate quota

2017-10-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206951#comment-16206951 ] Dong Lin commented on KAFKA-5871: - [~junrao] Yeah I read that comment. I think the actual problem is worse

[jira] [Comment Edited] (KAFKA-5871) bound the throttle time in byte rate quota

2017-10-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206951#comment-16206951 ] Dong Lin edited comment on KAFKA-5871 at 10/17/17 3:13 AM: --- [~junrao] Yeah I

[jira] [Commented] (KAFKA-5871) bound the throttle time in byte rate quota

2017-10-16 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16206901#comment-16206901 ] Dong Lin commented on KAFKA-5871: - [~junrao] I am not sure we can do this. The issue with having a hard

[jira] [Commented] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-10-11 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200603#comment-16200603 ] Dong Lin commented on KAFKA-5877: - I am not sure about our policy of back-port. Maybe [~ijuma] has better

[jira] [Created] (KAFKA-6045) All access to log should fail if log is closed

2017-10-10 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-6045: --- Summary: All access to log should fail if log is closed Key: KAFKA-6045 URL: https://issues.apache.org/jira/browse/KAFKA-6045 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-6027) System test failure: LogDirFailureTest

2017-10-10 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16198508#comment-16198508 ] Dong Lin commented on KAFKA-6027: - [~ijuma] Yeah it is really convenient to setup system test using

[jira] [Commented] (KAFKA-6027) System test failure: LogDirFailureTest

2017-10-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197310#comment-16197310 ] Dong Lin commented on KAFKA-6027: - [~tedyu] Cool. Thanks for the information. > System test failure:

[jira] [Commented] (KAFKA-5634) Replica fetcher thread crashes due to OffsetOutOfRangeException

2017-10-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197300#comment-16197300 ] Dong Lin commented on KAFKA-5634: - [~ijuma] I just realized that I have missed most email notifications

[jira] [Commented] (KAFKA-6027) System test failure: LogDirFailureTest

2017-10-09 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-6027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197259#comment-16197259 ] Dong Lin commented on KAFKA-6027: - [~ijuma] Thanks for creating this ticket. My changes which we merged

[jira] [Resolved] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-10-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5877. - Resolution: Fixed > Controller should only update reassignment znode if there is change in the >

[jira] [Commented] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-10-05 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16192636#comment-16192636 ] Dong Lin commented on KAFKA-5877: - This patch has been committed as part of

[jira] [Created] (KAFKA-5995) Rename AlterReplicaDir to AlterReplicaDirs

2017-09-29 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5995: --- Summary: Rename AlterReplicaDir to AlterReplicaDirs Key: KAFKA-5995 URL: https://issues.apache.org/jira/browse/KAFKA-5995 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-22 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16176332#comment-16176332 ] Dong Lin commented on KAFKA-5877: - [~tombentley] Cool. Thanks! > Controller should only update

[jira] [Commented] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175245#comment-16175245 ] Dong Lin commented on KAFKA-5877: - [~tombentley] I may have misunderstood your comment. Are you saying the

[jira] [Issue Comment Deleted] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5877: Comment: was deleted (was: [~tombentley] I didn't notice your comment earlier. The issue is fixed with

[jira] [Commented] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-21 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16175242#comment-16175242 ] Dong Lin commented on KAFKA-5877: - [~tombentley] I didn't notice your comment earlier. The issue is fixed

[jira] [Updated] (KAFKA-5695) Test DeleteRecordsRequest in AuthorizerIntegrationTest

2017-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5695: Fix Version/s: 1.0.0 > Test DeleteRecordsRequest in AuthorizerIntegrationTest >

[jira] [Updated] (KAFKA-5843) Mx4jLoader.maybeLoad should only be executed if kafka_mx4jenable is set to true

2017-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5843: Fix Version/s: 1.0.0 > Mx4jLoader.maybeLoad should only be executed if kafka_mx4jenable is set to > true >

[jira] [Updated] (KAFKA-5879) Controller should read the latest IsrChangeNotification znodes when handling IsrChangeNotification event

2017-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5879: Fix Version/s: 1.0.0 > Controller should read the latest IsrChangeNotification znodes when handling >

[jira] [Updated] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5877: Fix Version/s: 1.0.0 > Controller should only update reassignment znode if there is change in the >

[jira] [Updated] (KAFKA-5163) Support replicas movement between log directories (KIP-113)

2017-09-19 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5163: Fix Version/s: 1.0.0 > Support replicas movement between log directories (KIP-113) >

[jira] [Created] (KAFKA-5879) Controller should read the latest IsrChangeNotification znodes when handling IsrChangeNotification event

2017-09-12 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5879: --- Summary: Controller should read the latest IsrChangeNotification znodes when handling IsrChangeNotification event Key: KAFKA-5879 URL: https://issues.apache.org/jira/browse/KAFKA-5879

[jira] [Updated] (KAFKA-5879) Controller should read the latest IsrChangeNotification znodes when handling IsrChangeNotification event

2017-09-12 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5879: Description: Currently controller can be very inefficient in handling IsrChangeNotification event because

[jira] [Updated] (KAFKA-5879) Controller should read the latest IsrChangeNotification znodes when handling IsrChangeNotification event

2017-09-12 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5879: Description: Currently controller can be very inefficient in handling IsrChangeNotification event because

[jira] [Created] (KAFKA-5878) Add sensor for queue size of the controller-event-thread

2017-09-12 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5878: --- Summary: Add sensor for queue size of the controller-event-thread Key: KAFKA-5878 URL: https://issues.apache.org/jira/browse/KAFKA-5878 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-12 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5877: Description: I encountered a scenario where controller keeps printing the following stack trace repeatedly

[jira] [Created] (KAFKA-5877) Controller should only update reassignment znode if there is change in the reassignment data

2017-09-12 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5877: --- Summary: Controller should only update reassignment znode if there is change in the reassignment data Key: KAFKA-5877 URL: https://issues.apache.org/jira/browse/KAFKA-5877

[jira] [Resolved] (KAFKA-5845) KafkaController should send LeaderAndIsrRequest to broker which starts very soon after shutdown

2017-09-08 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5845. - Resolution: Won't Fix > KafkaController should send LeaderAndIsrRequest to broker which starts very >

[jira] [Updated] (KAFKA-5864) ReplicaFetcherThread should not die if there is offline log directory

2017-09-08 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5864: Summary: ReplicaFetcherThread should not die if there is offline log directory (was:

[jira] [Updated] (KAFKA-5864) ReplicaFetcherThread should not die due to replica in offline log directory

2017-09-08 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5864: Summary: ReplicaFetcherThread should not die due to replica in offline log directory (was:

[jira] [Created] (KAFKA-5864) ReplicaFetcherThread.processPartitionData() should throw KafkaStorageException if replica is offline

2017-09-08 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5864: --- Summary: ReplicaFetcherThread.processPartitionData() should throw KafkaStorageException if replica is offline Key: KAFKA-5864 URL: https://issues.apache.org/jira/browse/KAFKA-5864

[jira] [Updated] (KAFKA-5845) KafkaController should send LeaderAndIsrRequest to broker which starts very soon after shutdown

2017-09-06 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5845: Summary: KafkaController should send LeaderAndIsrRequest to broker which starts very soon after shutdown

[jira] [Created] (KAFKA-5845) KafkaController should send LeaderAndIsrRequest to brokers which starts very soon after shutdown

2017-09-06 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5845: --- Summary: KafkaController should send LeaderAndIsrRequest to brokers which starts very soon after shutdown Key: KAFKA-5845 URL: https://issues.apache.org/jira/browse/KAFKA-5845

[jira] [Created] (KAFKA-5843) Mx4jLoader.maybeLoad should only be executed if kafka_mx4jenable is set to true

2017-09-05 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5843: --- Summary: Mx4jLoader.maybeLoad should only be executed if kafka_mx4jenable is set to true Key: KAFKA-5843 URL: https://issues.apache.org/jira/browse/KAFKA-5843 Project: Kafka

[jira] [Updated] (KAFKA-5829) Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion

2017-09-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5829: Priority: Critical (was: Major) > Speedup broker startup after unclean shutdown by reducing unnecessary >

[jira] [Updated] (KAFKA-5829) Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion

2017-09-04 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5829: Fix Version/s: 1.0.0 > Speedup broker startup after unclean shutdown by reducing unnecessary > snapshot

[jira] [Created] (KAFKA-5829) Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion

2017-09-04 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5829: --- Summary: Speedup broker startup after unclean shutdown by reducing unnecessary snapshot files deletion Key: KAFKA-5829 URL: https://issues.apache.org/jira/browse/KAFKA-5829

[jira] [Commented] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-09-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150161#comment-16150161 ] Dong Lin commented on KAFKA-4763: - And BTW, the current design already does what you suggested -- if you

[jira] [Commented] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-09-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150157#comment-16150157 ] Dong Lin commented on KAFKA-4763: - [~uncleGen] Sorry, I am not ready to start a long discussion here

[jira] [Commented] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-09-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150131#comment-16150131 ] Dong Lin commented on KAFKA-4763: - [~uncleGen] The current design don't use remaining disk currently for

[jira] [Comment Edited] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-09-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150115#comment-16150115 ] Dong Lin edited comment on KAFKA-4763 at 9/1/17 6:40 AM: - [~uncleGen] Let's say we

[jira] [Commented] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-09-01 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150115#comment-16150115 ] Dong Lin commented on KAFKA-4763: - [~uncleGen] Le's say we have a broker of 2 disks. Each disk has 10 GB

[jira] [Commented] (KAFKA-4763) Handle disk failure for JBOD (KIP-112)

2017-08-31 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-4763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149954#comment-16149954 ] Dong Lin commented on KAFKA-4763: - [~uncleGen] Can you be more specific which part or which sentence needs

[jira] [Created] (KAFKA-5812) Represent logDir with case class where absolute path is required

2017-08-30 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5812: --- Summary: Represent logDir with case class where absolute path is required Key: KAFKA-5812 URL: https://issues.apache.org/jira/browse/KAFKA-5812 Project: Kafka Issue

[jira] [Updated] (KAFKA-5767) Kafka server should halt if IBP < 1.0.0 and there is log directory failure

2017-08-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5767: Priority: Critical (was: Major) > Kafka server should halt if IBP < 1.0.0 and there is log directory

[jira] [Updated] (KAFKA-5759) Allow user to specify relative path as log directory

2017-08-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5759: Priority: Critical (was: Major) > Allow user to specify relative path as log directory >

[jira] [Updated] (KAFKA-5759) Allow user to specify relative path as log directory

2017-08-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5759: Fix Version/s: 1.0.0 > Allow user to specify relative path as log directory >

[jira] [Updated] (KAFKA-5767) Kafka server should halt if IBP < 1.0.0 and there is log directory failure

2017-08-26 Thread Dong Lin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-5767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated KAFKA-5767: Fix Version/s: 1.0.0 > Kafka server should halt if IBP < 1.0.0 and there is log directory failure >

[jira] [Created] (KAFKA-5767) Kafka server should halt if IBP < 1.0.0 and there is log directory failure

2017-08-22 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5767: --- Summary: Kafka server should halt if IBP < 1.0.0 and there is log directory failure Key: KAFKA-5767 URL: https://issues.apache.org/jira/browse/KAFKA-5767 Project: Kafka

[jira] [Created] (KAFKA-5759) Allow user to specify relative path as log directory

2017-08-21 Thread Dong Lin (JIRA)
Dong Lin created KAFKA-5759: --- Summary: Allow user to specify relative path as log directory Key: KAFKA-5759 URL: https://issues.apache.org/jira/browse/KAFKA-5759 Project: Kafka Issue Type: Bug

<    1   2   3   4   5   6   7   >