[jira] [Commented] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-05-01 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17842783#comment-17842783 ] Jun Rao commented on KAFKA-16541: - [~ocadaruma] : Will you be able to work on this soon? The 3.8.0 code

[jira] [Comment Edited] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-04-12 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836717#comment-17836717 ] Jun Rao edited comment on KAFKA-16541 at 4/12/24 5:43 PM: -- Thanks for filing

[jira] [Commented] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-04-12 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17836717#comment-17836717 ] Jun Rao commented on KAFKA-16541: - Thanks for filing the jira, [~ocadaruma] !  Since this is a

[jira] [Updated] (KAFKA-16541) Potential leader epoch checkpoint file corruption on OS crash

2024-04-12 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-16541: Affects Version/s: 3.7.0 > Potential leader epoch checkpoint file corruption on OS crash >

[jira] [Resolved] (KAFKA-16485) Fix broker metrics to follow kebab/hyphen case

2024-04-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-16485. - Fix Version/s: 3.8.0 Resolution: Fixed Merged the PR to trunk. > Fix broker metrics to follow

[jira] [Commented] (KAFKA-16310) ListOffsets doesn't report the offset with maxTimestamp anymore

2024-03-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831959#comment-17831959 ] Jun Rao commented on KAFKA-16310: - Since the follower only maintains offsetForMaxTimestamp at the batch

[jira] [Comment Edited] (KAFKA-16310) ListOffsets doesn't report the offset with maxTimestamp anymore

2024-03-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831834#comment-17831834 ] Jun Rao edited comment on KAFKA-16310 at 3/28/24 3:04 PM: -- [~chia7712] :

[jira] [Commented] (KAFKA-16310) ListOffsets doesn't report the offset with maxTimestamp anymore

2024-03-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831834#comment-17831834 ] Jun Rao commented on KAFKA-16310: - [~chia7712] : {quote}Did you mean that we should change the schema to

[jira] [Commented] (KAFKA-16310) ListOffsets doesn't report the offset with maxTimestamp anymore

2024-03-27 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17831553#comment-17831553 ] Jun Rao commented on KAFKA-16310: - [~johnnyhsu] , [~showuon] and [~chia7712] : Sorry, but I just

[jira] [Resolved] (KAFKA-15950) Serialize broker heartbeat requests

2024-03-25 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15950. - Fix Version/s: 3.8.0 Resolution: Fixed merged the PR to trunk. > Serialize broker heartbeat

[jira] [Commented] (KAFKA-16385) Segment is rolled before segment.ms or segment.bytes breached

2024-03-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17828506#comment-17828506 ] Jun Rao commented on KAFKA-16385: - [~showuon] : Yes, the retention by time is supposed to cover the

[jira] [Commented] (KAFKA-16283) RoundRobinPartitioner will only send to half of the partitions in a topic

2024-02-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17819322#comment-17819322 ] Jun Rao commented on KAFKA-16283: - [~showuon] : Is this the same as

[jira] [Resolved] (KAFKA-16186) Implement broker metrics for client telemetry usage

2024-01-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-16186. - Fix Version/s: 3.8.0 Resolution: Fixed merged the PR to trunk > Implement broker metrics for

[jira] [Resolved] (KAFKA-15813) Improve implementation of client instance cache

2024-01-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15813. - Fix Version/s: 3.8.0 Resolution: Fixed Merged to the PR to trunk. > Improve implementation of

[jira] [Resolved] (KAFKA-16137) ListClientMetricsResourcesResponse definition is missing field descriptions

2024-01-22 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-16137. - Fix Version/s: 3.8.0 Resolution: Fixed merged the PR to trunk. >

[jira] [Resolved] (KAFKA-15811) implement capturing client port information from Socket Server

2024-01-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15811. - Fix Version/s: 3.8.0 Resolution: Fixed merged the PR to trunk. > implement capturing client

[jira] [Commented] (KAFKA-15863) Handle push telemetry throttling with quota manager

2024-01-16 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17807374#comment-17807374 ] Jun Rao commented on KAFKA-15863: - [~apoorvmittal10] : If we only hit the push interval based

[jira] [Updated] (KAFKA-15950) Serialize broker heartbeat requests

2023-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-15950: Description: This is a followup issue from the discussion in

[jira] [Updated] (KAFKA-15950) Serialize broker heartbeat requests

2023-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-15950: Description: This is a follow up issue from the discussion in

[jira] [Updated] (KAFKA-15950) Serialize broker heartbeat requests

2023-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-15950: Description: {{KafkaEventQueue}} does de-duping and only allows one outstanding  {{CommunicationEvent}} 

[jira] [Updated] (KAFKA-15950) Serialize broker heartbeat requests

2023-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-15950: Description: {{KafkaEventQueue}} does de-duping and only allows one outstanding  {{CommunicationEvent}} 

[jira] [Updated] (KAFKA-15950) Serialize broker heartbeat requests

2023-12-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-15950: Summary: Serialize broker heartbeat requests (was: CommunicationEvent should be scheduled with

[jira] [Resolved] (KAFKA-15684) Add support to describe all subscriptions through utility

2023-12-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15684. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk. > Add support to describe all

[jira] [Resolved] (KAFKA-15871) Implement kafka-client-metrics.sh tool

2023-12-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15871. - Resolution: Fixed merged the PR to trunk > Implement kafka-client-metrics.sh tool >

[jira] [Resolved] (KAFKA-15831) List Client Metrics Configuration Resources

2023-12-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15831. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk. > List Client Metrics

[jira] [Resolved] (KAFKA-15965) Test failure: org.apache.kafka.common.requests.BrokerRegistrationRequestTest

2023-12-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15965. - Fix Version/s: 3.7.0 Assignee: Colin McCabe Resolution: Fixed This is fixed by

[jira] [Commented] (KAFKA-15950) CommunicationEvent should be scheduled with EarliestDeadlineFunction

2023-11-29 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791367#comment-17791367 ] Jun Rao commented on KAFKA-15950: - cc [~soarez]  > CommunicationEvent should be scheduled with

[jira] [Created] (KAFKA-15950) CommunicationEvent should be scheduled with EarliestDeadlineFunction

2023-11-29 Thread Jun Rao (Jira)
Jun Rao created KAFKA-15950: --- Summary: CommunicationEvent should be scheduled with EarliestDeadlineFunction Key: KAFKA-15950 URL: https://issues.apache.org/jira/browse/KAFKA-15950 Project: Kafka

[jira] [Resolved] (KAFKA-15046) Produce performance issue under high disk load

2023-11-29 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15046. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk. > Produce performance issue

[jira] [Commented] (KAFKA-15674) Consider making RequestLocal thread safe

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778835#comment-17778835 ] Jun Rao commented on KAFKA-15674: - For context, [https://github.com/apache/kafka/pull/9220] was the

[jira] [Commented] (KAFKA-15401) Segment with corrupted index should not be uploaded to remote storage

2023-10-23 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17778807#comment-17778807 ] Jun Rao commented on KAFKA-15401: - [~nickstery] : Thanks for reporting this issue. I am wondering how a

[jira] [Resolved] (KAFKA-15651) Investigate auto commit guarantees during Consumer.assign()

2023-10-20 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15651. - Resolution: Not A Problem > Investigate auto commit guarantees during Consumer.assign() >

[jira] [Resolved] (KAFKA-15582) Clean shutdown detection, broker side

2023-10-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15582. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Clean shutdown detection,

[jira] [Resolved] (KAFKA-14960) Metadata Request Manager and listTopics/partitionsFor API

2023-09-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14960. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk. > Metadata Request Manager and

[jira] [Resolved] (KAFKA-15306) Integrate committed offsets logic when updating fetching positions

2023-09-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15306. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Integrate committed offsets

[jira] [Resolved] (KAFKA-15163) Implement validatePositions functionality for new KafkaConsumer

2023-09-13 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15163. - Fix Version/s: 3.7.0 Resolution: Fixed This is covered in

[jira] [Resolved] (KAFKA-15115) Implement resetPositions functionality in OffsetsRequestManager

2023-09-13 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15115. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Implement resetPositions

[jira] [Resolved] (KAFKA-9800) [KIP-580] Client Exponential Backoff Implementation

2023-09-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-9800. Fix Version/s: 3.7.0 Resolution: Fixed Merged [https://github.com/apache/kafka/pull/14111] to

[jira] [Resolved] (KAFKA-15081) Implement new consumer offsetsForTimes

2023-09-01 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-15081. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Implement new consumer

[jira] [Resolved] (KAFKA-14965) Introduce OffsetsRequestManager to integrate ListOffsets requests into new consumer threading refactor

2023-09-01 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14965. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Introduce OffsetsRequestManager

[jira] [Resolved] (KAFKA-14875) Implement Wakeup()

2023-08-29 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14875. - Fix Version/s: 3.7.0 Resolution: Fixed merged the PR to trunk > Implement Wakeup() >

[jira] [Resolved] (KAFKA-14950) Implement assign() and assignment()

2023-07-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14950. - Fix Version/s: 3.6.0 Resolution: Fixed merged the PR to trunk. > Implement assign() and

[jira] [Commented] (KAFKA-15046) Produce performance issue under high disk load

2023-06-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731375#comment-17731375 ] Jun Rao commented on KAFKA-15046: - The potential issue with moving the LeaderEpochFile flushing to an

[jira] [Commented] (KAFKA-15046) Produce performance issue under high disk load

2023-06-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17731119#comment-17731119 ] Jun Rao commented on KAFKA-15046: - [~ocadaruma] : Thanks for identifying the problem. Another way to

[jira] [Resolved] (KAFKA-14966) Extract reusable common logic from OffsetFetcher

2023-06-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14966. - Fix Version/s: 3.6.0 Resolution: Fixed Merged the PR to trunk. > Extract reusable common logic

[jira] [Created] (KAFKA-15058) Improve the accuracy of Histogram in client metric

2023-06-05 Thread Jun Rao (Jira)
Jun Rao created KAFKA-15058: --- Summary: Improve the accuracy of Histogram in client metric Key: KAFKA-15058 URL: https://issues.apache.org/jira/browse/KAFKA-15058 Project: Kafka Issue Type:

[jira] [Comment Edited] (KAFKA-14561) Improve transactions experience for older clients by ensuring ongoing transaction

2023-05-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720717#comment-17720717 ] Jun Rao edited comment on KAFKA-14561 at 5/9/23 12:24 AM: -- The PR was reverted

[jira] [Updated] (KAFKA-14561) Improve transactions experience for older clients by ensuring ongoing transaction

2023-05-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-14561: Fix Version/s: 3.6.0 (was: 3.5.0) The PR was reverted in 3.5 branch. Updated the

[jira] [Commented] (KAFKA-14892) Harmonize package names in storage module

2023-04-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715193#comment-17715193 ] Jun Rao commented on KAFKA-14892: - Sounds good to me. Including storage in the package name probably

[jira] [Resolved] (KAFKA-14561) Improve transactions experience for older clients by ensuring ongoing transaction

2023-04-12 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14561. - Fix Version/s: 3.5.0 Resolution: Fixed merged the PR to trunk. > Improve transactions

[jira] [Resolved] (KAFKA-14617) Replicas with stale broker epoch should not be allowed to join the ISR

2023-04-07 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14617. - Fix Version/s: 3.5.0 Resolution: Fixed merged all PRs to trunk. > Replicas with stale broker

[jira] [Resolved] (KAFKA-14685) TierStateMachine interface for building remote aux log

2023-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14685. - Fix Version/s: 3.5.0 Resolution: Fixed merged the PR to trunk. > TierStateMachine interface for

[jira] [Assigned] (KAFKA-14685) TierStateMachine interface for building remote aux log

2023-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-14685: --- Assignee: Matthew Wong > TierStateMachine interface for building remote aux log >

[jira] [Commented] (KAFKA-9087) ReplicaAlterLogDirs stuck and restart fails with java.lang.IllegalStateException: Offset mismatch for the future replica

2023-01-05 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17655153#comment-17655153 ] Jun Rao commented on KAFKA-9087: [~chia7712] : Thanks for the explanation. Great find! I agree that this

[jira] [Commented] (KAFKA-9087) ReplicaAlterLogDirs stuck and restart fails with java.lang.IllegalStateException: Offset mismatch for the future replica

2022-12-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17651012#comment-17651012 ] Jun Rao commented on KAFKA-9087: [~chia7712] : Thanks for the update. About the race condition. I am

[jira] [Assigned] (KAFKA-10432) LeaderEpochCache is incorrectly recovered on segment recovery for epoch 0

2022-12-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-10432: --- Assignee: Lucas Bradstreet > LeaderEpochCache is incorrectly recovered on segment recovery for

[jira] [Resolved] (KAFKA-12736) KafkaProducer.flush holds onto completed ProducerBatch(s) until flush completes

2022-12-19 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12736. - Fix Version/s: 3.0.0 Assignee: Lucas Bradstreet Resolution: Fixed > KafkaProducer.flush

[jira] [Resolved] (KAFKA-13369) Follower fetch protocol enhancements for tiered storage.

2022-12-17 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13369. - Fix Version/s: 3.5.0 Resolution: Fixed merged the PR to trunk. > Follower fetch protocol

[jira] [Resolved] (KAFKA-14303) Producer.send without record key and batch.size=0 goes into infinite loop

2022-11-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14303. - Fix Version/s: 3.4.0 3.3.2 Resolution: Fixed Merged the PR to 3.3 and trunk.

[jira] [Commented] (KAFKA-10760) In compacted topic with max.compaction.lag.ms, the segments are not rolled until new messages arrive

2022-10-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619908#comment-17619908 ] Jun Rao commented on KAFKA-10760: - A potential solution is to implement the time based segment rolling

[jira] [Resolved] (KAFKA-14321) max.compaction.lag.ms is not enforced accurately

2022-10-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14321. - Resolution: Duplicate This actually duplicates KAFKA-10760. Closing this one. > max.compaction.lag.ms

[jira] [Commented] (KAFKA-14321) max.compaction.lag.ms is not enforced accurately

2022-10-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17619904#comment-17619904 ] Jun Rao commented on KAFKA-14321: - A potential solution is to implement the time based segment rolling

[jira] [Created] (KAFKA-14321) max.compaction.lag.ms is not enforced accurately

2022-10-18 Thread Jun Rao (Jira)
Jun Rao created KAFKA-14321: --- Summary: max.compaction.lag.ms is not enforced accurately Key: KAFKA-14321 URL: https://issues.apache.org/jira/browse/KAFKA-14321 Project: Kafka Issue Type: Bug

[jira] [Resolved] (KAFKA-4545) tombstone needs to be removed after delete.retention.ms has passed after it has been cleaned

2022-10-18 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-4545. Fix Version/s: 3.1.0 Resolution: Fixed This is fixed in KAFKA-8522. > tombstone needs to be

[jira] [Resolved] (KAFKA-14156) Built-in partitioner may create suboptimal batches with large linger.ms

2022-09-14 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14156. - Assignee: Artem Livshits Resolution: Fixed Merged the PR to 3.3 and trunk. > Built-in

[jira] [Commented] (KAFKA-13868) Website updates to satisfy Apache privacy policies

2022-07-25 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17570964#comment-17570964 ] Jun Rao commented on KAFKA-13868: - Thanks, [~mimaison]. I see it now. > Website updates to satisfy

[jira] [Comment Edited] (KAFKA-13700) Kafka reporting CorruptRecordException exception

2022-07-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569563#comment-17569563 ] Jun Rao edited comment on KAFKA-13700 at 7/21/22 5:04 PM: -- Interesting. So the

[jira] [Commented] (KAFKA-13700) Kafka reporting CorruptRecordException exception

2022-07-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569563#comment-17569563 ] Jun Rao commented on KAFKA-13700: - Interesting. So the CRC validation passes with DumpLogSegments, but

[jira] [Commented] (KAFKA-13868) Website updates to satisfy Apache privacy policies

2022-07-21 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569525#comment-17569525 ] Jun Rao commented on KAFKA-13868: - [~mimaison] : You mentioned "As per the email sent to the PMC, all

[jira] [Resolved] (KAFKA-14020) Performance regression in Producer

2022-07-20 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-14020. - Resolution: Fixed merged the PR to 3.3. > Performance regression in Producer >

[jira] [Commented] (KAFKA-12901) Metadata not updated after broker restart.

2022-07-13 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566418#comment-17566418 ] Jun Rao commented on KAFKA-12901: - [~suriyav] : Thanks for the reply. We recently fixed

[jira] [Commented] (KAFKA-13953) kafka Console consumer fails with CorruptRecordException

2022-07-13 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17566412#comment-17566412 ] Jun Rao commented on KAFKA-13953: - [~doguscan] : It's possible that a Kafka bug caused the corruption.

[jira] [Commented] (KAFKA-13953) kafka Console consumer fails with CorruptRecordException

2022-07-11 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17565138#comment-17565138 ] Jun Rao commented on KAFKA-13953: - [~doguscan] : The broker verifies the batch level CRC before

[jira] [Commented] (KAFKA-13953) kafka Console consumer fails with CorruptRecordException

2022-07-08 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17564386#comment-17564386 ] Jun Rao commented on KAFKA-13953: - [~doguscan] : Interesting. Do all replicas have the identical

[jira] [Commented] (KAFKA-13953) kafka Console consumer fails with CorruptRecordException

2022-06-03 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17546196#comment-17546196 ] Jun Rao commented on KAFKA-13953: - [~abasilbr] : If you have multiple replicas, it's unlikely all

[jira] [Resolved] (KAFKA-13803) Refactor Leader API Access

2022-06-03 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13803. - Fix Version/s: 3.3.0 Resolution: Fixed merged the PR to trunk > Refactor Leader API Access >

[jira] [Commented] (KAFKA-13953) kafka Console consumer fails with CorruptRecordException

2022-06-02 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17545575#comment-17545575 ] Jun Rao commented on KAFKA-13953: - [~abasilbr] : This could be caused by data corruption on the broker.

[jira] [Resolved] (KAFKA-10888) Sticky partition leads to uneven product msg, resulting in abnormal delays in some partitions

2022-05-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-10888. - Fix Version/s: 3.3.0 Resolution: Fixed merged the PR to trunk. Thanks [~alivshits] for the

[jira] [Resolved] (KAFKA-13815) Avoid reinitialization for a replica that is being deleted

2022-05-04 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13815. - Fix Version/s: 3.3.0 Resolution: Fixed merged the PR to trunk > Avoid reinitialization for a

[jira] [Assigned] (KAFKA-12841) NPE from the provided metadata in client callback in case of ApiException

2022-04-26 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-12841: --- Fix Version/s: 3.2.0 Assignee: Philip Nee (was: Kirk True) Resolution: Fixed

[jira] [Resolved] (KAFKA-13448) Kafka Producer Client Callback behaviour does not align with Javadoc

2022-04-26 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13448. - Fix Version/s: 3.2.0 Assignee: Philip Nee Resolution: Fixed merged

[jira] [Commented] (KAFKA-9296) Correlation id for response () does not match request ()

2022-04-07 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17519194#comment-17519194 ] Jun Rao commented on KAFKA-9296: [~vongosling] : It would be useful to provide a bit more detail on when

[jira] [Resolved] (KAFKA-13687) Limit number of batches when using kafka-dump-log.sh

2022-04-06 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13687. - Fix Version/s: 3.3.0 Resolution: Fixed merged the PR to trunk. > Limit number of batches when

[jira] [Comment Edited] (KAFKA-13773) Data loss after recovery from crash due to full hard disk

2022-03-31 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515532#comment-17515532 ] Jun Rao edited comment on KAFKA-13773 at 3/31/22 7:25 PM: -- [~Timelad] : Thanks

[jira] [Commented] (KAFKA-13773) Data loss after recovery from crash due to full hard disk

2022-03-31 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515532#comment-17515532 ] Jun Rao commented on KAFKA-13773: - [~Timelad] : Thanks for the log. This does seem to be a real issue.

[jira] [Resolved] (KAFKA-12875) Change Log layer segment map mutations to avoid absence of active segment

2022-03-31 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-12875. - Fix Version/s: 3.3.0 Assignee: Yu Yang Resolution: Fixed Merged to trunk. > Change Log

[jira] [Commented] (KAFKA-13773) Data loss after recovery from crash due to full hard disk

2022-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514888#comment-17514888 ] Jun Rao commented on KAFKA-13773: - [~Timelad] : I checked kafka-0-2.8.0-before-fail.log

[jira] [Commented] (KAFKA-13773) Data loss after recovery from crash due to full hard disk

2022-03-30 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514808#comment-17514808 ] Jun Rao commented on KAFKA-13773: - [~Timelad] : Thanks for the additional logs. I took a quick look at 

[jira] [Commented] (KAFKA-13773) Data loss after recovery from crash due to full hard disk

2022-03-29 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17514245#comment-17514245 ] Jun Rao commented on KAFKA-13773: - [~Timelad] : Thanks for filing the jira. I ran the following tool on

[jira] [Commented] (KAFKA-13744) Quota metric tags are inconsistent

2022-03-15 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17507142#comment-17507142 ] Jun Rao commented on KAFKA-13744: - [~jeqo] : Thanks for reporting this issue. It seems that the tags are

[jira] [Commented] (KAFKA-13723) max.compaction.lag.ms implemented incorrectly

2022-03-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503854#comment-17503854 ] Jun Rao commented on KAFKA-13723: - [~xiongqiwu] : Thanks for the explanation. Make sense. So, this is

[jira] [Resolved] (KAFKA-13723) max.compaction.lag.ms implemented incorrectly

2022-03-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13723. - Resolution: Not A Problem > max.compaction.lag.ms implemented incorrectly >

[jira] [Commented] (KAFKA-13723) max.compaction.lag.ms implemented incorrectly

2022-03-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503813#comment-17503813 ] Jun Rao commented on KAFKA-13723: - [~xiongqiwu] and [~jjkoshy]  : Could you check if this is a real

[jira] [Created] (KAFKA-13723) max.compaction.lag.ms implemented incorrectly

2022-03-09 Thread Jun Rao (Jira)
Jun Rao created KAFKA-13723: --- Summary: max.compaction.lag.ms implemented incorrectly Key: KAFKA-13723 URL: https://issues.apache.org/jira/browse/KAFKA-13723 Project: Kafka Issue Type: Bug

[jira] [Commented] (KAFKA-10690) Produce-response delay caused by lagging replica fetch which affects in-sync one

2022-03-09 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503785#comment-17503785 ] Jun Rao commented on KAFKA-10690: - [~ocadaruma] : Thanks for filing the jira. Have you tried enabling

[jira] [Commented] (KAFKA-12901) Metadata not updated after broker restart.

2022-02-28 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499138#comment-17499138 ] Jun Rao commented on KAFKA-12901: - [~suriyav] : Did you see the same log error as in KAFKA-7987? If not,

[jira] [Commented] (KAFKA-13461) KafkaController stops functioning as active controller after ZooKeeperClient auth failure

2022-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497763#comment-17497763 ] Jun Rao commented on KAFKA-13461: - Basically, when there is no JAAS configured for ZK client and the ZK

[jira] [Resolved] (KAFKA-13407) Kafka controller out of service after ZK leader restart

2022-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13407. - Resolution: Fixed > Kafka controller out of service after ZK leader restart >

[jira] [Commented] (KAFKA-13407) Kafka controller out of service after ZK leader restart

2022-02-24 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497760#comment-17497760 ] Jun Rao commented on KAFKA-13407: - [~Olsson] : Thanks for the reply. I think we fixed this issue in

[jira] [Resolved] (KAFKA-13603) empty active segment can trigger recovery after clean shutdown and restart

2022-01-27 Thread Jun Rao (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-13603. - Fix Version/s: 3.2.0 Resolution: Fixed merged the PR to trunk. > empty active segment can

  1   2   3   4   5   >