[jira] [Commented] (KAFKA-7540) Flaky Test ConsumerBounceTest#testClose

2022-03-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17506529#comment-17506529 ] Guozhang Wang commented on KAFKA-7540: -- This test case is now very consistently failing with a

[jira] [Commented] (KAFKA-13699) ProcessorContext does not expose Stream Time

2022-03-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17505386#comment-17505386 ] Guozhang Wang commented on KAFKA-13699: --- I agree with [~mimaison], that we would only be able to

[jira] [Commented] (KAFKA-13690) Flaky test EosIntegrationTest.shouldWriteLatestOffsetsToCheckpointOnShutdown[at_least_once]

2022-03-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17503932#comment-17503932 ] Guozhang Wang commented on KAFKA-13690: --- May cover

[jira] [Created] (KAFKA-13722) Update internal interfaces that use ProcessorContext to use StateStoreContext instead

2022-03-09 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-13722: - Summary: Update internal interfaces that use ProcessorContext to use StateStoreContext instead Key: KAFKA-13722 URL: https://issues.apache.org/jira/browse/KAFKA-13722

[jira] [Updated] (KAFKA-7480) GlobalThread should honor custom auto.offset.reset policy

2022-03-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-7480: - Labels: needs-kip new-streams-runtime-should-fix (was: needs-kip) > GlobalThread should honor

[jira] [Commented] (KAFKA-6106) Postpone normal processing of tasks within a thread until restoration of all tasks have completed

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17501162#comment-17501162 ] Guozhang Wang commented on KAFKA-6106: -- As discussed with [~cadonna] offline, when we have completed

[jira] [Updated] (KAFKA-7934) Optimize restore for windowed and session stores

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-7934: - Labels: new-streams-runtime-should-fix (was: ) > Optimize restore for windowed and session

[jira] [Updated] (KAFKA-12634) Should checkpoint after restore finished

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12634: -- Priority: Critical (was: Major) > Should checkpoint after restore finished >

[jira] [Updated] (KAFKA-12634) Should checkpoint after restore finished

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12634: -- Labels: new-streams-runtime-should-fix newbie++ (was: newbie++) > Should checkpoint after

[jira] [Updated] (KAFKA-6106) Postpone normal processing of tasks within a thread until restoration of all tasks have completed

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-6106: - Labels: new-streams-runtime-should-fix newbie++ (was: newbie++) > Postpone normal processing of

[jira] [Updated] (KAFKA-13501) Avoid state restore via rebalance if standbys are enabled

2022-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13501: -- Labels: new-streams-runtime-should-fix (was: ) > Avoid state restore via rebalance if

[jira] [Updated] (KAFKA-8951) Avoid unnecessary rebalances and downtime for "safe" partitions

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8951: - Labels: new-rebalance-should-fix (was: ) > Avoid unnecessary rebalances and downtime for "safe"

[jira] [Updated] (KAFKA-7996) KafkaStreams does not pass timeout when closing Producer

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-7996: - Labels: needs-kip new-streams-runtime-should-fix (was: needs-kip) > KafkaStreams does not pass

[jira] [Updated] (KAFKA-10563) Make sure task directories don't remain locked by dead threads

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10563: -- Labels: new-streams-runtime-should-fix (was: ) > Make sure task directories don't remain

[jira] [Updated] (KAFKA-9062) Handle stalled writes to RocksDB

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9062: - Labels: new-streams-runtime-should-fix (was: ) > Handle stalled writes to RocksDB >

[jira] [Updated] (KAFKA-13295) Long restoration times for new tasks can lead to transaction timeouts

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13295: -- Labels: eos new-streams-runtime-should-fix (was: eos) > Long restoration times for new tasks

[jira] [Updated] (KAFKA-12738) Improved error handling for better at-least-once semantics and faster EOS

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12738: -- Labels: new-streams-runtime-should-fix (was: ) > Improved error handling for better

[jira] [Updated] (KAFKA-10263) Do not create standbys for those revoking active tasks if it is not stateful

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10263: -- Labels: new-streams-runtime-should-fix (was: ) > Do not create standbys for those revoking

[jira] [Updated] (KAFKA-10294) Consider whether some of ProcessorStateException should be auto-handled by Streams

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10294: -- Labels: new-streams-runtime-should-fix (was: ) > Consider whether some of

[jira] [Updated] (KAFKA-12693) Consecutive rebalances with zombie instances may cause corrupted changelogs

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12693: -- Labels: new-streams-runtime-should-fix streams (was: streams) > Consecutive rebalances with

[jira] [Updated] (KAFKA-10688) Handle accidental truncation of repartition topics as exceptional failure

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10688: -- Labels: new-streams-runtime-should-fix (was: ) > Handle accidental truncation of repartition

[jira] [Updated] (KAFKA-12812) Consider refactoring state store registration path

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12812: -- Labels: new-streams-runtime-should-fix (was: ) > Consider refactoring state store

[jira] [Commented] (KAFKA-8023) Improve global state store restoration by using multiple update threads

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499831#comment-17499831 ] Guozhang Wang commented on KAFKA-8023: -- One idea I'm having at the moment is that when we have

[jira] [Updated] (KAFKA-8037) KTable restore may load bad data

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8037: - Labels: new-streams-runtime-should-fix pull-request-available (was: pull-request-available) >

[jira] [Updated] (KAFKA-8023) Improve global state store restoration by using multiple update threads

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8023: - Labels: new-streams-runtime-should-fix performance (was: performance) > Improve global state

[jira] [Updated] (KAFKA-7663) Custom Processor supplied on addGlobalStore is not used when restoring state from topic

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-7663: - Labels: new-streams-runtime-should-fix (was: ) > Custom Processor supplied on addGlobalStore is

[jira] [Updated] (KAFKA-10410) OnRestoreStart disappeared from StateRestoreCallback in 2.6.0 and reappeared in a useless place

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10410: -- Labels: new-streams-runtime-should-fix (was: ) > OnRestoreStart disappeared from

[jira] [Updated] (KAFKA-10829) Kafka Streams handle produce exception improvement

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10829: -- Labels: new-streams-runtime-should-fix (was: ) > Kafka Streams handle produce exception

[jira] [Updated] (KAFKA-10575) StateRestoreListener#onRestoreEnd should always be triggered

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10575: -- Labels: new-streams-runtime-should-fix (was: ) > StateRestoreListener#onRestoreEnd should

[jira] [Updated] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12370: -- Labels: needs-kip new-streams-runtime-should-fix (was: needs-kip) > Refactor KafkaStreams

[jira] [Updated] (KAFKA-10357) Handle accidental deletion of repartition-topics as exceptional failure

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10357: -- Labels: needs-kip new-streams-runtime-should-fix (was: needs-kip) > Handle accidental

[jira] [Updated] (KAFKA-10199) Separate state restoration into separate threads

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10199: -- Labels: new-streams-runtime-should-fix (was: ) > Separate state restoration into separate

[jira] [Updated] (KAFKA-10532) Do not wipe state store under EOS when closing-dirty a RESTORING active or RUNNING standby task

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10532: -- Labels: new-streams-runtime-should-fix newbie++ (was: newbie++) > Do not wipe state store

[jira] [Commented] (KAFKA-13694) Some InvalidRecordException messages are thrown away

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499791#comment-17499791 ] Guozhang Wang commented on KAFKA-13694: --- Actually my previous suggestion has a flaw: even when one

[jira] [Commented] (KAFKA-13694) Some InvalidRecordException messages are thrown away

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499777#comment-17499777 ] Guozhang Wang commented on KAFKA-13694: --- [~RivenSun] I think that's a good point, I agree with you

[jira] [Commented] (KAFKA-13699) ProcessorContext does not expose Stream Time

2022-03-01 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17499683#comment-17499683 ] Guozhang Wang commented on KAFKA-13699: --- Hi [~lqxshay] thanks for filing the ticket. Just to

[jira] [Updated] (KAFKA-13333) Optimize condition for triggering rebalance after wiping out corrupted task

2022-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1: -- Labels: new-streams-runtime-should-fix (was: ) > Optimize condition for triggering rebalance

[jira] [Updated] (KAFKA-12486) Utilize HighAvailabilityTaskAssignor to avoid downtime on corrupted task

2022-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12486: -- Labels: new-streams-runtime-should-fix (was: ) > Utilize HighAvailabilityTaskAssignor to

[jira] [Commented] (KAFKA-13694) Some InvalidRecordException messages are thrown away

2022-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498491#comment-17498491 ] Guozhang Wang commented on KAFKA-13694: --- Thanks [~RivenSun]. It looks like we are in agreement on

[jira] [Commented] (KAFKA-13681) Sink event duplicates for partition-stuck stream application

2022-02-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498236#comment-17498236 ] Guozhang Wang commented on KAFKA-13681: --- [~DrozD_0] We have not decided when it would be applied

[jira] [Commented] (KAFKA-13694) Some InvalidRecordException messages are thrown away

2022-02-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17498234#comment-17498234 ] Guozhang Wang commented on KAFKA-13694: --- Hello [~RivenSun] thanks for the report. If I understand

[jira] [Commented] (KAFKA-13690) Flaky test EosIntegrationTest.shouldWriteLatestOffsetsToCheckpointOnShutdown[at_least_once]

2022-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497725#comment-17497725 ] Guozhang Wang commented on KAFKA-13690: --- I'll see if I can find a quick fix for this flakiness. >

[jira] [Commented] (KAFKA-13690) Flaky test EosIntegrationTest.shouldWriteLatestOffsetsToCheckpointOnShutdown[at_least_once]

2022-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497723#comment-17497723 ] Guozhang Wang commented on KAFKA-13690: --- I took a quick look at

[jira] [Commented] (KAFKA-13678) 2nd punctuation using STREAM_TIME does not respect scheduled interval

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497010#comment-17497010 ] Guozhang Wang commented on KAFKA-13678: --- Hello [~lorenzocagnatel] thanks for reporting. There's

[jira] [Commented] (KAFKA-13681) Sink event duplicates for partition-stuck stream application

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497004#comment-17497004 ] Guozhang Wang commented on KAFKA-13681: --- Thanks for reporting [~DrozD_0], I think this is indeed a

[jira] [Commented] (KAFKA-13683) Transactional Producer - Transaction with key xyz went wrong with exception: Timeout expired after 60000milliseconds while awaiting InitProducerId

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17497002#comment-17497002 ] Guozhang Wang commented on KAFKA-13683: --- Hello, I checked your uploaded files and cannot find any

[jira] [Updated] (KAFKA-13683) Transactional Producer - Transaction with key xyz went wrong with exception: Timeout expired after 60000milliseconds while awaiting InitProducerId

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13683: -- Labels: new-txn-protocol-should-fix (was: ) > Transactional Producer - Transaction with key

[jira] [Commented] (KAFKA-13684) KStream rebalance can lead to JVM process crash when network issues occure

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496995#comment-17496995 ] Guozhang Wang commented on KAFKA-13684: --- Thanks [~petercipov] for reporting this, we will look

[jira] [Updated] (KAFKA-13684) KStream rebalance can lead to JVM process crash when network issues occure

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13684: -- Priority: Critical (was: Major) > KStream rebalance can lead to JVM process crash when

[jira] [Commented] (KAFKA-13680) Kafka Streams application remains in RUNNING state although all stream threads shut down

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496989#comment-17496989 ] Guozhang Wang commented on KAFKA-13680: --- Thanks for reporting this Denis. I think we still need

[jira] [Commented] (KAFKA-13689) AbstractConfig log print information is incorrect

2022-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17496981#comment-17496981 ] Guozhang Wang commented on KAFKA-13689: --- Thanks [~RivenSun] for reporting this. I think logging

[jira] [Updated] (KAFKA-13676) When processing in ALOS, when one task encounters a task-specific exception we could still commit progress made by other tasks

2022-02-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13676: -- Description: When processing in ALOS, we might as well commit progress made by other tasks

[jira] [Updated] (KAFKA-13676) When processing in ALOS, when one task encounters a task-specific exception we could still commit progress made by other tasks

2022-02-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13676: -- Summary: When processing in ALOS, when one task encounters a task-specific exception we could

[jira] [Commented] (KAFKA-13615) Kafka Streams does not transition state on LeaveGroup due to poll interval being exceeded

2022-02-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491742#comment-17491742 ] Guozhang Wang commented on KAFKA-13615: --- [~timcosta] You mean your brokers are on the MSK right?

[jira] [Resolved] (KAFKA-12256) auto commit causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION

2022-02-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-12256. --- Fix Version/s: 3.2.0 Resolution: Fixed > auto commit causes delays due to retriable

[jira] [Commented] (KAFKA-12256) auto commit causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION

2022-02-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17491076#comment-17491076 ] Guozhang Wang commented on KAFKA-12256: --- Hello [~rleslie] yeah I think we can close this ticket

[jira] [Updated] (KAFKA-1935) Consumer should use a separate socket for Coordinator connection

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1935: - Labels: new-rebalance-should-fix newbie (was: new-consumer-threading-should-fix newbie) >

[jira] [Updated] (KAFKA-1935) Consumer should use a separate socket for Coordinator connection

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1935: - Labels: new-consumer-threading-should-fix newbie (was: newbie) > Consumer should use a separate

[jira] [Updated] (KAFKA-4740) Using new consumer API with a Deserializer that throws SerializationException can lead to infinite loop

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4740: - Labels: new-consumer-threading-should-fix (was: ) > Using new consumer API with a Deserializer

[jira] [Updated] (KAFKA-3949) Consumer topic subscription change may be ignored if a rebalance is in progress

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-3949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-3949: - Labels: new-consumer-threading-should-fix (was: ) > Consumer topic subscription change may be

[jira] [Updated] (KAFKA-2168) New consumer poll() can block other calls like position(), commit(), and close() indefinitely

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2168: - Labels: new-consumer-threading-should-fix (was: ) > New consumer poll() can block other calls

[jira] [Updated] (KAFKA-9140) Consumer gets stuck rejoining the group indefinitely

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9140: - Labels: new-consumer-threading-should-fix (was: ) > Consumer gets stuck rejoining the group

[jira] [Updated] (KAFKA-8104) Consumer cannot rejoin to the group after rebalancing

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8104: - Labels: new-consumer-threading-should-fix (was: ) > Consumer cannot rejoin to the group after

[jira] [Updated] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12169: -- Labels: bug new-rebalance-should-fix (was: bug) > Consumer can not know paritions change

[jira] [Commented] (KAFKA-12169) Consumer can not know paritions change when client leader restart with static membership protocol

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490715#comment-17490715 ] Guozhang Wang commented on KAFKA-12169: --- This seems related to KAFKA-13543 as well. > Consumer

[jira] [Updated] (KAFKA-10793) Race condition in FindCoordinatorFuture permanently severs connection to group coordinator

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-10793: -- Labels: new-consumer-threading-should-fix (was: ) > Race condition in FindCoordinatorFuture

[jira] [Updated] (KAFKA-13425) KafkaConsumer#pause() will lose its effect after groupRebalance occurs, which maybe cause data loss on the consumer side

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13425: -- Labels: new-consumer-threading-should-fix (was: ) > KafkaConsumer#pause() will lose its

[jira] [Updated] (KAFKA-13563) FindCoordinatorFuture never get cleared in non-group mode( consumer#assign)

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13563: -- Labels: new-consumer-threading-should-fix (was: ) > FindCoordinatorFuture never get cleared

[jira] [Updated] (KAFKA-12256) auto commit causes delays due to retriable UNKNOWN_TOPIC_OR_PARTITION

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-12256: -- Labels: new-consumer-threading-should-fix (was: ) > auto commit causes delays due to

[jira] [Updated] (KAFKA-7109) KafkaConsumer should close its incremental fetch sessions on close

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-7109: - Labels: new-consumer-threading-should-fix (was: ) > KafkaConsumer should close its incremental

[jira] [Updated] (KAFKA-13310) KafkaConsumer cannot jump out of the poll method, and the consumer is blocked in the ConsumerCoordinator method maybeAutoCommitOffsetsSync(Timer timer). Cpu and traffic

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13310: -- Labels: new-consumer-threading-should-fix (was: new-rebalance-should-fix) > KafkaConsumer

[jira] [Updated] (KAFKA-13322) Java client produces a large amount of garbage during a poll

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13322: -- Labels: new-consumer-threading-should-fix (was: new-rebalance-should-fix) > Java client

[jira] [Updated] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13463: -- Labels: new-consumer-threading-should-fix (was: new-rebalance-should-fix) > Improvement:

[jira] [Updated] (KAFKA-13435) Group won't consume partitions added after static member restart

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13435: -- Labels: new-rebalance-should-fix (was: ) > Group won't consume partitions added after static

[jira] [Commented] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17490704#comment-17490704 ] Guozhang Wang commented on KAFKA-13463: --- Thanks for brining this up [~RivenSun]. Just to bring

[jira] [Updated] (KAFKA-13463) Improvement: KafkaConsumer pause(Collection partitions)

2022-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13463: -- Labels: new-rebalance-should-fix (was: ) > Improvement: KafkaConsumer pause(Collection

[jira] [Commented] (KAFKA-13422) Even if the correct username and password are configured, when ClientBroker or KafkaClient tries to establish a SASL connection to ServerBroker, an exception is thrown

2022-02-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489744#comment-17489744 ] Guozhang Wang commented on KAFKA-13422: --- I'm unfortunately less familiar with security.auth

[jira] [Resolved] (KAFKA-13310) KafkaConsumer cannot jump out of the poll method, and the consumer is blocked in the ConsumerCoordinator method maybeAutoCommitOffsetsSync(Timer timer). Cpu and traffic

2022-02-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13310. --- Fix Version/s: 3.2.0 Resolution: Fixed > KafkaConsumer cannot jump out of the poll

[jira] [Updated] (KAFKA-13310) KafkaConsumer cannot jump out of the poll method, and the consumer is blocked in the ConsumerCoordinator method maybeAutoCommitOffsetsSync(Timer timer). Cpu and traffic

2022-02-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13310: -- Labels: new-rebalance-should-fix (was: ) > KafkaConsumer cannot jump out of the poll method,

[jira] [Assigned] (KAFKA-13310) KafkaConsumer cannot jump out of the poll method, and the consumer is blocked in the ConsumerCoordinator method maybeAutoCommitOffsetsSync(Timer timer). Cpu and traffic

2022-02-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-13310: - Assignee: RivenSun > KafkaConsumer cannot jump out of the poll method, and the

[jira] [Commented] (KAFKA-13647) RocksDb metrics 'number-open-files' is not correct

2022-02-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17488332#comment-17488332 ] Guozhang Wang commented on KAFKA-13647: --- TLDR: I think the `NO_FILE_OPENS` statistics is right,

[jira] [Resolved] (KAFKA-13563) FindCoordinatorFuture never get cleared in non-group mode( consumer#assign)

2022-02-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13563. --- Fix Version/s: 3.2.0 3.1.1 Resolution: Fixed >

[jira] [Commented] (KAFKA-13346) Kafka Streams fails due to RocksDB Locks Not Available Exception

2022-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17487405#comment-17487405 ] Guozhang Wang commented on KAFKA-13346: --- I'm closing this ticket for now since we have not heard

[jira] [Resolved] (KAFKA-13346) Kafka Streams fails due to RocksDB Locks Not Available Exception

2022-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-13346. --- Resolution: Not A Problem > Kafka Streams fails due to RocksDB Locks Not Available

[jira] [Commented] (KAFKA-13600) Rebalances while streams is in degraded state can cause stores to be reassigned and restore from scratch

2022-02-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486808#comment-17486808 ] Guozhang Wang commented on KAFKA-13600: --- Thanks guys for the great discussion here. I think just

[jira] [Commented] (KAFKA-7572) Producer should not send requests with negative partition id

2022-02-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17486780#comment-17486780 ] Guozhang Wang commented on KAFKA-7572: -- Thanks for pinging me. I've just made a pass on the PR. >

[jira] [Commented] (KAFKA-13621) Resign leader on network partition

2022-01-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17483938#comment-17483938 ] Guozhang Wang commented on KAFKA-13621: --- When we did KAFKA-12631 we discussed where we can

[jira] [Updated] (KAFKA-13322) Java client produces a large amount of garbage during a poll

2022-01-22 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13322: -- Labels: new-rebalance-should-fix (was: ) > Java client produces a large amount of garbage

[jira] [Updated] (KAFKA-13588) We should consolidate `changelogFor` methods to simplify the generation of internal topic names

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13588: -- Fix Version/s: 3.3.0 > We should consolidate `changelogFor` methods to simplify the

[jira] [Updated] (KAFKA-13588) We should consolidate `changelogFor` methods to simplify the generation of internal topic names

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13588: -- Description: [https://github.com/apache/kafka/pull/11611#discussion_r772625486] we should

[jira] [Commented] (KAFKA-13588) We should consolidate `changelogFor` methods to simplify the generation of internal topic names

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479643#comment-17479643 ] Guozhang Wang commented on KAFKA-13588: --- [~surahman] Thanks for your interests. I should clarify

[jira] [Assigned] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-13349: - Assignee: Sagar Rao (was: loboxu) > Allow Iterator.remove on KeyValueIterator >

[jira] [Commented] (KAFKA-13349) Allow Iterator.remove on KeyValueIterator

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479635#comment-17479635 ] Guozhang Wang commented on KAFKA-13349: --- [~sagarrao] I've just re-assigned the task to you. >

[jira] [Commented] (KAFKA-13600) Rebalances while streams is in degraded state can cause stores to be reassigned and restore from scratch

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479619#comment-17479619 ] Guozhang Wang commented on KAFKA-13600: --- [~tim.patterson] Thanks for filing this ticket. I'd like

[jira] [Updated] (KAFKA-13590) Rename InternalTopologyBuilder's #topicGroups method to be more descriptive

2022-01-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13590: -- Labels: newbie (was: ) > Rename InternalTopologyBuilder's #topicGroups method to be more

[jira] [Updated] (KAFKA-13543) Consumer may pass stale cluster metadata to the assignor following a subscription update

2022-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-13543: -- Labels: new-rebalance-should-fix (was: ) > Consumer may pass stale cluster metadata to the

[jira] [Commented] (KAFKA-13588) We should consolidate `changelogFor` methods to simplify the generation of internal topic names

2022-01-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472368#comment-17472368 ] Guozhang Wang commented on KAFKA-13588: --- This would also include consolidating the duplicated

[jira] [Commented] (KAFKA-13435) Group won't consume partitions added after static member restart

2022-01-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470930#comment-17470930 ] Guozhang Wang commented on KAFKA-13435: --- Sounds good, thanks @Jason. Let's do option 3) for now.

[jira] [Commented] (KAFKA-12537) Single Threaded applications will not work with SHUTDOWN_APPLICATION

2022-01-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469566#comment-17469566 ] Guozhang Wang commented on KAFKA-12537: --- Hey [~wcarlson5] just for my own understanding: why is

[jira] [Commented] (KAFKA-13563) FindCoordinatorFuture never get cleared in non-group mode( consumer#assign)

2022-01-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17469023#comment-17469023 ] Guozhang Wang commented on KAFKA-13563: --- Hi [~showuon] thanks for the report, I've reviewed the PR

<    1   2   3   4   5   6   7   8   9   10   >