[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057291#comment-17057291 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] Also about your reported Ille

[jira] [Comment Edited] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057285#comment-17057285 ] Guozhang Wang edited comment on KAFKA-8803 at 3/11/20, 6:09 PM: ---

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057285#comment-17057285 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] "and due to time shift which

[jira] [Comment Edited] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057285#comment-17057285 ] Guozhang Wang edited comment on KAFKA-8803 at 3/11/20, 6:08 PM: ---

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057279#comment-17057279 ] Guozhang Wang commented on KAFKA-8803: -- https://github.com/apache/kafka/pull/8269 >

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057269#comment-17057269 ] Guozhang Wang commented on KAFKA-8803: -- [~oleksii.boiko] indeed had a great observat

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-03-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057241#comment-17057241 ] Guozhang Wang commented on KAFKA-8803: -- [~rocketraman] Yes here are the current stat

[jira] [Commented] (KAFKA-6647) KafkaStreams.cleanUp creates .lock file in directory its trying to clean (Windows OS)

2020-03-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056511#comment-17056511 ] Guozhang Wang commented on KAFKA-6647: -- [~shoffmeister] [~slmingol] [~lind] I have a

[jira] [Commented] (KAFKA-9659) Kafka Streams / Consumer configured for static membership fails on "fatal exception: group.instance.id gets fenced"

2020-03-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056508#comment-17056508 ] Guozhang Wang commented on KAFKA-9659: -- My search in kibana has some good news and s

[jira] [Comment Edited] (KAFKA-9659) Kafka Streams / Consumer configured for static membership fails on "fatal exception: group.instance.id gets fenced"

2020-03-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056467#comment-17056467 ] Guozhang Wang edited comment on KAFKA-9659 at 3/10/20, 10:33 PM: --

[jira] [Commented] (KAFKA-9659) Kafka Streams / Consumer configured for static membership fails on "fatal exception: group.instance.id gets fenced"

2020-03-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056467#comment-17056467 ] Guozhang Wang commented on KAFKA-9659: -- March 5th 2020, 00:55:28.517ReplicaFetch

[jira] [Commented] (KAFKA-9659) Kafka Streams / Consumer configured for static membership fails on "fatal exception: group.instance.id gets fenced"

2020-03-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17056441#comment-17056441 ] Guozhang Wang commented on KAFKA-9659: -- Hi [~rohanpd] is the broker version the same

[jira] [Resolved] (KAFKA-9176) Flaky test failure: OptimizedKTableIntegrationTest.shouldApplyUpdatesToStandbyStore

2020-03-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9176. -- Fix Version/s: 2.6.0 Resolution: Fixed > Flaky test failure: > OptimizedKTableIntegrat

[jira] [Commented] (KAFKA-6647) KafkaStreams.cleanUp creates .lock file in directory its trying to clean (Windows OS)

2020-03-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17055452#comment-17055452 ] Guozhang Wang commented on KAFKA-6647: -- I looked at this ticket for another time and

[jira] [Resolved] (KAFKA-9645) Records could not find corresponding partition/task

2020-03-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9645. -- Fix Version/s: 2.6.0 Resolution: Fixed > Records could not find corresponding partition/

[jira] [Created] (KAFKA-9678) Introduce bounded exponential backoff in clients

2020-03-06 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9678: Summary: Introduce bounded exponential backoff in clients Key: KAFKA-9678 URL: https://issues.apache.org/jira/browse/KAFKA-9678 Project: Kafka Issue Type: Im

[jira] [Commented] (KAFKA-9176) Flaky test failure: OptimizedKTableIntegrationTest.shouldApplyUpdatesToStandbyStore

2020-03-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17052587#comment-17052587 ] Guozhang Wang commented on KAFKA-9176: -- The recent failure on trunk is an actual bug

[jira] [Assigned] (KAFKA-9176) Flaky test failure: OptimizedKTableIntegrationTest.shouldApplyUpdatesToStandbyStore

2020-03-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9176: Assignee: Guozhang Wang > Flaky test failure: > OptimizedKTableIntegrationTest.shouldApp

[jira] [Commented] (KAFKA-9061) StreamStreamJoinIntegrationTest flaky test failures

2020-03-03 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050486#comment-17050486 ] Guozhang Wang commented on KAFKA-9061: -- That's a good point -- I only looked at the

[jira] [Updated] (KAFKA-8894) Flaky org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromFileAfterResetWithoutIntermediateUserTopic

2020-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8894: - Component/s: streams > Flaky > org.apache.kafka.streams.integration.ResetIntegrationTest.testRep

[jira] [Updated] (KAFKA-8893) Flaky ResetIntegrationTest. testReprocessingFromScratchAfterResetWithIntermediateUserTopic

2020-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8893: - Component/s: streams > Flaky ResetIntegrationTest. > testReprocessingFromScratchAfterResetWithIn

[jira] [Updated] (KAFKA-8895) Flaky org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromDateTimeAfterResetWithoutIntermediateUserTopic

2020-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-8895: - Component/s: streams > Flaky > org.apache.kafka.streams.integration.ResetIntegrationTest.testRep

[jira] [Commented] (KAFKA-9061) StreamStreamJoinIntegrationTest flaky test failures

2020-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17049633#comment-17049633 ] Guozhang Wang commented on KAFKA-9061: -- I think this has been fixed via KAFKA-7195 (

[jira] [Resolved] (KAFKA-6819) Refactor build-in StreamsMetrics internal implementations

2020-03-02 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6819. -- Fix Version/s: 2.5.0 Resolution: Fixed > Refactor build-in StreamsMetrics internal imple

[jira] [Resolved] (KAFKA-9623) Streams will attempt to commit during shutdown if rebalance is in progress

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9623. -- Fix Version/s: 2.6.0 Resolution: Fixed > Streams will attempt to commit during shutdown

[jira] [Resolved] (KAFKA-9620) Task revocation failure could introduce remaining unclean tasks

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9620. -- Fix Version/s: 2.6.0 Resolution: Fixed > Task revocation failure could introduce remaini

[jira] [Commented] (KAFKA-9620) Task revocation failure could introduce remaining unclean tasks

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047841#comment-17047841 ] Guozhang Wang commented on KAFKA-9620: -- I synced with Boyang yesterday over the PR,

[jira] [Resolved] (KAFKA-9399) Flaky Test BranchedMultiLevelRepartitionConnectedTopologyTest.testTopologyBuild

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9399. -- Resolution: Fixed > Flaky Test > BranchedMultiLevelRepartitionConnectedTopologyTest.testTopolo

[jira] [Commented] (KAFKA-7544) Transient Failure: org.apache.kafka.streams.integration.EosIntegrationTest.shouldNotViolateEosIfOneTaskFails

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047811#comment-17047811 ] Guozhang Wang commented on KAFKA-7544: -- Failed again: {code} 19:38:58 org.apache.ka

[jira] [Resolved] (KAFKA-9606) Document Metrics Changes from KIP-444

2020-02-28 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9606. -- Resolution: Fixed > Document Metrics Changes from KIP-444 > ---

[jira] [Created] (KAFKA-9623) Streams will attempt to commit during shutdown if rebalance is in progress

2020-02-27 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9623: Summary: Streams will attempt to commit during shutdown if rebalance is in progress Key: KAFKA-9623 URL: https://issues.apache.org/jira/browse/KAFKA-9623 Project: Kaf

[jira] [Comment Edited] (KAFKA-9592) Safely abort Producer transactions during application shutdown

2020-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047100#comment-17047100 ] Guozhang Wang edited comment on KAFKA-9592 at 2/28/20 1:03 AM:

[jira] [Commented] (KAFKA-9592) Safely abort Producer transactions during application shutdown

2020-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17047100#comment-17047100 ] Guozhang Wang commented on KAFKA-9592: -- That's a good question -- if we are certain

[jira] [Commented] (KAFKA-9620) Task revocation failure could introduce remaining unclean tasks

2020-02-27 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17046995#comment-17046995 ] Guozhang Wang commented on KAFKA-9620: -- I think there are two issues we've observed

[jira] [Resolved] (KAFKA-9607) Should not clear partition queue during task close

2020-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9607. -- Fix Version/s: 2.6.0 Resolution: Fixed > Should not clear partition queue during task cl

[jira] [Resolved] (KAFKA-9610) Should not throw illegal state exception during task revocation

2020-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9610. -- Fix Version/s: 2.6.0 Resolution: Fixed > Should not throw illegal state exception during

[jira] [Resolved] (KAFKA-9614) Avoid initializing the topology twice when resuming stream tasks from suspended state

2020-02-26 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9614. -- Fix Version/s: 2.6.0 Resolution: Fixed > Avoid initializing the topology twice when resu

[jira] [Created] (KAFKA-9615) Refactor TaskManager to extract task creation / cleanup out of StreamThread

2020-02-26 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9615: Summary: Refactor TaskManager to extract task creation / cleanup out of StreamThread Key: KAFKA-9615 URL: https://issues.apache.org/jira/browse/KAFKA-9615 Project: Ka

[jira] [Created] (KAFKA-9614) Avoid initializing the topology twice when resuming stream tasks from suspended state

2020-02-26 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9614: Summary: Avoid initializing the topology twice when resuming stream tasks from suspended state Key: KAFKA-9614 URL: https://issues.apache.org/jira/browse/KAFKA-9614 P

[jira] [Resolved] (KAFKA-9602) Incorrect close of producer instance during partition assignment

2020-02-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9602. -- Resolution: Fixed > Incorrect close of producer instance during partition assignment >

[jira] [Resolved] (KAFKA-9572) Sum Computation with Exactly-Once Enabled and Injected Failures Misses Some Records

2020-02-25 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9572. -- Fix Version/s: (was: 2.5.0) 2.6.0 Resolution: Fixed > Sum Computa

[jira] [Commented] (KAFKA-9598) RocksDB exception when grouping dynamically appearing topics into a KTable

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044035#comment-17044035 ] Guozhang Wang commented on KAFKA-9598: -- I think it maybe related to some old bugs th

[jira] [Updated] (KAFKA-9598) RocksDB exception when grouping dynamically appearing topics into a KTable

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9598: - Description: A streams application consumes a number of topics via a whitelisted regex. The topi

[jira] [Commented] (KAFKA-9572) Sum Computation with Exactly-Once Enabled and Injected Failures Misses Some Records

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17044030#comment-17044030 ] Guozhang Wang commented on KAFKA-9572: -- I looked into the source code of 2.4 and 2.5

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043797#comment-17043797 ] Guozhang Wang commented on KAFKA-9455: -- I'm actually considering that we should use

[jira] [Resolved] (KAFKA-9599) create unique sensor to record group rebalance

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9599. -- Fix Version/s: 2.4.1 2.5.0 Resolution: Fixed > create unique sensor t

[jira] [Commented] (KAFKA-9599) create unique sensor to record group rebalance

2020-02-24 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043633#comment-17043633 ] Guozhang Wang commented on KAFKA-9599: -- Thanks for catching this bug [~chia7712]! Pl

[jira] [Commented] (KAFKA-9592) Safely abort Producer transactions during application shutdown

2020-02-23 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17043060#comment-17043060 ] Guozhang Wang commented on KAFKA-9592: -- My recommendation would be we first fix this

[jira] [Commented] (KAFKA-8037) KTable restore may load bad data

2020-02-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042315#comment-17042315 ] Guozhang Wang commented on KAFKA-8037: -- Not sure I fully understand... the committed

[jira] [Commented] (KAFKA-8037) KTable restore may load bad data

2020-02-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17042172#comment-17042172 ] Guozhang Wang commented on KAFKA-8037: -- This is an interesting idea. As for whether

[jira] [Commented] (KAFKA-9572) Sum Computation with Exactly-Once Enabled and Injected Failures Misses Some Records

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041389#comment-17041389 ] Guozhang Wang commented on KAFKA-9572: -- 8058 has been merged to trunk, I'm not sure

[jira] [Resolved] (KAFKA-9481) Improve TaskMigratedException handling on Stream thread

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9481. -- Fix Version/s: 2.6.0 Resolution: Fixed > Improve TaskMigratedException handling on Strea

[jira] [Commented] (KAFKA-9572) Sum Computation with Exactly-Once Enabled and Injected Failures Misses Some Records

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041328#comment-17041328 ] Guozhang Wang commented on KAFKA-9572: -- It seems that when we injected the error the

[jira] [Commented] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041255#comment-17041255 ] Guozhang Wang commented on KAFKA-9552: -- Normally `OutOfSequence` should not cause th

[jira] [Commented] (KAFKA-8726) Producer can't abort a transaction aftersome send errors

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041251#comment-17041251 ] Guozhang Wang commented on KAFKA-8726: -- OUT_OF_ORDER_SEQUENCE_NUMBER is a fatal erro

[jira] [Commented] (KAFKA-9572) Sum Computation with Exactly-Once Enabled and Injected Failures Misses Some Records

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17041245#comment-17041245 ] Guozhang Wang commented on KAFKA-9572: -- Yup I can take a look at it today. > Sum Co

[jira] [Resolved] (KAFKA-8910) Incorrect javadoc at KafkaProducer.InterceptorCallback#onCompletion

2020-02-20 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8910. -- Fix Version/s: 2.6.0 Resolution: Fixed > Incorrect javadoc at KafkaProducer.InterceptorC

[jira] [Assigned] (KAFKA-9546) Make FileStreamSourceTask extendable with generic streams

2020-02-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9546: Assignee: Csaba Galyo > Make FileStreamSourceTask extendable with generic streams > --

[jira] [Commented] (KAFKA-9552) Stream should handle OutOfSequence exception thrown from Producer

2020-02-16 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17038009#comment-17038009 ] Guozhang Wang commented on KAFKA-9552: -- I also agree that we should not treat `OutOf

[jira] [Commented] (KAFKA-9526) Augment topology description with serdes

2020-02-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17037347#comment-17037347 ] Guozhang Wang commented on KAFKA-9526: -- +1 ! > Augment topology description with se

[jira] [Resolved] (KAFKA-9417) Integration test for new EOS model with vanilla Producer and Consumer

2020-02-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9417. -- Resolution: Fixed > Integration test for new EOS model with vanilla Producer and Consumer > ---

[jira] [Updated] (KAFKA-9417) Integration test for new EOS model with vanilla Producer and Consumer

2020-02-12 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-9417: - Fix Version/s: 2.5.0 > Integration test for new EOS model with vanilla Producer and Consumer > --

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034923#comment-17034923 ] Guozhang Wang commented on KAFKA-9455: -- No we do not need a new point API, the exist

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-11 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17034889#comment-17034889 ] Guozhang Wang commented on KAFKA-9455: -- >From the ReadOnlyWindowedStore interface:

[jira] [Resolved] (KAFKA-9523) Reduce flakiness of BranchedMultiLevelRepartitionConnectedTopologyTest

2020-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9523. -- Fix Version/s: 2.5.0 Resolution: Fixed > Reduce flakiness of BranchedMultiLevelRepartiti

[jira] [Resolved] (KAFKA-9505) InternalTopicManager may falls into infinite loop with partially created topics

2020-02-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9505. -- Fix Version/s: 2.5.0 Resolution: Fixed > InternalTopicManager may falls into infinite lo

[jira] [Created] (KAFKA-9526) Augment topology description with serdes

2020-02-07 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9526: Summary: Augment topology description with serdes Key: KAFKA-9526 URL: https://issues.apache.org/jira/browse/KAFKA-9526 Project: Kafka Issue Type: Improvemen

[jira] [Commented] (KAFKA-8307) Kafka Streams should provide some mechanism to determine topology equality and compatibility

2020-02-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032525#comment-17032525 ] Guozhang Wang commented on KAFKA-8307: -- Thanks for the summary [~vvcephei]. I agree

[jira] [Resolved] (KAFKA-9177) Pause completed partitions on restore consumer

2020-02-07 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9177. -- Fix Version/s: 2.6.0 Assignee: Guozhang Wang Resolution: Fixed As part of KAFKA

[jira] [Resolved] (KAFKA-8737) TaskMigrated Exception while rebalancing kafka streams

2020-02-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8737. -- Assignee: Guozhang Wang (was: Bill Bejeck) Resolution: Duplicate > TaskMigrated Exceptio

[jira] [Commented] (KAFKA-8737) TaskMigrated Exception while rebalancing kafka streams

2020-02-06 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17032050#comment-17032050 ] Guozhang Wang commented on KAFKA-8737: -- While fixing KAFKA-9481 I've cleaned up the

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031237#comment-17031237 ] Guozhang Wang commented on KAFKA-9430: -- I see your point, we can expose this from th

[jira] [Commented] (KAFKA-9512) Flaky Test LagFetchIntegrationTest.shouldFetchLagsDuringRestoration

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031177#comment-17031177 ] Guozhang Wang commented on KAFKA-9512: -- Did you see it in Scala 2.13 or other Scala

[jira] [Resolved] (KAFKA-9427) StateRestoreListener.onRestoreEnd should report actual message count

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9427. -- Resolution: Fixed This has been fixed as part of KAFKA-9113. > StateRestoreListener.onRestoreE

[jira] [Resolved] (KAFKA-9113) Clean up task management

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9113. -- Fix Version/s: 2.6.0 Resolution: Fixed This clean is done in trunk (2.6.0) now. > Clean

[jira] [Commented] (KAFKA-8574) EOS race condition during task transition leads to LocalStateStore truncation in Kafka Streams 2.0.1

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030829#comment-17030829 ] Guozhang Wang commented on KAFKA-8574: -- As part of KAFKA-9113 we have moved the read

[jira] [Resolved] (KAFKA-8574) EOS race condition during task transition leads to LocalStateStore truncation in Kafka Streams 2.0.1

2020-02-05 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8574. -- Fix Version/s: 2.6.0 Assignee: Guozhang Wang Resolution: Fixed > EOS race condi

[jira] [Commented] (KAFKA-9430) Tighten up lag estimates when source topic optimization is on

2020-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030241#comment-17030241 ] Guozhang Wang commented on KAFKA-9430: -- Your analysis is correct, I think it is just

[jira] [Commented] (KAFKA-9455) Consider using TreeMap for in-memory stores of Streams

2020-02-04 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030153#comment-17030153 ] Guozhang Wang commented on KAFKA-9455: -- [~high.lee] Sure please feel free to pick it

[jira] [Created] (KAFKA-9505) InternalTopicManager may falls into infinite loop with partially created topics

2020-02-04 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9505: Summary: InternalTopicManager may falls into infinite loop with partially created topics Key: KAFKA-9505 URL: https://issues.apache.org/jira/browse/KAFKA-9505 Project

[jira] [Created] (KAFKA-9481) Improve TaskMigratedException handling on Stream thread

2020-01-29 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9481: Summary: Improve TaskMigratedException handling on Stream thread Key: KAFKA-9481 URL: https://issues.apache.org/jira/browse/KAFKA-9481 Project: Kafka Issue T

[jira] [Assigned] (KAFKA-9427) StateRestoreListener.onRestoreEnd should report actual message count

2020-01-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang reassigned KAFKA-9427: Assignee: Guozhang Wang > StateRestoreListener.onRestoreEnd should report actual message c

[jira] [Commented] (KAFKA-9427) StateRestoreListener.onRestoreEnd should report actual message count

2020-01-21 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020529#comment-17020529 ] Guozhang Wang commented on KAFKA-9427: -- Will do this as part of the KAFKA-9113 clean

[jira] [Commented] (KAFKA-9356) Potential data loss in InMemoryWindowStore and InMemorySessionStore

2020-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019177#comment-17019177 ] Guozhang Wang commented on KAFKA-9356: -- Thanks [~ableegoldman], I cannot find the ex

[jira] [Created] (KAFKA-9455) Consider using TreeMap for In-memory stores of Streams

2020-01-19 Thread Guozhang Wang (Jira)
Guozhang Wang created KAFKA-9455: Summary: Consider using TreeMap for In-memory stores of Streams Key: KAFKA-9455 URL: https://issues.apache.org/jira/browse/KAFKA-9455 Project: Kafka Issue Ty

[jira] [Commented] (KAFKA-8803) Stream will not start due to TimeoutException: Timeout expired after 60000milliseconds while awaiting InitProducerId

2020-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019171#comment-17019171 ] Guozhang Wang commented on KAFKA-8803: -- Hi [~rocketraman] [~panpan.liu] We are very

[jira] [Commented] (KAFKA-9142) topic __transaction_state disk space grows too big

2020-01-19 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019170#comment-17019170 ] Guozhang Wang commented on KAFKA-9142: -- Thanks [~panpan.liu], by `recover to normal`

[jira] [Commented] (KAFKA-9450) Decouple inner state flushing from committing with EOS

2020-01-18 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018781#comment-17018781 ] Guozhang Wang commented on KAFKA-9450: -- I think John's idea is to e.g. use a preserv

[jira] [Resolved] (KAFKA-6212) Kafka Streams - Incorrect partition rebalancing

2020-01-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-6212. -- Resolution: Cannot Reproduce > Kafka Streams - Incorrect partition rebalancing > --

[jira] [Commented] (KAFKA-6212) Kafka Streams - Incorrect partition rebalancing

2020-01-14 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17015205#comment-17015205 ] Guozhang Wang commented on KAFKA-6212: -- I'm closing this ticket since there's no act

[jira] [Resolved] (KAFKA-9159) Consumer.endOffsets Throw TimeoutException: Failed to get offsets by times in 30000ms after a leader change

2020-01-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9159. -- Fix Version/s: 2.5.0 Resolution: Fixed This has been fixed and would be included in the

[jira] [Commented] (KAFKA-7061) Enhanced log compaction

2020-01-13 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17014583#comment-17014583 ] Guozhang Wang commented on KAFKA-7061: -- Hi David, the corresponding KIP is already a

[jira] [Commented] (KAFKA-2758) Improve Offset Commit Behavior

2020-01-10 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-2758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013271#comment-17013271 ] Guozhang Wang commented on KAFKA-2758: -- We used to put it on hold especially for 1)

[jira] [Resolved] (KAFKA-8179) Incremental Rebalance Protocol for Kafka Consumer

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8179. -- Fix Version/s: 2.4.0 2.5.0 Resolution: Fixed > Incremental Rebalance

[jira] [Resolved] (KAFKA-8421) Allow consumer.poll() to return data in the middle of rebalance

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8421. -- Fix Version/s: 2.5.0 Assignee: Guozhang Wang Resolution: Fixed > Allow consumer

[jira] [Commented] (KAFKA-7965) Flaky Test ConsumerBounceTest#testRollingBrokerRestartsWithSmallerMaxGroupSizeConfigDisruptsBigGroup

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012305#comment-17012305 ] Guozhang Wang commented on KAFKA-7965: -- https://builds.apache.org/job/kafka-pr-jdk8-

[jira] [Commented] (KAFKA-6078) Investigate failure of ReassignPartitionsClusterTest.shouldExpandCluster

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-6078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012304#comment-17012304 ] Guozhang Wang commented on KAFKA-6078: -- Failed in https://builds.apache.org/job/kaf

[jira] [Commented] (KAFKA-9393) DeleteRecords may cause extreme lock contention for large partition directories

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012170#comment-17012170 ] Guozhang Wang commented on KAFKA-9393: -- Thanks for filing this Lucas. This is good t

[jira] [Commented] (KAFKA-9390) Non-key joining of KTable not compatible with confluent avro serdes

2020-01-09 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012167#comment-17012167 ] Guozhang Wang commented on KAFKA-9390: -- There is a known issue I think since Conflue

[jira] [Resolved] (KAFKA-9384) Loop improvements

2020-01-08 Thread Guozhang Wang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-9384. -- Fix Version/s: (was: 2.4.0) 2.5.0 Resolution: Fixed > Loop impro

<    5   6   7   8   9   10   11   12   13   14   >