John Roesler created KAFKA-7284: ----------------------------------- Summary: Producer getting fenced may cause Streams to shut down Key: KAFKA-7284 URL: https://issues.apache.org/jira/browse/KAFKA-7284 Project: Kafka Issue Type: Improvement Components: streams Affects Versions: 2.0.0 Reporter: John Roesler Assignee: John Roesler
As part of the investigation, I will determine what other versions are affected. In StreamTask, we catch a `ProducerFencedException` and throw a `TaskMigratedException`. However, in this case, the `RecordCollectorImpl` is throwing a `StreamsException`, caused by `KafkaException` caused by `ProducerFencedException`. In response to a TaskMigratedException, we would rebalance, but when we get a StreamsException, streams shuts itself down. In other words, we intended to do a rebalance in response to a producer fence, but actually, we shut down (when the fence happens inside the record collector). Coincidentally, Guozhang noticed and fixed this in a recent PR: [https://github.com/apache/kafka/pull/5428/files#diff-4e5612eeba09dabf30d0b8430f269ff6] The scope of this ticket is to extract that fix and associated tests, and send a separate PR to trunk and 2.0, and also to determine what other versions, if any, are affected. -- This message was sent by Atlassian JIRA (v7.6.3#76005)