Nico Kruber created FLINK-13537: ----------------------------------- Summary: Changing Kafka producer pool size and scaling out may create overlapping transaction IDs Key: FLINK-13537 URL: https://issues.apache.org/jira/browse/FLINK-13537 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.8.1, 1.9.0 Reporter: Nico Kruber
The Kafka producer's transaction IDs are only generated once when there was no previous state for that operator. In the case where we restore and increase parallelism (scale-out), some operators may not have previous state and create new IDs. Now, if we also reduce the poolSize, these new IDs may overlap with the old ones which should never happen! -- This message was sent by Atlassian JIRA (v7.6.14#76016)