Bill Bejeck created KAFKA-20753:
-----------------------------------
Summary: Transactional RocksDB store fails to reopen
(TaskCorrupted loop) when a task's active and standby are transiently
co-located on one instance under EOS
Key: KAFKA-20753
URL: https://issues.apache.org/jira/browse/KAFKA-20753
Project: Kafka
Issue Type: Bug
Components: streams
Affects Versions: 4.4.0
Reporter: Bill Bejeck
Assignee: Nicholas Telford
Fix For: 4.4.0
With {{processing.guarantee=exactly_once_v2}} and
{{enable.transactional.statestores=true,}} a rebalance that adds a StreamThread
can transiently co-locate the same task's active and standby on one
instance (different threads). The freshly-assigned active opens the
persistent RocksDB store while the live sibling standby still holds it open, so
the store-open status check rejects it and the task enters a {{TaskCorrupted →
re-init → corrupt}} loop.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
