nicktelford opened a new pull request, #21814: URL: https://github.com/apache/kafka/pull/21814
Kafka Streams 4.3 moved offset management from per-task `.checkpoint` files into RocksDB column families (KAFKA-17411/KAFKA-19712). An upgrade path exists (`migrateLegacyOffsets()`) to migrate offsets from old `.checkpoint` files into the new system, but there is no downgrade path — if a user rolls back to a pre-4.3 version, the old `.checkpoint` files no longer exist. This change adds downgrade support: when `upgrade.from` is set to a version older than 4.3, a consolidated per-task `.checkpoint` file is written during close so that an older Kafka Streams version can find its offsets. The conversion uses `OFFSET_UNKNOWN` for null offsets, matching the legacy checkpoint format. The downgrade checkpoint is written from `ProcessorStateManager.close()` for regular tasks and `GlobalStateManagerImpl.close()` for global stores. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
