junmuz opened a new pull request, #11205: URL: https://github.com/apache/paimon/pull/11205
### Purpose Extract the metadata and serialization changes from #11017 as the second part of the proposed six-PR split. This PR can merge independently of the storage primitives. Carry guard file references, writer generations, and observed guard source sets through splits, commit messages, writer recovery state, and Flink coordinator responses. Preserve guard metadata through binary and Java serialization, including paged Flink recovery responses. Runtime discovery and table activation follow separately. Ordinary data and incremental splits retain their existing encodings, and existing constructors default to empty guard metadata. Commit messages advance to version 16, manifest checkpoint envelopes to version 6, and Flink wrapped envelopes to version 2 with an explicit nested manifest version. Supported older formats remain readable. Newly written checkpoints and savepoints require the updated readers, including for jobs without guard capture. Restoring these checkpoints with older Paimon versions is unsupported. Update the savepoint documentation with the upgrade and rollback requirements. ### Tests 47 Core tests and 15 Flink tests passed with Java 11, the Flink 1 profile, and normal Maven checks enabled. Coverage includes legacy compatibility fixtures, multi-message checkpoint serialization, guarded split round trips, paged writer recovery, and existing Flink source checkpoint formats. Apache RAT also passed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
