junmuz opened a new pull request, #11205:
URL: https://github.com/apache/paimon/pull/11205

   ### Purpose
   
   Extract the metadata and serialization changes from #11017 as the second 
part of the proposed six-PR split. This PR can merge independently of the 
storage primitives.
   
   Carry guard file references, writer generations, and observed guard source 
sets through splits, commit messages, writer recovery state, and Flink 
coordinator responses. Preserve guard metadata through binary and Java 
serialization, including paged Flink recovery responses. Runtime discovery and 
table activation follow separately.
   
   Ordinary data and incremental splits retain their existing encodings, and 
existing constructors default to empty guard metadata.
   
   Commit messages advance to version 16, manifest checkpoint envelopes to 
version 6, and Flink wrapped envelopes to version 2 with an explicit nested 
manifest version. Supported older formats remain readable.
   
   Newly written checkpoints and savepoints require the updated readers, 
including for jobs without guard capture. Restoring these checkpoints with 
older Paimon versions is unsupported. Update the savepoint documentation with 
the upgrade and rollback requirements.
   
   ### Tests
   47 Core tests and 15 Flink tests passed with Java 11, the Flink 1 profile, 
and normal Maven checks enabled.
   
   Coverage includes legacy compatibility fixtures, multi-message checkpoint 
serialization, guarded split round trips, paged writer recovery, and existing 
Flink source checkpoint formats. Apache RAT also passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to