leaves12138 opened a new pull request, #10008:
URL: https://github.com/apache/paimon/pull/10008

   ### Purpose
   
   Row-ID reassignment currently publishes a metadata-only OVERWRITE snapshot 
without a durable record of the mapping it applied. Record 
`row-id-reassign.plan` in snapshot properties, referencing a versioned, 
checksummed file under `manifest/` containing the source/target snapshot IDs 
and absolute row-ID mappings by partition. Persist each retry's actual 
assignment before committing its snapshot.
   
   Keep the marker local to the reassignment commit: ordinary manifest 
replacement, manifest compaction, and rollback must not inherit it. Include 
plan files in snapshot/tag retention and orphan cleanup, and remove plans from 
definitively rejected commit attempts. This PR adds persistence and readback 
only; compact conflict rebasing will follow separately.
   
   ### Tests
   
   Passed 78 tests on dev2 with Java 11, using the normal Maven profile 
(without `fast-build`):
   
   - Plan round trips, concurrent append retries, null partitions, shifted 
range serialization, malformed plans, marker inheritance, snapshot/tag 
expiration, and orphan cleanup.
   - Existing manifest commit, rollback, snapshot expiration, and orphan 
cleanup regression tests.
   - Maven Checkstyle, Spotless, Enforcer, and Apache RAT checks.
   
   ```shell
   mvn -pl paimon-core -am -DfailIfNoTests=false -DwildcardSuites=none \
     
'-Dtest=DataEvolutionRowIdReassignerTest,RowRangeMappingIndexTest,FileStoreCommitTest#testManifestCompact+testCommitManifestWithProperties+testRollbackToAsLatestFileLevelDeleteIsVisibleToStreaming,ExpireSnapshotsTest#testMixedSnapshotAndTagDeletion+testSidecarsFollowSnapshotAndTagRetention,LocalOrphanFilesCleanTest#testOrphanCleanupProtectsReferencedSidecars+testPreservesManifestExtraFiles'
 test
   mvn -pl paimon-core validate
   mvn -pl paimon-core apache-rat:check
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to