JingsongLi commented on PR #9529: URL: https://github.com/apache/paimon/pull/9529#issuecomment-5526615097
Two suggestions on the publication contract: 1. **Keep `__versions` as a published-version manifest only.** Commit frames, episodes, tasks, and optional subtasks, create the common `version_id` tag on every component, then append one manifest row as the final publication step. For the current new-target-only importer, the `status` column and the initial `PENDING` row are unnecessary. The schema can simply be `(version_id, info_json, stats_json, has_subtasks)`. Failed imports may leave tables and tags for inspection; without a manifest row, the version remains unpublished. 2. **Make the reader and tag contract explicit.** Readers must only open versions present in `__versions` and read every required component through the matching `version_id` tag. A missing required tag must be an error, never a fallback to the latest snapshot. Published release tags must not be rebound to different snapshots, and their retention/deletion should be managed as a complete dataset release rather than independently per table. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
