plusplusjiajia opened a new pull request, #9036:
URL: https://github.com/apache/paimon/pull/9036
### Purpose
`IcebergCommitCallback` stamps every commit with the schema manager's
latest schema id, but a rollback publishes a snapshot on an older schema. The
rolled-back snapshot's metadata keeps claiming the evolved schema, so readers
project columns its data does not have. Through the REST metadata committer the
failure is silent: the current-schema pointer never moves back and the catalog
keeps serving the evolved schema — in the new test, `Record(1, 10)` reads back
as `Record(1, 10, null)`.
The fix:
- `IcebergCommitCallback`: label each commit with the schema active at
that snapshot, append only schema ids the metadata does not already carry, and
never regress `last-column-id`;
- `IcebergRestMetadataCommitter`: allow the current-schema pointer to move
backwards — the catalog keeps every schema it has registered.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
