yuzhaojing opened a new issue #2371:
URL: https://github.com/apache/iceberg/issues/2371
Currently, MergingSnapshotProducer#validateDataFilesExist will validate all
snapshots, but it doesn't consider rewrite and expire action. If we rewrite a
snapshot, and then expire any snapshot with `cleanExpiredFiles(true)` before
rewrite, this check will throw Execption.
`ValidationException.check(currentSnapshot != null,
"Cannot determine history between starting snapshot %s and current
%s",
startingSnapshotId, currentSnapshotId);`
Because cleanExpiredFiles will delete snapshot in metadata, and
MergingSnapshotProducer#validateDataFilesExist will check all snapshot in
metadata from current to first. There must be a parent-snapshot-id doesn't have
corresponding snapshot.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
