rdblue commented on issue #1349: URL: https://github.com/apache/iceberg/issues/1349#issuecomment-675136724
The version hint file is just that -- a hint. It is not guaranteed to be correct because we cannot guarantee that two different FS operations complete successfully (the rename to commit, and the version hint update). To handle cases where the version hint is missing or incorrect, Iceberg should look for newer versions. If the version hint says the current version is 3, but v4.metadata.json exists, it should detect v4 and use that instead, and keep trying new version numbers until one does not exist. So the main problem here is that you had an incorrect read when the version hint was out of date. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
