pvary commented on pull request #3851: URL: https://github.com/apache/iceberg/pull/3851#issuecomment-1007897477
> @pvary - Yes, all this needs is the latest metadata file. This was my conclusion too (after I have left the comment I continued chewing on this one 😄) Then I went further, and this is where I am now: - What happens, if a table is modified in one of the catalogs (I suspect that this is catalog dependent as HiveCatalog will not follow the changes, but HadoopTable/HadoopCatalog might follow each others changes, as they rely on the file names) - Also issues will arise if we start expiring snapshots. If one catalog decides that one of the files are not needed anymore, then it could remove the file, even if the file is still needed for the other table. Is there a way to prevent this situation? Thanks, Peter -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
