pvary commented on PR #18401: URL: https://github.com/apache/iceberg/pull/18401#issuecomment-6287756951
> Letting each maintenance job read the head's summary and set the keys itself works when the job controls its own code. It doesn't work for CALL system.rewrite_data_files or rewrite_manifests from SQL, or for a generic maintenance service that doesn't know the writers' keys. I think depending on the head's summary is brittle. Any concurrent write or compaction could break the use-case. > Retaining old snapshots with expiration settings keeps the uncompacted data files alive, which defeats the purpose of compaction. This use-case could be server by a compaction only feature. We don't need to be this in the core. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
