RussellSpitzer opened a new pull request #1395: URL: https://github.com/apache/iceberg/pull/1395
Previously ExpireSnapshotAction would always use toLocalIterator which ends up costing significantly more time on smaller data sets. Since even the largest lists of files are expected to fit in memory we are changing the default to Collect. Collect will bring back the results more quickly at the cost of additional memory. An option to streamDeleteResults will still be available for extremely large expire operations. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
