jrmccluskey opened a new pull request, #41177: URL: https://github.com/apache/beam/pull/41177
Implements a number of underlying types that will be used for ExpireSnapshots and DeleteOrphanFiles. This consists of `FileInfo` (tracking information for the underlying files within an iceberg table being operated on) and `ManifestDescriptor` (a serializable representation of a manifest file to distribute manifest reads across workers) along with the `FileCategory` enumeration and a `FileCategoryCounts` object to track the counts for files being modified (the latter will be converted into an appropriate results object at the end of both table maintenance operations.) [WIP overview doc](https://docs.google.com/document/d/1YrGL8Wb5pp1t1rC-dWKatxJZljVhG4viYIiQOay86Ug/edit?usp=sharing) Part of #39224 and #39225 <!-- Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). - [ ] Replace these instructions with a description of your change and why you have made it. - [ ] Mention the appropriate issue in your description (for example: `addresses #123` or `fixes #456`). - [ ] Update `CHANGES.md` with noteworthy changes. See [CONTRIBUTING.md]() for more details. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
