anoopj opened a new pull request, #17541: URL: https://github.com/apache/iceberg/pull/17541
Adds `ManifestExpander`, a planner that walks a v4 adaptive metadata tree and emits `FileScanTask`s. It reads the root manifest, emits a task per live DATA entry, and expands DATA_MANIFEST entries into their leaf manifests. Leaves are read lazily and, when a worker pool is supplied, expanded in parallel. Keeping it package-private and not wired into any scan yet. Support for the following features will be added in followup PRs. - Inherited tracking: sequence numbers, snapshot id, and first-row-id aren't applied - Manifest-level pruning - Delete content, manifest deletion vectors, encrypted leaves, and non-v4 leaves -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
