lyne7-sc opened a new issue, #2378: URL: https://github.com/apache/auron/issues/2378
**Is your feature request related to a problem? Please describe.** <!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...] --> Spark's `BatchScanExec` can carry runtime filters for dynamic partition pruning. These filters are resolved after query planning and can reduce the input partitions/files that a scan needs to read. Auron's native Iceberg scan should preserve and apply these runtime filters so dynamic partition pruning can reduce Iceberg scan work on the native path. **Describe the solution you'd like** <!-- A clear and concise description of what you want to happen. --> Native Iceberg scan should preserve Spark `BatchScanExec.runtimeFilters` and apply the runtime-filtered Iceberg input partitions before native execution. This should work consistently across supported native Iceberg scan paths and should handle cases where dynamic partition pruning reduces the scan to a subset of partitions or to an empty scan. **Describe alternatives you've considered** <!-- A clear and concise description of any alternative solutions or features you've considered. --> Keep using the static Iceberg scan plan and rely on downstream join/filter operators. This keeps query execution simple, but it does not let native Iceberg scan benefit from Spark's dynamic partition pruning. **Additional context** <!-- Add any other context or screenshots about the feature request here. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
