terbed opened a new issue, #58: URL: https://github.com/apache/datafusion-iceberg/issues/58
`IcebergDataSource` currently builds `TableScan` without forwarding read-ahead configuration. apache/iceberg-rust#3395 adds the underlying `TableScanBuilder` methods. Expose optional footer metadata size hints and range-coalescing gap settings through the DataFusion integration. Preserve existing behavior when unset, and support both static and catalog-backed table providers. Tests should verify actual storage byte ranges and unchanged query results with page pruning disabled, including a merged request larger than the configured gap. This proposes configurable controls without changing defaults. It depends on apache/iceberg-rust#3395 landing and updating the integration’s pinned Iceberg revision. I’m willing to implement this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
