terbed opened a new issue, #3392:
URL: https://github.com/apache/iceberg-rust/issues/3392
### Is your feature request related to a problem or challenge?
`ArrowReaderBuilder` already exposes `with_metadata_size_hint` and
`with_range_coalesce_bytes`, but callers using `TableScan` cannot configure
them.
I would like to expose these options through the scan API while preserving
existing defaults when unset. This would let applications tune the tradeoff
between storage requests and unnecessary bytes fetched.
### Describe the solution you'd like
Tests would verify unchanged defaults and forwarding through actual storage
reads, with page pruning disabled.
The coalescing option controls the maximum gap between merged ranges, not
the maximum request size. No upstream default change is proposed.
I’m happy to implement this. Would corresponding `TableScanBuilder` setters
fit the intended API like follows?
```rust
let scan = table.scan()
.with_range_coalesce_bytes(gap_bytes)
.with_metadata_size_hint(footer_hint_bytes)
.build()?;
```
### Willingness to contribute
I can contribute to this feature independently
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
