I think we can flag property to enable this as default true, It would be a great improvement for v4 parquet manifest. Tried to do benchmarkings as extensive as possible. I would love to hear thoughts on this.
Please review the PR once and would appreciate feedback. On Mon, Jul 20, 2026 at 10:02 PM Varun Lakhyani <[email protected]> wrote: > Hello Everyone, > > I evaluated using EagerInputFile in v4 manifest reader path (parquet) > using ManifestBenchmark and S3 as object store and EC2 machine for jmh > benchmarking. > > This is to make sure we are doing a proper checklist while wiring this > EagerInputFile path here, > Detailed benchmarking setup and results are commented on in PR[1]. > Using an EC2 machine in the same region (ap-south-1) gives *~28.4%* to > *~42.7%* betterment while comparing against baseline default while > benchmarking. > > Please provide review and feedback. > Thanks > > [1] https://github.com/apache/iceberg/pull/17284 > -- > Lakhyani Varun > Indian Institute of Technology Roorkee > Contact: +91 96246 46174 > >
