Hello Everyone, I evaluated using EagerInputFile in v4 manifest reader path (parquet) using ManifestBenchmark and S3 as object store and EC2 machine for jmh benchmarking.
This is to make sure we are doing a proper checklist while wiring this EagerInputFile path here, Detailed benchmarking setup and results are commented on in PR[1]. Using an EC2 machine in the same region (ap-south-1) gives *~28.4%* to *~42.7%* betterment while comparing against baseline default while benchmarking. Please provide review and feedback. Thanks [1] https://github.com/apache/iceberg/pull/17284 -- Lakhyani Varun Indian Institute of Technology Roorkee Contact: +91 96246 46174
