etseidl commented on PR #8797:
URL: https://github.com/apache/arrow-rs/pull/8797#issuecomment-3494420928
excerpts from new benchmarks
```
decode parquet metadata time: [15.050 µs 15.105 µs 15.164 µs]
decode metadata with schema
time: [7.7038 µs 7.7286 µs 7.7561 µs]
decode metadata with stats mask
time: [14.035 µs 14.100 µs 14.182 µs
decode metadata with skip PES
time: [13.976 µs 14.016 µs 14.060 µs]
decode parquet metadata (wide)
time: [54.013 ms 54.236 ms 54.468 ms]
decode metadata (wide) with schema
time: [48.399 ms 48.562 ms 48.738 ms]
decode metadata (wide) with stats mask
time: [44.912 ms 45.077 ms 45.253 ms]
decode metadata (wide) with skip PES
time: [44.500 ms 44.616 ms 44.739 ms]
```
Skipping the stats is not any faster than turning them into a mask 😮.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
