nssalian commented on PR #16747: URL: https://github.com/apache/iceberg/pull/16747#issuecomment-5236254544
Ran `PFOREncodingBenchmark` that was added here, on an Apple M4 Max (throughput, 5 iterations). At the small descriptor-array sizes Mumbling uses, the Iceberg PFOR codec is much faster than JavaFastPFOR - decode ~126-191x, encode ~10-17x: | benchmark | Iceberg PFOR | JavaFastPFOR | |---|---|---| | decode descriptor | 12.55M ops/s | 100k ops/s | | decode uniform | 18.91M ops/s | 99k ops/s | | encode descriptor | 949k ops/s | 96k ops/s | | encode uniform | 1.66M ops/s | 97k ops/s | I also ported the codec to iceberg-go and it decodes the same fixtures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
