gitmodimo commented on PR #51094: URL: https://github.com/apache/arrow/pull/51094#issuecomment-5494996449
## Benchmark results | Version | Execution | Stored results | |---|---|---| | Baseline `1fa6ddd` | [Buildkite #1100](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-amd64-c6a-4xlarge-linux/builds/1100/list) | [Conbench baseline](https://conbench.arrow-dev.org/runs/2f450098d0294a609592ad36499780e8/) | | rework `0d06ddc` | [Buildkite #1101](https://buildkite.com/apache-arrow/arrow-bci-benchmark-on-amd64-c6a-4xlarge-linux/builds/1101/list) | [Conbench rework](https://conbench.arrow-dev.org/runs/81c32f555bab4914876d33eae578d5cc/) | Times below are median wall time in milliseconds. Speedup is `baseline / rework`. ### Density and direction | Keys | L/R spacing | Direction | Serial baseline → rework | Speedup | Threaded baseline → rework | Speedup | |---|---:|---|---:|---:|---:|---:| | int32 | 400/400 | backward | 150.34 → 7.65 | 19.65× | 155.08 → 6.78 | 22.88× | | int32 | 400/400 | forward | 264.28 → 8.84 | 29.91× | 296.84 → 7.87 | 37.72× | | int32 | 200/1000 | backward | 692.05 → 9.16 | 75.54× | 672.34 → 8.24 | 81.55× | | int32 | 200/1000 | forward | 898.34 → 10.41 | 86.30× | 923.89 → 9.37 | 98.64× | | int32 | 1000/200 | backward | 25.60 → 9.05 | 2.83× | 24.15 → 8.24 | 2.93× | | int32 | 1000/200 | forward | 72.53 → 10.76 | 6.74× | 79.70 → 9.86 | 8.08× | | string128 | 400/400 | backward | 132.56 → 10.18 | 13.02× | 173.26 → 7.80 | 22.21× | | string128 | 400/400 | forward | 291.34 → 11.71 | 24.89× | 344.73 → 9.19 | 37.51× | | string128 | 200/1000 | backward | 681.20 → 12.32 | 55.28× | 678.57 → 9.45 | 71.82× | | string128 | 200/1000 | forward | 996.47 → 13.71 | 72.69× | 1003.86 → 10.78 | 93.08× | | string128 | 1000/200 | backward | 29.17 → 12.09 | 2.41× | 26.33 → 9.42 | 2.79× | | string128 | 1000/200 | forward | 99.32 → 14.32 | 6.94× | 102.87 → 11.20 | 9.19× | ### Scaling and overhead | Case | Serial baseline → rework | Speedup | Threaded baseline → rework | Speedup | |---|---:|---:|---:|---:| | Frequency 200 | 724.37 → 16.94 | 42.77× | 711.96 → 15.57 | 45.73× | | Default, merged | 170.56 → 8.53 | 20.00× | 150.59 → 7.74 | 19.46× | | Frequency 1000 | 19.12 → 3.50 | 5.45× | 19.64 → 3.37 | 5.83× | | 10 columns | 181.07 → 8.18 | 22.13× | 144.09 → 7.39 | 19.51× | | 100 columns | 239.44 → 10.88 | 22.01× | 237.14 → 10.91 | 21.74× | | 100 IDs | 8.50 → 1.61 | 5.27× | 8.64 → 1.77 | 4.88× | | 1000 IDs | 713.62 → 17.33 | 41.17× | 682.07 → 15.29 | 44.60× | | 10 right tables | 320.14 → 79.90 | 4.01× | 335.45 → 24.38 | 13.76× | | 50 right tables | 1054.67 → 427.78 | 2.47× | 1094.06 → 104.36 | 10.48× | | Batch size 1000 | 331.80 → 9.64 | 34.42× | 329.84 → 8.97 | 36.78× | | Batch size 32000 | 89.89 → 7.95 | 11.30× | 68.87 → 8.14 | 8.46× | All 46 matched records improved: - Serial: median 20.00×; range 2.41×–86.30×. - Threaded: median 21.74×; range 2.79×–98.64×. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
