adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4453633406
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4453035593) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.2±0.08ms 18.9 MB/sec 1.00 13.1±0.06ms 19.1 MB/sec bool/cdc 1.01 16.0±0.08ms 15.6 MB/sec 1.00 15.8±0.26ms 15.8 MB/sec bool/default 1.01 11.0±0.07ms 22.6 MB/sec 1.00 10.9±0.09ms 22.9 MB/sec bool/parquet_2 1.00 14.7±0.05ms 17.0 MB/sec 1.00 14.7±0.07ms 17.0 MB/sec bool/zstd 1.02 11.6±0.06ms 21.6 MB/sec 1.00 11.4±0.06ms 22.0 MB/sec bool/zstd_parquet_2 1.01 15.2±0.08ms 16.5 MB/sec 1.00 15.1±0.27ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 7.1±0.04ms 17.6 MB/sec 1.00 7.1±0.15ms 17.6 MB/sec bool_non_null/cdc 1.00 7.0±0.05ms 17.9 MB/sec 1.00 7.0±0.13ms 17.8 MB/sec bool_non_null/default 1.00 4.3±0.03ms 29.1 MB/sec 1.00 4.3±0.10ms 29.0 MB/sec bool_non_null/parquet_2 1.00 9.1±0.05ms 13.7 MB/sec 1.00 9.1±0.24ms 13.7 MB/sec bool_non_null/zstd 1.00 4.7±0.02ms 26.9 MB/sec 1.00 4.6±0.03ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.05ms 13.1 MB/sec 1.00 9.5±0.24ms 13.1 MB/sec float_with_nans/bloom_filter 1.00 95.7±2.15ms 146.3 MB/sec 1.01 97.0±2.24ms 144.3 MB/sec float_with_nans/cdc 1.00 82.9±1.46ms 168.8 MB/sec 1.03 85.0±1.07ms 164.7 MB/sec float_with_nans/default 1.00 76.1±2.46ms 184.0 MB/sec 1.01 76.9±1.74ms 182.0 MB/sec float_with_nans/parquet_2 1.00 97.5±2.31ms 143.7 MB/sec 1.00 97.7±2.52ms 143.3 MB/sec float_with_nans/zstd 1.01 114.5±2.02ms 122.2 MB/sec 1.00 113.0±1.76ms 123.9 MB/sec float_with_nans/zstd_parquet_2 1.00 134.1±2.59ms 104.4 MB/sec 1.01 135.2±2.50ms 103.6 MB/sec large_string_non_null/bloom_filter 1.00 84.5±3.68ms 3.0 GB/sec large_string_non_null/cdc 1.00 244.0±2.19ms 1049.1 MB/sec large_string_non_null/default 1.00 64.3±2.55ms 3.9 GB/sec large_string_non_null/parquet_2 1.00 63.7±3.92ms 3.9 GB/sec large_string_non_null/zstd 1.00 60.7±0.26ms 4.1 GB/sec large_string_non_null/zstd_parquet_2 1.00 62.2±1.88ms 4.0 GB/sec list_primitive/bloom_filter 1.00 340.8±6.92ms 1600.0 MB/sec 1.08 369.1±15.47ms 1477.7 MB/sec list_primitive/cdc 1.00 364.0±3.08ms 1498.2 MB/sec 1.02 371.0±8.13ms 1469.8 MB/sec list_primitive/default 1.00 255.5±6.60ms 2.1 GB/sec 1.07 274.6±8.33ms 1986.2 MB/sec list_primitive/parquet_2 1.00 271.3±3.24ms 2010.0 MB/sec 1.06 288.7±2.44ms 1888.7 MB/sec list_primitive/zstd 1.00 506.5±6.71ms 1076.6 MB/sec 1.03 520.8±7.25ms 1047.1 MB/sec list_primitive/zstd_parquet_2 1.00 496.0±3.27ms 1099.5 MB/sec 1.00 496.6±4.31ms 1098.2 MB/sec list_primitive_non_null/bloom_filter 1.00 447.4±21.93ms 1216.4 MB/sec 1.16 517.1±33.75ms 1052.5 MB/sec list_primitive_non_null/cdc 1.01 450.7±12.72ms 1207.4 MB/sec 1.00 447.8±11.71ms 1215.3 MB/sec list_primitive_non_null/default 1.00 303.8±11.10ms 1791.3 MB/sec 1.25 379.8±19.28ms 1432.9 MB/sec list_primitive_non_null/parquet_2 1.00 318.8±16.26ms 1707.3 MB/sec 1.33 422.5±16.94ms 1288.2 MB/sec list_primitive_non_null/zstd 1.00 735.5±14.23ms 740.0 MB/sec 1.07 783.7±19.04ms 694.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 702.1±6.10ms 775.1 MB/sec 1.06 747.6±4.61ms 728.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.3±0.24ms 3.2 GB/sec 1.04 11.7±0.06ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.02 23.0±0.23ms 1625.1 MB/sec 1.00 22.6±0.10ms 1652.1 MB/sec list_primitive_sparse_99pct_null/default 1.03 11.2±0.05ms 3.3 GB/sec 1.00 10.9±0.04ms 3.4 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.2±0.14ms 3.3 GB/sec 1.02 11.3±0.07ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.1±0.29ms 2.8 GB/sec 1.01 13.2±0.29ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 10.9±0.05ms 3.3 GB/sec 1.03 11.3±0.31ms 3.2 GB/sec primitive/bloom_filter 1.02 156.1±3.23ms 287.4 MB/sec 1.00 153.2±2.93ms 293.0 MB/sec primitive/cdc 1.00 161.7±3.06ms 277.5 MB/sec 1.01 162.6±3.18ms 276.1 MB/sec primitive/default 1.02 120.6±0.82ms 372.0 MB/sec 1.00 118.3±1.10ms 379.3 MB/sec primitive/parquet_2 1.00 134.6±2.25ms 333.5 MB/sec 1.00 134.9±1.97ms 332.7 MB/sec primitive/zstd 1.01 149.1±1.65ms 300.9 MB/sec 1.00 147.7±0.76ms 303.8 MB/sec primitive/zstd_parquet_2 1.00 168.8±1.53ms 265.9 MB/sec 1.00 168.8±1.52ms 265.8 MB/sec primitive_all_null/bloom_filter 1.00 11.9±0.18ms 3.7 GB/sec 1.00 11.8±0.23ms 3.7 GB/sec primitive_all_null/cdc 1.03 30.9±0.49ms 1450.1 MB/sec 1.00 30.1±0.51ms 1492.4 MB/sec primitive_all_null/default 1.00 10.9±0.11ms 4.0 GB/sec 1.00 11.0±0.16ms 4.0 GB/sec primitive_all_null/parquet_2 1.00 11.0±0.18ms 4.0 GB/sec 1.00 11.0±0.23ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.0±0.13ms 4.0 GB/sec 1.00 11.0±0.17ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.01 11.0±0.15ms 4.0 GB/sec 1.00 10.9±0.10ms 4.0 GB/sec primitive_non_null/bloom_filter 1.09 117.1±2.94ms 375.6 MB/sec 1.00 107.7±1.65ms 408.5 MB/sec primitive_non_null/cdc 1.00 92.0±1.42ms 478.3 MB/sec 1.00 91.8±1.31ms 479.5 MB/sec primitive_non_null/default 1.03 69.7±1.09ms 631.7 MB/sec 1.00 67.7±0.30ms 649.9 MB/sec primitive_non_null/parquet_2 1.01 91.7±1.91ms 479.9 MB/sec 1.00 91.2±1.32ms 482.7 MB/sec primitive_non_null/zstd 1.07 107.1±2.41ms 410.8 MB/sec 1.00 99.8±1.92ms 441.0 MB/sec primitive_non_null/zstd_parquet_2 1.05 131.4±1.99ms 334.8 MB/sec 1.00 124.6±1.30ms 353.2 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 19.0±0.38ms 2.3 GB/sec 1.00 18.9±0.49ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.01 37.5±0.40ms 1198.2 MB/sec 1.00 37.1±0.54ms 1208.8 MB/sec primitive_sparse_99pct_null/default 1.02 17.3±0.16ms 2.5 GB/sec 1.00 16.9±0.06ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.4±0.09ms 2.5 GB/sec 1.00 17.5±0.08ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.4±0.24ms 2.1 GB/sec 1.02 20.7±0.28ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 19.2±0.38ms 2.3 GB/sec 1.01 19.4±0.40ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 29.7±0.21ms 404.3 MB/sec short_string_non_null/cdc 1.00 20.6±0.17ms 581.8 MB/sec short_string_non_null/default 1.00 16.9±0.20ms 710.8 MB/sec short_string_non_null/parquet_2 1.00 26.5±0.24ms 452.8 MB/sec short_string_non_null/zstd 1.00 36.5±0.12ms 328.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.2±0.17ms 410.8 MB/sec string/bloom_filter 1.09 231.5±23.89ms 2.2 GB/sec 1.00 211.7±14.75ms 2.4 GB/sec string/cdc 1.01 226.1±9.11ms 2.3 GB/sec 1.00 224.7±11.94ms 2.3 GB/sec string/default 1.12 146.7±24.93ms 3.5 GB/sec 1.00 131.6±11.00ms 3.9 GB/sec string/parquet_2 1.07 129.2±2.88ms 4.0 GB/sec 1.00 120.6±6.92ms 4.2 GB/sec string/zstd 1.00 430.5±8.49ms 1217.7 MB/sec 1.03 441.5±9.87ms 1187.4 MB/sec string/zstd_parquet_2 1.00 397.8±4.26ms 1318.0 MB/sec 1.02 406.3±4.56ms 1290.2 MB/sec string_and_binary_view/bloom_filter 1.00 67.2±3.49ms 479.6 MB/sec 1.01 68.2±0.39ms 472.6 MB/sec string_and_binary_view/cdc 1.00 59.4±1.21ms 543.2 MB/sec 1.06 62.8±2.45ms 513.8 MB/sec string_and_binary_view/default 1.00 48.7±0.95ms 662.0 MB/sec 1.11 54.0±2.59ms 597.0 MB/sec string_and_binary_view/parquet_2 1.00 58.9±0.58ms 547.7 MB/sec 1.11 65.2±0.86ms 494.4 MB/sec string_and_binary_view/zstd 1.00 85.5±0.95ms 377.2 MB/sec 1.06 90.8±1.48ms 355.0 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.2±0.66ms 434.4 MB/sec 1.07 79.3±2.37ms 406.8 MB/sec string_dictionary/bloom_filter 1.03 104.5±0.90ms 2.5 GB/sec 1.00 101.1±5.73ms 2.6 GB/sec string_dictionary/cdc 1.38 78.4±2.15ms 3.3 GB/sec 1.00 56.7±3.11ms 4.6 GB/sec string_dictionary/default 1.29 65.3±3.55ms 3.9 GB/sec 1.00 50.6±0.56ms 5.1 GB/sec string_dictionary/parquet_2 1.19 67.8±0.44ms 3.8 GB/sec 1.00 56.8±1.57ms 4.5 GB/sec string_dictionary/zstd 1.02 218.7±3.32ms 1207.8 MB/sec 1.00 215.4±4.94ms 1226.0 MB/sec string_dictionary/zstd_parquet_2 1.00 200.1±2.51ms 1319.8 MB/sec 1.01 201.9±1.54ms 1308.5 MB/sec string_non_null/bloom_filter 1.03 270.4±28.27ms 1937.7 MB/sec 1.00 263.2±19.14ms 1990.8 MB/sec string_non_null/cdc 1.01 274.5±13.60ms 1909.1 MB/sec 1.00 272.9±11.94ms 1919.9 MB/sec string_non_null/default 1.00 148.1±14.93ms 3.5 GB/sec 1.03 152.1±16.41ms 3.4 GB/sec string_non_null/parquet_2 1.00 145.3±9.80ms 3.5 GB/sec 1.08 156.8±3.28ms 3.3 GB/sec string_non_null/zstd 1.00 573.6±17.33ms 913.5 MB/sec 1.02 584.3±20.28ms 896.8 MB/sec string_non_null/zstd_parquet_2 1.00 527.8±11.88ms 992.8 MB/sec 1.00 529.4±13.85ms 989.8 MB/sec struct_all_null/bloom_filter 1.00 2.6±0.04ms 6.1 GB/sec 1.01 2.6±0.04ms 6.1 GB/sec struct_all_null/cdc 1.00 9.9±0.17ms 1637.0 MB/sec 1.02 10.0±0.13ms 1612.6 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.00 2.3±0.00ms 6.8 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 47.1±0.89ms 339.4 MB/sec 1.03 48.4±1.17ms 330.9 MB/sec struct_non_null/cdc 1.00 46.4±0.36ms 344.8 MB/sec 1.00 46.3±0.38ms 345.9 MB/sec struct_non_null/default 1.01 32.8±0.62ms 487.6 MB/sec 1.00 32.6±0.23ms 490.3 MB/sec struct_non_null/parquet_2 1.00 40.9±0.33ms 391.4 MB/sec 1.01 41.4±0.79ms 386.5 MB/sec struct_non_null/zstd 1.02 41.3±0.53ms 387.0 MB/sec 1.00 40.7±0.23ms 392.8 MB/sec struct_non_null/zstd_parquet_2 1.01 55.3±0.45ms 289.4 MB/sec 1.00 54.9±0.14ms 291.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.9±0.36ms 2033.3 MB/sec 1.02 8.1±0.33ms 1993.7 MB/sec struct_sparse_99pct_null/cdc 1.04 16.0±0.15ms 1005.3 MB/sec 1.00 15.5±0.39ms 1041.4 MB/sec struct_sparse_99pct_null/default 1.00 7.2±0.18ms 2.2 GB/sec 1.03 7.4±0.08ms 2.1 GB/sec struct_sparse_99pct_null/parquet_2 1.00 7.0±0.12ms 2.2 GB/sec 1.03 7.3±0.22ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.05 8.9±0.27ms 1820.8 MB/sec 1.00 8.5±0.09ms 1903.6 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.8±0.10ms 2.0 GB/sec 1.03 8.1±0.22ms 1992.9 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1970.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1897.3s | | CPU sys | 71.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2145.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2083.9s | | CPU sys | 60.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
