adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4455018311
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4454549120) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.0±0.03ms 19.2 MB/sec 1.00 12.9±0.03ms 19.3 MB/sec bool/cdc 1.00 15.7±0.05ms 15.9 MB/sec 1.01 15.9±0.05ms 15.7 MB/sec bool/default 1.00 10.9±0.03ms 22.9 MB/sec 1.00 10.8±0.04ms 23.1 MB/sec bool/parquet_2 1.01 14.7±0.05ms 17.0 MB/sec 1.00 14.6±0.04ms 17.1 MB/sec bool/zstd 1.01 11.4±0.04ms 21.9 MB/sec 1.00 11.4±0.03ms 22.0 MB/sec bool/zstd_parquet_2 1.01 15.1±0.04ms 16.5 MB/sec 1.00 15.0±0.05ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.00 7.0±0.03ms 17.8 MB/sec bool_non_null/cdc 1.00 6.8±0.04ms 18.3 MB/sec 1.00 6.8±0.03ms 18.4 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.00 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.01 9.1±0.03ms 13.8 MB/sec 1.00 9.0±0.03ms 13.9 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.00 9.4±0.03ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 92.9±0.42ms 150.6 MB/sec 1.01 93.9±0.50ms 149.0 MB/sec float_with_nans/cdc 1.00 81.6±0.21ms 171.6 MB/sec 1.01 82.6±0.87ms 169.5 MB/sec float_with_nans/default 1.00 74.3±0.26ms 188.4 MB/sec 1.01 75.2±0.33ms 186.3 MB/sec float_with_nans/parquet_2 1.00 94.5±0.44ms 148.2 MB/sec 1.01 95.2±0.36ms 147.0 MB/sec float_with_nans/zstd 1.00 111.9±0.29ms 125.1 MB/sec 1.01 112.6±0.31ms 124.3 MB/sec float_with_nans/zstd_parquet_2 1.00 131.7±0.36ms 106.3 MB/sec 1.01 132.7±0.37ms 105.5 MB/sec large_string_non_null/bloom_filter 1.00 81.9±0.17ms 3.1 GB/sec large_string_non_null/cdc 1.00 242.1±1.22ms 1057.4 MB/sec large_string_non_null/default 1.00 62.1±0.16ms 4.0 GB/sec large_string_non_null/parquet_2 1.00 62.1±0.17ms 4.0 GB/sec large_string_non_null/zstd 1.00 62.2±0.16ms 4.0 GB/sec large_string_non_null/zstd_parquet_2 1.00 62.2±0.15ms 4.0 GB/sec list_primitive/bloom_filter 1.00 325.1±0.49ms 1677.5 MB/sec 1.10 358.8±2.20ms 1520.0 MB/sec list_primitive/cdc 1.00 359.1±0.90ms 1518.8 MB/sec 1.03 368.1±7.21ms 1481.6 MB/sec list_primitive/default 1.00 246.9±0.42ms 2.2 GB/sec 1.12 275.8±1.79ms 1977.5 MB/sec list_primitive/parquet_2 1.00 268.0±0.39ms 2035.1 MB/sec 1.06 285.1±3.32ms 1913.2 MB/sec list_primitive/zstd 1.00 498.2±1.76ms 1094.7 MB/sec 1.03 514.5±4.57ms 1060.0 MB/sec list_primitive/zstd_parquet_2 1.00 491.6±0.55ms 1109.3 MB/sec 1.01 495.8±1.57ms 1100.0 MB/sec list_primitive_non_null/bloom_filter 1.00 423.7±4.26ms 1284.5 MB/sec 1.15 487.9±12.33ms 1115.4 MB/sec list_primitive_non_null/cdc 1.02 442.1±9.25ms 1231.0 MB/sec 1.00 435.0±6.86ms 1251.0 MB/sec list_primitive_non_null/default 1.00 294.2±3.07ms 1849.9 MB/sec 1.26 371.9±16.37ms 1463.5 MB/sec list_primitive_non_null/parquet_2 1.00 308.7±13.40ms 1762.7 MB/sec 1.27 392.3±4.23ms 1387.3 MB/sec list_primitive_non_null/zstd 1.00 715.2±7.81ms 761.0 MB/sec 1.07 767.5±8.20ms 709.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 670.8±0.36ms 811.4 MB/sec 1.12 752.3±1.83ms 723.5 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.0±0.03ms 3.3 GB/sec 1.01 11.1±0.05ms 3.3 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.4±0.07ms 1668.9 MB/sec 1.04 23.2±0.09ms 1608.4 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.8±0.03ms 3.4 GB/sec 1.01 10.8±0.04ms 3.4 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.02ms 3.4 GB/sec 1.02 10.9±0.05ms 3.4 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.5±0.04ms 2.9 GB/sec 1.02 12.7±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 10.8±0.03ms 3.4 GB/sec 1.02 11.0±0.11ms 3.3 GB/sec primitive/bloom_filter 1.00 147.9±0.53ms 303.4 MB/sec 1.00 148.0±1.28ms 303.3 MB/sec primitive/cdc 1.00 158.5±0.49ms 283.0 MB/sec 1.00 158.5±0.56ms 283.1 MB/sec primitive/default 1.00 117.1±0.21ms 383.1 MB/sec 1.00 116.9±0.22ms 383.9 MB/sec primitive/parquet_2 1.00 132.1±0.21ms 339.7 MB/sec 1.00 132.4±0.49ms 339.1 MB/sec primitive/zstd 1.00 146.6±0.21ms 306.1 MB/sec 1.01 147.9±0.77ms 303.4 MB/sec primitive/zstd_parquet_2 1.00 165.4±0.37ms 271.3 MB/sec 1.00 165.9±0.42ms 270.5 MB/sec primitive_all_null/bloom_filter 1.00 11.5±0.17ms 3.8 GB/sec 1.02 11.8±0.21ms 3.7 GB/sec primitive_all_null/cdc 1.05 30.6±0.37ms 1466.2 MB/sec 1.00 29.1±0.30ms 1539.5 MB/sec primitive_all_null/default 1.00 10.9±0.14ms 4.0 GB/sec 1.01 11.0±0.16ms 4.0 GB/sec primitive_all_null/parquet_2 1.00 10.9±0.22ms 4.0 GB/sec 1.01 11.0±0.21ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.1±0.18ms 3.9 GB/sec 1.00 11.1±0.12ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.0±0.26ms 4.0 GB/sec 1.00 11.1±0.15ms 4.0 GB/sec primitive_non_null/bloom_filter 1.05 111.1±1.31ms 396.1 MB/sec 1.00 105.5±0.46ms 417.1 MB/sec primitive_non_null/cdc 1.01 90.9±0.59ms 484.3 MB/sec 1.00 89.8±0.26ms 489.8 MB/sec primitive_non_null/default 1.00 67.1±0.20ms 655.6 MB/sec 1.01 67.5±0.30ms 651.9 MB/sec primitive_non_null/parquet_2 1.00 89.1±0.38ms 494.1 MB/sec 1.00 88.7±0.23ms 495.9 MB/sec primitive_non_null/zstd 1.08 105.3±1.64ms 417.9 MB/sec 1.00 97.7±0.23ms 450.5 MB/sec primitive_non_null/zstd_parquet_2 1.06 130.2±1.80ms 338.0 MB/sec 1.00 122.3±0.24ms 359.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 18.3±0.12ms 2.4 GB/sec 1.00 18.2±0.11ms 2.4 GB/sec primitive_sparse_99pct_null/cdc 1.04 37.2±0.33ms 1206.6 MB/sec 1.00 35.7±0.29ms 1255.6 MB/sec primitive_sparse_99pct_null/default 1.00 16.8±0.05ms 2.6 GB/sec 1.00 16.8±0.05ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.8±0.07ms 2.6 GB/sec 1.00 16.8±0.04ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.0±0.06ms 2.2 GB/sec 1.00 20.1±0.05ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.7±0.06ms 2.3 GB/sec 1.01 18.8±0.17ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 29.1±0.18ms 412.1 MB/sec short_string_non_null/cdc 1.00 20.1±0.06ms 597.6 MB/sec short_string_non_null/default 1.00 16.3±0.14ms 735.5 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.18ms 462.1 MB/sec short_string_non_null/zstd 1.00 36.1±0.18ms 332.1 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.21ms 415.2 MB/sec string/bloom_filter 1.06 227.5±24.81ms 2.3 GB/sec 1.00 215.0±22.79ms 2.4 GB/sec string/cdc 1.00 221.1±5.72ms 2.3 GB/sec 1.00 220.2±9.61ms 2.3 GB/sec string/default 1.17 140.6±24.01ms 3.6 GB/sec 1.00 119.6±11.96ms 4.3 GB/sec string/parquet_2 1.00 125.2±0.37ms 4.1 GB/sec 1.03 129.4±1.07ms 4.0 GB/sec string/zstd 1.00 425.9±2.66ms 1231.0 MB/sec 1.05 446.6±18.59ms 1173.9 MB/sec string/zstd_parquet_2 1.00 394.7±1.31ms 1328.1 MB/sec 1.01 400.0±0.55ms 1310.7 MB/sec string_and_binary_view/bloom_filter 1.00 64.0±0.36ms 503.7 MB/sec 1.05 67.3±0.37ms 479.3 MB/sec string_and_binary_view/cdc 1.00 58.5±0.15ms 550.9 MB/sec 1.03 60.6±0.16ms 532.6 MB/sec string_and_binary_view/default 1.00 47.8±0.11ms 674.8 MB/sec 1.06 50.9±0.28ms 634.1 MB/sec string_and_binary_view/parquet_2 1.00 58.6±0.14ms 550.3 MB/sec 1.05 61.8±0.25ms 522.0 MB/sec string_and_binary_view/zstd 1.00 84.5±0.16ms 381.9 MB/sec 1.04 88.0±0.48ms 366.6 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.6±0.13ms 444.2 MB/sec 1.05 76.0±0.45ms 424.6 MB/sec string_dictionary/bloom_filter 1.00 89.0±0.65ms 2.9 GB/sec 1.03 91.4±0.43ms 2.8 GB/sec string_dictionary/cdc 1.60 84.9±0.64ms 3.0 GB/sec 1.00 53.0±0.47ms 4.9 GB/sec string_dictionary/default 1.00 48.4±0.30ms 5.3 GB/sec 1.03 50.0±0.78ms 5.2 GB/sec string_dictionary/parquet_2 1.00 53.8±0.21ms 4.8 GB/sec 1.04 55.9±0.13ms 4.6 GB/sec string_dictionary/zstd 1.00 209.4±0.94ms 1261.2 MB/sec 1.01 210.5±0.77ms 1254.6 MB/sec string_dictionary/zstd_parquet_2 1.00 198.1±0.19ms 1333.6 MB/sec 1.01 200.2±0.22ms 1319.2 MB/sec string_non_null/bloom_filter 1.00 250.8±14.97ms 2.0 GB/sec 1.03 259.5±13.75ms 2019.3 MB/sec string_non_null/cdc 1.00 269.3±9.38ms 1945.8 MB/sec 1.03 278.0±10.27ms 1885.2 MB/sec string_non_null/default 1.00 126.1±12.19ms 4.1 GB/sec 1.17 147.8±13.68ms 3.5 GB/sec string_non_null/parquet_2 1.00 141.2±11.51ms 3.6 GB/sec 1.12 158.6±0.34ms 3.2 GB/sec string_non_null/zstd 1.00 531.3±2.90ms 986.3 MB/sec 1.07 568.1±11.39ms 922.4 MB/sec string_non_null/zstd_parquet_2 1.00 507.1±2.20ms 1033.2 MB/sec 1.03 522.6±7.32ms 1002.8 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.2 GB/sec 1.00 2.5±0.00ms 6.2 GB/sec struct_all_null/cdc 1.00 9.8±0.11ms 1645.7 MB/sec 1.01 9.9±0.05ms 1624.5 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.8 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 46.8±0.15ms 341.7 MB/sec 1.01 47.2±0.83ms 339.1 MB/sec struct_non_null/cdc 1.00 45.7±0.18ms 350.3 MB/sec 1.01 46.0±0.13ms 347.5 MB/sec struct_non_null/default 1.00 32.3±0.11ms 495.8 MB/sec 1.02 32.8±0.35ms 488.2 MB/sec struct_non_null/parquet_2 1.00 40.9±0.13ms 391.5 MB/sec 1.00 41.0±0.18ms 390.4 MB/sec struct_non_null/zstd 1.00 41.0±0.10ms 390.1 MB/sec 1.00 41.0±0.38ms 390.2 MB/sec struct_non_null/zstd_parquet_2 1.00 55.0±0.12ms 291.1 MB/sec 1.01 55.4±0.13ms 288.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.5±0.03ms 2.1 GB/sec 1.07 8.0±0.04ms 2014.4 MB/sec struct_sparse_99pct_null/cdc 1.04 15.4±0.09ms 1048.1 MB/sec 1.00 14.8±0.10ms 1087.6 MB/sec struct_sparse_99pct_null/default 1.00 6.9±0.02ms 2.3 GB/sec 1.05 7.3±0.03ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.02ms 2.3 GB/sec 1.05 7.3±0.03ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.00 8.3±0.02ms 1946.8 MB/sec 1.03 8.6±0.05ms 1881.4 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.02ms 2.0 GB/sec 1.02 7.9±0.07ms 2044.8 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1935.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1879.4s | | CPU sys | 54.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2130.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2064.4s | | CPU sys | 63.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
