adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4448612662
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4448145440) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.02 13.2±0.11ms 18.9 MB/sec 1.00 13.0±0.08ms 19.2 MB/sec bool/cdc 1.01 16.0±0.10ms 15.6 MB/sec 1.00 15.8±0.15ms 15.8 MB/sec bool/default 1.02 11.2±0.09ms 22.4 MB/sec 1.00 10.9±0.04ms 22.9 MB/sec bool/parquet_2 1.01 14.9±0.11ms 16.8 MB/sec 1.00 14.7±0.05ms 17.0 MB/sec bool/zstd 1.02 11.6±0.07ms 21.5 MB/sec 1.00 11.5±0.06ms 21.8 MB/sec bool/zstd_parquet_2 1.02 15.3±0.10ms 16.4 MB/sec 1.00 15.1±0.07ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 7.1±0.04ms 17.7 MB/sec 1.00 7.0±0.03ms 17.8 MB/sec bool_non_null/cdc 1.01 7.0±0.08ms 18.0 MB/sec 1.00 6.9±0.10ms 18.1 MB/sec bool_non_null/default 1.00 4.3±0.03ms 29.1 MB/sec 1.00 4.3±0.02ms 29.1 MB/sec bool_non_null/parquet_2 1.00 9.1±0.04ms 13.7 MB/sec 1.00 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 26.9 MB/sec 1.00 4.7±0.03ms 26.8 MB/sec bool_non_null/zstd_parquet_2 1.01 9.5±0.04ms 13.1 MB/sec 1.00 9.5±0.05ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 94.5±1.08ms 148.1 MB/sec 1.01 95.7±2.49ms 146.3 MB/sec float_with_nans/cdc 1.00 83.0±0.82ms 168.8 MB/sec 1.01 83.7±1.57ms 167.2 MB/sec float_with_nans/default 1.00 75.5±1.07ms 185.5 MB/sec 1.00 75.3±1.01ms 185.9 MB/sec float_with_nans/parquet_2 1.00 97.2±0.72ms 144.1 MB/sec 1.00 97.4±1.82ms 143.7 MB/sec float_with_nans/zstd 1.00 113.2±1.37ms 123.7 MB/sec 1.01 114.0±1.22ms 122.8 MB/sec float_with_nans/zstd_parquet_2 1.00 133.3±1.99ms 105.0 MB/sec 1.02 135.3±1.48ms 103.4 MB/sec large_string_non_null/bloom_filter 1.00 84.8±1.96ms 2.9 GB/sec large_string_non_null/cdc 1.00 243.8±1.68ms 1050.1 MB/sec large_string_non_null/default 1.00 64.6±1.09ms 3.9 GB/sec large_string_non_null/parquet_2 1.00 65.2±2.66ms 3.8 GB/sec large_string_non_null/zstd 1.00 63.7±2.72ms 3.9 GB/sec large_string_non_null/zstd_parquet_2 1.00 63.6±2.71ms 3.9 GB/sec list_primitive/bloom_filter 1.22 417.0±14.54ms 1308.0 MB/sec 1.00 340.4±11.36ms 1602.2 MB/sec list_primitive/cdc 1.03 376.9±13.32ms 1447.0 MB/sec 1.00 364.3±4.07ms 1496.8 MB/sec list_primitive/default 1.28 324.3±7.20ms 1681.8 MB/sec 1.00 252.9±4.29ms 2.1 GB/sec list_primitive/parquet_2 1.24 336.6±2.67ms 1620.3 MB/sec 1.00 271.6±1.48ms 2008.1 MB/sec list_primitive/zstd 1.11 566.9±7.39ms 962.0 MB/sec 1.00 508.8±5.43ms 1072.0 MB/sec list_primitive/zstd_parquet_2 1.00 494.3±2.36ms 1103.3 MB/sec 1.01 497.0±2.60ms 1097.3 MB/sec list_primitive_non_null/bloom_filter 1.11 496.8±24.03ms 1095.5 MB/sec 1.00 447.3±18.74ms 1216.7 MB/sec list_primitive_non_null/cdc 1.00 444.9±8.81ms 1223.3 MB/sec 1.00 445.4±13.12ms 1221.9 MB/sec list_primitive_non_null/default 1.15 344.7±21.96ms 1579.1 MB/sec 1.00 300.1±6.76ms 1813.4 MB/sec list_primitive_non_null/parquet_2 1.09 352.8±3.69ms 1542.5 MB/sec 1.00 322.6±22.73ms 1687.1 MB/sec list_primitive_non_null/zstd 1.05 765.1±24.38ms 711.3 MB/sec 1.00 730.8±20.34ms 744.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 695.9±3.50ms 782.1 MB/sec 1.01 703.1±7.88ms 774.1 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.6±0.13ms 3.2 GB/sec 1.05 12.2±0.27ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.8±0.34ms 1637.4 MB/sec 1.03 23.6±0.18ms 1584.4 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.8±0.21ms 3.4 GB/sec 1.09 11.9±0.06ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.0±0.19ms 3.3 GB/sec 1.06 11.6±0.21ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.1±0.05ms 2.8 GB/sec 1.02 13.3±0.25ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.3±0.26ms 3.2 GB/sec 1.05 11.9±0.16ms 3.1 GB/sec primitive/bloom_filter 1.00 153.9±2.09ms 291.5 MB/sec 1.00 154.2±1.49ms 291.1 MB/sec primitive/cdc 1.00 161.3±1.88ms 278.2 MB/sec 1.00 161.2±1.30ms 278.4 MB/sec primitive/default 1.01 120.2±0.79ms 373.4 MB/sec 1.00 118.9±1.69ms 377.3 MB/sec primitive/parquet_2 1.00 134.5±1.65ms 333.7 MB/sec 1.01 135.2±1.74ms 332.0 MB/sec primitive/zstd 1.01 150.0±0.77ms 299.2 MB/sec 1.00 149.1±1.93ms 301.0 MB/sec primitive/zstd_parquet_2 1.01 169.4±1.51ms 264.9 MB/sec 1.00 167.5±1.20ms 267.9 MB/sec primitive_all_null/bloom_filter 1.01 11.8±0.11ms 3.7 GB/sec 1.00 11.7±0.22ms 3.7 GB/sec primitive_all_null/cdc 1.01 30.8±0.48ms 1458.4 MB/sec 1.00 30.6±0.35ms 1468.6 MB/sec primitive_all_null/default 1.00 11.0±0.18ms 4.0 GB/sec 1.00 11.0±0.14ms 4.0 GB/sec primitive_all_null/parquet_2 1.01 11.0±0.18ms 4.0 GB/sec 1.00 10.9±0.10ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.1±0.16ms 3.9 GB/sec 1.00 11.1±0.15ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.0±0.20ms 4.0 GB/sec 1.01 11.1±0.19ms 3.9 GB/sec primitive_non_null/bloom_filter 1.06 115.9±2.51ms 379.8 MB/sec 1.00 109.3±2.72ms 402.4 MB/sec primitive_non_null/cdc 1.02 92.5±1.13ms 475.8 MB/sec 1.00 91.0±1.65ms 483.7 MB/sec primitive_non_null/default 1.00 69.2±0.52ms 635.6 MB/sec 1.00 69.2±1.37ms 636.1 MB/sec primitive_non_null/parquet_2 1.00 91.0±1.37ms 483.3 MB/sec 1.00 90.7±0.56ms 484.9 MB/sec primitive_non_null/zstd 1.07 106.1±1.85ms 414.7 MB/sec 1.00 99.5±1.06ms 442.1 MB/sec primitive_non_null/zstd_parquet_2 1.06 132.2±2.10ms 332.8 MB/sec 1.00 124.4±1.51ms 353.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.6±0.64ms 2.4 GB/sec 1.05 19.6±0.16ms 2.2 GB/sec primitive_sparse_99pct_null/cdc 1.00 37.9±0.58ms 1185.4 MB/sec 1.00 37.8±0.30ms 1187.6 MB/sec primitive_sparse_99pct_null/default 1.00 17.1±0.27ms 2.6 GB/sec 1.00 17.2±0.25ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.3±0.07ms 2.5 GB/sec 1.00 17.3±0.31ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.4±0.26ms 2.2 GB/sec 1.00 20.4±0.28ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 19.3±0.10ms 2.3 GB/sec 1.00 19.2±0.32ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 28.2±0.27ms 425.8 MB/sec short_string_non_null/cdc 1.00 20.3±0.24ms 590.7 MB/sec short_string_non_null/default 1.00 16.1±0.06ms 743.5 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.05ms 466.2 MB/sec short_string_non_null/zstd 1.00 35.6±0.13ms 336.7 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.09ms 421.1 MB/sec string/bloom_filter 1.05 241.4±29.36ms 2.1 GB/sec 1.00 229.5±20.33ms 2.2 GB/sec string/cdc 1.01 226.3±8.62ms 2.3 GB/sec 1.00 224.0±7.48ms 2.3 GB/sec string/default 1.22 149.0±25.96ms 3.4 GB/sec 1.00 121.8±12.81ms 4.2 GB/sec string/parquet_2 1.05 128.5±2.18ms 4.0 GB/sec 1.00 121.8±2.90ms 4.2 GB/sec string/zstd 1.01 430.1±4.75ms 1219.0 MB/sec 1.00 425.7±4.35ms 1231.6 MB/sec string/zstd_parquet_2 1.00 395.1±1.99ms 1326.7 MB/sec 1.01 399.0±1.66ms 1313.8 MB/sec string_and_binary_view/bloom_filter 1.00 66.1±2.70ms 488.2 MB/sec 1.04 68.8±2.99ms 469.0 MB/sec string_and_binary_view/cdc 1.00 60.1±1.44ms 537.0 MB/sec 1.05 62.9±1.53ms 513.0 MB/sec string_and_binary_view/default 1.00 49.8±1.52ms 646.9 MB/sec 1.04 51.8±1.41ms 622.2 MB/sec string_and_binary_view/parquet_2 1.00 59.7±1.11ms 540.2 MB/sec 1.04 62.1±1.55ms 519.5 MB/sec string_and_binary_view/zstd 1.00 85.2±0.56ms 378.7 MB/sec 1.03 88.0±0.54ms 366.6 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.0±0.88ms 436.0 MB/sec 1.04 76.9±1.08ms 419.5 MB/sec string_dictionary/bloom_filter 1.00 110.0±7.61ms 2.3 GB/sec 1.28 141.3±7.91ms 1868.8 MB/sec string_dictionary/cdc 1.00 78.8±2.29ms 3.3 GB/sec 1.30 102.3±3.80ms 2.5 GB/sec string_dictionary/default 1.00 65.6±3.25ms 3.9 GB/sec 1.39 90.9±3.71ms 2.8 GB/sec string_dictionary/parquet_2 1.00 55.2±0.59ms 4.7 GB/sec 1.85 102.1±1.87ms 2.5 GB/sec string_dictionary/zstd 1.00 222.4±3.69ms 1187.8 MB/sec 1.01 224.7±15.20ms 1175.5 MB/sec string_dictionary/zstd_parquet_2 1.00 198.5±1.33ms 1330.5 MB/sec 1.19 236.0±1.85ms 1119.4 MB/sec string_non_null/bloom_filter 1.00 254.5±21.18ms 2.0 GB/sec 1.00 255.3±15.69ms 2.0 GB/sec string_non_null/cdc 1.00 277.0±13.67ms 1891.6 MB/sec 1.02 281.6±12.38ms 1861.0 MB/sec string_non_null/default 1.09 149.0±12.15ms 3.4 GB/sec 1.00 136.7±14.33ms 3.7 GB/sec string_non_null/parquet_2 1.00 124.0±2.41ms 4.1 GB/sec 1.25 154.5±2.23ms 3.3 GB/sec string_non_null/zstd 1.00 565.8±9.78ms 926.1 MB/sec 1.04 591.1±33.18ms 886.5 MB/sec string_non_null/zstd_parquet_2 1.00 505.3±2.87ms 1037.0 MB/sec 1.04 523.1±10.81ms 1001.6 MB/sec struct_all_null/bloom_filter 1.01 2.6±0.02ms 6.2 GB/sec 1.00 2.5±0.03ms 6.2 GB/sec struct_all_null/cdc 1.01 9.8±0.13ms 1640.3 MB/sec 1.00 9.8±0.10ms 1648.9 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.00 2.3±0.00ms 6.8 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 47.6±1.08ms 336.1 MB/sec 1.02 48.7±1.46ms 328.6 MB/sec struct_non_null/cdc 1.00 46.0±0.28ms 348.1 MB/sec 1.01 46.3±0.59ms 345.9 MB/sec struct_non_null/default 1.00 32.5±0.27ms 491.8 MB/sec 1.01 33.0±0.36ms 485.5 MB/sec struct_non_null/parquet_2 1.02 41.7±0.54ms 384.1 MB/sec 1.00 41.0±0.61ms 390.3 MB/sec struct_non_null/zstd 1.00 41.2±0.74ms 387.9 MB/sec 1.00 41.2±0.24ms 388.6 MB/sec struct_non_null/zstd_parquet_2 1.00 55.5±0.60ms 288.5 MB/sec 1.00 55.3±0.96ms 289.4 MB/sec struct_sparse_99pct_null/bloom_filter 1.04 7.9±0.28ms 2047.0 MB/sec 1.00 7.6±0.29ms 2.1 GB/sec struct_sparse_99pct_null/cdc 1.00 15.9±0.12ms 1014.2 MB/sec 1.00 15.8±0.27ms 1018.4 MB/sec struct_sparse_99pct_null/default 1.03 7.3±0.09ms 2.2 GB/sec 1.00 7.1±0.17ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.00 7.2±0.20ms 2.2 GB/sec 1.01 7.2±0.16ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.00 8.4±0.18ms 1924.8 MB/sec 1.03 8.6±0.06ms 1868.8 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 8.0±0.14ms 2015.1 MB/sec 1.00 8.0±0.18ms 2013.8 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2015.4s | | Peak memory | 6.2 GiB | | Avg memory | 6.0 GiB | | CPU user | 1897.3s | | CPU sys | 113.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2115.5s | | Peak memory | 6.5 GiB | | Avg memory | 6.3 GiB | | CPU user | 2032.5s | | CPU sys | 80.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
