adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4453179909
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4452557769) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.00 13.0±0.03ms 19.2 MB/sec 1.00 13.0±0.09ms 19.2 MB/sec bool/cdc 1.00 15.6±0.04ms 16.0 MB/sec 1.00 15.7±0.12ms 16.0 MB/sec bool/default 1.00 10.9±0.03ms 22.9 MB/sec 1.01 11.0±0.12ms 22.8 MB/sec bool/parquet_2 1.00 14.7±0.04ms 17.0 MB/sec 1.00 14.8±0.12ms 16.9 MB/sec bool/zstd 1.00 11.4±0.03ms 21.9 MB/sec 1.00 11.5±0.10ms 21.8 MB/sec bool/zstd_parquet_2 1.00 15.1±0.04ms 16.6 MB/sec 1.00 15.1±0.12ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.8 MB/sec 1.00 7.0±0.02ms 17.8 MB/sec bool_non_null/cdc 1.00 6.8±0.04ms 18.4 MB/sec 1.00 6.8±0.03ms 18.4 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.00 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.8 MB/sec 1.00 9.1±0.03ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.04ms 13.2 MB/sec 1.00 9.5±0.04ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 92.4±0.36ms 151.5 MB/sec 1.04 96.2±0.72ms 145.5 MB/sec float_with_nans/cdc 1.00 81.2±0.20ms 172.4 MB/sec 1.03 83.7±1.01ms 167.3 MB/sec float_with_nans/default 1.00 74.1±0.24ms 188.9 MB/sec 1.02 75.9±0.43ms 184.4 MB/sec float_with_nans/parquet_2 1.00 94.1±0.39ms 148.8 MB/sec 1.03 97.3±0.55ms 143.8 MB/sec float_with_nans/zstd 1.00 111.6±0.21ms 125.4 MB/sec 1.02 114.2±1.07ms 122.6 MB/sec float_with_nans/zstd_parquet_2 1.00 131.1±0.39ms 106.8 MB/sec 1.03 134.9±0.57ms 103.8 MB/sec large_string_non_null/bloom_filter 1.00 82.2±0.16ms 3.0 GB/sec large_string_non_null/cdc 1.00 242.6±1.01ms 1055.1 MB/sec large_string_non_null/default 1.00 63.1±0.22ms 4.0 GB/sec large_string_non_null/parquet_2 1.00 63.3±0.20ms 4.0 GB/sec large_string_non_null/zstd 1.00 63.4±0.22ms 3.9 GB/sec large_string_non_null/zstd_parquet_2 1.00 63.4±0.23ms 3.9 GB/sec list_primitive/bloom_filter 1.00 323.2±0.77ms 1687.2 MB/sec 1.05 340.5±3.10ms 1601.6 MB/sec list_primitive/cdc 1.00 357.4±1.04ms 1526.1 MB/sec 1.02 364.5±2.63ms 1496.3 MB/sec list_primitive/default 1.00 255.4±46.59ms 2.1 GB/sec 1.00 255.8±1.89ms 2.1 GB/sec list_primitive/parquet_2 1.00 268.4±0.72ms 2031.7 MB/sec 1.02 272.7±1.05ms 1999.7 MB/sec list_primitive/zstd 1.00 500.1±1.93ms 1090.5 MB/sec 1.02 511.1±1.79ms 1067.0 MB/sec list_primitive/zstd_parquet_2 1.00 490.5±0.49ms 1111.9 MB/sec 1.02 500.3±2.01ms 1090.1 MB/sec list_primitive_non_null/bloom_filter 1.00 418.7±6.33ms 1300.0 MB/sec 1.26 526.0±24.06ms 1034.8 MB/sec list_primitive_non_null/cdc 1.00 440.4±7.41ms 1235.7 MB/sec 1.01 442.8±6.00ms 1229.0 MB/sec list_primitive_non_null/default 1.00 285.9±4.54ms 1903.7 MB/sec 1.32 376.1±18.32ms 1446.9 MB/sec list_primitive_non_null/parquet_2 1.00 306.8±12.97ms 1773.9 MB/sec 1.30 397.9±5.13ms 1367.7 MB/sec list_primitive_non_null/zstd 1.00 719.5±6.21ms 756.4 MB/sec 1.09 782.7±16.12ms 695.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 686.4±1.31ms 792.9 MB/sec 1.09 749.3±3.12ms 726.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.1±0.22ms 3.3 GB/sec 1.05 11.7±0.11ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.5±0.09ms 1663.4 MB/sec 1.03 23.1±0.11ms 1615.5 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.7±0.04ms 3.4 GB/sec 1.05 11.2±0.11ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.04ms 3.4 GB/sec 1.04 11.2±0.05ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.6±0.05ms 2.9 GB/sec 1.04 13.1±0.05ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 10.9±0.04ms 3.4 GB/sec 1.04 11.4±0.08ms 3.2 GB/sec primitive/bloom_filter 1.00 148.3±0.47ms 302.7 MB/sec 1.00 148.8±0.66ms 301.6 MB/sec primitive/cdc 1.00 158.7±0.53ms 282.8 MB/sec 1.00 158.8±0.86ms 282.6 MB/sec primitive/default 1.00 117.3±0.24ms 382.6 MB/sec 1.01 117.9±0.68ms 380.5 MB/sec primitive/parquet_2 1.00 132.2±0.27ms 339.4 MB/sec 1.00 132.7±0.66ms 338.1 MB/sec primitive/zstd 1.00 146.8±0.28ms 305.8 MB/sec 1.01 147.7±0.71ms 303.7 MB/sec primitive/zstd_parquet_2 1.00 165.5±0.33ms 271.1 MB/sec 1.00 166.1±0.59ms 270.1 MB/sec primitive_all_null/bloom_filter 1.00 11.5±0.11ms 3.8 GB/sec 1.02 11.8±0.17ms 3.7 GB/sec primitive_all_null/cdc 1.03 30.6±0.39ms 1465.9 MB/sec 1.00 29.8±0.46ms 1503.4 MB/sec primitive_all_null/default 1.00 10.9±0.21ms 4.0 GB/sec 1.00 10.9±0.11ms 4.0 GB/sec primitive_all_null/parquet_2 1.01 11.0±0.20ms 4.0 GB/sec 1.00 10.9±0.15ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.0±0.14ms 4.0 GB/sec 1.02 11.2±0.21ms 3.9 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.0±0.16ms 4.0 GB/sec 1.01 11.1±0.22ms 4.0 GB/sec primitive_non_null/bloom_filter 1.08 113.3±1.61ms 388.4 MB/sec 1.00 105.2±0.20ms 418.4 MB/sec primitive_non_null/cdc 1.01 90.0±0.50ms 489.1 MB/sec 1.00 89.3±0.29ms 492.9 MB/sec primitive_non_null/default 1.01 67.4±0.22ms 653.2 MB/sec 1.00 67.0±0.18ms 656.5 MB/sec primitive_non_null/parquet_2 1.00 89.1±0.20ms 493.9 MB/sec 1.00 88.8±0.14ms 495.7 MB/sec primitive_non_null/zstd 1.08 105.6±0.45ms 416.8 MB/sec 1.00 97.6±0.12ms 450.8 MB/sec primitive_non_null/zstd_parquet_2 1.06 130.1±1.86ms 338.1 MB/sec 1.00 122.2±0.18ms 360.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.3±0.16ms 2.4 GB/sec 1.06 19.3±0.26ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 37.2±0.38ms 1207.0 MB/sec 1.00 37.2±0.37ms 1205.8 MB/sec primitive_sparse_99pct_null/default 1.00 16.8±0.06ms 2.6 GB/sec 1.03 17.3±0.08ms 2.5 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.06ms 2.6 GB/sec 1.03 17.3±0.10ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.0±0.10ms 2.2 GB/sec 1.03 20.6±0.12ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.7±0.09ms 2.3 GB/sec 1.03 19.3±0.12ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 29.7±0.13ms 403.9 MB/sec short_string_non_null/cdc 1.00 20.2±0.06ms 594.2 MB/sec short_string_non_null/default 1.00 16.4±0.13ms 733.4 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.14ms 461.6 MB/sec short_string_non_null/zstd 1.00 38.2±6.26ms 314.3 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.1±0.18ms 412.8 MB/sec string/bloom_filter 1.05 228.5±26.93ms 2.2 GB/sec 1.00 217.9±17.20ms 2.3 GB/sec string/cdc 1.00 220.9±5.71ms 2.3 GB/sec 1.00 220.6±5.33ms 2.3 GB/sec string/default 1.15 140.0±24.70ms 3.7 GB/sec 1.00 122.1±13.31ms 4.2 GB/sec string/parquet_2 1.01 126.4±1.85ms 4.1 GB/sec 1.00 124.8±1.03ms 4.1 GB/sec string/zstd 1.01 424.6±2.74ms 1234.6 MB/sec 1.00 421.6±1.32ms 1243.6 MB/sec string/zstd_parquet_2 1.00 394.7±1.28ms 1328.2 MB/sec 1.02 401.3±0.35ms 1306.2 MB/sec string_and_binary_view/bloom_filter 1.00 63.4±0.24ms 508.7 MB/sec 1.09 69.2±0.17ms 465.9 MB/sec string_and_binary_view/cdc 1.00 58.3±0.12ms 553.1 MB/sec 1.05 61.4±0.15ms 525.6 MB/sec string_and_binary_view/default 1.00 47.7±0.10ms 676.3 MB/sec 1.10 52.5±0.18ms 614.2 MB/sec string_and_binary_view/parquet_2 1.00 58.5±0.12ms 551.0 MB/sec 1.08 63.2±0.32ms 510.4 MB/sec string_and_binary_view/zstd 1.00 84.2±0.15ms 382.9 MB/sec 1.06 89.3±0.37ms 360.9 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.4±0.11ms 445.6 MB/sec 1.07 77.1±0.16ms 418.0 MB/sec string_dictionary/bloom_filter 1.00 88.8±0.66ms 2.9 GB/sec 1.54 136.8±2.03ms 1930.6 MB/sec string_dictionary/cdc 1.00 86.6±2.67ms 3.0 GB/sec 1.14 98.8±3.49ms 2.6 GB/sec string_dictionary/default 1.00 48.2±0.34ms 5.3 GB/sec 1.91 91.9±2.19ms 2.8 GB/sec string_dictionary/parquet_2 1.00 53.8±0.16ms 4.8 GB/sec 1.94 104.2±2.36ms 2.5 GB/sec string_dictionary/zstd 1.00 208.7±0.68ms 1265.8 MB/sec 1.07 223.1±14.95ms 1184.1 MB/sec string_dictionary/zstd_parquet_2 1.00 197.8±0.12ms 1335.0 MB/sec 1.20 236.6±1.77ms 1116.4 MB/sec string_non_null/bloom_filter 1.00 252.4±15.95ms 2.0 GB/sec 1.01 254.2±12.25ms 2.0 GB/sec string_non_null/cdc 1.00 267.6±9.15ms 1958.5 MB/sec 1.06 283.6±12.31ms 1847.7 MB/sec string_non_null/default 1.00 126.2±12.63ms 4.1 GB/sec 1.07 135.2±12.42ms 3.8 GB/sec string_non_null/parquet_2 1.00 141.3±12.34ms 3.6 GB/sec 1.11 157.1±1.99ms 3.3 GB/sec string_non_null/zstd 1.00 531.4±2.22ms 986.0 MB/sec 1.11 589.4±34.73ms 889.0 MB/sec string_non_null/zstd_parquet_2 1.00 505.7±2.52ms 1036.1 MB/sec 1.04 527.6±11.72ms 993.2 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.2 GB/sec 1.01 2.6±0.02ms 6.2 GB/sec struct_all_null/cdc 1.00 9.9±0.12ms 1634.9 MB/sec 1.01 10.0±0.12ms 1611.5 MB/sec struct_all_null/default 1.00 2.2±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.8 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 47.1±0.20ms 339.8 MB/sec 1.02 47.9±0.83ms 334.2 MB/sec struct_non_null/cdc 1.00 45.7±0.22ms 350.3 MB/sec 1.01 46.1±0.46ms 346.9 MB/sec struct_non_null/default 1.00 32.1±0.15ms 499.0 MB/sec 1.01 32.4±0.44ms 493.3 MB/sec struct_non_null/parquet_2 1.00 40.8±0.51ms 392.0 MB/sec 1.01 41.2±0.49ms 388.4 MB/sec struct_non_null/zstd 1.00 40.8±0.11ms 392.1 MB/sec 1.01 41.2±0.54ms 387.9 MB/sec struct_non_null/zstd_parquet_2 1.00 54.9±0.17ms 291.5 MB/sec 1.03 56.3±2.02ms 284.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.5±0.05ms 2.1 GB/sec 1.07 8.0±0.11ms 2019.0 MB/sec struct_sparse_99pct_null/cdc 1.00 15.3±0.08ms 1051.6 MB/sec 1.01 15.5±0.09ms 1040.0 MB/sec struct_sparse_99pct_null/default 1.00 7.0±0.04ms 2.3 GB/sec 1.04 7.3±0.07ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.03ms 2.3 GB/sec 1.05 7.3±0.07ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.00 8.3±0.02ms 1949.3 MB/sec 1.05 8.7±0.07ms 1864.2 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.02ms 2.0 GB/sec 1.05 8.1±0.04ms 1998.4 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1879.7s | | CPU sys | 57.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2155.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.7 GiB | | CPU user | 2078.6s | | CPU sys | 76.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
