adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4472165507
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4471890159) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.00 13.0±0.05ms 19.2 MB/sec 1.00 13.0±0.04ms 19.2 MB/sec bool/cdc 1.00 16.0±0.14ms 15.7 MB/sec 1.00 16.0±0.08ms 15.6 MB/sec bool/default 1.00 10.9±0.04ms 22.9 MB/sec 1.00 10.9±0.04ms 23.0 MB/sec bool/parquet_2 1.00 14.8±0.04ms 16.9 MB/sec 1.00 14.7±0.05ms 17.0 MB/sec bool/zstd 1.00 11.4±0.04ms 21.9 MB/sec 1.00 11.4±0.03ms 21.9 MB/sec bool/zstd_parquet_2 1.00 15.2±0.05ms 16.5 MB/sec 1.00 15.1±0.04ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.8 MB/sec 1.00 7.0±0.02ms 17.8 MB/sec bool_non_null/cdc 1.00 6.8±0.03ms 18.3 MB/sec 1.01 6.9±0.03ms 18.2 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.00 4.3±0.02ms 29.4 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.8 MB/sec 1.00 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.1 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.00 9.5±0.03ms 13.2 MB/sec float_with_nans/bloom_filter 1.01 95.8±0.70ms 146.2 MB/sec 1.00 95.0±0.32ms 147.4 MB/sec float_with_nans/cdc 1.01 82.7±1.56ms 169.2 MB/sec 1.00 82.1±0.29ms 170.5 MB/sec float_with_nans/default 1.01 75.8±0.28ms 184.7 MB/sec 1.00 75.4±0.41ms 185.8 MB/sec float_with_nans/parquet_2 1.01 97.1±0.45ms 144.1 MB/sec 1.00 96.7±0.29ms 144.9 MB/sec float_with_nans/zstd 1.00 113.6±0.33ms 123.2 MB/sec 1.00 113.3±0.32ms 123.6 MB/sec float_with_nans/zstd_parquet_2 1.00 134.3±0.61ms 104.3 MB/sec 1.00 133.9±0.34ms 104.5 MB/sec large_string_non_null/bloom_filter 1.00 72.9±0.10ms 3.4 GB/sec large_string_non_null/cdc 1.00 242.8±1.38ms 1054.2 MB/sec large_string_non_null/default 1.00 55.4±0.15ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.3±0.09ms 4.5 GB/sec large_string_non_null/zstd 1.00 55.4±0.08ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.6±0.29ms 4.5 GB/sec list_primitive/bloom_filter 1.00 335.5±1.76ms 1625.3 MB/sec 1.02 343.0±4.30ms 1590.0 MB/sec list_primitive/cdc 1.00 365.2±1.89ms 1493.4 MB/sec 1.05 382.1±12.10ms 1427.4 MB/sec list_primitive/default 1.00 255.1±2.37ms 2.1 GB/sec 1.02 260.4±1.18ms 2.0 GB/sec list_primitive/parquet_2 1.00 276.3±1.45ms 1974.0 MB/sec 1.00 277.2±1.49ms 1967.2 MB/sec list_primitive/zstd 1.00 506.6±2.69ms 1076.6 MB/sec 1.00 505.8±3.81ms 1078.2 MB/sec list_primitive/zstd_parquet_2 1.00 499.4±0.62ms 1091.9 MB/sec 1.00 500.6±1.67ms 1089.4 MB/sec list_primitive_non_null/bloom_filter 1.00 439.0±7.61ms 1239.7 MB/sec 1.09 479.9±15.88ms 1134.0 MB/sec list_primitive_non_null/cdc 1.00 440.2±10.36ms 1236.3 MB/sec 1.00 440.0±7.90ms 1237.0 MB/sec list_primitive_non_null/default 1.00 294.4±5.92ms 1848.5 MB/sec 1.12 331.2±15.87ms 1643.2 MB/sec list_primitive_non_null/parquet_2 1.00 313.8±12.12ms 1734.2 MB/sec 1.11 348.7±1.60ms 1560.6 MB/sec list_primitive_non_null/zstd 1.00 724.9±11.61ms 750.8 MB/sec 1.05 759.7±35.42ms 716.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 690.3±3.87ms 788.4 MB/sec 1.05 724.4±36.78ms 751.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.5±0.04ms 3.2 GB/sec 1.05 12.1±0.09ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.1±0.09ms 1619.2 MB/sec 1.03 23.7±0.12ms 1577.9 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.3±0.17ms 3.2 GB/sec 1.04 11.7±0.07ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.2±0.03ms 3.3 GB/sec 1.04 11.6±0.13ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.0±0.05ms 2.8 GB/sec 1.04 13.5±0.08ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.3±0.05ms 3.2 GB/sec 1.05 11.9±0.06ms 3.1 GB/sec primitive/bloom_filter 1.00 150.9±0.39ms 297.3 MB/sec 1.00 151.0±0.69ms 297.1 MB/sec primitive/cdc 1.00 160.0±1.05ms 280.5 MB/sec 1.01 161.0±0.50ms 278.8 MB/sec primitive/default 1.00 118.6±0.39ms 378.3 MB/sec 1.00 119.2±0.36ms 376.5 MB/sec primitive/parquet_2 1.00 133.5±0.42ms 336.2 MB/sec 1.00 133.5±1.24ms 336.1 MB/sec primitive/zstd 1.00 148.2±0.27ms 302.7 MB/sec 1.00 148.1±0.44ms 303.0 MB/sec primitive/zstd_parquet_2 1.00 167.0±0.29ms 268.8 MB/sec 1.00 167.0±0.55ms 268.7 MB/sec primitive_all_null/bloom_filter 1.00 887.4±8.57µs 49.4 GB/sec 1.02 908.6±6.74µs 48.2 GB/sec primitive_all_null/cdc 1.00 17.9±0.42ms 2.4 GB/sec 1.05 18.9±0.29ms 2.3 GB/sec primitive_all_null/default 1.00 260.1±0.91µs 168.5 GB/sec 1.06 275.6±1.81µs 159.0 GB/sec primitive_all_null/parquet_2 1.00 257.2±1.57µs 170.4 GB/sec 1.09 280.6±1.90µs 156.2 GB/sec primitive_all_null/zstd 1.00 373.2±0.48µs 117.4 GB/sec 1.04 389.6±1.94µs 112.5 GB/sec primitive_all_null/zstd_parquet_2 1.00 336.3±1.41µs 130.3 GB/sec 1.07 359.4±1.79µs 121.9 GB/sec primitive_non_null/bloom_filter 1.01 108.2±0.33ms 406.5 MB/sec 1.00 107.1±0.27ms 410.9 MB/sec primitive_non_null/cdc 1.01 91.9±0.49ms 478.8 MB/sec 1.00 90.7±0.53ms 484.9 MB/sec primitive_non_null/default 1.00 68.4±0.37ms 643.4 MB/sec 1.01 68.9±0.29ms 638.9 MB/sec primitive_non_null/parquet_2 1.00 90.0±0.18ms 489.0 MB/sec 1.00 90.0±0.17ms 488.9 MB/sec primitive_non_null/zstd 1.07 105.5±0.93ms 417.1 MB/sec 1.00 99.0±0.15ms 444.6 MB/sec primitive_non_null/zstd_parquet_2 1.05 130.0±2.71ms 338.5 MB/sec 1.00 123.7±0.25ms 355.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.4±0.14ms 2.4 GB/sec 1.04 19.0±0.17ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 35.7±0.45ms 1257.5 MB/sec 1.07 38.2±0.27ms 1174.7 MB/sec primitive_sparse_99pct_null/default 1.00 16.8±0.07ms 2.6 GB/sec 1.03 17.3±0.03ms 2.5 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.9±0.12ms 2.6 GB/sec 1.02 17.2±0.10ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.2±0.13ms 2.2 GB/sec 1.02 20.5±0.10ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.9±0.15ms 2.3 GB/sec 1.01 19.1±0.13ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 27.3±0.09ms 439.5 MB/sec short_string_non_null/cdc 1.00 20.1±0.12ms 595.6 MB/sec short_string_non_null/default 1.00 15.9±0.05ms 754.3 MB/sec short_string_non_null/parquet_2 1.00 25.6±0.09ms 468.9 MB/sec short_string_non_null/zstd 1.00 35.5±0.11ms 337.9 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.08ms 421.7 MB/sec string/bloom_filter 1.03 225.2±21.55ms 2.3 GB/sec 1.00 217.7±14.89ms 2.4 GB/sec string/cdc 1.02 223.1±4.93ms 2.3 GB/sec 1.00 217.8±7.46ms 2.4 GB/sec string/default 1.03 129.7±21.05ms 3.9 GB/sec 1.00 126.5±7.60ms 4.0 GB/sec string/parquet_2 1.00 112.2±6.49ms 4.6 GB/sec 1.12 125.5±0.81ms 4.1 GB/sec string/zstd 1.00 420.5±2.23ms 1246.8 MB/sec 1.07 448.5±16.48ms 1168.9 MB/sec string/zstd_parquet_2 1.00 404.2±6.93ms 1297.1 MB/sec 1.01 406.7±10.47ms 1289.1 MB/sec string_and_binary_view/bloom_filter 1.00 65.6±0.36ms 491.6 MB/sec 1.01 66.2±0.32ms 486.9 MB/sec string_and_binary_view/cdc 1.00 59.2±0.36ms 544.7 MB/sec 1.01 60.1±0.19ms 536.9 MB/sec string_and_binary_view/default 1.00 48.5±0.15ms 664.4 MB/sec 1.01 49.1±0.14ms 656.2 MB/sec string_and_binary_view/parquet_2 1.00 58.8±0.19ms 548.7 MB/sec 1.02 60.1±0.16ms 536.5 MB/sec string_and_binary_view/zstd 1.00 84.6±0.17ms 381.4 MB/sec 1.02 85.8±0.21ms 375.7 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.3±0.15ms 440.0 MB/sec 1.01 74.0±0.21ms 435.9 MB/sec string_dictionary/bloom_filter 1.00 94.6±1.05ms 2.7 GB/sec 1.04 97.9±0.49ms 2.6 GB/sec string_dictionary/cdc 1.00 52.7±1.02ms 4.9 GB/sec 1.07 56.4±0.77ms 4.6 GB/sec string_dictionary/default 1.00 48.7±1.63ms 5.3 GB/sec 1.07 52.2±0.39ms 4.9 GB/sec string_dictionary/parquet_2 1.00 55.1±0.28ms 4.7 GB/sec 1.01 55.6±0.36ms 4.6 GB/sec string_dictionary/zstd 1.00 210.2±1.56ms 1256.8 MB/sec 1.02 214.1±0.58ms 1233.4 MB/sec string_dictionary/zstd_parquet_2 1.00 200.5±0.34ms 1317.5 MB/sec 1.00 200.4±0.34ms 1318.2 MB/sec string_non_null/bloom_filter 1.00 267.0±14.97ms 1962.4 MB/sec 1.01 269.6±13.44ms 1943.9 MB/sec string_non_null/cdc 1.09 280.4±9.63ms 1868.9 MB/sec 1.00 256.7±1.95ms 2041.1 MB/sec string_non_null/default 1.03 146.6±11.06ms 3.5 GB/sec 1.00 142.1±12.93ms 3.6 GB/sec string_non_null/parquet_2 1.22 152.9±0.59ms 3.3 GB/sec 1.00 125.5±1.14ms 4.1 GB/sec string_non_null/zstd 1.05 570.4±6.01ms 918.6 MB/sec 1.00 544.9±4.66ms 961.7 MB/sec string_non_null/zstd_parquet_2 1.03 522.0±1.90ms 1003.8 MB/sec 1.00 508.0±2.22ms 1031.5 MB/sec struct_all_null/bloom_filter 1.00 371.1±1.79µs 42.4 GB/sec 1.01 374.0±1.84µs 42.1 GB/sec struct_all_null/cdc 1.00 7.2±0.13ms 2.2 GB/sec 1.06 7.6±0.06ms 2.1 GB/sec struct_all_null/default 1.00 112.7±0.33µs 139.7 GB/sec 1.07 120.1±0.85µs 131.1 GB/sec struct_all_null/parquet_2 1.00 111.6±0.51µs 141.1 GB/sec 1.09 121.7±0.80µs 129.4 GB/sec struct_all_null/zstd 1.00 160.1±0.62µs 98.3 GB/sec 1.05 167.9±1.16µs 93.8 GB/sec struct_all_null/zstd_parquet_2 1.00 144.3±0.52µs 109.2 GB/sec 1.07 155.0±0.72µs 101.6 GB/sec struct_non_null/bloom_filter 1.01 47.3±0.17ms 338.0 MB/sec 1.00 46.7±0.25ms 342.9 MB/sec struct_non_null/cdc 1.00 45.6±0.21ms 350.8 MB/sec 1.00 45.8±0.15ms 349.7 MB/sec struct_non_null/default 1.00 32.2±0.17ms 496.6 MB/sec 1.00 32.2±0.09ms 497.0 MB/sec struct_non_null/parquet_2 1.00 40.8±0.12ms 391.7 MB/sec 1.00 40.8±0.15ms 392.4 MB/sec struct_non_null/zstd 1.00 41.0±0.19ms 390.2 MB/sec 1.00 40.9±0.08ms 391.1 MB/sec struct_non_null/zstd_parquet_2 1.00 55.0±0.15ms 290.8 MB/sec 1.00 54.8±0.12ms 291.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.18ms 2.4 GB/sec 1.01 6.7±0.14ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.12ms 1179.5 MB/sec 1.08 14.8±0.15ms 1092.4 MB/sec struct_sparse_99pct_null/default 1.00 5.9±0.05ms 2.6 GB/sec 1.03 6.1±0.03ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 5.9±0.05ms 2.7 GB/sec 1.03 6.1±0.04ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.05ms 2.2 GB/sec 1.02 7.4±0.08ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 7.0±0.03ms 2.3 GB/sec 1.00 6.9±0.09ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1885.2s | | CPU sys | 52.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2085.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2020.1s | | CPU sys | 64.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
