adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4461469762
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4460974503) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.1±0.03ms 19.1 MB/sec 1.00 13.0±0.05ms 19.3 MB/sec bool/cdc 1.00 15.9±0.08ms 15.8 MB/sec 1.01 16.0±0.05ms 15.6 MB/sec bool/default 1.01 10.9±0.03ms 22.9 MB/sec 1.00 10.9±0.04ms 23.0 MB/sec bool/parquet_2 1.01 14.8±0.03ms 17.0 MB/sec 1.00 14.7±0.05ms 17.1 MB/sec bool/zstd 1.00 11.4±0.04ms 21.9 MB/sec 1.00 11.4±0.06ms 22.0 MB/sec bool/zstd_parquet_2 1.01 15.1±0.04ms 16.5 MB/sec 1.00 15.0±0.05ms 16.7 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.8 MB/sec 1.01 7.1±0.03ms 17.7 MB/sec bool_non_null/cdc 1.00 6.9±0.04ms 18.1 MB/sec 1.00 6.9±0.06ms 18.2 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.01 4.3±0.02ms 29.1 MB/sec bool_non_null/parquet_2 1.00 9.0±0.02ms 13.9 MB/sec 1.01 9.1±0.04ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.01 4.7±0.02ms 26.9 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.01 9.5±0.04ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 93.9±0.46ms 149.1 MB/sec 1.18 111.1±7.18ms 126.0 MB/sec float_with_nans/cdc 1.00 82.7±0.29ms 169.3 MB/sec 1.03 85.3±1.69ms 164.2 MB/sec float_with_nans/default 1.00 75.0±0.69ms 186.6 MB/sec 1.24 93.2±7.30ms 150.2 MB/sec float_with_nans/parquet_2 1.00 96.0±0.41ms 145.8 MB/sec 1.18 113.1±7.30ms 123.8 MB/sec float_with_nans/zstd 1.00 113.0±0.28ms 123.9 MB/sec 1.15 130.4±7.30ms 107.3 MB/sec float_with_nans/zstd_parquet_2 1.00 133.3±0.45ms 105.0 MB/sec 1.13 150.6±7.35ms 92.9 MB/sec large_string_non_null/bloom_filter 1.00 84.0±0.18ms 3.0 GB/sec large_string_non_null/cdc 1.00 244.2±1.12ms 1048.5 MB/sec large_string_non_null/default 1.00 64.1±0.21ms 3.9 GB/sec large_string_non_null/parquet_2 1.00 64.3±0.15ms 3.9 GB/sec large_string_non_null/zstd 1.00 64.4±0.18ms 3.9 GB/sec large_string_non_null/zstd_parquet_2 1.00 64.3±0.19ms 3.9 GB/sec list_primitive/bloom_filter 1.00 336.0±2.13ms 1623.2 MB/sec 1.01 339.6±1.11ms 1606.0 MB/sec list_primitive/cdc 1.00 366.3±1.72ms 1488.8 MB/sec 1.00 367.2±1.83ms 1485.1 MB/sec list_primitive/default 1.00 255.4±2.16ms 2.1 GB/sec 1.01 258.9±1.60ms 2.1 GB/sec list_primitive/parquet_2 1.00 276.3±0.71ms 1973.8 MB/sec 1.00 276.5±0.59ms 1972.7 MB/sec list_primitive/zstd 1.00 508.6±3.68ms 1072.2 MB/sec 1.00 508.9±1.97ms 1071.7 MB/sec list_primitive/zstd_parquet_2 1.00 498.4±1.21ms 1094.1 MB/sec 1.00 498.9±0.73ms 1093.2 MB/sec list_primitive_non_null/bloom_filter 1.00 397.7±4.61ms 1368.4 MB/sec 1.02 407.5±4.37ms 1335.6 MB/sec list_primitive_non_null/cdc 1.01 444.6±7.19ms 1224.0 MB/sec 1.00 441.4±7.22ms 1232.9 MB/sec list_primitive_non_null/default 1.00 267.2±3.87ms 2037.2 MB/sec 1.03 275.0±3.65ms 1978.9 MB/sec list_primitive_non_null/parquet_2 1.00 294.9±0.39ms 1845.3 MB/sec 1.04 305.7±0.36ms 1780.3 MB/sec list_primitive_non_null/zstd 1.00 690.3±4.78ms 788.4 MB/sec 1.01 698.9±6.52ms 778.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 670.5±1.17ms 811.7 MB/sec 1.00 671.2±0.75ms 810.9 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.04 11.8±0.03ms 3.1 GB/sec 1.00 11.4±0.06ms 3.2 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.3±0.03ms 1606.6 MB/sec 1.00 23.2±0.04ms 1607.5 MB/sec list_primitive_sparse_99pct_null/default 1.02 11.4±0.03ms 3.2 GB/sec 1.00 11.3±0.06ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.03 11.4±0.02ms 3.2 GB/sec 1.00 11.1±0.08ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 13.3±0.04ms 2.7 GB/sec 1.00 13.0±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.02 11.6±0.03ms 3.1 GB/sec 1.00 11.4±0.03ms 3.2 GB/sec primitive/bloom_filter 1.00 151.8±0.59ms 295.6 MB/sec 1.00 151.1±0.53ms 296.9 MB/sec primitive/cdc 1.00 159.3±0.57ms 281.6 MB/sec 1.01 160.3±0.65ms 279.9 MB/sec primitive/default 1.00 119.0±0.24ms 377.0 MB/sec 1.00 118.6±0.39ms 378.3 MB/sec primitive/parquet_2 1.00 133.9±0.34ms 335.1 MB/sec 1.00 133.4±0.25ms 336.3 MB/sec primitive/zstd 1.00 148.6±0.29ms 302.0 MB/sec 1.00 148.1±0.25ms 302.9 MB/sec primitive/zstd_parquet_2 1.00 166.6±0.33ms 269.4 MB/sec 1.00 166.8±0.30ms 269.0 MB/sec primitive_all_null/bloom_filter 1.00 895.2±2.85µs 49.0 GB/sec 1.01 905.4±4.07µs 48.4 GB/sec primitive_all_null/cdc 1.00 18.0±0.31ms 2.4 GB/sec 1.02 18.4±0.28ms 2.4 GB/sec primitive_all_null/default 1.00 263.1±0.48µs 166.6 GB/sec 1.05 276.2±1.88µs 158.7 GB/sec primitive_all_null/parquet_2 1.00 260.7±0.78µs 168.1 GB/sec 1.08 280.3±2.28µs 156.3 GB/sec primitive_all_null/zstd 1.00 376.1±0.57µs 116.5 GB/sec 1.03 388.7±2.12µs 112.7 GB/sec primitive_all_null/zstd_parquet_2 1.00 337.2±1.02µs 130.0 GB/sec 1.06 358.1±2.46µs 122.4 GB/sec primitive_non_null/bloom_filter 1.00 108.1±0.20ms 406.9 MB/sec 1.00 108.5±0.45ms 405.4 MB/sec primitive_non_null/cdc 1.00 91.3±0.24ms 482.1 MB/sec 1.00 91.5±0.57ms 481.1 MB/sec primitive_non_null/default 1.00 67.8±0.17ms 648.9 MB/sec 1.01 68.7±0.15ms 640.8 MB/sec primitive_non_null/parquet_2 1.00 89.6±0.30ms 491.1 MB/sec 1.00 89.6±0.20ms 490.8 MB/sec primitive_non_null/zstd 1.08 106.4±0.98ms 413.5 MB/sec 1.00 99.0±0.21ms 444.6 MB/sec primitive_non_null/zstd_parquet_2 1.05 129.9±2.60ms 338.8 MB/sec 1.00 123.9±0.18ms 355.2 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.8±0.17ms 2.3 GB/sec 1.01 19.0±0.06ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 35.7±0.25ms 1256.6 MB/sec 1.01 35.9±0.22ms 1249.2 MB/sec primitive_sparse_99pct_null/default 1.00 16.9±0.08ms 2.6 GB/sec 1.01 17.2±0.03ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.1±0.05ms 2.6 GB/sec 1.00 17.2±0.03ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.4±0.06ms 2.1 GB/sec 1.00 20.5±0.03ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 19.1±0.07ms 2.3 GB/sec 1.00 19.1±0.03ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 27.6±0.06ms 434.8 MB/sec short_string_non_null/cdc 1.00 20.3±0.06ms 591.1 MB/sec short_string_non_null/default 1.00 16.0±0.05ms 748.3 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.06ms 466.1 MB/sec short_string_non_null/zstd 1.00 35.6±0.10ms 337.0 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.6±0.10ms 419.8 MB/sec string/bloom_filter 1.00 221.3±21.32ms 2.3 GB/sec 1.00 220.3±15.07ms 2.3 GB/sec string/cdc 1.01 224.0±5.03ms 2.3 GB/sec 1.00 222.5±9.27ms 2.3 GB/sec string/default 1.03 129.8±21.08ms 3.9 GB/sec 1.00 126.3±8.01ms 4.1 GB/sec string/parquet_2 1.00 111.9±6.45ms 4.6 GB/sec 1.15 128.7±0.54ms 4.0 GB/sec string/zstd 1.00 418.2±2.09ms 1253.7 MB/sec 1.08 451.7±19.33ms 1160.6 MB/sec string/zstd_parquet_2 1.00 403.5±6.36ms 1299.3 MB/sec 1.01 408.1±5.30ms 1284.6 MB/sec string_and_binary_view/bloom_filter 1.00 65.4±0.23ms 493.5 MB/sec 1.08 70.3±0.33ms 458.9 MB/sec string_and_binary_view/cdc 1.00 58.5±0.13ms 551.3 MB/sec 1.07 62.3±0.40ms 517.3 MB/sec string_and_binary_view/default 1.00 48.3±0.10ms 667.7 MB/sec 1.10 53.1±0.23ms 607.8 MB/sec string_and_binary_view/parquet_2 1.00 59.0±0.17ms 546.2 MB/sec 1.08 63.7±0.46ms 506.3 MB/sec string_and_binary_view/zstd 1.00 84.7±0.14ms 380.9 MB/sec 1.06 89.8±0.59ms 359.1 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.8±0.16ms 443.3 MB/sec 1.07 77.9±0.45ms 413.8 MB/sec string_dictionary/bloom_filter 1.00 92.9±1.45ms 2.8 GB/sec 1.06 98.3±0.90ms 2.6 GB/sec string_dictionary/cdc 1.00 53.5±1.15ms 4.8 GB/sec 1.06 56.9±1.09ms 4.5 GB/sec string_dictionary/default 1.00 47.3±1.04ms 5.5 GB/sec 1.15 54.3±0.58ms 4.7 GB/sec string_dictionary/parquet_2 1.00 54.6±0.25ms 4.7 GB/sec 1.04 56.8±0.53ms 4.5 GB/sec string_dictionary/zstd 1.00 210.5±2.07ms 1255.0 MB/sec 1.02 215.4±0.41ms 1226.4 MB/sec string_dictionary/zstd_parquet_2 1.00 199.0±0.24ms 1327.0 MB/sec 1.01 202.0±0.28ms 1307.9 MB/sec string_non_null/bloom_filter 1.00 257.1±14.34ms 2038.0 MB/sec 1.03 266.0±12.46ms 1969.9 MB/sec string_non_null/cdc 1.00 267.7±2.97ms 1957.2 MB/sec 1.01 271.2±6.61ms 1931.9 MB/sec string_non_null/default 1.00 142.1±12.48ms 3.6 GB/sec 1.01 142.9±11.92ms 3.6 GB/sec string_non_null/parquet_2 1.00 132.2±3.04ms 3.9 GB/sec 1.03 136.4±7.91ms 3.8 GB/sec string_non_null/zstd 1.00 542.5±3.23ms 965.9 MB/sec 1.01 546.5±4.91ms 958.8 MB/sec string_non_null/zstd_parquet_2 1.00 505.4±0.85ms 1036.8 MB/sec 1.00 507.1±0.58ms 1033.3 MB/sec struct_all_null/bloom_filter 1.00 367.3±2.23µs 42.9 GB/sec 1.02 376.4±1.25µs 41.8 GB/sec struct_all_null/cdc 1.00 7.1±0.08ms 2.2 GB/sec 1.03 7.3±0.09ms 2.1 GB/sec struct_all_null/default 1.00 113.5±0.60µs 138.7 GB/sec 1.06 119.9±0.74µs 131.3 GB/sec struct_all_null/parquet_2 1.00 112.2±0.64µs 140.4 GB/sec 1.08 121.0±0.89µs 130.1 GB/sec struct_all_null/zstd 1.00 160.4±0.74µs 98.2 GB/sec 1.05 168.6±0.90µs 93.4 GB/sec struct_all_null/zstd_parquet_2 1.00 144.9±0.47µs 108.7 GB/sec 1.07 154.4±0.99µs 102.0 GB/sec struct_non_null/bloom_filter 1.03 47.1±0.15ms 339.4 MB/sec 1.00 45.9±0.18ms 348.4 MB/sec struct_non_null/cdc 1.00 45.7±0.15ms 350.4 MB/sec 1.00 45.5±0.16ms 351.9 MB/sec struct_non_null/default 1.00 32.2±0.15ms 497.0 MB/sec 1.00 32.1±0.12ms 497.8 MB/sec struct_non_null/parquet_2 1.00 41.1±0.09ms 389.6 MB/sec 1.00 41.1±0.13ms 389.3 MB/sec struct_non_null/zstd 1.01 41.3±0.13ms 387.4 MB/sec 1.00 40.9±0.12ms 390.8 MB/sec struct_non_null/zstd_parquet_2 1.01 55.3±0.12ms 289.3 MB/sec 1.00 54.9±0.13ms 291.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.8±0.04ms 2.3 GB/sec 1.01 6.9±0.05ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.07ms 1191.6 MB/sec 1.00 13.5±0.07ms 1192.9 MB/sec struct_sparse_99pct_null/default 1.00 6.1±0.03ms 2.6 GB/sec 1.01 6.1±0.05ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.03ms 2.6 GB/sec 1.00 6.1±0.04ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.03ms 2.1 GB/sec 1.00 7.5±0.05ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.9±0.03ms 2.3 GB/sec 1.00 6.9±0.09ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1890.7s | | CPU sys | 34.1s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2085.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2043.7s | | CPU sys | 38.0s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
