adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4469628053
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4469479264) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.0±0.05ms 19.2 MB/sec 1.00 12.9±0.03ms 19.3 MB/sec bool/cdc 1.01 15.7±0.05ms 15.9 MB/sec 1.00 15.7±0.04ms 16.0 MB/sec bool/default 1.00 10.9±0.03ms 23.0 MB/sec 1.00 10.8±0.03ms 23.1 MB/sec bool/parquet_2 1.01 14.7±0.03ms 17.0 MB/sec 1.00 14.6±0.03ms 17.1 MB/sec bool/zstd 1.01 11.4±0.03ms 21.9 MB/sec 1.00 11.3±0.02ms 22.0 MB/sec bool/zstd_parquet_2 1.01 15.1±0.03ms 16.6 MB/sec 1.00 15.0±0.03ms 16.7 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.9 MB/sec 1.01 7.1±0.03ms 17.7 MB/sec bool_non_null/cdc 1.00 6.8±0.03ms 18.5 MB/sec 1.01 6.9±0.09ms 18.2 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.4 MB/sec 1.02 4.3±0.02ms 28.9 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.00 9.0±0.03ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.02 4.7±0.02ms 26.7 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.3 MB/sec 1.00 9.5±0.03ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 92.8±0.28ms 150.9 MB/sec 1.01 94.0±0.35ms 148.9 MB/sec float_with_nans/cdc 1.00 81.5±0.16ms 171.7 MB/sec 1.00 81.9±0.17ms 171.0 MB/sec float_with_nans/default 1.00 74.1±0.21ms 188.9 MB/sec 1.00 74.5±0.24ms 188.0 MB/sec float_with_nans/parquet_2 1.00 94.3±0.37ms 148.5 MB/sec 1.01 95.1±0.22ms 147.2 MB/sec float_with_nans/zstd 1.00 111.7±0.22ms 125.3 MB/sec 1.00 112.2±0.25ms 124.8 MB/sec float_with_nans/zstd_parquet_2 1.00 131.3±0.32ms 106.6 MB/sec 1.01 133.0±0.42ms 105.3 MB/sec large_string_non_null/bloom_filter 1.00 72.9±0.12ms 3.4 GB/sec large_string_non_null/cdc 1.00 243.1±1.08ms 1053.1 MB/sec large_string_non_null/default 1.00 55.3±0.08ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.4±0.11ms 4.5 GB/sec large_string_non_null/zstd 1.00 55.4±0.08ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.4±0.10ms 4.5 GB/sec list_primitive/bloom_filter 1.00 328.2±1.31ms 1661.6 MB/sec 1.01 330.9±1.24ms 1648.3 MB/sec list_primitive/cdc 1.00 361.9±2.27ms 1506.9 MB/sec 1.01 365.1±0.81ms 1493.7 MB/sec list_primitive/default 1.00 252.1±1.42ms 2.1 GB/sec 1.02 257.0±1.39ms 2.1 GB/sec list_primitive/parquet_2 1.00 273.9±0.65ms 1991.1 MB/sec 1.01 277.1±0.92ms 1968.1 MB/sec list_primitive/zstd 1.00 503.0±1.60ms 1084.2 MB/sec 1.00 504.9±1.60ms 1080.1 MB/sec list_primitive/zstd_parquet_2 1.00 498.2±1.53ms 1094.7 MB/sec 1.00 499.5±0.79ms 1091.7 MB/sec list_primitive_non_null/bloom_filter 1.04 419.1±8.64ms 1298.6 MB/sec 1.00 402.5±3.81ms 1352.3 MB/sec list_primitive_non_null/cdc 1.00 430.1±7.35ms 1265.4 MB/sec 1.02 436.6±7.42ms 1246.6 MB/sec list_primitive_non_null/default 1.04 281.6±3.79ms 1932.7 MB/sec 1.00 270.9±3.67ms 2009.2 MB/sec list_primitive_non_null/parquet_2 1.04 316.0±0.50ms 1722.1 MB/sec 1.00 305.2±0.66ms 1783.1 MB/sec list_primitive_non_null/zstd 1.01 701.6±7.51ms 775.8 MB/sec 1.00 692.5±3.82ms 785.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 682.2±1.59ms 797.7 MB/sec 1.00 669.2±0.52ms 813.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.01 11.5±0.07ms 3.2 GB/sec 1.00 11.4±0.04ms 3.2 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.7±0.10ms 1649.3 MB/sec 1.02 23.1±0.09ms 1614.3 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.1±0.03ms 3.3 GB/sec 1.00 11.1±0.04ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.06ms 3.3 GB/sec 1.00 11.1±0.04ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.9±0.05ms 2.8 GB/sec 1.00 12.9±0.05ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.2±0.04ms 3.3 GB/sec 1.00 11.2±0.03ms 3.3 GB/sec primitive/bloom_filter 1.00 148.5±0.47ms 302.1 MB/sec 1.01 149.3±0.47ms 300.6 MB/sec primitive/cdc 1.00 157.2±0.51ms 285.5 MB/sec 1.01 158.7±0.38ms 282.8 MB/sec primitive/default 1.00 117.1±0.24ms 383.1 MB/sec 1.00 117.3±0.20ms 382.7 MB/sec primitive/parquet_2 1.00 131.8±0.22ms 340.4 MB/sec 1.00 132.0±0.25ms 339.9 MB/sec primitive/zstd 1.00 146.9±0.30ms 305.6 MB/sec 1.00 146.7±0.27ms 305.9 MB/sec primitive/zstd_parquet_2 1.00 165.3±0.28ms 271.5 MB/sec 1.00 165.5±0.22ms 271.2 MB/sec primitive_all_null/bloom_filter 1.00 873.4±2.42µs 50.2 GB/sec 1.03 902.8±1.72µs 48.5 GB/sec primitive_all_null/cdc 1.00 17.8±0.25ms 2.5 GB/sec 1.05 18.7±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 259.3±0.58µs 169.0 GB/sec 1.06 274.4±0.79µs 159.7 GB/sec primitive_all_null/parquet_2 1.00 257.2±1.09µs 170.4 GB/sec 1.08 278.9±1.05µs 157.1 GB/sec primitive_all_null/zstd 1.00 372.3±0.80µs 117.7 GB/sec 1.04 388.5±1.00µs 112.8 GB/sec primitive_all_null/zstd_parquet_2 1.00 334.2±1.09µs 131.1 GB/sec 1.07 356.6±1.08µs 122.9 GB/sec primitive_non_null/bloom_filter 1.00 105.8±0.29ms 415.7 MB/sec 1.02 108.1±0.35ms 407.1 MB/sec primitive_non_null/cdc 1.00 89.8±0.31ms 489.9 MB/sec 1.01 90.5±0.54ms 486.2 MB/sec primitive_non_null/default 1.00 67.1±0.24ms 656.1 MB/sec 1.01 67.7±0.18ms 649.8 MB/sec primitive_non_null/parquet_2 1.00 88.7±0.21ms 496.3 MB/sec 1.01 89.5±0.36ms 491.5 MB/sec primitive_non_null/zstd 1.05 103.7±0.93ms 424.3 MB/sec 1.00 98.4±0.33ms 447.3 MB/sec primitive_non_null/zstd_parquet_2 1.04 127.8±2.35ms 344.3 MB/sec 1.00 123.0±0.24ms 357.6 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.0±0.13ms 2.4 GB/sec 1.01 18.2±0.14ms 2.4 GB/sec primitive_sparse_99pct_null/cdc 1.00 34.9±0.25ms 1286.2 MB/sec 1.06 37.0±0.37ms 1212.0 MB/sec primitive_sparse_99pct_null/default 1.00 16.7±0.05ms 2.6 GB/sec 1.01 16.8±0.05ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.06ms 2.6 GB/sec 1.01 16.8±0.06ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 19.9±0.07ms 2.2 GB/sec 1.01 20.1±0.09ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.6±0.05ms 2.4 GB/sec 1.01 18.8±0.08ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 27.7±0.09ms 432.9 MB/sec short_string_non_null/cdc 1.00 19.9±0.06ms 603.1 MB/sec short_string_non_null/default 1.00 15.8±0.04ms 760.8 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.10ms 466.0 MB/sec short_string_non_null/zstd 1.00 35.4±0.06ms 339.3 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.05ms 420.7 MB/sec string/bloom_filter 1.00 214.9±19.20ms 2.4 GB/sec 1.01 217.1±13.59ms 2.4 GB/sec string/cdc 1.00 219.2±4.40ms 2.3 GB/sec 1.00 218.6±7.67ms 2.3 GB/sec string/default 1.01 123.8±19.39ms 4.1 GB/sec 1.00 122.7±7.41ms 4.2 GB/sec string/parquet_2 1.00 111.0±6.22ms 4.6 GB/sec 1.14 126.4±0.42ms 4.0 GB/sec string/zstd 1.00 414.9±1.75ms 1263.6 MB/sec 1.08 447.6±16.53ms 1171.4 MB/sec string/zstd_parquet_2 1.00 401.3±6.52ms 1306.3 MB/sec 1.01 407.2±10.83ms 1287.6 MB/sec string_and_binary_view/bloom_filter 1.00 63.3±0.31ms 509.1 MB/sec 1.08 68.5±0.33ms 471.1 MB/sec string_and_binary_view/cdc 1.00 57.9±0.15ms 557.3 MB/sec 1.07 62.0±0.20ms 520.3 MB/sec string_and_binary_view/default 1.00 47.5±0.11ms 679.4 MB/sec 1.08 51.5±0.18ms 626.5 MB/sec string_and_binary_view/parquet_2 1.00 58.7±0.17ms 549.5 MB/sec 1.06 62.3±0.15ms 517.5 MB/sec string_and_binary_view/zstd 1.00 84.1±0.10ms 383.4 MB/sec 1.05 88.2±0.15ms 365.7 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.3±0.14ms 446.1 MB/sec 1.05 76.2±0.18ms 423.3 MB/sec string_dictionary/bloom_filter 1.00 90.2±0.73ms 2.9 GB/sec 1.06 95.4±0.37ms 2.7 GB/sec string_dictionary/cdc 1.00 52.3±1.13ms 4.9 GB/sec 1.04 54.6±0.51ms 4.7 GB/sec string_dictionary/default 1.00 46.8±1.18ms 5.5 GB/sec 1.07 50.3±0.44ms 5.1 GB/sec string_dictionary/parquet_2 1.00 53.7±0.14ms 4.8 GB/sec 1.02 54.5±0.45ms 4.7 GB/sec string_dictionary/zstd 1.00 208.2±0.51ms 1268.4 MB/sec 1.01 210.9±0.32ms 1252.2 MB/sec string_dictionary/zstd_parquet_2 1.00 198.1±0.27ms 1333.3 MB/sec 1.01 199.2±0.60ms 1326.2 MB/sec string_non_null/bloom_filter 1.00 249.8±11.24ms 2.0 GB/sec 1.03 256.8±12.48ms 2040.7 MB/sec string_non_null/cdc 1.00 271.4±8.71ms 1930.6 MB/sec 1.03 278.6±9.48ms 1880.9 MB/sec string_non_null/default 1.01 140.1±10.26ms 3.7 GB/sec 1.00 138.7±12.54ms 3.7 GB/sec string_non_null/parquet_2 1.00 136.3±8.49ms 3.8 GB/sec 1.07 145.7±9.24ms 3.5 GB/sec string_non_null/zstd 1.01 556.0±3.82ms 942.4 MB/sec 1.00 550.9±3.23ms 951.2 MB/sec string_non_null/zstd_parquet_2 1.02 515.7±3.65ms 1016.1 MB/sec 1.00 504.8±0.38ms 1038.1 MB/sec struct_all_null/bloom_filter 1.00 368.9±1.02µs 42.7 GB/sec 1.02 376.3±1.41µs 41.9 GB/sec struct_all_null/cdc 1.00 7.1±0.08ms 2.2 GB/sec 1.06 7.6±0.08ms 2.1 GB/sec struct_all_null/default 1.00 113.2±0.24µs 139.1 GB/sec 1.05 119.3±0.32µs 132.0 GB/sec struct_all_null/parquet_2 1.00 112.0±0.39µs 140.6 GB/sec 1.08 121.1±0.58µs 130.1 GB/sec struct_all_null/zstd 1.00 160.1±0.36µs 98.4 GB/sec 1.04 166.8±0.68µs 94.4 GB/sec struct_all_null/zstd_parquet_2 1.00 143.8±0.60µs 109.5 GB/sec 1.07 154.1±0.41µs 102.2 GB/sec struct_non_null/bloom_filter 1.00 45.5±0.15ms 351.7 MB/sec 1.01 46.0±0.19ms 347.5 MB/sec struct_non_null/cdc 1.00 45.1±0.17ms 354.6 MB/sec 1.01 45.4±0.13ms 352.3 MB/sec struct_non_null/default 1.00 31.8±0.12ms 503.3 MB/sec 1.00 31.9±0.09ms 501.4 MB/sec struct_non_null/parquet_2 1.00 40.7±0.12ms 393.2 MB/sec 1.00 40.8±0.12ms 392.1 MB/sec struct_non_null/zstd 1.00 40.8±0.16ms 392.5 MB/sec 1.00 40.7±0.09ms 393.0 MB/sec struct_non_null/zstd_parquet_2 1.00 54.9±0.24ms 291.5 MB/sec 1.00 54.8±0.15ms 292.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.4±0.03ms 2.5 GB/sec 1.01 6.4±0.04ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.1±0.08ms 1230.1 MB/sec 1.09 14.3±0.07ms 1124.8 MB/sec struct_sparse_99pct_null/default 1.00 5.9±0.02ms 2.7 GB/sec 1.01 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.00 5.9±0.02ms 2.7 GB/sec 1.01 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.00 7.2±0.02ms 2.2 GB/sec 1.01 7.3±0.03ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.6±0.03ms 2.4 GB/sec 1.01 6.7±0.02ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1930.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1878.7s | | CPU sys | 49.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2065.4s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2020.1s | | CPU sys | 41.8s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
