adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4462707623
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4462063096) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.00 13.0±0.03ms 19.2 MB/sec 1.02 13.3±0.09ms 18.8 MB/sec bool/cdc 1.00 15.9±0.04ms 15.7 MB/sec 1.02 16.2±0.12ms 15.4 MB/sec bool/default 1.00 10.9±0.04ms 22.9 MB/sec 1.02 11.1±0.08ms 22.5 MB/sec bool/parquet_2 1.00 14.7±0.03ms 17.0 MB/sec 1.01 14.9±0.09ms 16.8 MB/sec bool/zstd 1.00 11.4±0.04ms 21.9 MB/sec 1.02 11.6±0.08ms 21.5 MB/sec bool/zstd_parquet_2 1.00 15.1±0.04ms 16.5 MB/sec 1.01 15.3±0.09ms 16.4 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.01 7.1±0.03ms 17.6 MB/sec bool_non_null/cdc 1.00 6.9±0.03ms 18.3 MB/sec 1.02 7.0±0.03ms 17.9 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.02 4.4±0.02ms 28.7 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.02 9.2±0.04ms 13.7 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 26.9 MB/sec 1.01 4.7±0.02ms 26.6 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.02ms 13.3 MB/sec 1.02 9.6±0.03ms 13.1 MB/sec float_with_nans/bloom_filter 1.01 94.3±0.27ms 148.4 MB/sec 1.00 93.2±0.37ms 150.2 MB/sec float_with_nans/cdc 1.00 82.7±0.28ms 169.4 MB/sec 1.00 82.6±0.42ms 169.4 MB/sec float_with_nans/default 1.00 75.3±0.31ms 185.8 MB/sec 1.00 75.1±0.59ms 186.3 MB/sec float_with_nans/parquet_2 1.02 96.9±0.38ms 144.5 MB/sec 1.00 95.4±0.35ms 146.7 MB/sec float_with_nans/zstd 1.00 113.0±0.39ms 123.9 MB/sec 1.00 112.8±0.49ms 124.2 MB/sec float_with_nans/zstd_parquet_2 1.00 133.5±0.47ms 104.9 MB/sec 1.00 132.9±0.45ms 105.3 MB/sec large_string_non_null/bloom_filter 1.00 81.1±0.28ms 3.1 GB/sec large_string_non_null/cdc 1.00 242.3±1.18ms 1056.4 MB/sec large_string_non_null/default 1.00 62.2±0.55ms 4.0 GB/sec large_string_non_null/parquet_2 1.00 61.7±0.28ms 4.1 GB/sec large_string_non_null/zstd 1.00 61.8±0.73ms 4.0 GB/sec large_string_non_null/zstd_parquet_2 1.00 61.9±0.28ms 4.0 GB/sec list_primitive/bloom_filter 1.00 335.9±1.28ms 1623.8 MB/sec 1.10 368.3±7.59ms 1480.9 MB/sec list_primitive/cdc 1.00 363.5±2.32ms 1500.5 MB/sec 1.03 374.9±5.77ms 1454.6 MB/sec list_primitive/default 1.00 256.5±2.35ms 2.1 GB/sec 1.08 277.5±1.41ms 1965.1 MB/sec list_primitive/parquet_2 1.00 275.8±0.65ms 1977.1 MB/sec 1.06 293.3±1.40ms 1859.4 MB/sec list_primitive/zstd 1.00 505.5±4.20ms 1078.9 MB/sec 1.01 510.3±1.79ms 1068.8 MB/sec list_primitive/zstd_parquet_2 1.00 498.5±0.66ms 1093.9 MB/sec 1.00 498.6±0.48ms 1093.8 MB/sec list_primitive_non_null/bloom_filter 1.00 423.6±4.93ms 1284.8 MB/sec 1.07 455.0±13.51ms 1196.2 MB/sec list_primitive_non_null/cdc 1.00 438.0±9.13ms 1242.4 MB/sec 1.01 440.9±6.79ms 1234.3 MB/sec list_primitive_non_null/default 1.00 291.0±3.93ms 1870.0 MB/sec 1.07 311.8±12.63ms 1745.2 MB/sec list_primitive_non_null/parquet_2 1.00 319.9±2.17ms 1701.4 MB/sec 1.08 346.6±3.29ms 1570.1 MB/sec list_primitive_non_null/zstd 1.00 713.7±9.28ms 762.6 MB/sec 1.01 719.0±19.80ms 757.0 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 685.3±0.92ms 794.2 MB/sec 1.00 670.7±0.81ms 811.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.8±0.09ms 3.1 GB/sec 1.00 11.8±0.05ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.2±0.07ms 1611.4 MB/sec 1.01 23.5±0.06ms 1591.1 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.3±0.10ms 3.2 GB/sec 1.02 11.5±0.04ms 3.2 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.4±0.05ms 3.2 GB/sec 1.00 11.4±0.05ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.3±0.07ms 2.8 GB/sec 1.00 13.3±0.04ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.6±0.08ms 3.2 GB/sec 1.00 11.6±0.06ms 3.1 GB/sec primitive/bloom_filter 1.01 152.8±0.44ms 293.6 MB/sec 1.00 151.3±0.79ms 296.5 MB/sec primitive/cdc 1.00 160.3±0.51ms 280.0 MB/sec 1.01 161.6±0.78ms 277.7 MB/sec primitive/default 1.00 119.3±0.27ms 376.2 MB/sec 1.00 119.8±0.45ms 374.6 MB/sec primitive/parquet_2 1.00 134.3±0.29ms 334.2 MB/sec 1.01 135.2±0.50ms 331.9 MB/sec primitive/zstd 1.00 149.1±0.28ms 301.0 MB/sec 1.00 149.7±0.44ms 299.8 MB/sec primitive/zstd_parquet_2 1.00 168.0±0.64ms 267.1 MB/sec 1.00 168.6±0.53ms 266.2 MB/sec primitive_all_null/bloom_filter 1.00 878.7±3.48µs 49.9 GB/sec 1.03 907.5±5.57µs 48.3 GB/sec primitive_all_null/cdc 1.00 17.8±0.24ms 2.5 GB/sec 1.04 18.5±0.28ms 2.4 GB/sec primitive_all_null/default 1.00 258.8±0.66µs 169.3 GB/sec 1.06 274.5±2.12µs 159.6 GB/sec primitive_all_null/parquet_2 1.00 256.8±1.05µs 170.7 GB/sec 1.09 278.9±1.73µs 157.1 GB/sec primitive_all_null/zstd 1.00 371.8±0.47µs 117.9 GB/sec 1.04 388.1±1.86µs 112.9 GB/sec primitive_all_null/zstd_parquet_2 1.00 333.6±1.05µs 131.4 GB/sec 1.07 357.1±1.71µs 122.7 GB/sec primitive_non_null/bloom_filter 1.01 111.3±0.39ms 395.3 MB/sec 1.00 109.8±0.33ms 400.6 MB/sec primitive_non_null/cdc 1.00 91.8±0.33ms 479.1 MB/sec 1.00 91.7±0.49ms 479.6 MB/sec primitive_non_null/default 1.00 69.2±0.34ms 636.3 MB/sec 1.00 69.1±0.25ms 636.5 MB/sec primitive_non_null/parquet_2 1.00 91.0±0.24ms 483.7 MB/sec 1.00 90.7±0.19ms 485.4 MB/sec primitive_non_null/zstd 1.07 106.9±1.04ms 411.7 MB/sec 1.00 99.9±0.34ms 440.7 MB/sec primitive_non_null/zstd_parquet_2 1.05 130.7±2.68ms 336.6 MB/sec 1.00 124.3±0.20ms 354.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.7±0.18ms 2.3 GB/sec 1.03 19.3±0.11ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 35.5±0.21ms 1265.0 MB/sec 1.02 36.3±0.29ms 1237.5 MB/sec primitive_sparse_99pct_null/default 1.00 17.1±0.09ms 2.6 GB/sec 1.01 17.3±0.03ms 2.5 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.9±0.08ms 2.6 GB/sec 1.02 17.3±0.04ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.3±0.07ms 2.2 GB/sec 1.02 20.6±0.04ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 19.0±0.09ms 2.3 GB/sec 1.01 19.2±0.03ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 27.0±0.08ms 444.7 MB/sec short_string_non_null/cdc 1.00 20.2±0.08ms 594.7 MB/sec short_string_non_null/default 1.00 16.0±0.05ms 750.9 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.06ms 467.2 MB/sec short_string_non_null/zstd 1.00 35.5±0.11ms 338.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.4±0.06ms 422.6 MB/sec string/bloom_filter 1.01 222.2±19.41ms 2.3 GB/sec 1.00 220.1±15.51ms 2.3 GB/sec string/cdc 1.02 225.3±4.59ms 2.3 GB/sec 1.00 221.8±9.16ms 2.3 GB/sec string/default 1.02 126.6±19.36ms 4.0 GB/sec 1.00 124.5±7.73ms 4.1 GB/sec string/parquet_2 1.00 112.7±6.60ms 4.5 GB/sec 1.13 126.9±1.67ms 4.0 GB/sec string/zstd 1.00 420.8±2.11ms 1245.9 MB/sec 1.06 447.6±19.90ms 1171.2 MB/sec string/zstd_parquet_2 1.00 404.0±6.73ms 1297.6 MB/sec 1.00 405.4±5.28ms 1293.0 MB/sec string_and_binary_view/bloom_filter 1.00 66.5±0.31ms 485.0 MB/sec 1.00 66.7±0.35ms 483.7 MB/sec string_and_binary_view/cdc 1.00 59.3±0.20ms 543.9 MB/sec 1.04 61.8±0.33ms 521.9 MB/sec string_and_binary_view/default 1.00 48.9±0.22ms 659.8 MB/sec 1.04 50.9±0.29ms 633.9 MB/sec string_and_binary_view/parquet_2 1.00 59.9±0.35ms 538.0 MB/sec 1.03 61.7±0.31ms 522.9 MB/sec string_and_binary_view/zstd 1.00 85.4±0.20ms 377.5 MB/sec 1.02 87.5±0.29ms 368.6 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.7±0.27ms 437.7 MB/sec 1.02 75.5±0.31ms 427.3 MB/sec string_dictionary/bloom_filter 1.01 95.4±0.94ms 2.7 GB/sec 1.00 94.3±0.65ms 2.7 GB/sec string_dictionary/cdc 1.00 51.7±0.29ms 5.0 GB/sec 1.07 55.3±0.75ms 4.7 GB/sec string_dictionary/default 1.00 48.8±1.60ms 5.3 GB/sec 1.05 51.4±0.64ms 5.0 GB/sec string_dictionary/parquet_2 1.00 55.0±0.28ms 4.7 GB/sec 1.00 54.9±0.24ms 4.7 GB/sec string_dictionary/zstd 1.00 209.7±2.02ms 1259.5 MB/sec 1.01 212.3±1.02ms 1244.1 MB/sec string_dictionary/zstd_parquet_2 1.00 199.8±0.29ms 1322.0 MB/sec 1.00 199.7±0.25ms 1322.5 MB/sec string_non_null/bloom_filter 1.02 263.5±12.50ms 1988.3 MB/sec 1.00 257.1±13.04ms 2037.9 MB/sec string_non_null/cdc 1.00 279.7±10.50ms 1873.6 MB/sec 1.00 279.6±12.81ms 1873.9 MB/sec string_non_null/default 1.00 144.8±12.98ms 3.5 GB/sec 1.01 146.0±9.40ms 3.5 GB/sec string_non_null/parquet_2 1.17 152.9±3.06ms 3.3 GB/sec 1.00 130.3±3.72ms 3.9 GB/sec string_non_null/zstd 1.06 570.9±5.62ms 917.9 MB/sec 1.00 539.6±3.16ms 971.1 MB/sec string_non_null/zstd_parquet_2 1.01 518.4±4.55ms 1010.8 MB/sec 1.00 512.6±10.97ms 1022.2 MB/sec struct_all_null/bloom_filter 1.00 366.6±1.33µs 43.0 GB/sec 1.04 380.0±4.19µs 41.4 GB/sec struct_all_null/cdc 1.00 7.1±0.07ms 2.2 GB/sec 1.04 7.4±0.12ms 2.1 GB/sec struct_all_null/default 1.00 113.4±0.21µs 138.9 GB/sec 1.06 119.7±0.97µs 131.6 GB/sec struct_all_null/parquet_2 1.00 111.8±0.45µs 140.8 GB/sec 1.08 120.8±0.94µs 130.4 GB/sec struct_all_null/zstd 1.00 158.7±0.94µs 99.2 GB/sec 1.06 168.0±0.87µs 93.7 GB/sec struct_all_null/zstd_parquet_2 1.00 144.3±0.43µs 109.1 GB/sec 1.08 156.3±0.92µs 100.8 GB/sec struct_non_null/bloom_filter 1.00 46.2±0.24ms 346.2 MB/sec 1.01 46.9±1.06ms 341.4 MB/sec struct_non_null/cdc 1.00 45.4±0.14ms 352.6 MB/sec 1.01 45.7±0.17ms 350.2 MB/sec struct_non_null/default 1.00 32.2±0.16ms 497.3 MB/sec 1.00 32.3±0.15ms 494.8 MB/sec struct_non_null/parquet_2 1.00 40.8±0.15ms 392.0 MB/sec 1.01 41.0±0.17ms 389.9 MB/sec struct_non_null/zstd 1.00 40.8±0.09ms 392.6 MB/sec 1.00 40.9±0.14ms 391.4 MB/sec struct_non_null/zstd_parquet_2 1.00 54.8±0.13ms 291.9 MB/sec 1.00 55.0±0.15ms 290.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.10ms 2.4 GB/sec 1.04 6.9±0.06ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.11ms 1195.6 MB/sec 1.02 13.7±0.10ms 1172.8 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.05ms 2.6 GB/sec 1.02 6.1±0.05ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.06ms 2.6 GB/sec 1.03 6.2±0.05ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.05ms 2.1 GB/sec 1.02 7.5±0.04ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.9±0.05ms 2.3 GB/sec 1.03 7.0±0.03ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1945.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1891.6s | | CPU sys | 53.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2095.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2037.1s | | CPU sys | 58.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
