adriangbot commented on PR #9955: URL: https://github.com/apache/arrow-rs/pull/9955#issuecomment-4502962677
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9955#issuecomment-4502500677) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group generalize_value_enc_inputs main ----- --------------------------- ---- bool/bloom_filter 1.00 13.0±0.05ms 19.2 MB/sec 1.00 13.1±0.07ms 19.2 MB/sec bool/cdc 1.01 15.8±0.28ms 15.8 MB/sec 1.00 15.7±0.09ms 16.0 MB/sec bool/default 1.00 10.9±0.03ms 23.0 MB/sec 1.00 10.9±0.07ms 22.9 MB/sec bool/parquet_2 1.00 14.8±0.04ms 16.9 MB/sec 1.00 14.8±0.08ms 16.9 MB/sec bool/zstd 1.00 11.4±0.04ms 21.9 MB/sec 1.00 11.5±0.07ms 21.8 MB/sec bool/zstd_parquet_2 1.00 15.1±0.04ms 16.5 MB/sec 1.00 15.2±0.08ms 16.4 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.03ms 17.8 MB/sec 1.00 7.0±0.02ms 17.8 MB/sec bool_non_null/cdc 1.02 6.9±0.03ms 18.1 MB/sec 1.00 6.8±0.03ms 18.4 MB/sec bool_non_null/default 1.00 4.3±0.02ms 29.3 MB/sec 1.00 4.3±0.02ms 29.3 MB/sec bool_non_null/parquet_2 1.00 9.1±0.03ms 13.8 MB/sec 1.01 9.1±0.03ms 13.7 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.1 MB/sec 1.00 4.6±0.02ms 27.2 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.01 9.6±0.03ms 13.1 MB/sec float_with_nans/bloom_filter 1.01 93.6±0.25ms 149.5 MB/sec 1.00 92.8±0.41ms 150.8 MB/sec float_with_nans/cdc 1.00 81.4±0.17ms 172.0 MB/sec 1.00 81.4±0.17ms 172.0 MB/sec float_with_nans/default 1.00 74.4±0.16ms 188.3 MB/sec 1.00 74.2±0.22ms 188.6 MB/sec float_with_nans/parquet_2 1.00 94.5±0.28ms 148.2 MB/sec 1.00 94.3±0.37ms 148.5 MB/sec float_with_nans/zstd 1.00 112.0±0.18ms 125.0 MB/sec 1.00 111.9±0.20ms 125.2 MB/sec float_with_nans/zstd_parquet_2 1.01 132.5±0.53ms 105.6 MB/sec 1.00 131.4±0.38ms 106.6 MB/sec list_primitive/bloom_filter 1.00 324.3±0.97ms 1681.5 MB/sec 1.00 324.7±1.08ms 1679.5 MB/sec list_primitive/cdc 1.00 357.1±1.46ms 1527.2 MB/sec 1.00 357.7±0.77ms 1524.7 MB/sec list_primitive/default 1.01 247.6±0.79ms 2.2 GB/sec 1.00 246.3±0.42ms 2.2 GB/sec list_primitive/parquet_2 1.00 267.9±0.45ms 2035.9 MB/sec 1.00 267.6±0.36ms 2037.8 MB/sec list_primitive/zstd 1.00 497.0±2.02ms 1097.4 MB/sec 1.00 496.2±0.42ms 1099.2 MB/sec list_primitive/zstd_parquet_2 1.00 491.3±0.41ms 1110.1 MB/sec 1.00 490.9±0.43ms 1110.9 MB/sec list_primitive_non_null/bloom_filter 1.00 418.0±3.08ms 1302.0 MB/sec 1.01 422.0±15.16ms 1289.7 MB/sec list_primitive_non_null/cdc 1.00 437.8±8.45ms 1243.2 MB/sec 1.00 439.5±7.90ms 1238.2 MB/sec list_primitive_non_null/default 1.00 290.3±4.78ms 1874.8 MB/sec 1.00 290.1±2.97ms 1876.1 MB/sec list_primitive_non_null/parquet_2 1.05 324.3±0.70ms 1678.1 MB/sec 1.00 310.2±13.54ms 1754.7 MB/sec list_primitive_non_null/zstd 1.00 703.2±10.82ms 774.0 MB/sec 1.01 713.6±4.22ms 762.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 687.3±3.34ms 791.9 MB/sec 1.00 687.3±26.83ms 791.8 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.4±0.04ms 3.2 GB/sec 1.05 11.9±0.25ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.9±0.09ms 1631.2 MB/sec 1.02 23.5±0.12ms 1591.9 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.0±0.04ms 3.3 GB/sec 1.00 11.1±0.05ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.04ms 3.3 GB/sec 1.02 11.3±0.07ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.9±0.04ms 2.8 GB/sec 1.02 13.1±0.08ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.2±0.04ms 3.3 GB/sec 1.03 11.5±0.07ms 3.2 GB/sec primitive/bloom_filter 1.00 151.9±0.51ms 295.3 MB/sec 1.00 152.2±0.72ms 294.9 MB/sec primitive/cdc 1.00 160.2±0.43ms 280.2 MB/sec 1.00 160.2±0.79ms 280.2 MB/sec primitive/default 1.01 119.7±0.63ms 375.0 MB/sec 1.00 119.0±0.49ms 377.1 MB/sec primitive/parquet_2 1.00 134.4±0.83ms 334.0 MB/sec 1.00 133.9±0.61ms 335.1 MB/sec primitive/zstd 1.00 148.7±0.31ms 301.7 MB/sec 1.00 148.6±0.59ms 302.0 MB/sec primitive/zstd_parquet_2 1.00 167.5±0.27ms 267.9 MB/sec 1.00 167.2±0.52ms 268.4 MB/sec primitive_all_null/bloom_filter 1.00 11.6±0.32ms 3.8 GB/sec 1.01 11.8±0.24ms 3.7 GB/sec primitive_all_null/cdc 1.06 30.6±0.47ms 1466.1 MB/sec 1.00 28.9±0.38ms 1551.7 MB/sec primitive_all_null/default 1.00 10.9±0.12ms 4.0 GB/sec 1.00 10.9±0.12ms 4.0 GB/sec primitive_all_null/parquet_2 1.00 10.9±0.23ms 4.0 GB/sec 1.01 11.0±0.29ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.1±0.26ms 3.9 GB/sec 1.00 11.1±0.19ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.1±0.25ms 4.0 GB/sec 1.01 11.1±0.24ms 3.9 GB/sec primitive_non_null/bloom_filter 1.00 109.4±0.64ms 402.3 MB/sec 1.05 115.4±1.38ms 381.4 MB/sec primitive_non_null/cdc 1.01 91.4±0.34ms 481.6 MB/sec 1.00 90.7±0.52ms 485.0 MB/sec primitive_non_null/default 1.01 68.8±0.70ms 639.1 MB/sec 1.00 67.9±0.25ms 647.6 MB/sec primitive_non_null/parquet_2 1.01 90.6±0.27ms 485.6 MB/sec 1.00 89.9±0.38ms 489.4 MB/sec primitive_non_null/zstd 1.01 106.8±0.26ms 411.9 MB/sec 1.00 105.8±0.33ms 416.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 124.8±0.93ms 352.5 MB/sec 1.05 130.8±1.87ms 336.4 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 18.4±0.13ms 2.4 GB/sec 1.00 18.2±0.10ms 2.4 GB/sec primitive_sparse_99pct_null/cdc 1.03 37.2±0.34ms 1205.7 MB/sec 1.00 36.1±0.38ms 1243.9 MB/sec primitive_sparse_99pct_null/default 1.00 16.8±0.06ms 2.6 GB/sec 1.00 16.7±0.06ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.8±0.07ms 2.6 GB/sec 1.00 16.8±0.08ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.01 20.3±0.08ms 2.2 GB/sec 1.00 20.2±0.13ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.7±0.08ms 2.3 GB/sec 1.02 19.1±0.17ms 2.3 GB/sec string/bloom_filter 1.00 216.5±3.12ms 2.4 GB/sec 1.09 236.4±27.55ms 2.2 GB/sec string/cdc 1.01 223.7±5.68ms 2.3 GB/sec 1.00 222.6±6.17ms 2.3 GB/sec string/default 1.00 123.3±1.82ms 4.2 GB/sec 1.21 149.4±28.02ms 3.4 GB/sec string/parquet_2 1.00 110.1±5.67ms 4.7 GB/sec 1.17 128.2±0.29ms 4.0 GB/sec string/zstd 1.00 425.1±2.86ms 1233.3 MB/sec 1.01 427.3±3.11ms 1226.9 MB/sec string/zstd_parquet_2 1.00 394.7±0.65ms 1328.1 MB/sec 1.00 395.4±0.45ms 1326.0 MB/sec string_and_binary_view/bloom_filter 1.01 65.1±0.25ms 495.6 MB/sec 1.00 64.6±0.29ms 499.0 MB/sec string_and_binary_view/cdc 1.00 59.3±0.22ms 543.9 MB/sec 1.00 59.2±0.20ms 544.3 MB/sec string_and_binary_view/default 1.01 48.9±3.29ms 659.7 MB/sec 1.00 48.3±0.15ms 667.2 MB/sec string_and_binary_view/parquet_2 1.00 59.5±0.21ms 541.8 MB/sec 1.00 59.2±0.16ms 544.5 MB/sec string_and_binary_view/zstd 1.00 85.0±0.21ms 379.2 MB/sec 1.00 84.9±0.17ms 380.0 MB/sec string_and_binary_view/zstd_parquet_2 1.01 73.6±0.22ms 438.3 MB/sec 1.00 73.1±0.21ms 441.4 MB/sec string_dictionary/bloom_filter 1.03 93.9±0.64ms 2.7 GB/sec 1.00 91.1±0.80ms 2.8 GB/sec string_dictionary/cdc 1.00 54.2±0.43ms 4.8 GB/sec 1.62 87.5±0.73ms 2.9 GB/sec string_dictionary/default 1.03 50.5±0.50ms 5.1 GB/sec 1.00 49.1±0.34ms 5.3 GB/sec string_dictionary/parquet_2 1.02 55.2±0.18ms 4.7 GB/sec 1.00 54.0±0.20ms 4.8 GB/sec string_dictionary/zstd 1.01 211.4±0.72ms 1249.7 MB/sec 1.00 209.9±0.74ms 1258.5 MB/sec string_dictionary/zstd_parquet_2 1.00 199.3±0.81ms 1325.3 MB/sec 1.00 198.5±0.22ms 1330.4 MB/sec string_non_null/bloom_filter 1.00 259.0±13.15ms 2023.4 MB/sec 1.01 261.6±17.07ms 2002.7 MB/sec string_non_null/cdc 1.02 274.7±11.75ms 1907.9 MB/sec 1.00 270.4±9.94ms 1937.7 MB/sec string_non_null/default 1.05 137.1±13.14ms 3.7 GB/sec 1.00 131.2±14.35ms 3.9 GB/sec string_non_null/parquet_2 1.00 137.5±0.51ms 3.7 GB/sec 1.04 143.5±12.90ms 3.6 GB/sec string_non_null/zstd 1.07 568.5±7.90ms 921.8 MB/sec 1.00 532.6±1.69ms 983.9 MB/sec string_non_null/zstd_parquet_2 1.02 518.2±5.91ms 1011.3 MB/sec 1.00 508.2±2.34ms 1031.1 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.2 GB/sec 1.00 2.5±0.00ms 6.2 GB/sec struct_all_null/cdc 1.00 9.9±0.13ms 1628.0 MB/sec 1.04 10.3±0.57ms 1571.7 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.00 2.3±0.00ms 6.8 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 46.5±0.17ms 344.1 MB/sec 1.01 47.2±0.39ms 339.1 MB/sec struct_non_null/cdc 1.00 45.5±0.16ms 351.5 MB/sec 1.01 46.0±1.08ms 347.8 MB/sec struct_non_null/default 1.00 32.3±0.11ms 495.5 MB/sec 1.00 32.4±0.22ms 494.1 MB/sec struct_non_null/parquet_2 1.00 41.0±0.13ms 390.1 MB/sec 1.00 41.0±0.13ms 390.0 MB/sec struct_non_null/zstd 1.00 41.0±0.12ms 390.1 MB/sec 1.00 41.0±0.22ms 390.2 MB/sec struct_non_null/zstd_parquet_2 1.00 55.0±0.14ms 290.7 MB/sec 1.00 55.0±0.14ms 290.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.4±0.03ms 2.1 GB/sec 1.06 7.8±0.09ms 2.0 GB/sec struct_sparse_99pct_null/cdc 1.04 15.3±0.10ms 1052.1 MB/sec 1.00 14.7±0.11ms 1098.7 MB/sec struct_sparse_99pct_null/default 1.00 6.9±0.02ms 2.3 GB/sec 1.03 7.1±0.05ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.02ms 2.3 GB/sec 1.04 7.2±0.05ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.00 8.2±0.02ms 1958.1 MB/sec 1.03 8.5±0.05ms 1897.3 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.02ms 2.1 GB/sec 1.03 7.9±0.06ms 2036.9 MB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1950.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1885.0s | | CPU sys | 61.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1940.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1888.0s | | CPU sys | 49.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
