adriangbot commented on PR #9955: URL: https://github.com/apache/arrow-rs/pull/9955#issuecomment-4502969430
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9955#issuecomment-4502500883) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group generalize_value_enc_inputs main ----- --------------------------- ---- bool/bloom_filter 1.00 13.0±0.03ms 19.3 MB/sec 1.00 12.9±0.03ms 19.3 MB/sec bool/cdc 1.00 15.6±0.04ms 16.1 MB/sec 1.00 15.5±0.04ms 16.1 MB/sec bool/default 1.00 10.9±0.03ms 23.0 MB/sec 1.00 10.9±0.03ms 23.0 MB/sec bool/parquet_2 1.00 14.7±0.04ms 17.0 MB/sec 1.00 14.7±0.03ms 17.0 MB/sec bool/zstd 1.00 11.4±0.02ms 22.0 MB/sec 1.00 11.4±0.03ms 21.9 MB/sec bool/zstd_parquet_2 1.00 15.1±0.03ms 16.6 MB/sec 1.00 15.1±0.03ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.8 MB/sec 1.00 7.0±0.02ms 17.8 MB/sec bool_non_null/cdc 1.00 6.8±0.02ms 18.4 MB/sec 1.00 6.8±0.03ms 18.4 MB/sec bool_non_null/default 1.00 4.2±0.02ms 29.4 MB/sec 1.00 4.2±0.02ms 29.5 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.01 9.1±0.04ms 13.7 MB/sec bool_non_null/zstd 1.00 4.6±0.02ms 27.2 MB/sec 1.00 4.6±0.02ms 27.2 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.01 9.5±0.04ms 13.1 MB/sec float_with_nans/bloom_filter 1.00 93.3±0.26ms 150.1 MB/sec 1.01 94.0±0.41ms 148.9 MB/sec float_with_nans/cdc 1.00 81.3±0.15ms 172.2 MB/sec 1.01 82.5±1.75ms 169.7 MB/sec float_with_nans/default 1.00 74.3±0.18ms 188.4 MB/sec 1.01 74.7±0.22ms 187.4 MB/sec float_with_nans/parquet_2 1.00 94.6±0.25ms 148.0 MB/sec 1.01 95.3±0.36ms 146.9 MB/sec float_with_nans/zstd 1.00 112.1±0.14ms 124.8 MB/sec 1.00 112.4±0.22ms 124.6 MB/sec float_with_nans/zstd_parquet_2 1.00 132.1±0.24ms 106.0 MB/sec 1.00 132.4±0.39ms 105.7 MB/sec list_primitive/bloom_filter 1.00 333.7±1.89ms 1634.5 MB/sec 1.00 332.0±4.91ms 1642.5 MB/sec list_primitive/cdc 1.01 362.0±2.13ms 1506.4 MB/sec 1.00 359.1±0.93ms 1518.9 MB/sec list_primitive/default 1.00 247.4±0.67ms 2.2 GB/sec 1.02 252.2±4.84ms 2.1 GB/sec list_primitive/parquet_2 1.00 269.0±0.57ms 2027.4 MB/sec 1.01 272.7±4.78ms 1999.7 MB/sec list_primitive/zstd 1.00 497.4±2.81ms 1096.5 MB/sec 1.01 503.1±4.89ms 1084.0 MB/sec list_primitive/zstd_parquet_2 1.00 492.9±0.42ms 1106.5 MB/sec 1.01 496.9±5.62ms 1097.6 MB/sec list_primitive_non_null/bloom_filter 1.01 429.4±8.01ms 1267.4 MB/sec 1.00 423.2±3.47ms 1286.0 MB/sec list_primitive_non_null/cdc 1.00 437.3±6.94ms 1244.5 MB/sec 1.01 441.2±7.33ms 1233.6 MB/sec list_primitive_non_null/default 1.04 298.5±7.30ms 1823.4 MB/sec 1.00 287.7±2.85ms 1891.9 MB/sec list_primitive_non_null/parquet_2 1.00 309.9±14.28ms 1756.1 MB/sec 1.00 308.8±12.70ms 1762.6 MB/sec list_primitive_non_null/zstd 1.01 722.9±9.81ms 752.8 MB/sec 1.00 715.9±3.88ms 760.2 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 701.9±2.31ms 775.4 MB/sec 1.00 686.2±1.64ms 793.1 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.4±0.03ms 3.2 GB/sec 1.01 11.5±0.22ms 3.2 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.0±0.04ms 1627.2 MB/sec 1.01 23.2±0.04ms 1610.5 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.1±0.02ms 3.3 GB/sec 1.01 11.2±0.07ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.02ms 3.3 GB/sec 1.01 11.2±0.07ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.9±0.02ms 2.8 GB/sec 1.01 13.1±0.08ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.2±0.02ms 3.3 GB/sec 1.01 11.3±0.07ms 3.2 GB/sec primitive/bloom_filter 1.00 150.5±0.34ms 298.2 MB/sec 1.00 150.1±0.32ms 298.9 MB/sec primitive/cdc 1.01 159.4±0.38ms 281.6 MB/sec 1.00 158.5±0.42ms 283.2 MB/sec primitive/default 1.00 118.3±0.23ms 379.4 MB/sec 1.00 118.1±0.24ms 380.1 MB/sec primitive/parquet_2 1.00 133.3±0.18ms 336.6 MB/sec 1.00 132.8±0.15ms 337.8 MB/sec primitive/zstd 1.00 147.9±0.17ms 303.5 MB/sec 1.00 147.4±0.18ms 304.5 MB/sec primitive/zstd_parquet_2 1.00 166.6±0.19ms 269.3 MB/sec 1.00 166.3±0.55ms 269.9 MB/sec primitive_all_null/bloom_filter 1.01 11.7±0.38ms 3.8 GB/sec 1.00 11.5±0.16ms 3.8 GB/sec primitive_all_null/cdc 1.07 30.7±0.51ms 1459.9 MB/sec 1.00 28.8±0.31ms 1557.8 MB/sec primitive_all_null/default 1.01 10.9±0.24ms 4.0 GB/sec 1.00 10.9±0.10ms 4.0 GB/sec primitive_all_null/parquet_2 1.00 10.9±0.20ms 4.0 GB/sec 1.00 10.9±0.17ms 4.0 GB/sec primitive_all_null/zstd 1.01 11.1±0.21ms 3.9 GB/sec 1.00 11.1±0.21ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.1±0.27ms 4.0 GB/sec 1.00 11.0±0.17ms 4.0 GB/sec primitive_non_null/bloom_filter 1.00 107.9±0.20ms 408.0 MB/sec 1.06 114.6±1.31ms 384.0 MB/sec primitive_non_null/cdc 1.00 90.8±0.25ms 484.6 MB/sec 1.01 91.3±0.50ms 481.8 MB/sec primitive_non_null/default 1.01 68.1±0.12ms 646.1 MB/sec 1.00 67.8±0.12ms 649.3 MB/sec primitive_non_null/parquet_2 1.01 90.6±0.33ms 485.6 MB/sec 1.00 89.5±0.17ms 491.8 MB/sec primitive_non_null/zstd 1.01 105.7±0.16ms 416.3 MB/sec 1.00 105.1±0.15ms 418.8 MB/sec primitive_non_null/zstd_parquet_2 1.00 124.0±0.82ms 354.9 MB/sec 1.06 130.9±1.78ms 336.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.3±0.07ms 2.4 GB/sec 1.01 18.4±0.08ms 2.4 GB/sec primitive_sparse_99pct_null/cdc 1.04 37.3±0.32ms 1203.9 MB/sec 1.00 35.8±0.27ms 1253.0 MB/sec primitive_sparse_99pct_null/default 1.00 16.7±0.04ms 2.6 GB/sec 1.00 16.8±0.03ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.04ms 2.6 GB/sec 1.00 16.8±0.04ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.0±0.04ms 2.2 GB/sec 1.00 20.1±0.04ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.7±0.04ms 2.3 GB/sec 1.00 18.8±0.05ms 2.3 GB/sec string/bloom_filter 1.00 207.2±1.73ms 2.5 GB/sec 1.11 230.9±24.69ms 2.2 GB/sec string/cdc 1.01 223.1±5.22ms 2.3 GB/sec 1.00 221.8±5.69ms 2.3 GB/sec string/default 1.00 118.4±1.36ms 4.3 GB/sec 1.19 141.4±24.30ms 3.6 GB/sec string/parquet_2 1.00 108.6±5.27ms 4.7 GB/sec 1.16 126.1±0.22ms 4.1 GB/sec string/zstd 1.00 420.6±2.53ms 1246.3 MB/sec 1.01 426.2±2.37ms 1230.0 MB/sec string/zstd_parquet_2 1.00 396.2±1.19ms 1323.1 MB/sec 1.00 395.8±0.30ms 1324.6 MB/sec string_and_binary_view/bloom_filter 1.00 64.8±0.10ms 497.4 MB/sec 1.01 65.6±0.11ms 491.5 MB/sec string_and_binary_view/cdc 1.00 59.0±0.11ms 546.8 MB/sec 1.00 59.1±0.12ms 545.9 MB/sec string_and_binary_view/default 1.00 48.3±0.08ms 668.2 MB/sec 1.00 48.2±0.08ms 669.0 MB/sec string_and_binary_view/parquet_2 1.00 59.3±0.09ms 544.1 MB/sec 1.00 59.2±0.10ms 544.8 MB/sec string_and_binary_view/zstd 1.00 84.8±0.10ms 380.3 MB/sec 1.01 85.4±0.22ms 377.6 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.2±0.10ms 440.6 MB/sec 1.00 73.1±0.10ms 441.4 MB/sec string_dictionary/bloom_filter 1.00 91.2±0.37ms 2.8 GB/sec 1.00 91.6±0.71ms 2.8 GB/sec string_dictionary/cdc 1.00 53.4±0.09ms 4.8 GB/sec 1.60 85.2±0.66ms 3.0 GB/sec string_dictionary/default 1.01 49.7±0.21ms 5.2 GB/sec 1.00 49.2±0.31ms 5.2 GB/sec string_dictionary/parquet_2 1.01 54.7±0.18ms 4.7 GB/sec 1.00 53.9±0.14ms 4.8 GB/sec string_dictionary/zstd 1.00 209.7±0.21ms 1259.6 MB/sec 1.00 210.4±0.70ms 1255.2 MB/sec string_dictionary/zstd_parquet_2 1.00 199.6±0.26ms 1323.3 MB/sec 1.00 199.0±0.17ms 1327.2 MB/sec string_non_null/bloom_filter 1.02 260.7±11.73ms 2009.6 MB/sec 1.00 256.8±14.84ms 2040.4 MB/sec string_non_null/cdc 1.01 273.1±10.94ms 1918.9 MB/sec 1.00 270.2±8.79ms 1939.7 MB/sec string_non_null/default 1.06 134.5±12.73ms 3.8 GB/sec 1.00 127.3±12.15ms 4.0 GB/sec string_non_null/parquet_2 1.05 148.8±0.46ms 3.4 GB/sec 1.00 141.2±11.45ms 3.6 GB/sec string_non_null/zstd 1.06 567.7±6.25ms 923.0 MB/sec 1.00 533.2±1.51ms 982.8 MB/sec string_non_null/zstd_parquet_2 1.02 520.6±6.32ms 1006.5 MB/sec 1.00 507.9±2.27ms 1031.7 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.2 GB/sec 1.00 2.5±0.00ms 6.2 GB/sec struct_all_null/cdc 1.00 9.8±0.11ms 1638.9 MB/sec 1.02 10.0±0.15ms 1605.8 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.00ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.00ms 6.9 GB/sec struct_non_null/bloom_filter 1.00 46.5±0.13ms 344.3 MB/sec 1.02 47.5±0.11ms 337.2 MB/sec struct_non_null/cdc 1.00 45.7±0.16ms 350.0 MB/sec 1.00 45.6±0.11ms 351.0 MB/sec struct_non_null/default 1.01 32.3±0.10ms 494.9 MB/sec 1.00 32.1±0.08ms 498.2 MB/sec struct_non_null/parquet_2 1.00 41.0±0.11ms 390.5 MB/sec 1.00 40.9±0.49ms 391.6 MB/sec struct_non_null/zstd 1.00 41.1±0.09ms 389.6 MB/sec 1.00 41.1±0.17ms 389.1 MB/sec struct_non_null/zstd_parquet_2 1.00 55.1±0.13ms 290.4 MB/sec 1.01 55.4±0.18ms 288.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.5±0.02ms 2.1 GB/sec 1.02 7.6±0.02ms 2.1 GB/sec struct_sparse_99pct_null/cdc 1.06 15.4±0.10ms 1047.1 MB/sec 1.00 14.5±0.10ms 1111.6 MB/sec struct_sparse_99pct_null/default 1.00 6.9±0.01ms 2.3 GB/sec 1.01 7.0±0.01ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.01ms 2.3 GB/sec 1.01 7.0±0.02ms 2.2 GB/sec struct_sparse_99pct_null/zstd 1.00 8.3±0.01ms 1947.0 MB/sec 1.01 8.4±0.01ms 1929.5 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.02ms 2.0 GB/sec 1.01 7.8±0.02ms 2.0 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1950.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1892.2s | | CPU sys | 55.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1945.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1892.0s | | CPU sys | 52.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
