adriangbot commented on PR #9653: URL: https://github.com/apache/arrow-rs/pull/9653#issuecomment-4522161757
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9653#issuecomment-4521692216) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group faster_sparse_columns_encoding main ----- ------------------------------ ---- bool/bloom_filter 1.00 12.9±0.03ms 19.3 MB/sec 1.01 13.0±0.05ms 19.2 MB/sec bool/cdc 1.00 15.8±0.06ms 15.8 MB/sec 1.02 16.1±0.16ms 15.5 MB/sec bool/default 1.00 11.0±0.06ms 22.8 MB/sec 1.00 10.9±0.04ms 22.9 MB/sec bool/parquet_2 1.00 14.7±0.06ms 17.0 MB/sec 1.01 14.8±0.03ms 16.9 MB/sec bool/zstd 1.00 11.5±0.06ms 21.8 MB/sec 1.00 11.5±0.05ms 21.8 MB/sec bool/zstd_parquet_2 1.00 15.0±0.05ms 16.6 MB/sec 1.01 15.1±0.07ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 6.8±0.05ms 18.4 MB/sec 1.04 7.1±0.03ms 17.7 MB/sec bool_non_null/cdc 1.00 6.5±0.05ms 19.2 MB/sec 1.07 6.9±0.13ms 18.0 MB/sec bool_non_null/default 1.00 4.0±0.02ms 31.1 MB/sec 1.07 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.00 8.7±0.03ms 14.4 MB/sec 1.04 9.0±0.03ms 13.8 MB/sec bool_non_null/zstd 1.00 4.4±0.03ms 28.6 MB/sec 1.06 4.6±0.02ms 26.9 MB/sec bool_non_null/zstd_parquet_2 1.00 9.1±0.04ms 13.7 MB/sec 1.04 9.5±0.05ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 93.6±2.71ms 149.5 MB/sec 1.01 94.5±2.51ms 148.1 MB/sec float_with_nans/cdc 1.00 79.7±0.80ms 175.6 MB/sec 1.03 81.9±0.92ms 171.0 MB/sec float_with_nans/default 1.00 74.0±1.22ms 189.1 MB/sec 1.03 76.1±1.09ms 184.0 MB/sec float_with_nans/parquet_2 1.00 93.3±0.41ms 150.0 MB/sec 1.02 94.9±1.35ms 147.5 MB/sec float_with_nans/zstd 1.00 110.9±0.66ms 126.3 MB/sec 1.02 112.6±0.86ms 124.3 MB/sec float_with_nans/zstd_parquet_2 1.00 132.1±1.90ms 106.0 MB/sec 1.02 134.1±2.17ms 104.4 MB/sec list_primitive/bloom_filter 1.10 375.8±11.90ms 1451.1 MB/sec 1.00 341.9±11.81ms 1595.3 MB/sec list_primitive/cdc 1.13 420.4±3.68ms 1297.4 MB/sec 1.00 371.0±5.37ms 1469.8 MB/sec list_primitive/default 1.15 295.0±5.98ms 1848.5 MB/sec 1.00 257.6±4.02ms 2.1 GB/sec list_primitive/parquet_2 1.13 315.9±2.71ms 1726.5 MB/sec 1.00 279.7±2.43ms 1949.9 MB/sec list_primitive/zstd 1.07 543.1±5.73ms 1004.2 MB/sec 1.00 509.4±6.75ms 1070.7 MB/sec list_primitive/zstd_parquet_2 1.07 538.9±3.50ms 1012.0 MB/sec 1.00 503.4±3.20ms 1083.4 MB/sec list_primitive_non_null/bloom_filter 1.00 409.7±19.96ms 1328.3 MB/sec 1.10 449.4±21.64ms 1211.0 MB/sec list_primitive_non_null/cdc 1.00 415.0±11.02ms 1311.3 MB/sec 1.07 443.1±9.67ms 1228.4 MB/sec list_primitive_non_null/default 1.00 265.5±8.21ms 2.0 GB/sec 1.15 305.8±8.52ms 1779.9 MB/sec list_primitive_non_null/parquet_2 1.00 298.6±10.42ms 1822.6 MB/sec 1.04 310.3±15.19ms 1754.0 MB/sec list_primitive_non_null/zstd 1.00 680.8±16.17ms 799.4 MB/sec 1.07 727.5±12.29ms 748.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 678.0±6.54ms 802.7 MB/sec 1.02 689.8±5.55ms 789.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 12.4±0.59ms 2.9 GB/sec 1.00 12.1±0.39ms 3.0 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.8±0.51ms 1635.4 MB/sec 1.06 24.1±0.08ms 1550.2 MB/sec list_primitive_sparse_99pct_null/default 1.00 11.8±0.28ms 3.1 GB/sec 1.00 11.9±0.24ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.5±0.07ms 3.2 GB/sec 1.01 11.6±0.24ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 13.6±0.33ms 2.7 GB/sec 1.00 13.3±0.04ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.04 12.4±0.11ms 2.9 GB/sec 1.00 11.9±0.11ms 3.1 GB/sec primitive/bloom_filter 1.02 155.3±3.10ms 288.9 MB/sec 1.00 152.5±3.06ms 294.2 MB/sec primitive/cdc 1.00 159.8±2.18ms 280.8 MB/sec 1.02 163.1±2.18ms 275.1 MB/sec primitive/default 1.00 119.0±0.59ms 377.1 MB/sec 1.00 119.3±2.07ms 376.2 MB/sec primitive/parquet_2 1.00 133.9±1.84ms 335.0 MB/sec 1.01 134.9±1.30ms 332.7 MB/sec primitive/zstd 1.00 147.7±0.50ms 303.7 MB/sec 1.01 148.7±2.02ms 301.7 MB/sec primitive/zstd_parquet_2 1.01 168.4±1.84ms 266.5 MB/sec 1.00 166.8±1.73ms 269.0 MB/sec primitive_all_null/bloom_filter 1.00 902.8±26.37µs 48.5 GB/sec 1.04 940.3±50.44µs 46.6 GB/sec primitive_all_null/cdc 1.00 18.2±0.25ms 2.4 GB/sec 1.04 18.9±0.35ms 2.3 GB/sec primitive_all_null/default 1.00 274.1±1.10µs 159.9 GB/sec 1.00 273.5±1.22µs 160.2 GB/sec primitive_all_null/parquet_2 1.00 275.5±1.23µs 159.1 GB/sec 1.01 277.5±1.44µs 157.9 GB/sec primitive_all_null/zstd 1.00 387.9±1.24µs 113.0 GB/sec 1.00 387.5±0.83µs 113.1 GB/sec primitive_all_null/zstd_parquet_2 1.00 352.8±1.01µs 124.2 GB/sec 1.01 357.7±1.19µs 122.5 GB/sec primitive_non_null/bloom_filter 1.00 101.8±1.31ms 432.4 MB/sec 1.07 108.7±1.85ms 404.7 MB/sec primitive_non_null/cdc 1.00 81.7±0.49ms 538.5 MB/sec 1.11 90.7±1.43ms 485.2 MB/sec primitive_non_null/default 1.00 59.8±0.14ms 735.4 MB/sec 1.13 67.4±0.24ms 652.9 MB/sec primitive_non_null/parquet_2 1.00 82.3±0.83ms 534.7 MB/sec 1.09 89.3±0.26ms 492.7 MB/sec primitive_non_null/zstd 1.00 91.4±1.20ms 481.2 MB/sec 1.17 107.3±1.43ms 410.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 115.6±0.93ms 380.8 MB/sec 1.13 130.3±3.03ms 337.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 12.7±0.63ms 3.4 GB/sec 1.00 12.6±0.77ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.9±0.44ms 1501.8 MB/sec 1.09 32.5±0.31ms 1382.7 MB/sec primitive_sparse_99pct_null/default 1.00 11.0±0.32ms 4.0 GB/sec 1.00 11.0±0.30ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.08ms 4.1 GB/sec 1.00 10.8±0.38ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.05 14.5±0.18ms 3.0 GB/sec 1.00 13.8±0.05ms 3.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.2±0.12ms 3.3 GB/sec 1.00 12.6±0.05ms 3.5 GB/sec string/bloom_filter 1.00 222.9±20.96ms 2.3 GB/sec 1.07 239.6±30.09ms 2.1 GB/sec string/cdc 1.00 217.4±4.65ms 2.4 GB/sec 1.03 224.3±7.42ms 2.3 GB/sec string/default 1.10 142.0±23.07ms 3.6 GB/sec 1.00 129.5±22.43ms 4.0 GB/sec string/parquet_2 1.13 127.9±1.64ms 4.0 GB/sec 1.00 112.8±8.25ms 4.5 GB/sec string/zstd 1.05 442.5±19.26ms 1184.8 MB/sec 1.00 423.3±7.82ms 1238.6 MB/sec string/zstd_parquet_2 1.00 397.6±3.24ms 1318.4 MB/sec 1.02 405.1±6.01ms 1294.1 MB/sec string_and_binary_view/bloom_filter 1.00 66.3±0.23ms 486.2 MB/sec 1.04 68.8±1.00ms 469.0 MB/sec string_and_binary_view/cdc 1.09 63.6±0.67ms 506.8 MB/sec 1.00 58.4±0.17ms 552.5 MB/sec string_and_binary_view/default 1.07 51.7±1.11ms 623.3 MB/sec 1.00 48.2±0.18ms 669.4 MB/sec string_and_binary_view/parquet_2 1.01 61.9±0.79ms 521.2 MB/sec 1.00 61.3±1.29ms 526.0 MB/sec string_and_binary_view/zstd 1.02 87.6±1.36ms 368.3 MB/sec 1.00 85.5±1.66ms 377.1 MB/sec string_and_binary_view/zstd_parquet_2 1.03 75.7±0.58ms 425.9 MB/sec 1.00 73.7±1.55ms 437.6 MB/sec string_dictionary/bloom_filter 1.00 94.0±7.08ms 2.7 GB/sec 1.01 95.1±5.54ms 2.7 GB/sec string_dictionary/cdc 1.05 57.0±3.68ms 4.5 GB/sec 1.00 54.5±3.95ms 4.7 GB/sec string_dictionary/default 1.05 51.1±2.33ms 5.1 GB/sec 1.00 48.6±1.71ms 5.3 GB/sec string_dictionary/parquet_2 1.00 54.4±1.45ms 4.7 GB/sec 1.02 55.4±2.02ms 4.7 GB/sec string_dictionary/zstd 1.00 207.5±1.13ms 1272.7 MB/sec 1.01 209.7±3.60ms 1259.8 MB/sec string_dictionary/zstd_parquet_2 1.02 205.3±2.52ms 1286.8 MB/sec 1.00 201.0±1.42ms 1314.4 MB/sec string_non_null/bloom_filter 1.00 237.4±14.52ms 2.2 GB/sec 1.15 272.1±22.69ms 1925.9 MB/sec string_non_null/cdc 1.00 265.9±9.45ms 1970.9 MB/sec 1.02 272.4±9.09ms 1923.4 MB/sec string_non_null/default 1.00 119.2±7.59ms 4.3 GB/sec 1.21 143.7±12.90ms 3.6 GB/sec string_non_null/parquet_2 1.00 133.3±6.33ms 3.8 GB/sec 1.14 152.4±4.50ms 3.4 GB/sec string_non_null/zstd 1.00 542.6±8.59ms 965.8 MB/sec 1.05 568.1±11.09ms 922.4 MB/sec string_non_null/zstd_parquet_2 1.00 511.4±10.10ms 1024.6 MB/sec 1.01 516.7±6.34ms 1014.0 MB/sec struct_all_null/bloom_filter 1.00 375.1±1.46µs 42.0 GB/sec 1.02 382.9±5.58µs 41.1 GB/sec struct_all_null/cdc 1.00 7.4±0.07ms 2.1 GB/sec 1.02 7.6±0.08ms 2.1 GB/sec struct_all_null/default 1.00 118.2±0.37µs 133.2 GB/sec 1.01 119.2±0.30µs 132.1 GB/sec struct_all_null/parquet_2 1.00 118.8±0.53µs 132.5 GB/sec 1.02 120.7±0.55µs 130.4 GB/sec struct_all_null/zstd 1.01 167.6±0.64µs 94.0 GB/sec 1.00 166.6±0.43µs 94.5 GB/sec struct_all_null/zstd_parquet_2 1.00 151.8±0.55µs 103.8 GB/sec 1.01 153.1±0.54µs 102.9 GB/sec struct_non_null/bloom_filter 1.00 43.1±0.17ms 371.1 MB/sec 1.11 47.8±1.45ms 334.8 MB/sec struct_non_null/cdc 1.00 42.3±0.61ms 378.1 MB/sec 1.10 46.4±0.84ms 344.9 MB/sec struct_non_null/default 1.00 29.6±0.61ms 541.0 MB/sec 1.11 32.8±0.99ms 487.2 MB/sec struct_non_null/parquet_2 1.00 38.4±0.27ms 416.7 MB/sec 1.07 41.1±0.11ms 389.4 MB/sec struct_non_null/zstd 1.00 38.5±0.64ms 415.2 MB/sec 1.08 41.7±0.38ms 383.5 MB/sec struct_non_null/zstd_parquet_2 1.00 52.6±0.80ms 304.1 MB/sec 1.07 56.1±0.81ms 285.2 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.5±0.03ms 2.4 GB/sec 1.00 6.5±0.04ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.26ms 1177.0 MB/sec 1.07 14.6±0.27ms 1103.2 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.02 6.1±0.22ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.07 6.3±0.05ms 2.5 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.00 7.7±0.20ms 2.0 GB/sec 1.00 7.7±0.04ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.9±0.27ms 2.3 GB/sec 1.02 7.1±0.14ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1950.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1889.9s | | CPU sys | 55.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1878.6s | | CPU sys | 45.6s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
