adriangbot commented on PR #9619: URL: https://github.com/apache/arrow-rs/pull/9619#issuecomment-4520847485
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9619#issuecomment-4520171218) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main total_order_514 ----- ---- --------------- bool/bloom_filter 1.02 13.1±0.06ms 19.1 MB/sec 1.00 12.8±0.04ms 19.5 MB/sec bool/cdc 1.03 16.0±0.09ms 15.6 MB/sec 1.00 15.5±0.05ms 16.1 MB/sec bool/default 1.02 11.0±0.05ms 22.7 MB/sec 1.00 10.8±0.08ms 23.2 MB/sec bool/parquet_2 1.01 14.7±0.06ms 17.0 MB/sec 1.00 14.5±0.06ms 17.2 MB/sec bool/zstd 1.02 11.6±0.08ms 21.6 MB/sec 1.00 11.3±0.06ms 22.1 MB/sec bool/zstd_parquet_2 1.01 15.1±0.06ms 16.5 MB/sec 1.00 14.9±0.08ms 16.7 MB/sec bool_non_null/bloom_filter 1.06 7.1±0.05ms 17.7 MB/sec 1.00 6.7±0.02ms 18.7 MB/sec bool_non_null/cdc 1.05 6.9±0.08ms 18.1 MB/sec 1.00 6.6±0.13ms 19.0 MB/sec bool_non_null/default 1.09 4.3±0.02ms 29.1 MB/sec 1.00 3.9±0.03ms 31.8 MB/sec bool_non_null/parquet_2 1.03 9.0±0.04ms 13.9 MB/sec 1.00 8.8±0.04ms 14.3 MB/sec bool_non_null/zstd 1.08 4.6±0.02ms 26.9 MB/sec 1.00 4.3±0.02ms 29.1 MB/sec bool_non_null/zstd_parquet_2 1.03 9.5±0.04ms 13.2 MB/sec 1.00 9.2±0.04ms 13.7 MB/sec float_with_nans/bloom_filter 1.00 95.6±1.25ms 146.5 MB/sec 1.01 96.6±2.29ms 145.0 MB/sec float_with_nans/cdc 1.01 84.3±1.28ms 166.1 MB/sec 1.00 83.7±1.37ms 167.3 MB/sec float_with_nans/default 1.00 74.5±0.24ms 187.9 MB/sec 1.03 76.8±0.58ms 182.4 MB/sec float_with_nans/parquet_2 1.00 96.1±2.19ms 145.7 MB/sec 1.01 97.2±2.08ms 144.1 MB/sec float_with_nans/zstd 1.00 112.7±1.32ms 124.2 MB/sec 1.01 113.7±1.55ms 123.1 MB/sec float_with_nans/zstd_parquet_2 1.00 131.7±0.29ms 106.3 MB/sec 1.02 135.0±1.85ms 103.7 MB/sec list_primitive/bloom_filter 1.00 343.7±9.92ms 1586.9 MB/sec 1.01 347.5±13.41ms 1569.2 MB/sec list_primitive/cdc 1.00 371.5±4.74ms 1468.0 MB/sec 1.00 371.1±4.69ms 1469.4 MB/sec list_primitive/default 1.00 259.5±5.41ms 2.1 GB/sec 1.00 259.9±4.95ms 2.0 GB/sec list_primitive/parquet_2 1.00 279.0±2.14ms 1954.8 MB/sec 1.00 278.6±2.58ms 1957.4 MB/sec list_primitive/zstd 1.00 513.5±7.03ms 1062.0 MB/sec 1.00 511.6±6.85ms 1066.1 MB/sec list_primitive/zstd_parquet_2 1.00 505.8±3.72ms 1078.3 MB/sec 1.00 503.3±3.83ms 1083.7 MB/sec list_primitive_non_null/bloom_filter 1.00 408.3±20.95ms 1333.1 MB/sec 1.06 431.6±20.86ms 1260.9 MB/sec list_primitive_non_null/cdc 1.01 446.4±10.18ms 1219.2 MB/sec 1.00 442.5±9.43ms 1229.9 MB/sec list_primitive_non_null/default 1.00 263.1±6.53ms 2.0 GB/sec 1.12 294.3±8.55ms 1849.5 MB/sec list_primitive_non_null/parquet_2 1.00 296.6±4.36ms 1835.2 MB/sec 1.10 325.0±5.13ms 1674.4 MB/sec list_primitive_non_null/zstd 1.00 692.0±12.44ms 786.5 MB/sec 1.04 716.7±16.07ms 759.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 674.1±7.37ms 807.3 MB/sec 1.02 690.7±5.90ms 787.9 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.8±0.05ms 3.1 GB/sec 1.06 12.5±0.26ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.6±0.14ms 1584.6 MB/sec 1.00 23.7±0.10ms 1578.2 MB/sec list_primitive_sparse_99pct_null/default 1.01 11.8±0.28ms 3.1 GB/sec 1.00 11.7±0.21ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.0±0.07ms 3.0 GB/sec 1.00 11.8±0.25ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.8±0.24ms 2.6 GB/sec 1.00 13.8±0.31ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.6±0.05ms 3.1 GB/sec 1.03 12.0±0.27ms 3.0 GB/sec primitive/bloom_filter 1.02 154.1±3.88ms 291.2 MB/sec 1.00 151.5±3.50ms 296.3 MB/sec primitive/cdc 1.01 161.4±1.80ms 278.0 MB/sec 1.00 159.1±1.34ms 282.1 MB/sec primitive/default 1.02 120.8±1.72ms 371.6 MB/sec 1.00 118.8±1.78ms 377.8 MB/sec primitive/parquet_2 1.01 134.0±1.64ms 335.0 MB/sec 1.00 132.4±0.62ms 338.9 MB/sec primitive/zstd 1.00 149.6±1.66ms 300.0 MB/sec 1.00 149.7±1.83ms 299.8 MB/sec primitive/zstd_parquet_2 1.01 168.3±2.13ms 266.7 MB/sec 1.00 166.9±1.73ms 268.9 MB/sec primitive_all_null/bloom_filter 1.00 893.0±2.47µs 49.1 GB/sec 1.04 929.9±19.40µs 47.1 GB/sec primitive_all_null/cdc 1.00 18.8±0.30ms 2.3 GB/sec 1.02 19.3±0.36ms 2.3 GB/sec primitive_all_null/default 1.00 275.3±1.23µs 159.2 GB/sec 1.02 281.1±2.30µs 155.9 GB/sec primitive_all_null/parquet_2 1.00 278.7±1.17µs 157.2 GB/sec 1.03 287.1±1.65µs 152.6 GB/sec primitive_all_null/zstd 1.00 388.8±1.32µs 112.7 GB/sec 1.02 398.3±2.68µs 110.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 356.2±1.07µs 123.0 GB/sec 1.03 365.4±1.77µs 119.9 GB/sec primitive_non_null/bloom_filter 1.00 114.3±2.26ms 385.0 MB/sec 1.01 115.5±3.96ms 381.0 MB/sec primitive_non_null/cdc 1.03 92.7±1.55ms 474.7 MB/sec 1.00 90.2±1.96ms 488.0 MB/sec primitive_non_null/default 1.01 68.7±0.99ms 640.2 MB/sec 1.00 68.1±1.36ms 645.9 MB/sec primitive_non_null/parquet_2 1.03 91.1±1.77ms 483.0 MB/sec 1.00 88.6±1.60ms 496.4 MB/sec primitive_non_null/zstd 1.03 106.8±2.28ms 412.2 MB/sec 1.00 103.7±0.27ms 424.3 MB/sec primitive_non_null/zstd_parquet_2 1.00 130.5±3.03ms 337.1 MB/sec 1.00 130.6±2.51ms 336.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.1±0.11ms 3.6 GB/sec 1.10 13.3±0.45ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.08 32.2±0.34ms 1395.8 MB/sec 1.00 29.7±0.32ms 1509.0 MB/sec primitive_sparse_99pct_null/default 1.02 10.9±0.34ms 4.0 GB/sec 1.00 10.7±0.24ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.03 11.0±0.26ms 4.0 GB/sec 1.00 10.7±0.19ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.03 14.5±0.29ms 3.0 GB/sec 1.00 14.1±0.23ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.05ms 3.4 GB/sec 1.01 12.9±0.37ms 3.4 GB/sec string/bloom_filter 1.00 225.5±18.88ms 2.3 GB/sec 1.06 239.3±26.32ms 2.1 GB/sec string/cdc 1.00 227.5±6.91ms 2.3 GB/sec 1.00 227.6±6.65ms 2.2 GB/sec string/default 1.00 126.8±20.08ms 4.0 GB/sec 1.01 128.3±16.61ms 4.0 GB/sec string/parquet_2 1.00 115.1±5.77ms 4.4 GB/sec 1.04 120.0±3.06ms 4.3 GB/sec string/zstd 1.00 421.4±5.27ms 1244.1 MB/sec 1.08 455.1±18.53ms 1152.0 MB/sec string/zstd_parquet_2 1.02 405.5±8.29ms 1292.9 MB/sec 1.00 399.5±3.76ms 1312.4 MB/sec string_and_binary_view/bloom_filter 1.01 66.4±2.96ms 485.9 MB/sec 1.00 65.7±0.22ms 491.0 MB/sec string_and_binary_view/cdc 1.00 58.9±0.70ms 547.5 MB/sec 1.03 60.6±1.78ms 532.6 MB/sec string_and_binary_view/default 1.00 48.7±1.27ms 662.2 MB/sec 1.01 49.2±1.32ms 656.1 MB/sec string_and_binary_view/parquet_2 1.00 59.1±0.13ms 545.7 MB/sec 1.03 60.7±0.81ms 531.0 MB/sec string_and_binary_view/zstd 1.00 86.4±0.89ms 373.4 MB/sec 1.00 86.3±1.08ms 373.7 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.4±0.73ms 439.5 MB/sec 1.01 74.2±1.48ms 434.5 MB/sec string_dictionary/bloom_filter 1.00 92.2±3.15ms 2.8 GB/sec 1.12 103.0±5.33ms 2.5 GB/sec string_dictionary/cdc 1.00 57.3±1.78ms 4.5 GB/sec 1.00 57.2±2.45ms 4.5 GB/sec string_dictionary/default 1.00 48.4±2.73ms 5.3 GB/sec 1.02 49.3±0.20ms 5.2 GB/sec string_dictionary/parquet_2 1.02 56.4±1.04ms 4.6 GB/sec 1.00 55.1±0.87ms 4.7 GB/sec string_dictionary/zstd 1.00 211.9±3.21ms 1246.6 MB/sec 1.01 213.3±3.93ms 1238.1 MB/sec string_dictionary/zstd_parquet_2 1.00 199.2±0.61ms 1325.6 MB/sec 1.01 201.5±1.77ms 1310.9 MB/sec string_non_null/bloom_filter 1.00 254.1±21.09ms 2.0 GB/sec 1.05 265.8±16.68ms 1971.1 MB/sec string_non_null/cdc 1.00 272.2±7.78ms 1925.0 MB/sec 1.02 277.1±10.00ms 1890.8 MB/sec string_non_null/default 1.01 141.8±16.02ms 3.6 GB/sec 1.00 141.0±16.11ms 3.6 GB/sec string_non_null/parquet_2 1.00 136.4±4.10ms 3.8 GB/sec 1.06 144.0±8.64ms 3.6 GB/sec string_non_null/zstd 1.00 543.2±10.21ms 964.7 MB/sec 1.05 568.9±11.42ms 921.0 MB/sec string_non_null/zstd_parquet_2 1.00 509.2±5.15ms 1029.0 MB/sec 1.00 509.3±4.53ms 1028.8 MB/sec struct_all_null/bloom_filter 1.00 381.2±3.09µs 41.3 GB/sec 1.00 381.0±3.73µs 41.3 GB/sec struct_all_null/cdc 1.00 7.6±0.12ms 2.1 GB/sec 1.04 7.9±0.14ms 2034.5 MB/sec struct_all_null/default 1.00 119.2±0.36µs 132.1 GB/sec 1.02 122.1±1.19µs 129.0 GB/sec struct_all_null/parquet_2 1.00 120.8±0.54µs 130.4 GB/sec 1.02 122.9±0.55µs 128.1 GB/sec struct_all_null/zstd 1.00 167.1±0.65µs 94.2 GB/sec 1.02 169.8±1.38µs 92.7 GB/sec struct_all_null/zstd_parquet_2 1.00 153.6±0.48µs 102.5 GB/sec 1.01 155.5±0.70µs 101.3 GB/sec struct_non_null/bloom_filter 1.05 48.0±1.10ms 333.4 MB/sec 1.00 45.6±1.11ms 350.9 MB/sec struct_non_null/cdc 1.02 45.7±0.20ms 350.2 MB/sec 1.00 44.7±0.44ms 357.7 MB/sec struct_non_null/default 1.04 32.2±0.14ms 497.5 MB/sec 1.00 30.9±0.45ms 517.2 MB/sec struct_non_null/parquet_2 1.06 41.7±0.40ms 383.9 MB/sec 1.00 39.1±0.37ms 408.8 MB/sec struct_non_null/zstd 1.04 41.0±0.45ms 389.9 MB/sec 1.00 39.5±0.81ms 404.7 MB/sec struct_non_null/zstd_parquet_2 1.05 55.7±0.92ms 287.1 MB/sec 1.00 53.1±0.10ms 301.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 7.0±0.31ms 2.3 GB/sec 1.00 6.9±0.38ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.06 14.6±0.09ms 1107.1 MB/sec 1.00 13.7±0.27ms 1177.5 MB/sec struct_sparse_99pct_null/default 1.02 6.3±0.07ms 2.5 GB/sec 1.00 6.1±0.19ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.0±0.18ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.02ms 2.2 GB/sec 1.00 7.3±0.09ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.03 6.9±0.24ms 2.3 GB/sec 1.00 6.7±0.02ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1935.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1901.0s | | CPU sys | 32.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1930.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1876.4s | | CPU sys | 53.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
