adriangbot commented on PR #9967: URL: https://github.com/apache/arrow-rs/pull/9967#issuecomment-4452202627
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9967#issuecomment-4451595571) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main perf_arrow-parquet-null-heavy ----- ---- ----------------------------- bool/bloom_filter 1.01 13.1±0.10ms 19.0 MB/sec 1.00 13.0±0.07ms 19.2 MB/sec bool/cdc 1.00 15.8±0.14ms 15.8 MB/sec 1.01 16.0±0.20ms 15.6 MB/sec bool/default 1.01 11.1±0.03ms 22.6 MB/sec 1.00 10.9±0.05ms 22.9 MB/sec bool/parquet_2 1.00 14.8±0.04ms 16.9 MB/sec 1.00 14.7±0.07ms 17.0 MB/sec bool/zstd 1.01 11.6±0.06ms 21.6 MB/sec 1.00 11.5±0.03ms 21.7 MB/sec bool/zstd_parquet_2 1.00 15.1±0.04ms 16.6 MB/sec 1.01 15.2±0.07ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 7.1±0.03ms 17.7 MB/sec 1.00 7.1±0.06ms 17.7 MB/sec bool_non_null/cdc 1.00 6.9±0.09ms 18.2 MB/sec 1.01 6.9±0.15ms 18.0 MB/sec bool_non_null/default 1.00 4.3±0.03ms 29.2 MB/sec 1.00 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.01 9.2±0.05ms 13.7 MB/sec 1.00 9.1±0.05ms 13.8 MB/sec bool_non_null/zstd 1.00 4.6±0.03ms 27.0 MB/sec 1.00 4.7±0.02ms 26.9 MB/sec bool_non_null/zstd_parquet_2 1.00 9.5±0.03ms 13.2 MB/sec 1.00 9.5±0.04ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 92.3±0.26ms 151.7 MB/sec 1.05 96.8±3.31ms 144.6 MB/sec float_with_nans/cdc 1.00 81.7±1.16ms 171.3 MB/sec 1.01 82.6±1.19ms 169.5 MB/sec float_with_nans/default 1.00 75.2±1.70ms 186.1 MB/sec 1.03 77.2±2.06ms 181.4 MB/sec float_with_nans/parquet_2 1.01 96.6±1.05ms 144.9 MB/sec 1.00 95.7±1.95ms 146.2 MB/sec float_with_nans/zstd 1.00 113.5±0.89ms 123.3 MB/sec 1.01 114.4±1.65ms 122.3 MB/sec float_with_nans/zstd_parquet_2 1.00 134.0±3.04ms 104.5 MB/sec 1.01 135.6±1.86ms 103.2 MB/sec list_primitive/bloom_filter 1.00 329.9±15.07ms 1653.4 MB/sec 1.02 334.9±11.50ms 1628.2 MB/sec list_primitive/cdc 1.01 360.6±5.53ms 1512.4 MB/sec 1.00 358.4±4.23ms 1521.8 MB/sec list_primitive/default 1.01 250.4±4.11ms 2.1 GB/sec 1.00 248.3±3.29ms 2.1 GB/sec list_primitive/parquet_2 1.01 270.4±1.93ms 2017.0 MB/sec 1.00 268.0±2.08ms 2034.8 MB/sec list_primitive/zstd 1.00 503.2±6.40ms 1083.9 MB/sec 1.00 502.4±7.10ms 1085.5 MB/sec list_primitive/zstd_parquet_2 1.00 494.8±3.35ms 1102.2 MB/sec 1.00 494.0±3.54ms 1104.1 MB/sec list_primitive_non_null/bloom_filter 1.00 426.4±18.19ms 1276.2 MB/sec 1.05 445.9±22.27ms 1220.6 MB/sec list_primitive_non_null/cdc 1.00 442.2±10.60ms 1230.6 MB/sec 1.00 441.1±11.33ms 1234.0 MB/sec list_primitive_non_null/default 1.00 292.0±9.91ms 1863.9 MB/sec 1.03 299.8±8.67ms 1815.2 MB/sec list_primitive_non_null/parquet_2 1.00 316.7±5.79ms 1718.7 MB/sec 1.02 324.4±17.07ms 1677.5 MB/sec list_primitive_non_null/zstd 1.00 712.5±12.94ms 763.9 MB/sec 1.01 721.2±19.01ms 754.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 685.5±7.87ms 793.9 MB/sec 1.02 699.0±7.44ms 778.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.0±0.03ms 3.3 GB/sec 1.06 11.7±0.06ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 22.8±0.31ms 1635.6 MB/sec 1.01 23.0±0.28ms 1624.9 MB/sec list_primitive_sparse_99pct_null/default 1.02 11.2±0.28ms 3.3 GB/sec 1.00 10.9±0.18ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.15ms 3.4 GB/sec 1.03 11.2±0.32ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 13.1±0.04ms 2.8 GB/sec 1.00 12.9±0.29ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.02 11.2±0.29ms 3.3 GB/sec 1.00 11.0±0.19ms 3.3 GB/sec primitive/bloom_filter 1.00 150.7±2.22ms 297.9 MB/sec 1.01 152.6±4.72ms 294.0 MB/sec primitive/cdc 1.00 161.2±1.65ms 278.4 MB/sec 1.00 161.3±1.87ms 278.3 MB/sec primitive/default 1.00 118.1±2.17ms 380.0 MB/sec 1.02 120.5±0.85ms 372.4 MB/sec primitive/parquet_2 1.01 134.9±1.36ms 332.7 MB/sec 1.00 133.8±1.55ms 335.4 MB/sec primitive/zstd 1.00 148.8±2.81ms 301.5 MB/sec 1.00 149.5±1.70ms 300.2 MB/sec primitive/zstd_parquet_2 1.00 166.8±1.61ms 269.0 MB/sec 1.01 168.5±2.26ms 266.3 MB/sec primitive_all_null/bloom_filter 2.13 11.5±0.13ms 3.8 GB/sec 1.00 5.4±0.25ms 8.1 GB/sec primitive_all_null/cdc 1.41 30.9±0.39ms 1452.1 MB/sec 1.00 22.0±0.28ms 2041.7 MB/sec primitive_all_null/default 2.38 11.0±0.25ms 4.0 GB/sec 1.00 4.6±0.21ms 9.5 GB/sec primitive_all_null/parquet_2 2.45 11.0±0.20ms 4.0 GB/sec 1.00 4.5±0.17ms 9.8 GB/sec primitive_all_null/zstd 2.49 11.2±0.28ms 3.9 GB/sec 1.00 4.5±0.07ms 9.8 GB/sec primitive_all_null/zstd_parquet_2 2.40 11.1±0.13ms 4.0 GB/sec 1.00 4.6±0.15ms 9.5 GB/sec primitive_non_null/bloom_filter 1.00 110.5±1.24ms 398.0 MB/sec 1.06 117.5±4.13ms 374.3 MB/sec primitive_non_null/cdc 1.00 90.0±0.49ms 489.0 MB/sec 1.02 91.6±2.06ms 480.4 MB/sec primitive_non_null/default 1.00 70.1±1.83ms 627.6 MB/sec 1.00 69.9±1.06ms 629.3 MB/sec primitive_non_null/parquet_2 1.02 91.0±0.39ms 483.3 MB/sec 1.00 89.2±0.17ms 493.5 MB/sec primitive_non_null/zstd 1.00 105.6±1.92ms 416.8 MB/sec 1.02 107.5±1.15ms 409.5 MB/sec primitive_non_null/zstd_parquet_2 1.05 132.2±2.85ms 332.9 MB/sec 1.00 125.4±1.29ms 350.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.48 19.4±0.70ms 2.3 GB/sec 1.00 13.1±0.13ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.30 38.1±0.29ms 1178.8 MB/sec 1.00 29.3±0.50ms 1529.8 MB/sec primitive_sparse_99pct_null/default 1.60 17.3±0.16ms 2.5 GB/sec 1.00 10.9±0.32ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.57 16.8±0.24ms 2.6 GB/sec 1.00 10.7±0.27ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.41 20.1±0.24ms 2.2 GB/sec 1.00 14.3±0.44ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.53 19.2±0.23ms 2.3 GB/sec 1.00 12.5±0.05ms 3.5 GB/sec string/bloom_filter 1.06 239.4±33.57ms 2.1 GB/sec 1.00 225.4±17.26ms 2.3 GB/sec string/cdc 1.00 223.0±8.52ms 2.3 GB/sec 1.01 225.0±6.91ms 2.3 GB/sec string/default 1.20 147.2±26.45ms 3.5 GB/sec 1.00 123.1±15.53ms 4.2 GB/sec string/parquet_2 1.00 126.4±2.12ms 4.0 GB/sec 1.00 126.9±3.82ms 4.0 GB/sec string/zstd 1.00 428.6±7.91ms 1223.2 MB/sec 1.10 470.6±11.92ms 1114.1 MB/sec string/zstd_parquet_2 1.00 396.3±2.38ms 1322.8 MB/sec 1.03 406.7±10.57ms 1289.0 MB/sec string_and_binary_view/bloom_filter 1.03 67.3±1.75ms 479.3 MB/sec 1.00 65.1±0.14ms 495.4 MB/sec string_and_binary_view/cdc 1.00 59.4±0.55ms 542.6 MB/sec 1.00 59.2±0.96ms 544.9 MB/sec string_and_binary_view/default 1.00 48.5±0.77ms 665.4 MB/sec 1.02 49.2±1.06ms 655.3 MB/sec string_and_binary_view/parquet_2 1.00 59.1±0.92ms 545.3 MB/sec 1.02 60.2±0.51ms 535.9 MB/sec string_and_binary_view/zstd 1.00 85.2±1.65ms 378.7 MB/sec 1.01 86.2±1.67ms 374.0 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.7±0.87ms 443.7 MB/sec 1.01 73.5±1.46ms 438.5 MB/sec string_dictionary/bloom_filter 1.13 109.7±10.08ms 2.4 GB/sec 1.00 96.7±6.66ms 2.7 GB/sec string_dictionary/cdc 1.26 73.7±1.93ms 3.5 GB/sec 1.00 58.6±3.26ms 4.4 GB/sec string_dictionary/default 1.21 64.9±2.65ms 4.0 GB/sec 1.00 53.5±0.96ms 4.8 GB/sec string_dictionary/parquet_2 1.18 66.2±1.81ms 3.9 GB/sec 1.00 56.0±0.61ms 4.6 GB/sec string_dictionary/zstd 1.02 217.1±4.47ms 1216.6 MB/sec 1.00 213.5±5.13ms 1237.2 MB/sec string_dictionary/zstd_parquet_2 1.00 200.3±2.11ms 1318.4 MB/sec 1.00 200.8±1.36ms 1315.2 MB/sec string_non_null/bloom_filter 1.00 261.6±20.52ms 2003.4 MB/sec 1.04 271.4±20.70ms 1930.6 MB/sec string_non_null/cdc 1.00 260.1±4.64ms 2014.7 MB/sec 1.06 275.6±9.63ms 1901.6 MB/sec string_non_null/default 1.00 140.1±15.44ms 3.7 GB/sec 1.01 142.1±16.40ms 3.6 GB/sec string_non_null/parquet_2 1.00 149.5±2.53ms 3.4 GB/sec 1.13 169.0±6.49ms 3.0 GB/sec string_non_null/zstd 1.05 600.0±27.35ms 873.3 MB/sec 1.00 571.6±13.71ms 916.7 MB/sec string_non_null/zstd_parquet_2 1.01 528.6±14.49ms 991.4 MB/sec 1.00 524.8±6.00ms 998.4 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.03ms 6.2 GB/sec 1.01 2.6±0.05ms 6.1 GB/sec struct_all_null/cdc 1.06 9.9±0.21ms 1635.3 MB/sec 1.00 9.3±0.09ms 1739.3 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.3±0.01ms 7.0 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.00 2.2±0.01ms 7.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.00 2.3±0.01ms 6.9 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.00 2.3±0.01ms 6.9 GB/sec struct_non_null/bloom_filter 1.03 48.8±0.95ms 328.1 MB/sec 1.00 47.4±1.12ms 337.7 MB/sec struct_non_null/cdc 1.00 45.9±0.53ms 348.9 MB/sec 1.00 46.1±0.45ms 347.4 MB/sec struct_non_null/default 1.00 32.0±0.10ms 499.9 MB/sec 1.02 32.7±0.40ms 489.2 MB/sec struct_non_null/parquet_2 1.02 41.9±0.53ms 382.1 MB/sec 1.00 41.1±0.80ms 389.2 MB/sec struct_non_null/zstd 1.03 42.3±0.97ms 378.3 MB/sec 1.00 41.1±0.57ms 389.3 MB/sec struct_non_null/zstd_parquet_2 1.01 55.9±1.10ms 286.1 MB/sec 1.00 55.1±0.43ms 290.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 7.9±0.35ms 2.0 GB/sec 1.00 7.8±0.38ms 2.0 GB/sec struct_sparse_99pct_null/cdc 1.04 15.4±0.06ms 1049.0 MB/sec 1.00 14.8±0.07ms 1088.6 MB/sec struct_sparse_99pct_null/default 1.04 7.3±0.11ms 2.2 GB/sec 1.00 7.0±0.18ms 2.2 GB/sec struct_sparse_99pct_null/parquet_2 1.05 7.2±0.15ms 2.2 GB/sec 1.00 6.9±0.02ms 2.3 GB/sec struct_sparse_99pct_null/zstd 1.00 8.4±0.16ms 1929.6 MB/sec 1.05 8.7±0.04ms 1844.7 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.02ms 2.1 GB/sec 1.01 7.7±0.02ms 2.0 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1960.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1888.6s | | CPU sys | 68.8s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1945.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1880.1s | | CPU sys | 62.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
