adriangbot commented on PR #10052: URL: https://github.com/apache/arrow-rs/pull/10052#issuecomment-4607135519
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10052#issuecomment-4606600306) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group alamb_arrow-writer-splice-no-copy main ----- --------------------------------- ---- bool/bloom_filter 1.00 13.2±0.07ms 18.9 MB/sec 1.00 13.2±0.03ms 18.9 MB/sec bool/cdc 1.00 15.8±0.04ms 15.8 MB/sec 1.01 16.0±0.05ms 15.6 MB/sec bool/default 1.00 11.1±0.08ms 22.6 MB/sec 1.00 11.1±0.04ms 22.5 MB/sec bool/parquet_2 1.00 14.9±0.08ms 16.8 MB/sec 1.00 14.8±0.03ms 16.9 MB/sec bool/zstd 1.00 11.6±0.07ms 21.6 MB/sec 1.00 11.6±0.03ms 21.5 MB/sec bool/zstd_parquet_2 1.00 15.2±0.08ms 16.4 MB/sec 1.00 15.2±0.04ms 16.4 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.02ms 17.9 MB/sec 1.02 7.1±0.02ms 17.5 MB/sec bool_non_null/cdc 1.00 6.8±0.03ms 18.3 MB/sec 1.02 7.0±0.02ms 17.9 MB/sec bool_non_null/default 1.00 4.2±0.01ms 30.0 MB/sec 1.03 4.3±0.02ms 29.1 MB/sec bool_non_null/parquet_2 1.00 8.9±0.03ms 14.0 MB/sec 1.01 9.0±0.02ms 13.9 MB/sec bool_non_null/zstd 1.00 4.5±0.01ms 27.8 MB/sec 1.03 4.6±0.02ms 26.9 MB/sec bool_non_null/zstd_parquet_2 1.00 9.3±0.03ms 13.4 MB/sec 1.01 9.4±0.02ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 94.7±0.55ms 147.8 MB/sec 1.01 95.9±0.36ms 146.0 MB/sec float_with_nans/cdc 1.00 83.1±0.38ms 168.5 MB/sec 1.00 83.3±0.25ms 168.1 MB/sec float_with_nans/default 1.00 75.5±1.13ms 185.3 MB/sec 1.00 75.8±0.18ms 184.8 MB/sec float_with_nans/parquet_2 1.00 96.2±0.39ms 145.5 MB/sec 1.01 96.9±0.29ms 144.4 MB/sec float_with_nans/zstd 1.00 113.1±0.23ms 123.8 MB/sec 1.00 113.6±0.18ms 123.3 MB/sec float_with_nans/zstd_parquet_2 1.00 133.8±0.43ms 104.6 MB/sec 1.00 134.5±0.28ms 104.1 MB/sec large_string_non_null/bloom_filter 1.17 87.7±0.38ms 2.8 GB/sec 1.00 74.9±0.32ms 3.3 GB/sec large_string_non_null/cdc 1.01 245.5±1.98ms 1042.7 MB/sec 1.00 242.1±1.26ms 1057.5 MB/sec large_string_non_null/default 1.24 67.9±0.27ms 3.7 GB/sec 1.00 54.8±0.23ms 4.6 GB/sec large_string_non_null/parquet_2 1.23 67.7±0.34ms 3.7 GB/sec 1.00 54.9±0.26ms 4.6 GB/sec large_string_non_null/zstd 1.23 67.5±0.38ms 3.7 GB/sec 1.00 54.9±0.33ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.21 66.5±0.37ms 3.8 GB/sec 1.00 55.0±0.20ms 4.5 GB/sec list_primitive/bloom_filter 1.00 338.7±1.41ms 1610.4 MB/sec 1.13 381.3±3.55ms 1430.5 MB/sec list_primitive/cdc 1.00 362.8±0.89ms 1503.4 MB/sec 1.06 384.0±12.99ms 1420.2 MB/sec list_primitive/default 1.00 249.2±3.35ms 2.1 GB/sec 1.16 288.1±7.45ms 1892.9 MB/sec list_primitive/parquet_2 1.00 269.0±0.68ms 2027.5 MB/sec 1.13 302.9±1.39ms 1800.5 MB/sec list_primitive/zstd 1.00 502.6±3.95ms 1085.1 MB/sec 1.05 530.1±4.61ms 1028.9 MB/sec list_primitive/zstd_parquet_2 1.00 497.1±0.87ms 1097.2 MB/sec 1.02 504.8±0.92ms 1080.3 MB/sec list_primitive_non_null/bloom_filter 1.00 447.0±7.31ms 1217.5 MB/sec 1.16 520.7±28.18ms 1045.2 MB/sec list_primitive_non_null/cdc 1.00 432.8±9.10ms 1257.6 MB/sec 1.03 443.9±11.05ms 1226.0 MB/sec list_primitive_non_null/default 1.00 291.6±11.90ms 1866.1 MB/sec 1.23 359.1±33.66ms 1515.4 MB/sec list_primitive_non_null/parquet_2 1.00 320.1±0.67ms 1700.2 MB/sec 1.12 356.9±36.38ms 1524.7 MB/sec list_primitive_non_null/zstd 1.00 723.2±14.90ms 752.6 MB/sec 1.03 743.4±22.37ms 732.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 691.1±1.64ms 787.4 MB/sec 1.02 708.0±8.28ms 768.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 11.8±0.03ms 3.1 GB/sec 1.00 11.5±0.03ms 3.2 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 23.4±0.07ms 1599.9 MB/sec 1.00 23.2±0.04ms 1611.6 MB/sec list_primitive_sparse_99pct_null/default 1.03 11.3±0.02ms 3.2 GB/sec 1.00 11.1±0.02ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.03 11.4±0.03ms 3.2 GB/sec 1.00 11.1±0.03ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 13.2±0.03ms 2.8 GB/sec 1.00 13.0±0.03ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.03 11.5±0.03ms 3.2 GB/sec 1.00 11.2±0.03ms 3.3 GB/sec primitive/bloom_filter 1.00 153.4±0.70ms 292.6 MB/sec 1.01 154.9±0.54ms 289.7 MB/sec primitive/cdc 1.00 160.6±0.47ms 279.4 MB/sec 1.01 161.7±0.49ms 277.6 MB/sec primitive/default 1.00 121.3±0.68ms 370.0 MB/sec 1.00 120.8±0.43ms 371.5 MB/sec primitive/parquet_2 1.00 135.0±0.58ms 332.3 MB/sec 1.01 136.0±0.28ms 330.1 MB/sec primitive/zstd 1.00 149.8±0.54ms 299.6 MB/sec 1.01 150.6±0.28ms 297.9 MB/sec primitive/zstd_parquet_2 1.00 168.4±0.50ms 266.4 MB/sec 1.01 169.6±1.12ms 264.5 MB/sec primitive_all_null/bloom_filter 1.00 930.4±4.09µs 47.1 GB/sec 1.01 941.5±3.67µs 46.5 GB/sec primitive_all_null/cdc 1.01 19.1±0.34ms 2.3 GB/sec 1.00 19.0±0.24ms 2.3 GB/sec primitive_all_null/default 1.00 258.9±1.89µs 169.2 GB/sec 1.06 273.5±0.86µs 160.2 GB/sec primitive_all_null/parquet_2 1.00 259.6±1.62µs 168.8 GB/sec 1.07 277.0±1.02µs 158.2 GB/sec primitive_all_null/zstd 1.00 373.8±1.83µs 117.2 GB/sec 1.04 388.1±0.85µs 112.9 GB/sec primitive_all_null/zstd_parquet_2 1.00 338.0±1.59µs 129.6 GB/sec 1.05 354.7±1.02µs 123.5 GB/sec primitive_non_null/bloom_filter 1.00 110.7±1.33ms 397.4 MB/sec 1.00 110.6±0.41ms 397.9 MB/sec primitive_non_null/cdc 1.00 91.8±0.58ms 479.1 MB/sec 1.01 92.8±0.34ms 474.0 MB/sec primitive_non_null/default 1.00 67.1±0.19ms 655.8 MB/sec 1.03 69.1±0.20ms 636.5 MB/sec primitive_non_null/parquet_2 1.00 89.5±0.18ms 491.4 MB/sec 1.01 90.7±0.24ms 485.0 MB/sec primitive_non_null/zstd 1.00 99.3±0.25ms 443.3 MB/sec 1.00 99.7±0.18ms 441.3 MB/sec primitive_non_null/zstd_parquet_2 1.00 124.2±0.19ms 354.4 MB/sec 1.01 125.0±0.52ms 352.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 13.2±0.06ms 3.3 GB/sec 1.00 13.1±0.05ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.03 31.0±0.30ms 1445.3 MB/sec 1.00 30.1±0.26ms 1489.7 MB/sec primitive_sparse_99pct_null/default 1.00 11.2±0.03ms 3.9 GB/sec 1.00 11.1±0.02ms 3.9 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.2±0.04ms 3.9 GB/sec 1.00 11.1±0.03ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.5±0.04ms 3.0 GB/sec 1.00 14.4±0.03ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.2±0.04ms 3.3 GB/sec 1.00 13.1±0.04ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.8±0.07ms 432.4 MB/sec 1.01 28.0±0.06ms 429.0 MB/sec short_string_non_null/cdc 1.00 19.9±0.07ms 602.0 MB/sec 1.01 20.2±0.04ms 593.6 MB/sec short_string_non_null/default 1.00 15.5±0.05ms 775.9 MB/sec 1.03 15.9±0.04ms 754.1 MB/sec short_string_non_null/parquet_2 1.00 25.4±0.06ms 472.4 MB/sec 1.01 25.7±0.26ms 466.1 MB/sec short_string_non_null/zstd 1.00 35.4±0.08ms 339.2 MB/sec 1.00 35.4±0.10ms 339.1 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.4±0.04ms 423.0 MB/sec 1.01 28.5±0.41ms 420.5 MB/sec string/bloom_filter 1.00 214.9±17.63ms 2.4 GB/sec 1.12 240.8±26.61ms 2.1 GB/sec string/cdc 1.00 211.1±6.57ms 2.4 GB/sec 1.03 217.5±7.40ms 2.4 GB/sec string/default 1.00 131.7±19.79ms 3.9 GB/sec 1.02 134.4±23.11ms 3.8 GB/sec string/parquet_2 1.03 113.4±0.65ms 4.5 GB/sec 1.00 110.1±5.60ms 4.7 GB/sec string/zstd 1.01 426.2±4.49ms 1230.2 MB/sec 1.00 423.0±2.61ms 1239.4 MB/sec string/zstd_parquet_2 1.00 387.8±1.08ms 1351.7 MB/sec 1.06 410.1±11.62ms 1278.3 MB/sec string_and_binary_view/bloom_filter 1.00 69.2±0.40ms 466.3 MB/sec 1.01 69.7±0.40ms 462.9 MB/sec string_and_binary_view/cdc 1.02 61.7±0.36ms 522.6 MB/sec 1.00 60.6±0.24ms 532.2 MB/sec string_and_binary_view/default 1.00 49.4±0.24ms 652.3 MB/sec 1.01 49.8±0.18ms 647.4 MB/sec string_and_binary_view/parquet_2 1.00 60.7±0.29ms 531.4 MB/sec 1.01 61.2±0.21ms 526.8 MB/sec string_and_binary_view/zstd 1.00 86.8±0.41ms 371.5 MB/sec 1.00 86.5±0.25ms 372.6 MB/sec string_and_binary_view/zstd_parquet_2 1.01 75.7±0.27ms 426.3 MB/sec 1.00 74.8±0.22ms 431.0 MB/sec string_dictionary/bloom_filter 1.00 99.9±1.36ms 2.6 GB/sec 1.01 100.7±1.40ms 2.6 GB/sec string_dictionary/cdc 1.00 51.3±1.23ms 5.0 GB/sec 1.15 59.0±0.46ms 4.4 GB/sec string_dictionary/default 1.00 46.9±1.64ms 5.5 GB/sec 1.13 52.9±1.12ms 4.9 GB/sec string_dictionary/parquet_2 1.00 50.1±0.56ms 5.1 GB/sec 1.11 55.7±0.44ms 4.6 GB/sec string_dictionary/zstd 1.00 211.4±0.48ms 1249.6 MB/sec 1.03 217.0±1.46ms 1217.1 MB/sec string_dictionary/zstd_parquet_2 1.00 196.4±0.25ms 1344.9 MB/sec 1.03 201.6±0.28ms 1310.4 MB/sec string_non_null/bloom_filter 1.00 267.2±22.83ms 1961.2 MB/sec 1.04 277.0±14.75ms 1891.4 MB/sec string_non_null/cdc 1.00 262.5±10.63ms 1996.4 MB/sec 1.06 279.1±12.13ms 1877.6 MB/sec string_non_null/default 1.00 131.6±15.11ms 3.9 GB/sec 1.13 149.2±15.70ms 3.4 GB/sec string_non_null/parquet_2 1.00 127.3±12.82ms 4.0 GB/sec 1.21 153.5±1.69ms 3.3 GB/sec string_non_null/zstd 1.00 569.1±10.79ms 920.7 MB/sec 1.02 579.4±16.04ms 904.4 MB/sec string_non_null/zstd_parquet_2 1.00 515.7±4.60ms 1016.1 MB/sec 1.01 522.6±9.70ms 1002.8 MB/sec struct_all_null/bloom_filter 1.00 372.4±1.62µs 42.3 GB/sec 1.04 386.9±1.35µs 40.7 GB/sec struct_all_null/cdc 1.00 7.8±0.10ms 2.0 GB/sec 1.01 7.9±0.16ms 2043.7 MB/sec struct_all_null/default 1.00 112.7±0.81µs 139.7 GB/sec 1.05 118.7±0.34µs 132.7 GB/sec struct_all_null/parquet_2 1.00 112.7±0.60µs 139.7 GB/sec 1.06 120.0±0.46µs 131.3 GB/sec struct_all_null/zstd 1.00 160.5±0.80µs 98.1 GB/sec 1.03 165.4±1.07µs 95.2 GB/sec struct_all_null/zstd_parquet_2 1.00 146.1±0.67µs 107.8 GB/sec 1.05 153.6±0.60µs 102.5 GB/sec struct_non_null/bloom_filter 1.00 47.8±0.25ms 334.8 MB/sec 1.01 48.3±0.20ms 331.4 MB/sec struct_non_null/cdc 1.00 45.5±0.16ms 351.5 MB/sec 1.01 46.0±0.13ms 347.7 MB/sec struct_non_null/default 1.00 32.1±0.20ms 497.8 MB/sec 1.01 32.6±0.13ms 490.8 MB/sec struct_non_null/parquet_2 1.00 40.7±0.15ms 393.5 MB/sec 1.02 41.3±0.12ms 387.2 MB/sec struct_non_null/zstd 1.00 41.0±0.15ms 390.1 MB/sec 1.00 41.2±0.11ms 388.2 MB/sec struct_non_null/zstd_parquet_2 1.00 54.7±0.16ms 292.5 MB/sec 1.01 55.4±0.10ms 289.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.0±0.03ms 2.3 GB/sec 1.00 7.0±0.02ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.04 14.5±0.08ms 1114.4 MB/sec 1.00 13.9±0.08ms 1162.8 MB/sec struct_sparse_99pct_null/default 1.01 6.3±0.02ms 2.5 GB/sec 1.00 6.2±0.02ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.2±0.02ms 2.5 GB/sec 1.00 6.2±0.02ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.6±0.02ms 2.1 GB/sec 1.00 7.6±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.1±0.02ms 2.2 GB/sec 1.00 7.1±0.03ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2135.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2048.0s | | CPU sys | 86.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2075.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.6 GiB | | CPU user | 2017.4s | | CPU sys | 57.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
