adriangbot commented on PR #9831: URL: https://github.com/apache/arrow-rs/pull/9831#issuecomment-4381973672
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9831#issuecomment-4381523979) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group compact_lvl_repr main ----- ---------------- ---- bool/bloom_filter 1.01 13.0±0.03ms 19.3 MB/sec 1.00 12.8±0.05ms 19.5 MB/sec bool/cdc 1.03 15.8±0.04ms 15.8 MB/sec 1.00 15.3±0.10ms 16.3 MB/sec bool/default 1.00 10.8±0.03ms 23.2 MB/sec 1.00 10.7±0.03ms 23.3 MB/sec bool/parquet_2 1.00 14.5±0.03ms 17.2 MB/sec 1.00 14.5±0.11ms 17.2 MB/sec bool/zstd 1.01 11.3±0.03ms 22.1 MB/sec 1.00 11.2±0.03ms 22.3 MB/sec bool/zstd_parquet_2 1.00 14.9±0.03ms 16.8 MB/sec 1.00 14.9±0.04ms 16.8 MB/sec bool_non_null/bloom_filter 1.00 6.9±0.04ms 18.0 MB/sec 1.00 6.9±0.03ms 18.0 MB/sec bool_non_null/cdc 1.01 6.8±0.03ms 18.5 MB/sec 1.00 6.7±0.03ms 18.7 MB/sec bool_non_null/default 1.00 4.2±0.02ms 30.1 MB/sec 1.01 4.2±0.02ms 29.8 MB/sec bool_non_null/parquet_2 1.00 9.0±0.04ms 14.0 MB/sec 1.01 9.0±0.09ms 13.9 MB/sec bool_non_null/zstd 1.00 4.5±0.02ms 27.8 MB/sec 1.01 4.5±0.02ms 27.7 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.4 MB/sec 1.01 9.4±0.04ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 93.9±0.50ms 149.1 MB/sec 1.10 103.4±1.45ms 135.3 MB/sec float_with_nans/cdc 1.00 82.2±0.28ms 170.3 MB/sec 1.03 84.7±0.55ms 165.4 MB/sec float_with_nans/default 1.00 74.9±0.26ms 186.9 MB/sec 1.16 86.9±7.62ms 161.2 MB/sec float_with_nans/parquet_2 1.00 95.5±0.37ms 146.7 MB/sec 1.05 100.6±0.65ms 139.2 MB/sec float_with_nans/zstd 1.00 112.9±0.36ms 124.0 MB/sec 1.02 115.3±0.39ms 121.4 MB/sec float_with_nans/zstd_parquet_2 1.00 132.5±0.41ms 105.6 MB/sec 1.04 138.4±0.52ms 101.2 MB/sec list_primitive/bloom_filter 1.07 328.9±2.84ms 1658.2 MB/sec 1.00 308.5±1.58ms 1767.7 MB/sec list_primitive/cdc 1.04 357.4±1.14ms 1525.7 MB/sec 1.00 342.6±2.47ms 1591.9 MB/sec list_primitive/default 1.06 247.8±1.09ms 2.1 GB/sec 1.00 232.8±2.80ms 2.3 GB/sec list_primitive/parquet_2 1.05 267.5±0.47ms 2038.5 MB/sec 1.00 255.1±0.48ms 2.1 GB/sec list_primitive/zstd 1.03 495.2±1.05ms 1101.4 MB/sec 1.00 481.3±2.40ms 1133.2 MB/sec list_primitive/zstd_parquet_2 1.02 491.2±1.65ms 1110.3 MB/sec 1.00 479.3±0.84ms 1137.8 MB/sec list_primitive_non_null/bloom_filter 1.06 420.6±4.82ms 1293.8 MB/sec 1.00 398.7±4.91ms 1365.1 MB/sec list_primitive_non_null/cdc 1.03 432.3±4.96ms 1258.9 MB/sec 1.00 421.6±4.49ms 1290.9 MB/sec list_primitive_non_null/default 1.07 285.7±3.41ms 1904.8 MB/sec 1.00 266.0±4.53ms 2045.9 MB/sec list_primitive_non_null/parquet_2 1.01 299.8±10.51ms 1815.6 MB/sec 1.00 298.0±2.73ms 1826.4 MB/sec list_primitive_non_null/zstd 1.03 702.7±11.81ms 774.5 MB/sec 1.00 684.6±5.59ms 795.0 MB/sec list_primitive_non_null/zstd_parquet_2 1.01 667.7±2.08ms 815.1 MB/sec 1.00 660.3±1.11ms 824.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.1±0.07ms 3.3 GB/sec 1.05 11.6±0.06ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.02 22.7±0.24ms 1649.4 MB/sec 1.00 22.3±0.09ms 1676.0 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.8±0.10ms 3.4 GB/sec 1.04 11.2±0.08ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.02ms 3.4 GB/sec 1.05 11.2±0.09ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.8±0.19ms 2.8 GB/sec 1.02 13.1±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.0±0.11ms 3.3 GB/sec 1.04 11.4±0.08ms 3.2 GB/sec primitive/bloom_filter 1.03 149.7±0.38ms 299.8 MB/sec 1.00 145.9±0.40ms 307.5 MB/sec primitive/cdc 1.03 159.1±0.45ms 282.1 MB/sec 1.00 154.5±0.34ms 290.5 MB/sec primitive/default 1.01 118.1±0.19ms 380.0 MB/sec 1.00 116.4±0.30ms 385.6 MB/sec primitive/parquet_2 1.02 133.3±0.28ms 336.7 MB/sec 1.00 131.0±0.28ms 342.6 MB/sec primitive/zstd 1.01 147.6±0.23ms 304.1 MB/sec 1.00 145.5±0.19ms 308.5 MB/sec primitive/zstd_parquet_2 1.01 166.8±0.78ms 269.0 MB/sec 1.00 165.8±1.31ms 270.6 MB/sec primitive_all_null/bloom_filter 1.00 11.5±0.16ms 3.8 GB/sec 1.01 11.6±0.16ms 3.8 GB/sec primitive_all_null/cdc 1.02 28.6±0.41ms 1567.2 MB/sec 1.00 28.0±0.18ms 1604.7 MB/sec primitive_all_null/default 1.00 10.9±0.12ms 4.0 GB/sec 1.00 10.9±0.08ms 4.0 GB/sec primitive_all_null/parquet_2 1.00 11.0±0.25ms 4.0 GB/sec 1.00 11.0±0.20ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.1±0.21ms 4.0 GB/sec 1.01 11.1±0.20ms 3.9 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.0±0.20ms 4.0 GB/sec 1.00 11.0±0.10ms 4.0 GB/sec primitive_non_null/bloom_filter 1.03 113.9±0.96ms 386.3 MB/sec 1.00 110.9±1.33ms 396.7 MB/sec primitive_non_null/cdc 1.01 91.2±0.24ms 482.7 MB/sec 1.00 90.3±0.81ms 487.4 MB/sec primitive_non_null/default 1.01 68.1±0.16ms 646.5 MB/sec 1.00 67.1±0.20ms 655.8 MB/sec primitive_non_null/parquet_2 1.01 89.9±0.27ms 489.5 MB/sec 1.00 88.7±0.15ms 496.3 MB/sec primitive_non_null/zstd 1.00 106.6±0.18ms 412.7 MB/sec 1.00 106.6±0.60ms 412.9 MB/sec primitive_non_null/zstd_parquet_2 1.00 131.5±1.84ms 334.5 MB/sec 1.00 131.2±2.09ms 335.4 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 18.4±0.45ms 2.4 GB/sec 1.01 18.7±0.20ms 2.3 GB/sec primitive_sparse_99pct_null/cdc 1.01 35.2±0.58ms 1273.3 MB/sec 1.00 35.0±0.37ms 1281.8 MB/sec primitive_sparse_99pct_null/default 1.00 16.7±0.11ms 2.6 GB/sec 1.01 16.9±0.11ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.8±0.15ms 2.6 GB/sec 1.01 16.9±0.09ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 19.9±0.04ms 2.2 GB/sec 1.02 20.2±0.06ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.5±0.11ms 2.4 GB/sec 1.01 18.8±0.13ms 2.3 GB/sec string/bloom_filter 1.06 225.1±21.20ms 2.3 GB/sec 1.00 211.5±17.13ms 2.4 GB/sec string/cdc 1.00 221.6±2.42ms 2.3 GB/sec 1.03 227.8±8.85ms 2.2 GB/sec string/default 1.04 131.0±18.91ms 3.9 GB/sec 1.00 126.4±16.87ms 4.0 GB/sec string/parquet_2 1.00 106.1±0.73ms 4.8 GB/sec 1.09 115.3±4.76ms 4.4 GB/sec string/zstd 1.00 418.6±1.75ms 1252.4 MB/sec 1.02 426.6±2.03ms 1228.8 MB/sec string/zstd_parquet_2 1.00 394.6±0.59ms 1328.4 MB/sec 1.04 411.0±7.80ms 1275.6 MB/sec string_and_binary_view/bloom_filter 1.00 65.0±0.30ms 495.9 MB/sec 1.08 70.2±0.79ms 459.3 MB/sec string_and_binary_view/cdc 1.00 59.1±0.12ms 545.4 MB/sec 1.02 60.6±0.52ms 532.5 MB/sec string_and_binary_view/default 1.00 48.3±0.15ms 668.2 MB/sec 1.04 50.4±0.43ms 640.3 MB/sec string_and_binary_view/parquet_2 1.00 59.7±0.22ms 540.4 MB/sec 1.03 61.4±0.56ms 525.2 MB/sec string_and_binary_view/zstd 1.00 84.7±0.12ms 380.6 MB/sec 1.03 87.1±0.39ms 370.2 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.2±0.25ms 440.8 MB/sec 1.02 74.9±0.36ms 430.5 MB/sec string_dictionary/bloom_filter 1.00 94.5±2.00ms 2.7 GB/sec 1.17 110.4±10.38ms 2.3 GB/sec string_dictionary/cdc 1.00 53.5±1.41ms 4.8 GB/sec 1.10 58.8±0.94ms 4.4 GB/sec string_dictionary/default 1.00 50.0±0.52ms 5.2 GB/sec 1.06 52.8±0.88ms 4.9 GB/sec string_dictionary/parquet_2 1.00 54.1±0.35ms 4.8 GB/sec 1.04 56.1±1.11ms 4.6 GB/sec string_dictionary/zstd 1.00 212.0±0.67ms 1245.9 MB/sec 1.02 216.8±0.85ms 1218.5 MB/sec string_dictionary/zstd_parquet_2 1.00 198.8±0.48ms 1328.4 MB/sec 1.02 203.2±4.52ms 1299.9 MB/sec string_non_null/bloom_filter 1.00 256.1±10.71ms 2046.3 MB/sec 1.16 297.1±17.04ms 1763.7 MB/sec string_non_null/cdc 1.00 276.1±8.88ms 1898.2 MB/sec 1.07 295.9±7.86ms 1770.7 MB/sec string_non_null/default 1.00 141.3±7.62ms 3.6 GB/sec 1.02 143.8±11.25ms 3.6 GB/sec string_non_null/parquet_2 1.00 143.8±6.09ms 3.6 GB/sec 1.01 145.9±9.75ms 3.5 GB/sec string_non_null/zstd 1.00 567.8±11.20ms 922.9 MB/sec 1.00 565.6±13.01ms 926.5 MB/sec string_non_null/zstd_parquet_2 1.00 523.4±7.33ms 1001.2 MB/sec 1.03 539.8±3.25ms 970.7 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.3 GB/sec 1.65 4.2±0.03ms 3.8 GB/sec struct_all_null/cdc 1.00 9.4±0.10ms 1710.2 MB/sec 1.14 10.7±0.14ms 1504.1 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.72 3.9±0.01ms 4.1 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.72 3.9±0.05ms 4.1 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.72 4.0±0.05ms 4.0 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.71 3.9±0.02ms 4.0 GB/sec struct_non_null/bloom_filter 1.00 46.7±0.37ms 342.3 MB/sec 1.07 50.2±0.13ms 318.9 MB/sec struct_non_null/cdc 1.00 45.1±0.11ms 354.8 MB/sec 1.03 46.4±0.09ms 345.0 MB/sec struct_non_null/default 1.00 32.0±0.21ms 500.7 MB/sec 1.07 34.1±0.15ms 469.4 MB/sec struct_non_null/parquet_2 1.00 40.6±0.20ms 394.0 MB/sec 1.05 42.4±0.09ms 377.0 MB/sec struct_non_null/zstd 1.00 41.2±0.25ms 388.3 MB/sec 1.03 42.6±0.09ms 376.0 MB/sec struct_non_null/zstd_parquet_2 1.00 54.7±0.19ms 292.5 MB/sec 1.03 56.4±0.18ms 283.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.4±0.02ms 2.1 GB/sec 1.02 7.5±0.04ms 2.1 GB/sec struct_sparse_99pct_null/cdc 1.03 14.2±0.09ms 1134.3 MB/sec 1.00 13.9±0.05ms 1163.7 MB/sec struct_sparse_99pct_null/default 1.00 6.9±0.01ms 2.3 GB/sec 1.00 6.9±0.04ms 2.3 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.9±0.01ms 2.3 GB/sec 1.00 6.9±0.02ms 2.3 GB/sec struct_sparse_99pct_null/zstd 1.00 8.2±0.01ms 1958.9 MB/sec 1.01 8.3±0.05ms 1945.4 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.7±0.01ms 2.1 GB/sec 1.01 7.7±0.04ms 2.0 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1915.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1867.6s | | CPU sys | 44.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1935.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1884.6s | | CPU sys | 48.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
