adriangbot commented on PR #9831: URL: https://github.com/apache/arrow-rs/pull/9831#issuecomment-4381976200
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9831#issuecomment-4381524481) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group compact_lvl_repr main ----- ---------------- ---- bool/bloom_filter 1.00 12.9±0.04ms 19.4 MB/sec 1.01 13.0±0.09ms 19.3 MB/sec bool/cdc 1.02 15.8±0.04ms 15.8 MB/sec 1.00 15.5±0.10ms 16.2 MB/sec bool/default 1.00 10.8±0.03ms 23.2 MB/sec 1.01 10.9±0.09ms 23.0 MB/sec bool/parquet_2 1.00 14.6±0.04ms 17.2 MB/sec 1.01 14.7±0.10ms 17.0 MB/sec bool/zstd 1.00 11.3±0.04ms 22.1 MB/sec 1.01 11.4±0.07ms 21.9 MB/sec bool/zstd_parquet_2 1.00 14.9±0.04ms 16.7 MB/sec 1.01 15.0±0.09ms 16.6 MB/sec bool_non_null/bloom_filter 1.00 6.9±0.03ms 18.1 MB/sec 1.01 6.9±0.03ms 18.0 MB/sec bool_non_null/cdc 1.00 6.7±0.03ms 18.7 MB/sec 1.00 6.7±0.02ms 18.7 MB/sec bool_non_null/default 1.00 4.2±0.02ms 30.1 MB/sec 1.00 4.2±0.01ms 30.0 MB/sec bool_non_null/parquet_2 1.00 8.9±0.04ms 14.0 MB/sec 1.00 8.9±0.03ms 14.0 MB/sec bool_non_null/zstd 1.00 4.5±0.01ms 27.8 MB/sec 1.01 4.5±0.02ms 27.6 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.03ms 13.4 MB/sec 1.00 9.4±0.05ms 13.3 MB/sec float_with_nans/bloom_filter 1.00 92.6±0.31ms 151.1 MB/sec 1.01 93.1±0.30ms 150.3 MB/sec float_with_nans/cdc 1.01 82.0±0.41ms 170.8 MB/sec 1.00 81.4±0.15ms 172.0 MB/sec float_with_nans/default 1.00 74.6±0.23ms 187.7 MB/sec 1.00 74.5±0.18ms 188.0 MB/sec float_with_nans/parquet_2 1.00 94.4±0.42ms 148.3 MB/sec 1.01 95.2±0.29ms 147.1 MB/sec float_with_nans/zstd 1.00 111.9±0.23ms 125.1 MB/sec 1.00 112.2±0.15ms 124.8 MB/sec float_with_nans/zstd_parquet_2 1.00 131.4±0.45ms 106.6 MB/sec 1.01 132.2±0.30ms 105.9 MB/sec list_primitive/bloom_filter 1.02 319.4±0.78ms 1707.3 MB/sec 1.00 313.6±1.75ms 1739.3 MB/sec list_primitive/cdc 1.05 355.4±0.75ms 1534.6 MB/sec 1.00 339.9±1.77ms 1604.6 MB/sec list_primitive/default 1.06 245.5±1.19ms 2.2 GB/sec 1.00 231.3±1.69ms 2.3 GB/sec list_primitive/parquet_2 1.04 265.8±0.48ms 2.0 GB/sec 1.00 254.8±0.86ms 2.1 GB/sec list_primitive/zstd 1.03 494.0±0.81ms 1104.0 MB/sec 1.00 479.0±1.34ms 1138.7 MB/sec list_primitive/zstd_parquet_2 1.02 489.3±0.48ms 1114.6 MB/sec 1.00 478.4±0.59ms 1139.9 MB/sec list_primitive_non_null/bloom_filter 1.02 414.4±4.36ms 1313.3 MB/sec 1.00 405.7±3.86ms 1341.5 MB/sec list_primitive_non_null/cdc 1.01 429.1±5.06ms 1268.2 MB/sec 1.00 423.0±9.08ms 1286.7 MB/sec list_primitive_non_null/default 1.04 282.8±2.93ms 1924.7 MB/sec 1.00 271.1±3.62ms 2007.4 MB/sec list_primitive_non_null/parquet_2 1.02 298.1±10.42ms 1825.9 MB/sec 1.00 291.8±8.79ms 1865.2 MB/sec list_primitive_non_null/zstd 1.01 700.0±11.20ms 777.4 MB/sec 1.00 691.6±5.35ms 786.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 664.4±0.69ms 819.1 MB/sec 1.00 662.6±3.55ms 821.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 11.1±0.04ms 3.3 GB/sec 1.03 11.4±0.06ms 3.2 GB/sec list_primitive_sparse_99pct_null/cdc 1.04 22.8±0.11ms 1638.6 MB/sec 1.00 21.8±0.08ms 1710.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 10.8±0.06ms 3.4 GB/sec 1.03 11.1±0.05ms 3.3 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.02ms 3.4 GB/sec 1.03 11.0±0.05ms 3.3 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 12.6±0.09ms 2.9 GB/sec 1.02 12.9±0.06ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 11.2±0.11ms 3.3 GB/sec 1.01 11.3±0.05ms 3.2 GB/sec primitive/bloom_filter 1.02 150.4±1.06ms 298.4 MB/sec 1.00 147.9±1.51ms 303.5 MB/sec primitive/cdc 1.01 158.6±0.56ms 283.0 MB/sec 1.00 157.3±0.84ms 285.3 MB/sec primitive/default 1.01 118.5±0.58ms 378.6 MB/sec 1.00 117.7±0.51ms 381.2 MB/sec primitive/parquet_2 1.00 133.1±0.49ms 337.2 MB/sec 1.00 133.3±0.85ms 336.6 MB/sec primitive/zstd 1.00 147.8±0.40ms 303.6 MB/sec 1.01 148.5±0.80ms 302.1 MB/sec primitive/zstd_parquet_2 1.00 166.2±0.81ms 269.9 MB/sec 1.01 167.4±0.63ms 268.0 MB/sec primitive_all_null/bloom_filter 1.00 11.6±0.19ms 3.8 GB/sec 1.00 11.6±0.24ms 3.8 GB/sec primitive_all_null/cdc 1.02 28.7±0.38ms 1563.7 MB/sec 1.00 28.0±0.28ms 1601.8 MB/sec primitive_all_null/default 1.01 11.0±0.27ms 4.0 GB/sec 1.00 10.9±0.11ms 4.0 GB/sec primitive_all_null/parquet_2 1.01 11.0±0.23ms 4.0 GB/sec 1.00 10.9±0.11ms 4.0 GB/sec primitive_all_null/zstd 1.00 11.1±0.24ms 4.0 GB/sec 1.00 11.1±0.17ms 4.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 11.1±0.23ms 4.0 GB/sec 1.00 11.0±0.14ms 4.0 GB/sec primitive_non_null/bloom_filter 1.00 113.1±1.02ms 389.2 MB/sec 1.01 113.9±1.45ms 386.4 MB/sec primitive_non_null/cdc 1.00 90.5±0.29ms 486.2 MB/sec 1.00 90.1±0.27ms 488.6 MB/sec primitive_non_null/default 1.00 67.7±0.26ms 649.8 MB/sec 1.01 68.3±0.46ms 644.5 MB/sec primitive_non_null/parquet_2 1.00 89.0±0.21ms 494.2 MB/sec 1.01 89.7±0.35ms 490.7 MB/sec primitive_non_null/zstd 1.00 106.1±0.34ms 414.6 MB/sec 1.01 106.7±0.27ms 412.4 MB/sec primitive_non_null/zstd_parquet_2 1.00 130.9±1.87ms 336.1 MB/sec 1.00 131.0±1.97ms 335.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 18.1±0.16ms 2.4 GB/sec 1.00 18.0±0.15ms 2.4 GB/sec primitive_sparse_99pct_null/cdc 1.05 35.9±0.42ms 1250.5 MB/sec 1.00 34.3±0.32ms 1307.6 MB/sec primitive_sparse_99pct_null/default 1.00 16.6±0.06ms 2.6 GB/sec 1.00 16.7±0.07ms 2.6 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 16.7±0.05ms 2.6 GB/sec 1.00 16.7±0.08ms 2.6 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.0±0.07ms 2.2 GB/sec 1.00 20.0±0.10ms 2.2 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 18.5±0.06ms 2.4 GB/sec 1.00 18.6±0.08ms 2.4 GB/sec string/bloom_filter 1.02 218.9±20.53ms 2.3 GB/sec 1.00 214.1±17.77ms 2.4 GB/sec string/cdc 1.00 218.7±2.29ms 2.3 GB/sec 1.01 221.0±8.58ms 2.3 GB/sec string/default 1.02 128.8±18.71ms 4.0 GB/sec 1.00 126.8±16.88ms 4.0 GB/sec string/parquet_2 1.00 104.9±0.76ms 4.9 GB/sec 1.10 115.3±4.63ms 4.4 GB/sec string/zstd 1.00 414.4±1.29ms 1265.2 MB/sec 1.00 415.2±1.64ms 1262.7 MB/sec string/zstd_parquet_2 1.00 393.9±0.50ms 1331.0 MB/sec 1.03 404.4±7.38ms 1296.4 MB/sec string_and_binary_view/bloom_filter 1.00 63.7±0.31ms 506.3 MB/sec 1.00 63.5±0.24ms 507.8 MB/sec string_and_binary_view/cdc 1.01 58.6±0.15ms 550.3 MB/sec 1.00 57.9±0.11ms 557.5 MB/sec string_and_binary_view/default 1.00 47.7±0.13ms 676.6 MB/sec 1.00 47.8±0.11ms 675.2 MB/sec string_and_binary_view/parquet_2 1.00 58.5±0.13ms 551.5 MB/sec 1.00 58.7±0.12ms 549.7 MB/sec string_and_binary_view/zstd 1.00 84.3±0.12ms 382.7 MB/sec 1.00 84.6±0.16ms 381.4 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.4±0.11ms 445.2 MB/sec 1.00 72.5±0.13ms 444.7 MB/sec string_dictionary/bloom_filter 1.00 89.4±0.47ms 2.9 GB/sec 1.00 89.4±0.35ms 2.9 GB/sec string_dictionary/cdc 1.00 51.6±1.22ms 5.0 GB/sec 1.02 52.7±0.63ms 4.9 GB/sec string_dictionary/default 1.00 48.5±0.42ms 5.3 GB/sec 1.01 48.9±0.47ms 5.3 GB/sec string_dictionary/parquet_2 1.00 53.4±0.21ms 4.8 GB/sec 1.01 54.0±0.25ms 4.8 GB/sec string_dictionary/zstd 1.00 209.0±0.48ms 1263.9 MB/sec 1.00 209.0±0.34ms 1264.0 MB/sec string_dictionary/zstd_parquet_2 1.00 198.7±0.81ms 1329.5 MB/sec 1.00 198.2±0.21ms 1332.6 MB/sec string_non_null/bloom_filter 1.00 248.0±9.99ms 2.1 GB/sec 1.00 247.9±14.92ms 2.1 GB/sec string_non_null/cdc 1.01 273.0±9.20ms 1919.6 MB/sec 1.00 269.3±6.46ms 1945.9 MB/sec string_non_null/default 1.01 136.5±7.46ms 3.7 GB/sec 1.00 135.1±14.69ms 3.8 GB/sec string_non_null/parquet_2 1.00 140.3±5.81ms 3.6 GB/sec 1.00 140.6±8.54ms 3.6 GB/sec string_non_null/zstd 1.05 561.4±11.02ms 933.4 MB/sec 1.00 532.8±2.74ms 983.5 MB/sec string_non_null/zstd_parquet_2 1.03 520.4±7.02ms 1006.9 MB/sec 1.00 502.8±0.48ms 1042.1 MB/sec struct_all_null/bloom_filter 1.00 2.5±0.00ms 6.2 GB/sec 1.65 4.2±0.03ms 3.8 GB/sec struct_all_null/cdc 1.00 9.4±0.10ms 1708.1 MB/sec 1.14 10.7±0.18ms 1501.2 MB/sec struct_all_null/default 1.00 2.3±0.00ms 7.0 GB/sec 1.72 3.9±0.02ms 4.1 GB/sec struct_all_null/parquet_2 1.00 2.3±0.00ms 7.0 GB/sec 1.73 3.9±0.04ms 4.0 GB/sec struct_all_null/zstd 1.00 2.3±0.00ms 6.8 GB/sec 1.70 3.9±0.02ms 4.0 GB/sec struct_all_null/zstd_parquet_2 1.00 2.3±0.00ms 6.9 GB/sec 1.72 3.9±0.05ms 4.0 GB/sec struct_non_null/bloom_filter 1.00 46.2±0.16ms 346.6 MB/sec 1.07 49.6±0.20ms 322.5 MB/sec struct_non_null/cdc 1.00 45.6±0.16ms 351.1 MB/sec 1.01 46.2±0.14ms 346.2 MB/sec struct_non_null/default 1.00 32.0±0.12ms 500.2 MB/sec 1.06 34.0±0.10ms 471.1 MB/sec struct_non_null/parquet_2 1.00 40.6±0.13ms 394.0 MB/sec 1.05 42.5±0.11ms 376.7 MB/sec struct_non_null/zstd 1.00 40.8±0.13ms 392.5 MB/sec 1.05 42.6±0.10ms 375.6 MB/sec struct_non_null/zstd_parquet_2 1.00 54.8±0.11ms 291.9 MB/sec 1.02 56.0±0.12ms 285.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.02 7.5±0.10ms 2.1 GB/sec 1.00 7.4±0.10ms 2.1 GB/sec struct_sparse_99pct_null/cdc 1.05 14.5±0.11ms 1115.5 MB/sec 1.00 13.8±0.12ms 1171.0 MB/sec struct_sparse_99pct_null/default 1.03 7.0±0.07ms 2.2 GB/sec 1.00 6.8±0.02ms 2.3 GB/sec struct_sparse_99pct_null/parquet_2 1.02 7.0±0.06ms 2.3 GB/sec 1.00 6.8±0.04ms 2.3 GB/sec struct_sparse_99pct_null/zstd 1.02 8.4±0.06ms 1925.7 MB/sec 1.00 8.2±0.02ms 1972.6 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 7.7±0.06ms 2.0 GB/sec 1.00 7.6±0.02ms 2.1 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1910.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1861.2s | | CPU sys | 44.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1925.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1876.4s | | CPU sys | 46.8s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
