adriangbot commented on PR #9653: URL: https://github.com/apache/arrow-rs/pull/9653#issuecomment-4522160162
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9653#issuecomment-4213853435) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group faster_sparse_columns_encoding main ----- ------------------------------ ---- bool/bloom_filter 1.00 13.0±0.07ms 19.2 MB/sec 1.01 13.2±0.08ms 18.9 MB/sec bool/cdc 1.00 15.7±0.04ms 15.9 MB/sec 1.03 16.2±0.16ms 15.4 MB/sec bool/default 1.00 10.9±0.03ms 22.9 MB/sec 1.02 11.1±0.06ms 22.4 MB/sec bool/parquet_2 1.00 14.6±0.07ms 17.1 MB/sec 1.02 15.0±0.07ms 16.7 MB/sec bool/zstd 1.00 11.3±0.03ms 22.0 MB/sec 1.03 11.7±0.07ms 21.5 MB/sec bool/zstd_parquet_2 1.00 15.0±0.03ms 16.7 MB/sec 1.02 15.4±0.09ms 16.3 MB/sec bool_non_null/bloom_filter 1.00 6.8±0.03ms 18.4 MB/sec 1.03 7.0±0.03ms 17.7 MB/sec bool_non_null/cdc 1.00 6.5±0.04ms 19.3 MB/sec 1.07 6.9±0.14ms 18.1 MB/sec bool_non_null/default 1.00 4.0±0.03ms 31.0 MB/sec 1.06 4.3±0.02ms 29.2 MB/sec bool_non_null/parquet_2 1.00 8.7±0.06ms 14.3 MB/sec 1.04 9.1±0.05ms 13.8 MB/sec bool_non_null/zstd 1.00 4.4±0.03ms 28.5 MB/sec 1.06 4.6±0.02ms 27.0 MB/sec bool_non_null/zstd_parquet_2 1.00 9.1±0.04ms 13.7 MB/sec 1.03 9.5±0.04ms 13.2 MB/sec float_with_nans/bloom_filter 1.00 92.0±1.75ms 152.2 MB/sec 1.02 94.0±2.35ms 149.0 MB/sec float_with_nans/cdc 1.00 79.6±1.18ms 176.0 MB/sec 1.02 81.5±0.22ms 171.7 MB/sec float_with_nans/default 1.00 74.5±1.24ms 187.8 MB/sec 1.02 75.7±1.38ms 184.9 MB/sec float_with_nans/parquet_2 1.00 93.7±1.78ms 149.5 MB/sec 1.01 94.5±0.48ms 148.2 MB/sec float_with_nans/zstd 1.00 110.3±1.04ms 126.9 MB/sec 1.02 112.7±1.01ms 124.2 MB/sec float_with_nans/zstd_parquet_2 1.00 133.2±1.49ms 105.1 MB/sec 1.00 133.8±2.23ms 104.6 MB/sec list_primitive/bloom_filter 1.11 377.6±14.34ms 1444.3 MB/sec 1.00 340.4±11.68ms 1602.1 MB/sec list_primitive/cdc 1.14 419.6±4.95ms 1299.7 MB/sec 1.00 368.0±5.01ms 1481.8 MB/sec list_primitive/default 1.13 292.1±4.91ms 1867.1 MB/sec 1.00 257.7±4.16ms 2.1 GB/sec list_primitive/parquet_2 1.12 314.2±3.86ms 1735.8 MB/sec 1.00 280.0±2.63ms 1947.4 MB/sec list_primitive/zstd 1.07 546.7±7.06ms 997.6 MB/sec 1.00 509.4±6.40ms 1070.5 MB/sec list_primitive/zstd_parquet_2 1.07 537.4±4.04ms 1014.8 MB/sec 1.00 502.3±3.14ms 1085.8 MB/sec list_primitive_non_null/bloom_filter 1.00 409.9±18.71ms 1327.7 MB/sec 1.04 424.5±15.86ms 1281.9 MB/sec list_primitive_non_null/cdc 1.00 417.2±15.50ms 1304.6 MB/sec 1.05 440.0±10.57ms 1236.8 MB/sec list_primitive_non_null/default 1.00 267.8±5.61ms 2031.9 MB/sec 1.11 297.7±10.41ms 1827.9 MB/sec list_primitive_non_null/parquet_2 1.00 294.7±14.82ms 1846.7 MB/sec 1.04 307.2±14.97ms 1771.8 MB/sec list_primitive_non_null/zstd 1.00 696.5±8.15ms 781.4 MB/sec 1.04 721.9±11.61ms 753.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 686.1±9.56ms 793.2 MB/sec 1.00 688.1±6.43ms 791.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.05 12.4±0.66ms 2.9 GB/sec 1.00 11.8±0.05ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.6±0.37ms 1584.1 MB/sec 1.02 24.0±0.20ms 1554.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.0±0.49ms 3.0 GB/sec 1.00 11.9±0.22ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 11.5±0.30ms 3.2 GB/sec 1.01 11.6±0.19ms 3.1 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 13.2±0.05ms 2.8 GB/sec 1.03 13.6±0.33ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.02 11.8±0.35ms 3.1 GB/sec 1.00 11.6±0.06ms 3.1 GB/sec primitive/bloom_filter 1.02 154.0±2.37ms 291.5 MB/sec 1.00 151.1±3.24ms 296.9 MB/sec primitive/cdc 1.00 158.8±2.08ms 282.5 MB/sec 1.03 163.0±1.63ms 275.4 MB/sec primitive/default 1.00 117.4±0.31ms 382.3 MB/sec 1.02 119.8±2.10ms 374.5 MB/sec primitive/parquet_2 1.00 133.4±1.92ms 336.4 MB/sec 1.02 135.8±1.39ms 330.5 MB/sec primitive/zstd 1.00 147.8±1.87ms 303.7 MB/sec 1.01 149.9±2.24ms 299.4 MB/sec primitive/zstd_parquet_2 1.01 168.8±1.61ms 265.9 MB/sec 1.00 167.6±1.73ms 267.7 MB/sec primitive_all_null/bloom_filter 1.00 886.8±3.60µs 49.4 GB/sec 1.02 901.8±27.81µs 48.6 GB/sec primitive_all_null/cdc 1.00 18.3±0.20ms 2.4 GB/sec 1.03 18.8±0.32ms 2.3 GB/sec primitive_all_null/default 1.00 275.0±1.33µs 159.3 GB/sec 1.00 274.5±1.11µs 159.7 GB/sec primitive_all_null/parquet_2 1.00 272.5±0.85µs 160.8 GB/sec 1.02 279.2±1.59µs 156.9 GB/sec primitive_all_null/zstd 1.00 384.9±1.55µs 113.8 GB/sec 1.01 389.0±1.23µs 112.7 GB/sec primitive_all_null/zstd_parquet_2 1.00 350.7±1.05µs 125.0 GB/sec 1.02 356.4±1.98µs 123.0 GB/sec primitive_non_null/bloom_filter 1.00 98.2±0.31ms 448.0 MB/sec 1.08 106.4±1.68ms 413.7 MB/sec primitive_non_null/cdc 1.00 81.1±0.37ms 542.5 MB/sec 1.11 89.9±0.57ms 489.4 MB/sec primitive_non_null/default 1.00 59.5±0.16ms 739.9 MB/sec 1.13 67.0±0.32ms 657.0 MB/sec primitive_non_null/parquet_2 1.00 82.1±0.41ms 535.8 MB/sec 1.08 88.5±0.29ms 497.0 MB/sec primitive_non_null/zstd 1.00 91.0±1.29ms 483.7 MB/sec 1.16 105.9±1.58ms 415.4 MB/sec primitive_non_null/zstd_parquet_2 1.00 115.3±0.98ms 381.7 MB/sec 1.13 129.8±3.16ms 339.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.07 12.8±0.79ms 3.4 GB/sec 1.00 12.0±0.18ms 3.7 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.9±0.10ms 1453.6 MB/sec 1.05 32.3±0.44ms 1387.8 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.12ms 4.1 GB/sec 1.04 11.1±0.29ms 3.9 GB/sec primitive_sparse_99pct_null/parquet_2 1.04 11.0±0.40ms 4.0 GB/sec 1.00 10.5±0.05ms 4.2 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.0±0.05ms 3.1 GB/sec 1.01 14.1±0.40ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.02 12.7±0.06ms 3.5 GB/sec 1.00 12.5±0.09ms 3.5 GB/sec string/bloom_filter 1.00 221.8±23.69ms 2.3 GB/sec 1.08 240.0±28.62ms 2.1 GB/sec string/cdc 1.00 217.0±6.77ms 2.4 GB/sec 1.04 225.0±7.60ms 2.3 GB/sec string/default 1.09 141.7±21.23ms 3.6 GB/sec 1.00 130.3±23.68ms 3.9 GB/sec string/parquet_2 1.10 124.1±1.15ms 4.1 GB/sec 1.00 113.0±8.05ms 4.5 GB/sec string/zstd 1.05 445.5±20.12ms 1176.9 MB/sec 1.00 422.4±7.49ms 1241.1 MB/sec string/zstd_parquet_2 1.00 397.4±3.06ms 1319.2 MB/sec 1.02 404.4±6.39ms 1296.4 MB/sec string_and_binary_view/bloom_filter 1.03 70.8±2.52ms 455.7 MB/sec 1.00 68.6±1.45ms 470.4 MB/sec string_and_binary_view/cdc 1.07 62.8±0.83ms 513.8 MB/sec 1.00 58.8±0.24ms 548.9 MB/sec string_and_binary_view/default 1.06 51.2±0.90ms 629.7 MB/sec 1.00 48.4±0.17ms 666.6 MB/sec string_and_binary_view/parquet_2 1.01 62.1±1.51ms 519.0 MB/sec 1.00 61.3±1.35ms 526.0 MB/sec string_and_binary_view/zstd 1.02 87.5±1.42ms 368.4 MB/sec 1.00 86.0±1.68ms 375.2 MB/sec string_and_binary_view/zstd_parquet_2 1.01 75.3±0.11ms 428.5 MB/sec 1.00 74.2±1.55ms 434.7 MB/sec string_dictionary/bloom_filter 1.00 91.1±5.21ms 2.8 GB/sec 1.05 95.7±6.85ms 2.7 GB/sec string_dictionary/cdc 1.00 53.4±1.83ms 4.8 GB/sec 1.04 55.7±3.59ms 4.6 GB/sec string_dictionary/default 1.06 52.2±2.28ms 4.9 GB/sec 1.00 49.1±2.04ms 5.3 GB/sec string_dictionary/parquet_2 1.00 53.7±0.37ms 4.8 GB/sec 1.04 55.8±1.96ms 4.6 GB/sec string_dictionary/zstd 1.00 207.1±2.24ms 1275.4 MB/sec 1.01 209.7±3.70ms 1259.8 MB/sec string_dictionary/zstd_parquet_2 1.00 200.6±2.12ms 1316.6 MB/sec 1.00 201.3±1.62ms 1311.8 MB/sec string_non_null/bloom_filter 1.00 231.2±12.36ms 2.2 GB/sec 1.19 274.9±23.54ms 1906.4 MB/sec string_non_null/cdc 1.00 264.2±9.74ms 1983.3 MB/sec 1.03 271.6±9.12ms 1929.0 MB/sec string_non_null/default 1.00 110.8±9.85ms 4.6 GB/sec 1.29 143.2±14.28ms 3.6 GB/sec string_non_null/parquet_2 1.00 132.2±8.47ms 3.9 GB/sec 1.15 151.8±4.80ms 3.4 GB/sec string_non_null/zstd 1.00 544.7±8.06ms 962.0 MB/sec 1.04 568.4±12.03ms 921.9 MB/sec string_non_null/zstd_parquet_2 1.00 512.4±5.88ms 1022.7 MB/sec 1.01 517.3±5.89ms 1012.9 MB/sec struct_all_null/bloom_filter 1.00 377.6±6.08µs 41.7 GB/sec 1.00 376.3±5.04µs 41.8 GB/sec struct_all_null/cdc 1.01 7.8±0.53ms 2.0 GB/sec 1.00 7.7±0.14ms 2.1 GB/sec struct_all_null/default 1.00 117.8±0.55µs 133.6 GB/sec 1.01 119.1±0.47µs 132.3 GB/sec struct_all_null/parquet_2 1.00 117.5±0.47µs 134.1 GB/sec 1.03 120.5±0.57µs 130.7 GB/sec struct_all_null/zstd 1.00 164.9±0.65µs 95.5 GB/sec 1.01 166.6±1.15µs 94.5 GB/sec struct_all_null/zstd_parquet_2 1.00 150.6±0.50µs 104.6 GB/sec 1.02 153.4±0.74µs 102.6 GB/sec struct_non_null/bloom_filter 1.00 44.1±1.40ms 362.6 MB/sec 1.06 46.8±1.34ms 341.8 MB/sec struct_non_null/cdc 1.00 42.3±0.63ms 378.0 MB/sec 1.08 45.7±0.87ms 349.8 MB/sec struct_non_null/default 1.00 29.6±0.65ms 540.2 MB/sec 1.08 32.1±0.14ms 499.2 MB/sec struct_non_null/parquet_2 1.00 37.8±0.11ms 423.7 MB/sec 1.07 40.5±0.23ms 394.7 MB/sec struct_non_null/zstd 1.00 38.4±0.38ms 416.5 MB/sec 1.07 41.0±0.49ms 390.3 MB/sec struct_non_null/zstd_parquet_2 1.00 52.6±0.64ms 304.1 MB/sec 1.06 55.6±0.66ms 287.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.4±0.02ms 2.5 GB/sec 1.00 6.4±0.23ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.8±0.34ms 1170.5 MB/sec 1.05 14.4±0.13ms 1118.8 MB/sec struct_sparse_99pct_null/default 1.04 6.1±0.23ms 2.6 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.02 6.0±0.04ms 2.6 GB/sec 1.00 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.03 7.8±0.04ms 2.0 GB/sec 1.00 7.6±0.13ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 7.1±0.22ms 2.2 GB/sec 1.00 7.0±0.20ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1945.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1889.7s | | CPU sys | 54.1s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 1920.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.3 GiB | | CPU user | 1870.7s | | CPU sys | 47.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
