adriangbot commented on PR #9972: URL: https://github.com/apache/arrow-rs/pull/9972#issuecomment-4463570329
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/9972#issuecomment-4462912234) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group main parquet-page-size-mid-batch ----- ---- --------------------------- bool/bloom_filter 1.01 13.2±0.08ms 19.0 MB/sec 1.00 13.1±0.06ms 19.1 MB/sec bool/cdc 1.00 16.2±0.10ms 15.5 MB/sec 1.00 16.2±0.07ms 15.4 MB/sec bool/default 1.01 11.0±0.06ms 22.6 MB/sec 1.00 10.9±0.05ms 22.8 MB/sec bool/parquet_2 1.01 14.9±0.08ms 16.8 MB/sec 1.00 14.8±0.05ms 16.9 MB/sec bool/zstd 1.01 11.6±0.07ms 21.6 MB/sec 1.00 11.5±0.06ms 21.8 MB/sec bool/zstd_parquet_2 1.01 15.3±0.08ms 16.4 MB/sec 1.00 15.2±0.06ms 16.5 MB/sec bool_non_null/bloom_filter 1.00 7.0±0.04ms 17.8 MB/sec 1.01 7.1±0.04ms 17.5 MB/sec bool_non_null/cdc 1.00 7.0±0.07ms 18.0 MB/sec 1.02 7.1±0.04ms 17.7 MB/sec bool_non_null/default 1.00 4.3±0.03ms 29.3 MB/sec 1.02 4.4±0.02ms 28.7 MB/sec bool_non_null/parquet_2 1.00 9.0±0.03ms 13.9 MB/sec 1.02 9.2±0.05ms 13.6 MB/sec bool_non_null/zstd 1.00 4.6±0.03ms 27.0 MB/sec 1.03 4.8±0.03ms 26.3 MB/sec bool_non_null/zstd_parquet_2 1.00 9.4±0.04ms 13.3 MB/sec 1.02 9.6±0.04ms 13.1 MB/sec float_with_nans/bloom_filter 1.03 99.5±3.55ms 140.7 MB/sec 1.00 96.2±2.54ms 145.5 MB/sec float_with_nans/cdc 1.01 84.9±1.61ms 164.9 MB/sec 1.00 84.4±1.58ms 166.0 MB/sec float_with_nans/default 1.03 78.2±1.51ms 179.0 MB/sec 1.00 76.3±0.82ms 183.6 MB/sec float_with_nans/parquet_2 1.01 98.8±2.38ms 141.7 MB/sec 1.00 97.9±2.09ms 143.1 MB/sec float_with_nans/zstd 1.01 115.4±1.89ms 121.4 MB/sec 1.00 113.9±1.30ms 122.9 MB/sec float_with_nans/zstd_parquet_2 1.01 137.6±2.42ms 101.7 MB/sec 1.00 136.0±1.19ms 102.9 MB/sec large_string_non_null/bloom_filter 1.00 84.3±3.26ms 3.0 GB/sec large_string_non_null/cdc 1.00 245.7±2.72ms 1041.8 MB/sec large_string_non_null/default 1.00 65.1±3.20ms 3.8 GB/sec large_string_non_null/parquet_2 1.00 63.6±2.96ms 3.9 GB/sec large_string_non_null/zstd 1.00 66.6±1.72ms 3.8 GB/sec large_string_non_null/zstd_parquet_2 1.00 65.2±1.71ms 3.8 GB/sec list_primitive/bloom_filter 1.01 360.9±14.46ms 1511.2 MB/sec 1.00 355.9±13.37ms 1532.3 MB/sec list_primitive/cdc 1.00 370.0±4.53ms 1474.2 MB/sec 1.00 368.7±3.89ms 1479.0 MB/sec list_primitive/default 1.00 262.1±5.03ms 2.0 GB/sec 1.00 262.1±3.87ms 2.0 GB/sec list_primitive/parquet_2 1.01 281.0±2.48ms 1940.8 MB/sec 1.00 278.7±2.15ms 1956.8 MB/sec list_primitive/zstd 1.01 517.4±5.04ms 1054.0 MB/sec 1.00 512.7±4.14ms 1063.8 MB/sec list_primitive/zstd_parquet_2 1.00 504.1±3.10ms 1081.9 MB/sec 1.00 502.0±2.27ms 1086.5 MB/sec list_primitive_non_null/bloom_filter 1.08 461.4±18.82ms 1179.5 MB/sec 1.00 428.1±14.10ms 1271.2 MB/sec list_primitive_non_null/cdc 1.00 443.5±6.74ms 1227.0 MB/sec 1.00 444.4±11.77ms 1224.6 MB/sec list_primitive_non_null/default 1.04 302.3±7.41ms 1800.2 MB/sec 1.00 291.1±6.44ms 1869.7 MB/sec list_primitive_non_null/parquet_2 1.07 329.4±4.81ms 1652.1 MB/sec 1.00 307.9±9.41ms 1767.8 MB/sec list_primitive_non_null/zstd 1.03 733.2±13.41ms 742.3 MB/sec 1.00 712.0±7.69ms 764.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.04 702.2±6.13ms 775.0 MB/sec 1.00 675.2±3.23ms 806.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 12.3±0.12ms 3.0 GB/sec 1.00 11.9±0.20ms 3.1 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.7±0.17ms 1574.9 MB/sec 1.00 23.7±0.11ms 1574.6 MB/sec list_primitive_sparse_99pct_null/default 1.01 11.8±0.09ms 3.1 GB/sec 1.00 11.6±0.19ms 3.1 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.04 11.9±0.06ms 3.1 GB/sec 1.00 11.5±0.21ms 3.2 GB/sec list_primitive_sparse_99pct_null/zstd 1.03 13.7±0.16ms 2.7 GB/sec 1.00 13.3±0.20ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.02 12.0±0.09ms 3.0 GB/sec 1.00 11.7±0.18ms 3.1 GB/sec primitive/bloom_filter 1.01 158.2±4.33ms 283.7 MB/sec 1.00 156.6±3.31ms 286.6 MB/sec primitive/cdc 1.01 164.0±1.79ms 273.6 MB/sec 1.00 162.0±2.09ms 277.0 MB/sec primitive/default 1.01 122.7±1.40ms 365.9 MB/sec 1.00 121.5±1.48ms 369.5 MB/sec primitive/parquet_2 1.00 136.3±1.72ms 329.2 MB/sec 1.00 135.7±1.73ms 330.6 MB/sec primitive/zstd 1.01 152.3±1.34ms 294.6 MB/sec 1.00 150.8±1.85ms 297.7 MB/sec primitive/zstd_parquet_2 1.01 171.7±2.28ms 261.3 MB/sec 1.00 169.7±1.78ms 264.5 MB/sec primitive_all_null/bloom_filter 1.00 929.5±24.01µs 47.1 GB/sec 1.00 927.8±26.67µs 47.2 GB/sec primitive_all_null/cdc 1.00 17.8±0.24ms 2.5 GB/sec 1.04 18.5±0.31ms 2.4 GB/sec primitive_all_null/default 1.00 262.5±1.21µs 167.0 GB/sec 1.05 275.0±1.05µs 159.4 GB/sec primitive_all_null/parquet_2 1.00 260.2±1.76µs 168.4 GB/sec 1.08 281.8±1.76µs 155.5 GB/sec primitive_all_null/zstd 1.00 375.4±1.90µs 116.7 GB/sec 1.05 392.8±1.94µs 111.6 GB/sec primitive_all_null/zstd_parquet_2 1.00 335.6±1.38µs 130.6 GB/sec 1.07 358.9±0.99µs 122.1 GB/sec primitive_non_null/bloom_filter 1.05 119.1±3.66ms 369.3 MB/sec 1.00 113.6±1.42ms 387.3 MB/sec primitive_non_null/cdc 1.01 94.7±2.01ms 464.5 MB/sec 1.00 94.1±0.85ms 467.6 MB/sec primitive_non_null/default 1.02 71.7±0.92ms 613.5 MB/sec 1.00 70.4±1.57ms 625.1 MB/sec primitive_non_null/parquet_2 1.01 92.6±1.78ms 475.0 MB/sec 1.00 92.1±1.71ms 477.9 MB/sec primitive_non_null/zstd 1.08 109.6±2.35ms 401.5 MB/sec 1.00 101.3±1.95ms 434.2 MB/sec primitive_non_null/zstd_parquet_2 1.06 133.9±3.12ms 328.6 MB/sec 1.00 125.7±1.67ms 349.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 19.7±0.31ms 2.2 GB/sec 1.00 19.6±0.40ms 2.2 GB/sec primitive_sparse_99pct_null/cdc 1.01 36.6±0.40ms 1224.4 MB/sec 1.00 36.4±0.34ms 1232.4 MB/sec primitive_sparse_99pct_null/default 1.00 17.4±0.13ms 2.5 GB/sec 1.00 17.5±0.08ms 2.5 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 17.5±0.20ms 2.5 GB/sec 1.00 17.4±0.21ms 2.5 GB/sec primitive_sparse_99pct_null/zstd 1.00 20.8±0.22ms 2.1 GB/sec 1.00 20.7±0.22ms 2.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.02 19.5±0.23ms 2.2 GB/sec 1.00 19.2±0.23ms 2.3 GB/sec short_string_non_null/bloom_filter 1.00 28.6±0.57ms 419.8 MB/sec short_string_non_null/cdc 1.00 20.6±0.19ms 583.7 MB/sec short_string_non_null/default 1.00 16.3±0.15ms 736.0 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.12ms 466.4 MB/sec short_string_non_null/zstd 1.00 35.7±0.17ms 335.9 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.6±0.09ms 419.8 MB/sec string/bloom_filter 1.10 251.2±24.68ms 2.0 GB/sec 1.00 228.0±11.12ms 2.2 GB/sec string/cdc 1.03 229.0±6.26ms 2.2 GB/sec 1.00 222.9±3.10ms 2.3 GB/sec string/default 1.00 129.3±18.07ms 4.0 GB/sec 1.08 139.5±18.20ms 3.7 GB/sec string/parquet_2 1.00 115.7±6.41ms 4.4 GB/sec 1.01 117.2±6.37ms 4.4 GB/sec string/zstd 1.00 430.3±4.32ms 1218.4 MB/sec 1.01 435.1±4.57ms 1204.9 MB/sec string/zstd_parquet_2 1.01 408.8±6.57ms 1282.4 MB/sec 1.00 404.0±4.27ms 1297.5 MB/sec string_and_binary_view/bloom_filter 1.00 69.6±2.56ms 463.1 MB/sec 1.07 74.5±2.01ms 432.8 MB/sec string_and_binary_view/cdc 1.00 60.4±1.92ms 533.9 MB/sec 1.06 63.9±2.00ms 504.9 MB/sec string_and_binary_view/default 1.00 49.7±1.73ms 649.2 MB/sec 1.06 52.7±1.80ms 612.5 MB/sec string_and_binary_view/parquet_2 1.00 61.8±0.74ms 521.9 MB/sec 1.04 64.4±1.27ms 500.7 MB/sec string_and_binary_view/zstd 1.00 87.7±1.72ms 367.9 MB/sec 1.03 90.4±2.13ms 356.9 MB/sec string_and_binary_view/zstd_parquet_2 1.00 75.2±1.98ms 429.0 MB/sec 1.03 77.8±1.82ms 414.7 MB/sec string_dictionary/bloom_filter 1.00 105.6±4.49ms 2.4 GB/sec 1.01 107.1±6.42ms 2.4 GB/sec string_dictionary/cdc 1.00 58.1±3.00ms 4.4 GB/sec 1.01 58.8±2.69ms 4.4 GB/sec string_dictionary/default 1.00 51.5±3.29ms 5.0 GB/sec 1.06 54.5±2.39ms 4.7 GB/sec string_dictionary/parquet_2 1.01 57.3±1.42ms 4.5 GB/sec 1.00 56.9±1.67ms 4.5 GB/sec string_dictionary/zstd 1.00 217.1±3.84ms 1216.5 MB/sec 1.00 216.6±3.80ms 1219.7 MB/sec string_dictionary/zstd_parquet_2 1.00 203.5±1.88ms 1298.0 MB/sec 1.00 203.5±1.58ms 1298.1 MB/sec string_non_null/bloom_filter 1.06 304.3±22.07ms 1722.1 MB/sec 1.00 287.2±22.06ms 1824.4 MB/sec string_non_null/cdc 1.04 287.2±8.24ms 1824.2 MB/sec 1.00 275.0±6.68ms 1905.5 MB/sec string_non_null/default 1.01 154.7±13.00ms 3.3 GB/sec 1.00 153.4±12.86ms 3.3 GB/sec string_non_null/parquet_2 1.02 149.7±9.28ms 3.4 GB/sec 1.00 146.6±5.13ms 3.5 GB/sec string_non_null/zstd 1.07 586.0±12.00ms 894.2 MB/sec 1.00 549.4±7.08ms 953.8 MB/sec string_non_null/zstd_parquet_2 1.03 529.7±7.07ms 989.2 MB/sec 1.00 512.8±4.68ms 1021.9 MB/sec struct_all_null/bloom_filter 1.00 378.0±5.82µs 41.7 GB/sec 1.00 379.4±5.58µs 41.5 GB/sec struct_all_null/cdc 1.00 7.1±0.09ms 2.2 GB/sec 1.04 7.4±0.10ms 2.1 GB/sec struct_all_null/default 1.00 113.3±0.78µs 139.0 GB/sec 1.06 119.8±0.55µs 131.5 GB/sec struct_all_null/parquet_2 1.00 112.3±0.65µs 140.2 GB/sec 1.08 121.4±0.49µs 129.7 GB/sec struct_all_null/zstd 1.00 159.9±0.81µs 98.5 GB/sec 1.05 168.0±0.41µs 93.7 GB/sec struct_all_null/zstd_parquet_2 1.00 145.2±0.77µs 108.5 GB/sec 1.07 154.8±0.33µs 101.7 GB/sec struct_non_null/bloom_filter 1.02 49.5±1.75ms 323.5 MB/sec 1.00 48.3±1.28ms 331.5 MB/sec struct_non_null/cdc 1.01 46.8±0.92ms 341.7 MB/sec 1.00 46.2±0.67ms 346.7 MB/sec struct_non_null/default 1.04 33.7±0.85ms 474.2 MB/sec 1.00 32.5±0.55ms 492.2 MB/sec struct_non_null/parquet_2 1.02 42.0±0.76ms 381.3 MB/sec 1.00 41.3±0.56ms 387.8 MB/sec struct_non_null/zstd 1.03 42.6±0.44ms 375.4 MB/sec 1.00 41.6±0.36ms 385.0 MB/sec struct_non_null/zstd_parquet_2 1.03 57.1±0.71ms 280.3 MB/sec 1.00 55.5±0.54ms 288.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.06 7.1±0.15ms 2.2 GB/sec 1.00 6.7±0.25ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.01 13.9±0.20ms 1161.0 MB/sec 1.00 13.7±0.21ms 1173.3 MB/sec struct_sparse_99pct_null/default 1.03 6.3±0.09ms 2.5 GB/sec 1.00 6.1±0.17ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.04 6.4±0.05ms 2.5 GB/sec 1.00 6.1±0.18ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.01 7.7±0.04ms 2.0 GB/sec 1.00 7.7±0.06ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.03 7.2±0.08ms 2.2 GB/sec 1.00 7.0±0.15ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1965.4s | | Peak memory | 6.6 GiB | | Avg memory | 6.4 GiB | | CPU user | 1910.0s | | CPU sys | 51.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 2095.5s | | Peak memory | 6.8 GiB | | Avg memory | 6.7 GiB | | CPU user | 2056.4s | | CPU sys | 34.1s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
