adriangbot commented on PR #10505: URL: https://github.com/apache/arrow-rs/pull/10505#issuecomment-5334778316
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10505#issuecomment-5333647780) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing fix-delta-byte-array-page-split-10489 (2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group fix-delta-byte-array-page-split-10489 main ----- ------------------------------------- ---- bool/bloom_filter 1.01 12.8±0.05ms 19.6 MB/sec 1.00 12.6±0.03ms 19.8 MB/sec bool/cdc 1.02 15.6±0.08ms 16.0 MB/sec 1.00 15.3±0.05ms 16.3 MB/sec bool/default 1.01 10.6±0.05ms 23.5 MB/sec 1.00 10.5±0.03ms 23.8 MB/sec bool/parquet_2 1.00 13.5±0.04ms 18.5 MB/sec 1.00 13.5±0.03ms 18.6 MB/sec bool/zstd 1.02 11.2±0.13ms 22.2 MB/sec 1.00 11.0±0.03ms 22.7 MB/sec bool/zstd_parquet_2 1.01 14.0±0.12ms 17.9 MB/sec 1.00 13.8±0.03ms 18.1 MB/sec bool_non_null/bloom_filter 1.01 6.7±0.04ms 18.7 MB/sec 1.00 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.02 6.5±0.07ms 19.3 MB/sec 1.00 6.3±0.03ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.6 MB/sec 1.00 3.8±0.02ms 32.8 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.4 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.01 4.2±0.03ms 29.7 MB/sec 1.00 4.2±0.02ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.00 8.1±0.02ms 15.5 MB/sec bool_ree/bloom_filter 1.00 30.1±0.07ms 7.1 MB/sec 1.00 30.1±0.05ms 7.1 MB/sec bool_ree/cdc 1.01 31.6±0.11ms 6.7 MB/sec 1.00 31.3±0.07ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.07ms 7.8 MB/sec 1.00 27.3±0.05ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.07ms 7.4 MB/sec 1.00 28.8±0.05ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.05ms 7.6 MB/sec 1.00 27.9±0.05ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.11ms 7.3 MB/sec 1.00 29.1±0.06ms 7.3 MB/sec decimal/bloom_filter 1.00 118.7±1.13ms 505.4 MB/sec 1.15 136.1±4.81ms 440.8 MB/sec decimal/cdc 1.00 101.0±0.40ms 594.3 MB/sec 1.03 104.1±1.88ms 576.5 MB/sec decimal/default 1.00 78.5±0.33ms 764.5 MB/sec 1.13 89.0±1.91ms 674.4 MB/sec decimal/parquet_2 1.00 178.0±2.04ms 337.1 MB/sec 1.10 195.6±4.18ms 306.8 MB/sec decimal/zstd 1.00 90.0±1.45ms 666.7 MB/sec 1.19 107.2±3.83ms 559.9 MB/sec decimal/zstd_parquet_2 1.00 196.7±1.98ms 305.0 MB/sec 1.13 222.2±7.23ms 270.0 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.5±0.33ms 17.2 MB/sec 1.00 58.3±0.21ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.01 62.1±0.21ms 16.2 MB/sec 1.00 61.6±0.23ms 16.4 MB/sec fixed_size_binary_ree/default 1.00 51.7±0.16ms 19.5 MB/sec 1.00 51.7±0.20ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.01 66.8±1.09ms 15.1 MB/sec 1.00 66.2±0.20ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.3±0.17ms 17.6 MB/sec 1.00 57.6±0.22ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.01 67.5±0.37ms 14.9 MB/sec 1.00 66.8±0.21ms 15.1 MB/sec float_with_nans/bloom_filter 1.00 80.7±1.05ms 173.4 MB/sec 1.00 81.1±0.28ms 172.7 MB/sec float_with_nans/cdc 1.00 70.8±0.43ms 197.9 MB/sec 1.01 71.1±0.88ms 196.8 MB/sec float_with_nans/default 1.00 63.2±0.20ms 221.5 MB/sec 1.00 63.4±1.70ms 220.7 MB/sec float_with_nans/parquet_2 1.00 80.7±0.43ms 173.6 MB/sec 1.00 80.7±0.21ms 173.4 MB/sec float_with_nans/zstd 1.00 101.3±0.21ms 138.3 MB/sec 1.01 102.0±1.31ms 137.3 MB/sec float_with_nans/zstd_parquet_2 1.00 117.7±1.24ms 118.9 MB/sec 1.00 118.3±1.31ms 118.3 MB/sec fsb/bloom_filter 1.00 8.1±0.04ms 1992.0 MB/sec 1.14 9.2±0.26ms 1753.8 MB/sec fsb/cdc 1.00 10.4±0.07ms 1546.8 MB/sec 1.09 11.4±0.16ms 1419.0 MB/sec fsb/default 1.00 7.0±0.09ms 2.2 GB/sec 1.09 7.6±0.13ms 2.1 GB/sec fsb/parquet_2 1.00 13.3±0.08ms 1216.8 MB/sec 1.14 15.2±0.68ms 1062.8 MB/sec fsb/zstd 1.00 9.4±0.04ms 1721.5 MB/sec 1.09 10.2±0.16ms 1575.1 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.08ms 1138.1 MB/sec 1.13 16.1±0.54ms 1003.3 MB/sec int32_ree/bloom_filter 1.02 41.2±0.26ms 9.9 MB/sec 1.00 40.4±0.17ms 10.1 MB/sec int32_ree/cdc 1.01 40.5±0.11ms 10.1 MB/sec 1.00 40.2±0.07ms 10.1 MB/sec int32_ree/default 1.01 36.7±0.11ms 11.1 MB/sec 1.00 36.5±0.07ms 11.2 MB/sec int32_ree/parquet_2 1.00 36.6±0.09ms 11.1 MB/sec 1.00 36.5±0.08ms 11.2 MB/sec int32_ree/zstd 1.00 37.2±0.09ms 10.9 MB/sec 1.00 37.1±0.07ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.09ms 10.9 MB/sec 1.00 37.1±0.15ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.0±0.08ms 18.5 MB/sec 1.00 21.9±0.03ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.06ms 17.0 MB/sec 1.00 23.9±0.08ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.04ms 18.8 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.03ms 18.8 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.04ms 18.6 MB/sec 1.00 21.8±0.03ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.05ms 18.7 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 65.3±0.69ms 3.8 GB/sec 1.43 93.6±5.09ms 2.7 GB/sec large_string_distinct/plain 1.00 61.5±0.98ms 4.1 GB/sec 1.18 72.6±4.46ms 3.4 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 54.6±0.70ms 4.6 GB/sec 1.30 71.1±5.66ms 3.5 GB/sec large_string_non_null/bloom_filter 1.02 72.9±0.17ms 3.4 GB/sec 1.00 71.6±0.09ms 3.5 GB/sec large_string_non_null/cdc 1.00 244.6±1.30ms 1046.6 MB/sec 1.00 244.2±1.33ms 1048.3 MB/sec large_string_non_null/default 1.03 55.4±0.42ms 4.5 GB/sec 1.00 54.0±0.43ms 4.6 GB/sec large_string_non_null/parquet_2 1.02 55.2±0.31ms 4.5 GB/sec 1.00 53.9±0.08ms 4.6 GB/sec large_string_non_null/zstd 1.02 55.2±0.21ms 4.5 GB/sec 1.00 54.0±0.15ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.02 55.3±0.22ms 4.5 GB/sec 1.00 54.0±0.11ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 56.8±0.77ms 4.4 GB/sec 2.52 143.4±11.60ms 1785.4 MB/sec large_string_shared_prefix/plain 1.00 95.1±1.96ms 2.6 GB/sec 1.24 117.9±7.15ms 2.1 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 55.8±0.45ms 4.5 GB/sec 1.26 70.1±5.74ms 3.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 47.1±0.42ms 5.3 GB/sec 1.93 90.7±6.60ms 2.8 GB/sec large_string_shared_prefix_nullable/plain 1.00 63.6±0.64ms 3.9 GB/sec 1.28 81.4±5.85ms 3.1 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 28.1±0.19ms 4.4 GB/sec 2.56 71.9±5.85ms 1780.0 MB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 68.1±0.79ms 3.7 GB/sec 1.26 85.6±5.72ms 2.9 GB/sec list_nested/bloom_filter 1.00 144.7±0.23ms 199.4 MB/sec 1.03 149.2±1.54ms 193.4 MB/sec list_nested/cdc 1.00 161.3±0.41ms 178.9 MB/sec 1.03 165.9±0.96ms 173.9 MB/sec list_nested/default 1.00 130.1±0.29ms 221.8 MB/sec 1.03 133.9±1.05ms 215.6 MB/sec list_nested/parquet_2 1.00 143.2±0.22ms 201.4 MB/sec 1.03 147.1±0.81ms 196.2 MB/sec list_nested/zstd 1.00 139.9±0.45ms 206.2 MB/sec 1.03 143.9±0.97ms 200.6 MB/sec list_nested/zstd_parquet_2 1.00 156.2±0.30ms 184.7 MB/sec 1.03 160.1±0.93ms 180.2 MB/sec list_primitive/bloom_filter 1.00 280.4±1.72ms 1944.6 MB/sec 1.29 362.9±18.02ms 1502.7 MB/sec list_primitive/cdc 1.00 312.9±1.44ms 1742.9 MB/sec 1.10 342.8±17.83ms 1591.1 MB/sec list_primitive/default 1.00 204.0±5.13ms 2.6 GB/sec 1.25 255.8±16.10ms 2.1 GB/sec list_primitive/parquet_2 1.00 223.8±0.45ms 2.4 GB/sec 1.32 296.5±4.87ms 1839.2 MB/sec list_primitive/zstd 1.00 465.2±4.29ms 1172.3 MB/sec 1.13 524.4±8.98ms 1040.1 MB/sec list_primitive/zstd_parquet_2 1.00 446.1±2.33ms 1222.5 MB/sec 1.13 503.1±5.59ms 1083.9 MB/sec list_primitive_non_null/bloom_filter 1.00 378.0±4.73ms 1439.9 MB/sec 1.38 520.2±34.56ms 1046.2 MB/sec list_primitive_non_null/cdc 1.00 396.7±10.57ms 1371.9 MB/sec 1.02 404.3±10.33ms 1346.1 MB/sec list_primitive_non_null/default 1.00 243.8±4.39ms 2.2 GB/sec 1.32 321.8±28.07ms 1691.3 MB/sec list_primitive_non_null/parquet_2 1.00 271.0±1.81ms 2008.6 MB/sec 1.12 303.8±5.18ms 1791.7 MB/sec list_primitive_non_null/zstd 1.00 664.6±2.67ms 818.9 MB/sec 1.15 766.6±12.45ms 709.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 651.7±9.48ms 835.1 MB/sec 1.15 748.3±24.25ms 727.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.9±0.14ms 2.8 GB/sec 1.06 13.6±0.21ms 2.7 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.4±0.16ms 1529.8 MB/sec 1.03 25.3±0.25ms 1479.5 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.7±0.16ms 2.9 GB/sec 1.04 13.1±0.17ms 2.8 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.5±0.11ms 2.9 GB/sec 1.06 13.2±0.20ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.4±0.09ms 2.5 GB/sec 1.05 15.1±0.15ms 2.4 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.09ms 2.9 GB/sec 1.05 13.4±0.15ms 2.7 GB/sec list_struct_with_list/bloom_filter 1.00 283.1±1.17ms 161.0 MB/sec 1.04 293.3±3.35ms 155.5 MB/sec list_struct_with_list/cdc 1.00 320.4±0.85ms 142.3 MB/sec 1.02 326.0±2.25ms 139.9 MB/sec list_struct_with_list/default 1.00 255.8±0.79ms 178.3 MB/sec 1.02 261.6±1.52ms 174.3 MB/sec list_struct_with_list/parquet_2 1.00 273.1±0.71ms 166.9 MB/sec 1.02 279.1±1.75ms 163.4 MB/sec list_struct_with_list/zstd 1.00 277.6±1.01ms 164.2 MB/sec 1.02 284.1±1.59ms 160.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.4±1.33ms 153.8 MB/sec 1.02 302.2±2.35ms 150.9 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 37.4±0.14ms 6.7 GB/sec 1.19 44.6±2.16ms 5.6 GB/sec primitive/bloom_filter 1.09 158.3±3.43ms 283.5 MB/sec 1.00 145.8±0.58ms 307.8 MB/sec primitive/cdc 1.05 161.8±1.97ms 277.3 MB/sec 1.00 154.4±0.49ms 290.6 MB/sec primitive/default 1.06 120.5±1.95ms 372.3 MB/sec 1.00 113.9±0.36ms 393.9 MB/sec primitive/parquet_2 1.04 134.4±1.52ms 333.9 MB/sec 1.00 129.0±0.44ms 347.9 MB/sec primitive/zstd 1.05 150.9±1.77ms 297.3 MB/sec 1.00 143.6±0.39ms 312.4 MB/sec primitive/zstd_parquet_2 1.04 168.2±2.30ms 266.7 MB/sec 1.00 162.1±0.48ms 276.9 MB/sec primitive_all_null/bloom_filter 1.00 892.0±3.05µs 49.1 GB/sec 1.12 1002.3±59.69µs 43.7 GB/sec primitive_all_null/cdc 1.00 19.0±0.22ms 2.3 GB/sec 1.00 19.0±0.26ms 2.3 GB/sec primitive_all_null/default 1.00 273.5±1.55µs 160.2 GB/sec 1.02 278.5±1.42µs 157.4 GB/sec primitive_all_null/parquet_2 1.00 279.5±1.55µs 156.8 GB/sec 1.03 286.9±1.39µs 152.7 GB/sec primitive_all_null/zstd 1.00 422.8±2.33µs 103.6 GB/sec 1.01 427.9±2.35µs 102.4 GB/sec primitive_all_null/zstd_parquet_2 1.00 381.1±1.31µs 115.0 GB/sec 1.01 385.3±2.09µs 113.7 GB/sec primitive_non_null/bloom_filter 1.10 112.2±4.33ms 392.2 MB/sec 1.00 102.2±0.45ms 430.6 MB/sec primitive_non_null/cdc 1.05 89.6±2.16ms 490.8 MB/sec 1.00 85.2±0.28ms 516.3 MB/sec primitive_non_null/default 1.09 67.9±2.58ms 647.6 MB/sec 1.00 62.6±0.54ms 703.0 MB/sec primitive_non_null/parquet_2 1.05 88.5±1.65ms 497.4 MB/sec 1.00 84.3±0.27ms 521.9 MB/sec primitive_non_null/zstd 1.06 99.2±2.21ms 443.5 MB/sec 1.00 93.2±0.40ms 472.2 MB/sec primitive_non_null/zstd_parquet_2 1.03 121.6±1.51ms 361.8 MB/sec 1.00 117.6±0.31ms 374.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.4±0.13ms 3.5 GB/sec 1.15 14.2±0.46ms 3.1 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.3±0.37ms 1479.6 MB/sec 1.04 31.5±0.50ms 1424.5 MB/sec primitive_sparse_99pct_null/default 1.00 10.9±0.10ms 4.0 GB/sec 1.08 11.8±0.20ms 3.7 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.9±0.13ms 4.0 GB/sec 1.08 11.8±0.20ms 3.7 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.4±0.11ms 3.1 GB/sec 1.07 15.4±0.19ms 2.9 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.0±0.12ms 3.4 GB/sec 1.07 13.9±0.19ms 3.2 GB/sec short_string_non_null/bloom_filter 1.02 28.0±0.10ms 428.3 MB/sec 1.00 27.5±0.05ms 436.2 MB/sec short_string_non_null/cdc 1.01 19.9±0.16ms 604.5 MB/sec 1.00 19.7±0.07ms 607.7 MB/sec short_string_non_null/default 1.00 15.6±0.09ms 768.2 MB/sec 1.01 15.7±0.10ms 764.3 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.12ms 463.7 MB/sec 1.00 25.8±0.05ms 466.0 MB/sec short_string_non_null/zstd 1.00 36.0±0.15ms 333.7 MB/sec 1.00 35.9±0.10ms 334.3 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.7±0.11ms 417.6 MB/sec 1.00 28.6±0.07ms 418.9 MB/sec small_string_distinct/delta_byte_array 1.00 983.1±13.19µs 8.0 GB/sec 1.24 1216.1±104.14µs 6.4 GB/sec small_string_distinct/plain 1.00 753.9±15.04µs 10.4 GB/sec 1.22 922.5±55.09µs 8.5 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1013.1±9.83µs 7.7 GB/sec 1.40 1422.9±124.32µs 5.5 GB/sec small_string_partial_prefix/plain 1.00 1011.5±9.40µs 7.8 GB/sec 1.34 1359.9±120.31µs 5.8 GB/sec small_string_shared_prefix/delta_byte_array 1.00 980.4±6.23µs 8.0 GB/sec 1.13 1111.1±173.63µs 7.1 GB/sec small_string_shared_prefix/plain 1.00 1126.5±9.18µs 7.0 GB/sec 1.16 1307.9±108.07µs 6.0 GB/sec string/bloom_filter 1.01 208.3±5.45ms 2.5 GB/sec 1.00 205.8±19.20ms 2.5 GB/sec string/cdc 1.00 202.5±1.31ms 2.5 GB/sec 1.03 207.9±10.46ms 2.5 GB/sec string/default 1.00 112.4±3.42ms 4.6 GB/sec 1.09 122.1±21.21ms 4.2 GB/sec string/parquet_2 1.00 117.2±1.47ms 4.4 GB/sec 1.44 168.4±0.52ms 3.0 GB/sec string/zstd 1.00 432.8±5.15ms 1211.2 MB/sec 1.07 464.0±11.51ms 1129.9 MB/sec string/zstd_parquet_2 1.00 385.9±3.64ms 1358.5 MB/sec 1.15 444.4±1.38ms 1179.6 MB/sec string_and_binary_view/bloom_filter 1.00 64.6±0.36ms 499.0 MB/sec 1.00 64.7±0.20ms 498.4 MB/sec string_and_binary_view/cdc 1.01 59.5±0.34ms 541.7 MB/sec 1.00 59.2±0.36ms 544.6 MB/sec string_and_binary_view/default 1.00 48.4±0.55ms 666.5 MB/sec 1.00 48.2±0.11ms 669.5 MB/sec string_and_binary_view/parquet_2 1.01 59.9±1.90ms 538.5 MB/sec 1.00 59.4±0.11ms 542.5 MB/sec string_and_binary_view/zstd 1.01 85.9±0.83ms 375.4 MB/sec 1.00 85.4±0.16ms 377.5 MB/sec string_and_binary_view/zstd_parquet_2 1.01 74.1±0.95ms 435.0 MB/sec 1.00 73.5±0.12ms 438.9 MB/sec string_dictionary/bloom_filter 1.09 91.9±2.11ms 2.8 GB/sec 1.00 84.2±0.69ms 3.1 GB/sec string_dictionary/cdc 1.02 48.2±0.45ms 5.3 GB/sec 1.00 47.2±0.45ms 5.5 GB/sec string_dictionary/default 1.04 44.8±0.35ms 5.8 GB/sec 1.00 43.1±0.96ms 6.0 GB/sec string_dictionary/parquet_2 1.03 50.0±0.59ms 5.2 GB/sec 1.00 48.5±0.23ms 5.3 GB/sec string_dictionary/zstd 1.02 211.9±1.05ms 1246.6 MB/sec 1.00 208.1±1.38ms 1269.0 MB/sec string_dictionary/zstd_parquet_2 1.00 192.1±0.27ms 1375.0 MB/sec 1.00 192.7±0.73ms 1370.5 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.2±0.16ms 117.1 MB/sec 1.00 34.1±0.09ms 117.4 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.7±0.12ms 144.9 MB/sec 1.00 27.7±0.07ms 144.5 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.3±0.15ms 158.1 MB/sec 1.00 25.4±0.08ms 157.9 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.3±0.15ms 158.0 MB/sec 1.00 25.4±0.07ms 158.0 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.7±0.16ms 155.7 MB/sec 1.00 25.7±0.10ms 155.6 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.7±0.14ms 155.7 MB/sec 1.00 25.7±0.06ms 155.9 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.8±0.14ms 118.3 MB/sec 1.01 34.2±0.09ms 117.0 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.8±0.12ms 143.9 MB/sec 1.01 28.2±0.08ms 142.3 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.5±0.15ms 156.9 MB/sec 1.01 25.8±0.10ms 155.2 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.5±0.13ms 156.9 MB/sec 1.01 25.8±0.10ms 155.3 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.6±0.14ms 156.2 MB/sec 1.01 26.0±0.10ms 154.3 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.6±0.12ms 156.3 MB/sec 1.01 25.9±0.08ms 154.5 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.02 35.4±0.15ms 113.2 MB/sec 1.00 34.7±0.07ms 115.5 MB/sec string_dictionary_low_cardinality_400/cdc 1.01 28.3±0.18ms 141.7 MB/sec 1.00 28.0±0.06ms 143.4 MB/sec string_dictionary_low_cardinality_400/default 1.01 25.9±0.16ms 154.8 MB/sec 1.00 25.6±0.11ms 156.9 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.01 25.9±0.17ms 155.1 MB/sec 1.00 25.5±0.07ms 157.1 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 26.4±0.14ms 151.9 MB/sec 1.00 26.2±0.15ms 153.3 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.4±0.15ms 152.2 MB/sec 1.00 26.0±0.07ms 154.3 MB/sec string_non_null/bloom_filter 1.00 233.0±13.21ms 2.2 GB/sec 1.03 240.9±15.06ms 2.1 GB/sec string_non_null/cdc 1.00 256.7±6.36ms 2041.4 MB/sec 1.01 258.1±9.48ms 2029.9 MB/sec string_non_null/default 1.00 118.5±11.82ms 4.3 GB/sec 1.05 124.8±12.87ms 4.1 GB/sec string_non_null/parquet_2 1.01 108.8±0.65ms 4.7 GB/sec 1.00 108.1±1.57ms 4.7 GB/sec string_non_null/zstd 1.00 548.7±4.38ms 955.0 MB/sec 1.03 562.4±12.74ms 931.7 MB/sec string_non_null/zstd_parquet_2 1.00 502.0±3.69ms 1043.8 MB/sec 1.02 510.0±8.89ms 1027.4 MB/sec string_ree/bloom_filter 1.00 150.7±1.14ms 108.9 MB/sec 1.03 155.3±0.71ms 105.7 MB/sec string_ree/cdc 1.00 220.3±1.66ms 74.5 MB/sec 1.12 246.8±7.80ms 66.5 MB/sec string_ree/default 1.00 122.2±1.40ms 134.3 MB/sec 1.04 127.5±0.66ms 128.7 MB/sec string_ree/parquet_2 1.00 127.3±0.45ms 128.9 MB/sec 1.03 131.5±1.97ms 124.8 MB/sec string_ree/zstd 1.00 182.4±1.96ms 89.9 MB/sec 1.04 189.9±0.81ms 86.4 MB/sec string_ree/zstd_parquet_2 1.00 142.3±0.50ms 115.3 MB/sec 1.03 147.2±0.56ms 111.5 MB/sec string_ree_95pct_null/bloom_filter 1.01 26.6±0.12ms 53.0 MB/sec 1.00 26.2±0.16ms 53.7 MB/sec string_ree_95pct_null/cdc 1.00 32.6±0.09ms 43.2 MB/sec 1.00 32.5±0.16ms 43.3 MB/sec string_ree_95pct_null/default 1.01 24.9±0.07ms 56.4 MB/sec 1.00 24.8±0.15ms 56.8 MB/sec string_ree_95pct_null/parquet_2 1.01 24.9±0.10ms 56.6 MB/sec 1.00 24.7±0.09ms 57.0 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.12ms 54.8 MB/sec 1.00 25.6±0.16ms 55.0 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.7±0.13ms 54.7 MB/sec 1.00 25.5±0.09ms 55.1 MB/sec struct_all_null/bloom_filter 1.00 376.3±3.33µs 41.8 GB/sec 1.04 390.7±7.06µs 40.3 GB/sec struct_all_null/cdc 1.01 7.8±0.08ms 2.0 GB/sec 1.00 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.00 117.4±0.63µs 134.1 GB/sec 1.01 118.1±0.60µs 133.3 GB/sec struct_all_null/parquet_2 1.00 119.3±0.53µs 132.0 GB/sec 1.02 121.2±0.44µs 130.0 GB/sec struct_all_null/zstd 1.00 180.7±0.88µs 87.1 GB/sec 1.01 182.9±1.05µs 86.1 GB/sec struct_all_null/zstd_parquet_2 1.00 164.3±0.49µs 95.9 GB/sec 1.00 164.5±0.58µs 95.8 GB/sec struct_non_null/bloom_filter 1.00 43.5±0.17ms 367.7 MB/sec 1.12 48.7±1.73ms 328.2 MB/sec struct_non_null/cdc 1.00 43.4±0.35ms 368.7 MB/sec 1.06 45.8±1.02ms 349.4 MB/sec struct_non_null/default 1.00 29.7±0.17ms 539.3 MB/sec 1.07 31.8±1.08ms 503.3 MB/sec struct_non_null/parquet_2 1.00 38.3±0.13ms 418.1 MB/sec 1.06 40.7±0.80ms 393.0 MB/sec struct_non_null/zstd 1.00 38.1±0.13ms 419.5 MB/sec 1.08 41.1±0.97ms 389.4 MB/sec struct_non_null/zstd_parquet_2 1.00 52.1±0.14ms 306.8 MB/sec 1.06 55.4±1.02ms 288.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.05ms 2.4 GB/sec 1.19 7.9±0.17ms 2.0 GB/sec struct_sparse_99pct_null/cdc 1.00 13.6±0.11ms 1186.0 MB/sec 1.08 14.7±0.23ms 1095.7 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.05ms 2.6 GB/sec 1.15 6.9±0.10ms 2.3 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.04ms 2.6 GB/sec 1.15 6.9±0.08ms 2.3 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.04ms 2.1 GB/sec 1.12 8.3±0.10ms 1938.3 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.07ms 2.3 GB/sec 1.13 7.7±0.13ms 2.0 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3400.8s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3214.6s | | CPU sys | 179.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3149.6s | | CPU sys | 83.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
