adriangbot commented on PR #10505: URL: https://github.com/apache/arrow-rs/pull/10505#issuecomment-5334764374
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10505#issuecomment-5333647116) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing fix-delta-byte-array-page-split-10489 (2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group fix-delta-byte-array-page-split-10489 main ----- ------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.06ms 19.7 MB/sec 1.00 12.7±0.06ms 19.7 MB/sec bool/cdc 1.00 15.5±0.07ms 16.2 MB/sec 1.00 15.5±0.06ms 16.2 MB/sec bool/default 1.00 10.6±0.05ms 23.7 MB/sec 1.00 10.5±0.04ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.06ms 18.6 MB/sec 1.00 13.5±0.05ms 18.5 MB/sec bool/zstd 1.00 11.1±0.05ms 22.6 MB/sec 1.00 11.0±0.04ms 22.7 MB/sec bool/zstd_parquet_2 1.00 13.8±0.06ms 18.1 MB/sec 1.00 13.9±0.06ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 19.0 MB/sec 1.00 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.00 6.4±0.04ms 19.6 MB/sec 1.00 6.4±0.03ms 19.6 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.9 MB/sec 1.00 3.8±0.02ms 32.7 MB/sec bool_non_null/parquet_2 1.00 7.6±0.05ms 16.4 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.00 4.2±0.03ms 30.0 MB/sec 1.00 4.2±0.02ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.01 8.1±0.03ms 15.5 MB/sec bool_ree/bloom_filter 1.00 30.1±0.06ms 7.1 MB/sec 1.00 30.1±0.05ms 7.1 MB/sec bool_ree/cdc 1.00 31.3±0.09ms 6.8 MB/sec 1.00 31.4±0.08ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.07ms 7.8 MB/sec 1.00 27.3±0.06ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.07ms 7.4 MB/sec 1.00 28.8±0.08ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.08ms 7.6 MB/sec 1.00 28.0±0.10ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.00 29.1±0.07ms 7.3 MB/sec decimal/bloom_filter 1.00 119.9±0.40ms 500.3 MB/sec 1.23 147.4±0.43ms 407.1 MB/sec decimal/cdc 1.00 101.2±0.30ms 592.9 MB/sec 1.00 101.5±0.49ms 591.0 MB/sec decimal/default 1.00 79.0±1.05ms 759.2 MB/sec 1.34 105.9±1.56ms 566.8 MB/sec decimal/parquet_2 1.00 178.1±2.43ms 336.9 MB/sec 1.16 206.6±2.58ms 290.4 MB/sec decimal/zstd 1.00 90.1±0.45ms 665.8 MB/sec 1.30 117.1±0.34ms 512.4 MB/sec decimal/zstd_parquet_2 1.00 197.7±1.83ms 303.5 MB/sec 1.14 225.7±2.49ms 265.9 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.9±0.93ms 17.1 MB/sec 1.00 58.8±0.27ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.9±0.25ms 16.3 MB/sec 1.00 61.8±0.29ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.7±0.90ms 19.5 MB/sec 1.00 51.7±0.19ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.6±0.91ms 15.1 MB/sec 1.00 66.4±0.23ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.01 57.7±1.51ms 17.5 MB/sec 1.00 57.4±0.23ms 17.6 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.0±0.95ms 15.0 MB/sec 1.00 67.1±0.28ms 15.0 MB/sec float_with_nans/bloom_filter 1.00 81.4±1.10ms 171.9 MB/sec 1.00 81.6±1.03ms 171.7 MB/sec float_with_nans/cdc 1.00 70.7±0.40ms 198.0 MB/sec 1.00 70.9±0.49ms 197.4 MB/sec float_with_nans/default 1.00 63.7±0.30ms 219.6 MB/sec 1.00 63.6±1.04ms 220.1 MB/sec float_with_nans/parquet_2 1.00 80.7±1.00ms 173.5 MB/sec 1.00 80.7±0.16ms 173.4 MB/sec float_with_nans/zstd 1.00 102.0±1.44ms 137.3 MB/sec 1.00 101.7±1.02ms 137.7 MB/sec float_with_nans/zstd_parquet_2 1.00 117.7±1.03ms 118.9 MB/sec 1.00 118.1±1.44ms 118.5 MB/sec fsb/bloom_filter 1.00 8.1±0.06ms 1994.6 MB/sec 1.02 8.2±0.05ms 1960.1 MB/sec fsb/cdc 1.00 10.4±0.04ms 1548.7 MB/sec 1.02 10.6±0.08ms 1520.6 MB/sec fsb/default 1.00 6.9±0.04ms 2.3 GB/sec 1.02 7.1±0.04ms 2.2 GB/sec fsb/parquet_2 1.00 13.3±0.09ms 1215.8 MB/sec 1.01 13.5±0.06ms 1197.9 MB/sec fsb/zstd 1.00 9.4±0.05ms 1713.7 MB/sec 1.02 9.6±0.05ms 1685.6 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.09ms 1136.2 MB/sec 1.02 14.5±0.11ms 1108.7 MB/sec int32_ree/bloom_filter 1.00 40.8±0.18ms 10.0 MB/sec 1.02 41.5±0.41ms 9.8 MB/sec int32_ree/cdc 1.00 40.4±0.09ms 10.1 MB/sec 1.00 40.4±0.08ms 10.1 MB/sec int32_ree/default 1.00 36.6±0.09ms 11.1 MB/sec 1.00 36.6±0.08ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.11ms 11.1 MB/sec 1.00 36.6±0.09ms 11.1 MB/sec int32_ree/zstd 1.00 37.2±0.08ms 10.9 MB/sec 1.00 37.1±0.07ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.10ms 11.0 MB/sec 1.00 37.1±0.09ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.1±0.08ms 18.4 MB/sec 1.00 22.1±0.08ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.04ms 17.0 MB/sec 1.00 24.0±0.07ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.04ms 18.8 MB/sec 1.00 21.7±0.04ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.06ms 18.8 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.05ms 18.7 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 65.1±0.49ms 3.8 GB/sec 1.15 75.1±0.44ms 3.3 GB/sec large_string_distinct/plain 1.00 60.2±0.79ms 4.2 GB/sec 1.01 61.0±1.07ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 53.4±0.33ms 4.7 GB/sec 1.03 55.0±0.64ms 4.5 GB/sec large_string_non_null/bloom_filter 1.01 73.3±0.18ms 3.4 GB/sec 1.00 72.6±0.32ms 3.4 GB/sec large_string_non_null/cdc 1.01 245.5±1.29ms 1043.0 MB/sec 1.00 244.0±1.22ms 1049.3 MB/sec large_string_non_null/default 1.02 55.4±0.17ms 4.5 GB/sec 1.00 54.1±0.29ms 4.6 GB/sec large_string_non_null/parquet_2 1.02 55.4±0.15ms 4.5 GB/sec 1.00 54.1±0.29ms 4.6 GB/sec large_string_non_null/zstd 1.02 55.5±0.19ms 4.5 GB/sec 1.00 54.1±0.31ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.03 55.7±0.21ms 4.5 GB/sec 1.00 54.3±0.34ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 55.5±0.45ms 4.5 GB/sec 1.99 110.1±1.37ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 93.6±1.41ms 2.7 GB/sec 1.01 94.1±1.10ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 54.3±0.31ms 4.6 GB/sec 1.03 56.1±0.40ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 46.7±0.22ms 5.4 GB/sec 1.52 71.0±0.64ms 3.5 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.1±0.42ms 4.0 GB/sec 1.06 65.8±0.55ms 3.8 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.7±0.14ms 4.5 GB/sec 1.99 55.3±0.65ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 66.7±0.30ms 3.7 GB/sec 1.03 69.0±0.62ms 3.6 GB/sec list_nested/bloom_filter 1.01 145.1±0.30ms 198.8 MB/sec 1.00 143.8±0.35ms 200.6 MB/sec list_nested/cdc 1.00 161.0±0.18ms 179.3 MB/sec 1.00 161.2±0.19ms 179.0 MB/sec list_nested/default 1.00 129.9±0.15ms 222.2 MB/sec 1.00 130.2±0.20ms 221.6 MB/sec list_nested/parquet_2 1.00 143.1±0.24ms 201.6 MB/sec 1.00 143.6±0.30ms 201.0 MB/sec list_nested/zstd 1.00 139.4±0.43ms 207.1 MB/sec 1.00 139.5±0.28ms 206.9 MB/sec list_nested/zstd_parquet_2 1.00 155.9±0.20ms 185.1 MB/sec 1.00 156.2±0.23ms 184.7 MB/sec list_primitive/bloom_filter 1.00 281.4±1.22ms 1937.9 MB/sec 1.14 320.7±16.39ms 1700.3 MB/sec list_primitive/cdc 1.00 310.7±1.84ms 1755.4 MB/sec 1.03 319.3±8.41ms 1708.2 MB/sec list_primitive/default 1.00 199.8±1.51ms 2.7 GB/sec 1.18 234.9±18.06ms 2.3 GB/sec list_primitive/parquet_2 1.00 224.6±0.76ms 2.4 GB/sec 1.23 276.8±0.60ms 1970.5 MB/sec list_primitive/zstd 1.00 455.7±2.38ms 1196.8 MB/sec 1.09 495.3±4.65ms 1101.0 MB/sec list_primitive/zstd_parquet_2 1.00 448.1±1.56ms 1217.0 MB/sec 1.04 467.0±7.28ms 1167.8 MB/sec list_primitive_non_null/bloom_filter 1.00 382.7±6.09ms 1422.1 MB/sec 1.07 407.8±13.59ms 1334.6 MB/sec list_primitive_non_null/cdc 1.00 390.4±9.58ms 1394.2 MB/sec 1.00 390.9±6.55ms 1392.3 MB/sec list_primitive_non_null/default 1.00 242.8±5.80ms 2.2 GB/sec 1.12 271.6±11.54ms 2003.8 MB/sec list_primitive_non_null/parquet_2 1.00 276.5±4.20ms 1968.2 MB/sec 1.01 279.3±0.72ms 1948.7 MB/sec list_primitive_non_null/zstd 1.00 666.5±3.65ms 816.6 MB/sec 1.04 696.3±6.45ms 781.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 659.3±2.19ms 825.5 MB/sec 1.00 643.6±15.37ms 845.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.9±0.09ms 2.8 GB/sec 1.02 13.1±0.43ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.4±0.11ms 1531.0 MB/sec 1.01 24.6±0.10ms 1516.0 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.5±0.06ms 2.9 GB/sec 1.01 12.7±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.5±0.05ms 2.9 GB/sec 1.01 12.7±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.5±0.12ms 2.5 GB/sec 1.00 14.5±0.07ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.09ms 2.9 GB/sec 1.00 12.8±0.07ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 281.9±0.66ms 161.7 MB/sec 1.03 290.5±0.76ms 157.0 MB/sec list_struct_with_list/cdc 1.00 320.1±0.55ms 142.4 MB/sec 1.02 325.9±0.69ms 139.9 MB/sec list_struct_with_list/default 1.00 255.5±0.52ms 178.4 MB/sec 1.02 260.8±0.48ms 174.9 MB/sec list_struct_with_list/parquet_2 1.00 272.8±0.49ms 167.1 MB/sec 1.02 279.0±0.87ms 163.4 MB/sec list_struct_with_list/zstd 1.00 277.3±0.58ms 164.4 MB/sec 1.02 282.9±0.61ms 161.1 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.2±0.68ms 153.9 MB/sec 1.02 301.9±0.55ms 151.0 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 37.2±0.09ms 6.7 GB/sec 1.09 40.5±0.40ms 6.2 GB/sec primitive/bloom_filter 1.00 144.9±0.54ms 309.7 MB/sec 1.02 147.1±0.62ms 305.1 MB/sec primitive/cdc 1.00 154.6±0.76ms 290.2 MB/sec 1.01 155.7±0.51ms 288.1 MB/sec primitive/default 1.00 113.9±0.49ms 394.1 MB/sec 1.01 115.1±0.49ms 390.1 MB/sec primitive/parquet_2 1.00 128.6±0.41ms 349.0 MB/sec 1.01 129.8±0.37ms 345.8 MB/sec primitive/zstd 1.00 144.1±0.48ms 311.5 MB/sec 1.01 145.0±0.47ms 309.6 MB/sec primitive/zstd_parquet_2 1.00 161.7±0.56ms 277.5 MB/sec 1.01 163.1±0.39ms 275.1 MB/sec primitive_all_null/bloom_filter 1.00 887.6±3.29µs 49.4 GB/sec 1.02 907.4±6.97µs 48.3 GB/sec primitive_all_null/cdc 1.02 19.3±0.34ms 2.3 GB/sec 1.00 18.9±0.24ms 2.3 GB/sec primitive_all_null/default 1.00 275.5±1.39µs 159.1 GB/sec 1.00 275.3±1.79µs 159.2 GB/sec primitive_all_null/parquet_2 1.00 282.1±1.27µs 155.4 GB/sec 1.01 284.2±2.14µs 154.2 GB/sec primitive_all_null/zstd 1.00 424.8±1.40µs 103.2 GB/sec 1.00 424.6±1.61µs 103.2 GB/sec primitive_all_null/zstd_parquet_2 1.00 382.0±1.20µs 114.7 GB/sec 1.00 382.8±1.38µs 114.5 GB/sec primitive_non_null/bloom_filter 1.00 101.2±0.50ms 434.6 MB/sec 1.03 104.6±0.38ms 420.5 MB/sec primitive_non_null/cdc 1.00 84.9±0.28ms 518.4 MB/sec 1.02 86.7±0.34ms 507.5 MB/sec primitive_non_null/default 1.00 62.7±0.37ms 702.3 MB/sec 1.01 63.4±0.36ms 693.7 MB/sec primitive_non_null/parquet_2 1.00 84.0±0.31ms 523.9 MB/sec 1.01 85.2±0.27ms 516.3 MB/sec primitive_non_null/zstd 1.00 92.9±0.32ms 473.4 MB/sec 1.01 94.0±0.23ms 468.1 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.0±0.23ms 376.0 MB/sec 1.01 118.6±0.30ms 370.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.4±0.12ms 3.5 GB/sec 1.01 12.6±0.14ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.3±0.32ms 1479.4 MB/sec 1.00 30.4±0.28ms 1478.2 MB/sec primitive_sparse_99pct_null/default 1.00 10.8±0.05ms 4.1 GB/sec 1.01 10.9±0.07ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.0±0.13ms 4.0 GB/sec 1.00 11.0±0.29ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.3±0.13ms 3.1 GB/sec 1.00 14.4±0.09ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.07ms 3.4 GB/sec 1.01 13.0±0.11ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.9±0.06ms 430.4 MB/sec 1.01 28.1±0.18ms 427.3 MB/sec short_string_non_null/cdc 1.00 19.9±0.08ms 603.7 MB/sec 1.00 19.9±0.04ms 603.4 MB/sec short_string_non_null/default 1.00 15.7±0.03ms 764.5 MB/sec 1.01 15.9±0.06ms 757.1 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.06ms 460.7 MB/sec 1.00 26.0±0.12ms 461.5 MB/sec short_string_non_null/zstd 1.00 35.9±0.13ms 333.9 MB/sec 1.00 36.0±0.09ms 333.1 MB/sec short_string_non_null/zstd_parquet_2 1.01 29.0±0.10ms 413.3 MB/sec 1.00 28.9±0.07ms 415.6 MB/sec small_string_distinct/delta_byte_array 1.00 998.5±7.42µs 7.9 GB/sec 1.00 998.8±9.96µs 7.9 GB/sec small_string_distinct/plain 1.00 752.6±6.57µs 10.4 GB/sec 1.02 764.1±8.92µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1017.6±11.58µs 7.7 GB/sec 1.02 1040.2±11.64µs 7.5 GB/sec small_string_partial_prefix/plain 1.00 1017.1±13.14µs 7.7 GB/sec 1.02 1037.5±13.52µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.00 977.4±5.23µs 8.0 GB/sec 1.00 981.8±6.73µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1104.3±5.61µs 7.1 GB/sec 1.03 1139.6±5.89µs 6.9 GB/sec string/bloom_filter 1.00 207.5±20.07ms 2.5 GB/sec 1.02 211.4±19.78ms 2.4 GB/sec string/cdc 1.00 210.0±7.58ms 2.4 GB/sec 1.00 209.2±10.44ms 2.4 GB/sec string/default 1.00 124.3±21.96ms 4.1 GB/sec 1.01 126.0±23.05ms 4.1 GB/sec string/parquet_2 1.00 161.3±0.53ms 3.2 GB/sec 1.05 169.4±0.60ms 3.0 GB/sec string/zstd 1.00 465.8±9.85ms 1125.5 MB/sec 1.00 466.3±11.32ms 1124.2 MB/sec string/zstd_parquet_2 1.00 387.6±5.00ms 1352.6 MB/sec 1.14 442.7±0.67ms 1184.1 MB/sec string_and_binary_view/bloom_filter 1.00 64.7±0.20ms 498.4 MB/sec 1.01 65.4±0.19ms 493.2 MB/sec string_and_binary_view/cdc 1.00 59.3±0.17ms 543.9 MB/sec 1.00 59.4±0.17ms 542.7 MB/sec string_and_binary_view/default 1.00 48.5±0.19ms 664.6 MB/sec 1.00 48.7±0.18ms 662.1 MB/sec string_and_binary_view/parquet_2 1.00 59.9±0.21ms 538.7 MB/sec 1.00 60.1±0.19ms 536.4 MB/sec string_and_binary_view/zstd 1.00 85.8±0.16ms 376.1 MB/sec 1.00 86.1±0.28ms 374.4 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.6±0.15ms 438.2 MB/sec 1.01 74.1±0.18ms 435.5 MB/sec string_dictionary/bloom_filter 1.01 88.1±0.95ms 2.9 GB/sec 1.00 86.9±1.36ms 3.0 GB/sec string_dictionary/cdc 1.00 47.9±0.53ms 5.4 GB/sec 1.02 49.0±2.75ms 5.3 GB/sec string_dictionary/default 1.00 43.7±0.19ms 5.9 GB/sec 1.00 43.8±1.05ms 5.9 GB/sec string_dictionary/parquet_2 1.01 49.0±0.19ms 5.3 GB/sec 1.00 48.7±0.15ms 5.3 GB/sec string_dictionary/zstd 1.00 208.8±0.52ms 1264.9 MB/sec 1.00 209.7±0.48ms 1259.5 MB/sec string_dictionary/zstd_parquet_2 1.00 193.2±0.25ms 1367.0 MB/sec 1.00 192.6±0.29ms 1371.4 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.4±0.16ms 116.4 MB/sec 1.00 34.5±0.09ms 116.2 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 27.9±0.16ms 143.5 MB/sec 1.00 27.8±0.08ms 144.2 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.6±0.16ms 156.6 MB/sec 1.00 25.4±0.07ms 157.9 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.01 25.6±0.15ms 156.7 MB/sec 1.00 25.4±0.09ms 157.7 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 26.0±0.15ms 154.3 MB/sec 1.00 25.8±0.08ms 155.5 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 26.0±0.17ms 154.1 MB/sec 1.00 25.7±0.07ms 155.9 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 33.8±0.16ms 118.5 MB/sec 1.00 33.0±0.07ms 121.4 MB/sec string_dictionary_low_cardinality_20/cdc 1.01 27.9±0.14ms 143.8 MB/sec 1.00 27.5±0.07ms 145.8 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.5±0.14ms 157.1 MB/sec 1.00 25.2±0.07ms 158.9 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.02 25.5±0.16ms 157.1 MB/sec 1.00 25.1±0.07ms 159.7 MB/sec string_dictionary_low_cardinality_20/zstd 1.01 25.6±0.15ms 156.2 MB/sec 1.00 25.3±0.08ms 158.5 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.02 25.7±0.15ms 156.0 MB/sec 1.00 25.2±0.09ms 158.8 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.3±0.16ms 113.6 MB/sec 1.00 34.9±0.09ms 115.0 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.2±0.13ms 142.1 MB/sec 1.00 28.2±0.10ms 142.2 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.8±0.17ms 155.2 MB/sec 1.00 25.8±0.08ms 155.8 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.9±0.15ms 155.0 MB/sec 1.00 25.8±0.09ms 155.8 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.4±0.13ms 152.1 MB/sec 1.00 26.3±0.12ms 152.3 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.4±0.13ms 151.8 MB/sec 1.00 26.3±0.08ms 152.6 MB/sec string_non_null/bloom_filter 1.00 236.9±4.96ms 2.2 GB/sec 1.04 246.4±13.15ms 2.1 GB/sec string_non_null/cdc 1.00 238.7±1.24ms 2.1 GB/sec 1.05 250.2±4.23ms 2.0 GB/sec string_non_null/default 1.00 116.5±7.76ms 4.4 GB/sec 1.14 132.2±12.22ms 3.9 GB/sec string_non_null/parquet_2 1.00 109.5±0.54ms 4.7 GB/sec 1.16 126.6±8.80ms 4.0 GB/sec string_non_null/zstd 1.01 535.8±2.59ms 978.0 MB/sec 1.00 531.6±5.12ms 985.6 MB/sec string_non_null/zstd_parquet_2 1.00 490.2±1.13ms 1069.0 MB/sec 1.04 510.2±8.26ms 1027.0 MB/sec string_ree/bloom_filter 1.00 152.0±1.14ms 107.9 MB/sec 1.01 152.8±1.05ms 107.4 MB/sec string_ree/cdc 1.00 220.1±0.69ms 74.5 MB/sec 1.09 240.0±5.44ms 68.3 MB/sec string_ree/default 1.00 123.5±0.82ms 132.8 MB/sec 1.01 124.9±0.44ms 131.4 MB/sec string_ree/parquet_2 1.00 123.0±0.38ms 133.4 MB/sec 1.05 129.0±0.38ms 127.2 MB/sec string_ree/zstd 1.00 183.4±0.96ms 89.4 MB/sec 1.00 183.7±0.70ms 89.3 MB/sec string_ree/zstd_parquet_2 1.00 137.8±0.49ms 119.1 MB/sec 1.06 145.9±0.43ms 112.4 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.5±0.08ms 53.1 MB/sec 1.01 26.6±0.10ms 52.8 MB/sec string_ree_95pct_null/cdc 1.00 32.5±0.08ms 43.2 MB/sec 1.00 32.6±0.10ms 43.2 MB/sec string_ree_95pct_null/default 1.00 24.9±0.05ms 56.5 MB/sec 1.01 25.0±0.09ms 56.2 MB/sec string_ree_95pct_null/parquet_2 1.00 24.9±0.06ms 56.4 MB/sec 1.00 25.0±0.06ms 56.3 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.06ms 54.7 MB/sec 1.00 25.8±0.06ms 54.5 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.7±0.07ms 54.8 MB/sec 1.00 25.7±0.06ms 54.7 MB/sec struct_all_null/bloom_filter 1.00 373.2±1.58µs 42.2 GB/sec 1.02 382.0±2.59µs 41.2 GB/sec struct_all_null/cdc 1.00 7.8±0.08ms 2.0 GB/sec 1.00 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.00 117.6±0.62µs 133.9 GB/sec 1.00 118.0±0.72µs 133.4 GB/sec struct_all_null/parquet_2 1.00 119.7±0.52µs 131.5 GB/sec 1.03 122.8±0.84µs 128.2 GB/sec struct_all_null/zstd 1.00 182.1±0.66µs 86.5 GB/sec 1.00 181.8±0.80µs 86.6 GB/sec struct_all_null/zstd_parquet_2 1.00 163.3±0.60µs 96.4 GB/sec 1.00 164.0±0.62µs 96.0 GB/sec struct_non_null/bloom_filter 1.00 43.5±0.13ms 368.0 MB/sec 1.03 44.8±0.21ms 357.5 MB/sec struct_non_null/cdc 1.00 43.2±0.14ms 370.8 MB/sec 1.00 43.3±0.13ms 369.4 MB/sec struct_non_null/default 1.00 29.5±0.12ms 542.5 MB/sec 1.02 30.0±0.16ms 533.3 MB/sec struct_non_null/parquet_2 1.00 38.3±0.11ms 418.3 MB/sec 1.01 38.7±0.11ms 413.6 MB/sec struct_non_null/zstd 1.00 38.1±0.11ms 419.7 MB/sec 1.01 38.4±0.14ms 416.5 MB/sec struct_non_null/zstd_parquet_2 1.00 51.9±0.13ms 308.2 MB/sec 1.01 52.5±0.13ms 305.0 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.04ms 2.4 GB/sec 1.06 7.0±0.06ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.6±0.10ms 1188.2 MB/sec 1.03 14.0±0.13ms 1155.9 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.07 6.4±0.03ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.07ms 2.6 GB/sec 1.06 6.4±0.04ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.05ms 2.1 GB/sec 1.06 7.8±0.08ms 2.0 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.07 7.2±0.07ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3305.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.5 GiB | | CPU user | 3139.6s | | CPU sys | 162.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3240.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3147.7s | | CPU sys | 90.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
