adriangbot commented on PR #10505: URL: https://github.com/apache/arrow-rs/pull/10505#issuecomment-5334863139
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10505#issuecomment-5333648421) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing fix-delta-byte-array-page-split-10489 (2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group fix-delta-byte-array-page-split-10489 main ----- ------------------------------------- ---- bool/bloom_filter 1.00 12.9±0.11ms 19.4 MB/sec 1.00 12.8±0.06ms 19.5 MB/sec bool/cdc 1.00 15.4±0.09ms 16.2 MB/sec 1.02 15.7±0.09ms 15.9 MB/sec bool/default 1.02 10.8±0.09ms 23.1 MB/sec 1.00 10.6±0.04ms 23.5 MB/sec bool/parquet_2 1.00 13.6±0.09ms 18.3 MB/sec 1.00 13.6±0.04ms 18.4 MB/sec bool/zstd 1.01 11.3±0.09ms 22.2 MB/sec 1.00 11.2±0.03ms 22.4 MB/sec bool/zstd_parquet_2 1.00 14.0±0.08ms 17.8 MB/sec 1.00 14.0±0.06ms 17.9 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.02ms 19.0 MB/sec 1.02 6.7±0.05ms 18.7 MB/sec bool_non_null/cdc 1.00 6.4±0.04ms 19.7 MB/sec 1.05 6.7±0.07ms 18.7 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.8 MB/sec 1.02 3.9±0.04ms 32.2 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.5 MB/sec 1.01 7.7±0.04ms 16.2 MB/sec bool_non_null/zstd 1.00 4.2±0.03ms 29.9 MB/sec 1.02 4.3±0.03ms 29.3 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.01 8.1±0.04ms 15.4 MB/sec bool_ree/bloom_filter 1.00 30.3±0.14ms 7.0 MB/sec 1.00 30.3±0.08ms 7.0 MB/sec bool_ree/cdc 1.00 31.4±0.13ms 6.8 MB/sec 1.01 31.7±0.13ms 6.7 MB/sec bool_ree/default 1.01 27.7±0.12ms 7.7 MB/sec 1.00 27.5±0.07ms 7.7 MB/sec bool_ree/parquet_2 1.00 29.1±0.11ms 7.3 MB/sec 1.00 29.0±0.10ms 7.3 MB/sec bool_ree/zstd 1.00 28.2±0.13ms 7.5 MB/sec 1.00 28.2±0.16ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.4±0.13ms 7.2 MB/sec 1.00 29.3±0.12ms 7.3 MB/sec decimal/bloom_filter 1.00 119.0±0.43ms 504.3 MB/sec 1.07 127.5±2.85ms 470.7 MB/sec decimal/cdc 1.00 102.7±3.90ms 584.5 MB/sec 1.02 105.1±1.18ms 570.9 MB/sec decimal/default 1.00 78.7±1.05ms 762.8 MB/sec 1.07 83.9±1.49ms 715.6 MB/sec decimal/parquet_2 1.00 177.7±2.52ms 337.6 MB/sec 1.04 185.0±2.27ms 324.3 MB/sec decimal/zstd 1.00 89.7±0.37ms 669.1 MB/sec 1.05 94.4±2.08ms 635.4 MB/sec decimal/zstd_parquet_2 1.00 197.3±2.73ms 304.0 MB/sec 1.04 205.5±3.47ms 292.0 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.8±0.43ms 17.1 MB/sec 1.06 62.6±1.31ms 16.1 MB/sec fixed_size_binary_ree/cdc 1.00 62.6±1.82ms 16.1 MB/sec 1.01 63.2±0.54ms 15.9 MB/sec fixed_size_binary_ree/default 1.00 51.8±0.27ms 19.4 MB/sec 1.03 53.5±0.77ms 18.8 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.3±0.30ms 15.2 MB/sec 1.06 70.1±1.00ms 14.4 MB/sec fixed_size_binary_ree/zstd 1.00 57.5±0.29ms 17.5 MB/sec 1.03 59.2±0.71ms 17.0 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.9±0.33ms 15.1 MB/sec 1.06 71.0±1.05ms 14.2 MB/sec float_with_nans/bloom_filter 1.00 80.0±0.30ms 175.0 MB/sec 1.12 89.4±3.14ms 156.6 MB/sec float_with_nans/cdc 1.00 71.3±1.97ms 196.4 MB/sec 1.06 75.3±1.15ms 186.0 MB/sec float_with_nans/default 1.00 63.0±0.18ms 222.4 MB/sec 1.07 67.7±1.22ms 206.9 MB/sec float_with_nans/parquet_2 1.00 80.2±0.19ms 174.6 MB/sec 1.07 85.7±1.21ms 163.3 MB/sec float_with_nans/zstd 1.00 101.2±0.21ms 138.3 MB/sec 1.05 106.5±1.07ms 131.5 MB/sec float_with_nans/zstd_parquet_2 1.00 117.4±0.23ms 119.3 MB/sec 1.05 123.3±1.37ms 113.6 MB/sec fsb/bloom_filter 1.00 8.3±0.07ms 1951.8 MB/sec 1.11 9.2±0.33ms 1756.5 MB/sec fsb/cdc 1.00 10.6±0.20ms 1514.6 MB/sec 1.06 11.3±0.15ms 1429.1 MB/sec fsb/default 1.00 7.0±0.04ms 2.2 GB/sec 1.08 7.6±0.14ms 2.1 GB/sec fsb/parquet_2 1.00 13.5±0.07ms 1197.5 MB/sec 1.11 14.9±0.65ms 1083.7 MB/sec fsb/zstd 1.00 9.5±0.05ms 1702.4 MB/sec 1.07 10.1±0.16ms 1594.7 MB/sec fsb/zstd_parquet_2 1.00 14.5±0.07ms 1112.4 MB/sec 1.11 16.1±0.71ms 1004.6 MB/sec int32_ree/bloom_filter 1.00 41.2±0.34ms 9.9 MB/sec 1.07 44.2±0.60ms 9.2 MB/sec int32_ree/cdc 1.00 40.4±0.13ms 10.1 MB/sec 1.03 41.5±0.31ms 9.8 MB/sec int32_ree/default 1.00 36.9±0.15ms 11.0 MB/sec 1.02 37.6±0.23ms 10.8 MB/sec int32_ree/parquet_2 1.00 36.8±0.14ms 11.0 MB/sec 1.01 37.3±0.22ms 10.9 MB/sec int32_ree/zstd 1.00 37.4±0.14ms 10.9 MB/sec 1.01 37.8±0.17ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.3±0.15ms 10.9 MB/sec 1.01 37.8±0.16ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.06ms 18.6 MB/sec 1.03 22.5±0.09ms 18.1 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.06ms 17.0 MB/sec 1.02 24.4±0.13ms 16.6 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.04ms 18.9 MB/sec 1.02 22.0±0.08ms 18.5 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.04ms 18.9 MB/sec 1.02 22.0±0.10ms 18.5 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.6 MB/sec 1.02 22.2±0.12ms 18.3 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.05ms 18.7 MB/sec 1.02 22.2±0.09ms 18.4 MB/sec large_string_distinct/delta_byte_array 1.00 66.3±0.93ms 3.8 GB/sec 1.10 73.2±0.84ms 3.4 GB/sec large_string_distinct/plain 1.00 61.4±0.98ms 4.1 GB/sec 1.00 61.4±1.34ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.01 54.7±0.49ms 4.6 GB/sec 1.00 54.2±0.53ms 4.6 GB/sec large_string_non_null/bloom_filter 1.00 73.1±0.10ms 3.4 GB/sec 1.12 82.0±2.17ms 3.0 GB/sec large_string_non_null/cdc 1.00 244.8±1.12ms 1045.6 MB/sec 1.02 250.7±2.48ms 1021.1 MB/sec large_string_non_null/default 1.00 55.3±0.15ms 4.5 GB/sec 1.14 63.0±2.62ms 4.0 GB/sec large_string_non_null/parquet_2 1.00 55.3±0.12ms 4.5 GB/sec 1.12 62.2±2.52ms 4.0 GB/sec large_string_non_null/zstd 1.00 55.3±0.11ms 4.5 GB/sec 1.13 62.4±3.18ms 4.0 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.4±0.10ms 4.5 GB/sec 1.14 62.9±2.86ms 4.0 GB/sec large_string_shared_prefix/delta_byte_array 1.00 56.9±3.40ms 4.4 GB/sec 1.90 108.1±2.11ms 2.3 GB/sec large_string_shared_prefix/plain 1.01 94.7±0.71ms 2.6 GB/sec 1.00 94.1±0.97ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 55.7±0.49ms 4.5 GB/sec 1.00 55.7±0.64ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 47.2±0.24ms 5.3 GB/sec 1.65 77.8±9.35ms 3.2 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.6±0.51ms 4.0 GB/sec 1.00 62.9±0.61ms 4.0 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 28.2±0.17ms 4.4 GB/sec 1.89 53.3±0.35ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 68.8±0.87ms 3.6 GB/sec 1.00 68.8±0.32ms 3.6 GB/sec list_nested/bloom_filter 1.00 145.0±0.31ms 198.9 MB/sec 1.03 148.9±1.17ms 193.8 MB/sec list_nested/cdc 1.00 161.3±0.27ms 178.9 MB/sec 1.02 164.4±1.28ms 175.5 MB/sec list_nested/default 1.00 130.5±0.17ms 221.1 MB/sec 1.02 133.2±0.80ms 216.6 MB/sec list_nested/parquet_2 1.00 143.7±0.17ms 200.9 MB/sec 1.02 146.4±0.79ms 197.2 MB/sec list_nested/zstd 1.00 139.9±0.20ms 206.3 MB/sec 1.02 142.5±0.94ms 202.4 MB/sec list_nested/zstd_parquet_2 1.00 156.5±0.31ms 184.4 MB/sec 1.02 158.9±0.93ms 181.6 MB/sec list_primitive/bloom_filter 1.00 281.0±0.91ms 1941.0 MB/sec 1.17 329.8±10.33ms 1653.8 MB/sec list_primitive/cdc 1.00 313.5±0.97ms 1739.6 MB/sec 1.05 329.6±3.46ms 1654.7 MB/sec list_primitive/default 1.00 201.7±0.74ms 2.6 GB/sec 1.07 216.6±5.99ms 2.5 GB/sec list_primitive/parquet_2 1.00 223.3±0.35ms 2.4 GB/sec 1.04 232.2±2.30ms 2.3 GB/sec list_primitive/zstd 1.00 455.3±1.04ms 1197.7 MB/sec 1.07 488.2±7.87ms 1117.1 MB/sec list_primitive/zstd_parquet_2 1.00 444.8±0.50ms 1226.2 MB/sec 1.05 465.3±3.52ms 1172.1 MB/sec list_primitive_non_null/bloom_filter 1.00 388.8±4.12ms 1399.8 MB/sec 1.06 412.6±17.42ms 1319.2 MB/sec list_primitive_non_null/cdc 1.00 398.6±9.99ms 1365.5 MB/sec 1.04 415.8±8.77ms 1309.0 MB/sec list_primitive_non_null/default 1.11 254.4±5.39ms 2.1 GB/sec 1.00 228.2±8.25ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.16 285.7±0.77ms 1904.7 MB/sec 1.00 246.6±4.19ms 2.2 GB/sec list_primitive_non_null/zstd 1.00 680.0±2.83ms 800.3 MB/sec 1.01 687.3±6.83ms 791.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 666.6±1.22ms 816.4 MB/sec 1.00 652.0±6.84ms 834.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.12ms 2.9 GB/sec 1.08 13.7±0.17ms 2.7 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.4±0.17ms 1534.0 MB/sec 1.07 26.0±0.47ms 1434.9 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.07ms 3.0 GB/sec 1.06 13.1±0.15ms 2.8 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.4±0.08ms 3.0 GB/sec 1.06 13.2±0.16ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.10ms 2.6 GB/sec 1.05 15.1±0.15ms 2.4 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.5±0.09ms 2.9 GB/sec 1.06 13.3±0.19ms 2.7 GB/sec list_struct_with_list/bloom_filter 1.00 282.3±0.58ms 161.5 MB/sec 1.02 288.8±2.75ms 157.9 MB/sec list_struct_with_list/cdc 1.00 320.3±0.57ms 142.3 MB/sec 1.00 319.5±0.71ms 142.7 MB/sec list_struct_with_list/default 1.00 255.5±0.56ms 178.4 MB/sec 1.01 258.1±1.74ms 176.7 MB/sec list_struct_with_list/parquet_2 1.00 273.0±0.76ms 167.0 MB/sec 1.00 274.1±1.64ms 166.3 MB/sec list_struct_with_list/zstd 1.00 277.5±0.53ms 164.3 MB/sec 1.00 278.5±1.55ms 163.7 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.6±0.87ms 153.7 MB/sec 1.00 296.1±1.19ms 154.0 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.5±0.17ms 6.5 GB/sec 1.02 39.4±0.30ms 6.3 GB/sec primitive/bloom_filter 1.00 148.2±0.92ms 302.7 MB/sec 1.00 147.5±0.50ms 304.2 MB/sec primitive/cdc 1.00 155.3±0.92ms 289.0 MB/sec 1.05 162.9±2.27ms 275.5 MB/sec primitive/default 1.01 115.9±0.80ms 387.2 MB/sec 1.00 114.9±0.35ms 390.5 MB/sec primitive/parquet_2 1.01 131.3±1.05ms 341.7 MB/sec 1.00 129.9±0.80ms 345.4 MB/sec primitive/zstd 1.00 145.4±0.60ms 308.5 MB/sec 1.01 147.2±1.87ms 304.9 MB/sec primitive/zstd_parquet_2 1.00 163.3±0.49ms 274.9 MB/sec 1.04 169.2±2.62ms 265.2 MB/sec primitive_all_null/bloom_filter 1.00 892.4±2.33µs 49.1 GB/sec 1.12 995.8±59.35µs 44.0 GB/sec primitive_all_null/cdc 1.00 19.1±0.33ms 2.3 GB/sec 1.00 19.0±0.25ms 2.3 GB/sec primitive_all_null/default 1.00 274.5±1.29µs 159.6 GB/sec 1.00 275.5±1.48µs 159.0 GB/sec primitive_all_null/parquet_2 1.00 282.5±1.25µs 155.1 GB/sec 1.00 283.9±1.69µs 154.3 GB/sec primitive_all_null/zstd 1.00 422.3±1.12µs 103.8 GB/sec 1.01 428.0±1.73µs 102.4 GB/sec primitive_all_null/zstd_parquet_2 1.00 380.5±1.27µs 115.2 GB/sec 1.01 386.1±1.57µs 113.5 GB/sec primitive_non_null/bloom_filter 1.00 101.9±0.54ms 431.6 MB/sec 1.15 116.8±3.59ms 376.6 MB/sec primitive_non_null/cdc 1.00 85.1±0.33ms 517.1 MB/sec 1.09 92.9±1.89ms 473.4 MB/sec primitive_non_null/default 1.00 62.5±0.37ms 703.6 MB/sec 1.10 68.5±1.90ms 642.1 MB/sec primitive_non_null/parquet_2 1.00 84.1±0.32ms 523.0 MB/sec 1.08 90.7±1.85ms 485.0 MB/sec primitive_non_null/zstd 1.00 93.0±0.31ms 473.2 MB/sec 1.09 101.0±2.12ms 435.8 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.1±0.37ms 375.9 MB/sec 1.07 125.3±1.75ms 351.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.5±0.29ms 3.5 GB/sec 1.15 14.4±0.35ms 3.0 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.3±0.33ms 1479.4 MB/sec 1.04 31.5±0.59ms 1422.6 MB/sec primitive_sparse_99pct_null/default 1.00 10.8±0.07ms 4.0 GB/sec 1.09 11.8±0.15ms 3.7 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.07ms 4.0 GB/sec 1.09 11.8±0.17ms 3.7 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.3±0.11ms 3.1 GB/sec 1.07 15.3±0.26ms 2.9 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.08ms 3.4 GB/sec 1.08 13.8±0.21ms 3.2 GB/sec short_string_non_null/bloom_filter 1.00 28.2±0.09ms 425.2 MB/sec 1.07 30.2±0.98ms 396.8 MB/sec short_string_non_null/cdc 1.00 19.7±0.06ms 608.4 MB/sec 1.04 20.5±0.36ms 584.6 MB/sec short_string_non_null/default 1.00 15.6±0.05ms 767.9 MB/sec 1.04 16.3±0.34ms 736.4 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.13ms 461.2 MB/sec 1.01 26.3±0.37ms 456.6 MB/sec short_string_non_null/zstd 1.00 36.0±0.10ms 333.7 MB/sec 1.02 36.7±0.44ms 326.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.07ms 416.2 MB/sec 1.01 29.2±0.31ms 410.4 MB/sec small_string_distinct/delta_byte_array 1.00 987.6±9.96µs 7.9 GB/sec 1.00 985.1±23.79µs 8.0 GB/sec small_string_distinct/plain 1.00 757.9±7.23µs 10.3 GB/sec 1.02 776.5±13.53µs 10.1 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1027.0±13.78µs 7.6 GB/sec 1.00 1023.5±15.18µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 1017.6±8.67µs 7.7 GB/sec 1.02 1042.2±18.69µs 7.5 GB/sec small_string_shared_prefix/delta_byte_array 1.00 974.9±2.99µs 8.0 GB/sec 1.00 978.0±10.08µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1131.9±5.19µs 6.9 GB/sec 1.00 1132.4±10.70µs 6.9 GB/sec string/bloom_filter 1.00 221.1±24.94ms 2.3 GB/sec 1.26 279.1±31.36ms 1878.3 MB/sec string/cdc 1.00 205.2±5.89ms 2.5 GB/sec 1.10 226.7±13.96ms 2.3 GB/sec string/default 1.00 137.2±28.57ms 3.7 GB/sec 1.08 148.5±25.01ms 3.4 GB/sec string/parquet_2 1.45 180.7±0.90ms 2.8 GB/sec 1.00 125.0±26.23ms 4.1 GB/sec string/zstd 1.00 471.9±11.71ms 1111.0 MB/sec 1.06 502.1±14.69ms 1044.1 MB/sec string/zstd_parquet_2 1.00 388.8±5.50ms 1348.5 MB/sec 1.03 400.0±7.63ms 1310.6 MB/sec string_and_binary_view/bloom_filter 1.00 65.3±0.36ms 493.6 MB/sec 1.14 74.7±3.03ms 431.6 MB/sec string_and_binary_view/cdc 1.00 59.3±0.26ms 543.5 MB/sec 1.10 65.6±2.34ms 491.9 MB/sec string_and_binary_view/default 1.00 48.8±0.26ms 660.6 MB/sec 1.11 54.1±2.45ms 595.8 MB/sec string_and_binary_view/parquet_2 1.00 60.1±0.25ms 536.7 MB/sec 1.10 66.0±3.04ms 488.9 MB/sec string_and_binary_view/zstd 1.00 85.9±0.30ms 375.2 MB/sec 1.07 91.8±2.45ms 351.3 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.9±0.25ms 436.5 MB/sec 1.08 80.2±2.33ms 402.3 MB/sec string_dictionary/bloom_filter 1.00 83.8±0.66ms 3.1 GB/sec 1.40 117.6±8.82ms 2.2 GB/sec string_dictionary/cdc 1.00 45.9±0.72ms 5.6 GB/sec 1.26 57.9±2.67ms 4.5 GB/sec string_dictionary/default 1.00 41.9±1.08ms 6.2 GB/sec 1.25 52.3±2.39ms 4.9 GB/sec string_dictionary/parquet_2 1.00 48.0±0.12ms 5.4 GB/sec 1.07 51.3±1.27ms 5.0 GB/sec string_dictionary/zstd 1.00 205.2±0.65ms 1287.5 MB/sec 1.11 228.2±4.07ms 1157.4 MB/sec string_dictionary/zstd_parquet_2 1.00 192.7±0.24ms 1370.7 MB/sec 1.04 200.0±2.91ms 1320.8 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.1±0.13ms 117.6 MB/sec 1.00 34.2±0.11ms 117.2 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.6±0.12ms 145.0 MB/sec 1.01 27.9±0.09ms 143.8 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.12ms 157.9 MB/sec 1.00 25.3±0.09ms 158.3 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.4±0.13ms 157.7 MB/sec 1.00 25.3±0.08ms 158.1 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.7±0.14ms 155.7 MB/sec 1.00 25.7±0.08ms 155.9 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 25.8±0.15ms 155.3 MB/sec 1.00 25.6±0.08ms 156.2 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.01 34.1±0.16ms 117.4 MB/sec 1.00 33.9±0.08ms 118.3 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 28.1±0.18ms 142.5 MB/sec 1.00 28.1±0.09ms 142.7 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.6±0.15ms 156.3 MB/sec 1.00 25.5±0.08ms 157.1 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.01 25.8±0.19ms 155.4 MB/sec 1.00 25.5±0.07ms 157.0 MB/sec string_dictionary_low_cardinality_20/zstd 1.01 25.9±0.17ms 154.9 MB/sec 1.00 25.7±0.08ms 155.9 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.01 25.9±0.19ms 154.5 MB/sec 1.00 25.6±0.07ms 156.3 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.3±0.16ms 113.6 MB/sec 1.00 35.2±0.08ms 113.9 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.5±0.15ms 141.0 MB/sec 1.02 29.0±0.18ms 138.3 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.1±0.14ms 153.8 MB/sec 1.00 26.1±0.09ms 154.0 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.1±0.14ms 153.6 MB/sec 1.00 26.1±0.11ms 153.9 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.6±0.16ms 150.7 MB/sec 1.00 26.6±0.08ms 150.8 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.7±0.17ms 150.5 MB/sec 1.00 26.6±0.08ms 151.1 MB/sec string_non_null/bloom_filter 1.00 233.3±8.64ms 2.2 GB/sec 1.33 311.1±27.95ms 1684.4 MB/sec string_non_null/cdc 1.01 257.6±11.02ms 2034.4 MB/sec 1.00 253.9±4.97ms 2.0 GB/sec string_non_null/default 1.00 113.8±14.50ms 4.5 GB/sec 1.45 165.4±23.02ms 3.1 GB/sec string_non_null/parquet_2 1.00 111.8±7.30ms 4.6 GB/sec 1.06 119.1±5.21ms 4.3 GB/sec string_non_null/zstd 1.00 559.5±14.97ms 936.5 MB/sec 1.00 561.2±10.15ms 933.7 MB/sec string_non_null/zstd_parquet_2 1.00 504.0±9.25ms 1039.6 MB/sec 1.01 511.3±4.80ms 1024.8 MB/sec string_ree/bloom_filter 1.28 156.3±0.79ms 105.0 MB/sec 1.00 121.8±3.45ms 134.7 MB/sec string_ree/cdc 1.07 199.1±7.04ms 82.4 MB/sec 1.00 186.5±2.71ms 88.0 MB/sec string_ree/default 1.43 128.7±1.22ms 127.5 MB/sec 1.00 90.3±3.67ms 181.7 MB/sec string_ree/parquet_2 1.52 129.3±0.62ms 126.9 MB/sec 1.00 85.0±1.76ms 193.0 MB/sec string_ree/zstd 1.18 186.7±1.20ms 87.9 MB/sec 1.00 157.8±5.56ms 104.0 MB/sec string_ree/zstd_parquet_2 1.43 143.9±0.40ms 114.1 MB/sec 1.00 100.5±1.82ms 163.3 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.2±0.19ms 53.7 MB/sec 1.06 27.7±0.32ms 50.8 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.16ms 43.5 MB/sec 1.05 33.9±0.33ms 41.5 MB/sec string_ree_95pct_null/default 1.00 24.8±0.11ms 56.6 MB/sec 1.04 25.9±0.24ms 54.3 MB/sec string_ree_95pct_null/parquet_2 1.00 24.8±0.12ms 56.8 MB/sec 1.05 26.0±0.24ms 54.2 MB/sec string_ree_95pct_null/zstd 1.00 25.6±0.13ms 55.0 MB/sec 1.05 26.9±0.26ms 52.4 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.15ms 55.2 MB/sec 1.05 26.7±0.35ms 52.7 MB/sec struct_all_null/bloom_filter 1.00 377.7±1.93µs 41.7 GB/sec 1.05 397.3±8.40µs 39.6 GB/sec struct_all_null/cdc 1.00 7.8±0.12ms 2.0 GB/sec 1.00 7.8±0.13ms 2.0 GB/sec struct_all_null/default 1.00 118.1±0.75µs 133.3 GB/sec 1.01 118.8±0.54µs 132.5 GB/sec struct_all_null/parquet_2 1.00 120.8±0.51µs 130.3 GB/sec 1.01 122.3±0.51µs 128.7 GB/sec struct_all_null/zstd 1.00 182.0±0.59µs 86.5 GB/sec 1.01 183.0±0.72µs 86.1 GB/sec struct_all_null/zstd_parquet_2 1.00 163.6±0.56µs 96.3 GB/sec 1.00 163.6±0.80µs 96.2 GB/sec struct_non_null/bloom_filter 1.00 43.6±0.15ms 366.8 MB/sec 1.16 50.4±2.22ms 317.5 MB/sec struct_non_null/cdc 1.00 43.2±0.14ms 370.0 MB/sec 1.07 46.2±0.81ms 346.3 MB/sec struct_non_null/default 1.00 29.5±0.12ms 542.5 MB/sec 1.10 32.5±0.62ms 492.4 MB/sec struct_non_null/parquet_2 1.00 38.3±0.11ms 418.3 MB/sec 1.08 41.2±0.79ms 388.8 MB/sec struct_non_null/zstd 1.00 38.2±0.13ms 419.4 MB/sec 1.09 41.6±0.93ms 384.2 MB/sec struct_non_null/zstd_parquet_2 1.00 52.0±0.15ms 308.0 MB/sec 1.08 56.1±1.03ms 285.4 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.05ms 2.4 GB/sec 1.22 8.0±0.17ms 2010.3 MB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.15ms 1178.1 MB/sec 1.08 14.8±0.20ms 1087.0 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.04ms 2.6 GB/sec 1.16 7.0±0.12ms 2.3 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.03ms 2.6 GB/sec 1.17 7.0±0.09ms 2.3 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.04ms 2.1 GB/sec 1.14 8.4±0.11ms 1916.7 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.08ms 2.3 GB/sec 1.14 7.8±0.11ms 2.0 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3310.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.7 GiB | | CPU user | 3267.0s | | CPU sys | 37.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3270.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3157.8s | | CPU sys | 110.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
