adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5344904392
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5343487278) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (525a6595f42c7c70f4999e08660137b43bdbff60) to 505afcb (merge-base) [diff](https://github.com/apache/arrow-rs/compare/505afcbfd2c27897f747916e782d41e1593b7007..525a6595f42c7c70f4999e08660137b43bdbff60) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.6±0.04ms 19.9 MB/sec 1.00 12.6±0.04ms 19.8 MB/sec bool/cdc 1.01 15.4±0.05ms 16.2 MB/sec 1.00 15.3±0.04ms 16.4 MB/sec bool/default 1.00 10.4±0.05ms 24.1 MB/sec 1.01 10.5±0.03ms 23.9 MB/sec bool/parquet_2 1.00 13.4±0.07ms 18.6 MB/sec 1.00 13.4±0.03ms 18.7 MB/sec bool/zstd 1.00 10.9±0.04ms 22.9 MB/sec 1.01 11.0±0.03ms 22.8 MB/sec bool/zstd_parquet_2 1.00 13.8±0.04ms 18.1 MB/sec 1.00 13.8±0.03ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.3 MB/sec 1.01 6.6±0.03ms 19.1 MB/sec bool_non_null/cdc 1.00 6.3±0.05ms 19.8 MB/sec 1.01 6.4±0.04ms 19.7 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.5 MB/sec 1.01 3.8±0.02ms 33.3 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.4 MB/sec 1.00 7.6±0.03ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.7 MB/sec 1.01 4.1±0.02ms 30.5 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.02ms 15.6 MB/sec 1.00 8.0±0.03ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.0±0.06ms 7.1 MB/sec 1.00 30.0±0.04ms 7.1 MB/sec bool_ree/cdc 1.00 31.4±0.06ms 6.8 MB/sec 1.00 31.3±0.10ms 6.8 MB/sec bool_ree/default 1.00 27.2±0.05ms 7.8 MB/sec 1.00 27.3±0.04ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.06ms 7.4 MB/sec 1.00 28.8±0.05ms 7.4 MB/sec bool_ree/zstd 1.00 27.9±0.07ms 7.6 MB/sec 1.00 27.9±0.05ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.0±0.05ms 7.3 MB/sec 1.00 29.1±0.04ms 7.3 MB/sec decimal/bloom_filter 1.01 119.2±1.06ms 503.4 MB/sec 1.00 117.9±1.81ms 508.9 MB/sec decimal/cdc 1.00 101.4±0.29ms 591.9 MB/sec 1.00 101.2±0.48ms 592.7 MB/sec decimal/default 1.00 79.0±1.11ms 759.1 MB/sec 1.00 78.9±1.77ms 760.4 MB/sec decimal/parquet_2 1.01 178.5±2.18ms 336.1 MB/sec 1.00 177.3±2.73ms 338.4 MB/sec decimal/zstd 1.01 90.5±1.14ms 662.8 MB/sec 1.00 89.9±2.02ms 667.8 MB/sec decimal/zstd_parquet_2 1.01 198.2±2.34ms 302.8 MB/sec 1.00 196.7±2.66ms 305.1 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.8±0.36ms 17.1 MB/sec 1.00 59.0±0.83ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.8±0.18ms 16.3 MB/sec 1.00 61.9±0.24ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.7±0.29ms 19.5 MB/sec 1.01 52.2±1.22ms 19.3 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.5±1.01ms 15.1 MB/sec 1.00 66.8±0.86ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.00 57.3±0.21ms 17.6 MB/sec 1.01 57.9±0.81ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.4±1.31ms 15.0 MB/sec 1.01 67.9±1.25ms 14.8 MB/sec float_with_nans/bloom_filter 1.01 81.4±1.12ms 172.0 MB/sec 1.00 80.6±1.61ms 173.8 MB/sec float_with_nans/cdc 1.00 70.7±0.30ms 198.1 MB/sec 1.00 70.3±0.23ms 199.0 MB/sec float_with_nans/default 1.00 63.5±0.30ms 220.6 MB/sec 1.00 63.5±0.89ms 220.5 MB/sec float_with_nans/parquet_2 1.00 80.8±0.26ms 173.2 MB/sec 1.00 80.4±0.87ms 174.0 MB/sec float_with_nans/zstd 1.00 101.6±1.05ms 137.7 MB/sec 1.00 101.5±1.36ms 137.9 MB/sec float_with_nans/zstd_parquet_2 1.01 118.1±1.06ms 118.6 MB/sec 1.00 117.5±1.34ms 119.2 MB/sec fsb/bloom_filter 1.00 8.2±0.06ms 1968.7 MB/sec 1.00 8.2±0.12ms 1966.0 MB/sec fsb/cdc 1.00 10.7±0.11ms 1509.9 MB/sec 1.00 10.7±0.08ms 1511.5 MB/sec fsb/default 1.01 7.1±0.06ms 2.2 GB/sec 1.00 7.1±0.11ms 2.2 GB/sec fsb/parquet_2 1.01 13.4±0.07ms 1205.8 MB/sec 1.00 13.3±0.12ms 1213.2 MB/sec fsb/zstd 1.00 9.6±0.20ms 1677.3 MB/sec 1.00 9.6±0.12ms 1679.8 MB/sec fsb/zstd_parquet_2 1.01 14.4±0.12ms 1120.9 MB/sec 1.00 14.3±0.14ms 1127.2 MB/sec int32_ree/bloom_filter 1.01 41.4±0.17ms 9.8 MB/sec 1.00 41.2±0.28ms 9.9 MB/sec int32_ree/cdc 1.00 40.7±0.09ms 10.0 MB/sec 1.00 40.6±0.09ms 10.0 MB/sec int32_ree/default 1.00 36.7±0.09ms 11.1 MB/sec 1.00 36.7±0.08ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.07ms 11.1 MB/sec 1.00 36.6±0.06ms 11.1 MB/sec int32_ree/zstd 1.00 37.3±0.09ms 10.9 MB/sec 1.00 37.2±0.09ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.08ms 10.9 MB/sec 1.00 37.2±0.08ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.2±0.06ms 18.4 MB/sec 1.00 22.1±0.07ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.01 24.5±0.05ms 16.6 MB/sec 1.00 24.3±0.04ms 16.8 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.03ms 18.8 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.7±0.03ms 18.8 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.04ms 18.5 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.03ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.01 75.5±1.08ms 3.3 GB/sec 1.00 74.8±1.02ms 3.3 GB/sec large_string_distinct/plain 1.00 60.3±0.86ms 4.1 GB/sec 1.00 60.3±0.92ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 54.5±0.83ms 4.6 GB/sec 1.00 54.5±0.94ms 4.6 GB/sec large_string_non_null/bloom_filter 1.00 69.0±0.20ms 3.6 GB/sec 1.13 77.7±0.37ms 3.2 GB/sec large_string_non_null/cdc 1.00 240.5±0.91ms 1064.7 MB/sec 1.01 243.9±0.98ms 1049.7 MB/sec large_string_non_null/default 1.00 51.6±0.28ms 4.8 GB/sec 1.16 59.8±0.42ms 4.2 GB/sec large_string_non_null/parquet_2 1.00 51.7±0.27ms 4.8 GB/sec 1.15 59.7±0.33ms 4.2 GB/sec large_string_non_null/zstd 1.00 51.6±0.22ms 4.8 GB/sec 1.17 60.1±0.59ms 4.2 GB/sec large_string_non_null/zstd_parquet_2 1.00 51.9±0.31ms 4.8 GB/sec 1.15 59.9±0.50ms 4.2 GB/sec large_string_shared_prefix/delta_byte_array 1.00 109.3±2.70ms 2.3 GB/sec 1.00 109.6±1.86ms 2.3 GB/sec large_string_shared_prefix/plain 1.01 93.5±1.05ms 2.7 GB/sec 1.00 92.7±0.89ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 55.3±0.65ms 4.5 GB/sec 1.00 55.5±0.73ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 70.3±0.92ms 3.6 GB/sec 1.00 70.3±0.83ms 3.6 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.1±0.76ms 4.0 GB/sec 1.01 62.9±0.80ms 4.0 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.01 55.9±3.56ms 2.2 GB/sec 1.00 55.1±1.03ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.19 81.5±7.47ms 3.1 GB/sec 1.00 68.6±0.97ms 3.6 GB/sec list_nested/bloom_filter 1.00 144.9±0.26ms 199.2 MB/sec 1.00 144.9±0.24ms 199.1 MB/sec list_nested/cdc 1.00 161.6±0.31ms 178.6 MB/sec 1.01 163.3±0.31ms 176.7 MB/sec list_nested/default 1.00 130.4±0.27ms 221.3 MB/sec 1.01 131.8±0.22ms 218.9 MB/sec list_nested/parquet_2 1.00 143.6±0.29ms 200.9 MB/sec 1.01 145.0±0.27ms 199.0 MB/sec list_nested/zstd 1.00 139.7±0.26ms 206.6 MB/sec 1.01 141.1±0.31ms 204.6 MB/sec list_nested/zstd_parquet_2 1.01 158.9±1.13ms 181.6 MB/sec 1.00 157.8±0.23ms 182.8 MB/sec list_primitive/bloom_filter 1.06 310.6±4.43ms 1755.6 MB/sec 1.00 293.5±2.75ms 1858.0 MB/sec list_primitive/cdc 1.02 323.0±8.75ms 1688.6 MB/sec 1.00 315.1±4.62ms 1730.8 MB/sec list_primitive/default 1.04 223.2±4.84ms 2.4 GB/sec 1.00 214.8±2.56ms 2.5 GB/sec list_primitive/parquet_2 1.06 248.1±3.19ms 2.1 GB/sec 1.00 234.1±0.99ms 2.3 GB/sec list_primitive/zstd 1.07 487.1±12.67ms 1119.5 MB/sec 1.00 453.6±2.76ms 1202.4 MB/sec list_primitive/zstd_parquet_2 1.02 465.7±1.79ms 1171.0 MB/sec 1.00 454.8±0.98ms 1199.2 MB/sec list_primitive_non_null/bloom_filter 1.06 414.0±11.05ms 1314.7 MB/sec 1.00 389.9±11.11ms 1395.8 MB/sec list_primitive_non_null/cdc 1.00 388.5±7.49ms 1400.8 MB/sec 1.00 390.3±9.26ms 1394.4 MB/sec list_primitive_non_null/default 1.10 283.7±15.90ms 1918.3 MB/sec 1.00 256.9±8.51ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.01 273.7±23.44ms 1988.6 MB/sec 1.00 270.3±17.15ms 2013.7 MB/sec list_primitive_non_null/zstd 1.04 710.5±8.55ms 766.0 MB/sec 1.00 681.2±3.42ms 798.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 660.2±21.97ms 824.3 MB/sec 1.02 673.9±9.63ms 807.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.9±0.15ms 2.8 GB/sec 1.00 12.9±0.14ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.04 25.4±0.14ms 1469.6 MB/sec 1.00 24.4±0.14ms 1532.6 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.6±0.10ms 2.9 GB/sec 1.00 12.6±0.10ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.6±0.10ms 2.9 GB/sec 1.00 12.6±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.4±0.09ms 2.5 GB/sec 1.00 14.4±0.09ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.11ms 2.9 GB/sec 1.00 12.7±0.13ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 282.4±0.77ms 161.5 MB/sec 1.00 280.3±0.53ms 162.7 MB/sec list_struct_with_list/cdc 1.01 323.7±4.10ms 140.9 MB/sec 1.00 320.8±0.68ms 142.1 MB/sec list_struct_with_list/default 1.00 254.9±0.52ms 178.9 MB/sec 1.00 255.7±0.77ms 178.3 MB/sec list_struct_with_list/parquet_2 1.00 272.3±0.56ms 167.4 MB/sec 1.00 272.7±0.57ms 167.2 MB/sec list_struct_with_list/zstd 1.00 277.5±0.94ms 164.3 MB/sec 1.00 277.1±0.61ms 164.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.5±0.50ms 154.3 MB/sec 1.00 295.9±0.54ms 154.1 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 37.5±0.21ms 6.7 GB/sec 1.07 40.0±0.67ms 6.3 GB/sec primitive/bloom_filter 1.00 145.9±0.64ms 307.5 MB/sec 1.02 149.5±0.62ms 300.1 MB/sec primitive/cdc 1.00 156.0±0.44ms 287.6 MB/sec 1.01 157.1±0.68ms 285.6 MB/sec primitive/default 1.00 114.4±0.39ms 392.3 MB/sec 1.01 115.9±0.46ms 387.3 MB/sec primitive/parquet_2 1.00 129.1±0.38ms 347.6 MB/sec 1.01 130.8±0.39ms 343.1 MB/sec primitive/zstd 1.00 144.2±0.48ms 311.2 MB/sec 1.01 145.9±0.42ms 307.6 MB/sec primitive/zstd_parquet_2 1.00 162.2±0.40ms 276.6 MB/sec 1.01 164.1±0.51ms 273.5 MB/sec primitive_all_null/bloom_filter 1.00 886.7±5.18µs 49.4 GB/sec 1.00 885.3±4.36µs 49.5 GB/sec primitive_all_null/cdc 1.00 18.9±0.32ms 2.3 GB/sec 1.01 19.1±0.29ms 2.3 GB/sec primitive_all_null/default 1.00 271.3±1.75µs 161.5 GB/sec 1.01 273.6±1.48µs 160.2 GB/sec primitive_all_null/parquet_2 1.00 277.6±1.65µs 157.8 GB/sec 1.02 282.3±1.68µs 155.2 GB/sec primitive_all_null/zstd 1.00 421.9±1.99µs 103.9 GB/sec 1.00 422.5±1.86µs 103.7 GB/sec primitive_all_null/zstd_parquet_2 1.00 375.4±1.57µs 116.7 GB/sec 1.01 378.2±1.89µs 115.9 GB/sec primitive_non_null/bloom_filter 1.00 103.3±0.68ms 426.1 MB/sec 1.03 105.8±0.45ms 415.7 MB/sec primitive_non_null/cdc 1.00 85.2±0.33ms 516.6 MB/sec 1.01 86.4±0.29ms 509.1 MB/sec primitive_non_null/default 1.00 63.0±0.33ms 698.9 MB/sec 1.01 63.8±0.33ms 689.2 MB/sec primitive_non_null/parquet_2 1.00 84.5±0.28ms 521.0 MB/sec 1.01 85.5±0.41ms 514.5 MB/sec primitive_non_null/zstd 1.00 93.3±0.31ms 471.8 MB/sec 1.01 94.6±0.34ms 465.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.4±0.28ms 374.8 MB/sec 1.01 118.8±0.32ms 370.4 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.8±0.24ms 3.4 GB/sec 1.01 12.8±0.23ms 3.4 GB/sec primitive_sparse_99pct_null/cdc 1.04 32.3±0.28ms 1388.9 MB/sec 1.00 31.0±0.26ms 1445.5 MB/sec primitive_sparse_99pct_null/default 1.00 11.0±0.10ms 4.0 GB/sec 1.01 11.1±0.12ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.0±0.09ms 4.0 GB/sec 1.00 11.0±0.12ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.5±0.12ms 3.0 GB/sec 1.00 14.4±0.12ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.1±0.11ms 3.4 GB/sec 1.00 12.9±0.12ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.2±0.05ms 440.5 MB/sec 1.08 29.5±0.06ms 406.7 MB/sec short_string_non_null/cdc 1.00 19.8±0.07ms 605.7 MB/sec 1.01 20.1±0.08ms 597.4 MB/sec short_string_non_null/default 1.00 15.6±0.03ms 767.3 MB/sec 1.02 15.9±0.05ms 752.7 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.07ms 463.8 MB/sec 1.01 26.1±0.10ms 460.4 MB/sec short_string_non_null/zstd 1.00 35.8±0.11ms 334.9 MB/sec 1.01 36.2±0.09ms 331.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.7±0.09ms 418.6 MB/sec 1.01 28.9±0.04ms 415.4 MB/sec small_string_distinct/delta_byte_array 1.00 983.6±11.57µs 8.0 GB/sec 1.00 985.0±9.82µs 8.0 GB/sec small_string_distinct/plain 1.10 766.7±12.87µs 10.2 GB/sec 1.00 698.5±12.41µs 11.2 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1030.6±22.47µs 7.6 GB/sec 1.00 1030.4±24.36µs 7.6 GB/sec small_string_partial_prefix/plain 1.07 1026.6±14.72µs 7.6 GB/sec 1.00 955.2±26.64µs 8.2 GB/sec small_string_shared_prefix/delta_byte_array 1.00 972.4±4.60µs 8.1 GB/sec 1.01 980.3±9.03µs 8.0 GB/sec small_string_shared_prefix/plain 1.06 1122.9±4.55µs 7.0 GB/sec 1.00 1054.7±7.40µs 7.4 GB/sec string/bloom_filter 1.00 222.0±26.83ms 2.3 GB/sec 1.01 224.1±27.05ms 2.3 GB/sec string/cdc 1.04 216.3±14.50ms 2.4 GB/sec 1.00 208.7±6.80ms 2.5 GB/sec string/default 1.00 124.3±19.25ms 4.1 GB/sec 1.01 125.6±21.29ms 4.1 GB/sec string/parquet_2 1.43 169.0±7.19ms 3.0 GB/sec 1.00 118.2±1.83ms 4.3 GB/sec string/zstd 1.01 472.9±12.90ms 1108.5 MB/sec 1.00 468.6±25.57ms 1118.8 MB/sec string/zstd_parquet_2 1.00 401.2±14.57ms 1306.6 MB/sec 1.14 457.4±8.00ms 1146.1 MB/sec string_and_binary_view/bloom_filter 1.02 67.0±0.31ms 481.5 MB/sec 1.00 66.0±0.50ms 488.7 MB/sec string_and_binary_view/cdc 1.02 60.8±0.20ms 530.5 MB/sec 1.00 59.8±0.15ms 539.1 MB/sec string_and_binary_view/default 1.02 50.2±0.19ms 643.0 MB/sec 1.00 49.1±0.16ms 657.2 MB/sec string_and_binary_view/parquet_2 1.01 60.8±0.16ms 530.3 MB/sec 1.00 60.5±0.22ms 533.2 MB/sec string_and_binary_view/zstd 1.01 87.4±0.23ms 369.0 MB/sec 1.00 86.3±0.18ms 373.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.8±0.16ms 431.4 MB/sec 1.00 74.4±0.20ms 433.4 MB/sec string_dictionary/bloom_filter 1.00 88.7±1.68ms 2.9 GB/sec 1.01 89.9±1.03ms 2.9 GB/sec string_dictionary/cdc 1.00 46.2±0.58ms 5.6 GB/sec 1.09 50.3±0.49ms 5.1 GB/sec string_dictionary/default 1.00 43.9±0.60ms 5.9 GB/sec 1.04 45.7±0.73ms 5.6 GB/sec string_dictionary/parquet_2 1.00 49.2±0.25ms 5.2 GB/sec 1.00 49.1±0.14ms 5.3 GB/sec string_dictionary/zstd 1.00 210.7±1.25ms 1253.6 MB/sec 1.00 211.2±0.98ms 1250.6 MB/sec string_dictionary/zstd_parquet_2 1.00 192.4±0.33ms 1372.9 MB/sec 1.00 192.7±0.28ms 1370.6 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.0±0.06ms 117.9 MB/sec 1.01 34.4±0.13ms 116.5 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.4±0.05ms 146.1 MB/sec 1.02 27.9±0.12ms 143.6 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.1±0.07ms 159.6 MB/sec 1.02 25.5±0.14ms 157.0 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.1±0.07ms 159.6 MB/sec 1.02 25.5±0.13ms 156.9 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.5±0.07ms 157.2 MB/sec 1.02 25.9±0.13ms 154.6 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.5±0.06ms 157.4 MB/sec 1.02 25.9±0.13ms 154.9 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.01 33.8±0.07ms 118.5 MB/sec 1.00 33.6±0.14ms 119.3 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.7±0.08ms 144.7 MB/sec 1.01 27.9±0.12ms 143.8 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.4±0.08ms 157.9 MB/sec 1.01 25.5±0.14ms 156.9 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.5±0.10ms 157.2 MB/sec 1.00 25.5±0.15ms 156.8 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.6±0.10ms 156.3 MB/sec 1.00 25.7±0.13ms 155.9 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.5±0.07ms 156.9 MB/sec 1.00 25.6±0.13ms 156.3 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.1±0.06ms 114.3 MB/sec 1.01 35.3±0.13ms 113.7 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.2±0.09ms 142.2 MB/sec 1.01 28.4±0.14ms 141.4 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.7±0.06ms 156.3 MB/sec 1.01 26.0±0.17ms 154.4 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.7±0.06ms 156.0 MB/sec 1.01 26.0±0.16ms 154.2 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.2±0.06ms 152.9 MB/sec 1.01 26.6±0.15ms 150.9 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.2±0.05ms 152.9 MB/sec 1.01 26.5±0.14ms 151.4 MB/sec string_non_null/bloom_filter 1.00 241.9±10.89ms 2.1 GB/sec 1.14 274.9±30.57ms 1905.9 MB/sec string_non_null/cdc 1.00 251.2±5.22ms 2.0 GB/sec 1.00 250.3±3.79ms 2.0 GB/sec string_non_null/default 1.00 135.7±23.22ms 3.8 GB/sec 1.11 150.0±27.46ms 3.4 GB/sec string_non_null/parquet_2 1.02 126.5±11.72ms 4.0 GB/sec 1.00 124.6±12.33ms 4.1 GB/sec string_non_null/zstd 1.00 557.7±5.81ms 939.5 MB/sec 1.05 586.8±13.94ms 893.0 MB/sec string_non_null/zstd_parquet_2 1.02 511.1±14.00ms 1025.3 MB/sec 1.00 502.7±16.05ms 1042.4 MB/sec string_ree/bloom_filter 1.03 159.8±6.23ms 102.7 MB/sec 1.00 154.7±2.99ms 106.0 MB/sec string_ree/cdc 1.00 223.5±3.60ms 73.4 MB/sec 1.00 222.5±1.86ms 73.7 MB/sec string_ree/default 1.01 128.5±4.29ms 127.7 MB/sec 1.00 127.2±2.57ms 129.0 MB/sec string_ree/parquet_2 1.04 132.6±4.90ms 123.7 MB/sec 1.00 127.2±2.30ms 129.0 MB/sec string_ree/zstd 1.01 188.9±5.22ms 86.9 MB/sec 1.00 186.2±2.84ms 88.1 MB/sec string_ree/zstd_parquet_2 1.02 146.5±4.26ms 112.0 MB/sec 1.00 143.2±3.07ms 114.5 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.7±0.09ms 52.8 MB/sec 1.00 26.6±0.16ms 52.9 MB/sec string_ree_95pct_null/cdc 1.00 32.6±0.13ms 43.1 MB/sec 1.01 33.1±0.18ms 42.5 MB/sec string_ree_95pct_null/default 1.00 25.0±0.08ms 56.2 MB/sec 1.00 25.0±0.11ms 56.4 MB/sec string_ree_95pct_null/parquet_2 1.00 25.0±0.06ms 56.3 MB/sec 1.03 25.7±0.10ms 54.8 MB/sec string_ree_95pct_null/zstd 1.00 25.8±0.05ms 54.5 MB/sec 1.01 26.0±0.32ms 54.2 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.7±0.07ms 54.7 MB/sec 1.00 25.8±0.07ms 54.6 MB/sec struct_all_null/bloom_filter 1.03 382.3±4.00µs 41.2 GB/sec 1.00 370.9±1.75µs 42.5 GB/sec struct_all_null/cdc 1.00 7.6±0.10ms 2.1 GB/sec 1.04 7.9±0.09ms 2044.7 MB/sec struct_all_null/default 1.00 115.2±0.77µs 136.7 GB/sec 1.03 118.3±0.88µs 133.2 GB/sec struct_all_null/parquet_2 1.00 119.0±0.78µs 132.4 GB/sec 1.03 122.0±0.76µs 129.1 GB/sec struct_all_null/zstd 1.00 180.6±0.80µs 87.2 GB/sec 1.01 181.7±0.98µs 86.7 GB/sec struct_all_null/zstd_parquet_2 1.00 162.1±0.86µs 97.2 GB/sec 1.00 162.8±0.84µs 96.7 GB/sec struct_non_null/bloom_filter 1.02 44.2±0.15ms 362.1 MB/sec 1.00 43.3±0.18ms 369.4 MB/sec struct_non_null/cdc 1.00 43.3±0.19ms 369.8 MB/sec 1.00 43.2±0.20ms 370.6 MB/sec struct_non_null/default 1.01 30.0±0.66ms 533.7 MB/sec 1.00 29.6±0.17ms 540.0 MB/sec struct_non_null/parquet_2 1.00 38.4±0.12ms 416.5 MB/sec 1.00 38.3±0.13ms 417.6 MB/sec struct_non_null/zstd 1.00 38.3±0.11ms 417.7 MB/sec 1.00 38.2±0.12ms 418.6 MB/sec struct_non_null/zstd_parquet_2 1.00 52.2±0.20ms 306.3 MB/sec 1.00 52.2±0.23ms 306.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.12ms 2.3 GB/sec 1.00 6.7±0.10ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.05 14.9±0.15ms 1084.0 MB/sec 1.00 14.2±0.15ms 1134.2 MB/sec struct_sparse_99pct_null/default 1.00 6.1±0.06ms 2.6 GB/sec 1.00 6.1±0.05ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.1±0.05ms 2.6 GB/sec 1.00 6.1±0.06ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.06ms 2.1 GB/sec 1.00 7.4±0.06ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.02 6.9±0.11ms 2.3 GB/sec 1.00 6.8±0.06ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3295.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3167.7s | | CPU sys | 123.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3295.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3155.6s | | CPU sys | 138.3s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
