adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5337331144
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5336010826) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (477a393bfca1658b56679d71ed149066184e670f) to 177bde8 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/177bde8225b5ffa49c19f3b66109ae3091ef3114..477a393bfca1658b56679d71ed149066184e670f) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.6±0.03ms 19.8 MB/sec 1.03 12.9±0.11ms 19.3 MB/sec bool/cdc 1.00 15.2±0.05ms 16.4 MB/sec 1.03 15.6±0.08ms 16.0 MB/sec bool/default 1.00 10.5±0.04ms 23.7 MB/sec 1.02 10.8±0.11ms 23.2 MB/sec bool/parquet_2 1.00 13.5±0.05ms 18.5 MB/sec 1.01 13.7±0.12ms 18.2 MB/sec bool/zstd 1.00 11.0±0.03ms 22.7 MB/sec 1.02 11.3±0.11ms 22.2 MB/sec bool/zstd_parquet_2 1.00 13.9±0.03ms 18.0 MB/sec 1.01 14.1±0.12ms 17.8 MB/sec bool_non_null/bloom_filter 1.01 6.6±0.03ms 18.9 MB/sec 1.00 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.01 6.4±0.03ms 19.7 MB/sec 1.00 6.3±0.03ms 19.8 MB/sec bool_non_null/default 1.02 3.9±0.03ms 32.2 MB/sec 1.00 3.8±0.02ms 32.8 MB/sec bool_non_null/parquet_2 1.02 7.8±0.03ms 16.1 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.02 4.2±0.03ms 29.5 MB/sec 1.00 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.02 8.2±0.03ms 15.3 MB/sec 1.00 8.0±0.03ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.1±0.09ms 7.1 MB/sec 1.01 30.3±0.15ms 7.0 MB/sec bool_ree/cdc 1.00 31.3±0.09ms 6.8 MB/sec 1.01 31.6±0.14ms 6.7 MB/sec bool_ree/default 1.00 27.4±0.12ms 7.8 MB/sec 1.01 27.6±0.15ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.9±0.08ms 7.4 MB/sec 1.00 29.1±0.15ms 7.3 MB/sec bool_ree/zstd 1.00 28.0±0.06ms 7.6 MB/sec 1.01 28.2±0.14ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.07ms 7.3 MB/sec 1.01 29.4±0.14ms 7.2 MB/sec decimal/bloom_filter 1.00 120.6±0.37ms 497.7 MB/sec 1.27 153.3±0.58ms 391.3 MB/sec decimal/cdc 1.00 101.2±0.35ms 593.0 MB/sec 1.03 104.3±3.56ms 575.5 MB/sec decimal/default 1.00 78.9±1.09ms 760.4 MB/sec 1.49 117.9±1.12ms 509.1 MB/sec decimal/parquet_2 1.00 177.6±1.77ms 337.9 MB/sec 1.20 213.4±1.79ms 281.1 MB/sec decimal/zstd 1.00 90.0±1.20ms 666.9 MB/sec 1.43 128.2±1.24ms 467.9 MB/sec decimal/zstd_parquet_2 1.00 198.5±1.79ms 302.3 MB/sec 1.19 236.2±1.78ms 254.0 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.4±0.99ms 17.2 MB/sec 1.00 58.1±0.39ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.00 61.4±0.25ms 16.4 MB/sec 1.01 61.9±0.36ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.5±0.24ms 19.6 MB/sec 1.00 51.6±0.29ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.2±1.39ms 15.2 MB/sec 1.00 66.0±0.28ms 15.3 MB/sec fixed_size_binary_ree/zstd 1.00 57.4±0.26ms 17.6 MB/sec 1.00 57.6±0.25ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.01 67.0±1.38ms 15.0 MB/sec 1.00 66.7±0.26ms 15.1 MB/sec float_with_nans/bloom_filter 1.00 81.0±0.36ms 172.8 MB/sec 1.09 88.6±0.38ms 158.1 MB/sec float_with_nans/cdc 1.00 70.4±0.23ms 198.7 MB/sec 1.00 70.2±0.62ms 199.4 MB/sec float_with_nans/default 1.00 63.2±0.24ms 221.4 MB/sec 1.13 71.4±0.31ms 196.1 MB/sec float_with_nans/parquet_2 1.00 80.7±0.26ms 173.6 MB/sec 1.10 88.8±0.27ms 157.6 MB/sec float_with_nans/zstd 1.00 101.5±0.29ms 137.9 MB/sec 1.08 109.6±0.26ms 127.7 MB/sec float_with_nans/zstd_parquet_2 1.00 117.5±0.29ms 119.1 MB/sec 1.07 125.9±0.29ms 111.2 MB/sec fsb/bloom_filter 1.02 8.2±0.04ms 1968.9 MB/sec 1.00 8.0±0.03ms 2005.1 MB/sec fsb/cdc 1.00 10.4±0.04ms 1552.5 MB/sec 1.00 10.4±0.04ms 1547.5 MB/sec fsb/default 1.01 7.1±0.04ms 2.2 GB/sec 1.00 7.0±0.03ms 2.2 GB/sec fsb/parquet_2 1.02 13.3±0.07ms 1210.3 MB/sec 1.00 13.1±0.05ms 1230.2 MB/sec fsb/zstd 1.00 9.5±0.03ms 1703.0 MB/sec 1.00 9.5±0.03ms 1705.4 MB/sec fsb/zstd_parquet_2 1.01 14.2±0.08ms 1137.5 MB/sec 1.00 14.0±0.08ms 1150.6 MB/sec int32_ree/bloom_filter 1.01 40.6±0.25ms 10.0 MB/sec 1.00 40.3±0.17ms 10.1 MB/sec int32_ree/cdc 1.01 40.6±0.08ms 10.0 MB/sec 1.00 40.3±0.08ms 10.1 MB/sec int32_ree/default 1.00 36.6±0.12ms 11.1 MB/sec 1.00 36.5±0.08ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.15ms 11.1 MB/sec 1.00 36.5±0.07ms 11.1 MB/sec int32_ree/zstd 1.00 37.2±0.12ms 10.9 MB/sec 1.00 37.0±0.07ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.01 37.3±0.26ms 10.9 MB/sec 1.00 37.0±0.06ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.05ms 18.5 MB/sec 1.00 21.9±0.05ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.02 24.2±0.05ms 16.8 MB/sec 1.00 23.8±0.04ms 17.1 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.02ms 18.8 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.04ms 18.7 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.04ms 18.6 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.01 74.0±0.72ms 3.4 GB/sec 1.00 73.6±0.29ms 3.4 GB/sec large_string_distinct/plain 1.00 59.4±0.60ms 4.2 GB/sec 1.00 59.6±0.63ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 52.8±0.29ms 4.7 GB/sec 1.00 52.8±0.30ms 4.7 GB/sec large_string_non_null/bloom_filter 1.00 68.2±0.09ms 3.7 GB/sec 1.05 71.8±0.09ms 3.5 GB/sec large_string_non_null/cdc 1.00 239.7±1.12ms 1068.0 MB/sec 1.02 243.4±1.01ms 1051.9 MB/sec large_string_non_null/default 1.00 50.9±0.08ms 4.9 GB/sec 1.06 54.0±0.09ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 50.9±0.07ms 4.9 GB/sec 1.06 54.1±0.09ms 4.6 GB/sec large_string_non_null/zstd 1.00 51.0±0.08ms 4.9 GB/sec 1.06 54.1±0.09ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 51.0±0.07ms 4.9 GB/sec 1.06 54.1±0.09ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.01 106.4±0.30ms 2.4 GB/sec 1.00 105.5±0.35ms 2.4 GB/sec large_string_shared_prefix/plain 1.00 92.1±0.67ms 2.7 GB/sec 1.00 92.0±0.84ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 53.7±0.27ms 4.7 GB/sec 1.00 53.9±0.20ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.01 68.7±0.43ms 3.6 GB/sec 1.00 68.2±0.31ms 3.7 GB/sec large_string_shared_prefix_nullable/plain 1.04 63.0±0.37ms 4.0 GB/sec 1.00 60.5±0.27ms 4.1 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.01 53.4±0.44ms 2.3 GB/sec 1.00 53.1±0.44ms 2.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.01 66.5±0.26ms 3.8 GB/sec 1.00 65.8±0.21ms 3.8 GB/sec list_nested/bloom_filter 1.01 143.6±0.19ms 200.9 MB/sec 1.00 142.9±0.23ms 201.9 MB/sec list_nested/cdc 1.00 160.2±0.18ms 180.1 MB/sec 1.00 160.9±0.18ms 179.4 MB/sec list_nested/default 1.00 128.8±0.19ms 224.1 MB/sec 1.01 129.9±0.21ms 222.2 MB/sec list_nested/parquet_2 1.00 142.0±0.20ms 203.2 MB/sec 1.01 143.1±0.19ms 201.6 MB/sec list_nested/zstd 1.00 138.2±0.45ms 208.8 MB/sec 1.01 139.1±0.22ms 207.4 MB/sec list_nested/zstd_parquet_2 1.00 154.8±0.18ms 186.4 MB/sec 1.01 155.9±0.17ms 185.1 MB/sec list_primitive/bloom_filter 1.00 301.1±3.13ms 1811.1 MB/sec 1.01 304.1±10.87ms 1793.7 MB/sec list_primitive/cdc 1.00 319.6±8.01ms 1706.6 MB/sec 1.00 318.5±8.85ms 1712.3 MB/sec list_primitive/default 1.00 222.3±4.30ms 2.4 GB/sec 1.13 252.1±23.70ms 2.1 GB/sec list_primitive/parquet_2 1.05 246.5±0.79ms 2.2 GB/sec 1.00 235.7±0.47ms 2.3 GB/sec list_primitive/zstd 1.00 472.6±1.42ms 1153.9 MB/sec 1.03 486.3±6.91ms 1121.5 MB/sec list_primitive/zstd_parquet_2 1.00 463.8±0.44ms 1175.8 MB/sec 1.00 464.8±8.74ms 1173.4 MB/sec list_primitive_non_null/bloom_filter 1.00 408.1±10.87ms 1333.5 MB/sec 1.02 416.0±15.74ms 1308.3 MB/sec list_primitive_non_null/cdc 1.00 389.0±7.46ms 1398.9 MB/sec 1.00 390.4±7.66ms 1394.0 MB/sec list_primitive_non_null/default 1.00 265.4±12.76ms 2.0 GB/sec 1.06 282.4±20.56ms 1927.1 MB/sec list_primitive_non_null/parquet_2 1.00 257.5±14.84ms 2.1 GB/sec 1.03 265.0±13.68ms 2.0 GB/sec list_primitive_non_null/zstd 1.02 645.2±3.98ms 843.5 MB/sec 1.00 630.5±2.93ms 863.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 648.9±15.09ms 838.7 MB/sec 1.00 638.5±5.11ms 852.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.6±0.05ms 2.9 GB/sec 1.00 12.5±0.05ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.0±0.09ms 1559.0 MB/sec 1.00 23.9±0.09ms 1562.4 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.04ms 3.0 GB/sec 1.00 12.2±0.04ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.3±0.04ms 3.0 GB/sec 1.00 12.2±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.1±0.05ms 2.6 GB/sec 1.00 14.1±0.06ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.5±0.04ms 2.9 GB/sec 1.00 12.4±0.04ms 3.0 GB/sec list_struct_with_list/bloom_filter 1.01 279.8±0.45ms 163.0 MB/sec 1.00 277.9±0.48ms 164.1 MB/sec list_struct_with_list/cdc 1.00 317.9±0.47ms 143.4 MB/sec 1.00 317.5±0.41ms 143.6 MB/sec list_struct_with_list/default 1.00 252.5±0.44ms 180.6 MB/sec 1.00 252.9±0.48ms 180.3 MB/sec list_struct_with_list/parquet_2 1.00 269.9±0.42ms 168.9 MB/sec 1.00 270.4±0.53ms 168.6 MB/sec list_struct_with_list/zstd 1.00 274.6±0.49ms 166.1 MB/sec 1.00 274.8±0.44ms 165.9 MB/sec list_struct_with_list/zstd_parquet_2 1.00 293.2±0.48ms 155.5 MB/sec 1.00 294.1±0.99ms 155.0 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 34.9±0.07ms 7.2 GB/sec 1.08 37.9±0.09ms 6.6 GB/sec primitive/bloom_filter 1.00 146.5±0.88ms 306.3 MB/sec 1.00 146.0±0.64ms 307.3 MB/sec primitive/cdc 1.00 155.2±0.47ms 289.2 MB/sec 1.00 155.6±0.74ms 288.5 MB/sec primitive/default 1.00 114.1±0.31ms 393.4 MB/sec 1.01 115.2±0.48ms 389.4 MB/sec primitive/parquet_2 1.00 129.1±0.29ms 347.7 MB/sec 1.01 130.5±0.60ms 344.0 MB/sec primitive/zstd 1.00 143.9±0.34ms 311.9 MB/sec 1.01 145.0±0.63ms 309.5 MB/sec primitive/zstd_parquet_2 1.00 162.1±0.32ms 276.9 MB/sec 1.01 163.2±0.51ms 275.0 MB/sec primitive_all_null/bloom_filter 1.00 879.8±2.26µs 49.8 GB/sec 1.00 878.4±1.96µs 49.9 GB/sec primitive_all_null/cdc 1.01 19.3±0.46ms 2.3 GB/sec 1.00 19.1±0.36ms 2.3 GB/sec primitive_all_null/default 1.01 275.4±1.40µs 159.1 GB/sec 1.00 273.5±1.12µs 160.2 GB/sec primitive_all_null/parquet_2 1.01 283.8±1.29µs 154.4 GB/sec 1.00 282.3±1.16µs 155.2 GB/sec primitive_all_null/zstd 1.00 422.6±1.40µs 103.7 GB/sec 1.00 421.4±1.51µs 104.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 378.8±1.25µs 115.7 GB/sec 1.01 381.2±1.33µs 115.0 GB/sec primitive_non_null/bloom_filter 1.03 102.9±0.52ms 427.5 MB/sec 1.00 100.3±0.35ms 438.5 MB/sec primitive_non_null/cdc 1.01 85.3±0.31ms 516.0 MB/sec 1.00 84.7±0.29ms 519.3 MB/sec primitive_non_null/default 1.01 62.8±0.25ms 701.0 MB/sec 1.00 61.9±0.22ms 710.5 MB/sec primitive_non_null/parquet_2 1.01 84.5±0.23ms 520.9 MB/sec 1.00 83.9±0.24ms 524.3 MB/sec primitive_non_null/zstd 1.01 93.2±0.24ms 472.3 MB/sec 1.00 92.6±0.27ms 475.2 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.3±0.25ms 375.2 MB/sec 1.00 117.0±0.22ms 376.2 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 12.2±0.10ms 3.6 GB/sec 1.00 12.1±0.10ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.03 30.4±0.38ms 1476.9 MB/sec 1.00 29.6±0.31ms 1515.5 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.04ms 4.1 GB/sec 1.00 10.7±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.04ms 4.1 GB/sec 1.00 10.7±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.06ms 3.1 GB/sec 1.00 14.1±0.06ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 3.5 GB/sec 1.00 12.7±0.07ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.4±0.06ms 438.7 MB/sec 1.00 27.3±0.08ms 439.9 MB/sec short_string_non_null/cdc 1.00 19.6±0.05ms 611.8 MB/sec 1.00 19.6±0.05ms 611.4 MB/sec short_string_non_null/default 1.00 15.4±0.05ms 778.9 MB/sec 1.00 15.5±0.04ms 775.7 MB/sec short_string_non_null/parquet_2 1.00 25.4±0.05ms 472.6 MB/sec 1.01 25.6±0.04ms 468.2 MB/sec short_string_non_null/zstd 1.00 35.6±0.05ms 336.6 MB/sec 1.01 36.0±0.11ms 333.5 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.2±0.07ms 424.8 MB/sec 1.01 28.5±0.05ms 420.5 MB/sec small_string_distinct/delta_byte_array 1.00 951.3±9.26µs 8.2 GB/sec 1.00 951.6±10.38µs 8.2 GB/sec small_string_distinct/plain 1.01 734.3±3.45µs 10.7 GB/sec 1.00 724.5±3.50µs 10.8 GB/sec small_string_partial_prefix/delta_byte_array 1.00 987.9±4.01µs 7.9 GB/sec 1.00 984.6±6.05µs 8.0 GB/sec small_string_partial_prefix/plain 1.01 987.8±3.86µs 7.9 GB/sec 1.00 975.0±5.08µs 8.0 GB/sec small_string_shared_prefix/delta_byte_array 1.00 962.5±1.34µs 8.1 GB/sec 1.01 975.9±2.51µs 8.0 GB/sec small_string_shared_prefix/plain 1.02 1098.3±8.47µs 7.1 GB/sec 1.00 1079.9±9.87µs 7.3 GB/sec string/bloom_filter 1.04 214.2±22.55ms 2.4 GB/sec 1.00 206.7±23.01ms 2.5 GB/sec string/cdc 1.00 200.4±2.14ms 2.6 GB/sec 1.03 207.1±10.22ms 2.5 GB/sec string/default 1.01 119.6±18.92ms 4.3 GB/sec 1.00 118.9±19.52ms 4.3 GB/sec string/parquet_2 1.53 176.1±0.53ms 2.9 GB/sec 1.00 114.8±0.38ms 4.5 GB/sec string/zstd 1.00 457.2±12.37ms 1146.8 MB/sec 1.02 464.4±11.31ms 1128.8 MB/sec string/zstd_parquet_2 1.05 427.3±0.69ms 1226.9 MB/sec 1.00 405.4±0.43ms 1293.3 MB/sec string_and_binary_view/bloom_filter 1.03 65.6±0.34ms 491.4 MB/sec 1.00 63.5±0.28ms 507.6 MB/sec string_and_binary_view/cdc 1.02 60.2±0.11ms 535.9 MB/sec 1.00 59.2±0.24ms 544.6 MB/sec string_and_binary_view/default 1.02 49.5±0.10ms 652.0 MB/sec 1.00 48.5±0.17ms 665.0 MB/sec string_and_binary_view/parquet_2 1.01 60.2±0.18ms 535.3 MB/sec 1.00 59.9±0.24ms 538.7 MB/sec string_and_binary_view/zstd 1.01 86.4±0.14ms 373.1 MB/sec 1.00 85.6±0.24ms 376.5 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.1±0.12ms 435.3 MB/sec 1.00 73.9±0.27ms 436.2 MB/sec string_dictionary/bloom_filter 1.00 82.6±0.26ms 3.1 GB/sec 1.02 83.9±0.58ms 3.1 GB/sec string_dictionary/cdc 1.00 46.6±1.05ms 5.5 GB/sec 1.01 47.2±0.50ms 5.5 GB/sec string_dictionary/default 1.00 42.4±0.19ms 6.1 GB/sec 1.02 43.1±0.63ms 6.0 GB/sec string_dictionary/parquet_2 1.00 48.0±0.53ms 5.4 GB/sec 1.02 49.0±0.13ms 5.3 GB/sec string_dictionary/zstd 1.00 206.2±1.23ms 1281.0 MB/sec 1.00 207.0±0.60ms 1276.1 MB/sec string_dictionary/zstd_parquet_2 1.00 191.4±0.11ms 1379.9 MB/sec 1.00 191.9±0.20ms 1376.6 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.1±0.14ms 117.3 MB/sec 1.00 34.1±0.07ms 117.3 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.7±0.12ms 144.7 MB/sec 1.00 27.8±0.06ms 144.2 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.13ms 157.9 MB/sec 1.00 25.4±0.06ms 157.6 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.4±0.15ms 157.6 MB/sec 1.00 25.4±0.06ms 157.5 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.8±0.15ms 155.3 MB/sec 1.00 25.8±0.06ms 155.4 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.8±0.16ms 155.6 MB/sec 1.00 25.8±0.06ms 155.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 34.1±0.15ms 117.4 MB/sec 1.00 33.3±0.05ms 120.1 MB/sec string_dictionary_low_cardinality_20/cdc 1.03 28.3±0.11ms 141.7 MB/sec 1.00 27.5±0.07ms 145.6 MB/sec string_dictionary_low_cardinality_20/default 1.03 25.9±0.23ms 154.9 MB/sec 1.00 25.1±0.06ms 159.4 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.03 25.9±0.14ms 154.5 MB/sec 1.00 25.1±0.07ms 159.3 MB/sec string_dictionary_low_cardinality_20/zstd 1.03 26.0±0.14ms 153.8 MB/sec 1.00 25.4±0.06ms 157.8 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.03 26.0±0.14ms 153.8 MB/sec 1.00 25.2±0.06ms 158.6 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 34.8±0.16ms 115.1 MB/sec 1.00 34.7±0.09ms 115.7 MB/sec string_dictionary_low_cardinality_400/cdc 1.01 28.2±0.16ms 142.1 MB/sec 1.00 28.1±0.08ms 143.0 MB/sec string_dictionary_low_cardinality_400/default 1.01 25.8±0.16ms 155.6 MB/sec 1.00 25.5±0.08ms 157.2 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.01 25.8±0.17ms 155.5 MB/sec 1.00 25.6±0.08ms 157.0 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 26.3±0.18ms 152.3 MB/sec 1.00 26.1±0.09ms 153.4 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.4±0.20ms 152.0 MB/sec 1.00 26.0±0.09ms 154.2 MB/sec string_non_null/bloom_filter 1.01 246.5±24.27ms 2.1 GB/sec 1.00 243.8±23.07ms 2.1 GB/sec string_non_null/cdc 1.05 249.0±4.08ms 2.1 GB/sec 1.00 236.8±1.17ms 2.2 GB/sec string_non_null/default 1.09 137.4±26.84ms 3.7 GB/sec 1.00 126.5±18.36ms 4.0 GB/sec string_non_null/parquet_2 1.08 121.4±4.48ms 4.2 GB/sec 1.00 112.1±7.96ms 4.6 GB/sec string_non_null/zstd 1.01 563.7±9.53ms 929.6 MB/sec 1.00 558.9±13.84ms 937.5 MB/sec string_non_null/zstd_parquet_2 1.02 496.4±7.28ms 1055.6 MB/sec 1.00 488.0±4.90ms 1073.8 MB/sec string_ree/bloom_filter 1.00 152.1±0.71ms 107.9 MB/sec 1.00 151.8±0.92ms 108.1 MB/sec string_ree/cdc 1.00 222.5±3.06ms 73.7 MB/sec 1.00 221.9±0.62ms 73.9 MB/sec string_ree/default 1.02 125.3±0.76ms 130.9 MB/sec 1.00 123.0±1.90ms 133.3 MB/sec string_ree/parquet_2 1.00 125.4±0.46ms 130.8 MB/sec 1.00 125.3±0.48ms 130.9 MB/sec string_ree/zstd 1.00 181.9±0.74ms 90.2 MB/sec 1.00 182.5±0.90ms 89.9 MB/sec string_ree/zstd_parquet_2 1.00 140.5±0.75ms 116.7 MB/sec 1.00 140.2±0.51ms 117.0 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.1±0.11ms 53.9 MB/sec 1.00 26.2±0.11ms 53.8 MB/sec string_ree_95pct_null/cdc 1.01 32.6±0.10ms 43.2 MB/sec 1.00 32.2±0.09ms 43.6 MB/sec string_ree_95pct_null/default 1.00 24.7±0.08ms 57.0 MB/sec 1.00 24.7±0.08ms 57.0 MB/sec string_ree_95pct_null/parquet_2 1.00 24.7±0.07ms 57.0 MB/sec 1.00 24.7±0.08ms 57.0 MB/sec string_ree_95pct_null/zstd 1.00 25.5±0.10ms 55.1 MB/sec 1.00 25.6±0.66ms 55.0 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.4±0.11ms 55.3 MB/sec 1.00 25.4±0.11ms 55.3 MB/sec struct_all_null/bloom_filter 1.00 367.3±1.02µs 42.9 GB/sec 1.00 369.0±0.90µs 42.7 GB/sec struct_all_null/cdc 1.00 7.9±0.18ms 2.0 GB/sec 1.00 7.9±0.10ms 2.0 GB/sec struct_all_null/default 1.00 116.6±0.57µs 135.1 GB/sec 1.01 118.3±0.48µs 133.1 GB/sec struct_all_null/parquet_2 1.00 120.3±0.48µs 130.9 GB/sec 1.01 121.6±0.43µs 129.5 GB/sec struct_all_null/zstd 1.01 181.2±0.57µs 86.9 GB/sec 1.00 180.2±0.58µs 87.4 GB/sec struct_all_null/zstd_parquet_2 1.00 162.5±0.47µs 96.9 GB/sec 1.00 163.2±0.44µs 96.5 GB/sec struct_non_null/bloom_filter 1.04 44.2±0.20ms 361.8 MB/sec 1.00 42.7±0.16ms 374.9 MB/sec struct_non_null/cdc 1.02 43.4±0.18ms 368.6 MB/sec 1.00 42.6±0.16ms 376.0 MB/sec struct_non_null/default 1.04 30.4±0.48ms 526.3 MB/sec 1.00 29.3±0.12ms 547.0 MB/sec struct_non_null/parquet_2 1.02 38.6±0.17ms 414.8 MB/sec 1.00 38.0±0.10ms 421.0 MB/sec struct_non_null/zstd 1.02 38.4±0.13ms 416.7 MB/sec 1.00 37.8±0.12ms 423.2 MB/sec struct_non_null/zstd_parquet_2 1.01 52.2±0.13ms 306.3 MB/sec 1.00 51.7±0.13ms 309.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.20ms 2.3 GB/sec 1.01 6.8±0.03ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.03 14.0±0.11ms 1149.1 MB/sec 1.00 13.7±0.08ms 1179.6 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.06ms 2.6 GB/sec 1.05 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.05 6.3±0.01ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.03ms 2.1 GB/sec 1.04 7.7±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.03ms 2.3 GB/sec 1.04 7.0±0.02ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3285.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3134.2s | | CPU sys | 147.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3275.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3148.5s | | CPU sys | 124.5s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
