adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5344915440
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5343488871) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (525a6595f42c7c70f4999e08660137b43bdbff60) to 505afcb (merge-base) [diff](https://github.com/apache/arrow-rs/compare/505afcbfd2c27897f747916e782d41e1593b7007..525a6595f42c7c70f4999e08660137b43bdbff60) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.5±0.03ms 20.0 MB/sec 1.01 12.6±0.04ms 19.8 MB/sec bool/cdc 1.02 15.4±0.05ms 16.2 MB/sec 1.00 15.2±0.04ms 16.5 MB/sec bool/default 1.00 10.4±0.04ms 24.0 MB/sec 1.01 10.5±0.03ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.04ms 18.7 MB/sec 1.00 13.4±0.03ms 18.6 MB/sec bool/zstd 1.00 10.9±0.03ms 22.9 MB/sec 1.01 11.0±0.03ms 22.8 MB/sec bool/zstd_parquet_2 1.00 13.8±0.04ms 18.1 MB/sec 1.00 13.8±0.04ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.2 MB/sec 1.00 6.5±0.02ms 19.2 MB/sec bool_non_null/cdc 1.03 6.4±0.05ms 19.5 MB/sec 1.00 6.2±0.02ms 20.1 MB/sec bool_non_null/default 1.00 3.7±0.04ms 33.5 MB/sec 1.01 3.8±0.02ms 33.3 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.4 MB/sec 1.00 7.6±0.02ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.04ms 30.6 MB/sec 1.00 4.1±0.02ms 30.5 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.04ms 15.6 MB/sec 1.00 8.0±0.02ms 15.7 MB/sec bool_ree/bloom_filter 1.01 30.4±0.15ms 7.0 MB/sec 1.00 30.1±0.08ms 7.1 MB/sec bool_ree/cdc 1.01 31.7±0.15ms 6.7 MB/sec 1.00 31.3±0.09ms 6.8 MB/sec bool_ree/default 1.01 27.6±0.16ms 7.7 MB/sec 1.00 27.3±0.07ms 7.8 MB/sec bool_ree/parquet_2 1.01 29.1±0.17ms 7.3 MB/sec 1.00 28.8±0.07ms 7.4 MB/sec bool_ree/zstd 1.01 28.2±0.16ms 7.6 MB/sec 1.00 28.0±0.06ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.01 29.4±0.17ms 7.2 MB/sec 1.00 29.1±0.07ms 7.3 MB/sec decimal/bloom_filter 1.01 121.4±1.39ms 494.4 MB/sec 1.00 120.5±1.18ms 498.0 MB/sec decimal/cdc 1.00 101.6±0.33ms 590.4 MB/sec 1.00 101.7±0.40ms 590.2 MB/sec decimal/default 1.00 78.9±1.12ms 760.7 MB/sec 1.00 78.6±0.43ms 763.8 MB/sec decimal/parquet_2 1.00 177.0±1.84ms 339.0 MB/sec 1.00 177.6±1.61ms 337.9 MB/sec decimal/zstd 1.00 90.0±0.44ms 667.0 MB/sec 1.00 89.6±0.30ms 669.6 MB/sec decimal/zstd_parquet_2 1.00 197.4±1.59ms 304.0 MB/sec 1.00 197.1±2.33ms 304.3 MB/sec fixed_size_binary_ree/bloom_filter 1.03 59.7±0.51ms 16.9 MB/sec 1.00 57.7±0.29ms 17.5 MB/sec fixed_size_binary_ree/cdc 1.01 62.1±0.31ms 16.2 MB/sec 1.00 61.6±0.28ms 16.3 MB/sec fixed_size_binary_ree/default 1.03 52.8±0.28ms 19.1 MB/sec 1.00 51.3±0.19ms 19.6 MB/sec fixed_size_binary_ree/parquet_2 1.03 67.9±0.49ms 14.8 MB/sec 1.00 65.7±0.26ms 15.3 MB/sec fixed_size_binary_ree/zstd 1.02 58.2±0.27ms 17.3 MB/sec 1.00 57.0±0.20ms 17.7 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.03 68.6±0.46ms 14.7 MB/sec 1.00 66.3±0.24ms 15.2 MB/sec float_with_nans/bloom_filter 1.06 84.8±0.99ms 165.0 MB/sec 1.00 80.3±0.24ms 174.5 MB/sec float_with_nans/cdc 1.00 70.8±0.61ms 197.7 MB/sec 1.00 71.0±0.67ms 197.3 MB/sec float_with_nans/default 1.01 63.7±1.05ms 219.8 MB/sec 1.00 63.3±1.06ms 221.3 MB/sec float_with_nans/parquet_2 1.03 82.7±1.59ms 169.3 MB/sec 1.00 79.9±0.19ms 175.2 MB/sec float_with_nans/zstd 1.01 102.3±0.39ms 136.9 MB/sec 1.00 101.6±0.53ms 137.8 MB/sec float_with_nans/zstd_parquet_2 1.01 118.8±0.73ms 117.8 MB/sec 1.00 117.6±0.32ms 119.0 MB/sec fsb/bloom_filter 1.00 8.2±0.11ms 1960.3 MB/sec 1.03 8.5±0.09ms 1904.2 MB/sec fsb/cdc 1.04 11.1±0.08ms 1455.9 MB/sec 1.00 10.7±0.11ms 1507.3 MB/sec fsb/default 1.03 7.2±0.10ms 2.2 GB/sec 1.00 7.0±0.05ms 2.3 GB/sec fsb/parquet_2 1.01 13.5±0.17ms 1191.1 MB/sec 1.00 13.4±0.15ms 1203.5 MB/sec fsb/zstd 1.01 9.5±0.10ms 1694.0 MB/sec 1.00 9.4±0.03ms 1706.9 MB/sec fsb/zstd_parquet_2 1.04 14.7±0.32ms 1093.2 MB/sec 1.00 14.2±0.09ms 1137.4 MB/sec int32_ree/bloom_filter 1.00 41.6±0.22ms 9.8 MB/sec 1.01 41.9±0.14ms 9.7 MB/sec int32_ree/cdc 1.02 41.2±0.16ms 9.9 MB/sec 1.00 40.4±0.06ms 10.1 MB/sec int32_ree/default 1.01 37.1±0.19ms 11.0 MB/sec 1.00 36.7±0.07ms 11.1 MB/sec int32_ree/parquet_2 1.02 37.2±0.17ms 10.9 MB/sec 1.00 36.6±0.07ms 11.1 MB/sec int32_ree/zstd 1.02 37.8±0.18ms 10.8 MB/sec 1.00 37.2±0.06ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.01 37.6±0.17ms 10.8 MB/sec 1.00 37.2±0.06ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.0±0.10ms 18.5 MB/sec 1.00 21.9±0.06ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.01 24.4±0.07ms 16.6 MB/sec 1.00 24.2±0.08ms 16.8 MB/sec int32_ree_95pct_null/default 1.01 21.6±0.04ms 18.8 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.04ms 18.8 MB/sec 1.00 21.5±0.01ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.01 22.0±0.04ms 18.5 MB/sec 1.00 21.8±0.02ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.06ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 75.4±0.30ms 3.3 GB/sec 1.05 79.4±1.89ms 3.1 GB/sec large_string_distinct/plain 1.00 60.8±0.91ms 4.1 GB/sec 1.03 62.6±1.02ms 4.0 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 55.1±1.19ms 4.5 GB/sec 1.07 59.2±1.59ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 69.6±0.08ms 3.6 GB/sec 1.08 75.3±0.76ms 3.3 GB/sec large_string_non_null/cdc 1.00 241.5±0.94ms 1059.9 MB/sec 1.01 244.9±1.08ms 1045.3 MB/sec large_string_non_null/default 1.00 52.7±0.36ms 4.7 GB/sec 1.06 55.6±0.90ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 53.3±0.49ms 4.7 GB/sec 1.06 56.7±1.04ms 4.4 GB/sec large_string_non_null/zstd 1.00 52.7±0.28ms 4.7 GB/sec 1.06 55.7±0.89ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 53.1±0.74ms 4.7 GB/sec 1.08 57.5±1.53ms 4.3 GB/sec large_string_shared_prefix/delta_byte_array 1.00 110.0±1.67ms 2.3 GB/sec 1.04 114.1±4.58ms 2.2 GB/sec large_string_shared_prefix/plain 1.00 94.0±1.18ms 2.7 GB/sec 1.00 94.4±1.07ms 2.6 GB/sec large_string_shared_prefix_list/delta_byte_array 1.09 63.0±4.10ms 4.0 GB/sec 1.00 57.9±1.16ms 4.3 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 70.9±0.63ms 3.5 GB/sec 1.04 73.8±3.19ms 3.4 GB/sec large_string_shared_prefix_nullable/plain 1.00 64.6±0.84ms 3.9 GB/sec 1.05 67.6±1.23ms 3.7 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 55.1±0.66ms 2.3 GB/sec 1.07 58.7±1.64ms 2.1 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 69.2±1.03ms 3.6 GB/sec 1.06 73.4±3.42ms 3.4 GB/sec list_nested/bloom_filter 1.00 147.7±0.55ms 195.3 MB/sec 1.00 147.0±0.90ms 196.3 MB/sec list_nested/cdc 1.00 162.3±0.28ms 177.8 MB/sec 1.00 163.0±0.24ms 177.1 MB/sec list_nested/default 1.00 131.4±0.53ms 219.5 MB/sec 1.00 131.5±0.30ms 219.5 MB/sec list_nested/parquet_2 1.00 143.9±0.24ms 200.5 MB/sec 1.01 145.3±0.61ms 198.6 MB/sec list_nested/zstd 1.00 140.1±0.72ms 205.9 MB/sec 1.01 141.3±0.53ms 204.3 MB/sec list_nested/zstd_parquet_2 1.00 156.7±0.28ms 184.1 MB/sec 1.01 158.1±0.36ms 182.5 MB/sec list_primitive/bloom_filter 1.00 286.6±5.40ms 1902.7 MB/sec 1.11 317.1±11.87ms 1720.1 MB/sec list_primitive/cdc 1.00 314.8±1.95ms 1732.7 MB/sec 1.04 328.2±10.72ms 1661.8 MB/sec list_primitive/default 1.00 203.6±4.17ms 2.6 GB/sec 1.18 240.4±3.89ms 2.2 GB/sec list_primitive/parquet_2 1.00 222.4±0.79ms 2.4 GB/sec 1.17 261.1±0.95ms 2.0 GB/sec list_primitive/zstd 1.00 460.3±3.97ms 1184.7 MB/sec 1.07 494.5±6.56ms 1102.9 MB/sec list_primitive/zstd_parquet_2 1.00 446.5±1.13ms 1221.4 MB/sec 1.08 482.2±3.07ms 1130.9 MB/sec list_primitive_non_null/bloom_filter 1.00 392.1±8.76ms 1387.9 MB/sec 1.03 405.8±12.99ms 1341.2 MB/sec list_primitive_non_null/cdc 1.00 396.3±7.81ms 1373.2 MB/sec 1.00 395.1±11.64ms 1377.6 MB/sec list_primitive_non_null/default 1.00 251.4±8.90ms 2.1 GB/sec 1.08 271.5±18.22ms 2004.4 MB/sec list_primitive_non_null/parquet_2 1.00 265.9±17.32ms 2047.0 MB/sec 1.21 322.6±1.25ms 1687.2 MB/sec list_primitive_non_null/zstd 1.00 681.4±5.97ms 798.7 MB/sec 1.06 722.9±11.70ms 752.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.03 664.6±14.40ms 819.0 MB/sec 1.00 645.8±32.92ms 842.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.02 12.9±0.18ms 2.8 GB/sec 1.00 12.7±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.03 24.7±0.19ms 1511.4 MB/sec 1.00 23.9±0.06ms 1561.7 MB/sec list_primitive_sparse_99pct_null/default 1.04 12.8±0.09ms 2.8 GB/sec 1.00 12.4±0.04ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.02 12.6±0.11ms 2.9 GB/sec 1.00 12.4±0.05ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 14.4±0.11ms 2.5 GB/sec 1.00 14.2±0.05ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.1±0.05ms 2.8 GB/sec 1.00 12.4±0.03ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 285.9±1.88ms 159.5 MB/sec 1.00 282.1±0.47ms 161.6 MB/sec list_struct_with_list/cdc 1.00 321.9±1.44ms 141.7 MB/sec 1.00 321.5±0.76ms 141.8 MB/sec list_struct_with_list/default 1.00 255.7±0.65ms 178.3 MB/sec 1.00 254.9±0.45ms 178.9 MB/sec list_struct_with_list/parquet_2 1.00 273.2±0.92ms 166.9 MB/sec 1.01 275.1±1.88ms 165.7 MB/sec list_struct_with_list/zstd 1.00 277.8±1.27ms 164.1 MB/sec 1.00 277.7±1.09ms 164.2 MB/sec list_struct_with_list/zstd_parquet_2 1.00 298.8±2.01ms 152.6 MB/sec 1.00 297.5±1.15ms 153.3 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.7±0.28ms 6.5 GB/sec 1.04 40.3±0.24ms 6.2 GB/sec primitive/bloom_filter 1.00 152.8±1.48ms 293.8 MB/sec 1.00 153.0±0.85ms 293.2 MB/sec primitive/cdc 1.00 157.0±0.65ms 285.8 MB/sec 1.00 156.6±0.69ms 286.6 MB/sec primitive/default 1.00 115.4±1.00ms 388.7 MB/sec 1.04 119.9±0.88ms 374.2 MB/sec primitive/parquet_2 1.00 131.2±0.68ms 342.0 MB/sec 1.00 131.4±0.68ms 341.4 MB/sec primitive/zstd 1.00 144.6±0.36ms 310.3 MB/sec 1.00 145.3±0.47ms 308.9 MB/sec primitive/zstd_parquet_2 1.00 163.0±0.67ms 275.3 MB/sec 1.00 163.2±0.49ms 275.0 MB/sec primitive_all_null/bloom_filter 1.00 900.3±10.99µs 48.7 GB/sec 1.01 912.3±7.73µs 48.0 GB/sec primitive_all_null/cdc 1.00 19.1±0.36ms 2.3 GB/sec 1.00 19.1±0.30ms 2.3 GB/sec primitive_all_null/default 1.00 273.0±1.67µs 160.5 GB/sec 1.01 274.5±1.18µs 159.6 GB/sec primitive_all_null/parquet_2 1.00 279.4±1.81µs 156.9 GB/sec 1.02 283.8±1.51µs 154.4 GB/sec primitive_all_null/zstd 1.00 423.2±1.91µs 103.6 GB/sec 1.00 425.3±1.54µs 103.0 GB/sec primitive_all_null/zstd_parquet_2 1.00 376.6±2.10µs 116.4 GB/sec 1.01 381.8±1.84µs 114.8 GB/sec primitive_non_null/bloom_filter 1.00 104.1±0.89ms 422.7 MB/sec 1.02 105.7±0.80ms 416.1 MB/sec primitive_non_null/cdc 1.00 85.4±0.31ms 515.3 MB/sec 1.00 85.7±0.30ms 513.6 MB/sec primitive_non_null/default 1.00 63.3±0.27ms 694.7 MB/sec 1.00 63.6±0.63ms 692.2 MB/sec primitive_non_null/parquet_2 1.00 85.0±0.32ms 517.9 MB/sec 1.02 86.8±0.51ms 507.0 MB/sec primitive_non_null/zstd 1.00 93.6±0.21ms 470.0 MB/sec 1.01 94.5±0.41ms 465.6 MB/sec primitive_non_null/zstd_parquet_2 1.01 118.3±0.36ms 372.1 MB/sec 1.00 117.7±0.20ms 374.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.08 13.6±0.16ms 3.2 GB/sec 1.00 12.6±0.23ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.09 32.9±0.34ms 1366.0 MB/sec 1.00 30.1±0.26ms 1489.9 MB/sec primitive_sparse_99pct_null/default 1.00 11.0±0.07ms 4.0 GB/sec 1.00 11.1±0.16ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.05 11.4±0.08ms 3.9 GB/sec 1.00 10.8±0.12ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.7±0.14ms 3.0 GB/sec 1.00 14.5±0.17ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.9±0.11ms 3.4 GB/sec 1.01 13.0±0.17ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 28.5±0.08ms 421.3 MB/sec 1.00 28.5±0.10ms 420.5 MB/sec short_string_non_null/cdc 1.00 19.9±0.08ms 601.7 MB/sec 1.00 19.9±0.11ms 604.1 MB/sec short_string_non_null/default 1.01 15.9±0.08ms 756.1 MB/sec 1.00 15.8±0.03ms 760.1 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.05ms 464.8 MB/sec 1.00 25.9±0.09ms 463.2 MB/sec short_string_non_null/zstd 1.00 36.0±0.09ms 333.5 MB/sec 1.00 35.9±0.13ms 334.1 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.05ms 416.8 MB/sec 1.00 28.8±0.18ms 417.2 MB/sec small_string_distinct/delta_byte_array 1.00 938.2±13.24µs 8.4 GB/sec 1.04 977.8±16.11µs 8.0 GB/sec small_string_distinct/plain 1.02 786.2±6.30µs 10.0 GB/sec 1.00 772.0±12.28µs 10.2 GB/sec small_string_partial_prefix/delta_byte_array 1.03 1036.9±22.07µs 7.6 GB/sec 1.00 1003.2±3.40µs 7.8 GB/sec small_string_partial_prefix/plain 1.08 1103.9±39.82µs 7.1 GB/sec 1.00 1026.1±16.58µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.02 993.2±8.88µs 7.9 GB/sec 1.00 971.2±3.75µs 8.1 GB/sec small_string_shared_prefix/plain 1.05 1150.1±8.39µs 6.8 GB/sec 1.00 1092.2±9.20µs 7.2 GB/sec string/bloom_filter 1.00 219.7±22.24ms 2.3 GB/sec 1.09 238.8±25.87ms 2.1 GB/sec string/cdc 1.00 203.5±1.44ms 2.5 GB/sec 1.02 206.7±9.94ms 2.5 GB/sec string/default 1.00 119.5±18.58ms 4.3 GB/sec 1.04 123.9±20.09ms 4.1 GB/sec string/parquet_2 1.00 114.5±1.71ms 4.5 GB/sec 1.01 115.4±0.39ms 4.4 GB/sec string/zstd 1.00 442.2±24.95ms 1185.6 MB/sec 1.08 475.8±14.00ms 1101.8 MB/sec string/zstd_parquet_2 1.00 415.0±32.84ms 1263.4 MB/sec 1.10 456.7±2.46ms 1147.8 MB/sec string_and_binary_view/bloom_filter 1.03 67.4±0.27ms 478.8 MB/sec 1.00 65.2±0.32ms 495.0 MB/sec string_and_binary_view/cdc 1.04 61.4±0.36ms 525.2 MB/sec 1.00 59.1±0.14ms 545.4 MB/sec string_and_binary_view/default 1.04 50.6±0.19ms 637.9 MB/sec 1.00 48.6±0.13ms 663.6 MB/sec string_and_binary_view/parquet_2 1.02 61.2±0.20ms 526.7 MB/sec 1.00 59.9±0.21ms 538.1 MB/sec string_and_binary_view/zstd 1.03 87.9±0.26ms 366.7 MB/sec 1.00 85.8±0.25ms 376.1 MB/sec string_and_binary_view/zstd_parquet_2 1.02 75.3±0.29ms 428.4 MB/sec 1.00 73.8±0.20ms 436.7 MB/sec string_dictionary/bloom_filter 1.01 90.5±2.11ms 2.9 GB/sec 1.00 89.2±2.16ms 2.9 GB/sec string_dictionary/cdc 1.00 48.3±0.43ms 5.3 GB/sec 1.22 58.7±4.42ms 4.4 GB/sec string_dictionary/default 1.01 45.0±1.27ms 5.7 GB/sec 1.00 44.6±0.84ms 5.8 GB/sec string_dictionary/parquet_2 1.00 48.6±0.26ms 5.3 GB/sec 1.02 49.4±0.32ms 5.2 GB/sec string_dictionary/zstd 1.00 211.7±1.92ms 1247.4 MB/sec 1.00 211.7±1.64ms 1247.6 MB/sec string_dictionary/zstd_parquet_2 1.00 192.6±1.05ms 1371.5 MB/sec 1.00 192.6±0.43ms 1371.2 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.2±0.09ms 117.1 MB/sec 1.02 34.8±0.13ms 115.0 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.5±0.08ms 145.5 MB/sec 1.02 28.1±0.13ms 142.7 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.2±0.10ms 159.3 MB/sec 1.02 25.6±0.14ms 156.5 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.3±0.09ms 158.3 MB/sec 1.02 25.7±0.13ms 155.9 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.6±0.09ms 156.4 MB/sec 1.02 26.0±0.15ms 153.8 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.6±0.10ms 156.4 MB/sec 1.02 26.0±0.14ms 154.0 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.5±0.08ms 119.7 MB/sec 1.01 33.9±0.12ms 118.1 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.1±0.08ms 147.7 MB/sec 1.03 27.8±0.11ms 144.0 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.0±0.09ms 160.4 MB/sec 1.02 25.5±0.11ms 157.2 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 24.8±0.06ms 161.4 MB/sec 1.03 25.5±0.11ms 156.9 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.0±0.07ms 160.2 MB/sec 1.03 25.7±0.11ms 156.0 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 24.9±0.05ms 160.6 MB/sec 1.03 25.6±0.11ms 156.3 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.2±0.09ms 114.1 MB/sec 1.00 35.2±0.14ms 114.0 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.0±0.11ms 143.2 MB/sec 1.02 28.6±0.19ms 140.2 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.6±0.13ms 156.4 MB/sec 1.02 26.0±0.14ms 154.1 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.8±0.10ms 155.4 MB/sec 1.01 26.0±0.18ms 154.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.4±0.10ms 152.0 MB/sec 1.01 26.6±0.14ms 150.8 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.2±0.12ms 152.9 MB/sec 1.01 26.5±0.17ms 151.3 MB/sec string_non_null/bloom_filter 1.00 244.6±10.64ms 2.1 GB/sec 1.04 253.6±26.92ms 2.0 GB/sec string_non_null/cdc 1.00 256.4±7.25ms 2043.4 MB/sec 1.00 256.8±6.95ms 2040.4 MB/sec string_non_null/default 1.00 120.8±9.83ms 4.2 GB/sec 1.16 140.3±26.18ms 3.6 GB/sec string_non_null/parquet_2 1.00 123.1±10.28ms 4.2 GB/sec 1.05 129.1±8.62ms 4.0 GB/sec string_non_null/zstd 1.01 557.8±7.46ms 939.4 MB/sec 1.00 551.5±3.39ms 950.1 MB/sec string_non_null/zstd_parquet_2 1.00 501.0±6.60ms 1045.8 MB/sec 1.00 503.4±4.90ms 1040.9 MB/sec string_ree/bloom_filter 1.00 121.2±2.27ms 135.4 MB/sec 1.31 158.6±1.75ms 103.5 MB/sec string_ree/cdc 1.00 175.6±2.00ms 93.4 MB/sec 1.35 237.1±3.42ms 69.2 MB/sec string_ree/default 1.00 81.3±0.52ms 201.9 MB/sec 1.59 129.1±2.21ms 127.1 MB/sec string_ree/parquet_2 1.00 82.2±3.05ms 199.6 MB/sec 1.58 129.9±1.00ms 126.3 MB/sec string_ree/zstd 1.00 140.2±3.14ms 117.0 MB/sec 1.37 192.5±1.07ms 85.2 MB/sec string_ree/zstd_parquet_2 1.00 95.3±0.39ms 172.2 MB/sec 1.52 145.3±1.11ms 112.9 MB/sec string_ree_95pct_null/bloom_filter 1.02 26.6±0.12ms 52.8 MB/sec 1.00 26.1±0.08ms 53.9 MB/sec string_ree_95pct_null/cdc 1.00 32.4±0.11ms 43.5 MB/sec 1.00 32.5±0.05ms 43.3 MB/sec string_ree_95pct_null/default 1.02 25.1±0.11ms 56.0 MB/sec 1.00 24.6±0.03ms 57.2 MB/sec string_ree_95pct_null/parquet_2 1.02 25.0±0.07ms 56.3 MB/sec 1.00 24.6±0.03ms 57.2 MB/sec string_ree_95pct_null/zstd 1.02 25.8±0.08ms 54.5 MB/sec 1.00 25.4±0.04ms 55.3 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.7±0.11ms 54.7 MB/sec 1.00 25.4±0.05ms 55.5 MB/sec struct_all_null/bloom_filter 1.00 375.2±2.42µs 42.0 GB/sec 1.01 379.4±3.72µs 41.5 GB/sec struct_all_null/cdc 1.00 7.8±0.10ms 2.0 GB/sec 1.01 7.9±0.08ms 2.0 GB/sec struct_all_null/default 1.00 115.5±0.73µs 136.3 GB/sec 1.03 119.3±0.57µs 132.0 GB/sec struct_all_null/parquet_2 1.00 118.9±0.83µs 132.5 GB/sec 1.03 122.9±1.29µs 128.2 GB/sec struct_all_null/zstd 1.00 180.8±0.92µs 87.1 GB/sec 1.01 182.5±1.11µs 86.3 GB/sec struct_all_null/zstd_parquet_2 1.00 161.5±0.99µs 97.5 GB/sec 1.02 164.2±1.18µs 95.9 GB/sec struct_non_null/bloom_filter 1.01 45.3±0.45ms 353.5 MB/sec 1.00 44.8±0.59ms 357.3 MB/sec struct_non_null/cdc 1.01 43.6±0.18ms 367.0 MB/sec 1.00 43.1±0.17ms 371.7 MB/sec struct_non_null/default 1.01 30.1±0.21ms 532.1 MB/sec 1.00 29.8±0.14ms 537.0 MB/sec struct_non_null/parquet_2 1.01 38.9±0.20ms 411.3 MB/sec 1.00 38.5±0.15ms 415.7 MB/sec struct_non_null/zstd 1.01 38.8±0.16ms 411.9 MB/sec 1.00 38.4±0.17ms 416.9 MB/sec struct_non_null/zstd_parquet_2 1.02 53.3±0.44ms 300.3 MB/sec 1.00 52.1±0.19ms 306.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.09 7.1±0.20ms 2.2 GB/sec 1.00 6.5±0.08ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.05 14.9±0.15ms 1085.6 MB/sec 1.00 14.2±0.14ms 1134.8 MB/sec struct_sparse_99pct_null/default 1.03 6.2±0.09ms 2.5 GB/sec 1.00 6.0±0.05ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.06 6.4±0.04ms 2.5 GB/sec 1.00 6.0±0.05ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.05ms 2.1 GB/sec 1.02 7.6±0.08ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.8±0.03ms 2.3 GB/sec 1.00 6.8±0.05ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3330.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3182.2s | | CPU sys | 146.4s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3250.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3185.4s | | CPU sys | 60.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
