adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5338017189
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5336769914) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (4729b257e467851c78e5c5263e07fd9ea7da2dad) to 65844079fb9105c97547a081775a7746355203c5 [diff](https://github.com/apache/arrow-rs/compare/65844079fb9105c97547a081775a7746355203c5..4729b257e467851c78e5c5263e07fd9ea7da2dad) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "65844079fb9105c97547a081775a7746355203c5" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.02 12.9±0.09ms 19.4 MB/sec 1.00 12.7±0.06ms 19.7 MB/sec bool/cdc 1.02 15.7±0.09ms 15.9 MB/sec 1.00 15.5±0.08ms 16.2 MB/sec bool/default 1.02 10.8±0.08ms 23.2 MB/sec 1.00 10.6±0.07ms 23.6 MB/sec bool/parquet_2 1.01 13.7±0.09ms 18.2 MB/sec 1.00 13.5±0.08ms 18.5 MB/sec bool/zstd 1.01 11.3±0.10ms 22.2 MB/sec 1.00 11.1±0.06ms 22.5 MB/sec bool/zstd_parquet_2 1.02 14.1±0.11ms 17.8 MB/sec 1.00 13.9±0.07ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.1 MB/sec 1.00 6.5±0.03ms 19.1 MB/sec bool_non_null/cdc 1.00 6.3±0.04ms 19.9 MB/sec 1.01 6.3±0.03ms 19.8 MB/sec bool_non_null/default 1.00 3.8±0.03ms 33.3 MB/sec 1.01 3.8±0.02ms 33.1 MB/sec bool_non_null/parquet_2 1.01 7.6±0.03ms 16.4 MB/sec 1.00 7.6±0.02ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.03ms 30.4 MB/sec 1.01 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.00 8.0±0.03ms 15.7 MB/sec bool_ree/bloom_filter 1.01 30.3±0.10ms 7.0 MB/sec 1.00 30.1±0.13ms 7.1 MB/sec bool_ree/cdc 1.01 31.7±0.18ms 6.7 MB/sec 1.00 31.4±0.11ms 6.8 MB/sec bool_ree/default 1.01 27.7±0.09ms 7.7 MB/sec 1.00 27.3±0.12ms 7.8 MB/sec bool_ree/parquet_2 1.01 29.1±0.08ms 7.3 MB/sec 1.00 28.8±0.11ms 7.4 MB/sec bool_ree/zstd 1.01 28.3±0.52ms 7.5 MB/sec 1.00 27.9±0.10ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.01 29.5±0.16ms 7.2 MB/sec 1.00 29.1±0.10ms 7.3 MB/sec decimal/bloom_filter 1.00 120.3±1.58ms 498.9 MB/sec 1.01 120.9±1.23ms 496.3 MB/sec decimal/cdc 1.00 101.1±0.43ms 593.7 MB/sec 1.01 101.6±0.46ms 590.7 MB/sec decimal/default 1.00 78.9±0.52ms 760.1 MB/sec 1.00 79.3±0.35ms 756.6 MB/sec decimal/parquet_2 1.00 177.6±1.61ms 337.8 MB/sec 1.01 178.6±1.72ms 335.9 MB/sec decimal/zstd 1.00 89.7±1.91ms 669.2 MB/sec 1.01 90.9±2.25ms 660.3 MB/sec decimal/zstd_parquet_2 1.00 197.8±1.44ms 303.4 MB/sec 1.00 198.2±1.33ms 302.7 MB/sec fixed_size_binary_ree/bloom_filter 1.01 59.3±0.30ms 17.0 MB/sec 1.00 59.0±0.93ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.01 62.4±0.35ms 16.1 MB/sec 1.00 61.7±0.24ms 16.3 MB/sec fixed_size_binary_ree/default 1.01 52.3±0.27ms 19.3 MB/sec 1.00 52.0±0.24ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.9±1.00ms 15.1 MB/sec 1.00 66.8±0.93ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.01 58.1±0.34ms 17.3 MB/sec 1.00 57.8±0.23ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.5±0.30ms 14.9 MB/sec 1.00 67.4±0.96ms 15.0 MB/sec float_with_nans/bloom_filter 1.00 80.8±0.33ms 173.2 MB/sec 1.00 81.0±0.21ms 172.9 MB/sec float_with_nans/cdc 1.00 70.7±0.28ms 198.0 MB/sec 1.00 70.7±0.22ms 198.0 MB/sec float_with_nans/default 1.00 63.4±0.29ms 221.0 MB/sec 1.00 63.3±1.04ms 221.2 MB/sec float_with_nans/parquet_2 1.01 80.8±1.05ms 173.3 MB/sec 1.00 80.4±0.22ms 174.2 MB/sec float_with_nans/zstd 1.00 101.5±0.25ms 137.9 MB/sec 1.00 101.4±0.18ms 138.0 MB/sec float_with_nans/zstd_parquet_2 1.01 118.1±1.85ms 118.5 MB/sec 1.00 117.3±0.23ms 119.3 MB/sec fsb/bloom_filter 1.00 8.1±0.04ms 1997.9 MB/sec 1.01 8.1±0.04ms 1981.8 MB/sec fsb/cdc 1.00 10.5±0.06ms 1533.8 MB/sec 1.00 10.5±0.04ms 1533.5 MB/sec fsb/default 1.00 6.9±0.04ms 2.3 GB/sec 1.02 7.0±0.07ms 2.2 GB/sec fsb/parquet_2 1.00 13.3±0.07ms 1212.0 MB/sec 1.02 13.6±0.08ms 1189.2 MB/sec fsb/zstd 1.00 9.3±0.04ms 1726.5 MB/sec 1.02 9.5±0.06ms 1695.0 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.08ms 1135.3 MB/sec 1.02 14.5±0.10ms 1114.7 MB/sec int32_ree/bloom_filter 1.00 40.9±0.23ms 9.9 MB/sec 1.00 40.8±0.24ms 10.0 MB/sec int32_ree/cdc 1.01 40.7±0.13ms 10.0 MB/sec 1.00 40.4±0.12ms 10.1 MB/sec int32_ree/default 1.00 36.7±0.12ms 11.1 MB/sec 1.00 36.7±0.12ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.12ms 11.1 MB/sec 1.00 36.7±0.13ms 11.1 MB/sec int32_ree/zstd 1.00 37.3±0.13ms 10.9 MB/sec 1.00 37.2±0.12ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.3±0.51ms 10.9 MB/sec 1.00 37.2±0.12ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.9±0.05ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.02 24.4±0.08ms 16.7 MB/sec 1.00 24.0±0.04ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.04ms 18.8 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.04ms 18.8 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.8±0.03ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.7 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 60.3±0.53ms 4.1 GB/sec 1.09 65.9±0.55ms 3.8 GB/sec large_string_distinct/plain 1.00 60.2±0.47ms 4.2 GB/sec 1.00 60.4±0.43ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 56.6±0.65ms 4.4 GB/sec 1.09 61.8±0.43ms 4.0 GB/sec large_string_non_null/bloom_filter 1.00 69.3±0.11ms 3.6 GB/sec 1.04 71.9±0.15ms 3.5 GB/sec large_string_non_null/cdc 1.00 241.1±1.01ms 1061.9 MB/sec 1.01 243.7±0.79ms 1050.6 MB/sec large_string_non_null/default 1.00 51.9±0.12ms 4.8 GB/sec 1.04 53.8±0.14ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 51.9±0.10ms 4.8 GB/sec 1.04 53.8±0.14ms 4.6 GB/sec large_string_non_null/zstd 1.00 52.0±0.09ms 4.8 GB/sec 1.04 54.1±0.20ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 52.0±0.11ms 4.8 GB/sec 1.04 54.1±0.20ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 42.7±0.19ms 5.9 GB/sec 1.33 56.6±0.42ms 4.4 GB/sec large_string_shared_prefix/plain 1.00 93.1±0.50ms 2.7 GB/sec 1.01 94.0±0.82ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 53.9±0.31ms 4.6 GB/sec 1.03 55.4±0.34ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 40.2±0.18ms 6.2 GB/sec 1.32 52.9±0.34ms 4.7 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.1±0.36ms 4.0 GB/sec 1.02 63.4±0.47ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 21.7±0.09ms 5.8 GB/sec 1.31 28.4±0.20ms 4.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 40.3±0.18ms 6.2 GB/sec 1.32 53.0±0.40ms 4.7 GB/sec list_nested/bloom_filter 1.02 146.7±0.36ms 196.7 MB/sec 1.00 143.7±0.22ms 200.8 MB/sec list_nested/cdc 1.01 161.6±0.22ms 178.5 MB/sec 1.00 160.6±0.25ms 179.7 MB/sec list_nested/default 1.00 130.5±0.25ms 221.1 MB/sec 1.00 130.2±0.42ms 221.5 MB/sec list_nested/parquet_2 1.01 143.8±0.28ms 200.6 MB/sec 1.00 143.0±0.20ms 201.8 MB/sec list_nested/zstd 1.01 139.8±0.28ms 206.4 MB/sec 1.00 138.9±0.27ms 207.8 MB/sec list_nested/zstd_parquet_2 1.00 156.5±0.24ms 184.4 MB/sec 1.00 155.7±0.20ms 185.3 MB/sec list_primitive/bloom_filter 1.00 282.6±0.82ms 1929.7 MB/sec 1.05 297.7±3.16ms 1831.9 MB/sec list_primitive/cdc 1.00 314.6±1.40ms 1733.6 MB/sec 1.01 317.4±7.31ms 1718.2 MB/sec list_primitive/default 1.00 202.9±1.45ms 2.6 GB/sec 1.07 217.8±2.62ms 2.4 GB/sec list_primitive/parquet_2 1.00 222.5±0.39ms 2.4 GB/sec 1.05 233.6±2.02ms 2.3 GB/sec list_primitive/zstd 1.00 457.5±1.60ms 1191.9 MB/sec 1.02 464.8±1.94ms 1173.4 MB/sec list_primitive/zstd_parquet_2 1.00 445.1±1.53ms 1225.3 MB/sec 1.03 458.7±2.28ms 1189.0 MB/sec list_primitive_non_null/bloom_filter 1.00 357.7±5.18ms 1521.5 MB/sec 1.14 406.3±12.03ms 1339.6 MB/sec list_primitive_non_null/cdc 1.02 395.9±8.43ms 1374.6 MB/sec 1.00 389.8±10.48ms 1396.1 MB/sec list_primitive_non_null/default 1.00 221.9±3.61ms 2.4 GB/sec 1.20 265.6±13.99ms 2.0 GB/sec list_primitive_non_null/parquet_2 1.00 245.6±4.54ms 2.2 GB/sec 1.09 268.8±22.89ms 2024.5 MB/sec list_primitive_non_null/zstd 1.00 641.2±3.26ms 848.8 MB/sec 1.01 649.6±2.60ms 837.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 635.4±4.71ms 856.5 MB/sec 1.06 672.3±18.61ms 809.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.6±0.05ms 2.9 GB/sec 1.01 12.7±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.2±0.36ms 1541.7 MB/sec 1.00 24.3±0.10ms 1540.4 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.05ms 3.0 GB/sec 1.01 12.4±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.3±0.05ms 3.0 GB/sec 1.01 12.4±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.2±0.06ms 2.6 GB/sec 1.01 14.3±0.07ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.5±0.07ms 2.9 GB/sec 1.01 12.5±0.08ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 280.6±0.41ms 162.5 MB/sec 1.01 282.0±0.60ms 161.7 MB/sec list_struct_with_list/cdc 1.00 319.3±0.51ms 142.8 MB/sec 1.00 319.7±0.44ms 142.6 MB/sec list_struct_with_list/default 1.00 254.1±0.41ms 179.4 MB/sec 1.00 254.9±0.44ms 178.9 MB/sec list_struct_with_list/parquet_2 1.00 272.0±0.83ms 167.6 MB/sec 1.00 272.2±0.41ms 167.5 MB/sec list_struct_with_list/zstd 1.00 276.1±0.38ms 165.1 MB/sec 1.00 276.7±0.35ms 164.8 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.7±0.42ms 154.7 MB/sec 1.00 295.3±0.88ms 154.4 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 35.4±0.08ms 7.1 GB/sec 1.23 43.5±0.78ms 5.8 GB/sec primitive/bloom_filter 1.00 147.3±0.64ms 304.6 MB/sec 1.01 149.3±0.71ms 300.6 MB/sec primitive/cdc 1.01 158.0±0.74ms 283.9 MB/sec 1.00 156.3±0.95ms 287.2 MB/sec primitive/default 1.01 116.2±0.58ms 386.2 MB/sec 1.00 114.9±0.60ms 390.4 MB/sec primitive/parquet_2 1.01 131.1±0.47ms 342.4 MB/sec 1.00 130.1±0.65ms 345.0 MB/sec primitive/zstd 1.01 146.1±0.52ms 307.2 MB/sec 1.00 144.7±0.54ms 310.0 MB/sec primitive/zstd_parquet_2 1.01 164.0±0.51ms 273.6 MB/sec 1.00 163.1±0.66ms 275.1 MB/sec primitive_all_null/bloom_filter 1.00 898.4±7.89µs 48.8 GB/sec 1.00 901.4±5.08µs 48.6 GB/sec primitive_all_null/cdc 1.00 18.9±0.34ms 2.3 GB/sec 1.01 19.2±0.39ms 2.3 GB/sec primitive_all_null/default 1.00 275.7±1.42µs 159.0 GB/sec 1.00 274.5±1.76µs 159.6 GB/sec primitive_all_null/parquet_2 1.00 282.9±1.70µs 154.9 GB/sec 1.00 283.0±1.55µs 154.8 GB/sec primitive_all_null/zstd 1.00 423.2±1.84µs 103.6 GB/sec 1.01 426.1±1.27µs 102.8 GB/sec primitive_all_null/zstd_parquet_2 1.00 380.2±1.66µs 115.3 GB/sec 1.01 383.5±1.63µs 114.3 GB/sec primitive_non_null/bloom_filter 1.00 101.1±0.42ms 435.4 MB/sec 1.04 105.5±0.38ms 417.2 MB/sec primitive_non_null/cdc 1.00 85.0±0.32ms 517.7 MB/sec 1.01 85.9±0.48ms 512.4 MB/sec primitive_non_null/default 1.00 63.0±0.27ms 698.2 MB/sec 1.00 63.0±0.22ms 698.0 MB/sec primitive_non_null/parquet_2 1.00 84.2±0.26ms 522.8 MB/sec 1.01 84.9±0.25ms 518.4 MB/sec primitive_non_null/zstd 1.00 93.3±0.30ms 471.5 MB/sec 1.01 93.8±0.37ms 469.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.4±0.29ms 374.7 MB/sec 1.00 118.0±0.32ms 372.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.3±0.12ms 3.5 GB/sec 1.01 12.4±0.11ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.06 32.0±0.34ms 1400.8 MB/sec 1.00 30.2±0.35ms 1486.2 MB/sec primitive_sparse_99pct_null/default 1.00 10.9±0.04ms 4.0 GB/sec 1.00 10.8±0.05ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.04ms 4.1 GB/sec 1.00 10.8±0.05ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.2±0.06ms 3.1 GB/sec 1.00 14.2±0.05ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 3.4 GB/sec 1.00 12.8±0.05ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 28.5±0.15ms 421.4 MB/sec 1.01 28.7±0.09ms 417.8 MB/sec short_string_non_null/cdc 1.00 19.8±0.06ms 607.0 MB/sec 1.01 20.0±0.04ms 600.6 MB/sec short_string_non_null/default 1.00 15.6±0.05ms 771.1 MB/sec 1.02 15.8±0.05ms 758.1 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.14ms 465.0 MB/sec 1.01 26.1±0.05ms 459.7 MB/sec short_string_non_null/zstd 1.00 35.9±0.13ms 334.2 MB/sec 1.01 36.1±0.07ms 332.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.6±0.05ms 419.4 MB/sec 1.01 29.0±0.07ms 413.4 MB/sec small_string_distinct/delta_byte_array 1.00 951.9±7.56µs 8.2 GB/sec 1.03 979.8±7.98µs 8.0 GB/sec small_string_distinct/plain 1.00 757.7±5.69µs 10.4 GB/sec 1.02 774.1±4.81µs 10.1 GB/sec small_string_partial_prefix/delta_byte_array 1.00 999.2±6.23µs 7.8 GB/sec 1.02 1019.2±5.11µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 1016.9±5.34µs 7.7 GB/sec 1.03 1043.5±6.32µs 7.5 GB/sec small_string_shared_prefix/delta_byte_array 1.00 970.2±2.76µs 8.1 GB/sec 1.02 986.9±2.27µs 7.9 GB/sec small_string_shared_prefix/plain 1.00 1130.7±11.58µs 6.9 GB/sec 1.03 1161.0±7.58µs 6.8 GB/sec string/bloom_filter 1.00 213.3±23.89ms 2.4 GB/sec 1.04 222.2±24.47ms 2.3 GB/sec string/cdc 1.00 208.3±8.08ms 2.5 GB/sec 1.01 210.0±7.08ms 2.4 GB/sec string/default 1.00 131.7±23.11ms 3.9 GB/sec 1.01 133.3±24.75ms 3.8 GB/sec string/parquet_2 1.00 114.9±0.45ms 4.5 GB/sec 1.60 183.8±0.68ms 2.8 GB/sec string/zstd 1.00 424.7±1.05ms 1234.3 MB/sec 1.12 473.7±15.59ms 1106.8 MB/sec string/zstd_parquet_2 1.01 401.1±1.25ms 1307.1 MB/sec 1.00 396.8±8.12ms 1321.3 MB/sec string_and_binary_view/bloom_filter 1.03 68.2±0.42ms 473.0 MB/sec 1.00 66.5±0.31ms 485.1 MB/sec string_and_binary_view/cdc 1.03 61.6±0.25ms 523.5 MB/sec 1.00 60.1±0.31ms 536.7 MB/sec string_and_binary_view/default 1.03 50.9±0.31ms 633.9 MB/sec 1.00 49.2±0.24ms 655.4 MB/sec string_and_binary_view/parquet_2 1.02 61.6±0.36ms 523.5 MB/sec 1.00 60.5±0.27ms 533.0 MB/sec string_and_binary_view/zstd 1.02 88.0±0.36ms 366.6 MB/sec 1.00 86.2±0.29ms 374.1 MB/sec string_and_binary_view/zstd_parquet_2 1.01 75.6±0.35ms 426.7 MB/sec 1.00 74.5±0.33ms 432.7 MB/sec string_dictionary/bloom_filter 1.00 87.6±0.38ms 2.9 GB/sec 1.00 88.0±0.60ms 2.9 GB/sec string_dictionary/cdc 1.01 49.3±0.36ms 5.2 GB/sec 1.00 49.0±0.89ms 5.3 GB/sec string_dictionary/default 1.00 44.0±0.23ms 5.9 GB/sec 1.00 44.1±0.44ms 5.8 GB/sec string_dictionary/parquet_2 1.00 48.8±0.19ms 5.3 GB/sec 1.01 49.2±0.15ms 5.2 GB/sec string_dictionary/zstd 1.00 210.0±0.90ms 1257.7 MB/sec 1.00 210.1±0.58ms 1257.2 MB/sec string_dictionary/zstd_parquet_2 1.00 193.0±0.30ms 1368.6 MB/sec 1.00 193.6±0.27ms 1364.1 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.3±0.16ms 116.6 MB/sec 1.01 34.6±0.12ms 115.7 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.6±0.12ms 144.9 MB/sec 1.01 28.1±0.13ms 142.8 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.14ms 157.6 MB/sec 1.01 25.8±0.14ms 155.3 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.4±0.13ms 157.4 MB/sec 1.01 25.8±0.11ms 155.4 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.8±0.12ms 155.3 MB/sec 1.01 26.1±0.11ms 153.3 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.8±0.14ms 155.4 MB/sec 1.02 26.3±0.12ms 152.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.4±0.13ms 120.1 MB/sec 1.02 33.9±0.12ms 118.2 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.3±0.13ms 146.5 MB/sec 1.01 27.5±0.14ms 145.6 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.1±0.14ms 159.7 MB/sec 1.00 25.2±0.12ms 159.2 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.1±0.14ms 159.6 MB/sec 1.00 25.2±0.14ms 159.1 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.2±0.15ms 158.9 MB/sec 1.00 25.3±0.14ms 158.1 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.2±0.14ms 158.8 MB/sec 1.00 25.3±0.12ms 158.3 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.4±0.19ms 113.3 MB/sec 1.00 35.2±0.16ms 113.9 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.2±0.14ms 142.2 MB/sec 1.01 28.4±0.15ms 141.1 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.0±0.17ms 154.2 MB/sec 1.00 25.9±0.12ms 154.6 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.0±0.16ms 154.2 MB/sec 1.00 26.0±0.15ms 154.4 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.5±0.19ms 151.2 MB/sec 1.00 26.5±0.16ms 151.1 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.5±0.17ms 151.6 MB/sec 1.00 26.5±0.13ms 151.4 MB/sec string_non_null/bloom_filter 1.00 234.1±9.57ms 2.2 GB/sec 1.02 238.8±21.01ms 2.1 GB/sec string_non_null/cdc 1.00 248.1±2.63ms 2.1 GB/sec 1.04 257.4±7.31ms 2035.7 MB/sec string_non_null/default 1.01 117.1±11.32ms 4.4 GB/sec 1.00 115.7±20.72ms 4.4 GB/sec string_non_null/parquet_2 1.00 110.7±6.72ms 4.6 GB/sec 1.01 111.5±3.82ms 4.6 GB/sec string_non_null/zstd 1.00 533.7±4.37ms 981.8 MB/sec 1.03 551.6±3.42ms 950.0 MB/sec string_non_null/zstd_parquet_2 1.00 495.7±5.76ms 1057.0 MB/sec 1.01 500.5±7.74ms 1046.9 MB/sec string_ree/bloom_filter 1.00 154.5±1.36ms 106.2 MB/sec 1.02 158.2±0.99ms 103.7 MB/sec string_ree/cdc 1.00 221.3±2.42ms 74.1 MB/sec 1.03 227.2±0.60ms 72.2 MB/sec string_ree/default 1.00 126.6±1.47ms 129.6 MB/sec 1.03 130.3±1.42ms 125.9 MB/sec string_ree/parquet_2 1.00 126.7±1.13ms 129.5 MB/sec 1.03 130.5±0.58ms 125.7 MB/sec string_ree/zstd 1.00 182.0±1.81ms 90.1 MB/sec 1.03 187.4±2.29ms 87.6 MB/sec string_ree/zstd_parquet_2 1.00 141.0±0.42ms 116.3 MB/sec 1.03 145.4±0.40ms 112.8 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.2±0.09ms 53.6 MB/sec 1.00 26.3±0.09ms 53.5 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.07ms 43.5 MB/sec 1.00 32.4±0.08ms 43.4 MB/sec string_ree_95pct_null/default 1.00 24.7±0.06ms 56.9 MB/sec 1.00 24.8±0.07ms 56.6 MB/sec string_ree_95pct_null/parquet_2 1.00 24.7±0.07ms 56.9 MB/sec 1.01 24.9±0.09ms 56.5 MB/sec string_ree_95pct_null/zstd 1.00 25.6±0.07ms 54.9 MB/sec 1.01 25.8±0.09ms 54.6 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.09ms 55.1 MB/sec 1.00 25.6±0.08ms 54.9 MB/sec struct_all_null/bloom_filter 1.01 378.9±2.88µs 41.6 GB/sec 1.00 376.1±2.24µs 41.9 GB/sec struct_all_null/cdc 1.00 7.7±0.08ms 2.1 GB/sec 1.02 7.8±0.11ms 2.0 GB/sec struct_all_null/default 1.00 117.8±0.65µs 133.7 GB/sec 1.00 117.5±0.68µs 134.0 GB/sec struct_all_null/parquet_2 1.00 121.3±0.61µs 129.8 GB/sec 1.00 121.0±0.68µs 130.2 GB/sec struct_all_null/zstd 1.00 181.4±0.74µs 86.8 GB/sec 1.01 182.8±0.64µs 86.1 GB/sec struct_all_null/zstd_parquet_2 1.00 163.5±0.66µs 96.3 GB/sec 1.01 165.2±0.78µs 95.3 GB/sec struct_non_null/bloom_filter 1.00 44.5±0.16ms 359.3 MB/sec 1.00 44.5±0.19ms 359.2 MB/sec struct_non_null/cdc 1.00 43.6±0.18ms 367.2 MB/sec 1.00 43.4±0.18ms 368.5 MB/sec struct_non_null/default 1.02 30.4±0.78ms 525.5 MB/sec 1.00 29.7±0.14ms 538.1 MB/sec struct_non_null/parquet_2 1.00 38.6±0.14ms 414.1 MB/sec 1.00 38.6±0.12ms 414.2 MB/sec struct_non_null/zstd 1.01 38.7±0.14ms 413.1 MB/sec 1.00 38.4±0.12ms 416.2 MB/sec struct_non_null/zstd_parquet_2 1.00 52.5±0.19ms 304.7 MB/sec 1.00 52.3±0.14ms 305.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.03ms 2.4 GB/sec 1.01 6.6±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.07 14.6±0.11ms 1106.3 MB/sec 1.00 13.7±0.13ms 1178.6 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.01 6.0±0.04ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.01 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.03ms 2.1 GB/sec 1.01 7.4±0.03ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.01 6.8±0.02ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3275.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3148.1s | | CPU sys | 121.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.7 GiB | | CPU user | 3156.3s | | CPU sys | 75.5s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
