adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5186288780
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5185596818) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (5af13c01ba6f907cf0b0296056ffa536c93b948c) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..5af13c01ba6f907cf0b0296056ffa536c93b948c) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.01 12.7±0.06ms 19.7 MB/sec 1.00 12.7±0.05ms 19.8 MB/sec bool/cdc 1.02 15.7±0.07ms 16.0 MB/sec 1.00 15.3±0.05ms 16.3 MB/sec bool/default 1.01 10.6±0.05ms 23.5 MB/sec 1.00 10.6±0.04ms 23.7 MB/sec bool/parquet_2 1.01 14.4±0.06ms 17.3 MB/sec 1.00 14.3±0.04ms 17.5 MB/sec bool/zstd 1.01 11.2±0.06ms 22.4 MB/sec 1.00 11.0±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.01 14.8±0.07ms 16.9 MB/sec 1.00 14.7±0.05ms 17.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.1 MB/sec 1.01 6.6±0.04ms 18.9 MB/sec bool_non_null/cdc 1.00 6.3±0.04ms 19.8 MB/sec 1.01 6.4±0.03ms 19.6 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.4 MB/sec 1.03 3.9±0.02ms 32.5 MB/sec bool_non_null/parquet_2 1.00 8.5±0.03ms 14.7 MB/sec 1.02 8.6±0.04ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.4 MB/sec 1.03 4.2±0.02ms 29.6 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.0 MB/sec 1.01 9.1±0.04ms 13.8 MB/sec bool_ree/bloom_filter 1.00 30.1±0.08ms 7.1 MB/sec 1.00 30.0±0.04ms 7.1 MB/sec bool_ree/cdc 1.01 31.6±0.08ms 6.7 MB/sec 1.00 31.3±0.09ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.05ms 7.8 MB/sec 1.00 27.3±0.03ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.09ms 7.4 MB/sec 1.00 28.9±0.06ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.08ms 7.6 MB/sec 1.00 27.9±0.06ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.05ms 7.3 MB/sec 1.00 29.2±0.05ms 7.3 MB/sec decimal/bloom_filter 1.02 120.8±0.43ms 496.9 MB/sec 1.00 117.9±0.42ms 508.8 MB/sec decimal/cdc 1.00 101.8±0.43ms 589.5 MB/sec 1.00 101.5±0.60ms 591.0 MB/sec decimal/default 1.00 79.5±0.44ms 755.1 MB/sec 1.00 79.2±2.48ms 757.8 MB/sec decimal/parquet_2 1.01 179.9±2.07ms 333.5 MB/sec 1.00 177.9±1.39ms 337.3 MB/sec decimal/zstd 1.01 90.7±1.82ms 661.2 MB/sec 1.00 90.1±1.23ms 665.7 MB/sec decimal/zstd_parquet_2 1.00 197.7±1.50ms 303.5 MB/sec 1.00 197.0±2.41ms 304.6 MB/sec fixed_size_binary_ree/bloom_filter 1.01 58.9±0.33ms 17.1 MB/sec 1.00 58.2±0.26ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.00 61.8±0.22ms 16.3 MB/sec 1.00 61.6±0.26ms 16.4 MB/sec fixed_size_binary_ree/default 1.01 52.0±0.21ms 19.4 MB/sec 1.00 51.6±0.26ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.01 66.8±0.33ms 15.1 MB/sec 1.00 66.5±0.32ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.9±0.25ms 17.4 MB/sec 1.00 57.7±0.93ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.01 67.7±0.23ms 14.9 MB/sec 1.00 67.1±0.27ms 15.0 MB/sec float_with_nans/bloom_filter 1.02 81.5±0.46ms 171.9 MB/sec 1.00 80.2±0.22ms 174.6 MB/sec float_with_nans/cdc 1.01 70.5±0.25ms 198.6 MB/sec 1.00 70.0±0.38ms 199.9 MB/sec float_with_nans/default 1.01 63.4±0.44ms 221.0 MB/sec 1.00 62.7±0.23ms 223.2 MB/sec float_with_nans/parquet_2 1.01 81.2±0.49ms 172.5 MB/sec 1.00 80.1±0.23ms 174.9 MB/sec float_with_nans/zstd 1.01 101.6±0.45ms 137.9 MB/sec 1.00 100.9±0.24ms 138.8 MB/sec float_with_nans/zstd_parquet_2 1.01 118.1±0.50ms 118.6 MB/sec 1.00 116.9±0.25ms 119.8 MB/sec fsb/bloom_filter 1.01 8.1±0.05ms 1984.8 MB/sec 1.00 8.0±0.05ms 2009.8 MB/sec fsb/cdc 1.01 10.5±0.05ms 1532.8 MB/sec 1.00 10.4±0.05ms 1551.6 MB/sec fsb/default 1.01 7.0±0.02ms 2.3 GB/sec 1.00 6.9±0.03ms 2.3 GB/sec fsb/parquet_2 1.01 13.3±0.07ms 1208.0 MB/sec 1.00 13.2±0.05ms 1221.7 MB/sec fsb/zstd 1.01 9.5±0.05ms 1697.6 MB/sec 1.00 9.4±0.04ms 1709.3 MB/sec fsb/zstd_parquet_2 1.01 14.3±0.07ms 1131.4 MB/sec 1.00 14.1±0.06ms 1142.8 MB/sec int32_ree/bloom_filter 1.00 41.1±0.17ms 9.9 MB/sec 1.00 41.0±0.16ms 9.9 MB/sec int32_ree/cdc 1.01 40.6±0.21ms 10.0 MB/sec 1.00 40.4±0.06ms 10.1 MB/sec int32_ree/default 1.01 36.8±0.11ms 11.0 MB/sec 1.00 36.4±0.08ms 11.2 MB/sec int32_ree/parquet_2 1.01 36.8±0.11ms 11.1 MB/sec 1.00 36.5±0.06ms 11.2 MB/sec int32_ree/zstd 1.01 37.3±0.13ms 10.9 MB/sec 1.00 37.0±0.07ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.01 37.3±0.13ms 10.9 MB/sec 1.00 37.0±0.04ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.1±0.05ms 18.4 MB/sec 1.00 22.0±0.04ms 18.5 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.06ms 17.0 MB/sec 1.01 24.2±0.06ms 16.8 MB/sec int32_ree_95pct_null/default 1.01 21.7±0.02ms 18.8 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.02ms 18.7 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.01 22.0±0.03ms 18.5 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 21.9±0.02ms 18.6 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.01 65.2±0.40ms 3.8 GB/sec 1.00 64.5±0.38ms 3.9 GB/sec large_string_distinct/plain 1.01 60.3±0.89ms 4.1 GB/sec 1.00 59.9±0.63ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 72.1±0.12ms 3.5 GB/sec 1.01 73.0±0.26ms 3.4 GB/sec large_string_non_null/cdc 1.00 243.5±1.13ms 1051.4 MB/sec 1.00 243.3±0.96ms 1052.3 MB/sec large_string_non_null/default 1.00 54.3±0.10ms 4.6 GB/sec 1.01 54.8±0.20ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 54.4±0.08ms 4.6 GB/sec 1.01 54.8±0.20ms 4.6 GB/sec large_string_non_null/zstd 1.00 54.4±0.10ms 4.6 GB/sec 1.01 54.8±0.21ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.4±0.10ms 4.6 GB/sec 1.01 54.8±0.22ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.01 55.6±0.23ms 4.5 GB/sec 1.00 55.2±0.20ms 4.5 GB/sec large_string_shared_prefix/plain 1.01 93.5±0.80ms 2.7 GB/sec 1.00 92.7±0.71ms 2.7 GB/sec list_nested/bloom_filter 1.01 144.8±0.38ms 199.3 MB/sec 1.00 143.8±0.25ms 200.7 MB/sec list_nested/cdc 1.00 161.4±0.36ms 178.8 MB/sec 1.00 161.9±0.16ms 178.2 MB/sec list_nested/default 1.00 130.4±0.40ms 221.3 MB/sec 1.00 130.6±0.14ms 221.0 MB/sec list_nested/parquet_2 1.00 144.0±0.61ms 200.4 MB/sec 1.00 143.8±0.17ms 200.7 MB/sec list_nested/zstd 1.00 139.5±0.36ms 206.8 MB/sec 1.00 139.8±0.18ms 206.4 MB/sec list_nested/zstd_parquet_2 1.00 156.4±0.38ms 184.5 MB/sec 1.00 156.5±0.17ms 184.3 MB/sec list_primitive/bloom_filter 1.02 281.9±1.36ms 1934.3 MB/sec 1.00 277.2±1.98ms 1967.2 MB/sec list_primitive/cdc 1.00 313.3±1.36ms 1740.7 MB/sec 1.00 312.1±0.55ms 1747.6 MB/sec list_primitive/default 1.01 202.2±1.85ms 2.6 GB/sec 1.00 200.8±1.17ms 2.7 GB/sec list_primitive/parquet_2 1.01 225.9±0.30ms 2.4 GB/sec 1.00 223.9±0.34ms 2.4 GB/sec list_primitive/zstd 1.00 457.9±0.88ms 1191.1 MB/sec 1.00 457.5±1.76ms 1192.2 MB/sec list_primitive/zstd_parquet_2 1.00 447.2±0.39ms 1219.5 MB/sec 1.00 446.0±0.92ms 1222.7 MB/sec list_primitive_non_null/bloom_filter 1.00 365.1±5.41ms 1490.5 MB/sec 1.05 383.1±8.58ms 1420.7 MB/sec list_primitive_non_null/cdc 1.00 394.0±8.81ms 1381.4 MB/sec 1.00 393.7±9.71ms 1382.3 MB/sec list_primitive_non_null/default 1.00 233.0±6.22ms 2.3 GB/sec 1.08 250.7±7.88ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.00 256.9±8.84ms 2.1 GB/sec 1.04 268.4±18.24ms 2027.7 MB/sec list_primitive_non_null/zstd 1.00 646.8±5.35ms 841.4 MB/sec 1.06 684.4±2.18ms 795.2 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 649.0±4.12ms 838.6 MB/sec 1.01 658.1±14.20ms 827.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 13.0±0.08ms 2.8 GB/sec 1.00 13.0±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.5±0.10ms 1522.4 MB/sec 1.00 24.4±0.06ms 1529.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.5±0.09ms 2.9 GB/sec 1.00 12.6±0.05ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.5±0.08ms 2.9 GB/sec 1.01 12.6±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 14.6±0.08ms 2.5 GB/sec 1.00 14.5±0.05ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.06ms 2.9 GB/sec 1.01 12.8±0.06ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 282.8±0.97ms 161.2 MB/sec 1.00 278.8±0.54ms 163.6 MB/sec list_struct_with_list/cdc 1.00 320.6±0.68ms 142.2 MB/sec 1.00 319.4±0.37ms 142.7 MB/sec list_struct_with_list/default 1.01 255.3±0.96ms 178.6 MB/sec 1.00 254.0±0.71ms 179.5 MB/sec list_struct_with_list/parquet_2 1.01 272.8±0.99ms 167.1 MB/sec 1.00 271.4±0.49ms 168.0 MB/sec list_struct_with_list/zstd 1.01 277.3±0.96ms 164.4 MB/sec 1.00 275.8±0.53ms 165.3 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.0±0.94ms 154.0 MB/sec 1.00 295.1±1.12ms 154.5 MB/sec primitive/bloom_filter 1.02 150.5±0.64ms 298.2 MB/sec 1.00 147.8±0.84ms 303.7 MB/sec primitive/cdc 1.01 157.4±1.25ms 285.0 MB/sec 1.00 155.4±0.54ms 288.8 MB/sec primitive/default 1.01 115.8±0.51ms 387.5 MB/sec 1.00 114.5±0.60ms 391.8 MB/sec primitive/parquet_2 1.01 130.6±0.55ms 343.7 MB/sec 1.00 129.3±0.38ms 347.1 MB/sec primitive/zstd 1.01 145.4±0.59ms 308.7 MB/sec 1.00 144.0±0.26ms 311.7 MB/sec primitive/zstd_parquet_2 1.01 163.4±0.56ms 274.7 MB/sec 1.00 162.1±0.42ms 276.8 MB/sec primitive_all_null/bloom_filter 1.01 896.2±3.02µs 48.9 GB/sec 1.00 883.9±3.51µs 49.6 GB/sec primitive_all_null/cdc 1.00 18.4±0.37ms 2.4 GB/sec 1.04 19.2±0.33ms 2.3 GB/sec primitive_all_null/default 1.00 272.1±1.02µs 161.1 GB/sec 1.00 272.9±1.20µs 160.6 GB/sec primitive_all_null/parquet_2 1.01 281.7±0.95µs 155.6 GB/sec 1.00 279.2±1.20µs 156.9 GB/sec primitive_all_null/zstd 1.01 424.4±1.29µs 103.3 GB/sec 1.00 420.0±1.42µs 104.4 GB/sec primitive_all_null/zstd_parquet_2 1.02 386.9±2.12µs 113.3 GB/sec 1.00 379.6±1.37µs 115.4 GB/sec primitive_non_null/bloom_filter 1.02 105.0±0.61ms 419.1 MB/sec 1.00 102.8±0.35ms 428.1 MB/sec primitive_non_null/cdc 1.01 86.4±0.85ms 509.3 MB/sec 1.00 85.3±0.27ms 515.6 MB/sec primitive_non_null/default 1.02 63.9±0.52ms 688.7 MB/sec 1.00 62.6±0.17ms 703.0 MB/sec primitive_non_null/parquet_2 1.01 85.2±0.45ms 516.3 MB/sec 1.00 84.4±0.20ms 521.5 MB/sec primitive_non_null/zstd 1.01 94.1±0.44ms 467.8 MB/sec 1.00 93.3±0.16ms 471.4 MB/sec primitive_non_null/zstd_parquet_2 1.01 118.2±0.44ms 372.4 MB/sec 1.00 117.4±0.17ms 374.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 12.8±0.12ms 3.4 GB/sec 1.00 12.6±0.11ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.2±0.36ms 1485.9 MB/sec 1.03 31.0±0.28ms 1445.3 MB/sec primitive_sparse_99pct_null/default 1.01 11.0±0.06ms 4.0 GB/sec 1.00 10.9±0.05ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.01 11.0±0.06ms 4.0 GB/sec 1.00 10.9±0.05ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.5±0.08ms 3.0 GB/sec 1.00 14.3±0.05ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.1±0.07ms 3.3 GB/sec 1.00 13.0±0.09ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.1±0.05ms 443.3 MB/sec 1.03 28.0±0.04ms 429.1 MB/sec short_string_non_null/cdc 1.00 19.9±0.04ms 604.0 MB/sec 1.00 19.9±0.05ms 604.3 MB/sec short_string_non_null/default 1.00 15.6±0.04ms 767.3 MB/sec 1.01 15.7±0.04ms 762.5 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.08ms 462.9 MB/sec 1.01 26.1±0.50ms 459.8 MB/sec short_string_non_null/zstd 1.00 35.9±0.09ms 334.7 MB/sec 1.00 35.9±0.11ms 334.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.08ms 416.3 MB/sec 1.01 29.0±0.11ms 414.1 MB/sec small_string_distinct/delta_byte_array 1.00 979.1±4.31µs 8.0 GB/sec 1.01 992.4±7.55µs 7.9 GB/sec small_string_distinct/plain 1.00 753.8±4.68µs 10.4 GB/sec 1.00 755.4±5.18µs 10.4 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1012.1±7.85µs 7.7 GB/sec 1.02 1027.4±16.65µs 7.6 GB/sec small_string_partial_prefix/plain 1.00 1009.4±6.25µs 7.8 GB/sec 1.00 1009.4±8.21µs 7.8 GB/sec small_string_shared_prefix/delta_byte_array 1.00 983.5±3.19µs 8.0 GB/sec 1.01 995.8±4.67µs 7.9 GB/sec small_string_shared_prefix/plain 1.00 1119.0±3.37µs 7.0 GB/sec 1.01 1135.0±4.22µs 6.9 GB/sec string/bloom_filter 1.10 227.1±25.57ms 2.3 GB/sec 1.00 206.6±17.44ms 2.5 GB/sec string/cdc 1.01 201.7±0.85ms 2.5 GB/sec 1.00 200.2±1.08ms 2.6 GB/sec string/default 1.21 131.9±24.00ms 3.9 GB/sec 1.00 108.7±2.57ms 4.7 GB/sec string/parquet_2 1.13 109.3±7.56ms 4.7 GB/sec 1.00 96.8±4.26ms 5.3 GB/sec string/zstd 1.00 441.5±3.80ms 1187.4 MB/sec 1.02 449.4±8.98ms 1166.6 MB/sec string/zstd_parquet_2 1.00 390.9±8.37ms 1341.0 MB/sec 1.00 389.5±5.82ms 1346.0 MB/sec string_and_binary_view/bloom_filter 1.00 63.6±0.20ms 507.4 MB/sec 1.02 65.0±0.35ms 496.1 MB/sec string_and_binary_view/cdc 1.00 58.9±0.13ms 547.8 MB/sec 1.00 58.9±0.16ms 547.4 MB/sec string_and_binary_view/default 1.00 48.1±0.12ms 670.8 MB/sec 1.00 48.3±0.20ms 667.6 MB/sec string_and_binary_view/parquet_2 1.00 59.2±0.24ms 544.8 MB/sec 1.00 59.4±0.11ms 542.7 MB/sec string_and_binary_view/zstd 1.00 85.0±0.18ms 379.2 MB/sec 1.00 85.4±0.11ms 377.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.2±0.13ms 440.7 MB/sec 1.00 73.3±0.11ms 440.1 MB/sec string_dictionary/bloom_filter 1.00 84.7±0.62ms 3.0 GB/sec 1.02 86.5±0.54ms 3.0 GB/sec string_dictionary/cdc 1.00 45.4±1.06ms 5.7 GB/sec 1.06 48.3±0.58ms 5.3 GB/sec string_dictionary/default 1.00 42.5±0.88ms 6.1 GB/sec 1.03 43.8±0.22ms 5.9 GB/sec string_dictionary/parquet_2 1.00 48.7±0.11ms 5.3 GB/sec 1.00 48.8±0.17ms 5.3 GB/sec string_dictionary/zstd 1.00 205.3±1.26ms 1286.3 MB/sec 1.02 209.7±0.40ms 1259.8 MB/sec string_dictionary/zstd_parquet_2 1.00 192.0±0.16ms 1375.5 MB/sec 1.00 192.3±0.18ms 1373.6 MB/sec string_non_null/bloom_filter 1.00 229.4±11.26ms 2.2 GB/sec 1.02 233.0±13.91ms 2.2 GB/sec string_non_null/cdc 1.04 244.7±3.65ms 2.1 GB/sec 1.00 234.1±0.55ms 2.2 GB/sec string_non_null/default 1.02 121.2±7.96ms 4.2 GB/sec 1.00 118.7±11.97ms 4.3 GB/sec string_non_null/parquet_2 1.02 128.2±5.55ms 4.0 GB/sec 1.00 125.3±9.17ms 4.1 GB/sec string_non_null/zstd 1.02 552.9±2.40ms 947.8 MB/sec 1.00 544.5±11.11ms 962.4 MB/sec string_non_null/zstd_parquet_2 1.00 489.4±5.13ms 1070.8 MB/sec 1.02 497.1±8.30ms 1054.2 MB/sec string_ree/bloom_filter 1.00 147.9±0.93ms 110.9 MB/sec 1.08 160.3±0.55ms 102.3 MB/sec string_ree/cdc 1.00 217.8±0.71ms 75.3 MB/sec 1.05 228.8±1.21ms 71.7 MB/sec string_ree/default 1.00 119.0±0.62ms 137.9 MB/sec 1.11 131.8±0.57ms 124.5 MB/sec string_ree/parquet_2 1.00 125.7±0.55ms 130.6 MB/sec 1.06 132.6±0.37ms 123.7 MB/sec string_ree/zstd 1.00 180.2±0.69ms 91.0 MB/sec 1.06 191.8±0.62ms 85.6 MB/sec string_ree/zstd_parquet_2 1.00 140.4±0.37ms 116.8 MB/sec 1.05 147.3±0.37ms 111.4 MB/sec string_ree_95pct_null/bloom_filter 1.01 26.7±0.06ms 52.7 MB/sec 1.00 26.5±0.07ms 53.1 MB/sec string_ree_95pct_null/cdc 1.00 32.7±0.10ms 43.0 MB/sec 1.00 32.8±0.07ms 42.9 MB/sec string_ree_95pct_null/default 1.01 25.0±0.05ms 56.2 MB/sec 1.00 24.9±0.04ms 56.6 MB/sec string_ree_95pct_null/parquet_2 1.01 25.1±0.05ms 56.0 MB/sec 1.00 24.9±0.04ms 56.6 MB/sec string_ree_95pct_null/zstd 1.01 25.9±0.04ms 54.3 MB/sec 1.00 25.7±0.04ms 54.7 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.9±0.09ms 54.4 MB/sec 1.00 25.6±0.05ms 54.9 MB/sec struct_all_null/bloom_filter 1.01 372.8±0.95µs 42.2 GB/sec 1.00 367.9±1.46µs 42.8 GB/sec struct_all_null/cdc 1.00 7.3±0.09ms 2.2 GB/sec 1.08 7.9±0.09ms 2042.0 MB/sec struct_all_null/default 1.02 118.2±0.51µs 133.2 GB/sec 1.00 116.2±0.63µs 135.5 GB/sec struct_all_null/parquet_2 1.01 121.8±0.54µs 129.2 GB/sec 1.00 120.5±0.55µs 130.6 GB/sec struct_all_null/zstd 1.02 184.2±0.69µs 85.5 GB/sec 1.00 180.2±0.88µs 87.4 GB/sec struct_all_null/zstd_parquet_2 1.02 165.8±0.49µs 95.0 GB/sec 1.00 162.4±0.62µs 96.9 GB/sec struct_non_null/bloom_filter 1.04 44.6±0.37ms 358.4 MB/sec 1.00 43.0±0.10ms 371.7 MB/sec struct_non_null/cdc 1.01 43.3±0.47ms 369.7 MB/sec 1.00 43.0±0.09ms 371.9 MB/sec struct_non_null/default 1.02 30.1±0.31ms 532.3 MB/sec 1.00 29.6±0.08ms 541.1 MB/sec struct_non_null/parquet_2 1.01 38.7±0.29ms 413.7 MB/sec 1.00 38.3±0.09ms 418.1 MB/sec struct_non_null/zstd 1.01 38.5±0.35ms 415.2 MB/sec 1.00 38.1±0.06ms 420.0 MB/sec struct_non_null/zstd_parquet_2 1.01 52.3±0.32ms 305.8 MB/sec 1.00 51.9±0.11ms 308.3 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.7±0.04ms 2.4 GB/sec 1.00 6.6±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.10ms 1193.8 MB/sec 1.05 14.1±0.10ms 1139.9 MB/sec struct_sparse_99pct_null/default 1.01 6.1±0.03ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.1±0.03ms 2.6 GB/sec 1.00 6.1±0.03ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.04ms 2.1 GB/sec 1.01 7.5±0.06ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.9±0.05ms 2.3 GB/sec 1.00 6.8±0.04ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3000.6s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 2903.3s | | CPU sys | 92.1s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3000.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2916.7s | | CPU sys | 79.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
