adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5338019469
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5336769512) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (4729b257e467851c78e5c5263e07fd9ea7da2dad) to 65844079fb9105c97547a081775a7746355203c5 [diff](https://github.com/apache/arrow-rs/compare/65844079fb9105c97547a081775a7746355203c5..4729b257e467851c78e5c5263e07fd9ea7da2dad) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "65844079fb9105c97547a081775a7746355203c5" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.6±0.03ms 19.9 MB/sec 1.02 12.8±0.07ms 19.5 MB/sec bool/cdc 1.01 15.5±0.17ms 16.1 MB/sec 1.00 15.4±0.05ms 16.2 MB/sec bool/default 1.00 10.5±0.05ms 23.9 MB/sec 1.01 10.6±0.04ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.04ms 18.6 MB/sec 1.00 13.5±0.05ms 18.6 MB/sec bool/zstd 1.00 11.0±0.06ms 22.7 MB/sec 1.00 11.1±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.8±0.06ms 18.1 MB/sec 1.00 13.9±0.06ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.2 MB/sec 1.01 6.6±0.05ms 19.1 MB/sec bool_non_null/cdc 1.00 6.2±0.05ms 20.0 MB/sec 1.01 6.3±0.03ms 19.9 MB/sec bool_non_null/default 1.00 3.7±0.01ms 33.6 MB/sec 1.01 3.8±0.02ms 33.2 MB/sec bool_non_null/parquet_2 1.01 7.6±0.03ms 16.4 MB/sec 1.00 7.6±0.03ms 16.6 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.7 MB/sec 1.01 4.1±0.03ms 30.2 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.02ms 15.6 MB/sec 1.00 8.0±0.03ms 15.7 MB/sec bool_ree/bloom_filter 1.00 29.9±0.05ms 7.1 MB/sec 1.01 30.4±0.19ms 7.0 MB/sec bool_ree/cdc 1.00 31.3±0.15ms 6.8 MB/sec 1.01 31.7±0.21ms 6.7 MB/sec bool_ree/default 1.00 27.3±0.06ms 7.8 MB/sec 1.02 27.7±0.19ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.9±0.08ms 7.4 MB/sec 1.01 29.1±0.18ms 7.3 MB/sec bool_ree/zstd 1.00 27.9±0.06ms 7.6 MB/sec 1.02 28.4±0.20ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.01 29.4±0.19ms 7.2 MB/sec decimal/bloom_filter 1.00 119.6±1.57ms 501.7 MB/sec 1.01 120.2±1.75ms 499.0 MB/sec decimal/cdc 1.00 101.5±0.86ms 591.2 MB/sec 1.00 101.2±0.79ms 592.6 MB/sec decimal/default 1.00 79.4±1.14ms 755.9 MB/sec 1.02 81.2±2.56ms 738.5 MB/sec decimal/parquet_2 1.00 177.3±2.12ms 338.4 MB/sec 1.00 177.4±1.46ms 338.2 MB/sec decimal/zstd 1.02 91.8±2.42ms 653.9 MB/sec 1.00 90.1±2.15ms 665.6 MB/sec decimal/zstd_parquet_2 1.00 197.1±1.76ms 304.5 MB/sec 1.00 197.9±2.20ms 303.2 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.7±1.41ms 17.2 MB/sec 1.00 58.7±0.40ms 17.2 MB/sec fixed_size_binary_ree/cdc 1.00 62.1±0.43ms 16.2 MB/sec 1.00 61.8±0.31ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.8±0.19ms 19.5 MB/sec 1.01 52.5±0.47ms 19.2 MB/sec fixed_size_binary_ree/parquet_2 1.03 68.4±1.75ms 14.7 MB/sec 1.00 66.7±0.27ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.00 57.6±0.29ms 17.5 MB/sec 1.02 58.7±0.83ms 17.2 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.2±0.68ms 15.0 MB/sec 1.00 67.4±0.33ms 14.9 MB/sec float_with_nans/bloom_filter 1.03 82.8±3.48ms 169.0 MB/sec 1.00 80.8±0.18ms 173.3 MB/sec float_with_nans/cdc 1.03 73.2±1.98ms 191.3 MB/sec 1.00 70.9±1.25ms 197.4 MB/sec float_with_nans/default 1.00 63.1±0.19ms 221.7 MB/sec 1.00 63.3±0.15ms 221.3 MB/sec float_with_nans/parquet_2 1.00 80.8±0.64ms 173.3 MB/sec 1.02 82.7±2.01ms 169.3 MB/sec float_with_nans/zstd 1.00 101.7±1.10ms 137.6 MB/sec 1.00 101.7±1.21ms 137.6 MB/sec float_with_nans/zstd_parquet_2 1.00 117.8±1.12ms 118.9 MB/sec 1.00 117.4±1.03ms 119.3 MB/sec fsb/bloom_filter 1.00 8.1±0.06ms 1985.5 MB/sec 1.01 8.2±0.36ms 1974.3 MB/sec fsb/cdc 1.02 10.6±0.19ms 1522.9 MB/sec 1.00 10.3±0.03ms 1559.6 MB/sec fsb/default 1.01 7.0±0.19ms 2.2 GB/sec 1.00 7.0±0.14ms 2.3 GB/sec fsb/parquet_2 1.01 13.4±0.08ms 1205.7 MB/sec 1.00 13.3±0.06ms 1215.8 MB/sec fsb/zstd 1.02 9.8±0.32ms 1653.2 MB/sec 1.00 9.5±0.26ms 1690.8 MB/sec fsb/zstd_parquet_2 1.00 14.4±0.08ms 1121.3 MB/sec 1.01 14.6±0.73ms 1105.4 MB/sec int32_ree/bloom_filter 1.00 40.9±0.95ms 9.9 MB/sec 1.01 41.4±0.92ms 9.8 MB/sec int32_ree/cdc 1.00 40.7±0.24ms 10.0 MB/sec 1.00 40.7±0.24ms 10.0 MB/sec int32_ree/default 1.00 36.7±0.20ms 11.1 MB/sec 1.01 37.1±0.30ms 11.0 MB/sec int32_ree/parquet_2 1.00 36.6±0.07ms 11.1 MB/sec 1.01 37.0±0.27ms 11.0 MB/sec int32_ree/zstd 1.00 37.4±0.32ms 10.9 MB/sec 1.00 37.5±0.17ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.16ms 10.9 MB/sec 1.02 37.8±0.37ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.03ms 18.6 MB/sec 1.00 21.9±0.18ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.02 24.4±0.18ms 16.6 MB/sec 1.00 23.9±0.15ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.12ms 18.8 MB/sec 1.00 21.6±0.11ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.17ms 18.7 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.06ms 18.6 MB/sec 1.00 21.9±0.15ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.07ms 18.7 MB/sec 1.00 21.8±0.10ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 60.5±0.27ms 4.1 GB/sec 1.06 64.4±0.72ms 3.9 GB/sec large_string_distinct/plain 1.05 62.5±2.99ms 4.0 GB/sec 1.00 59.6±0.54ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 57.0±1.75ms 4.4 GB/sec 1.05 60.1±0.39ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 68.9±0.16ms 3.6 GB/sec 1.10 75.8±2.31ms 3.3 GB/sec large_string_non_null/cdc 1.00 242.6±3.18ms 1055.0 MB/sec 1.01 244.0±2.77ms 1049.3 MB/sec large_string_non_null/default 1.00 52.6±1.60ms 4.8 GB/sec 1.01 53.2±0.09ms 4.7 GB/sec large_string_non_null/parquet_2 1.00 51.5±0.08ms 4.9 GB/sec 1.05 54.2±1.48ms 4.6 GB/sec large_string_non_null/zstd 1.00 51.6±0.07ms 4.8 GB/sec 1.04 53.5±0.60ms 4.7 GB/sec large_string_non_null/zstd_parquet_2 1.00 51.6±0.08ms 4.8 GB/sec 1.04 53.8±1.25ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 44.6±2.54ms 5.6 GB/sec 1.35 60.1±6.92ms 4.2 GB/sec large_string_shared_prefix/plain 1.15 108.5±11.97ms 2.3 GB/sec 1.00 94.7±6.36ms 2.6 GB/sec large_string_shared_prefix_list/delta_byte_array 1.26 68.4±2.97ms 3.7 GB/sec 1.00 54.3±0.17ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 46.5±4.03ms 5.4 GB/sec 1.12 52.1±0.23ms 4.8 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.4±0.57ms 4.0 GB/sec 1.06 66.5±4.87ms 3.8 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 22.9±1.37ms 5.5 GB/sec 1.22 27.9±0.08ms 4.5 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 41.6±2.01ms 6.0 GB/sec 1.41 58.5±7.03ms 4.3 GB/sec list_nested/bloom_filter 1.03 148.1±1.54ms 194.8 MB/sec 1.00 144.2±1.21ms 200.2 MB/sec list_nested/cdc 1.00 162.5±1.33ms 177.6 MB/sec 1.00 162.1±1.71ms 178.0 MB/sec list_nested/default 1.00 130.6±0.66ms 220.9 MB/sec 1.00 131.0±1.37ms 220.3 MB/sec list_nested/parquet_2 1.00 144.0±0.92ms 200.4 MB/sec 1.01 145.0±1.42ms 199.0 MB/sec list_nested/zstd 1.00 140.0±0.79ms 206.1 MB/sec 1.00 140.0±1.51ms 206.2 MB/sec list_nested/zstd_parquet_2 1.00 156.6±0.58ms 184.3 MB/sec 1.00 156.8±1.09ms 184.0 MB/sec list_primitive/bloom_filter 1.03 287.6±8.62ms 1896.0 MB/sec 1.00 279.3±10.24ms 1952.7 MB/sec list_primitive/cdc 1.02 317.6±6.20ms 1716.9 MB/sec 1.00 312.4±6.51ms 1745.8 MB/sec list_primitive/default 1.01 204.7±5.64ms 2.6 GB/sec 1.00 202.2±6.07ms 2.6 GB/sec list_primitive/parquet_2 1.01 225.5±3.36ms 2.4 GB/sec 1.00 223.2±2.76ms 2.4 GB/sec list_primitive/zstd 1.01 458.5±7.22ms 1189.4 MB/sec 1.00 454.1±5.71ms 1201.1 MB/sec list_primitive/zstd_parquet_2 1.00 447.1±2.93ms 1219.7 MB/sec 1.00 446.3±4.28ms 1222.0 MB/sec list_primitive_non_null/bloom_filter 1.01 387.5±28.58ms 1404.6 MB/sec 1.00 384.2±32.93ms 1416.4 MB/sec list_primitive_non_null/cdc 1.03 399.5±13.90ms 1362.4 MB/sec 1.00 389.5±11.41ms 1397.3 MB/sec list_primitive_non_null/default 1.00 232.0±5.84ms 2.3 GB/sec 1.04 240.2±5.58ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.00 263.6±6.47ms 2.0 GB/sec 1.03 270.7±5.71ms 2010.8 MB/sec list_primitive_non_null/zstd 1.00 660.9±16.50ms 823.4 MB/sec 1.01 666.4±13.37ms 816.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 650.0±8.16ms 837.3 MB/sec 1.01 654.3±16.23ms 831.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.8±0.39ms 2.9 GB/sec 1.01 12.9±0.39ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.02 24.8±0.66ms 1504.3 MB/sec 1.00 24.3±0.47ms 1537.6 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.04ms 3.0 GB/sec 1.01 12.4±0.14ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.3±0.04ms 3.0 GB/sec 1.02 12.5±0.29ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.2±0.06ms 2.6 GB/sec 1.01 14.3±0.05ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.30ms 2.9 GB/sec 1.00 12.5±0.13ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 285.3±5.25ms 159.8 MB/sec 1.00 286.2±4.81ms 159.3 MB/sec list_struct_with_list/cdc 1.00 320.7±2.11ms 142.2 MB/sec 1.00 320.5±3.35ms 142.3 MB/sec list_struct_with_list/default 1.00 255.0±1.67ms 178.8 MB/sec 1.01 256.6±2.40ms 177.7 MB/sec list_struct_with_list/parquet_2 1.00 272.5±1.73ms 167.3 MB/sec 1.00 272.9±2.24ms 167.1 MB/sec list_struct_with_list/zstd 1.00 279.1±3.61ms 163.4 MB/sec 1.00 278.9±3.31ms 163.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.4±2.30ms 154.3 MB/sec 1.00 296.1±2.40ms 154.0 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 36.1±0.08ms 6.9 GB/sec 1.20 43.5±1.06ms 5.8 GB/sec primitive/bloom_filter 1.00 146.6±3.33ms 306.1 MB/sec 1.01 147.6±4.91ms 304.0 MB/sec primitive/cdc 1.00 155.9±1.50ms 287.8 MB/sec 1.00 155.5±2.50ms 288.5 MB/sec primitive/default 1.02 115.4±2.72ms 389.0 MB/sec 1.00 113.6±0.33ms 395.0 MB/sec primitive/parquet_2 1.00 129.3±1.40ms 347.1 MB/sec 1.00 129.5±1.74ms 346.5 MB/sec primitive/zstd 1.00 143.9±1.47ms 311.9 MB/sec 1.00 143.7±1.48ms 312.2 MB/sec primitive/zstd_parquet_2 1.01 163.4±2.67ms 274.6 MB/sec 1.00 162.6±1.74ms 276.0 MB/sec primitive_all_null/bloom_filter 1.01 902.5±18.84µs 48.6 GB/sec 1.00 893.7±20.42µs 49.0 GB/sec primitive_all_null/cdc 1.00 19.0±0.47ms 2.3 GB/sec 1.01 19.3±0.28ms 2.3 GB/sec primitive_all_null/default 1.01 276.4±1.40µs 158.6 GB/sec 1.00 273.3±1.30µs 160.3 GB/sec primitive_all_null/parquet_2 1.01 286.3±1.38µs 153.1 GB/sec 1.00 283.3±1.29µs 154.7 GB/sec primitive_all_null/zstd 1.00 424.4±1.40µs 103.3 GB/sec 1.00 426.4±1.80µs 102.8 GB/sec primitive_all_null/zstd_parquet_2 1.00 382.7±2.37µs 114.5 GB/sec 1.00 384.1±1.62µs 114.1 GB/sec primitive_non_null/bloom_filter 1.05 107.0±5.49ms 411.3 MB/sec 1.00 102.0±2.26ms 431.2 MB/sec primitive_non_null/cdc 1.05 88.6±2.76ms 496.7 MB/sec 1.00 84.5±0.31ms 520.6 MB/sec primitive_non_null/default 1.00 62.5±0.21ms 704.5 MB/sec 1.00 62.3±1.12ms 706.0 MB/sec primitive_non_null/parquet_2 1.02 85.1±1.52ms 516.9 MB/sec 1.00 83.8±0.23ms 525.1 MB/sec primitive_non_null/zstd 1.01 93.8±1.53ms 469.0 MB/sec 1.00 93.2±1.86ms 472.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.8±1.39ms 373.6 MB/sec 1.00 117.2±1.04ms 375.4 MB/sec primitive_sparse_99pct_null/bloom_filter 1.03 12.5±0.58ms 3.5 GB/sec 1.00 12.1±0.21ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.01 31.9±0.61ms 1406.3 MB/sec 1.00 31.4±0.62ms 1427.2 MB/sec primitive_sparse_99pct_null/default 1.00 10.8±0.10ms 4.1 GB/sec 1.02 11.0±0.37ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.01 10.8±0.21ms 4.1 GB/sec 1.00 10.7±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.06ms 3.1 GB/sec 1.01 14.3±0.40ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.2±0.56ms 3.3 GB/sec 1.00 12.6±0.03ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 28.1±0.10ms 427.8 MB/sec 1.04 29.1±0.50ms 412.9 MB/sec short_string_non_null/cdc 1.01 20.1±0.27ms 597.4 MB/sec 1.00 19.9±0.25ms 603.6 MB/sec short_string_non_null/default 1.00 15.6±0.20ms 771.1 MB/sec 1.00 15.6±0.03ms 771.0 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.19ms 467.1 MB/sec 1.01 25.8±0.12ms 464.3 MB/sec short_string_non_null/zstd 1.00 35.8±0.21ms 335.5 MB/sec 1.00 35.9±0.10ms 334.0 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.5±0.07ms 420.3 MB/sec 1.01 28.7±0.06ms 418.1 MB/sec small_string_distinct/delta_byte_array 1.02 983.0±55.21µs 8.0 GB/sec 1.00 960.5±48.35µs 8.2 GB/sec small_string_distinct/plain 1.00 739.0±71.31µs 10.6 GB/sec 1.06 783.4±42.31µs 10.0 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1010.6±4.71µs 7.8 GB/sec 1.01 1018.8±63.78µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 943.5±3.64µs 8.3 GB/sec 1.11 1045.7±110.63µs 7.5 GB/sec small_string_shared_prefix/delta_byte_array 1.01 986.8±25.01µs 7.9 GB/sec 1.00 974.5±20.98µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1088.9±68.67µs 7.2 GB/sec 1.02 1106.0±5.68µs 7.1 GB/sec string/bloom_filter 1.00 206.3±25.28ms 2.5 GB/sec 1.11 229.7±37.00ms 2.2 GB/sec string/cdc 1.00 208.1±9.49ms 2.5 GB/sec 1.00 208.9±6.36ms 2.5 GB/sec string/default 1.00 127.4±23.88ms 4.0 GB/sec 1.02 129.7±24.36ms 3.9 GB/sec string/parquet_2 1.04 183.4±6.06ms 2.8 GB/sec 1.00 175.5±2.73ms 2.9 GB/sec string/zstd 1.00 463.4±14.34ms 1131.3 MB/sec 1.01 469.9±20.97ms 1115.6 MB/sec string/zstd_parquet_2 1.02 404.7±5.18ms 1295.3 MB/sec 1.00 394.9±9.74ms 1327.5 MB/sec string_and_binary_view/bloom_filter 1.00 66.6±2.14ms 484.1 MB/sec 1.00 66.4±3.12ms 486.0 MB/sec string_and_binary_view/cdc 1.02 61.4±1.58ms 525.6 MB/sec 1.00 60.4±1.89ms 534.1 MB/sec string_and_binary_view/default 1.03 50.2±1.13ms 642.0 MB/sec 1.00 48.6±0.75ms 664.1 MB/sec string_and_binary_view/parquet_2 1.00 60.5±0.11ms 533.0 MB/sec 1.00 60.4±1.43ms 534.2 MB/sec string_and_binary_view/zstd 1.04 89.2±2.69ms 361.4 MB/sec 1.00 85.9±1.44ms 375.4 MB/sec string_and_binary_view/zstd_parquet_2 1.02 75.2±1.53ms 429.1 MB/sec 1.00 73.9±1.51ms 436.3 MB/sec string_dictionary/bloom_filter 1.04 90.4±11.64ms 2.9 GB/sec 1.00 87.0±5.96ms 3.0 GB/sec string_dictionary/cdc 1.36 66.5±4.98ms 3.9 GB/sec 1.00 48.8±2.44ms 5.3 GB/sec string_dictionary/default 1.00 43.5±2.20ms 5.9 GB/sec 1.01 43.8±1.76ms 5.9 GB/sec string_dictionary/parquet_2 1.00 48.0±0.82ms 5.4 GB/sec 1.02 48.9±0.92ms 5.3 GB/sec string_dictionary/zstd 1.00 209.2±4.30ms 1262.7 MB/sec 1.02 213.0±7.90ms 1240.3 MB/sec string_dictionary/zstd_parquet_2 1.00 192.7±1.26ms 1370.7 MB/sec 1.00 192.2±0.84ms 1373.9 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 33.9±0.14ms 118.1 MB/sec 1.02 34.7±0.80ms 115.4 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.4±0.23ms 146.0 MB/sec 1.01 27.7±0.11ms 144.7 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.2±0.14ms 159.1 MB/sec 1.02 25.7±0.82ms 155.9 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.1±0.16ms 159.3 MB/sec 1.03 25.8±0.84ms 155.2 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.5±0.14ms 157.1 MB/sec 1.02 26.1±0.83ms 153.5 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.5±0.12ms 157.1 MB/sec 1.02 26.1±0.83ms 153.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 34.3±0.18ms 116.8 MB/sec 1.00 33.5±0.82ms 119.5 MB/sec string_dictionary_low_cardinality_20/cdc 1.04 28.5±0.20ms 140.6 MB/sec 1.00 27.4±0.21ms 146.4 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.8±0.19ms 155.4 MB/sec 1.00 25.5±0.86ms 156.9 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.01 25.7±0.17ms 155.6 MB/sec 1.00 25.4±0.82ms 157.5 MB/sec string_dictionary_low_cardinality_20/zstd 1.01 25.9±0.19ms 154.6 MB/sec 1.00 25.5±0.82ms 156.9 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.02 25.9±0.16ms 154.9 MB/sec 1.00 25.5±0.82ms 157.2 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.1±0.21ms 114.2 MB/sec 1.03 36.0±0.97ms 111.3 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.1±0.13ms 142.7 MB/sec 1.01 28.3±0.14ms 141.8 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.1±0.31ms 154.0 MB/sec 1.02 26.5±0.92ms 151.3 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.0±0.23ms 154.4 MB/sec 1.02 26.4±0.91ms 151.8 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.4±0.13ms 152.1 MB/sec 1.03 27.2±0.86ms 147.8 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.5±0.26ms 151.4 MB/sec 1.02 27.0±1.08ms 148.4 MB/sec string_non_null/bloom_filter 1.00 231.1±14.62ms 2.2 GB/sec 1.03 238.9±29.68ms 2.1 GB/sec string_non_null/cdc 1.08 256.9±9.20ms 2039.7 MB/sec 1.00 238.0±6.70ms 2.1 GB/sec string_non_null/default 1.10 132.0±24.35ms 3.9 GB/sec 1.00 120.0±14.60ms 4.3 GB/sec string_non_null/parquet_2 1.00 115.6±5.24ms 4.4 GB/sec 1.12 128.9±8.39ms 4.0 GB/sec string_non_null/zstd 1.00 546.8±15.01ms 958.4 MB/sec 1.04 567.8±16.99ms 922.8 MB/sec string_non_null/zstd_parquet_2 1.02 502.2±6.92ms 1043.4 MB/sec 1.00 493.2±8.09ms 1062.4 MB/sec string_ree/bloom_filter 1.01 152.2±3.57ms 107.8 MB/sec 1.00 150.2±2.81ms 109.2 MB/sec string_ree/cdc 1.00 223.4±5.45ms 73.4 MB/sec 1.03 229.1±6.32ms 71.6 MB/sec string_ree/default 1.01 123.8±2.73ms 132.5 MB/sec 1.00 122.6±3.12ms 133.9 MB/sec string_ree/parquet_2 1.00 127.2±3.75ms 129.0 MB/sec 1.02 129.9±1.73ms 126.3 MB/sec string_ree/zstd 1.00 182.1±4.20ms 90.1 MB/sec 1.04 189.3±8.79ms 86.7 MB/sec string_ree/zstd_parquet_2 1.00 138.4±1.36ms 118.5 MB/sec 1.05 145.3±1.52ms 112.9 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.0±0.06ms 54.1 MB/sec 1.00 26.1±0.11ms 53.9 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.46ms 43.5 MB/sec 1.01 32.7±0.46ms 43.0 MB/sec string_ree_95pct_null/default 1.00 24.7±0.35ms 56.9 MB/sec 1.00 24.8±0.33ms 56.7 MB/sec string_ree_95pct_null/parquet_2 1.03 25.4±0.40ms 55.3 MB/sec 1.00 24.7±0.07ms 57.0 MB/sec string_ree_95pct_null/zstd 1.00 25.5±0.29ms 55.1 MB/sec 1.01 25.9±0.52ms 54.4 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.4±0.10ms 55.5 MB/sec 1.01 25.5±0.31ms 55.1 MB/sec struct_all_null/bloom_filter 1.01 378.0±3.01µs 41.7 GB/sec 1.00 372.7±4.41µs 42.3 GB/sec struct_all_null/cdc 1.00 7.6±0.11ms 2.1 GB/sec 1.02 7.8±0.10ms 2.0 GB/sec struct_all_null/default 1.00 118.0±0.76µs 133.4 GB/sec 1.00 117.9±1.22µs 133.6 GB/sec struct_all_null/parquet_2 1.01 122.6±0.66µs 128.5 GB/sec 1.00 121.7±0.63µs 129.4 GB/sec struct_all_null/zstd 1.00 181.9±0.97µs 86.6 GB/sec 1.00 181.9±0.66µs 86.6 GB/sec struct_all_null/zstd_parquet_2 1.00 164.1±0.86µs 96.0 GB/sec 1.01 165.7±0.69µs 95.0 GB/sec struct_non_null/bloom_filter 1.03 45.8±1.37ms 349.3 MB/sec 1.00 44.3±0.29ms 361.2 MB/sec struct_non_null/cdc 1.01 43.9±0.23ms 364.6 MB/sec 1.00 43.5±0.52ms 368.2 MB/sec struct_non_null/default 1.04 30.8±0.70ms 520.3 MB/sec 1.00 29.5±0.44ms 541.6 MB/sec struct_non_null/parquet_2 1.03 39.2±0.71ms 408.3 MB/sec 1.00 38.2±0.16ms 418.7 MB/sec struct_non_null/zstd 1.07 40.8±1.36ms 392.2 MB/sec 1.00 38.0±0.11ms 421.1 MB/sec struct_non_null/zstd_parquet_2 1.00 52.6±0.13ms 304.1 MB/sec 1.02 53.7±1.19ms 298.1 MB/sec struct_sparse_99pct_null/bloom_filter 1.03 6.7±0.37ms 2.3 GB/sec 1.00 6.5±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.08 14.7±0.14ms 1096.0 MB/sec 1.00 13.6±0.18ms 1186.6 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.10ms 2.6 GB/sec 1.00 6.0±0.05ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.01ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.09 8.0±0.15ms 2020.3 MB/sec 1.00 7.3±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.04 7.0±0.32ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3260.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3156.7s | | CPU sys | 100.9s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3270.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3169.5s | | CPU sys | 97.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
