adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187756442
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187132250) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.05ms 19.7 MB/sec 1.00 12.7±0.06ms 19.7 MB/sec bool/cdc 1.01 15.5±0.07ms 16.1 MB/sec 1.00 15.3±0.05ms 16.3 MB/sec bool/default 1.00 10.6±0.05ms 23.6 MB/sec 1.00 10.6±0.05ms 23.7 MB/sec bool/parquet_2 1.00 14.4±0.06ms 17.4 MB/sec 1.00 14.4±0.05ms 17.4 MB/sec bool/zstd 1.00 11.1±0.05ms 22.5 MB/sec 1.00 11.1±0.04ms 22.5 MB/sec bool/zstd_parquet_2 1.00 14.7±0.05ms 17.0 MB/sec 1.00 14.7±0.05ms 17.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.3 MB/sec 1.02 6.6±0.03ms 18.9 MB/sec bool_non_null/cdc 1.00 6.3±0.04ms 20.0 MB/sec 1.02 6.4±0.02ms 19.7 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.5 MB/sec 1.03 3.8±0.02ms 32.5 MB/sec bool_non_null/parquet_2 1.00 8.5±0.03ms 14.8 MB/sec 1.02 8.6±0.03ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.6 MB/sec 1.03 4.2±0.02ms 29.8 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.1 MB/sec 1.02 9.0±0.04ms 13.9 MB/sec bool_ree/bloom_filter 1.00 30.1±0.11ms 7.1 MB/sec 1.00 30.1±0.09ms 7.1 MB/sec bool_ree/cdc 1.01 31.7±0.12ms 6.7 MB/sec 1.00 31.4±0.11ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.10ms 7.8 MB/sec 1.00 27.4±0.09ms 7.8 MB/sec bool_ree/parquet_2 1.00 29.0±0.13ms 7.3 MB/sec 1.00 29.0±0.09ms 7.3 MB/sec bool_ree/zstd 1.00 28.1±0.10ms 7.6 MB/sec 1.00 28.0±0.08ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.4±0.11ms 7.3 MB/sec 1.00 29.3±0.09ms 7.3 MB/sec decimal/bloom_filter 1.24 144.9±1.11ms 414.2 MB/sec 1.00 117.2±0.37ms 512.1 MB/sec decimal/cdc 1.00 101.3±0.35ms 592.3 MB/sec 1.00 101.3±1.00ms 592.3 MB/sec decimal/default 1.33 104.7±1.12ms 573.3 MB/sec 1.00 78.7±0.40ms 762.3 MB/sec decimal/parquet_2 1.15 204.2±2.17ms 293.8 MB/sec 1.00 177.6±2.55ms 337.9 MB/sec decimal/zstd 1.34 119.2±7.99ms 503.2 MB/sec 1.00 89.3±0.37ms 672.2 MB/sec decimal/zstd_parquet_2 1.16 228.3±8.29ms 262.8 MB/sec 1.00 196.7±1.72ms 305.1 MB/sec fixed_size_binary_ree/bloom_filter 1.26 74.1±1.33ms 13.6 MB/sec 1.00 58.9±0.24ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.7±0.28ms 16.3 MB/sec 1.00 61.8±0.31ms 16.3 MB/sec fixed_size_binary_ree/default 1.30 67.3±0.96ms 15.0 MB/sec 1.00 51.9±0.22ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.23 81.6±0.45ms 12.3 MB/sec 1.00 66.4±0.24ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.27 73.1±0.95ms 13.8 MB/sec 1.00 57.8±0.25ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.23 82.5±0.89ms 12.2 MB/sec 1.00 67.2±1.33ms 15.0 MB/sec float_with_nans/bloom_filter 1.12 88.6±0.26ms 158.0 MB/sec 1.00 79.4±0.24ms 176.3 MB/sec float_with_nans/cdc 1.00 70.1±0.16ms 199.8 MB/sec 1.00 69.9±0.20ms 200.4 MB/sec float_with_nans/default 1.13 71.0±0.23ms 197.3 MB/sec 1.00 62.6±0.21ms 223.8 MB/sec float_with_nans/parquet_2 1.11 88.9±0.21ms 157.6 MB/sec 1.00 79.9±0.23ms 175.3 MB/sec float_with_nans/zstd 1.08 109.3±0.23ms 128.1 MB/sec 1.00 100.8±0.22ms 138.9 MB/sec float_with_nans/zstd_parquet_2 1.08 126.3±2.14ms 110.8 MB/sec 1.00 116.6±0.21ms 120.1 MB/sec fsb/bloom_filter 1.00 8.0±0.04ms 2022.7 MB/sec 1.00 8.0±0.05ms 2024.3 MB/sec fsb/cdc 1.00 10.4±0.07ms 1545.2 MB/sec 1.00 10.4±0.07ms 1546.3 MB/sec fsb/default 1.00 6.9±0.04ms 2.3 GB/sec 1.00 6.9±0.04ms 2.3 GB/sec fsb/parquet_2 1.00 13.2±0.06ms 1225.7 MB/sec 1.00 13.2±0.08ms 1222.2 MB/sec fsb/zstd 1.01 9.4±0.05ms 1720.0 MB/sec 1.00 9.3±0.05ms 1730.2 MB/sec fsb/zstd_parquet_2 1.00 14.1±0.09ms 1144.9 MB/sec 1.00 14.0±0.08ms 1149.2 MB/sec int32_ree/bloom_filter 1.00 40.2±0.19ms 10.1 MB/sec 1.01 40.6±0.24ms 10.0 MB/sec int32_ree/cdc 1.00 40.1±0.09ms 10.1 MB/sec 1.00 40.3±0.09ms 10.1 MB/sec int32_ree/default 1.00 36.4±0.09ms 11.2 MB/sec 1.00 36.4±0.08ms 11.2 MB/sec int32_ree/parquet_2 1.00 36.4±0.08ms 11.2 MB/sec 1.00 36.4±0.06ms 11.2 MB/sec int32_ree/zstd 1.00 37.0±0.08ms 11.0 MB/sec 1.00 36.9±0.08ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 36.9±0.10ms 11.0 MB/sec 1.00 36.9±0.10ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.8±0.06ms 18.7 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.08ms 17.1 MB/sec 1.01 24.1±0.06ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.02ms 18.9 MB/sec 1.00 21.5±0.03ms 19.0 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 21.8±0.06ms 18.7 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec large_string_distinct/delta_byte_array 1.00 62.7±0.63ms 4.0 GB/sec 1.01 63.6±0.54ms 3.9 GB/sec large_string_distinct/plain 1.00 59.8±0.82ms 4.2 GB/sec 1.00 59.7±0.60ms 4.2 GB/sec large_string_non_null/bloom_filter 1.00 72.1±0.10ms 3.5 GB/sec 1.05 75.5±0.55ms 3.3 GB/sec large_string_non_null/cdc 1.00 244.0±3.07ms 1049.3 MB/sec 1.00 244.4±1.35ms 1047.3 MB/sec large_string_non_null/default 1.00 54.2±0.08ms 4.6 GB/sec 1.04 56.5±0.97ms 4.4 GB/sec large_string_non_null/parquet_2 1.00 54.3±0.09ms 4.6 GB/sec 1.03 56.0±0.94ms 4.5 GB/sec large_string_non_null/zstd 1.00 54.3±0.08ms 4.6 GB/sec 1.05 56.9±0.96ms 4.4 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.3±0.08ms 4.6 GB/sec 1.04 56.6±1.02ms 4.4 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.6±0.33ms 4.6 GB/sec 1.00 54.5±0.24ms 4.6 GB/sec large_string_shared_prefix/plain 1.00 92.4±3.33ms 2.7 GB/sec 1.00 92.2±1.21ms 2.7 GB/sec list_nested/bloom_filter 1.00 144.8±0.27ms 199.2 MB/sec 1.00 144.5±0.61ms 199.7 MB/sec list_nested/cdc 1.00 162.4±0.62ms 177.7 MB/sec 1.00 161.8±0.16ms 178.4 MB/sec list_nested/default 1.00 131.0±0.16ms 220.3 MB/sec 1.00 130.5±0.24ms 221.1 MB/sec list_nested/parquet_2 1.00 144.1±0.22ms 200.2 MB/sec 1.00 143.5±0.17ms 201.0 MB/sec list_nested/zstd 1.00 140.1±0.27ms 205.9 MB/sec 1.00 139.6±0.17ms 206.7 MB/sec list_nested/zstd_parquet_2 1.01 157.3±0.46ms 183.5 MB/sec 1.00 156.3±0.23ms 184.6 MB/sec list_primitive/bloom_filter 1.16 319.1±16.43ms 1709.1 MB/sec 1.00 274.6±0.67ms 1986.4 MB/sec list_primitive/cdc 1.03 316.6±8.75ms 1722.3 MB/sec 1.00 307.7±0.51ms 1772.2 MB/sec list_primitive/default 1.20 237.7±20.09ms 2.2 GB/sec 1.00 197.6±1.15ms 2.7 GB/sec list_primitive/parquet_2 1.07 240.6±11.95ms 2.2 GB/sec 1.00 224.5±0.42ms 2.4 GB/sec list_primitive/zstd 1.06 482.0±10.66ms 1131.5 MB/sec 1.00 453.4±1.54ms 1202.8 MB/sec list_primitive/zstd_parquet_2 1.07 476.7±4.88ms 1144.1 MB/sec 1.00 445.9±0.39ms 1223.0 MB/sec list_primitive_non_null/bloom_filter 1.11 406.4±26.51ms 1339.1 MB/sec 1.00 365.0±3.38ms 1490.9 MB/sec list_primitive_non_null/cdc 1.00 385.3±6.04ms 1412.5 MB/sec 1.02 391.6±8.66ms 1389.8 MB/sec list_primitive_non_null/default 1.18 281.6±22.59ms 1932.7 MB/sec 1.00 239.3±4.12ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.01 265.7±21.12ms 2.0 GB/sec 1.00 262.6±13.31ms 2.0 GB/sec list_primitive_non_null/zstd 1.09 719.1±20.14ms 756.8 MB/sec 1.00 661.1±10.90ms 823.3 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 646.0±19.33ms 842.5 MB/sec 1.01 650.3±10.56ms 836.9 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.07ms 2.9 GB/sec 1.00 12.7±0.12ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.3±0.09ms 1539.9 MB/sec 1.00 24.0±0.15ms 1556.3 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.4±0.07ms 2.9 GB/sec 1.00 12.4±0.09ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.5±0.07ms 2.9 GB/sec 1.00 12.4±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 14.3±0.07ms 2.6 GB/sec 1.00 14.2±0.11ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.06ms 2.9 GB/sec 1.00 12.5±0.09ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 279.9±0.43ms 162.9 MB/sec 1.00 279.3±1.09ms 163.3 MB/sec list_struct_with_list/cdc 1.00 319.9±1.73ms 142.5 MB/sec 1.00 318.7±0.35ms 143.1 MB/sec list_struct_with_list/default 1.00 253.6±0.42ms 179.8 MB/sec 1.00 253.2±0.39ms 180.1 MB/sec list_struct_with_list/parquet_2 1.00 271.2±0.57ms 168.1 MB/sec 1.00 270.4±0.37ms 168.6 MB/sec list_struct_with_list/zstd 1.00 275.6±0.43ms 165.5 MB/sec 1.00 275.0±0.39ms 165.8 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.6±0.58ms 154.8 MB/sec 1.00 293.9±0.40ms 155.1 MB/sec primitive/bloom_filter 1.00 144.5±0.50ms 310.5 MB/sec 1.02 147.6±0.54ms 304.0 MB/sec primitive/cdc 1.00 154.7±0.55ms 290.0 MB/sec 1.01 155.9±0.73ms 287.9 MB/sec primitive/default 1.00 113.5±0.35ms 395.5 MB/sec 1.01 114.5±0.34ms 391.8 MB/sec primitive/parquet_2 1.00 128.4±0.30ms 349.6 MB/sec 1.01 129.4±0.37ms 346.7 MB/sec primitive/zstd 1.00 143.1±0.42ms 313.6 MB/sec 1.01 144.1±0.35ms 311.4 MB/sec primitive/zstd_parquet_2 1.00 161.2±0.33ms 278.4 MB/sec 1.01 162.2±0.36ms 276.6 MB/sec primitive_all_null/bloom_filter 1.01 888.5±9.35µs 49.3 GB/sec 1.00 879.5±3.40µs 49.8 GB/sec primitive_all_null/cdc 1.00 18.3±0.38ms 2.4 GB/sec 1.04 19.0±0.27ms 2.3 GB/sec primitive_all_null/default 1.01 276.7±1.10µs 158.4 GB/sec 1.00 273.8±1.25µs 160.1 GB/sec primitive_all_null/parquet_2 1.00 284.4±1.57µs 154.1 GB/sec 1.00 284.6±1.21µs 154.0 GB/sec primitive_all_null/zstd 1.01 424.9±1.25µs 103.2 GB/sec 1.00 420.9±1.40µs 104.1 GB/sec primitive_all_null/zstd_parquet_2 1.01 385.0±1.44µs 113.8 GB/sec 1.00 380.8±1.49µs 115.1 GB/sec primitive_non_null/bloom_filter 1.00 100.5±0.44ms 437.7 MB/sec 1.03 103.3±0.41ms 426.0 MB/sec primitive_non_null/cdc 1.00 84.8±0.21ms 519.0 MB/sec 1.00 85.1±0.34ms 516.8 MB/sec primitive_non_null/default 1.00 61.9±0.20ms 711.0 MB/sec 1.01 62.2±0.19ms 707.3 MB/sec primitive_non_null/parquet_2 1.00 83.7±0.22ms 525.4 MB/sec 1.00 84.0±0.21ms 523.6 MB/sec primitive_non_null/zstd 1.00 92.3±0.20ms 476.7 MB/sec 1.01 92.8±0.22ms 474.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.4±0.22ms 378.0 MB/sec 1.01 117.0±0.26ms 375.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.3±0.16ms 3.6 GB/sec 1.04 12.9±0.21ms 3.4 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.5±0.36ms 1519.4 MB/sec 1.04 30.8±0.32ms 1458.1 MB/sec primitive_sparse_99pct_null/default 1.00 10.8±0.06ms 4.0 GB/sec 1.03 11.1±0.08ms 3.9 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.05ms 4.0 GB/sec 1.03 11.1±0.08ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.2±0.07ms 3.1 GB/sec 1.01 14.3±0.13ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.05ms 3.4 GB/sec 1.01 12.8±0.12ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.0±0.05ms 445.1 MB/sec 1.05 28.3±0.04ms 423.4 MB/sec short_string_non_null/cdc 1.00 19.7±0.06ms 609.6 MB/sec 1.01 19.8±0.05ms 604.9 MB/sec short_string_non_null/default 1.00 15.7±0.05ms 763.6 MB/sec 1.01 15.8±0.04ms 757.6 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.11ms 463.2 MB/sec 1.01 26.1±0.05ms 460.2 MB/sec short_string_non_null/zstd 1.00 35.8±0.14ms 335.2 MB/sec 1.01 36.1±0.10ms 332.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.09ms 417.3 MB/sec 1.01 29.0±0.04ms 413.9 MB/sec small_string_distinct/delta_byte_array 1.00 964.3±10.53µs 8.1 GB/sec 1.00 967.8±9.11µs 8.1 GB/sec small_string_distinct/plain 1.01 751.0±9.23µs 10.4 GB/sec 1.00 741.7±4.46µs 10.6 GB/sec small_string_partial_prefix/delta_byte_array 1.00 990.4±9.25µs 7.9 GB/sec 1.00 993.9±6.28µs 7.9 GB/sec small_string_partial_prefix/plain 1.00 997.5±10.73µs 7.9 GB/sec 1.01 1008.6±7.24µs 7.8 GB/sec small_string_shared_prefix/delta_byte_array 1.00 980.8±4.79µs 8.0 GB/sec 1.01 987.5±4.85µs 7.9 GB/sec small_string_shared_prefix/plain 1.00 1115.9±15.31µs 7.0 GB/sec 1.00 1111.4±10.04µs 7.1 GB/sec string/bloom_filter 1.00 200.7±18.97ms 2.6 GB/sec 1.09 218.5±22.85ms 2.3 GB/sec string/cdc 1.00 206.3±7.30ms 2.5 GB/sec 1.02 210.0±11.56ms 2.4 GB/sec string/default 1.00 109.6±14.10ms 4.7 GB/sec 1.05 114.8±17.33ms 4.5 GB/sec string/parquet_2 1.60 161.8±0.68ms 3.2 GB/sec 1.00 101.4±8.62ms 5.1 GB/sec string/zstd 1.09 454.8±15.56ms 1152.7 MB/sec 1.00 416.2±1.51ms 1259.6 MB/sec string/zstd_parquet_2 1.03 403.4±0.32ms 1299.6 MB/sec 1.00 391.3±9.41ms 1339.6 MB/sec string_and_binary_view/bloom_filter 1.00 63.2±0.20ms 510.6 MB/sec 1.03 64.8±0.21ms 497.5 MB/sec string_and_binary_view/cdc 1.00 58.8±0.16ms 548.7 MB/sec 1.01 59.3±0.16ms 544.0 MB/sec string_and_binary_view/default 1.00 47.8±0.13ms 675.0 MB/sec 1.02 48.6±0.13ms 663.1 MB/sec string_and_binary_view/parquet_2 1.00 59.0±0.16ms 546.4 MB/sec 1.02 60.0±0.18ms 537.8 MB/sec string_and_binary_view/zstd 1.00 84.8±0.15ms 380.4 MB/sec 1.01 85.7±0.18ms 376.3 MB/sec string_and_binary_view/zstd_parquet_2 1.00 72.9±0.16ms 442.4 MB/sec 1.01 73.8±0.16ms 437.1 MB/sec string_dictionary/bloom_filter 1.00 81.7±0.46ms 3.2 GB/sec 1.07 87.0±0.52ms 3.0 GB/sec string_dictionary/cdc 1.00 45.2±0.52ms 5.7 GB/sec 1.07 48.3±0.37ms 5.3 GB/sec string_dictionary/default 1.00 41.1±0.93ms 6.3 GB/sec 1.07 44.1±0.26ms 5.9 GB/sec string_dictionary/parquet_2 1.00 48.8±0.14ms 5.3 GB/sec 1.00 48.7±0.25ms 5.3 GB/sec string_dictionary/zstd 1.00 204.4±0.97ms 1292.2 MB/sec 1.02 209.1±0.56ms 1263.2 MB/sec string_dictionary/zstd_parquet_2 1.01 193.3±4.12ms 1366.2 MB/sec 1.00 192.0±0.18ms 1375.6 MB/sec string_non_null/bloom_filter 1.00 231.1±17.13ms 2.2 GB/sec 1.01 234.0±12.68ms 2.2 GB/sec string_non_null/cdc 1.00 246.7±3.55ms 2.1 GB/sec 1.02 251.4±3.32ms 2.0 GB/sec string_non_null/default 1.00 116.8±15.31ms 4.4 GB/sec 1.00 117.3±11.11ms 4.4 GB/sec string_non_null/parquet_2 1.00 122.4±13.29ms 4.2 GB/sec 1.04 127.7±6.87ms 4.0 GB/sec string_non_null/zstd 1.00 556.8±7.20ms 941.1 MB/sec 1.00 559.4±6.41ms 936.7 MB/sec string_non_null/zstd_parquet_2 1.00 499.2±12.16ms 1049.6 MB/sec 1.01 502.8±7.22ms 1042.3 MB/sec string_ree/bloom_filter 1.00 149.6±0.75ms 109.7 MB/sec 1.05 157.2±0.87ms 104.4 MB/sec string_ree/cdc 1.17 223.2±0.57ms 73.5 MB/sec 1.00 190.9±3.81ms 86.0 MB/sec string_ree/default 1.00 119.0±1.94ms 137.8 MB/sec 1.08 128.2±0.53ms 127.9 MB/sec string_ree/parquet_2 1.00 128.3±0.48ms 127.9 MB/sec 1.01 129.5±0.44ms 126.7 MB/sec string_ree/zstd 1.00 184.5±0.56ms 88.9 MB/sec 1.02 187.8±0.63ms 87.4 MB/sec string_ree/zstd_parquet_2 1.51 142.9±0.41ms 114.8 MB/sec 1.00 94.7±0.35ms 173.3 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.2±0.16ms 53.6 MB/sec 1.00 26.2±0.11ms 53.6 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.11ms 43.6 MB/sec 1.01 32.7±0.10ms 43.1 MB/sec string_ree_95pct_null/default 1.00 24.7±0.09ms 56.9 MB/sec 1.00 24.7±0.09ms 56.9 MB/sec string_ree_95pct_null/parquet_2 1.00 24.8±0.10ms 56.8 MB/sec 1.00 24.8±0.10ms 56.6 MB/sec string_ree_95pct_null/zstd 1.00 25.6±0.13ms 55.0 MB/sec 1.00 25.6±0.10ms 55.0 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.11ms 55.2 MB/sec 1.00 25.5±0.09ms 55.2 MB/sec struct_all_null/bloom_filter 1.00 369.9±1.66µs 42.6 GB/sec 1.00 369.2±1.39µs 42.6 GB/sec struct_all_null/cdc 1.00 7.4±0.11ms 2.1 GB/sec 1.06 7.9±0.09ms 2.0 GB/sec struct_all_null/default 1.01 118.3±0.51µs 133.1 GB/sec 1.00 116.7±0.72µs 135.0 GB/sec struct_all_null/parquet_2 1.01 122.3±0.64µs 128.7 GB/sec 1.00 120.8±0.67µs 130.4 GB/sec struct_all_null/zstd 1.02 183.0±0.67µs 86.0 GB/sec 1.00 180.2±0.67µs 87.4 GB/sec struct_all_null/zstd_parquet_2 1.01 165.9±0.48µs 94.9 GB/sec 1.00 164.0±0.78µs 96.0 GB/sec struct_non_null/bloom_filter 1.01 43.5±0.24ms 368.2 MB/sec 1.00 43.1±0.21ms 371.3 MB/sec struct_non_null/cdc 1.01 43.1±1.00ms 371.1 MB/sec 1.00 42.8±0.16ms 373.6 MB/sec struct_non_null/default 1.00 29.5±0.09ms 541.6 MB/sec 1.00 29.5±0.11ms 542.6 MB/sec struct_non_null/parquet_2 1.00 38.2±0.09ms 419.0 MB/sec 1.00 38.1±0.08ms 420.5 MB/sec struct_non_null/zstd 1.00 38.1±0.08ms 419.7 MB/sec 1.00 37.9±0.09ms 421.7 MB/sec struct_non_null/zstd_parquet_2 1.00 51.9±0.12ms 308.5 MB/sec 1.00 51.7±0.11ms 309.3 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.03ms 2.4 GB/sec 1.01 6.5±0.05ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.3±0.10ms 1211.0 MB/sec 1.06 14.0±0.13ms 1147.7 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.01 6.0±0.03ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.01 6.0±0.03ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.02ms 2.1 GB/sec 1.00 7.4±0.04ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.00 6.8±0.03ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 2995.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2918.4s | | CPU sys | 74.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3060.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.5 GiB | | CPU user | 2894.7s | | CPU sys | 163.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
