adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5186236091
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5185561213) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (5af13c01ba6f907cf0b0296056ffa536c93b948c) to main [diff](https://github.com/apache/arrow-rs/compare/b5471c192c4a2c1f274f278b6882e5eebefdca9a..5af13c01ba6f907cf0b0296056ffa536c93b948c) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.10ms 19.8 MB/sec 1.00 12.6±0.06ms 19.9 MB/sec bool/cdc 1.02 15.6±0.12ms 16.0 MB/sec 1.00 15.3±0.11ms 16.4 MB/sec bool/default 1.01 10.5±0.08ms 23.8 MB/sec 1.00 10.4±0.06ms 24.0 MB/sec bool/parquet_2 1.00 14.3±0.05ms 17.5 MB/sec 1.00 14.2±0.07ms 17.6 MB/sec bool/zstd 1.00 11.0±0.06ms 22.7 MB/sec 1.00 11.0±0.03ms 22.8 MB/sec bool/zstd_parquet_2 1.00 14.7±0.05ms 17.1 MB/sec 1.00 14.6±0.06ms 17.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.2 MB/sec 1.00 6.5±0.03ms 19.2 MB/sec bool_non_null/cdc 1.00 6.3±0.07ms 19.9 MB/sec 1.01 6.3±0.05ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.3 MB/sec 1.00 3.8±0.02ms 33.3 MB/sec bool_non_null/parquet_2 1.00 8.5±0.03ms 14.7 MB/sec 1.00 8.5±0.04ms 14.7 MB/sec bool_non_null/zstd 1.01 4.1±0.03ms 30.2 MB/sec 1.00 4.1±0.02ms 30.5 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.03ms 14.0 MB/sec 1.00 8.9±0.03ms 14.0 MB/sec bool_ree/bloom_filter 1.01 30.2±0.08ms 7.0 MB/sec 1.00 30.1±0.07ms 7.1 MB/sec bool_ree/cdc 1.01 31.6±0.12ms 6.7 MB/sec 1.00 31.3±0.10ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.06ms 7.8 MB/sec 1.00 27.3±0.07ms 7.8 MB/sec bool_ree/parquet_2 1.00 29.0±0.07ms 7.3 MB/sec 1.00 28.9±0.04ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.06ms 7.6 MB/sec 1.00 27.9±0.08ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.07ms 7.3 MB/sec 1.00 29.2±0.07ms 7.3 MB/sec decimal/bloom_filter 1.01 121.3±1.92ms 494.6 MB/sec 1.00 119.8±1.56ms 500.8 MB/sec decimal/cdc 1.00 102.3±0.89ms 586.5 MB/sec 1.00 102.0±0.52ms 588.4 MB/sec decimal/default 1.00 80.1±0.99ms 749.2 MB/sec 1.00 80.1±0.90ms 748.8 MB/sec decimal/parquet_2 1.01 179.7±2.04ms 333.8 MB/sec 1.00 177.4±1.79ms 338.3 MB/sec decimal/zstd 1.00 90.8±0.75ms 661.1 MB/sec 1.00 90.9±0.82ms 660.1 MB/sec decimal/zstd_parquet_2 1.00 197.8±1.59ms 303.4 MB/sec 1.00 197.0±2.12ms 304.5 MB/sec fixed_size_binary_ree/bloom_filter 1.00 59.0±0.75ms 17.1 MB/sec 1.00 58.8±1.22ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.9±0.38ms 16.3 MB/sec 1.00 62.0±0.29ms 16.2 MB/sec fixed_size_binary_ree/default 1.01 52.2±0.40ms 19.3 MB/sec 1.00 51.7±0.30ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 67.1±0.93ms 15.0 MB/sec 1.00 66.8±0.79ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.01 58.1±0.54ms 17.3 MB/sec 1.00 57.4±0.36ms 17.6 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.01 68.3±1.10ms 14.8 MB/sec 1.00 67.6±0.77ms 14.9 MB/sec float_with_nans/bloom_filter 1.00 81.2±1.10ms 172.5 MB/sec 1.00 81.4±1.08ms 171.9 MB/sec float_with_nans/cdc 1.01 71.4±1.13ms 196.1 MB/sec 1.00 70.8±0.83ms 197.9 MB/sec float_with_nans/default 1.00 63.4±0.68ms 220.8 MB/sec 1.00 63.1±0.74ms 221.8 MB/sec float_with_nans/parquet_2 1.01 81.3±0.85ms 172.2 MB/sec 1.00 80.8±1.68ms 173.2 MB/sec float_with_nans/zstd 1.00 101.8±1.03ms 137.5 MB/sec 1.00 101.7±0.71ms 137.7 MB/sec float_with_nans/zstd_parquet_2 1.00 118.3±0.74ms 118.4 MB/sec 1.00 117.7±0.79ms 119.0 MB/sec fsb/bloom_filter 1.01 8.3±0.19ms 1945.8 MB/sec 1.00 8.2±0.29ms 1972.3 MB/sec fsb/cdc 1.01 10.8±0.25ms 1486.8 MB/sec 1.00 10.7±0.24ms 1507.5 MB/sec fsb/default 1.01 7.1±0.15ms 2.2 GB/sec 1.00 7.1±0.15ms 2.2 GB/sec fsb/parquet_2 1.03 13.8±0.42ms 1171.5 MB/sec 1.00 13.3±0.36ms 1209.7 MB/sec fsb/zstd 1.00 9.5±0.15ms 1704.6 MB/sec 1.00 9.5±0.17ms 1704.3 MB/sec fsb/zstd_parquet_2 1.01 14.4±0.29ms 1118.7 MB/sec 1.00 14.3±0.58ms 1126.1 MB/sec int32_ree/bloom_filter 1.00 41.2±0.72ms 9.9 MB/sec 1.01 41.5±0.70ms 9.8 MB/sec int32_ree/cdc 1.00 40.3±0.20ms 10.1 MB/sec 1.01 40.7±0.24ms 10.0 MB/sec int32_ree/default 1.00 36.5±0.19ms 11.1 MB/sec 1.01 36.9±0.16ms 11.0 MB/sec int32_ree/parquet_2 1.00 36.7±0.23ms 11.1 MB/sec 1.01 37.0±0.19ms 11.0 MB/sec int32_ree/zstd 1.00 37.1±0.17ms 11.0 MB/sec 1.01 37.5±0.16ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.21ms 11.0 MB/sec 1.01 37.3±0.19ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.2±0.19ms 18.3 MB/sec 1.00 22.2±0.18ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.17ms 17.0 MB/sec 1.01 24.3±0.14ms 16.7 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.11ms 18.7 MB/sec 1.00 21.7±0.09ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.08ms 18.8 MB/sec 1.00 21.7±0.08ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 22.0±0.10ms 18.5 MB/sec 1.00 21.9±0.07ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.09ms 18.6 MB/sec 1.00 21.9±0.07ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.00 69.3±5.68ms 3.6 GB/sec 1.09 75.4±2.01ms 3.3 GB/sec large_string_distinct/plain 1.00 60.9±1.57ms 4.1 GB/sec 1.01 61.7±2.66ms 4.1 GB/sec large_string_non_null/bloom_filter 1.01 74.3±1.64ms 3.4 GB/sec 1.00 73.5±0.80ms 3.4 GB/sec large_string_non_null/cdc 1.00 245.8±2.09ms 1041.4 MB/sec 1.00 245.1±1.07ms 1044.3 MB/sec large_string_non_null/default 1.01 55.9±0.71ms 4.5 GB/sec 1.00 55.3±0.64ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.6±0.66ms 4.5 GB/sec 1.01 56.0±0.51ms 4.5 GB/sec large_string_non_null/zstd 1.01 56.0±0.90ms 4.5 GB/sec 1.00 55.6±0.66ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.03 57.5±1.62ms 4.4 GB/sec 1.00 55.9±0.69ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 56.5±1.91ms 4.4 GB/sec 1.96 110.7±7.09ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 95.8±6.04ms 2.6 GB/sec 1.00 95.7±5.24ms 2.6 GB/sec list_nested/bloom_filter 1.00 145.7±0.87ms 198.1 MB/sec 1.00 146.1±0.90ms 197.5 MB/sec list_nested/cdc 1.00 161.7±0.74ms 178.4 MB/sec 1.01 163.1±0.46ms 176.9 MB/sec list_nested/default 1.00 130.9±0.79ms 220.4 MB/sec 1.00 131.2±0.66ms 220.0 MB/sec list_nested/parquet_2 1.00 143.8±0.60ms 200.7 MB/sec 1.00 144.5±0.42ms 199.7 MB/sec list_nested/zstd 1.00 140.1±0.94ms 205.9 MB/sec 1.00 140.5±0.48ms 205.4 MB/sec list_nested/zstd_parquet_2 1.00 156.6±0.78ms 184.3 MB/sec 1.01 157.4±0.51ms 183.3 MB/sec list_primitive/bloom_filter 1.02 285.6±9.86ms 1909.6 MB/sec 1.00 280.1±3.95ms 1947.2 MB/sec list_primitive/cdc 1.01 313.8±3.60ms 1737.9 MB/sec 1.00 311.3±2.86ms 1751.6 MB/sec list_primitive/default 1.03 205.2±3.92ms 2.6 GB/sec 1.00 199.9±2.32ms 2.7 GB/sec list_primitive/parquet_2 1.01 226.6±1.73ms 2.4 GB/sec 1.00 225.3±0.97ms 2.4 GB/sec list_primitive/zstd 1.01 461.5±6.89ms 1181.6 MB/sec 1.00 455.8±4.49ms 1196.6 MB/sec list_primitive/zstd_parquet_2 1.00 448.4±2.06ms 1216.3 MB/sec 1.00 447.8±1.74ms 1217.9 MB/sec list_primitive_non_null/bloom_filter 1.00 366.7±17.01ms 1484.2 MB/sec 1.05 384.5±10.94ms 1415.3 MB/sec list_primitive_non_null/cdc 1.00 389.4±7.55ms 1397.7 MB/sec 1.01 392.4±5.85ms 1386.9 MB/sec list_primitive_non_null/default 1.00 228.5±6.03ms 2.3 GB/sec 1.07 244.1±5.35ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.00 261.6±6.05ms 2.0 GB/sec 1.23 322.5±25.26ms 1687.3 MB/sec list_primitive_non_null/zstd 1.01 647.0±10.52ms 841.2 MB/sec 1.00 637.9±6.51ms 853.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.04 651.8±3.77ms 835.0 MB/sec 1.00 624.3±2.48ms 871.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.03 13.2±0.36ms 2.8 GB/sec 1.00 12.9±0.27ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.4±0.36ms 1530.7 MB/sec 1.01 24.7±0.30ms 1514.7 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.5±0.22ms 2.9 GB/sec 1.00 12.6±0.16ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.6±0.23ms 2.9 GB/sec 1.00 12.6±0.21ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 14.6±0.28ms 2.5 GB/sec 1.00 14.4±0.24ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.30ms 2.9 GB/sec 1.00 12.8±0.14ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 282.2±2.70ms 161.6 MB/sec 1.02 286.5±4.39ms 159.1 MB/sec list_struct_with_list/cdc 1.00 320.4±3.01ms 142.3 MB/sec 1.01 324.0±2.03ms 140.7 MB/sec list_struct_with_list/default 1.00 254.8±1.33ms 179.0 MB/sec 1.01 256.5±0.90ms 177.8 MB/sec list_struct_with_list/parquet_2 1.00 272.9±1.96ms 167.1 MB/sec 1.02 278.9±0.48ms 163.5 MB/sec list_struct_with_list/zstd 1.00 277.0±2.70ms 164.6 MB/sec 1.03 284.2±0.58ms 160.5 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.6±2.09ms 154.3 MB/sec 1.02 302.4±1.51ms 150.8 MB/sec primitive/bloom_filter 1.00 149.1±2.78ms 301.0 MB/sec 1.00 148.7±2.28ms 301.9 MB/sec primitive/cdc 1.00 156.1±1.95ms 287.4 MB/sec 1.00 156.2±1.38ms 287.3 MB/sec primitive/default 1.00 115.1±1.32ms 390.0 MB/sec 1.00 115.4±1.07ms 389.0 MB/sec primitive/parquet_2 1.00 130.1±1.66ms 345.0 MB/sec 1.00 130.2±0.98ms 344.8 MB/sec primitive/zstd 1.00 145.0±1.65ms 309.5 MB/sec 1.00 145.1±1.12ms 309.2 MB/sec primitive/zstd_parquet_2 1.00 163.2±1.56ms 275.0 MB/sec 1.00 162.7±1.07ms 275.8 MB/sec primitive_all_null/bloom_filter 1.01 899.6±20.69µs 48.7 GB/sec 1.00 893.5±13.10µs 49.0 GB/sec primitive_all_null/cdc 1.00 18.4±0.29ms 2.4 GB/sec 1.03 18.9±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 272.7±1.39µs 160.7 GB/sec 1.00 272.4±1.47µs 160.9 GB/sec primitive_all_null/parquet_2 1.00 281.9±1.40µs 155.5 GB/sec 1.00 280.7±1.68µs 156.1 GB/sec primitive_all_null/zstd 1.01 426.3±1.78µs 102.8 GB/sec 1.00 421.7±1.39µs 103.9 GB/sec primitive_all_null/zstd_parquet_2 1.03 386.3±1.51µs 113.4 GB/sec 1.00 375.6±1.55µs 116.7 GB/sec primitive_non_null/bloom_filter 1.01 105.2±2.44ms 418.1 MB/sec 1.00 103.7±1.41ms 424.2 MB/sec primitive_non_null/cdc 1.01 86.4±1.30ms 509.2 MB/sec 1.00 85.4±0.88ms 515.3 MB/sec primitive_non_null/default 1.00 63.5±1.44ms 692.6 MB/sec 1.00 63.6±0.64ms 691.7 MB/sec primitive_non_null/parquet_2 1.01 85.2±1.13ms 516.7 MB/sec 1.00 84.7±0.83ms 519.4 MB/sec primitive_non_null/zstd 1.00 94.1±1.57ms 467.5 MB/sec 1.00 94.1±0.88ms 467.7 MB/sec primitive_non_null/zstd_parquet_2 1.01 118.2±1.27ms 372.3 MB/sec 1.00 117.6±0.79ms 374.2 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.64ms 3.5 GB/sec 1.00 12.7±0.56ms 3.4 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.8±0.48ms 1505.6 MB/sec 1.06 31.6±0.73ms 1421.6 MB/sec primitive_sparse_99pct_null/default 1.02 11.2±0.29ms 3.9 GB/sec 1.00 11.0±0.23ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.03 11.1±0.28ms 3.9 GB/sec 1.00 10.8±0.19ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.5±0.30ms 3.0 GB/sec 1.00 14.5±0.23ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.1±0.38ms 3.3 GB/sec 1.00 13.0±0.25ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.6±0.28ms 435.0 MB/sec 1.01 27.7±0.13ms 432.5 MB/sec short_string_non_null/cdc 1.01 20.0±0.18ms 601.5 MB/sec 1.00 19.8±0.19ms 606.0 MB/sec short_string_non_null/default 1.00 15.7±0.13ms 764.5 MB/sec 1.00 15.8±0.18ms 761.2 MB/sec short_string_non_null/parquet_2 1.00 26.1±0.12ms 460.4 MB/sec 1.00 26.0±0.11ms 461.8 MB/sec short_string_non_null/zstd 1.00 36.0±0.19ms 333.4 MB/sec 1.00 36.0±0.25ms 333.7 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.16ms 414.7 MB/sec 1.01 29.1±0.11ms 411.9 MB/sec small_string_distinct/delta_byte_array 1.03 991.2±54.11µs 7.9 GB/sec 1.00 965.3±33.78µs 8.1 GB/sec small_string_distinct/plain 1.05 773.7±34.59µs 10.1 GB/sec 1.00 738.0±50.31µs 10.6 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1056.8±46.71µs 7.4 GB/sec 1.00 1055.7±48.04µs 7.4 GB/sec small_string_partial_prefix/plain 1.01 1034.8±88.85µs 7.6 GB/sec 1.00 1022.0±89.40µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.00 971.2±11.14µs 8.1 GB/sec 1.02 992.2±20.91µs 7.9 GB/sec small_string_shared_prefix/plain 1.06 1107.0±20.03µs 7.1 GB/sec 1.00 1040.2±18.51µs 7.5 GB/sec string/bloom_filter 1.02 230.3±25.83ms 2.2 GB/sec 1.00 225.9±24.97ms 2.3 GB/sec string/cdc 1.00 204.3±3.23ms 2.5 GB/sec 1.01 207.0±7.57ms 2.5 GB/sec string/default 1.04 131.7±23.57ms 3.9 GB/sec 1.00 126.9±18.83ms 4.0 GB/sec string/parquet_2 1.00 108.7±7.69ms 4.7 GB/sec 1.52 165.7±2.75ms 3.1 GB/sec string/zstd 1.00 443.1±9.28ms 1183.2 MB/sec 1.05 464.9±11.45ms 1127.6 MB/sec string/zstd_parquet_2 1.00 390.1±7.82ms 1343.8 MB/sec 1.13 439.8±2.86ms 1191.9 MB/sec string_and_binary_view/bloom_filter 1.00 65.4±1.48ms 492.9 MB/sec 1.00 65.4±1.14ms 493.2 MB/sec string_and_binary_view/cdc 1.01 59.6±0.55ms 540.8 MB/sec 1.00 59.3±0.53ms 543.8 MB/sec string_and_binary_view/default 1.01 48.8±0.75ms 660.6 MB/sec 1.00 48.5±0.39ms 665.2 MB/sec string_and_binary_view/parquet_2 1.00 59.9±0.48ms 538.3 MB/sec 1.00 59.7±0.41ms 540.2 MB/sec string_and_binary_view/zstd 1.01 86.2±1.27ms 374.2 MB/sec 1.00 85.6±0.66ms 376.8 MB/sec string_and_binary_view/zstd_parquet_2 1.01 74.5±1.38ms 432.6 MB/sec 1.00 73.9±0.69ms 436.5 MB/sec string_dictionary/bloom_filter 1.00 87.1±2.34ms 3.0 GB/sec 1.01 88.0±2.56ms 2.9 GB/sec string_dictionary/cdc 1.00 46.9±1.83ms 5.5 GB/sec 1.00 46.8±1.16ms 5.5 GB/sec string_dictionary/default 1.00 43.5±1.71ms 5.9 GB/sec 1.00 43.5±1.19ms 5.9 GB/sec string_dictionary/parquet_2 1.03 49.4±1.27ms 5.2 GB/sec 1.00 48.1±0.41ms 5.4 GB/sec string_dictionary/zstd 1.00 207.5±3.19ms 1273.1 MB/sec 1.02 210.8±3.41ms 1253.2 MB/sec string_dictionary/zstd_parquet_2 1.00 192.7±1.12ms 1370.5 MB/sec 1.00 193.2±0.99ms 1367.1 MB/sec string_non_null/bloom_filter 1.00 241.0±16.23ms 2.1 GB/sec 1.01 243.1±21.49ms 2.1 GB/sec string_non_null/cdc 1.00 248.3±5.72ms 2.1 GB/sec 1.01 250.2±4.63ms 2.0 GB/sec string_non_null/default 1.00 125.2±10.57ms 4.1 GB/sec 1.09 136.7±30.57ms 3.7 GB/sec string_non_null/parquet_2 1.20 129.8±5.82ms 3.9 GB/sec 1.00 108.3±4.31ms 4.7 GB/sec string_non_null/zstd 1.06 561.0±11.53ms 934.0 MB/sec 1.00 530.9±6.76ms 987.0 MB/sec string_non_null/zstd_parquet_2 1.00 491.1±5.60ms 1067.0 MB/sec 1.02 499.7±2.63ms 1048.7 MB/sec string_ree/bloom_filter 1.00 150.6±3.48ms 108.9 MB/sec 1.03 155.1±4.13ms 105.8 MB/sec string_ree/cdc 1.00 217.4±2.75ms 75.5 MB/sec 1.03 223.0±3.84ms 73.6 MB/sec string_ree/default 1.00 121.7±2.97ms 134.8 MB/sec 1.04 126.1±3.97ms 130.1 MB/sec string_ree/parquet_2 1.00 127.7±3.04ms 128.5 MB/sec 1.01 128.4±4.18ms 127.8 MB/sec string_ree/zstd 1.00 182.2±4.17ms 90.0 MB/sec 1.03 187.9±4.63ms 87.3 MB/sec string_ree/zstd_parquet_2 1.00 141.0±2.69ms 116.3 MB/sec 1.01 141.8±3.99ms 115.7 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.7±0.47ms 52.6 MB/sec 1.00 26.6±0.39ms 52.9 MB/sec string_ree_95pct_null/cdc 1.00 32.6±0.44ms 43.1 MB/sec 1.02 33.1±0.27ms 42.4 MB/sec string_ree_95pct_null/default 1.00 25.1±0.34ms 56.0 MB/sec 1.00 25.1±0.26ms 56.2 MB/sec string_ree_95pct_null/parquet_2 1.00 25.0±0.29ms 56.3 MB/sec 1.00 25.1±0.24ms 56.0 MB/sec string_ree_95pct_null/zstd 1.01 26.1±0.38ms 54.0 MB/sec 1.00 25.9±0.30ms 54.3 MB/sec string_ree_95pct_null/zstd_parquet_2 1.02 25.9±0.32ms 54.3 MB/sec 1.00 25.5±0.10ms 55.2 MB/sec struct_all_null/bloom_filter 1.00 377.2±2.40µs 41.8 GB/sec 1.00 378.3±6.37µs 41.6 GB/sec struct_all_null/cdc 1.00 7.3±0.07ms 2.2 GB/sec 1.07 7.8±0.16ms 2.0 GB/sec struct_all_null/default 1.00 116.7±0.67µs 134.9 GB/sec 1.00 116.8±0.53µs 134.8 GB/sec struct_all_null/parquet_2 1.02 122.2±0.60µs 128.9 GB/sec 1.00 120.0±0.60µs 131.3 GB/sec struct_all_null/zstd 1.03 184.4±0.75µs 85.4 GB/sec 1.00 178.7±0.59µs 88.1 GB/sec struct_all_null/zstd_parquet_2 1.03 164.9±0.60µs 95.5 GB/sec 1.00 160.4±0.71µs 98.2 GB/sec struct_non_null/bloom_filter 1.01 45.0±0.57ms 355.9 MB/sec 1.00 44.4±0.63ms 360.6 MB/sec struct_non_null/cdc 1.00 43.4±0.46ms 368.5 MB/sec 1.00 43.5±0.32ms 367.5 MB/sec struct_non_null/default 1.01 30.2±0.28ms 530.6 MB/sec 1.00 29.9±0.25ms 535.6 MB/sec struct_non_null/parquet_2 1.01 38.9±0.35ms 411.7 MB/sec 1.00 38.5±0.25ms 415.9 MB/sec struct_non_null/zstd 1.01 38.9±0.67ms 411.3 MB/sec 1.00 38.5±0.29ms 416.0 MB/sec struct_non_null/zstd_parquet_2 1.00 52.1±0.13ms 306.8 MB/sec 1.00 52.2±0.28ms 306.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.02 6.8±0.34ms 2.3 GB/sec 1.00 6.6±0.25ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.25ms 1191.5 MB/sec 1.05 14.2±0.27ms 1133.9 MB/sec struct_sparse_99pct_null/default 1.00 6.1±0.13ms 2.6 GB/sec 1.00 6.1±0.15ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.16ms 2.6 GB/sec 1.00 6.1±0.15ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.01 7.6±0.23ms 2.1 GB/sec 1.00 7.6±0.13ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.13ms 2.3 GB/sec 1.01 6.9±0.16ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3045.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 2933.9s | | CPU sys | 106.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3005.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2920.5s | | CPU sys | 81.0s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
