adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5186241637
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5185561100) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (5af13c01ba6f907cf0b0296056ffa536c93b948c) to main [diff](https://github.com/apache/arrow-rs/compare/b5471c192c4a2c1f274f278b6882e5eebefdca9a..5af13c01ba6f907cf0b0296056ffa536c93b948c) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.02 13.0±0.17ms 19.2 MB/sec 1.00 12.8±0.11ms 19.5 MB/sec bool/cdc 1.02 15.9±0.12ms 15.7 MB/sec 1.00 15.7±0.13ms 15.9 MB/sec bool/default 1.02 10.9±0.14ms 23.0 MB/sec 1.00 10.7±0.10ms 23.4 MB/sec bool/parquet_2 1.01 14.7±0.14ms 17.0 MB/sec 1.00 14.6±0.09ms 17.2 MB/sec bool/zstd 1.02 11.4±0.15ms 21.9 MB/sec 1.00 11.2±0.10ms 22.4 MB/sec bool/zstd_parquet_2 1.02 15.1±0.15ms 16.5 MB/sec 1.00 14.8±0.09ms 16.9 MB/sec bool_non_null/bloom_filter 1.01 6.6±0.05ms 19.0 MB/sec 1.00 6.5±0.02ms 19.2 MB/sec bool_non_null/cdc 1.00 6.4±0.07ms 19.6 MB/sec 1.00 6.4±0.10ms 19.6 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.3 MB/sec 1.01 3.8±0.03ms 33.0 MB/sec bool_non_null/parquet_2 1.00 8.5±0.03ms 14.7 MB/sec 1.00 8.5±0.03ms 14.7 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.4 MB/sec 1.00 4.1±0.01ms 30.5 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.04ms 14.0 MB/sec 1.00 8.9±0.04ms 14.0 MB/sec bool_ree/bloom_filter 1.01 30.6±0.14ms 6.9 MB/sec 1.00 30.4±0.15ms 7.0 MB/sec bool_ree/cdc 1.01 32.1±0.15ms 6.6 MB/sec 1.00 31.7±0.20ms 6.7 MB/sec bool_ree/default 1.01 28.0±0.14ms 7.6 MB/sec 1.00 27.7±0.14ms 7.7 MB/sec bool_ree/parquet_2 1.01 29.5±0.15ms 7.2 MB/sec 1.00 29.3±0.16ms 7.3 MB/sec bool_ree/zstd 1.01 28.5±0.15ms 7.5 MB/sec 1.00 28.3±0.14ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.01 29.8±0.15ms 7.1 MB/sec 1.00 29.6±0.16ms 7.2 MB/sec decimal/bloom_filter 1.00 121.2±2.27ms 494.9 MB/sec 1.01 122.2±1.15ms 491.2 MB/sec decimal/cdc 1.00 102.1±0.79ms 587.5 MB/sec 1.02 103.7±1.44ms 578.7 MB/sec decimal/default 1.00 80.1±2.33ms 748.9 MB/sec 1.00 80.4±0.49ms 746.1 MB/sec decimal/parquet_2 1.00 179.5±3.43ms 334.2 MB/sec 1.00 179.7±2.48ms 333.9 MB/sec decimal/zstd 1.00 91.6±2.18ms 654.7 MB/sec 1.03 94.5±3.64ms 635.1 MB/sec decimal/zstd_parquet_2 1.00 198.4±2.10ms 302.5 MB/sec 1.02 202.1±4.07ms 296.8 MB/sec fixed_size_binary_ree/bloom_filter 1.00 59.7±1.54ms 16.9 MB/sec 1.07 63.6±2.21ms 15.8 MB/sec fixed_size_binary_ree/cdc 1.00 62.4±0.32ms 16.1 MB/sec 1.00 62.2±0.28ms 16.2 MB/sec fixed_size_binary_ree/default 1.01 52.3±1.39ms 19.3 MB/sec 1.00 52.0±0.33ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.01 68.5±1.46ms 14.7 MB/sec 1.00 68.1±1.12ms 14.8 MB/sec fixed_size_binary_ree/zstd 1.02 58.9±0.53ms 17.1 MB/sec 1.00 57.6±0.35ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.7±0.45ms 14.9 MB/sec 1.02 69.1±1.70ms 14.6 MB/sec float_with_nans/bloom_filter 1.07 88.2±5.22ms 158.7 MB/sec 1.00 82.5±1.67ms 169.7 MB/sec float_with_nans/cdc 1.02 72.0±1.56ms 194.6 MB/sec 1.00 70.7±0.98ms 198.0 MB/sec float_with_nans/default 1.00 63.4±1.08ms 220.9 MB/sec 1.01 64.0±1.52ms 218.8 MB/sec float_with_nans/parquet_2 1.05 85.5±3.15ms 163.8 MB/sec 1.00 81.7±1.25ms 171.3 MB/sec float_with_nans/zstd 1.00 101.6±1.09ms 137.8 MB/sec 1.01 102.1±1.21ms 137.1 MB/sec float_with_nans/zstd_parquet_2 1.00 118.7±1.84ms 117.9 MB/sec 1.00 118.3±1.27ms 118.3 MB/sec fsb/bloom_filter 1.00 8.2±0.11ms 1956.1 MB/sec 1.01 8.3±0.23ms 1945.8 MB/sec fsb/cdc 1.00 10.7±0.09ms 1510.4 MB/sec 1.03 11.0±0.40ms 1462.7 MB/sec fsb/default 1.05 7.4±0.28ms 2.1 GB/sec 1.00 7.1±0.08ms 2.2 GB/sec fsb/parquet_2 1.00 13.5±0.17ms 1193.0 MB/sec 1.00 13.5±0.10ms 1197.0 MB/sec fsb/zstd 1.02 9.7±0.20ms 1654.2 MB/sec 1.00 9.5±0.08ms 1689.0 MB/sec fsb/zstd_parquet_2 1.00 14.4±0.10ms 1117.2 MB/sec 1.01 14.6±0.47ms 1104.3 MB/sec int32_ree/bloom_filter 1.00 41.4±0.44ms 9.8 MB/sec 1.01 42.0±0.58ms 9.7 MB/sec int32_ree/cdc 1.00 40.7±0.30ms 10.0 MB/sec 1.01 41.1±0.26ms 9.9 MB/sec int32_ree/default 1.00 36.8±0.12ms 11.1 MB/sec 1.01 37.2±0.20ms 10.9 MB/sec int32_ree/parquet_2 1.00 36.7±0.13ms 11.1 MB/sec 1.01 37.1±0.17ms 11.0 MB/sec int32_ree/zstd 1.00 37.5±0.12ms 10.9 MB/sec 1.00 37.6±0.16ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.3±0.17ms 10.9 MB/sec 1.01 37.7±0.21ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.2±0.10ms 18.4 MB/sec 1.01 22.3±0.21ms 18.2 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.05ms 17.0 MB/sec 1.02 24.4±0.17ms 16.7 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.04ms 18.7 MB/sec 1.01 21.8±0.11ms 18.6 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.7±0.04ms 18.8 MB/sec 1.00 21.7±0.05ms 18.7 MB/sec int32_ree_95pct_null/zstd 1.00 22.0±0.07ms 18.5 MB/sec 1.00 22.0±0.07ms 18.5 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.9±0.05ms 18.6 MB/sec 1.01 22.0±0.11ms 18.5 MB/sec large_string_distinct/delta_byte_array 1.00 70.6±7.46ms 3.5 GB/sec 1.09 76.7±1.96ms 3.3 GB/sec large_string_distinct/plain 1.07 67.1±4.41ms 3.7 GB/sec 1.00 62.5±2.38ms 4.0 GB/sec large_string_non_null/bloom_filter 1.02 76.2±2.98ms 3.3 GB/sec 1.00 74.6±2.96ms 3.3 GB/sec large_string_non_null/cdc 1.00 249.0±3.28ms 1028.0 MB/sec 1.00 248.1±4.19ms 1031.8 MB/sec large_string_non_null/default 1.06 59.9±2.92ms 4.2 GB/sec 1.00 56.8±3.62ms 4.4 GB/sec large_string_non_null/parquet_2 1.04 60.0±2.92ms 4.2 GB/sec 1.00 57.6±3.28ms 4.3 GB/sec large_string_non_null/zstd 1.03 56.8±1.23ms 4.4 GB/sec 1.00 54.9±0.46ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.09 59.9±3.80ms 4.2 GB/sec 1.00 55.0±0.61ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 56.3±1.48ms 4.4 GB/sec 2.12 119.1±12.49ms 2.1 GB/sec large_string_shared_prefix/plain 1.00 94.1±1.69ms 2.7 GB/sec 1.00 94.6±1.34ms 2.6 GB/sec list_nested/bloom_filter 1.00 145.1±0.71ms 198.8 MB/sec 1.01 146.6±1.11ms 196.8 MB/sec list_nested/cdc 1.00 162.1±0.94ms 178.0 MB/sec 1.01 163.3±0.56ms 176.8 MB/sec list_nested/default 1.00 131.2±0.96ms 219.9 MB/sec 1.00 131.5±0.55ms 219.4 MB/sec list_nested/parquet_2 1.00 144.5±1.13ms 199.8 MB/sec 1.00 145.0±1.24ms 198.9 MB/sec list_nested/zstd 1.00 140.6±1.21ms 205.2 MB/sec 1.01 141.4±1.08ms 204.1 MB/sec list_nested/zstd_parquet_2 1.00 157.3±1.18ms 183.4 MB/sec 1.00 157.5±0.62ms 183.2 MB/sec list_primitive/bloom_filter 1.01 299.6±14.59ms 1820.2 MB/sec 1.00 295.4±26.86ms 1846.3 MB/sec list_primitive/cdc 1.00 321.2±8.70ms 1698.0 MB/sec 1.00 320.9±7.41ms 1699.4 MB/sec list_primitive/default 1.05 216.8±2.90ms 2.5 GB/sec 1.00 206.4±5.11ms 2.6 GB/sec list_primitive/parquet_2 1.07 242.1±4.21ms 2.2 GB/sec 1.00 226.9±2.51ms 2.3 GB/sec list_primitive/zstd 1.00 457.5±6.66ms 1191.9 MB/sec 1.02 465.8±9.01ms 1170.9 MB/sec list_primitive/zstd_parquet_2 1.00 460.7±4.25ms 1183.7 MB/sec 1.00 459.1±12.28ms 1187.8 MB/sec list_primitive_non_null/bloom_filter 1.00 383.7±9.43ms 1418.3 MB/sec 1.01 386.4±29.21ms 1408.5 MB/sec list_primitive_non_null/cdc 1.00 393.3±10.27ms 1383.9 MB/sec 1.02 402.1±12.85ms 1353.4 MB/sec list_primitive_non_null/default 1.15 269.5±17.39ms 2019.5 MB/sec 1.00 233.8±11.41ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.10 289.5±24.16ms 1879.6 MB/sec 1.00 263.7±4.98ms 2.0 GB/sec list_primitive_non_null/zstd 1.07 703.3±14.80ms 773.9 MB/sec 1.00 657.0±17.44ms 828.4 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 635.8±19.02ms 856.0 MB/sec 1.03 656.1±14.98ms 829.5 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 13.1±0.23ms 2.8 GB/sec 1.04 13.6±0.27ms 2.7 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.9±0.30ms 1501.8 MB/sec 1.01 25.3±0.30ms 1479.7 MB/sec list_primitive_sparse_99pct_null/default 1.01 13.0±0.28ms 2.8 GB/sec 1.00 12.8±0.21ms 2.8 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 13.1±0.44ms 2.8 GB/sec 1.02 13.4±0.28ms 2.7 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.5±0.19ms 2.5 GB/sec 1.01 14.7±0.26ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.13ms 2.8 GB/sec 1.02 13.1±0.27ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.00 283.8±3.36ms 160.6 MB/sec 1.01 287.6±3.16ms 158.6 MB/sec list_struct_with_list/cdc 1.00 323.5±3.99ms 140.9 MB/sec 1.00 322.8±1.05ms 141.2 MB/sec list_struct_with_list/default 1.00 256.1±1.55ms 178.0 MB/sec 1.01 258.8±4.34ms 176.2 MB/sec list_struct_with_list/parquet_2 1.00 273.1±1.79ms 166.9 MB/sec 1.01 274.8±1.64ms 165.9 MB/sec list_struct_with_list/zstd 1.00 278.4±3.04ms 163.8 MB/sec 1.00 278.7±1.23ms 163.6 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.8±1.03ms 154.2 MB/sec 1.01 298.8±3.07ms 152.6 MB/sec primitive/bloom_filter 1.00 148.6±4.00ms 302.0 MB/sec 1.02 151.1±3.47ms 297.1 MB/sec primitive/cdc 1.00 159.3±1.93ms 281.6 MB/sec 1.00 159.4±1.70ms 281.6 MB/sec primitive/default 1.00 116.7±2.99ms 384.5 MB/sec 1.01 117.7±2.02ms 381.2 MB/sec primitive/parquet_2 1.00 130.4±1.73ms 344.2 MB/sec 1.02 132.9±1.63ms 337.6 MB/sec primitive/zstd 1.00 145.8±2.05ms 307.7 MB/sec 1.03 150.1±4.80ms 299.0 MB/sec primitive/zstd_parquet_2 1.00 163.2±1.00ms 275.0 MB/sec 1.02 166.8±2.97ms 269.0 MB/sec primitive_all_null/bloom_filter 1.00 899.7±21.45µs 48.7 GB/sec 1.00 901.5±18.70µs 48.6 GB/sec primitive_all_null/cdc 1.00 18.4±0.27ms 2.4 GB/sec 1.03 19.0±0.29ms 2.3 GB/sec primitive_all_null/default 1.01 273.2±1.39µs 160.4 GB/sec 1.00 271.2±1.38µs 161.6 GB/sec primitive_all_null/parquet_2 1.01 282.8±1.20µs 154.9 GB/sec 1.00 279.3±1.45µs 156.9 GB/sec primitive_all_null/zstd 1.01 426.0±1.39µs 102.9 GB/sec 1.00 422.0±1.61µs 103.8 GB/sec primitive_all_null/zstd_parquet_2 1.03 386.1±1.36µs 113.5 GB/sec 1.00 375.7±1.78µs 116.6 GB/sec primitive_non_null/bloom_filter 1.00 105.4±5.17ms 417.4 MB/sec 1.02 107.7±5.01ms 408.5 MB/sec primitive_non_null/cdc 1.00 85.9±1.15ms 512.5 MB/sec 1.00 86.1±0.72ms 511.3 MB/sec primitive_non_null/default 1.00 64.5±1.87ms 682.3 MB/sec 1.00 64.3±1.77ms 684.6 MB/sec primitive_non_null/parquet_2 1.03 88.4±3.21ms 497.5 MB/sec 1.00 85.8±1.12ms 512.8 MB/sec primitive_non_null/zstd 1.00 93.6±0.87ms 470.2 MB/sec 1.02 95.7±3.20ms 460.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 118.2±1.58ms 372.3 MB/sec 1.01 119.7±1.79ms 367.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 13.0±0.23ms 3.4 GB/sec 1.02 13.2±0.56ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 31.0±0.71ms 1448.1 MB/sec 1.01 31.3±0.51ms 1435.9 MB/sec primitive_sparse_99pct_null/default 1.00 11.2±0.13ms 3.9 GB/sec 1.03 11.5±0.37ms 3.8 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.2±0.18ms 3.9 GB/sec 1.01 11.3±0.29ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.7±0.20ms 3.0 GB/sec 1.00 14.5±0.18ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.1±0.14ms 3.3 GB/sec 1.02 13.4±0.31ms 3.3 GB/sec short_string_non_null/bloom_filter 1.05 29.1±0.69ms 412.6 MB/sec 1.00 27.7±0.15ms 432.9 MB/sec short_string_non_null/cdc 1.01 20.3±0.13ms 590.2 MB/sec 1.00 20.2±0.14ms 593.8 MB/sec short_string_non_null/default 1.02 16.4±0.29ms 733.4 MB/sec 1.00 16.0±0.08ms 750.6 MB/sec short_string_non_null/parquet_2 1.01 26.3±0.10ms 455.7 MB/sec 1.00 26.0±0.20ms 461.7 MB/sec short_string_non_null/zstd 1.00 36.3±0.13ms 330.6 MB/sec 1.00 36.2±0.16ms 331.8 MB/sec short_string_non_null/zstd_parquet_2 1.01 29.3±0.09ms 410.1 MB/sec 1.00 29.1±0.23ms 412.6 MB/sec small_string_distinct/delta_byte_array 1.02 1023.7±62.76µs 7.7 GB/sec 1.00 1005.8±23.68µs 7.8 GB/sec small_string_distinct/plain 1.00 770.0±17.73µs 10.2 GB/sec 1.04 798.3±38.67µs 9.8 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1039.2±31.38µs 7.5 GB/sec 1.11 1150.9±156.83µs 6.8 GB/sec small_string_partial_prefix/plain 1.28 1307.4±191.17µs 6.0 GB/sec 1.00 1019.8±13.03µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.00 990.2±9.00µs 7.9 GB/sec 1.04 1031.6±69.50µs 7.6 GB/sec small_string_shared_prefix/plain 1.00 1152.9±51.98µs 6.8 GB/sec 1.34 1545.6±246.82µs 5.1 GB/sec string/bloom_filter 1.07 236.8±31.52ms 2.2 GB/sec 1.00 222.1±31.90ms 2.3 GB/sec string/cdc 1.00 209.0±3.98ms 2.4 GB/sec 1.00 209.7±8.55ms 2.4 GB/sec string/default 1.09 136.2±26.16ms 3.8 GB/sec 1.00 125.0±20.50ms 4.1 GB/sec string/parquet_2 1.00 110.8±7.96ms 4.6 GB/sec 1.55 171.4±6.23ms 3.0 GB/sec string/zstd 1.00 439.0±14.62ms 1194.2 MB/sec 1.10 482.2±15.91ms 1087.2 MB/sec string/zstd_parquet_2 1.01 395.2±7.58ms 1326.4 MB/sec 1.00 392.4±9.01ms 1336.1 MB/sec string_and_binary_view/bloom_filter 1.16 75.8±3.51ms 425.3 MB/sec 1.00 65.3±1.05ms 494.1 MB/sec string_and_binary_view/cdc 1.01 61.0±0.48ms 528.6 MB/sec 1.00 60.3±1.62ms 534.9 MB/sec string_and_binary_view/default 1.00 50.1±0.60ms 644.0 MB/sec 1.01 50.5±2.81ms 638.3 MB/sec string_and_binary_view/parquet_2 1.00 61.5±0.50ms 524.7 MB/sec 1.01 61.9±2.10ms 520.6 MB/sec string_and_binary_view/zstd 1.03 88.7±1.70ms 363.4 MB/sec 1.00 86.1±0.64ms 374.6 MB/sec string_and_binary_view/zstd_parquet_2 1.04 76.8±2.20ms 420.0 MB/sec 1.00 74.2±0.36ms 434.9 MB/sec string_dictionary/bloom_filter 1.06 93.3±6.75ms 2.8 GB/sec 1.00 87.8±1.53ms 2.9 GB/sec string_dictionary/cdc 1.06 51.6±2.86ms 5.0 GB/sec 1.00 48.9±2.82ms 5.3 GB/sec string_dictionary/default 1.06 47.2±3.76ms 5.5 GB/sec 1.00 44.6±0.65ms 5.8 GB/sec string_dictionary/parquet_2 1.02 50.7±1.55ms 5.1 GB/sec 1.00 49.8±1.48ms 5.2 GB/sec string_dictionary/zstd 1.03 217.9±6.43ms 1212.0 MB/sec 1.00 211.9±2.85ms 1246.6 MB/sec string_dictionary/zstd_parquet_2 1.01 196.1±3.13ms 1347.2 MB/sec 1.00 194.3±2.03ms 1359.4 MB/sec string_non_null/bloom_filter 1.01 255.1±18.63ms 2.0 GB/sec 1.00 251.3±45.06ms 2.0 GB/sec string_non_null/cdc 1.02 258.9±8.53ms 2023.7 MB/sec 1.00 253.4±5.63ms 2.0 GB/sec string_non_null/default 1.06 124.5±14.73ms 4.1 GB/sec 1.00 117.6±15.14ms 4.4 GB/sec string_non_null/parquet_2 1.00 123.5±9.39ms 4.1 GB/sec 1.11 137.1±10.07ms 3.7 GB/sec string_non_null/zstd 1.00 553.3±12.91ms 947.1 MB/sec 1.05 578.4±28.11ms 906.0 MB/sec string_non_null/zstd_parquet_2 1.00 494.9±3.98ms 1058.8 MB/sec 1.03 507.5±9.73ms 1032.4 MB/sec string_ree/bloom_filter 1.03 158.1±6.00ms 103.8 MB/sec 1.00 152.9±1.71ms 107.3 MB/sec string_ree/cdc 1.03 228.3±6.76ms 71.9 MB/sec 1.00 220.9±2.17ms 74.3 MB/sec string_ree/default 1.00 125.4±0.94ms 130.8 MB/sec 1.00 125.5±3.82ms 130.7 MB/sec string_ree/parquet_2 1.04 130.4±3.42ms 125.9 MB/sec 1.00 124.9±1.97ms 131.4 MB/sec string_ree/zstd 1.00 190.0±4.85ms 86.4 MB/sec 1.02 193.8±14.96ms 84.7 MB/sec string_ree/zstd_parquet_2 1.04 145.9±2.99ms 112.4 MB/sec 1.00 140.7±3.34ms 116.6 MB/sec string_ree_95pct_null/bloom_filter 1.00 27.0±0.45ms 52.1 MB/sec 1.03 27.7±0.40ms 50.7 MB/sec string_ree_95pct_null/cdc 1.00 32.8±0.17ms 42.9 MB/sec 1.02 33.5±0.31ms 42.0 MB/sec string_ree_95pct_null/default 1.03 25.8±0.40ms 54.4 MB/sec 1.00 25.1±0.11ms 56.1 MB/sec string_ree_95pct_null/parquet_2 1.01 25.5±0.38ms 55.3 MB/sec 1.00 25.2±0.22ms 55.7 MB/sec string_ree_95pct_null/zstd 1.01 26.2±0.36ms 53.7 MB/sec 1.00 25.9±0.14ms 54.3 MB/sec string_ree_95pct_null/zstd_parquet_2 1.01 25.9±0.27ms 54.2 MB/sec 1.00 25.8±0.11ms 54.5 MB/sec struct_all_null/bloom_filter 1.00 370.2±3.33µs 42.5 GB/sec 1.01 374.9±1.36µs 42.0 GB/sec struct_all_null/cdc 1.00 7.4±0.08ms 2.1 GB/sec 1.06 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.01 118.1±0.63µs 133.3 GB/sec 1.00 116.9±0.59µs 134.7 GB/sec struct_all_null/parquet_2 1.02 122.3±0.63µs 128.8 GB/sec 1.00 120.1±0.71µs 131.1 GB/sec struct_all_null/zstd 1.02 184.0±0.61µs 85.6 GB/sec 1.00 180.4±0.67µs 87.3 GB/sec struct_all_null/zstd_parquet_2 1.04 166.4±0.72µs 94.6 GB/sec 1.00 160.5±0.84µs 98.1 GB/sec struct_non_null/bloom_filter 1.00 45.5±1.89ms 351.9 MB/sec 1.10 50.1±3.70ms 319.4 MB/sec struct_non_null/cdc 1.00 44.9±0.94ms 356.7 MB/sec 1.04 46.7±1.80ms 342.9 MB/sec struct_non_null/default 1.00 29.8±0.16ms 536.2 MB/sec 1.03 30.8±0.83ms 519.7 MB/sec struct_non_null/parquet_2 1.00 38.8±0.86ms 412.8 MB/sec 1.01 39.3±0.84ms 407.5 MB/sec struct_non_null/zstd 1.00 39.7±1.52ms 403.4 MB/sec 1.02 40.4±1.82ms 396.2 MB/sec struct_non_null/zstd_parquet_2 1.00 52.4±0.64ms 305.6 MB/sec 1.01 52.7±0.22ms 303.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.19ms 2.3 GB/sec 1.00 6.7±0.12ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.6±0.19ms 1184.1 MB/sec 1.08 14.8±0.32ms 1091.9 MB/sec struct_sparse_99pct_null/default 1.03 6.3±0.20ms 2.5 GB/sec 1.00 6.2±0.15ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.15ms 2.6 GB/sec 1.02 6.2±0.14ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.10ms 2.1 GB/sec 1.00 7.5±0.14ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.0±0.13ms 2.3 GB/sec 1.00 6.9±0.08ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3065.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2972.2s | | CPU sys | 90.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3040.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2940.3s | | CPU sys | 94.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
