adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5186243904
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5185561005) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (5af13c01ba6f907cf0b0296056ffa536c93b948c) to main [diff](https://github.com/apache/arrow-rs/compare/b5471c192c4a2c1f274f278b6882e5eebefdca9a..5af13c01ba6f907cf0b0296056ffa536c93b948c) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.05ms 19.7 MB/sec 1.00 12.7±0.08ms 19.6 MB/sec bool/cdc 1.00 15.6±0.05ms 16.0 MB/sec 1.00 15.7±0.07ms 15.9 MB/sec bool/default 1.00 10.6±0.05ms 23.7 MB/sec 1.01 10.7±0.07ms 23.4 MB/sec bool/parquet_2 1.00 14.3±0.05ms 17.5 MB/sec 1.01 14.4±0.10ms 17.3 MB/sec bool/zstd 1.00 11.1±0.06ms 22.5 MB/sec 1.00 11.2±0.07ms 22.4 MB/sec bool/zstd_parquet_2 1.00 14.7±0.05ms 17.0 MB/sec 1.01 14.9±0.09ms 16.8 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.1 MB/sec 1.00 6.6±0.03ms 19.1 MB/sec bool_non_null/cdc 1.00 6.4±0.05ms 19.4 MB/sec 1.00 6.4±0.04ms 19.5 MB/sec bool_non_null/default 1.00 3.7±0.03ms 33.5 MB/sec 1.01 3.8±0.02ms 33.3 MB/sec bool_non_null/parquet_2 1.00 8.5±0.03ms 14.7 MB/sec 1.00 8.5±0.04ms 14.7 MB/sec bool_non_null/zstd 1.00 4.1±0.03ms 30.4 MB/sec 1.00 4.1±0.02ms 30.3 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.04ms 14.0 MB/sec 1.00 8.9±0.02ms 14.0 MB/sec bool_ree/bloom_filter 1.00 30.3±0.10ms 7.0 MB/sec 1.00 30.2±0.09ms 7.1 MB/sec bool_ree/cdc 1.01 31.9±0.08ms 6.7 MB/sec 1.00 31.6±0.11ms 6.7 MB/sec bool_ree/default 1.01 27.5±0.09ms 7.7 MB/sec 1.00 27.4±0.08ms 7.8 MB/sec bool_ree/parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.00 29.0±0.08ms 7.3 MB/sec bool_ree/zstd 1.00 28.2±0.10ms 7.6 MB/sec 1.00 28.0±0.08ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.4±0.11ms 7.2 MB/sec 1.00 29.4±0.10ms 7.2 MB/sec decimal/bloom_filter 1.00 125.1±1.45ms 479.7 MB/sec 1.02 127.3±0.90ms 471.5 MB/sec decimal/cdc 1.00 103.2±0.61ms 581.3 MB/sec 1.01 103.8±0.43ms 577.8 MB/sec decimal/default 1.00 81.6±1.07ms 735.3 MB/sec 1.01 82.5±1.67ms 726.9 MB/sec decimal/parquet_2 1.00 180.3±1.28ms 332.7 MB/sec 1.00 180.7±2.52ms 332.0 MB/sec decimal/zstd 1.00 92.6±0.69ms 648.0 MB/sec 1.01 93.5±1.65ms 641.9 MB/sec decimal/zstd_parquet_2 1.00 200.4±1.53ms 299.4 MB/sec 1.00 200.9±1.98ms 298.6 MB/sec fixed_size_binary_ree/bloom_filter 1.00 60.8±0.50ms 16.6 MB/sec 1.00 60.8±0.77ms 16.6 MB/sec fixed_size_binary_ree/cdc 1.00 62.2±0.25ms 16.2 MB/sec 1.01 62.5±0.25ms 16.1 MB/sec fixed_size_binary_ree/default 1.00 52.7±0.31ms 19.1 MB/sec 1.00 52.7±0.97ms 19.1 MB/sec fixed_size_binary_ree/parquet_2 1.00 68.8±0.42ms 14.6 MB/sec 1.01 69.2±1.75ms 14.6 MB/sec fixed_size_binary_ree/zstd 1.00 58.6±0.30ms 17.2 MB/sec 1.00 58.6±0.30ms 17.2 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 69.4±0.51ms 14.5 MB/sec 1.00 69.2±0.99ms 14.5 MB/sec float_with_nans/bloom_filter 1.00 86.0±1.34ms 162.8 MB/sec 1.00 85.7±1.53ms 163.4 MB/sec float_with_nans/cdc 1.00 72.4±0.82ms 193.4 MB/sec 1.00 72.4±1.05ms 193.5 MB/sec float_with_nans/default 1.00 64.9±0.48ms 215.7 MB/sec 1.01 65.5±2.06ms 213.8 MB/sec float_with_nans/parquet_2 1.00 82.8±0.68ms 169.1 MB/sec 1.00 82.8±0.56ms 169.1 MB/sec float_with_nans/zstd 1.00 103.2±0.59ms 135.7 MB/sec 1.01 103.9±1.28ms 134.7 MB/sec float_with_nans/zstd_parquet_2 1.00 119.6±0.57ms 117.0 MB/sec 1.01 120.3±1.62ms 116.4 MB/sec fsb/bloom_filter 1.00 8.8±0.15ms 1834.2 MB/sec 1.00 8.8±0.16ms 1832.5 MB/sec fsb/cdc 1.00 11.1±0.07ms 1458.8 MB/sec 1.01 11.2±0.08ms 1439.6 MB/sec fsb/default 1.01 7.3±0.05ms 2.1 GB/sec 1.00 7.3±0.08ms 2.2 GB/sec fsb/parquet_2 1.00 14.0±0.24ms 1148.7 MB/sec 1.02 14.3±0.31ms 1129.4 MB/sec fsb/zstd 1.01 9.8±0.05ms 1645.8 MB/sec 1.00 9.7±0.06ms 1655.2 MB/sec fsb/zstd_parquet_2 1.00 14.8±0.14ms 1090.2 MB/sec 1.04 15.3±0.26ms 1050.9 MB/sec int32_ree/bloom_filter 1.00 42.2±0.27ms 9.6 MB/sec 1.01 42.5±0.32ms 9.6 MB/sec int32_ree/cdc 1.00 40.8±0.13ms 10.0 MB/sec 1.00 41.0±0.10ms 9.9 MB/sec int32_ree/default 1.00 37.0±0.10ms 11.0 MB/sec 1.00 37.1±0.08ms 11.0 MB/sec int32_ree/parquet_2 1.00 37.1±0.13ms 11.0 MB/sec 1.00 37.1±0.09ms 11.0 MB/sec int32_ree/zstd 1.00 37.5±0.09ms 10.8 MB/sec 1.00 37.6±0.11ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.5±0.10ms 10.8 MB/sec 1.00 37.6±0.12ms 10.8 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.4±0.06ms 18.1 MB/sec 1.00 22.4±0.04ms 18.2 MB/sec int32_ree_95pct_null/cdc 1.00 24.2±0.05ms 16.8 MB/sec 1.01 24.5±0.07ms 16.6 MB/sec int32_ree_95pct_null/default 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.03ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.8±0.03ms 18.6 MB/sec 1.01 22.0±0.05ms 18.5 MB/sec int32_ree_95pct_null/zstd 1.00 22.1±0.04ms 18.4 MB/sec 1.00 22.1±0.04ms 18.4 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 22.0±0.03ms 18.5 MB/sec 1.00 22.0±0.03ms 18.5 MB/sec large_string_distinct/delta_byte_array 1.00 75.2±2.67ms 3.3 GB/sec 1.12 84.1±2.09ms 3.0 GB/sec large_string_distinct/plain 1.00 66.4±1.49ms 3.8 GB/sec 1.00 66.6±2.35ms 3.8 GB/sec large_string_non_null/bloom_filter 1.02 76.5±1.29ms 3.3 GB/sec 1.00 75.0±1.01ms 3.3 GB/sec large_string_non_null/cdc 1.00 247.6±1.20ms 1033.9 MB/sec 1.00 247.8±1.04ms 1033.0 MB/sec large_string_non_null/default 1.02 57.7±0.67ms 4.3 GB/sec 1.00 56.7±0.79ms 4.4 GB/sec large_string_non_null/parquet_2 1.01 57.9±0.90ms 4.3 GB/sec 1.00 57.2±0.73ms 4.4 GB/sec large_string_non_null/zstd 1.03 58.4±0.87ms 4.3 GB/sec 1.00 56.9±0.70ms 4.4 GB/sec large_string_non_null/zstd_parquet_2 1.04 59.2±0.89ms 4.2 GB/sec 1.00 57.0±0.70ms 4.4 GB/sec large_string_shared_prefix/delta_byte_array 1.00 61.7±2.13ms 4.0 GB/sec 2.01 124.1±4.42ms 2.0 GB/sec large_string_shared_prefix/plain 1.01 105.6±3.13ms 2.4 GB/sec 1.00 104.4±2.27ms 2.4 GB/sec list_nested/bloom_filter 1.00 147.0±0.67ms 196.3 MB/sec 1.01 149.1±0.65ms 193.6 MB/sec list_nested/cdc 1.00 163.6±0.57ms 176.4 MB/sec 1.01 164.5±0.62ms 175.4 MB/sec list_nested/default 1.00 131.9±0.43ms 218.8 MB/sec 1.01 132.8±0.45ms 217.3 MB/sec list_nested/parquet_2 1.00 145.2±0.34ms 198.7 MB/sec 1.00 145.5±0.49ms 198.3 MB/sec list_nested/zstd 1.00 141.5±0.49ms 203.9 MB/sec 1.00 142.2±0.62ms 203.0 MB/sec list_nested/zstd_parquet_2 1.00 158.0±0.51ms 182.7 MB/sec 1.00 158.7±0.65ms 181.8 MB/sec list_primitive/bloom_filter 1.05 318.4±6.58ms 1713.0 MB/sec 1.00 303.8±6.30ms 1794.9 MB/sec list_primitive/cdc 1.01 322.4±4.17ms 1691.8 MB/sec 1.00 320.6±2.43ms 1701.3 MB/sec list_primitive/default 1.05 222.0±2.52ms 2.4 GB/sec 1.00 210.5±3.19ms 2.5 GB/sec list_primitive/parquet_2 1.05 240.4±2.28ms 2.2 GB/sec 1.00 229.8±1.45ms 2.3 GB/sec list_primitive/zstd 1.00 468.9±3.78ms 1163.0 MB/sec 1.01 474.5±6.61ms 1149.4 MB/sec list_primitive/zstd_parquet_2 1.02 461.4±1.42ms 1182.0 MB/sec 1.00 453.8±1.56ms 1201.8 MB/sec list_primitive_non_null/bloom_filter 1.11 431.9±15.15ms 1260.2 MB/sec 1.00 387.8±11.60ms 1403.6 MB/sec list_primitive_non_null/cdc 1.00 402.9±8.30ms 1350.8 MB/sec 1.00 403.0±8.55ms 1350.5 MB/sec list_primitive_non_null/default 1.18 270.3±12.35ms 2013.4 MB/sec 1.00 229.7±5.77ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.12 287.4±18.81ms 1893.7 MB/sec 1.00 257.2±4.40ms 2.1 GB/sec list_primitive_non_null/zstd 1.08 709.8±7.79ms 766.8 MB/sec 1.00 654.4±5.14ms 831.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.04 674.5±16.77ms 806.9 MB/sec 1.00 647.7±2.42ms 840.3 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 13.4±0.10ms 2.7 GB/sec 1.00 13.4±0.12ms 2.7 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 25.0±0.10ms 1495.5 MB/sec 1.01 25.1±0.10ms 1487.2 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.9±0.11ms 2.8 GB/sec 1.00 12.9±0.06ms 2.8 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.9±0.09ms 2.8 GB/sec 1.00 13.0±0.08ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.8±0.14ms 2.5 GB/sec 1.01 14.8±0.08ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.1±0.06ms 2.8 GB/sec 1.00 13.1±0.07ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.00 285.2±1.43ms 159.9 MB/sec 1.02 291.2±1.59ms 156.6 MB/sec list_struct_with_list/cdc 1.00 323.4±1.10ms 141.0 MB/sec 1.01 325.8±0.79ms 140.0 MB/sec list_struct_with_list/default 1.00 257.9±0.87ms 176.8 MB/sec 1.00 258.8±0.72ms 176.2 MB/sec list_struct_with_list/parquet_2 1.00 275.4±0.89ms 165.5 MB/sec 1.00 276.4±0.81ms 165.0 MB/sec list_struct_with_list/zstd 1.00 280.1±0.91ms 162.8 MB/sec 1.01 281.5±1.08ms 162.0 MB/sec list_struct_with_list/zstd_parquet_2 1.00 298.8±1.15ms 152.6 MB/sec 1.00 299.7±0.72ms 152.2 MB/sec primitive/bloom_filter 1.00 152.7±1.54ms 293.8 MB/sec 1.02 156.4±1.56ms 287.0 MB/sec primitive/cdc 1.00 158.5±0.95ms 283.0 MB/sec 1.01 160.6±0.88ms 279.5 MB/sec primitive/default 1.00 117.7±0.66ms 381.2 MB/sec 1.02 119.7±0.81ms 375.0 MB/sec primitive/parquet_2 1.00 132.4±0.99ms 338.9 MB/sec 1.02 134.4±1.20ms 333.9 MB/sec primitive/zstd 1.00 147.5±0.78ms 304.3 MB/sec 1.01 149.2±0.73ms 300.7 MB/sec primitive/zstd_parquet_2 1.00 165.4±0.69ms 271.3 MB/sec 1.01 167.2±0.96ms 268.3 MB/sec primitive_all_null/bloom_filter 1.01 938.8±12.12µs 46.7 GB/sec 1.00 929.9±10.49µs 47.1 GB/sec primitive_all_null/cdc 1.00 18.5±0.40ms 2.4 GB/sec 1.04 19.2±0.52ms 2.3 GB/sec primitive_all_null/default 1.01 273.7±1.22µs 160.1 GB/sec 1.00 270.1±1.21µs 162.2 GB/sec primitive_all_null/parquet_2 1.01 281.5±1.22µs 155.7 GB/sec 1.00 277.9±1.51µs 157.7 GB/sec primitive_all_null/zstd 1.01 427.5±1.80µs 102.5 GB/sec 1.00 421.3±1.45µs 104.0 GB/sec primitive_all_null/zstd_parquet_2 1.03 388.0±1.60µs 113.0 GB/sec 1.00 376.1±1.63µs 116.5 GB/sec primitive_non_null/bloom_filter 1.00 107.6±0.91ms 408.9 MB/sec 1.02 109.6±1.51ms 401.3 MB/sec primitive_non_null/cdc 1.00 88.5±0.80ms 496.9 MB/sec 1.01 89.3±0.99ms 492.9 MB/sec primitive_non_null/default 1.00 65.1±0.73ms 675.5 MB/sec 1.00 65.2±0.51ms 675.1 MB/sec primitive_non_null/parquet_2 1.00 86.3±0.57ms 509.6 MB/sec 1.02 88.0±0.91ms 500.1 MB/sec primitive_non_null/zstd 1.00 95.8±0.86ms 459.4 MB/sec 1.01 96.5±0.58ms 456.2 MB/sec primitive_non_null/zstd_parquet_2 1.00 119.5±0.47ms 368.1 MB/sec 1.01 120.4±0.84ms 365.5 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 13.7±0.15ms 3.2 GB/sec 1.01 13.8±0.15ms 3.2 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.7±0.36ms 1460.2 MB/sec 1.04 31.9±0.36ms 1408.4 MB/sec primitive_sparse_99pct_null/default 1.00 11.6±0.11ms 3.8 GB/sec 1.00 11.5±0.07ms 3.8 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.5±0.08ms 3.8 GB/sec 1.00 11.5±0.10ms 3.8 GB/sec primitive_sparse_99pct_null/zstd 1.00 15.0±0.09ms 2.9 GB/sec 1.00 15.0±0.07ms 2.9 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.6±0.07ms 3.2 GB/sec 1.00 13.5±0.09ms 3.3 GB/sec short_string_non_null/bloom_filter 1.00 28.0±0.10ms 429.0 MB/sec 1.01 28.3±0.15ms 423.9 MB/sec short_string_non_null/cdc 1.00 20.3±0.08ms 591.2 MB/sec 1.00 20.3±0.07ms 592.0 MB/sec short_string_non_null/default 1.00 16.1±0.04ms 745.2 MB/sec 1.00 16.1±0.05ms 744.5 MB/sec short_string_non_null/parquet_2 1.01 26.4±0.07ms 454.7 MB/sec 1.00 26.1±0.06ms 459.5 MB/sec short_string_non_null/zstd 1.00 36.3±0.11ms 330.3 MB/sec 1.00 36.3±0.10ms 330.5 MB/sec short_string_non_null/zstd_parquet_2 1.01 29.4±0.12ms 408.7 MB/sec 1.00 29.2±0.13ms 411.1 MB/sec small_string_distinct/delta_byte_array 1.00 1006.8±34.49µs 7.8 GB/sec 1.08 1084.1±49.55µs 7.2 GB/sec small_string_distinct/plain 1.03 831.8±16.89µs 9.4 GB/sec 1.00 808.5±18.48µs 9.7 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1110.7±25.11µs 7.1 GB/sec 1.04 1150.8±51.48µs 6.8 GB/sec small_string_partial_prefix/plain 1.00 1134.6±28.12µs 6.9 GB/sec 1.03 1168.5±49.35µs 6.7 GB/sec small_string_shared_prefix/delta_byte_array 1.01 1031.8±9.23µs 7.6 GB/sec 1.00 1022.9±11.05µs 7.7 GB/sec small_string_shared_prefix/plain 1.01 1199.8±26.76µs 6.5 GB/sec 1.00 1184.6±23.76µs 6.6 GB/sec string/bloom_filter 1.04 247.7±29.63ms 2.1 GB/sec 1.00 237.9±24.72ms 2.2 GB/sec string/cdc 1.00 209.5±1.85ms 2.4 GB/sec 1.02 213.5±6.35ms 2.4 GB/sec string/default 1.03 136.3±23.83ms 3.8 GB/sec 1.00 132.7±23.45ms 3.9 GB/sec string/parquet_2 1.00 111.7±7.52ms 4.6 GB/sec 1.55 173.6±1.40ms 2.9 GB/sec string/zstd 1.00 442.9±8.28ms 1183.8 MB/sec 1.09 483.1±10.43ms 1085.2 MB/sec string/zstd_parquet_2 1.00 394.1±6.59ms 1330.2 MB/sec 1.00 392.3±6.61ms 1336.2 MB/sec string_and_binary_view/bloom_filter 1.02 69.5±1.27ms 464.0 MB/sec 1.00 68.3±1.27ms 472.2 MB/sec string_and_binary_view/cdc 1.00 61.2±1.09ms 527.2 MB/sec 1.01 62.0±0.81ms 520.6 MB/sec string_and_binary_view/default 1.00 50.1±0.75ms 643.8 MB/sec 1.01 50.6±0.58ms 637.1 MB/sec string_and_binary_view/parquet_2 1.00 61.9±1.10ms 521.2 MB/sec 1.01 62.3±0.82ms 517.7 MB/sec string_and_binary_view/zstd 1.00 87.2±0.66ms 369.9 MB/sec 1.01 88.1±0.88ms 366.1 MB/sec string_and_binary_view/zstd_parquet_2 1.00 75.9±0.85ms 425.2 MB/sec 1.00 76.1±0.84ms 423.7 MB/sec string_dictionary/bloom_filter 1.00 94.6±2.98ms 2.7 GB/sec 1.03 97.6±2.89ms 2.6 GB/sec string_dictionary/cdc 1.00 50.6±1.25ms 5.1 GB/sec 1.05 53.3±0.93ms 4.8 GB/sec string_dictionary/default 1.00 43.8±1.54ms 5.9 GB/sec 1.08 47.6±1.25ms 5.4 GB/sec string_dictionary/parquet_2 1.00 49.5±0.46ms 5.2 GB/sec 1.03 51.0±0.75ms 5.1 GB/sec string_dictionary/zstd 1.00 217.0±2.25ms 1217.4 MB/sec 1.00 218.0±1.57ms 1211.7 MB/sec string_dictionary/zstd_parquet_2 1.00 195.1±0.74ms 1353.8 MB/sec 1.00 195.7±0.85ms 1349.7 MB/sec string_non_null/bloom_filter 1.00 263.4±16.21ms 1989.1 MB/sec 1.01 265.1±20.95ms 1976.9 MB/sec string_non_null/cdc 1.03 260.0±3.46ms 2015.4 MB/sec 1.00 251.7±5.26ms 2.0 GB/sec string_non_null/default 1.00 130.7±9.95ms 3.9 GB/sec 1.03 134.5±14.40ms 3.8 GB/sec string_non_null/parquet_2 1.01 114.3±4.31ms 4.5 GB/sec 1.00 113.0±1.45ms 4.5 GB/sec string_non_null/zstd 1.01 558.8±4.72ms 937.7 MB/sec 1.00 553.6±5.26ms 946.5 MB/sec string_non_null/zstd_parquet_2 1.00 501.7±4.10ms 1044.4 MB/sec 1.00 499.8±6.43ms 1048.3 MB/sec string_ree/bloom_filter 1.00 158.9±1.64ms 103.2 MB/sec 1.01 160.1±2.14ms 102.5 MB/sec string_ree/cdc 1.00 227.1±1.61ms 72.2 MB/sec 1.00 227.3±1.81ms 72.2 MB/sec string_ree/default 1.00 129.9±1.67ms 126.3 MB/sec 1.01 131.0±2.49ms 125.2 MB/sec string_ree/parquet_2 1.01 128.3±1.31ms 127.9 MB/sec 1.00 127.3±0.91ms 128.9 MB/sec string_ree/zstd 1.00 193.8±3.03ms 84.7 MB/sec 1.00 193.9±2.36ms 84.6 MB/sec string_ree/zstd_parquet_2 1.01 143.2±1.17ms 114.6 MB/sec 1.00 142.4±1.47ms 115.3 MB/sec string_ree_95pct_null/bloom_filter 1.00 27.2±0.18ms 51.7 MB/sec 1.00 27.2±0.10ms 51.8 MB/sec string_ree_95pct_null/cdc 1.00 33.3±0.13ms 42.3 MB/sec 1.01 33.6±0.14ms 41.8 MB/sec string_ree_95pct_null/default 1.00 25.4±0.12ms 55.4 MB/sec 1.01 25.6±0.16ms 55.1 MB/sec string_ree_95pct_null/parquet_2 1.00 25.4±0.11ms 55.4 MB/sec 1.00 25.5±0.12ms 55.2 MB/sec string_ree_95pct_null/zstd 1.02 26.8±0.85ms 52.4 MB/sec 1.00 26.3±0.17ms 53.5 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 26.2±0.12ms 53.8 MB/sec 1.01 26.3±0.13ms 53.4 MB/sec struct_all_null/bloom_filter 1.01 384.4±2.78µs 41.0 GB/sec 1.00 380.8±3.24µs 41.4 GB/sec struct_all_null/cdc 1.00 7.3±0.14ms 2.1 GB/sec 1.07 7.9±0.14ms 2046.5 MB/sec struct_all_null/default 1.02 118.2±0.67µs 133.2 GB/sec 1.00 115.9±0.57µs 135.8 GB/sec struct_all_null/parquet_2 1.02 122.4±0.56µs 128.6 GB/sec 1.00 120.4±0.80µs 130.8 GB/sec struct_all_null/zstd 1.01 183.3±0.66µs 85.9 GB/sec 1.00 180.7±0.97µs 87.2 GB/sec struct_all_null/zstd_parquet_2 1.03 166.6±0.74µs 94.5 GB/sec 1.00 161.4±0.89µs 97.5 GB/sec struct_non_null/bloom_filter 1.00 46.7±0.84ms 342.9 MB/sec 1.02 47.5±0.78ms 337.0 MB/sec struct_non_null/cdc 1.00 44.3±0.32ms 361.4 MB/sec 1.01 44.6±0.34ms 358.9 MB/sec struct_non_null/default 1.00 30.9±0.35ms 518.4 MB/sec 1.00 31.0±0.25ms 516.9 MB/sec struct_non_null/parquet_2 1.00 39.3±0.30ms 406.9 MB/sec 1.01 39.6±0.28ms 403.9 MB/sec struct_non_null/zstd 1.00 39.6±0.24ms 404.0 MB/sec 1.01 40.0±0.41ms 400.5 MB/sec struct_non_null/zstd_parquet_2 1.00 53.3±0.38ms 300.3 MB/sec 1.00 53.4±0.29ms 299.7 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 7.2±0.08ms 2.2 GB/sec 1.01 7.3±0.09ms 2.2 GB/sec struct_sparse_99pct_null/cdc 1.00 14.0±0.14ms 1150.6 MB/sec 1.05 14.7±0.13ms 1098.3 MB/sec struct_sparse_99pct_null/default 1.01 6.4±0.07ms 2.5 GB/sec 1.00 6.4±0.07ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.5±0.06ms 2.4 GB/sec 1.00 6.4±0.06ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.7±0.05ms 2.0 GB/sec 1.00 7.8±0.05ms 2.0 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.2±0.05ms 2.2 GB/sec 1.00 7.2±0.06ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3060.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2972.9s | | CPU sys | 83.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3065.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2962.9s | | CPU sys | 95.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
