adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5189166118
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5188253266) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to main [diff](https://github.com/apache/arrow-rs/compare/291efc247b9639c0bf87d2621f679b6cce4942bf..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "main" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.11ms 19.7 MB/sec 1.00 12.7±0.07ms 19.7 MB/sec bool/cdc 1.02 15.5±0.09ms 16.1 MB/sec 1.00 15.3±0.08ms 16.4 MB/sec bool/default 1.00 10.5±0.10ms 23.7 MB/sec 1.00 10.6±0.06ms 23.6 MB/sec bool/parquet_2 1.07 14.4±0.09ms 17.4 MB/sec 1.00 13.5±0.06ms 18.5 MB/sec bool/zstd 1.00 11.1±0.08ms 22.6 MB/sec 1.00 11.1±0.06ms 22.6 MB/sec bool/zstd_parquet_2 1.06 14.7±0.09ms 17.0 MB/sec 1.00 13.9±0.06ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.2 MB/sec 1.03 6.7±0.03ms 18.7 MB/sec bool_non_null/cdc 1.00 6.3±0.05ms 19.9 MB/sec 1.02 6.4±0.02ms 19.4 MB/sec bool_non_null/default 1.00 3.7±0.03ms 33.4 MB/sec 1.05 3.9±0.03ms 31.9 MB/sec bool_non_null/parquet_2 1.10 8.5±0.05ms 14.7 MB/sec 1.00 7.7±0.03ms 16.3 MB/sec bool_non_null/zstd 1.00 4.1±0.04ms 30.5 MB/sec 1.04 4.3±0.02ms 29.3 MB/sec bool_non_null/zstd_parquet_2 1.10 8.9±0.05ms 14.0 MB/sec 1.00 8.1±0.02ms 15.4 MB/sec bool_ree/bloom_filter 1.00 30.1±0.12ms 7.1 MB/sec 1.00 30.1±0.08ms 7.1 MB/sec bool_ree/cdc 1.00 31.5±0.12ms 6.7 MB/sec 1.00 31.4±0.13ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.11ms 7.8 MB/sec 1.00 27.4±0.10ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.09ms 7.4 MB/sec 1.00 28.9±0.12ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.11ms 7.6 MB/sec 1.00 28.0±0.11ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.09ms 7.3 MB/sec 1.00 29.2±0.13ms 7.3 MB/sec decimal/bloom_filter 1.00 118.4±1.09ms 506.9 MB/sec 1.00 118.0±0.42ms 508.4 MB/sec decimal/cdc 1.01 101.2±0.31ms 592.6 MB/sec 1.00 100.1±0.34ms 599.2 MB/sec decimal/default 1.01 78.7±1.06ms 761.9 MB/sec 1.00 78.0±0.38ms 769.7 MB/sec decimal/parquet_2 1.01 177.2±1.57ms 338.6 MB/sec 1.00 175.7±1.68ms 341.6 MB/sec decimal/zstd 1.00 88.9±0.31ms 674.8 MB/sec 1.00 88.7±1.56ms 676.1 MB/sec decimal/zstd_parquet_2 1.01 197.0±1.65ms 304.6 MB/sec 1.00 195.3±2.49ms 307.3 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.1±0.27ms 17.3 MB/sec 1.00 58.2±0.29ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.21ms 16.3 MB/sec 1.00 61.5±0.30ms 16.4 MB/sec fixed_size_binary_ree/default 1.00 51.5±0.21ms 19.6 MB/sec 1.00 51.5±0.28ms 19.6 MB/sec fixed_size_binary_ree/parquet_2 1.02 66.1±0.96ms 15.2 MB/sec 1.00 64.6±0.32ms 15.6 MB/sec fixed_size_binary_ree/zstd 1.00 57.2±0.22ms 17.6 MB/sec 1.00 57.3±0.28ms 17.6 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.02 66.6±0.26ms 15.1 MB/sec 1.00 65.2±0.32ms 15.5 MB/sec float_with_nans/bloom_filter 1.01 80.3±1.03ms 174.4 MB/sec 1.00 79.3±0.32ms 176.5 MB/sec float_with_nans/cdc 1.02 70.2±0.26ms 199.6 MB/sec 1.00 69.1±0.77ms 202.7 MB/sec float_with_nans/default 1.02 62.8±1.01ms 222.9 MB/sec 1.00 61.6±0.26ms 227.2 MB/sec float_with_nans/parquet_2 1.04 80.7±1.72ms 173.4 MB/sec 1.00 77.3±0.27ms 181.0 MB/sec float_with_nans/zstd 1.01 100.8±0.17ms 138.9 MB/sec 1.00 100.0±0.25ms 140.0 MB/sec float_with_nans/zstd_parquet_2 1.03 117.2±1.02ms 119.4 MB/sec 1.00 114.2±0.27ms 122.6 MB/sec fsb/bloom_filter 1.01 8.2±0.10ms 1967.3 MB/sec 1.00 8.2±0.09ms 1978.0 MB/sec fsb/cdc 1.00 10.5±0.06ms 1543.0 MB/sec 1.01 10.6±0.08ms 1526.0 MB/sec fsb/default 1.01 7.1±0.05ms 2.2 GB/sec 1.00 7.0±0.07ms 2.2 GB/sec fsb/parquet_2 1.01 13.4±0.09ms 1199.9 MB/sec 1.00 13.3±0.11ms 1216.3 MB/sec fsb/zstd 1.00 9.5±0.06ms 1704.7 MB/sec 1.02 9.6±0.07ms 1678.1 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.09ms 1133.3 MB/sec 1.00 14.2±0.09ms 1132.4 MB/sec int32_ree/bloom_filter 1.02 40.3±0.23ms 10.1 MB/sec 1.00 39.3±0.25ms 10.3 MB/sec int32_ree/cdc 1.03 40.2±0.11ms 10.1 MB/sec 1.00 39.1±0.14ms 10.4 MB/sec int32_ree/default 1.04 36.6±0.17ms 11.1 MB/sec 1.00 35.3±0.12ms 11.5 MB/sec int32_ree/parquet_2 1.03 36.5±0.12ms 11.1 MB/sec 1.00 35.3±0.14ms 11.5 MB/sec int32_ree/zstd 1.03 37.0±0.12ms 11.0 MB/sec 1.00 35.9±0.13ms 11.3 MB/sec int32_ree/zstd_parquet_2 1.03 37.0±0.11ms 11.0 MB/sec 1.00 35.8±0.13ms 11.4 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.05ms 18.5 MB/sec 1.00 21.9±0.06ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.07ms 17.0 MB/sec 1.01 24.1±0.05ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.04ms 18.8 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.04ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.7 MB/sec 1.00 21.7±0.04ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 63.6±0.76ms 3.9 GB/sec 1.17 74.3±0.92ms 3.4 GB/sec large_string_distinct/plain 1.00 59.9±1.07ms 4.2 GB/sec 1.01 60.3±1.33ms 4.1 GB/sec large_string_non_null/bloom_filter 1.01 73.3±0.15ms 3.4 GB/sec 1.00 72.4±0.14ms 3.5 GB/sec large_string_non_null/cdc 1.01 245.1±1.09ms 1044.5 MB/sec 1.00 242.9±0.69ms 1053.8 MB/sec large_string_non_null/default 1.03 55.4±0.14ms 4.5 GB/sec 1.00 54.0±0.12ms 4.6 GB/sec large_string_non_null/parquet_2 1.03 55.5±0.13ms 4.5 GB/sec 1.00 54.0±0.11ms 4.6 GB/sec large_string_non_null/zstd 1.03 55.5±0.11ms 4.5 GB/sec 1.00 54.0±0.14ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.03 55.5±0.14ms 4.5 GB/sec 1.00 54.1±0.12ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.6±0.48ms 4.6 GB/sec 1.96 107.1±1.19ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 92.1±1.02ms 2.7 GB/sec 1.01 92.8±0.99ms 2.7 GB/sec list_nested/bloom_filter 1.00 145.0±0.23ms 199.1 MB/sec 1.00 144.3±0.56ms 200.0 MB/sec list_nested/cdc 1.00 161.8±0.25ms 178.4 MB/sec 1.00 161.2±0.22ms 179.0 MB/sec list_nested/default 1.00 130.6±0.17ms 220.9 MB/sec 1.00 130.0±0.18ms 221.9 MB/sec list_nested/parquet_2 1.01 143.9±0.20ms 200.6 MB/sec 1.00 142.9±0.18ms 201.9 MB/sec list_nested/zstd 1.01 139.8±0.19ms 206.5 MB/sec 1.00 139.0±0.20ms 207.6 MB/sec list_nested/zstd_parquet_2 1.01 156.6±0.21ms 184.2 MB/sec 1.00 155.7±0.20ms 185.4 MB/sec list_primitive/bloom_filter 1.00 274.8±1.23ms 1984.3 MB/sec 1.06 292.4±2.58ms 1865.1 MB/sec list_primitive/cdc 1.00 311.9±1.18ms 1748.6 MB/sec 1.03 320.8±10.87ms 1700.1 MB/sec list_primitive/default 1.00 199.3±2.05ms 2.7 GB/sec 1.08 215.2±2.07ms 2.5 GB/sec list_primitive/parquet_2 1.00 224.3±0.35ms 2.4 GB/sec 1.04 234.2±0.71ms 2.3 GB/sec list_primitive/zstd 1.00 451.9±2.29ms 1206.8 MB/sec 1.01 455.4±1.18ms 1197.6 MB/sec list_primitive/zstd_parquet_2 1.00 445.7±0.39ms 1223.7 MB/sec 1.02 455.3±0.71ms 1197.9 MB/sec list_primitive_non_null/bloom_filter 1.00 384.3±12.21ms 1416.1 MB/sec 1.10 422.4±17.85ms 1288.4 MB/sec list_primitive_non_null/cdc 1.00 392.1±11.09ms 1388.0 MB/sec 1.01 394.2±9.34ms 1380.6 MB/sec list_primitive_non_null/default 1.00 258.6±6.94ms 2.1 GB/sec 1.11 287.0±19.02ms 1896.4 MB/sec list_primitive_non_null/parquet_2 1.01 268.3±17.83ms 2028.3 MB/sec 1.00 266.6±18.42ms 2041.7 MB/sec list_primitive_non_null/zstd 1.00 686.4±4.87ms 792.9 MB/sec 1.04 714.6±16.92ms 761.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 652.8±13.56ms 833.7 MB/sec 1.08 702.5±5.51ms 774.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.01 12.8±0.06ms 2.9 GB/sec 1.00 12.6±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.3±0.09ms 1539.3 MB/sec 1.00 24.0±0.08ms 1554.0 MB/sec list_primitive_sparse_99pct_null/default 1.01 12.4±0.04ms 2.9 GB/sec 1.00 12.3±0.07ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.5±0.04ms 2.9 GB/sec 1.00 12.3±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.07ms 2.6 GB/sec 1.00 14.2±0.07ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.06ms 2.9 GB/sec 1.00 12.4±0.05ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 279.7±0.42ms 163.0 MB/sec 1.00 280.9±0.55ms 162.3 MB/sec list_struct_with_list/cdc 1.00 318.7±0.44ms 143.1 MB/sec 1.00 318.3±1.64ms 143.3 MB/sec list_struct_with_list/default 1.01 254.0±0.74ms 179.5 MB/sec 1.00 252.6±0.48ms 180.5 MB/sec list_struct_with_list/parquet_2 1.00 271.1±0.41ms 168.2 MB/sec 1.00 270.0±0.47ms 168.9 MB/sec list_struct_with_list/zstd 1.00 275.4±0.38ms 165.6 MB/sec 1.00 274.4±0.45ms 166.2 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.2±0.45ms 155.0 MB/sec 1.00 293.2±0.51ms 155.5 MB/sec primitive/bloom_filter 1.03 147.2±0.96ms 304.9 MB/sec 1.00 143.6±0.57ms 312.5 MB/sec primitive/cdc 1.01 154.9±0.72ms 289.7 MB/sec 1.00 153.0±3.00ms 293.2 MB/sec primitive/default 1.04 115.2±0.83ms 389.7 MB/sec 1.00 110.5±0.49ms 406.0 MB/sec primitive/parquet_2 1.04 130.1±0.81ms 344.9 MB/sec 1.00 125.7±0.62ms 357.1 MB/sec primitive/zstd 1.03 145.1±1.17ms 309.3 MB/sec 1.00 140.4±0.52ms 319.7 MB/sec primitive/zstd_parquet_2 1.03 163.4±0.87ms 274.6 MB/sec 1.00 158.4±0.52ms 283.3 MB/sec primitive_all_null/bloom_filter 1.00 887.1±4.69µs 49.4 GB/sec 1.00 891.2±5.99µs 49.2 GB/sec primitive_all_null/cdc 1.00 18.2±0.23ms 2.4 GB/sec 1.05 19.2±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 276.1±1.27µs 158.7 GB/sec 1.00 276.6±1.95µs 158.4 GB/sec primitive_all_null/parquet_2 1.00 285.7±1.37µs 153.4 GB/sec 1.00 284.3±1.65µs 154.2 GB/sec primitive_all_null/zstd 1.00 424.2±1.25µs 103.3 GB/sec 1.01 428.5±1.98µs 102.3 GB/sec primitive_all_null/zstd_parquet_2 1.00 388.0±1.16µs 112.9 GB/sec 1.00 386.3±1.49µs 113.5 GB/sec primitive_non_null/bloom_filter 1.04 103.8±4.31ms 424.1 MB/sec 1.00 100.1±0.44ms 439.8 MB/sec primitive_non_null/cdc 1.06 86.7±0.41ms 507.4 MB/sec 1.00 81.8±0.35ms 537.9 MB/sec primitive_non_null/default 1.05 62.5±0.36ms 704.2 MB/sec 1.00 59.3±0.25ms 742.4 MB/sec primitive_non_null/parquet_2 1.04 84.3±0.28ms 521.9 MB/sec 1.00 81.3±0.24ms 541.3 MB/sec primitive_non_null/zstd 1.04 93.7±0.26ms 469.7 MB/sec 1.00 90.2±0.27ms 487.7 MB/sec primitive_non_null/zstd_parquet_2 1.03 117.7±0.24ms 373.8 MB/sec 1.00 114.7±0.24ms 383.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.2±0.08ms 3.6 GB/sec 1.00 12.1±0.12ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.4±0.25ms 1525.4 MB/sec 1.04 30.5±0.34ms 1469.5 MB/sec primitive_sparse_99pct_null/default 1.01 10.7±0.04ms 4.1 GB/sec 1.00 10.6±0.06ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.02 10.8±0.05ms 4.1 GB/sec 1.00 10.6±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.01 14.2±0.06ms 3.1 GB/sec 1.00 14.0±0.09ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.7±0.06ms 3.4 GB/sec 1.00 12.5±0.07ms 3.5 GB/sec short_string_non_null/bloom_filter 1.02 27.9±0.21ms 429.7 MB/sec 1.00 27.4±0.06ms 438.4 MB/sec short_string_non_null/cdc 1.00 19.9±0.06ms 603.3 MB/sec 1.00 19.9±0.08ms 603.5 MB/sec short_string_non_null/default 1.00 15.8±0.06ms 759.1 MB/sec 1.00 15.8±0.07ms 757.9 MB/sec short_string_non_null/parquet_2 1.01 26.2±0.11ms 457.6 MB/sec 1.00 26.0±0.09ms 461.5 MB/sec short_string_non_null/zstd 1.00 36.1±0.06ms 332.8 MB/sec 1.00 36.0±0.10ms 333.3 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.0±0.07ms 413.2 MB/sec 1.00 28.9±0.10ms 414.6 MB/sec small_string_distinct/delta_byte_array 1.00 971.6±10.67µs 8.1 GB/sec 1.00 968.4±9.09µs 8.1 GB/sec small_string_distinct/plain 1.02 759.3±8.55µs 10.3 GB/sec 1.00 746.2±4.72µs 10.5 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1004.7±7.92µs 7.8 GB/sec 1.00 1002.0±6.67µs 7.8 GB/sec small_string_partial_prefix/plain 1.01 1015.3±9.88µs 7.7 GB/sec 1.00 1001.5±5.67µs 7.8 GB/sec small_string_shared_prefix/delta_byte_array 1.00 973.9±5.20µs 8.1 GB/sec 1.02 990.2±2.05µs 7.9 GB/sec small_string_shared_prefix/plain 1.02 1140.3±13.42µs 6.9 GB/sec 1.00 1118.1±9.55µs 7.0 GB/sec string/bloom_filter 1.03 216.9±26.35ms 2.4 GB/sec 1.00 209.7±21.94ms 2.4 GB/sec string/cdc 1.02 209.6±7.05ms 2.4 GB/sec 1.00 206.4±9.98ms 2.5 GB/sec string/default 1.00 112.8±14.68ms 4.5 GB/sec 1.14 128.7±23.67ms 4.0 GB/sec string/parquet_2 1.00 103.0±6.98ms 5.0 GB/sec 1.12 115.0±1.38ms 4.5 GB/sec string/zstd 1.00 417.8±1.04ms 1254.8 MB/sec 1.12 466.2±12.13ms 1124.6 MB/sec string/zstd_parquet_2 1.00 383.9±0.31ms 1365.6 MB/sec 1.16 445.2±3.10ms 1177.5 MB/sec string_and_binary_view/bloom_filter 1.02 65.2±0.95ms 494.5 MB/sec 1.00 64.1±0.27ms 502.9 MB/sec string_and_binary_view/cdc 1.00 58.7±0.23ms 549.4 MB/sec 1.00 58.7±0.20ms 549.5 MB/sec string_and_binary_view/default 1.01 48.6±0.21ms 663.9 MB/sec 1.00 48.0±0.16ms 671.7 MB/sec string_and_binary_view/parquet_2 1.00 59.1±0.22ms 546.1 MB/sec 1.00 59.2±0.20ms 545.0 MB/sec string_and_binary_view/zstd 1.00 84.8±0.23ms 380.5 MB/sec 1.00 85.2±0.23ms 378.7 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.0±0.22ms 441.8 MB/sec 1.00 73.2±0.20ms 440.6 MB/sec string_dictionary/bloom_filter 1.00 83.2±1.02ms 3.1 GB/sec 1.00 83.5±1.06ms 3.1 GB/sec string_dictionary/cdc 1.07 47.2±0.43ms 5.5 GB/sec 1.00 44.0±0.52ms 5.9 GB/sec string_dictionary/default 1.03 42.3±0.75ms 6.1 GB/sec 1.00 41.2±1.34ms 6.3 GB/sec string_dictionary/parquet_2 1.00 47.8±0.15ms 5.4 GB/sec 1.02 48.8±0.23ms 5.3 GB/sec string_dictionary/zstd 1.01 206.6±1.65ms 1278.5 MB/sec 1.00 205.3±1.98ms 1286.4 MB/sec string_dictionary/zstd_parquet_2 1.00 192.0±0.23ms 1375.8 MB/sec 1.00 191.7±0.17ms 1378.2 MB/sec string_non_null/bloom_filter 1.00 233.6±16.97ms 2.2 GB/sec 1.01 236.7±15.93ms 2.2 GB/sec string_non_null/cdc 1.01 236.5±0.77ms 2.2 GB/sec 1.00 234.0±0.47ms 2.2 GB/sec string_non_null/default 1.00 119.0±16.87ms 4.3 GB/sec 1.03 122.0±13.27ms 4.2 GB/sec string_non_null/parquet_2 1.00 105.6±0.76ms 4.8 GB/sec 1.08 113.9±5.15ms 4.5 GB/sec string_non_null/zstd 1.07 563.8±10.04ms 929.5 MB/sec 1.00 527.1±1.43ms 994.2 MB/sec string_non_null/zstd_parquet_2 1.01 495.3±13.80ms 1057.9 MB/sec 1.00 488.9±4.57ms 1071.8 MB/sec string_ree/bloom_filter 1.03 151.8±3.76ms 108.1 MB/sec 1.00 147.9±3.65ms 111.0 MB/sec string_ree/cdc 1.00 218.5±2.22ms 75.1 MB/sec 1.02 222.4±2.76ms 73.8 MB/sec string_ree/default 1.02 122.1±3.44ms 134.4 MB/sec 1.00 119.5±3.10ms 137.3 MB/sec string_ree/parquet_2 1.00 126.5±3.31ms 129.7 MB/sec 1.04 131.6±3.45ms 124.7 MB/sec string_ree/zstd 1.00 181.6±4.07ms 90.3 MB/sec 1.01 184.1±3.20ms 89.1 MB/sec string_ree/zstd_parquet_2 1.00 140.0±3.27ms 117.2 MB/sec 1.05 146.4±3.50ms 112.1 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.4±0.13ms 53.3 MB/sec 1.00 26.3±0.13ms 53.4 MB/sec string_ree_95pct_null/cdc 1.00 32.4±0.09ms 43.4 MB/sec 1.01 32.8±0.12ms 42.9 MB/sec string_ree_95pct_null/default 1.00 24.9±0.09ms 56.5 MB/sec 1.00 24.8±0.09ms 56.7 MB/sec string_ree_95pct_null/parquet_2 1.00 24.9±0.08ms 56.6 MB/sec 1.00 24.8±0.08ms 56.7 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.09ms 54.7 MB/sec 1.00 25.6±0.08ms 54.9 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.6±0.10ms 54.9 MB/sec 1.00 25.6±0.12ms 55.0 MB/sec struct_all_null/bloom_filter 1.00 370.5±2.78µs 42.5 GB/sec 1.01 374.1±2.56µs 42.1 GB/sec struct_all_null/cdc 1.00 7.3±0.06ms 2.2 GB/sec 1.08 7.9±0.09ms 2041.8 MB/sec struct_all_null/default 1.00 118.3±0.64µs 133.1 GB/sec 1.00 118.0±0.57µs 133.4 GB/sec struct_all_null/parquet_2 1.01 122.4±0.58µs 128.7 GB/sec 1.00 121.5±0.76µs 129.6 GB/sec struct_all_null/zstd 1.01 182.5±0.57µs 86.3 GB/sec 1.00 181.5±0.64µs 86.8 GB/sec struct_all_null/zstd_parquet_2 1.00 166.0±0.54µs 94.9 GB/sec 1.00 165.8±0.65µs 95.0 GB/sec struct_non_null/bloom_filter 1.03 43.5±0.15ms 368.1 MB/sec 1.00 42.1±0.16ms 380.2 MB/sec struct_non_null/cdc 1.04 42.9±0.15ms 373.1 MB/sec 1.00 41.1±0.14ms 389.6 MB/sec struct_non_null/default 1.07 29.5±0.08ms 542.1 MB/sec 1.00 27.5±0.13ms 580.9 MB/sec struct_non_null/parquet_2 1.06 38.3±0.10ms 417.9 MB/sec 1.00 36.3±0.10ms 440.9 MB/sec struct_non_null/zstd 1.05 38.1±0.10ms 420.2 MB/sec 1.00 36.2±0.12ms 442.2 MB/sec struct_non_null/zstd_parquet_2 1.04 52.3±0.12ms 306.2 MB/sec 1.00 50.1±0.12ms 319.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.5±0.02ms 2.4 GB/sec 1.00 6.5±0.05ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.30ms 1195.7 MB/sec 1.03 14.0±0.11ms 1155.7 MB/sec struct_sparse_99pct_null/default 1.01 6.0±0.02ms 2.6 GB/sec 1.00 5.9±0.03ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.0±0.01ms 2.6 GB/sec 1.00 5.9±0.04ms 2.7 GB/sec struct_sparse_99pct_null/zstd 1.01 7.4±0.02ms 2.1 GB/sec 1.00 7.3±0.04ms 2.2 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.8±0.06ms 2.3 GB/sec 1.00 6.7±0.04ms 2.4 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3025.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 2896.4s | | CPU sys | 126.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3000.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2912.1s | | CPU sys | 86.5s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
