adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187753928
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5187132154) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (9a4c021a1b3dc42dab54506974a8a9a1827e262b) to fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8 [diff](https://github.com/apache/arrow-rs/compare/fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8..9a4c021a1b3dc42dab54506974a8a9a1827e262b) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "fd806be5d3c0ac522fd9e3e0b3dd70b08e527dd8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.06ms 19.7 MB/sec 1.00 12.7±0.04ms 19.7 MB/sec bool/cdc 1.02 15.7±0.06ms 16.0 MB/sec 1.00 15.4±0.08ms 16.3 MB/sec bool/default 1.00 10.6±0.05ms 23.7 MB/sec 1.00 10.6±0.04ms 23.6 MB/sec bool/parquet_2 1.00 14.3±0.06ms 17.5 MB/sec 1.00 14.4±0.05ms 17.4 MB/sec bool/zstd 1.00 11.1±0.04ms 22.6 MB/sec 1.00 11.1±0.04ms 22.5 MB/sec bool/zstd_parquet_2 1.00 14.7±0.05ms 17.0 MB/sec 1.00 14.8±0.06ms 16.9 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 19.0 MB/sec 1.00 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.01 6.4±0.04ms 19.4 MB/sec 1.00 6.4±0.03ms 19.6 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.2 MB/sec 1.02 3.8±0.02ms 32.5 MB/sec bool_non_null/parquet_2 1.00 8.5±0.04ms 14.7 MB/sec 1.01 8.6±0.03ms 14.5 MB/sec bool_non_null/zstd 1.00 4.1±0.04ms 30.3 MB/sec 1.02 4.2±0.02ms 29.8 MB/sec bool_non_null/zstd_parquet_2 1.00 8.9±0.04ms 14.0 MB/sec 1.01 9.0±0.03ms 13.9 MB/sec bool_ree/bloom_filter 1.00 30.1±0.14ms 7.1 MB/sec 1.00 30.0±0.06ms 7.1 MB/sec bool_ree/cdc 1.02 31.8±0.10ms 6.7 MB/sec 1.00 31.3±0.06ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.06ms 7.8 MB/sec 1.00 27.3±0.05ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.08ms 7.4 MB/sec 1.00 28.9±0.08ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.06ms 7.6 MB/sec 1.00 27.9±0.07ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.3±0.08ms 7.3 MB/sec 1.00 29.2±0.05ms 7.3 MB/sec decimal/bloom_filter 1.04 126.0±1.50ms 476.1 MB/sec 1.00 121.5±1.31ms 493.7 MB/sec decimal/cdc 1.01 103.1±0.58ms 582.2 MB/sec 1.00 101.9±0.36ms 589.1 MB/sec decimal/default 1.03 83.0±0.86ms 722.8 MB/sec 1.00 80.9±0.47ms 741.5 MB/sec decimal/parquet_2 1.03 183.3±1.31ms 327.3 MB/sec 1.00 178.3±1.75ms 336.5 MB/sec decimal/zstd 1.04 94.3±1.17ms 636.0 MB/sec 1.00 90.5±0.40ms 663.2 MB/sec decimal/zstd_parquet_2 1.03 203.3±1.73ms 295.1 MB/sec 1.00 198.3±1.73ms 302.6 MB/sec fixed_size_binary_ree/bloom_filter 1.01 60.2±0.92ms 16.7 MB/sec 1.00 59.3±0.30ms 17.0 MB/sec fixed_size_binary_ree/cdc 1.00 62.4±0.35ms 16.2 MB/sec 1.00 62.1±0.25ms 16.2 MB/sec fixed_size_binary_ree/default 1.00 52.2±0.91ms 19.3 MB/sec 1.00 52.1±0.29ms 19.3 MB/sec fixed_size_binary_ree/parquet_2 1.03 68.2±0.46ms 14.8 MB/sec 1.00 66.5±0.28ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.00 57.9±1.00ms 17.4 MB/sec 1.00 57.7±0.16ms 17.4 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 68.7±0.84ms 14.7 MB/sec 1.00 68.4±0.61ms 14.7 MB/sec float_with_nans/bloom_filter 1.06 88.3±1.52ms 158.5 MB/sec 1.00 83.5±0.60ms 167.6 MB/sec float_with_nans/cdc 1.03 74.2±0.55ms 188.6 MB/sec 1.00 71.8±0.31ms 195.0 MB/sec float_with_nans/default 1.02 66.2±0.59ms 211.5 MB/sec 1.00 64.6±0.36ms 216.8 MB/sec float_with_nans/parquet_2 1.03 84.4±0.64ms 165.8 MB/sec 1.00 82.3±0.46ms 170.1 MB/sec float_with_nans/zstd 1.01 104.5±0.66ms 134.0 MB/sec 1.00 103.2±0.36ms 135.7 MB/sec float_with_nans/zstd_parquet_2 1.02 121.7±0.74ms 115.1 MB/sec 1.00 119.4±0.45ms 117.2 MB/sec fsb/bloom_filter 1.00 8.1±0.07ms 1996.6 MB/sec 1.05 8.5±0.15ms 1902.2 MB/sec fsb/cdc 1.00 10.4±0.08ms 1550.0 MB/sec 1.04 10.8±0.17ms 1492.6 MB/sec fsb/default 1.00 7.0±0.06ms 2.3 GB/sec 1.03 7.2±0.12ms 2.2 GB/sec fsb/parquet_2 1.00 13.3±0.11ms 1212.1 MB/sec 1.03 13.7±0.23ms 1180.7 MB/sec fsb/zstd 1.00 9.4±0.10ms 1709.1 MB/sec 1.02 9.7±0.09ms 1669.7 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.11ms 1133.1 MB/sec 1.02 14.5±0.27ms 1111.6 MB/sec int32_ree/bloom_filter 1.00 41.4±0.15ms 9.8 MB/sec 1.01 41.9±0.22ms 9.7 MB/sec int32_ree/cdc 1.00 40.5±0.09ms 10.0 MB/sec 1.00 40.5±0.07ms 10.1 MB/sec int32_ree/default 1.01 36.9±0.15ms 11.0 MB/sec 1.00 36.4±0.05ms 11.2 MB/sec int32_ree/parquet_2 1.00 36.8±0.09ms 11.0 MB/sec 1.00 36.7±0.07ms 11.1 MB/sec int32_ree/zstd 1.01 37.4±0.16ms 10.9 MB/sec 1.00 37.2±0.08ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.01 37.4±0.17ms 10.9 MB/sec 1.00 37.1±0.06ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.4±0.05ms 18.1 MB/sec 1.00 22.2±0.03ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 24.3±0.07ms 16.8 MB/sec 1.00 24.3±0.04ms 16.7 MB/sec int32_ree_95pct_null/default 1.01 21.9±0.06ms 18.6 MB/sec 1.00 21.6±0.03ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.9±0.04ms 18.6 MB/sec 1.00 21.6±0.02ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.01 22.2±0.04ms 18.4 MB/sec 1.00 21.9±0.02ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 22.1±0.06ms 18.4 MB/sec 1.00 21.8±0.02ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.10 71.3±4.33ms 3.5 GB/sec 1.00 64.9±0.63ms 3.9 GB/sec large_string_distinct/plain 1.04 64.0±1.56ms 3.9 GB/sec 1.00 61.5±0.92ms 4.1 GB/sec large_string_non_null/bloom_filter 1.00 74.0±0.50ms 3.4 GB/sec 1.02 75.5±0.76ms 3.3 GB/sec large_string_non_null/cdc 1.00 245.6±1.06ms 1042.3 MB/sec 1.00 244.8±1.29ms 1045.6 MB/sec large_string_non_null/default 1.00 56.4±0.65ms 4.4 GB/sec 1.01 57.0±0.58ms 4.4 GB/sec large_string_non_null/parquet_2 1.00 56.2±0.50ms 4.4 GB/sec 1.01 56.5±0.55ms 4.4 GB/sec large_string_non_null/zstd 1.01 56.3±0.52ms 4.4 GB/sec 1.00 55.8±0.60ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.02 55.9±0.43ms 4.5 GB/sec 1.00 55.0±0.26ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.07 60.9±1.66ms 4.1 GB/sec 1.00 57.0±0.54ms 4.4 GB/sec large_string_shared_prefix/plain 1.04 103.3±2.66ms 2.4 GB/sec 1.00 99.5±1.83ms 2.5 GB/sec list_nested/bloom_filter 1.02 147.0±1.24ms 196.3 MB/sec 1.00 144.4±0.52ms 199.8 MB/sec list_nested/cdc 1.01 163.9±0.33ms 176.0 MB/sec 1.00 162.7±0.46ms 177.4 MB/sec list_nested/default 1.01 131.8±0.39ms 219.0 MB/sec 1.00 130.3±0.71ms 221.5 MB/sec list_nested/parquet_2 1.00 145.9±0.30ms 197.8 MB/sec 1.02 149.3±3.61ms 193.3 MB/sec list_nested/zstd 1.01 141.9±0.28ms 203.4 MB/sec 1.00 140.4±0.33ms 205.5 MB/sec list_nested/zstd_parquet_2 1.00 158.5±0.22ms 182.0 MB/sec 1.02 161.9±3.62ms 178.2 MB/sec list_primitive/bloom_filter 1.16 327.7±9.11ms 1664.2 MB/sec 1.00 282.2±3.08ms 1932.7 MB/sec list_primitive/cdc 1.02 320.8±6.27ms 1700.1 MB/sec 1.00 315.3±1.43ms 1729.6 MB/sec list_primitive/default 1.08 218.0±3.34ms 2.4 GB/sec 1.00 202.1±1.40ms 2.6 GB/sec list_primitive/parquet_2 1.07 243.6±2.03ms 2.2 GB/sec 1.00 226.8±0.85ms 2.3 GB/sec list_primitive/zstd 1.00 457.0±4.21ms 1193.4 MB/sec 1.02 467.9±2.52ms 1165.5 MB/sec list_primitive/zstd_parquet_2 1.03 461.9±1.22ms 1180.7 MB/sec 1.00 448.7±0.68ms 1215.4 MB/sec list_primitive_non_null/bloom_filter 1.10 423.3±13.29ms 1285.6 MB/sec 1.00 384.2±8.59ms 1416.5 MB/sec list_primitive_non_null/cdc 1.01 396.9±10.83ms 1371.1 MB/sec 1.00 393.1±9.40ms 1384.4 MB/sec list_primitive_non_null/default 1.09 266.6±11.15ms 2041.5 MB/sec 1.00 245.5±5.67ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.05 269.3±9.93ms 2021.0 MB/sec 1.00 256.1±12.27ms 2.1 GB/sec list_primitive_non_null/zstd 1.04 701.6±5.53ms 775.7 MB/sec 1.00 673.5±7.14ms 808.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.03 666.0±15.74ms 817.2 MB/sec 1.00 647.1±9.42ms 841.1 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 13.1±0.06ms 2.8 GB/sec 1.01 13.3±0.06ms 2.7 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.9±0.08ms 1498.8 MB/sec 1.00 24.8±0.11ms 1505.9 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.7±0.06ms 2.9 GB/sec 1.01 12.9±0.06ms 2.8 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.8±0.19ms 2.9 GB/sec 1.01 12.9±0.05ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.7±0.08ms 2.5 GB/sec 1.01 14.8±0.07ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.0±0.08ms 2.8 GB/sec 1.00 13.1±0.07ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.01 285.2±0.95ms 159.9 MB/sec 1.00 283.4±0.93ms 160.9 MB/sec list_struct_with_list/cdc 1.00 320.4±1.04ms 142.3 MB/sec 1.00 319.0±0.34ms 142.9 MB/sec list_struct_with_list/default 1.00 256.5±0.66ms 177.7 MB/sec 1.00 256.1±0.50ms 178.1 MB/sec list_struct_with_list/parquet_2 1.00 273.7±0.52ms 166.6 MB/sec 1.00 274.7±2.53ms 166.0 MB/sec list_struct_with_list/zstd 1.00 277.9±0.69ms 164.1 MB/sec 1.00 277.8±1.14ms 164.1 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.2±0.62ms 153.9 MB/sec 1.00 297.5±3.46ms 153.3 MB/sec primitive/bloom_filter 1.00 146.4±0.39ms 306.6 MB/sec 1.02 149.1±0.57ms 301.1 MB/sec primitive/cdc 1.01 157.5±1.34ms 284.8 MB/sec 1.00 155.9±0.55ms 287.8 MB/sec primitive/default 1.00 114.3±0.36ms 392.6 MB/sec 1.01 115.0±0.49ms 390.4 MB/sec primitive/parquet_2 1.00 129.1±0.48ms 347.5 MB/sec 1.00 129.3±0.38ms 347.0 MB/sec primitive/zstd 1.00 143.4±0.36ms 313.0 MB/sec 1.01 144.5±0.41ms 310.5 MB/sec primitive/zstd_parquet_2 1.00 161.5±0.34ms 277.8 MB/sec 1.01 162.4±0.37ms 276.3 MB/sec primitive_all_null/bloom_filter 1.00 910.3±8.89µs 48.1 GB/sec 1.01 922.8±10.81µs 47.5 GB/sec primitive_all_null/cdc 1.00 18.5±0.36ms 2.4 GB/sec 1.03 19.1±0.30ms 2.3 GB/sec primitive_all_null/default 1.01 275.9±1.59µs 158.9 GB/sec 1.00 273.1±1.25µs 160.5 GB/sec primitive_all_null/parquet_2 1.01 283.7±1.34µs 154.5 GB/sec 1.00 281.9±1.33µs 155.5 GB/sec primitive_all_null/zstd 1.01 426.5±1.70µs 102.8 GB/sec 1.00 421.7±1.55µs 103.9 GB/sec primitive_all_null/zstd_parquet_2 1.02 387.4±1.18µs 113.1 GB/sec 1.00 380.5±1.54µs 115.2 GB/sec primitive_non_null/bloom_filter 1.00 106.4±1.10ms 413.6 MB/sec 1.02 108.9±1.64ms 404.0 MB/sec primitive_non_null/cdc 1.00 87.5±0.40ms 503.0 MB/sec 1.00 87.4±0.51ms 503.3 MB/sec primitive_non_null/default 1.00 64.5±0.46ms 682.4 MB/sec 1.00 64.7±0.52ms 679.7 MB/sec primitive_non_null/parquet_2 1.00 86.1±0.37ms 511.2 MB/sec 1.00 86.2±0.55ms 510.2 MB/sec primitive_non_null/zstd 1.00 95.4±0.45ms 461.1 MB/sec 1.00 95.8±0.54ms 459.3 MB/sec primitive_non_null/zstd_parquet_2 1.00 119.0±0.39ms 369.8 MB/sec 1.01 119.6±0.45ms 367.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 13.3±0.16ms 3.3 GB/sec 1.01 13.4±0.11ms 3.3 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.4±0.36ms 1476.1 MB/sec 1.04 31.6±0.29ms 1420.0 MB/sec primitive_sparse_99pct_null/default 1.00 11.3±0.08ms 3.9 GB/sec 1.00 11.3±0.03ms 3.9 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.3±0.08ms 3.9 GB/sec 1.00 11.3±0.04ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.7±0.07ms 3.0 GB/sec 1.01 14.9±0.09ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.3±0.06ms 3.3 GB/sec 1.01 13.4±0.04ms 3.3 GB/sec short_string_non_null/bloom_filter 1.00 27.3±0.06ms 440.2 MB/sec 1.08 29.3±0.22ms 409.0 MB/sec short_string_non_null/cdc 1.00 20.0±0.06ms 599.0 MB/sec 1.01 20.2±0.06ms 594.0 MB/sec short_string_non_null/default 1.00 15.7±0.05ms 762.7 MB/sec 1.02 16.1±0.05ms 746.1 MB/sec short_string_non_null/parquet_2 1.00 26.0±0.05ms 461.7 MB/sec 1.01 26.2±0.07ms 458.2 MB/sec short_string_non_null/zstd 1.00 35.9±0.05ms 334.1 MB/sec 1.01 36.4±0.13ms 329.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.0±0.07ms 414.3 MB/sec 1.01 29.2±0.09ms 411.5 MB/sec small_string_distinct/delta_byte_array 1.06 1055.1±21.54µs 7.4 GB/sec 1.00 994.0±10.78µs 7.9 GB/sec small_string_distinct/plain 1.13 847.4±17.44µs 9.3 GB/sec 1.00 747.3±11.33µs 10.5 GB/sec small_string_partial_prefix/delta_byte_array 1.24 1228.8±46.87µs 6.4 GB/sec 1.00 993.3±6.11µs 7.9 GB/sec small_string_partial_prefix/plain 1.14 1053.9±24.12µs 7.4 GB/sec 1.00 927.1±7.89µs 8.5 GB/sec small_string_shared_prefix/delta_byte_array 1.03 1006.9±11.61µs 7.8 GB/sec 1.00 981.2±2.21µs 8.0 GB/sec small_string_shared_prefix/plain 1.10 1160.4±8.71µs 6.8 GB/sec 1.00 1054.8±13.13µs 7.4 GB/sec string/bloom_filter 1.04 230.8±25.86ms 2.2 GB/sec 1.00 222.8±23.35ms 2.3 GB/sec string/cdc 1.00 208.2±6.89ms 2.5 GB/sec 1.04 216.2±12.15ms 2.4 GB/sec string/default 1.01 117.6±14.71ms 4.4 GB/sec 1.00 116.5±17.50ms 4.4 GB/sec string/parquet_2 1.02 103.5±7.13ms 4.9 GB/sec 1.00 101.9±8.64ms 5.0 GB/sec string/zstd 1.00 419.4±1.17ms 1250.0 MB/sec 1.00 419.6±2.02ms 1249.4 MB/sec string/zstd_parquet_2 1.00 383.0±0.94ms 1368.9 MB/sec 1.03 394.5±9.19ms 1328.9 MB/sec string_and_binary_view/bloom_filter 1.03 67.9±2.25ms 475.2 MB/sec 1.00 65.6±0.24ms 491.3 MB/sec string_and_binary_view/cdc 1.00 60.0±0.41ms 537.7 MB/sec 1.04 62.3±0.65ms 517.4 MB/sec string_and_binary_view/default 1.00 48.9±0.30ms 660.1 MB/sec 1.01 49.1±0.13ms 656.8 MB/sec string_and_binary_view/parquet_2 1.00 60.3±0.37ms 535.1 MB/sec 1.00 60.0±0.12ms 537.1 MB/sec string_and_binary_view/zstd 1.00 86.1±0.44ms 374.7 MB/sec 1.02 87.9±1.77ms 366.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.3±0.50ms 434.3 MB/sec 1.03 76.6±0.79ms 420.9 MB/sec string_dictionary/bloom_filter 1.00 89.7±1.62ms 2.9 GB/sec 1.05 94.1±5.87ms 2.7 GB/sec string_dictionary/cdc 1.00 50.6±0.86ms 5.1 GB/sec 1.03 52.2±2.08ms 4.9 GB/sec string_dictionary/default 1.00 45.0±1.26ms 5.7 GB/sec 1.09 49.1±1.05ms 5.3 GB/sec string_dictionary/parquet_2 1.00 48.9±0.20ms 5.3 GB/sec 1.03 50.5±0.65ms 5.1 GB/sec string_dictionary/zstd 1.00 212.6±2.98ms 1242.6 MB/sec 1.02 217.4±2.86ms 1214.8 MB/sec string_dictionary/zstd_parquet_2 1.00 193.7±0.27ms 1363.6 MB/sec 1.00 194.4±0.87ms 1358.6 MB/sec string_non_null/bloom_filter 1.00 232.5±17.41ms 2.2 GB/sec 1.13 263.0±18.38ms 1992.2 MB/sec string_non_null/cdc 1.02 252.8±5.84ms 2.0 GB/sec 1.00 247.4±1.30ms 2.1 GB/sec string_non_null/default 1.00 120.9±14.18ms 4.2 GB/sec 1.07 129.4±13.40ms 4.0 GB/sec string_non_null/parquet_2 1.00 110.1±3.90ms 4.6 GB/sec 1.05 115.6±8.31ms 4.4 GB/sec string_non_null/zstd 1.00 530.1±1.71ms 988.4 MB/sec 1.11 586.2±6.32ms 894.0 MB/sec string_non_null/zstd_parquet_2 1.00 491.3±3.55ms 1066.5 MB/sec 1.01 494.6±1.70ms 1059.4 MB/sec string_ree/bloom_filter 1.00 155.8±3.40ms 105.3 MB/sec 1.00 155.8±1.62ms 105.3 MB/sec string_ree/cdc 1.22 225.6±1.92ms 72.7 MB/sec 1.00 184.8±4.50ms 88.8 MB/sec string_ree/default 1.00 121.4±1.21ms 135.1 MB/sec 1.08 130.8±1.70ms 125.4 MB/sec string_ree/parquet_2 1.62 129.7±1.04ms 126.5 MB/sec 1.00 80.0±0.34ms 205.2 MB/sec string_ree/zstd 1.39 192.9±2.00ms 85.1 MB/sec 1.00 138.9±0.92ms 118.1 MB/sec string_ree/zstd_parquet_2 1.52 144.0±1.05ms 113.9 MB/sec 1.00 94.6±0.34ms 173.5 MB/sec string_ree_95pct_null/bloom_filter 1.02 27.4±0.15ms 51.3 MB/sec 1.00 27.0±0.09ms 52.1 MB/sec string_ree_95pct_null/cdc 1.00 33.3±0.13ms 42.3 MB/sec 1.01 33.5±0.06ms 42.0 MB/sec string_ree_95pct_null/default 1.01 25.6±0.17ms 54.9 MB/sec 1.00 25.3±0.07ms 55.7 MB/sec string_ree_95pct_null/parquet_2 1.02 25.7±0.14ms 54.8 MB/sec 1.00 25.3±0.08ms 55.7 MB/sec string_ree_95pct_null/zstd 1.02 26.6±0.16ms 52.9 MB/sec 1.00 26.1±0.07ms 53.9 MB/sec string_ree_95pct_null/zstd_parquet_2 1.02 26.5±0.19ms 53.1 MB/sec 1.00 26.1±0.07ms 54.0 MB/sec struct_all_null/bloom_filter 1.00 372.5±2.68µs 42.3 GB/sec 1.02 379.8±3.28µs 41.5 GB/sec struct_all_null/cdc 1.00 7.4±0.11ms 2.1 GB/sec 1.06 7.8±0.08ms 2.0 GB/sec struct_all_null/default 1.00 117.6±0.74µs 133.9 GB/sec 1.00 117.6±0.65µs 133.9 GB/sec struct_all_null/parquet_2 1.01 122.0±0.67µs 129.0 GB/sec 1.00 121.4±0.62µs 129.7 GB/sec struct_all_null/zstd 1.01 181.2±0.70µs 86.9 GB/sec 1.00 179.0±0.67µs 88.0 GB/sec struct_all_null/zstd_parquet_2 1.01 165.3±0.68µs 95.3 GB/sec 1.00 163.6±0.71µs 96.2 GB/sec struct_non_null/bloom_filter 1.03 45.2±0.30ms 354.1 MB/sec 1.00 43.9±0.37ms 364.5 MB/sec struct_non_null/cdc 1.00 42.9±0.13ms 372.6 MB/sec 1.00 43.1±0.15ms 371.4 MB/sec struct_non_null/default 1.01 30.1±0.16ms 530.8 MB/sec 1.00 29.9±0.13ms 534.6 MB/sec struct_non_null/parquet_2 1.02 39.0±0.33ms 409.9 MB/sec 1.00 38.4±0.40ms 417.0 MB/sec struct_non_null/zstd 1.02 38.8±0.16ms 412.2 MB/sec 1.00 38.0±0.09ms 420.6 MB/sec struct_non_null/zstd_parquet_2 1.01 52.6±0.17ms 304.2 MB/sec 1.00 51.9±0.11ms 308.4 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.02ms 2.4 GB/sec 1.01 6.6±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.3±0.11ms 1210.8 MB/sec 1.17 15.6±0.43ms 1033.8 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.00 6.0±0.08ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.06ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.03ms 2.1 GB/sec 1.00 7.4±0.03ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.05ms 2.3 GB/sec 1.06 7.3±0.05ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3010.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 2954.8s | | CPU sys | 53.7s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3035.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 2936.8s | | CPU sys | 91.8s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
