adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5344929545
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5343490576) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 505afcbfd2c27897f747916e782d41e1593b7007 (505afcbfd2c27897f747916e782d41e1593b7007) to 505afcbfd2c27897f747916e782d41e1593b7007 [diff](https://github.com/apache/arrow-rs/compare/505afcbfd2c27897f747916e782d41e1593b7007..505afcbfd2c27897f747916e782d41e1593b7007) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "505afcbfd2c27897f747916e782d41e1593b7007" changed: ref: "505afcbfd2c27897f747916e782d41e1593b7007" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.7±0.04ms 19.8 MB/sec 1.00 12.7±0.07ms 19.7 MB/sec bool/cdc 1.00 15.3±0.06ms 16.4 MB/sec 1.00 15.2±0.05ms 16.4 MB/sec bool/default 1.00 10.5±0.04ms 23.8 MB/sec 1.01 10.6±0.09ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.05ms 18.6 MB/sec 1.00 13.5±0.09ms 18.5 MB/sec bool/zstd 1.00 11.0±0.04ms 22.7 MB/sec 1.00 11.1±0.08ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.8±0.05ms 18.1 MB/sec 1.00 13.9±0.09ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 19.0 MB/sec 1.00 6.6±0.03ms 19.1 MB/sec bool_non_null/cdc 1.00 6.3±0.04ms 19.8 MB/sec 1.00 6.3±0.03ms 19.9 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.3 MB/sec 1.00 3.7±0.03ms 33.4 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.5 MB/sec 1.00 7.6±0.03ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.03ms 30.5 MB/sec 1.00 4.1±0.03ms 30.6 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.02ms 15.6 MB/sec 1.00 8.0±0.02ms 15.7 MB/sec bool_ree/bloom_filter 1.00 30.0±0.08ms 7.1 MB/sec 1.00 30.1±0.15ms 7.1 MB/sec bool_ree/cdc 1.00 31.3±0.08ms 6.8 MB/sec 1.00 31.3±0.07ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.08ms 7.8 MB/sec 1.00 27.4±0.13ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.05ms 7.4 MB/sec 1.00 28.9±0.16ms 7.4 MB/sec bool_ree/zstd 1.00 27.9±0.08ms 7.6 MB/sec 1.00 28.0±0.17ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.00 29.2±0.17ms 7.3 MB/sec decimal/bloom_filter 1.12 133.3±1.10ms 450.1 MB/sec 1.00 118.7±1.18ms 505.7 MB/sec decimal/cdc 1.00 101.6±0.35ms 590.3 MB/sec 1.00 101.2±0.39ms 593.0 MB/sec decimal/default 1.14 89.9±2.29ms 667.1 MB/sec 1.00 79.1±0.54ms 758.2 MB/sec decimal/parquet_2 1.06 187.6±1.99ms 319.8 MB/sec 1.00 177.1±1.49ms 338.8 MB/sec decimal/zstd 1.12 99.9±1.13ms 600.4 MB/sec 1.00 89.1±1.50ms 673.5 MB/sec decimal/zstd_parquet_2 1.06 208.0±1.70ms 288.5 MB/sec 1.00 196.6±1.77ms 305.3 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.7±0.30ms 17.2 MB/sec 1.00 58.7±1.02ms 17.2 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.26ms 16.4 MB/sec 1.01 62.0±0.28ms 16.3 MB/sec fixed_size_binary_ree/default 1.01 51.9±1.26ms 19.4 MB/sec 1.00 51.7±0.29ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.6±0.42ms 15.1 MB/sec 1.00 66.6±0.65ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.00 57.5±0.24ms 17.5 MB/sec 1.00 57.4±0.29ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.2±0.37ms 15.0 MB/sec 1.00 67.0±1.32ms 15.0 MB/sec float_with_nans/bloom_filter 1.02 82.5±0.33ms 169.7 MB/sec 1.00 80.6±0.49ms 173.8 MB/sec float_with_nans/cdc 1.01 71.3±0.29ms 196.3 MB/sec 1.00 70.6±0.28ms 198.2 MB/sec float_with_nans/default 1.01 63.5±0.26ms 220.3 MB/sec 1.00 63.1±0.30ms 221.7 MB/sec float_with_nans/parquet_2 1.01 81.2±1.46ms 172.4 MB/sec 1.00 80.8±0.36ms 173.4 MB/sec float_with_nans/zstd 1.00 101.9±0.31ms 137.4 MB/sec 1.00 101.4±0.30ms 138.0 MB/sec float_with_nans/zstd_parquet_2 1.01 118.5±1.73ms 118.2 MB/sec 1.00 117.6±0.30ms 119.0 MB/sec fsb/bloom_filter 1.04 8.4±0.07ms 1920.1 MB/sec 1.00 8.1±0.07ms 1991.7 MB/sec fsb/cdc 1.00 10.6±0.08ms 1519.7 MB/sec 1.00 10.6±0.09ms 1521.0 MB/sec fsb/default 1.00 7.1±0.04ms 2.2 GB/sec 1.00 7.1±0.05ms 2.2 GB/sec fsb/parquet_2 1.03 13.7±0.07ms 1175.6 MB/sec 1.00 13.3±0.08ms 1216.6 MB/sec fsb/zstd 1.00 9.6±0.06ms 1678.5 MB/sec 1.00 9.6±0.06ms 1685.8 MB/sec fsb/zstd_parquet_2 1.03 14.5±0.10ms 1109.0 MB/sec 1.00 14.1±0.07ms 1146.3 MB/sec int32_ree/bloom_filter 1.02 42.1±0.20ms 9.7 MB/sec 1.00 41.2±0.24ms 9.9 MB/sec int32_ree/cdc 1.00 40.6±0.10ms 10.0 MB/sec 1.00 40.6±0.11ms 10.0 MB/sec int32_ree/default 1.00 36.8±0.09ms 11.1 MB/sec 1.00 36.7±0.11ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.8±0.09ms 11.0 MB/sec 1.00 36.7±0.09ms 11.1 MB/sec int32_ree/zstd 1.00 37.3±0.10ms 10.9 MB/sec 1.00 37.2±0.08ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.10ms 10.9 MB/sec 1.00 37.2±0.10ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.0±0.07ms 18.5 MB/sec 1.00 22.0±0.09ms 18.5 MB/sec int32_ree_95pct_null/cdc 1.00 24.3±0.06ms 16.8 MB/sec 1.00 24.3±0.09ms 16.7 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.8 MB/sec 1.00 21.7±0.05ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.05ms 18.8 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.9±0.06ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.05ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.06 77.8±0.78ms 3.2 GB/sec 1.00 73.1±0.82ms 3.4 GB/sec large_string_distinct/plain 1.02 62.2±1.13ms 4.0 GB/sec 1.00 61.0±0.77ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.03 56.3±0.48ms 4.4 GB/sec 1.00 54.6±0.75ms 4.6 GB/sec large_string_non_null/bloom_filter 1.02 73.3±0.14ms 3.4 GB/sec 1.00 71.9±0.29ms 3.5 GB/sec large_string_non_null/cdc 1.01 245.7±1.08ms 1042.1 MB/sec 1.00 243.9±1.23ms 1049.8 MB/sec large_string_non_null/default 1.03 55.5±0.20ms 4.5 GB/sec 1.00 53.8±0.10ms 4.7 GB/sec large_string_non_null/parquet_2 1.02 55.7±0.51ms 4.5 GB/sec 1.00 54.4±0.27ms 4.6 GB/sec large_string_non_null/zstd 1.02 55.5±0.14ms 4.5 GB/sec 1.00 54.6±0.27ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.02 55.4±0.10ms 4.5 GB/sec 1.00 54.4±0.30ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.04 112.5±1.20ms 2.2 GB/sec 1.00 108.3±1.60ms 2.3 GB/sec large_string_shared_prefix/plain 1.02 97.3±1.32ms 2.6 GB/sec 1.00 95.3±1.13ms 2.6 GB/sec large_string_shared_prefix_list/delta_byte_array 1.06 58.0±0.73ms 4.3 GB/sec 1.00 54.9±0.53ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.03 71.6±0.65ms 3.5 GB/sec 1.00 69.3±0.52ms 3.6 GB/sec large_string_shared_prefix_nullable/plain 1.04 65.0±0.69ms 3.8 GB/sec 1.00 62.7±0.53ms 4.0 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.06 56.7±0.64ms 2.2 GB/sec 1.00 53.3±0.64ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.03 69.7±0.57ms 3.6 GB/sec 1.00 67.5±0.74ms 3.7 GB/sec list_nested/bloom_filter 1.02 148.9±0.33ms 193.8 MB/sec 1.00 145.6±0.55ms 198.2 MB/sec list_nested/cdc 1.00 163.5±0.30ms 176.5 MB/sec 1.00 163.0±0.26ms 177.0 MB/sec list_nested/default 1.00 131.8±0.24ms 218.9 MB/sec 1.00 131.7±0.21ms 219.1 MB/sec list_nested/parquet_2 1.00 145.2±0.26ms 198.8 MB/sec 1.00 144.9±0.24ms 199.2 MB/sec list_nested/zstd 1.00 141.4±0.28ms 204.0 MB/sec 1.00 140.8±0.22ms 205.0 MB/sec list_nested/zstd_parquet_2 1.00 158.2±0.27ms 182.4 MB/sec 1.00 157.7±0.24ms 182.9 MB/sec list_primitive/bloom_filter 1.16 325.3±11.83ms 1676.7 MB/sec 1.00 281.4±2.10ms 1938.1 MB/sec list_primitive/cdc 1.02 330.0±12.89ms 1652.6 MB/sec 1.00 324.0±12.50ms 1683.1 MB/sec list_primitive/default 1.16 235.6±7.99ms 2.3 GB/sec 1.00 203.6±1.43ms 2.6 GB/sec list_primitive/parquet_2 1.18 264.4±0.69ms 2.0 GB/sec 1.00 223.8±0.59ms 2.4 GB/sec list_primitive/zstd 1.08 496.1±2.75ms 1099.3 MB/sec 1.00 459.2±2.47ms 1187.6 MB/sec list_primitive/zstd_parquet_2 1.05 466.1±5.79ms 1170.2 MB/sec 1.00 445.6±0.38ms 1224.0 MB/sec list_primitive_non_null/bloom_filter 1.00 421.8±21.75ms 1290.4 MB/sec 1.04 439.4±25.00ms 1238.6 MB/sec list_primitive_non_null/cdc 1.01 395.3±7.64ms 1376.9 MB/sec 1.00 390.9±9.94ms 1392.4 MB/sec list_primitive_non_null/default 1.00 289.5±17.78ms 1880.2 MB/sec 1.03 296.9±23.15ms 1833.2 MB/sec list_primitive_non_null/parquet_2 1.00 268.7±19.85ms 2025.5 MB/sec 1.21 326.2±20.14ms 1668.2 MB/sec list_primitive_non_null/zstd 1.00 725.9±10.17ms 749.8 MB/sec 1.00 722.5±8.91ms 753.3 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 643.0±20.72ms 846.4 MB/sec 1.10 705.3±1.48ms 771.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.01 13.2±0.08ms 2.8 GB/sec 1.00 13.1±0.13ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.7±0.08ms 1513.6 MB/sec 1.00 24.3±0.13ms 1536.2 MB/sec list_primitive_sparse_99pct_null/default 1.01 12.8±0.07ms 2.9 GB/sec 1.00 12.6±0.10ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.8±0.05ms 2.8 GB/sec 1.00 12.7±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.01 14.7±0.12ms 2.5 GB/sec 1.00 14.6±0.05ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.9±0.08ms 2.8 GB/sec 1.00 12.8±0.10ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.02 286.5±1.40ms 159.2 MB/sec 1.00 280.8±0.81ms 162.4 MB/sec list_struct_with_list/cdc 1.00 322.1±0.56ms 141.6 MB/sec 1.00 320.6±0.55ms 142.2 MB/sec list_struct_with_list/default 1.00 256.2±0.58ms 177.9 MB/sec 1.00 255.2±0.47ms 178.7 MB/sec list_struct_with_list/parquet_2 1.00 273.8±0.61ms 166.6 MB/sec 1.00 273.4±0.61ms 166.8 MB/sec list_struct_with_list/zstd 1.01 278.5±0.58ms 163.7 MB/sec 1.00 276.9±0.56ms 164.7 MB/sec list_struct_with_list/zstd_parquet_2 1.00 296.9±0.52ms 153.6 MB/sec 1.00 295.7±0.46ms 154.2 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 39.4±0.14ms 6.3 GB/sec 1.02 40.3±0.28ms 6.2 GB/sec primitive/bloom_filter 1.02 149.7±0.71ms 299.7 MB/sec 1.00 146.4±0.88ms 306.5 MB/sec primitive/cdc 1.01 156.8±0.63ms 286.2 MB/sec 1.00 155.6±0.83ms 288.4 MB/sec primitive/default 1.00 115.2±0.55ms 389.4 MB/sec 1.00 115.1±0.69ms 389.8 MB/sec primitive/parquet_2 1.00 130.7±0.34ms 343.4 MB/sec 1.00 130.7±0.60ms 343.3 MB/sec primitive/zstd 1.00 145.1±0.53ms 309.3 MB/sec 1.00 145.6±0.48ms 308.3 MB/sec primitive/zstd_parquet_2 1.00 163.4±0.50ms 274.7 MB/sec 1.00 163.5±0.58ms 274.5 MB/sec primitive_all_null/bloom_filter 1.02 907.9±3.89µs 48.3 GB/sec 1.00 887.6±3.82µs 49.4 GB/sec primitive_all_null/cdc 1.00 19.3±0.37ms 2.3 GB/sec 1.00 19.2±0.53ms 2.3 GB/sec primitive_all_null/default 1.01 277.6±1.72µs 157.9 GB/sec 1.00 274.9±1.68µs 159.4 GB/sec primitive_all_null/parquet_2 1.00 285.0±1.62µs 153.8 GB/sec 1.00 284.6±1.80µs 154.0 GB/sec primitive_all_null/zstd 1.01 427.2±1.92µs 102.6 GB/sec 1.00 423.7±1.78µs 103.4 GB/sec primitive_all_null/zstd_parquet_2 1.01 382.1±2.05µs 114.7 GB/sec 1.00 378.7±1.91µs 115.7 GB/sec primitive_non_null/bloom_filter 1.05 106.9±0.69ms 411.6 MB/sec 1.00 101.5±0.51ms 433.5 MB/sec primitive_non_null/cdc 1.01 86.4±0.38ms 509.3 MB/sec 1.00 85.2±0.37ms 516.7 MB/sec primitive_non_null/default 1.01 63.4±0.30ms 693.9 MB/sec 1.00 62.6±0.36ms 703.3 MB/sec primitive_non_null/parquet_2 1.01 85.3±0.34ms 515.6 MB/sec 1.00 84.4±0.33ms 521.1 MB/sec primitive_non_null/zstd 1.01 94.3±0.35ms 466.5 MB/sec 1.00 93.2±0.38ms 472.1 MB/sec primitive_non_null/zstd_parquet_2 1.01 118.3±0.31ms 372.0 MB/sec 1.00 117.7±0.29ms 374.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.05 13.1±0.21ms 3.3 GB/sec 1.00 12.5±0.18ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.01 31.4±0.27ms 1427.5 MB/sec 1.00 31.1±0.50ms 1442.6 MB/sec primitive_sparse_99pct_null/default 1.02 11.1±0.12ms 4.0 GB/sec 1.00 10.9±0.13ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.01 11.0±0.13ms 4.0 GB/sec 1.00 11.0±0.13ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.02 14.6±0.10ms 3.0 GB/sec 1.00 14.3±0.13ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.01 13.1±0.10ms 3.3 GB/sec 1.00 12.9±0.12ms 3.4 GB/sec short_string_non_null/bloom_filter 1.03 28.5±0.06ms 421.4 MB/sec 1.00 27.7±0.05ms 433.3 MB/sec short_string_non_null/cdc 1.01 20.0±0.07ms 599.8 MB/sec 1.00 19.8±0.07ms 605.1 MB/sec short_string_non_null/default 1.01 15.8±0.05ms 758.6 MB/sec 1.00 15.6±0.05ms 768.5 MB/sec short_string_non_null/parquet_2 1.02 26.2±0.12ms 457.7 MB/sec 1.00 25.8±0.06ms 465.4 MB/sec short_string_non_null/zstd 1.01 36.1±0.09ms 332.4 MB/sec 1.00 35.9±0.08ms 334.3 MB/sec short_string_non_null/zstd_parquet_2 1.01 28.9±0.08ms 414.5 MB/sec 1.00 28.7±0.04ms 418.0 MB/sec small_string_distinct/delta_byte_array 1.00 1000.3±4.81µs 7.8 GB/sec 1.00 1003.7±5.76µs 7.8 GB/sec small_string_distinct/plain 1.07 798.4±6.85µs 9.8 GB/sec 1.00 744.0±9.58µs 10.5 GB/sec small_string_partial_prefix/delta_byte_array 1.03 1055.4±17.76µs 7.4 GB/sec 1.00 1026.7±18.48µs 7.6 GB/sec small_string_partial_prefix/plain 1.08 1082.5±13.19µs 7.2 GB/sec 1.00 1006.1±19.95µs 7.8 GB/sec small_string_shared_prefix/delta_byte_array 1.00 973.6±3.93µs 8.1 GB/sec 1.00 969.3±8.07µs 8.1 GB/sec small_string_shared_prefix/plain 1.03 1141.6±4.67µs 6.9 GB/sec 1.00 1109.8±7.71µs 7.1 GB/sec string/bloom_filter 1.03 214.6±19.43ms 2.4 GB/sec 1.00 209.2±22.82ms 2.4 GB/sec string/cdc 1.00 202.3±1.24ms 2.5 GB/sec 1.03 207.4±9.82ms 2.5 GB/sec string/default 1.03 121.3±19.31ms 4.2 GB/sec 1.00 118.2±18.62ms 4.3 GB/sec string/parquet_2 1.00 113.8±13.48ms 4.5 GB/sec 1.01 114.6±0.38ms 4.5 GB/sec string/zstd 1.00 421.0±2.82ms 1245.2 MB/sec 1.11 467.6±11.48ms 1121.1 MB/sec string/zstd_parquet_2 1.00 388.8±5.14ms 1348.4 MB/sec 1.04 405.1±0.53ms 1294.1 MB/sec string_and_binary_view/bloom_filter 1.06 67.6±0.30ms 477.3 MB/sec 1.00 63.8±0.26ms 505.6 MB/sec string_and_binary_view/cdc 1.02 60.2±0.22ms 536.0 MB/sec 1.00 59.0±0.18ms 546.3 MB/sec string_and_binary_view/default 1.01 49.4±0.15ms 653.3 MB/sec 1.00 48.6±0.23ms 662.9 MB/sec string_and_binary_view/parquet_2 1.01 60.7±0.22ms 531.7 MB/sec 1.00 60.0±0.26ms 537.3 MB/sec string_and_binary_view/zstd 1.01 86.4±0.21ms 373.3 MB/sec 1.00 85.8±0.33ms 375.7 MB/sec string_and_binary_view/zstd_parquet_2 1.01 74.5±0.23ms 432.6 MB/sec 1.00 74.0±0.35ms 435.6 MB/sec string_dictionary/bloom_filter 1.06 91.9±0.98ms 2.8 GB/sec 1.00 86.3±1.29ms 3.0 GB/sec string_dictionary/cdc 1.03 49.6±0.65ms 5.2 GB/sec 1.00 48.3±0.75ms 5.3 GB/sec string_dictionary/default 1.04 45.5±0.74ms 5.7 GB/sec 1.00 43.8±0.86ms 5.9 GB/sec string_dictionary/parquet_2 1.00 48.8±0.24ms 5.3 GB/sec 1.00 48.7±0.18ms 5.3 GB/sec string_dictionary/zstd 1.02 214.8±1.48ms 1229.6 MB/sec 1.00 211.2±1.12ms 1250.9 MB/sec string_dictionary/zstd_parquet_2 1.01 193.2±0.38ms 1366.8 MB/sec 1.00 192.3±0.33ms 1373.8 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.01 34.6±0.13ms 115.7 MB/sec 1.00 34.2±0.12ms 117.0 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 28.1±0.13ms 142.7 MB/sec 1.00 27.8±0.11ms 144.1 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.8±0.14ms 155.3 MB/sec 1.00 25.5±0.11ms 157.3 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.01 25.8±0.13ms 155.1 MB/sec 1.00 25.5±0.11ms 157.2 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 26.1±0.13ms 153.3 MB/sec 1.00 25.9±0.13ms 154.7 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 26.2±0.09ms 153.2 MB/sec 1.00 25.9±0.14ms 154.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 34.1±0.12ms 117.6 MB/sec 1.00 34.1±0.16ms 117.4 MB/sec string_dictionary_low_cardinality_20/cdc 1.01 28.0±0.11ms 142.9 MB/sec 1.00 27.9±0.16ms 143.8 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.6±0.11ms 156.2 MB/sec 1.00 25.5±0.16ms 156.8 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.01 25.6±0.13ms 156.2 MB/sec 1.00 25.5±0.13ms 157.0 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.8±0.11ms 155.4 MB/sec 1.00 25.7±0.15ms 156.0 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.8±0.13ms 155.5 MB/sec 1.00 25.6±0.14ms 156.2 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.5±0.13ms 112.9 MB/sec 1.00 35.4±0.15ms 113.4 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.6±0.12ms 140.5 MB/sec 1.00 28.5±0.17ms 140.8 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.0±0.13ms 154.5 MB/sec 1.00 26.1±0.17ms 153.9 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.0±0.14ms 154.4 MB/sec 1.01 26.1±0.17ms 153.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.5±0.14ms 151.1 MB/sec 1.00 26.6±0.15ms 150.7 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.5±0.16ms 151.1 MB/sec 1.00 26.6±0.14ms 150.8 MB/sec string_non_null/bloom_filter 1.00 242.4±12.61ms 2.1 GB/sec 1.00 242.5±24.20ms 2.1 GB/sec string_non_null/cdc 1.07 251.3±5.03ms 2.0 GB/sec 1.00 234.0±0.81ms 2.2 GB/sec string_non_null/default 1.00 114.4±12.46ms 4.5 GB/sec 1.14 130.8±21.33ms 3.9 GB/sec string_non_null/parquet_2 1.05 116.0±6.33ms 4.4 GB/sec 1.00 111.0±8.80ms 4.6 GB/sec string_non_null/zstd 1.01 535.4±2.82ms 978.7 MB/sec 1.00 529.3±1.92ms 990.0 MB/sec string_non_null/zstd_parquet_2 1.03 502.8±3.22ms 1042.3 MB/sec 1.00 487.4±1.59ms 1075.1 MB/sec string_ree/bloom_filter 1.01 109.2±0.76ms 150.3 MB/sec 1.00 107.6±1.06ms 152.5 MB/sec string_ree/cdc 1.00 176.0±2.04ms 93.2 MB/sec 1.00 175.9±1.03ms 93.3 MB/sec string_ree/default 1.19 94.7±20.02ms 173.3 MB/sec 1.00 79.2±1.39ms 207.1 MB/sec string_ree/parquet_2 1.01 80.3±0.30ms 204.4 MB/sec 1.00 79.6±0.37ms 206.2 MB/sec string_ree/zstd 1.01 139.3±1.68ms 117.7 MB/sec 1.00 138.5±1.26ms 118.5 MB/sec string_ree/zstd_parquet_2 1.01 94.9±0.27ms 172.9 MB/sec 1.00 94.1±0.32ms 174.4 MB/sec string_ree_95pct_null/bloom_filter 1.01 26.7±0.16ms 52.6 MB/sec 1.00 26.5±0.17ms 53.0 MB/sec string_ree_95pct_null/cdc 1.00 33.0±0.18ms 42.6 MB/sec 1.01 33.3±0.17ms 42.3 MB/sec string_ree_95pct_null/default 1.00 25.0±0.09ms 56.2 MB/sec 1.00 25.1±0.06ms 56.2 MB/sec string_ree_95pct_null/parquet_2 1.00 25.1±0.08ms 56.1 MB/sec 1.00 25.1±0.10ms 56.1 MB/sec string_ree_95pct_null/zstd 1.00 25.8±0.10ms 54.5 MB/sec 1.00 26.0±0.08ms 54.2 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.7±0.12ms 54.7 MB/sec 1.00 25.8±0.05ms 54.6 MB/sec struct_all_null/bloom_filter 1.02 379.3±2.62µs 41.5 GB/sec 1.00 373.4±2.58µs 42.2 GB/sec struct_all_null/cdc 1.01 7.9±0.17ms 2044.9 MB/sec 1.00 7.8±0.14ms 2.0 GB/sec struct_all_null/default 1.00 117.7±0.76µs 133.8 GB/sec 1.00 118.0±0.80µs 133.5 GB/sec struct_all_null/parquet_2 1.00 122.0±0.77µs 129.1 GB/sec 1.00 121.5±0.85µs 129.6 GB/sec struct_all_null/zstd 1.00 182.3±1.33µs 86.4 GB/sec 1.00 182.2±0.82µs 86.4 GB/sec struct_all_null/zstd_parquet_2 1.00 162.9±1.37µs 96.7 GB/sec 1.00 162.2±0.88µs 97.1 GB/sec struct_non_null/bloom_filter 1.05 45.7±0.22ms 350.4 MB/sec 1.00 43.5±0.17ms 367.4 MB/sec struct_non_null/cdc 1.02 43.9±0.12ms 364.6 MB/sec 1.00 43.1±0.22ms 370.9 MB/sec struct_non_null/default 1.02 30.3±0.12ms 528.4 MB/sec 1.00 29.7±0.15ms 539.1 MB/sec struct_non_null/parquet_2 1.01 38.9±0.12ms 411.1 MB/sec 1.00 38.4±0.11ms 417.1 MB/sec struct_non_null/zstd 1.02 38.9±0.12ms 411.4 MB/sec 1.00 38.3±0.16ms 417.8 MB/sec struct_non_null/zstd_parquet_2 1.01 52.7±0.14ms 303.4 MB/sec 1.00 52.0±0.24ms 307.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.07ms 2.4 GB/sec 1.00 6.7±0.08ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 14.3±0.13ms 1127.3 MB/sec 1.00 14.4±0.14ms 1122.3 MB/sec struct_sparse_99pct_null/default 1.02 6.1±0.07ms 2.6 GB/sec 1.00 6.0±0.04ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.01 6.1±0.07ms 2.6 GB/sec 1.00 6.0±0.03ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.05ms 2.1 GB/sec 1.00 7.5±0.07ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.9±0.03ms 2.3 GB/sec 1.00 6.8±0.04ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3250.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3161.2s | | CPU sys | 83.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3270.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3185.0s | | CPU sys | 82.0s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
