adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336600179
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335761930) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.05ms 19.8 MB/sec 1.00 12.7±0.03ms 19.7 MB/sec bool/cdc 1.00 15.4±0.04ms 16.3 MB/sec 1.00 15.4±0.06ms 16.3 MB/sec bool/default 1.00 10.5±0.05ms 23.7 MB/sec 1.00 10.5±0.06ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.05ms 18.6 MB/sec 1.00 13.4±0.05ms 18.6 MB/sec bool/zstd 1.00 11.1±0.06ms 22.6 MB/sec 1.00 11.1±0.17ms 22.5 MB/sec bool/zstd_parquet_2 1.00 13.8±0.06ms 18.1 MB/sec 1.00 13.8±0.04ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.1 MB/sec 1.01 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.02ms 19.9 MB/sec 1.01 6.3±0.03ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.1 MB/sec 1.01 3.8±0.02ms 32.8 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.5 MB/sec 1.00 7.6±0.02ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.2 MB/sec 1.00 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.7 MB/sec 1.01 8.1±0.04ms 15.5 MB/sec bool_ree/bloom_filter 1.00 30.1±0.11ms 7.1 MB/sec 1.00 30.0±0.06ms 7.1 MB/sec bool_ree/cdc 1.00 31.4±0.12ms 6.8 MB/sec 1.00 31.3±0.07ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.11ms 7.8 MB/sec 1.00 27.3±0.12ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.09ms 7.4 MB/sec 1.00 28.8±0.09ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.09ms 7.6 MB/sec 1.00 27.9±0.12ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.11ms 7.3 MB/sec 1.00 29.1±0.06ms 7.3 MB/sec decimal/bloom_filter 1.01 120.2±0.80ms 499.1 MB/sec 1.00 118.9±0.36ms 504.4 MB/sec decimal/cdc 1.00 101.2±0.41ms 592.9 MB/sec 1.00 100.9±0.59ms 594.6 MB/sec decimal/default 1.03 80.7±1.18ms 743.5 MB/sec 1.00 78.6±0.27ms 763.8 MB/sec decimal/parquet_2 1.01 179.0±1.80ms 335.2 MB/sec 1.00 177.5±2.48ms 338.0 MB/sec decimal/zstd 1.01 90.1±1.44ms 666.1 MB/sec 1.00 89.4±0.31ms 671.0 MB/sec decimal/zstd_parquet_2 1.00 197.2±1.07ms 304.3 MB/sec 1.00 197.3±1.96ms 304.1 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.0±0.35ms 17.4 MB/sec 1.02 59.0±1.48ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.31ms 16.4 MB/sec 1.00 61.7±0.23ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.5±0.32ms 19.6 MB/sec 1.01 51.9±0.20ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.2±1.51ms 15.2 MB/sec 1.00 66.5±0.25ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.3±0.32ms 17.6 MB/sec 1.01 57.6±0.17ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.0±1.76ms 15.0 MB/sec 1.01 67.5±0.28ms 14.9 MB/sec float_with_nans/bloom_filter 1.00 80.9±0.69ms 173.1 MB/sec 1.00 80.7±0.95ms 173.5 MB/sec float_with_nans/cdc 1.02 71.8±0.51ms 195.1 MB/sec 1.00 70.4±0.42ms 198.9 MB/sec float_with_nans/default 1.03 64.7±2.46ms 216.3 MB/sec 1.00 63.1±0.98ms 222.0 MB/sec float_with_nans/parquet_2 1.01 80.8±0.40ms 173.2 MB/sec 1.00 80.3±0.20ms 174.4 MB/sec float_with_nans/zstd 1.00 101.7±1.95ms 137.7 MB/sec 1.00 101.2±0.18ms 138.3 MB/sec float_with_nans/zstd_parquet_2 1.00 117.5±0.42ms 119.1 MB/sec 1.00 117.4±1.43ms 119.2 MB/sec fsb/bloom_filter 1.00 8.0±0.06ms 2003.8 MB/sec 1.01 8.1±0.06ms 1990.0 MB/sec fsb/cdc 1.00 10.3±0.05ms 1561.1 MB/sec 1.01 10.5±0.05ms 1542.8 MB/sec fsb/default 1.00 6.9±0.04ms 2.3 GB/sec 1.01 7.0±0.02ms 2.3 GB/sec fsb/parquet_2 1.00 13.3±0.07ms 1215.9 MB/sec 1.01 13.4±0.09ms 1204.2 MB/sec fsb/zstd 1.00 9.4±0.07ms 1720.1 MB/sec 1.02 9.5±0.05ms 1693.0 MB/sec fsb/zstd_parquet_2 1.00 14.2±0.09ms 1139.0 MB/sec 1.01 14.4±0.08ms 1122.2 MB/sec int32_ree/bloom_filter 1.00 40.5±0.22ms 10.0 MB/sec 1.01 40.9±0.52ms 9.9 MB/sec int32_ree/cdc 1.00 40.4±0.11ms 10.1 MB/sec 1.00 40.4±0.13ms 10.1 MB/sec int32_ree/default 1.00 36.6±0.11ms 11.1 MB/sec 1.00 36.6±0.10ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.6±0.10ms 11.1 MB/sec 1.00 36.6±0.09ms 11.1 MB/sec int32_ree/zstd 1.00 37.3±0.11ms 10.9 MB/sec 1.00 37.2±0.11ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.10ms 11.0 MB/sec 1.00 37.1±0.07ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.05ms 18.6 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.02 24.3±0.04ms 16.8 MB/sec 1.00 23.8±0.05ms 17.1 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.6 MB/sec 1.00 21.8±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.03ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 64.2±0.36ms 3.9 GB/sec 1.17 75.3±0.56ms 3.3 GB/sec large_string_distinct/plain 1.00 60.3±1.30ms 4.1 GB/sec 1.00 60.4±1.06ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.12 60.7±0.54ms 4.1 GB/sec 1.00 54.4±0.41ms 4.6 GB/sec large_string_non_null/bloom_filter 1.00 72.5±0.11ms 3.4 GB/sec 1.01 73.2±0.27ms 3.4 GB/sec large_string_non_null/cdc 1.00 243.8±1.05ms 1050.2 MB/sec 1.00 243.3±1.18ms 1052.1 MB/sec large_string_non_null/default 1.00 54.7±0.09ms 4.6 GB/sec 1.00 54.8±0.46ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 54.8±0.09ms 4.6 GB/sec 1.00 54.8±0.43ms 4.6 GB/sec large_string_non_null/zstd 1.00 54.7±0.09ms 4.6 GB/sec 1.00 54.9±0.47ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.8±0.09ms 4.6 GB/sec 1.00 54.7±0.46ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 55.3±0.25ms 4.5 GB/sec 1.97 109.0±0.87ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 92.7±0.70ms 2.7 GB/sec 1.01 94.0±0.49ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 53.8±0.22ms 4.7 GB/sec 1.04 56.2±0.34ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 51.9±0.30ms 4.8 GB/sec 1.36 70.6±0.42ms 3.5 GB/sec large_string_shared_prefix_nullable/plain 1.01 63.9±0.35ms 3.9 GB/sec 1.00 63.4±0.67ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 28.1±0.14ms 4.4 GB/sec 1.94 54.4±0.25ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 52.0±0.29ms 4.8 GB/sec 1.32 68.8±0.34ms 3.6 GB/sec list_nested/bloom_filter 1.01 145.4±0.25ms 198.4 MB/sec 1.00 143.9±0.24ms 200.5 MB/sec list_nested/cdc 1.00 161.2±0.17ms 179.0 MB/sec 1.00 161.2±0.23ms 179.0 MB/sec list_nested/default 1.00 130.4±0.18ms 221.2 MB/sec 1.00 130.3±0.19ms 221.4 MB/sec list_nested/parquet_2 1.00 143.4±0.20ms 201.2 MB/sec 1.00 143.4±0.19ms 201.2 MB/sec list_nested/zstd 1.00 139.5±0.20ms 206.8 MB/sec 1.00 139.5±0.20ms 206.8 MB/sec list_nested/zstd_parquet_2 1.00 156.2±0.20ms 184.7 MB/sec 1.00 156.2±0.19ms 184.7 MB/sec list_primitive/bloom_filter 1.00 279.4±1.51ms 1951.9 MB/sec 1.04 290.2±1.56ms 1879.5 MB/sec list_primitive/cdc 1.00 310.9±1.26ms 1753.9 MB/sec 1.01 312.7±3.49ms 1744.2 MB/sec list_primitive/default 1.00 200.6±1.82ms 2.7 GB/sec 1.07 214.5±1.32ms 2.5 GB/sec list_primitive/parquet_2 1.00 222.1±0.38ms 2.4 GB/sec 1.02 226.5±4.60ms 2.4 GB/sec list_primitive/zstd 1.00 453.3±2.12ms 1203.1 MB/sec 1.00 454.2±1.98ms 1200.8 MB/sec list_primitive/zstd_parquet_2 1.00 445.0±1.30ms 1225.6 MB/sec 1.02 453.5±0.55ms 1202.5 MB/sec list_primitive_non_null/bloom_filter 1.00 388.0±5.29ms 1402.8 MB/sec 1.01 393.1±8.45ms 1384.6 MB/sec list_primitive_non_null/cdc 1.00 391.8±9.78ms 1389.1 MB/sec 1.00 391.2±6.70ms 1391.4 MB/sec list_primitive_non_null/default 1.00 256.9±5.62ms 2.1 GB/sec 1.00 256.3±8.13ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.12 290.5±0.58ms 1873.2 MB/sec 1.00 259.0±12.44ms 2.1 GB/sec list_primitive_non_null/zstd 1.07 678.2±3.11ms 802.5 MB/sec 1.00 635.2±3.31ms 856.8 MB/sec list_primitive_non_null/zstd_parquet_2 1.06 670.7±1.51ms 811.5 MB/sec 1.00 633.8±0.55ms 858.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.01 12.8±0.07ms 2.9 GB/sec 1.00 12.7±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.2±0.11ms 1546.6 MB/sec 1.00 24.1±0.11ms 1551.6 MB/sec list_primitive_sparse_99pct_null/default 1.01 12.4±0.05ms 2.9 GB/sec 1.00 12.3±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.5±0.04ms 2.9 GB/sec 1.00 12.4±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.08ms 2.5 GB/sec 1.00 14.3±0.06ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.6±0.06ms 2.9 GB/sec 1.00 12.5±0.09ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 282.1±0.99ms 161.6 MB/sec 1.00 282.5±0.49ms 161.4 MB/sec list_struct_with_list/cdc 1.00 318.6±0.43ms 143.1 MB/sec 1.00 319.0±1.07ms 142.9 MB/sec list_struct_with_list/default 1.00 254.6±0.53ms 179.1 MB/sec 1.00 253.7±0.47ms 179.7 MB/sec list_struct_with_list/parquet_2 1.00 271.7±0.38ms 167.8 MB/sec 1.00 271.3±0.45ms 168.1 MB/sec list_struct_with_list/zstd 1.00 276.3±0.43ms 165.0 MB/sec 1.00 275.7±0.43ms 165.4 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.9±0.39ms 154.6 MB/sec 1.00 294.6±0.50ms 154.8 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 37.8±0.09ms 6.6 GB/sec 1.09 41.1±0.98ms 6.1 GB/sec primitive/bloom_filter 1.00 144.8±0.63ms 309.8 MB/sec 1.00 145.2±0.53ms 309.1 MB/sec primitive/cdc 1.00 154.3±0.59ms 290.9 MB/sec 1.00 154.3±0.51ms 290.8 MB/sec primitive/default 1.00 113.6±0.41ms 395.1 MB/sec 1.00 113.8±0.36ms 394.2 MB/sec primitive/parquet_2 1.00 128.6±0.44ms 349.0 MB/sec 1.00 128.9±0.41ms 348.1 MB/sec primitive/zstd 1.00 143.2±0.39ms 313.4 MB/sec 1.00 143.5±0.38ms 312.7 MB/sec primitive/zstd_parquet_2 1.00 161.9±0.65ms 277.2 MB/sec 1.00 161.8±0.37ms 277.3 MB/sec primitive_all_null/bloom_filter 1.00 886.2±2.16µs 49.4 GB/sec 1.01 895.8±2.18µs 48.9 GB/sec primitive_all_null/cdc 1.01 19.1±0.26ms 2.3 GB/sec 1.00 18.9±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 272.3±1.22µs 160.9 GB/sec 1.02 277.3±1.64µs 158.1 GB/sec primitive_all_null/parquet_2 1.00 281.7±1.33µs 155.6 GB/sec 1.01 283.3±1.35µs 154.7 GB/sec primitive_all_null/zstd 1.00 423.8±1.25µs 103.4 GB/sec 1.00 423.8±1.66µs 103.4 GB/sec primitive_all_null/zstd_parquet_2 1.00 382.0±1.53µs 114.7 GB/sec 1.00 382.3±1.22µs 114.6 GB/sec primitive_non_null/bloom_filter 1.00 100.5±0.52ms 437.8 MB/sec 1.01 101.7±0.44ms 432.6 MB/sec primitive_non_null/cdc 1.00 84.4±0.29ms 521.1 MB/sec 1.01 85.3±0.30ms 516.1 MB/sec primitive_non_null/default 1.00 61.9±0.24ms 711.3 MB/sec 1.01 62.2±0.24ms 707.0 MB/sec primitive_non_null/parquet_2 1.00 83.7±0.27ms 526.0 MB/sec 1.01 84.4±0.37ms 521.2 MB/sec primitive_non_null/zstd 1.00 92.4±0.27ms 476.2 MB/sec 1.01 93.5±0.55ms 470.7 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.7±0.31ms 377.0 MB/sec 1.01 117.7±0.54ms 373.7 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.2±0.12ms 3.6 GB/sec 1.01 12.2±0.13ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.01 29.7±0.39ms 1510.0 MB/sec 1.00 29.6±0.35ms 1518.3 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.05ms 4.1 GB/sec 1.00 10.8±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.8±0.04ms 4.1 GB/sec 1.00 10.8±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.07ms 3.1 GB/sec 1.00 14.1±0.07ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 3.5 GB/sec 1.00 12.7±0.07ms 3.5 GB/sec short_string_non_null/bloom_filter 1.01 27.9±0.07ms 430.7 MB/sec 1.00 27.7±0.10ms 433.0 MB/sec short_string_non_null/cdc 1.00 19.7±0.06ms 608.6 MB/sec 1.00 19.8±0.05ms 606.5 MB/sec short_string_non_null/default 1.00 15.6±0.06ms 767.8 MB/sec 1.01 15.8±0.08ms 759.6 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.06ms 463.2 MB/sec 1.00 26.0±0.07ms 462.3 MB/sec short_string_non_null/zstd 1.00 35.9±0.09ms 333.8 MB/sec 1.00 36.0±0.09ms 333.8 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.09ms 415.8 MB/sec 1.00 28.8±0.06ms 416.4 MB/sec small_string_distinct/delta_byte_array 1.00 932.9±8.50µs 8.4 GB/sec 1.06 990.9±9.76µs 7.9 GB/sec small_string_distinct/plain 1.00 675.0±6.74µs 11.6 GB/sec 1.13 760.2±6.79µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 991.5±4.85µs 7.9 GB/sec 1.01 1005.2±5.96µs 7.8 GB/sec small_string_partial_prefix/plain 1.00 928.2±6.81µs 8.4 GB/sec 1.10 1024.2±7.12µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.00 974.4±1.65µs 8.0 GB/sec 1.00 970.1±0.94µs 8.1 GB/sec small_string_shared_prefix/plain 1.00 1024.9±9.52µs 7.7 GB/sec 1.09 1117.4±7.84µs 7.0 GB/sec string/bloom_filter 1.02 211.4±21.60ms 2.4 GB/sec 1.00 208.0±19.32ms 2.5 GB/sec string/cdc 1.00 201.0±1.02ms 2.5 GB/sec 1.04 209.9±10.89ms 2.4 GB/sec string/default 1.04 128.5±24.69ms 4.0 GB/sec 1.00 123.5±22.12ms 4.1 GB/sec string/parquet_2 1.00 165.2±0.56ms 3.1 GB/sec 1.01 166.7±0.86ms 3.1 GB/sec string/zstd 1.00 465.1±12.06ms 1127.1 MB/sec 1.02 472.3±12.92ms 1109.9 MB/sec string/zstd_parquet_2 1.00 384.6±4.88ms 1363.1 MB/sec 1.15 443.0±2.29ms 1183.5 MB/sec string_and_binary_view/bloom_filter 1.00 64.7±0.45ms 498.5 MB/sec 1.01 65.1±0.16ms 495.1 MB/sec string_and_binary_view/cdc 1.01 59.6±0.45ms 541.1 MB/sec 1.00 59.0±0.14ms 546.6 MB/sec string_and_binary_view/default 1.00 48.5±0.34ms 664.9 MB/sec 1.00 48.4±0.14ms 666.9 MB/sec string_and_binary_view/parquet_2 1.00 59.7±0.39ms 539.9 MB/sec 1.00 59.7±0.15ms 540.3 MB/sec string_and_binary_view/zstd 1.00 85.5±0.36ms 377.4 MB/sec 1.00 85.5±0.14ms 377.0 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.7±0.39ms 437.6 MB/sec 1.00 73.6±0.13ms 438.2 MB/sec string_dictionary/bloom_filter 1.00 84.4±0.33ms 3.1 GB/sec 1.00 84.3±0.82ms 3.1 GB/sec string_dictionary/cdc 1.00 46.4±0.87ms 5.6 GB/sec 1.02 47.2±0.45ms 5.5 GB/sec string_dictionary/default 1.00 43.0±0.44ms 6.0 GB/sec 1.00 43.0±0.95ms 6.0 GB/sec string_dictionary/parquet_2 1.00 47.9±0.11ms 5.4 GB/sec 1.01 48.4±0.28ms 5.3 GB/sec string_dictionary/zstd 1.00 206.8±0.42ms 1277.3 MB/sec 1.00 207.5±0.56ms 1273.1 MB/sec string_dictionary/zstd_parquet_2 1.00 192.1±0.11ms 1374.8 MB/sec 1.00 192.0±0.13ms 1375.4 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.2±0.15ms 117.2 MB/sec 1.00 34.3±0.08ms 116.7 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.7±0.12ms 144.8 MB/sec 1.01 27.8±0.07ms 144.1 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.14ms 157.9 MB/sec 1.00 25.5±0.06ms 157.2 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.4±0.13ms 157.7 MB/sec 1.00 25.5±0.07ms 157.4 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.7±0.13ms 155.6 MB/sec 1.00 25.8±0.07ms 155.3 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.7±0.12ms 155.8 MB/sec 1.00 25.7±0.07ms 155.6 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.4±0.14ms 120.0 MB/sec 1.01 33.6±0.13ms 119.0 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.4±0.13ms 146.4 MB/sec 1.02 27.8±0.09ms 143.9 MB/sec string_dictionary_low_cardinality_20/default 1.00 24.9±0.14ms 160.6 MB/sec 1.02 25.5±0.09ms 157.1 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 24.9±0.14ms 160.6 MB/sec 1.02 25.5±0.09ms 156.9 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.1±0.14ms 159.7 MB/sec 1.02 25.6±0.08ms 156.4 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.1±0.13ms 159.4 MB/sec 1.02 25.6±0.08ms 156.5 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.1±0.17ms 114.3 MB/sec 1.00 34.7±0.10ms 115.7 MB/sec string_dictionary_low_cardinality_400/cdc 1.01 28.1±0.13ms 142.5 MB/sec 1.00 27.9±0.07ms 143.7 MB/sec string_dictionary_low_cardinality_400/default 1.01 25.7±0.13ms 155.8 MB/sec 1.00 25.5±0.07ms 157.6 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.01 25.8±0.12ms 155.5 MB/sec 1.00 25.5±0.08ms 157.4 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 26.3±0.13ms 152.5 MB/sec 1.00 26.0±0.09ms 154.1 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.3±0.13ms 152.7 MB/sec 1.00 26.0±0.07ms 154.5 MB/sec string_non_null/bloom_filter 1.00 228.6±6.16ms 2.2 GB/sec 1.05 240.4±12.54ms 2.1 GB/sec string_non_null/cdc 1.01 236.2±1.14ms 2.2 GB/sec 1.00 233.9±0.45ms 2.2 GB/sec string_non_null/default 1.00 112.7±7.23ms 4.5 GB/sec 1.11 125.0±13.94ms 4.1 GB/sec string_non_null/parquet_2 1.10 128.5±9.04ms 4.0 GB/sec 1.00 116.8±11.78ms 4.4 GB/sec string_non_null/zstd 1.00 558.9±9.30ms 937.5 MB/sec 1.00 557.2±9.28ms 940.5 MB/sec string_non_null/zstd_parquet_2 1.00 487.1±0.33ms 1075.8 MB/sec 1.01 492.1±9.79ms 1064.7 MB/sec string_ree/bloom_filter 1.41 150.4±0.65ms 109.1 MB/sec 1.00 106.8±0.42ms 153.6 MB/sec string_ree/cdc 1.15 201.9±15.27ms 81.2 MB/sec 1.00 176.1±1.31ms 93.2 MB/sec string_ree/default 1.54 122.5±1.20ms 134.0 MB/sec 1.00 79.3±0.40ms 206.8 MB/sec string_ree/parquet_2 1.55 123.6±0.48ms 132.7 MB/sec 1.00 79.9±0.35ms 205.2 MB/sec string_ree/zstd 1.00 136.4±0.51ms 120.3 MB/sec 1.00 137.1±0.67ms 119.7 MB/sec string_ree/zstd_parquet_2 1.00 94.4±0.34ms 173.7 MB/sec 1.00 94.2±0.25ms 174.2 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.2±0.13ms 53.7 MB/sec 1.00 26.2±0.16ms 53.7 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.13ms 43.6 MB/sec 1.00 32.3±0.13ms 43.6 MB/sec string_ree_95pct_null/default 1.00 24.7±0.11ms 56.9 MB/sec 1.00 24.8±0.11ms 56.8 MB/sec string_ree_95pct_null/parquet_2 1.00 24.7±0.09ms 56.9 MB/sec 1.00 24.7±0.09ms 56.9 MB/sec string_ree_95pct_null/zstd 1.00 25.5±0.10ms 55.1 MB/sec 1.00 25.6±0.12ms 55.1 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.4±0.11ms 55.3 MB/sec 1.00 25.5±0.13ms 55.2 MB/sec struct_all_null/bloom_filter 1.00 372.9±1.37µs 42.2 GB/sec 1.01 376.7±1.96µs 41.8 GB/sec struct_all_null/cdc 1.00 7.8±0.08ms 2.0 GB/sec 1.01 7.9±0.17ms 2045.8 MB/sec struct_all_null/default 1.00 117.7±0.57µs 133.8 GB/sec 1.01 118.8±0.72µs 132.6 GB/sec struct_all_null/parquet_2 1.00 121.8±0.63µs 129.3 GB/sec 1.00 122.1±0.56µs 129.0 GB/sec struct_all_null/zstd 1.00 182.6±0.64µs 86.3 GB/sec 1.00 182.6±0.65µs 86.3 GB/sec struct_all_null/zstd_parquet_2 1.00 165.5±0.66µs 95.1 GB/sec 1.00 165.1±0.58µs 95.4 GB/sec struct_non_null/bloom_filter 1.00 43.7±0.15ms 366.1 MB/sec 1.01 44.3±0.17ms 361.2 MB/sec struct_non_null/cdc 1.01 43.2±0.21ms 370.1 MB/sec 1.00 43.0±0.15ms 372.0 MB/sec struct_non_null/default 1.00 29.7±0.12ms 539.4 MB/sec 1.00 29.7±0.12ms 539.1 MB/sec struct_non_null/parquet_2 1.00 38.3±0.12ms 417.5 MB/sec 1.01 38.5±0.13ms 415.4 MB/sec struct_non_null/zstd 1.00 38.1±0.12ms 419.8 MB/sec 1.00 38.3±0.13ms 418.2 MB/sec struct_non_null/zstd_parquet_2 1.00 51.9±0.15ms 308.0 MB/sec 1.01 52.3±0.12ms 306.2 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.04ms 2.4 GB/sec 1.05 6.9±0.04ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.09ms 1195.5 MB/sec 1.02 13.7±0.09ms 1174.7 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.03ms 2.6 GB/sec 1.05 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.06 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.02ms 2.1 GB/sec 1.05 7.7±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.05 7.1±0.02ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3162.2s | | CPU sys | 69.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3142.1s | | CPU sys | 89.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
