adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336540403
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335761493) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.01 12.7±0.08ms 19.7 MB/sec 1.00 12.7±0.03ms 19.8 MB/sec bool/cdc 1.00 15.4±0.04ms 16.2 MB/sec 1.00 15.5±0.05ms 16.2 MB/sec bool/default 1.00 10.5±0.05ms 23.7 MB/sec 1.00 10.5±0.03ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.04ms 18.6 MB/sec 1.00 13.5±0.04ms 18.6 MB/sec bool/zstd 1.00 11.1±0.04ms 22.6 MB/sec 1.00 11.1±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.8±0.04ms 18.1 MB/sec 1.00 13.9±0.05ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.1 MB/sec 1.01 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 19.8 MB/sec 1.02 6.4±0.03ms 19.5 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.2 MB/sec 1.01 3.8±0.02ms 32.7 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.5 MB/sec 1.01 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.3 MB/sec 1.01 4.2±0.02ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.02ms 15.7 MB/sec 1.01 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.1±0.06ms 7.1 MB/sec 1.00 30.1±0.04ms 7.1 MB/sec bool_ree/cdc 1.00 31.4±0.08ms 6.8 MB/sec 1.00 31.5±0.13ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.06ms 7.8 MB/sec 1.00 27.4±0.09ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.11ms 7.4 MB/sec 1.00 28.8±0.06ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.08ms 7.6 MB/sec 1.00 28.0±0.06ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.06ms 7.3 MB/sec 1.00 29.1±0.06ms 7.3 MB/sec decimal/bloom_filter 1.01 119.5±1.18ms 502.1 MB/sec 1.00 117.8±1.09ms 509.5 MB/sec decimal/cdc 1.01 101.6±0.36ms 590.4 MB/sec 1.00 100.8±0.44ms 595.1 MB/sec decimal/default 1.01 79.4±0.41ms 755.4 MB/sec 1.00 78.8±0.28ms 761.7 MB/sec decimal/parquet_2 1.00 178.0±1.14ms 337.1 MB/sec 1.00 178.5±2.02ms 336.2 MB/sec decimal/zstd 1.01 90.7±0.40ms 661.5 MB/sec 1.00 89.6±0.30ms 669.6 MB/sec decimal/zstd_parquet_2 1.00 198.4±1.63ms 302.4 MB/sec 1.00 198.2±2.29ms 302.7 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.9±0.24ms 17.1 MB/sec 1.00 58.9±0.24ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.7±0.18ms 16.3 MB/sec 1.00 61.9±0.22ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 51.6±0.19ms 19.5 MB/sec 1.00 51.8±0.21ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.9±0.27ms 15.0 MB/sec 1.00 66.9±0.99ms 15.0 MB/sec fixed_size_binary_ree/zstd 1.00 57.4±0.17ms 17.5 MB/sec 1.00 57.5±0.96ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 67.2±0.34ms 15.0 MB/sec 1.01 67.9±1.33ms 14.8 MB/sec float_with_nans/bloom_filter 1.00 81.3±0.30ms 172.2 MB/sec 1.00 81.0±0.28ms 172.8 MB/sec float_with_nans/cdc 1.00 70.5±0.27ms 198.6 MB/sec 1.00 70.7±0.40ms 198.0 MB/sec float_with_nans/default 1.00 63.3±0.25ms 221.0 MB/sec 1.00 63.5±1.41ms 220.3 MB/sec float_with_nans/parquet_2 1.00 80.9±1.12ms 173.0 MB/sec 1.00 80.8±1.72ms 173.2 MB/sec float_with_nans/zstd 1.00 101.5±1.50ms 137.9 MB/sec 1.00 102.0±1.42ms 137.2 MB/sec float_with_nans/zstd_parquet_2 1.00 117.7±1.52ms 119.0 MB/sec 1.00 117.7±0.23ms 119.0 MB/sec fsb/bloom_filter 1.00 8.2±0.07ms 1975.1 MB/sec 1.02 8.4±0.06ms 1928.4 MB/sec fsb/cdc 1.00 10.6±0.08ms 1521.8 MB/sec 1.00 10.6±0.06ms 1527.9 MB/sec fsb/default 1.00 7.1±0.06ms 2.2 GB/sec 1.02 7.2±0.06ms 2.2 GB/sec fsb/parquet_2 1.00 13.5±0.10ms 1198.8 MB/sec 1.02 13.7±0.09ms 1180.7 MB/sec fsb/zstd 1.00 9.5±0.07ms 1689.3 MB/sec 1.01 9.7±0.05ms 1668.2 MB/sec fsb/zstd_parquet_2 1.00 14.3±0.08ms 1128.5 MB/sec 1.02 14.6±0.08ms 1105.1 MB/sec int32_ree/bloom_filter 1.00 41.4±0.15ms 9.8 MB/sec 1.01 41.7±0.14ms 9.8 MB/sec int32_ree/cdc 1.00 40.6±0.08ms 10.0 MB/sec 1.00 40.6±0.09ms 10.0 MB/sec int32_ree/default 1.00 36.8±0.09ms 11.1 MB/sec 1.00 36.7±0.06ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.7±0.07ms 11.1 MB/sec 1.00 36.6±0.06ms 11.1 MB/sec int32_ree/zstd 1.00 37.3±0.06ms 10.9 MB/sec 1.00 37.3±0.13ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.07ms 10.9 MB/sec 1.00 37.2±0.07ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 22.2±0.05ms 18.4 MB/sec 1.00 22.1±0.05ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 24.1±0.05ms 16.9 MB/sec 1.00 24.0±0.05ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.7±0.03ms 18.8 MB/sec 1.00 21.7±0.02ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.7±0.02ms 18.8 MB/sec 1.00 21.7±0.02ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 22.0±0.07ms 18.5 MB/sec 1.00 21.9±0.02ms 18.5 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.9±0.02ms 18.6 MB/sec 1.00 21.8±0.02ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.00 65.6±0.52ms 3.8 GB/sec 1.17 76.9±1.26ms 3.3 GB/sec large_string_distinct/plain 1.00 59.9±1.00ms 4.2 GB/sec 1.03 61.5±1.36ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.09 61.6±0.53ms 4.1 GB/sec 1.00 56.3±0.61ms 4.4 GB/sec large_string_non_null/bloom_filter 1.02 73.1±0.18ms 3.4 GB/sec 1.00 71.9±0.15ms 3.5 GB/sec large_string_non_null/cdc 1.01 244.4±1.13ms 1047.4 MB/sec 1.00 243.0±0.89ms 1053.4 MB/sec large_string_non_null/default 1.02 55.5±0.19ms 4.5 GB/sec 1.00 54.2±0.17ms 4.6 GB/sec large_string_non_null/parquet_2 1.01 54.9±0.13ms 4.6 GB/sec 1.00 54.2±0.12ms 4.6 GB/sec large_string_non_null/zstd 1.01 55.0±0.12ms 4.5 GB/sec 1.00 54.3±0.21ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.01 54.9±0.12ms 4.6 GB/sec 1.00 54.3±0.12ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 56.2±0.62ms 4.5 GB/sec 1.97 110.7±2.36ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 93.7±1.07ms 2.7 GB/sec 1.01 94.2±0.91ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 55.4±0.51ms 4.5 GB/sec 1.02 56.5±0.40ms 4.4 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 52.0±0.37ms 4.8 GB/sec 1.39 72.1±0.66ms 3.5 GB/sec large_string_shared_prefix_nullable/plain 1.02 65.5±0.59ms 3.8 GB/sec 1.00 64.3±0.49ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.9±0.18ms 4.5 GB/sec 1.98 55.2±0.54ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 52.2±0.37ms 4.8 GB/sec 1.33 69.6±0.67ms 3.6 GB/sec list_nested/bloom_filter 1.00 145.0±0.36ms 199.0 MB/sec 1.00 144.6±0.29ms 199.5 MB/sec list_nested/cdc 1.00 161.7±0.47ms 178.4 MB/sec 1.00 161.6±0.21ms 178.5 MB/sec list_nested/default 1.00 130.5±0.22ms 221.0 MB/sec 1.00 130.9±0.26ms 220.4 MB/sec list_nested/parquet_2 1.00 143.5±0.22ms 201.0 MB/sec 1.00 143.9±0.17ms 200.6 MB/sec list_nested/zstd 1.00 139.7±0.29ms 206.5 MB/sec 1.00 140.1±0.24ms 205.9 MB/sec list_nested/zstd_parquet_2 1.00 156.6±0.29ms 184.2 MB/sec 1.00 156.7±0.20ms 184.1 MB/sec list_primitive/bloom_filter 1.01 283.3±1.28ms 1925.4 MB/sec 1.00 279.1±2.43ms 1954.1 MB/sec list_primitive/cdc 1.00 313.6±2.04ms 1739.1 MB/sec 1.00 312.2±1.36ms 1746.7 MB/sec list_primitive/default 1.00 202.6±2.18ms 2.6 GB/sec 1.00 202.5±1.51ms 2.6 GB/sec list_primitive/parquet_2 1.00 223.2±0.50ms 2.4 GB/sec 1.00 222.6±0.31ms 2.4 GB/sec list_primitive/zstd 1.00 457.3±4.04ms 1192.7 MB/sec 1.00 457.2±1.67ms 1192.9 MB/sec list_primitive/zstd_parquet_2 1.00 444.5±0.55ms 1226.9 MB/sec 1.00 444.6±0.58ms 1226.7 MB/sec list_primitive_non_null/bloom_filter 1.00 366.6±5.04ms 1484.4 MB/sec 1.01 370.0±5.39ms 1471.0 MB/sec list_primitive_non_null/cdc 1.00 393.7±8.21ms 1382.4 MB/sec 1.00 394.0±6.29ms 1381.4 MB/sec list_primitive_non_null/default 1.00 224.8±4.72ms 2.4 GB/sec 1.01 227.5±5.84ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.00 246.1±4.97ms 2.2 GB/sec 1.05 257.2±0.77ms 2.1 GB/sec list_primitive_non_null/zstd 1.00 644.1±4.42ms 845.0 MB/sec 1.00 643.4±4.08ms 845.9 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 638.9±3.87ms 851.9 MB/sec 1.01 644.3±0.72ms 844.7 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.9±0.10ms 2.8 GB/sec 1.01 13.1±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.5±0.11ms 1527.2 MB/sec 1.00 24.5±0.07ms 1526.0 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.7±0.09ms 2.9 GB/sec 1.00 12.7±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.7±0.05ms 2.9 GB/sec 1.00 12.7±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.5±0.08ms 2.5 GB/sec 1.00 14.4±0.09ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.8±0.07ms 2.9 GB/sec 1.01 12.9±0.05ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.00 281.4±0.40ms 162.0 MB/sec 1.01 283.6±0.60ms 160.8 MB/sec list_struct_with_list/cdc 1.00 319.0±0.56ms 142.9 MB/sec 1.00 319.2±0.55ms 142.8 MB/sec list_struct_with_list/default 1.00 254.7±0.46ms 179.0 MB/sec 1.00 254.3±0.54ms 179.3 MB/sec list_struct_with_list/parquet_2 1.00 272.1±0.99ms 167.6 MB/sec 1.00 271.8±0.53ms 167.8 MB/sec list_struct_with_list/zstd 1.00 276.4±0.60ms 164.9 MB/sec 1.00 276.1±0.47ms 165.1 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.2±0.39ms 154.5 MB/sec 1.00 296.3±0.75ms 153.9 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 37.1±0.11ms 6.7 GB/sec 1.11 41.0±0.36ms 6.1 GB/sec primitive/bloom_filter 1.00 146.8±0.51ms 305.7 MB/sec 1.02 149.7±0.55ms 299.9 MB/sec primitive/cdc 1.00 156.0±0.86ms 287.7 MB/sec 1.00 156.5±0.67ms 286.8 MB/sec primitive/default 1.00 114.7±0.39ms 391.2 MB/sec 1.01 115.5±0.37ms 388.5 MB/sec primitive/parquet_2 1.00 130.5±0.89ms 343.8 MB/sec 1.00 131.1±1.09ms 342.2 MB/sec primitive/zstd 1.00 145.0±0.75ms 309.4 MB/sec 1.00 145.7±0.42ms 308.0 MB/sec primitive/zstd_parquet_2 1.00 162.7±0.35ms 275.9 MB/sec 1.01 163.9±0.38ms 273.8 MB/sec primitive_all_null/bloom_filter 1.00 901.4±6.32µs 48.6 GB/sec 1.00 902.6±7.02µs 48.6 GB/sec primitive_all_null/cdc 1.00 18.9±0.22ms 2.3 GB/sec 1.00 18.9±0.31ms 2.3 GB/sec primitive_all_null/default 1.00 273.8±2.07µs 160.0 GB/sec 1.00 274.1±1.36µs 159.9 GB/sec primitive_all_null/parquet_2 1.00 282.0±1.60µs 155.4 GB/sec 1.00 282.1±1.23µs 155.4 GB/sec primitive_all_null/zstd 1.01 426.4±1.75µs 102.8 GB/sec 1.00 423.4±1.14µs 103.5 GB/sec primitive_all_null/zstd_parquet_2 1.00 382.8±1.61µs 114.5 GB/sec 1.00 381.9±1.10µs 114.7 GB/sec primitive_non_null/bloom_filter 1.00 101.9±0.37ms 431.7 MB/sec 1.05 106.5±0.38ms 413.0 MB/sec primitive_non_null/cdc 1.00 85.3±0.40ms 515.8 MB/sec 1.01 86.6±0.35ms 508.2 MB/sec primitive_non_null/default 1.00 62.9±0.21ms 699.3 MB/sec 1.01 63.8±0.25ms 689.3 MB/sec primitive_non_null/parquet_2 1.00 84.4±0.27ms 521.1 MB/sec 1.02 85.7±0.23ms 513.3 MB/sec primitive_non_null/zstd 1.00 93.9±0.35ms 468.8 MB/sec 1.01 94.4±0.30ms 466.2 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.8±0.22ms 373.7 MB/sec 1.01 119.3±0.25ms 369.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.01 13.0±0.13ms 3.4 GB/sec 1.00 13.0±0.11ms 3.4 GB/sec primitive_sparse_99pct_null/cdc 1.01 30.3±0.31ms 1481.2 MB/sec 1.00 30.1±0.24ms 1493.2 MB/sec primitive_sparse_99pct_null/default 1.00 11.1±0.07ms 4.0 GB/sec 1.00 11.0±0.07ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 11.1±0.06ms 4.0 GB/sec 1.00 11.1±0.08ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.5±0.09ms 3.0 GB/sec 1.01 14.6±0.06ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 13.1±0.06ms 3.4 GB/sec 1.00 13.1±0.05ms 3.3 GB/sec short_string_non_null/bloom_filter 1.04 28.4±0.06ms 423.0 MB/sec 1.00 27.2±0.04ms 441.0 MB/sec short_string_non_null/cdc 1.01 20.0±0.06ms 600.5 MB/sec 1.00 19.8±0.05ms 605.3 MB/sec short_string_non_null/default 1.02 16.0±0.03ms 749.0 MB/sec 1.00 15.7±0.04ms 763.9 MB/sec short_string_non_null/parquet_2 1.02 26.3±0.08ms 456.3 MB/sec 1.00 25.9±0.03ms 464.1 MB/sec short_string_non_null/zstd 1.01 36.2±0.06ms 331.5 MB/sec 1.00 35.9±0.09ms 333.9 MB/sec short_string_non_null/zstd_parquet_2 1.02 29.2±0.12ms 410.3 MB/sec 1.00 28.8±0.04ms 417.2 MB/sec small_string_distinct/delta_byte_array 1.00 963.1±3.99µs 8.1 GB/sec 1.04 1005.7±6.95µs 7.8 GB/sec small_string_distinct/plain 1.00 762.5±6.42µs 10.3 GB/sec 1.02 778.5±6.27µs 10.1 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1001.8±7.93µs 7.8 GB/sec 1.05 1050.3±12.70µs 7.5 GB/sec small_string_partial_prefix/plain 1.00 1003.1±12.01µs 7.8 GB/sec 1.04 1047.4±12.45µs 7.5 GB/sec small_string_shared_prefix/delta_byte_array 1.00 985.8±4.71µs 8.0 GB/sec 1.00 982.8±5.98µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1102.2±4.76µs 7.1 GB/sec 1.03 1131.7±5.07µs 6.9 GB/sec string/bloom_filter 1.00 215.0±20.97ms 2.4 GB/sec 1.00 215.8±18.89ms 2.4 GB/sec string/cdc 1.00 203.7±1.45ms 2.5 GB/sec 1.02 206.8±9.80ms 2.5 GB/sec string/default 1.02 126.8±22.27ms 4.0 GB/sec 1.00 123.8±20.84ms 4.1 GB/sec string/parquet_2 1.00 162.4±0.58ms 3.2 GB/sec 1.02 166.3±0.62ms 3.1 GB/sec string/zstd 1.00 468.4±11.37ms 1119.3 MB/sec 1.00 468.0±11.30ms 1120.1 MB/sec string/zstd_parquet_2 1.00 388.4±8.63ms 1349.7 MB/sec 1.14 444.2±0.79ms 1180.1 MB/sec string_and_binary_view/bloom_filter 1.03 65.9±0.36ms 489.3 MB/sec 1.00 64.0±0.24ms 504.3 MB/sec string_and_binary_view/cdc 1.02 59.9±0.32ms 538.0 MB/sec 1.00 58.7±0.15ms 549.2 MB/sec string_and_binary_view/default 1.02 49.1±0.27ms 656.3 MB/sec 1.00 48.1±0.17ms 670.2 MB/sec string_and_binary_view/parquet_2 1.02 60.3±0.31ms 534.9 MB/sec 1.00 59.3±0.13ms 544.1 MB/sec string_and_binary_view/zstd 1.01 86.2±0.27ms 374.3 MB/sec 1.00 85.4±0.17ms 377.5 MB/sec string_and_binary_view/zstd_parquet_2 1.01 74.2±0.28ms 434.6 MB/sec 1.00 73.4±0.24ms 439.2 MB/sec string_dictionary/bloom_filter 1.03 88.2±2.42ms 2.9 GB/sec 1.00 86.0±1.04ms 3.0 GB/sec string_dictionary/cdc 1.00 47.7±1.11ms 5.4 GB/sec 1.01 48.1±0.71ms 5.4 GB/sec string_dictionary/default 1.02 44.1±0.80ms 5.8 GB/sec 1.00 43.2±1.04ms 6.0 GB/sec string_dictionary/parquet_2 1.03 49.6±0.20ms 5.2 GB/sec 1.00 48.4±0.11ms 5.3 GB/sec string_dictionary/zstd 1.00 210.8±0.52ms 1253.1 MB/sec 1.00 210.7±1.26ms 1253.3 MB/sec string_dictionary/zstd_parquet_2 1.01 192.6±0.19ms 1371.1 MB/sec 1.00 191.6±0.15ms 1378.9 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.02 34.7±0.11ms 115.3 MB/sec 1.00 34.1±0.07ms 117.3 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 28.1±0.13ms 142.5 MB/sec 1.00 27.9±0.08ms 143.8 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.7±0.13ms 155.9 MB/sec 1.00 25.5±0.07ms 157.1 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.01 25.7±0.13ms 155.6 MB/sec 1.00 25.5±0.07ms 157.1 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 26.1±0.13ms 153.3 MB/sec 1.00 25.8±0.06ms 155.0 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 26.1±0.12ms 153.6 MB/sec 1.00 25.8±0.07ms 155.1 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.7±0.15ms 118.8 MB/sec 1.00 33.6±0.10ms 119.0 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.8±0.15ms 144.3 MB/sec 1.01 28.0±0.09ms 143.1 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.4±0.15ms 157.7 MB/sec 1.01 25.7±0.10ms 156.1 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.4±0.15ms 157.8 MB/sec 1.01 25.6±0.10ms 156.5 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.6±0.15ms 156.7 MB/sec 1.01 25.8±0.11ms 155.2 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.6±0.14ms 156.8 MB/sec 1.01 25.8±0.09ms 155.5 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.4±0.15ms 113.4 MB/sec 1.00 34.9±0.07ms 115.0 MB/sec string_dictionary_low_cardinality_400/cdc 1.02 28.6±0.17ms 140.1 MB/sec 1.00 28.1±0.09ms 142.6 MB/sec string_dictionary_low_cardinality_400/default 1.02 26.2±0.16ms 153.4 MB/sec 1.00 25.7±0.07ms 156.0 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.02 26.2±0.14ms 153.4 MB/sec 1.00 25.8±0.07ms 155.8 MB/sec string_dictionary_low_cardinality_400/zstd 1.02 26.7±0.14ms 150.3 MB/sec 1.00 26.3±0.08ms 152.8 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.6±0.14ms 150.6 MB/sec 1.00 26.2±0.07ms 152.9 MB/sec string_non_null/bloom_filter 1.00 232.4±11.18ms 2.2 GB/sec 1.05 243.4±12.26ms 2.1 GB/sec string_non_null/cdc 1.04 254.2±3.25ms 2.0 GB/sec 1.00 245.0±2.47ms 2.1 GB/sec string_non_null/default 1.04 131.7±22.68ms 3.9 GB/sec 1.00 126.0±12.13ms 4.1 GB/sec string_non_null/parquet_2 1.00 110.8±4.43ms 4.6 GB/sec 1.05 115.9±11.99ms 4.4 GB/sec string_non_null/zstd 1.08 571.8±6.96ms 916.4 MB/sec 1.00 531.2±1.67ms 986.5 MB/sec string_non_null/zstd_parquet_2 1.02 503.3±2.43ms 1041.2 MB/sec 1.00 492.6±3.97ms 1063.7 MB/sec string_ree/bloom_filter 1.02 149.8±2.53ms 109.5 MB/sec 1.00 146.9±0.56ms 111.7 MB/sec string_ree/cdc 1.02 222.2±1.66ms 73.8 MB/sec 1.00 217.3±1.27ms 75.5 MB/sec string_ree/default 1.01 120.5±2.34ms 136.2 MB/sec 1.00 118.7±1.19ms 138.2 MB/sec string_ree/parquet_2 1.00 123.8±0.35ms 132.5 MB/sec 1.01 124.5±0.43ms 131.8 MB/sec string_ree/zstd 1.00 179.4±0.59ms 91.5 MB/sec 1.00 180.0±1.28ms 91.2 MB/sec string_ree/zstd_parquet_2 1.00 139.1±0.35ms 117.9 MB/sec 1.00 139.7±0.42ms 117.5 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.7±0.08ms 52.7 MB/sec 1.00 26.7±0.05ms 52.6 MB/sec string_ree_95pct_null/cdc 1.01 32.9±0.13ms 42.8 MB/sec 1.00 32.6±0.07ms 43.1 MB/sec string_ree_95pct_null/default 1.00 25.0±0.06ms 56.2 MB/sec 1.00 25.1±0.06ms 56.1 MB/sec string_ree_95pct_null/parquet_2 1.00 25.0±0.06ms 56.2 MB/sec 1.00 25.1±0.05ms 56.2 MB/sec string_ree_95pct_null/zstd 1.00 25.9±0.06ms 54.3 MB/sec 1.00 25.9±0.05ms 54.3 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.7±0.07ms 54.7 MB/sec 1.00 25.8±0.06ms 54.5 MB/sec struct_all_null/bloom_filter 1.00 373.1±2.19µs 42.2 GB/sec 1.02 381.1±1.13µs 41.3 GB/sec struct_all_null/cdc 1.00 7.8±0.08ms 2.0 GB/sec 1.01 7.8±0.10ms 2.0 GB/sec struct_all_null/default 1.00 117.8±0.80µs 133.6 GB/sec 1.01 119.3±0.61µs 132.0 GB/sec struct_all_null/parquet_2 1.00 121.5±0.88µs 129.6 GB/sec 1.01 122.5±0.54µs 128.6 GB/sec struct_all_null/zstd 1.01 182.6±0.78µs 86.2 GB/sec 1.00 181.0±0.47µs 87.0 GB/sec struct_all_null/zstd_parquet_2 1.00 165.1±1.05µs 95.4 GB/sec 1.00 165.2±0.50µs 95.3 GB/sec struct_non_null/bloom_filter 1.00 43.5±0.15ms 367.6 MB/sec 1.03 44.8±0.17ms 357.2 MB/sec struct_non_null/cdc 1.00 43.3±0.22ms 369.7 MB/sec 1.00 43.1±0.11ms 370.9 MB/sec struct_non_null/default 1.00 29.6±0.14ms 539.7 MB/sec 1.01 29.9±0.15ms 534.6 MB/sec struct_non_null/parquet_2 1.00 38.4±0.13ms 416.4 MB/sec 1.01 38.6±0.14ms 414.2 MB/sec struct_non_null/zstd 1.00 38.6±0.20ms 414.3 MB/sec 1.00 38.5±0.16ms 416.1 MB/sec struct_non_null/zstd_parquet_2 1.00 52.2±0.26ms 306.8 MB/sec 1.01 52.4±0.14ms 305.2 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.7±0.10ms 2.3 GB/sec 1.07 7.2±0.09ms 2.2 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.12ms 1173.3 MB/sec 1.02 14.0±0.09ms 1148.9 MB/sec struct_sparse_99pct_null/default 1.00 6.2±0.05ms 2.6 GB/sec 1.05 6.5±0.06ms 2.4 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.04ms 2.6 GB/sec 1.06 6.5±0.05ms 2.4 GB/sec struct_sparse_99pct_null/zstd 1.00 7.5±0.05ms 2.1 GB/sec 1.05 7.9±0.05ms 2047.0 MB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.06ms 2.3 GB/sec 1.07 7.3±0.05ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3245.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3146.7s | | CPU sys | 92.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3230.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.7 GiB | | CPU user | 3143.6s | | CPU sys | 82.1s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
