adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336547108
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335761055) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 7c306e4 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.04ms 19.7 MB/sec 1.00 12.7±0.05ms 19.8 MB/sec bool/cdc 1.00 15.5±0.07ms 16.1 MB/sec 1.00 15.4±0.09ms 16.2 MB/sec bool/default 1.00 10.6±0.04ms 23.6 MB/sec 1.00 10.6±0.04ms 23.7 MB/sec bool/parquet_2 1.00 13.5±0.04ms 18.5 MB/sec 1.00 13.5±0.13ms 18.5 MB/sec bool/zstd 1.01 11.1±0.05ms 22.5 MB/sec 1.00 11.1±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.9±0.04ms 18.0 MB/sec 1.00 13.9±0.06ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.2 MB/sec 1.01 6.6±0.02ms 19.1 MB/sec bool_non_null/cdc 1.00 6.3±0.02ms 19.9 MB/sec 1.01 6.3±0.02ms 19.8 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.1 MB/sec 1.01 3.8±0.02ms 32.9 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.5 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.3 MB/sec 1.01 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.02ms 15.7 MB/sec 1.01 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.1±0.07ms 7.1 MB/sec 1.00 30.0±0.08ms 7.1 MB/sec bool_ree/cdc 1.01 31.4±0.10ms 6.8 MB/sec 1.00 31.3±0.06ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.06ms 7.8 MB/sec 1.00 27.3±0.06ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.08ms 7.4 MB/sec 1.00 28.9±0.10ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.08ms 7.6 MB/sec 1.00 28.0±0.07ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.07ms 7.3 MB/sec 1.00 29.1±0.05ms 7.3 MB/sec decimal/bloom_filter 1.00 117.7±2.26ms 509.8 MB/sec 1.05 123.0±2.13ms 487.8 MB/sec decimal/cdc 1.00 101.2±0.55ms 592.8 MB/sec 1.02 102.9±0.49ms 583.0 MB/sec decimal/default 1.00 78.9±1.78ms 760.6 MB/sec 1.04 81.8±0.45ms 733.9 MB/sec decimal/parquet_2 1.00 177.8±2.12ms 337.5 MB/sec 1.02 180.9±2.30ms 331.6 MB/sec decimal/zstd 1.00 90.1±1.79ms 666.0 MB/sec 1.02 92.2±1.98ms 650.9 MB/sec decimal/zstd_parquet_2 1.00 198.2±2.49ms 302.8 MB/sec 1.01 200.4±2.14ms 299.3 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.6±1.22ms 17.2 MB/sec 1.00 58.4±0.40ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.00 61.9±0.28ms 16.3 MB/sec 1.01 62.4±0.26ms 16.1 MB/sec fixed_size_binary_ree/default 1.01 51.7±0.81ms 19.5 MB/sec 1.00 51.5±0.34ms 19.6 MB/sec fixed_size_binary_ree/parquet_2 1.00 66.2±0.83ms 15.2 MB/sec 1.00 66.1±0.96ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.4±0.82ms 17.5 MB/sec 1.00 57.5±0.36ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.6±0.83ms 15.1 MB/sec 1.04 69.0±0.31ms 14.6 MB/sec float_with_nans/bloom_filter 1.00 79.6±0.98ms 175.9 MB/sec 1.06 84.5±1.82ms 165.6 MB/sec float_with_nans/cdc 1.00 70.2±0.39ms 199.5 MB/sec 1.04 72.7±0.51ms 192.6 MB/sec float_with_nans/default 1.00 62.9±0.90ms 222.5 MB/sec 1.03 64.9±0.22ms 215.7 MB/sec float_with_nans/parquet_2 1.00 80.1±0.91ms 174.9 MB/sec 1.03 82.4±1.06ms 169.9 MB/sec float_with_nans/zstd 1.00 101.0±0.93ms 138.6 MB/sec 1.03 103.7±0.36ms 135.0 MB/sec float_with_nans/zstd_parquet_2 1.00 117.0±0.89ms 119.7 MB/sec 1.03 119.9±0.35ms 116.8 MB/sec fsb/bloom_filter 1.00 8.0±0.10ms 2016.8 MB/sec 1.01 8.1±0.04ms 1990.3 MB/sec fsb/cdc 1.00 10.4±0.06ms 1546.4 MB/sec 1.00 10.5±0.03ms 1542.0 MB/sec fsb/default 1.00 6.9±0.10ms 2.3 GB/sec 1.02 7.0±0.03ms 2.2 GB/sec fsb/parquet_2 1.00 13.1±0.13ms 1232.7 MB/sec 1.02 13.3±0.05ms 1212.2 MB/sec fsb/zstd 1.00 9.4±0.10ms 1721.5 MB/sec 1.01 9.4±0.03ms 1710.4 MB/sec fsb/zstd_parquet_2 1.00 14.0±0.13ms 1151.3 MB/sec 1.01 14.2±0.05ms 1135.3 MB/sec int32_ree/bloom_filter 1.02 41.2±0.30ms 9.9 MB/sec 1.00 40.6±0.29ms 10.0 MB/sec int32_ree/cdc 1.00 40.4±0.10ms 10.1 MB/sec 1.00 40.3±0.11ms 10.1 MB/sec int32_ree/default 1.00 36.6±0.09ms 11.1 MB/sec 1.00 36.5±0.07ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.6±0.07ms 11.1 MB/sec 1.00 36.5±0.08ms 11.1 MB/sec int32_ree/zstd 1.00 37.2±0.09ms 10.9 MB/sec 1.00 37.1±0.08ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.09ms 11.0 MB/sec 1.00 37.0±0.09ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.06ms 18.6 MB/sec 1.02 22.3±0.06ms 18.3 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.04ms 17.0 MB/sec 1.01 24.2±0.08ms 16.8 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.04ms 18.9 MB/sec 1.01 21.8±0.04ms 18.7 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.04ms 18.9 MB/sec 1.01 21.8±0.03ms 18.7 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.04ms 18.7 MB/sec 1.01 22.1±0.04ms 18.4 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.03ms 18.7 MB/sec 1.01 22.0±0.04ms 18.5 MB/sec large_string_distinct/delta_byte_array 1.00 63.8±0.63ms 3.9 GB/sec 1.17 74.8±1.09ms 3.3 GB/sec large_string_distinct/plain 1.00 59.4±0.39ms 4.2 GB/sec 1.03 61.2±1.06ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.09 60.0±0.39ms 4.2 GB/sec 1.00 55.2±0.46ms 4.5 GB/sec large_string_non_null/bloom_filter 1.00 73.3±0.11ms 3.4 GB/sec 1.00 73.5±0.27ms 3.4 GB/sec large_string_non_null/cdc 1.01 244.8±1.04ms 1045.6 MB/sec 1.00 243.6±1.04ms 1051.1 MB/sec large_string_non_null/default 1.00 55.3±0.10ms 4.5 GB/sec 1.00 55.2±0.41ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 55.5±0.44ms 4.5 GB/sec 1.00 55.3±0.48ms 4.5 GB/sec large_string_non_null/zstd 1.01 55.8±0.44ms 4.5 GB/sec 1.00 55.3±0.44ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.3±0.10ms 4.5 GB/sec 1.00 55.2±0.38ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.9±0.19ms 4.6 GB/sec 1.98 108.6±0.72ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 92.1±0.64ms 2.7 GB/sec 1.03 94.9±0.84ms 2.6 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 53.8±0.27ms 4.6 GB/sec 1.04 55.8±0.38ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 51.3±0.11ms 4.9 GB/sec 1.39 71.5±0.72ms 3.5 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.3±0.29ms 4.0 GB/sec 1.03 64.0±0.53ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.7±0.11ms 4.5 GB/sec 1.96 54.4±0.55ms 2.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 51.4±0.12ms 4.9 GB/sec 1.34 68.7±0.51ms 3.6 GB/sec list_nested/bloom_filter 1.01 145.1±0.57ms 198.8 MB/sec 1.00 144.0±0.30ms 200.3 MB/sec list_nested/cdc 1.00 160.7±0.15ms 179.6 MB/sec 1.00 161.2±0.30ms 179.1 MB/sec list_nested/default 1.00 129.9±0.19ms 222.1 MB/sec 1.00 130.1±0.24ms 221.7 MB/sec list_nested/parquet_2 1.00 143.1±0.22ms 201.6 MB/sec 1.00 143.3±0.26ms 201.4 MB/sec list_nested/zstd 1.00 139.1±0.18ms 207.5 MB/sec 1.00 139.3±0.24ms 207.1 MB/sec list_nested/zstd_parquet_2 1.00 155.8±0.18ms 185.2 MB/sec 1.00 156.1±0.22ms 184.8 MB/sec list_primitive/bloom_filter 1.00 275.4±0.79ms 1980.5 MB/sec 1.07 294.4±2.13ms 1852.7 MB/sec list_primitive/cdc 1.00 309.2±3.37ms 1764.0 MB/sec 1.08 333.1±13.16ms 1637.3 MB/sec list_primitive/default 1.00 197.6±0.84ms 2.7 GB/sec 1.04 205.2±2.49ms 2.6 GB/sec list_primitive/parquet_2 1.00 222.0±0.36ms 2.4 GB/sec 1.02 227.1±0.62ms 2.3 GB/sec list_primitive/zstd 1.00 452.7±1.15ms 1204.8 MB/sec 1.03 465.6±3.99ms 1171.4 MB/sec list_primitive/zstd_parquet_2 1.00 443.1±0.44ms 1230.8 MB/sec 1.02 451.5±0.84ms 1207.8 MB/sec list_primitive_non_null/bloom_filter 1.00 352.6±5.17ms 1543.3 MB/sec 1.23 433.4±21.97ms 1255.8 MB/sec list_primitive_non_null/cdc 1.00 394.8±9.84ms 1378.4 MB/sec 1.00 394.7±9.07ms 1378.8 MB/sec list_primitive_non_null/default 1.00 223.6±4.03ms 2.4 GB/sec 1.29 287.6±18.14ms 1892.1 MB/sec list_primitive_non_null/parquet_2 1.00 256.5±7.54ms 2.1 GB/sec 1.29 331.9±2.00ms 1639.6 MB/sec list_primitive_non_null/zstd 1.00 658.9±7.50ms 825.9 MB/sec 1.09 717.3±11.66ms 758.7 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 649.9±3.50ms 837.5 MB/sec 1.08 701.7±0.68ms 775.6 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.05 13.2±0.11ms 2.8 GB/sec 1.00 12.6±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.04 24.9±0.12ms 1502.6 MB/sec 1.00 24.0±0.07ms 1558.7 MB/sec list_primitive_sparse_99pct_null/default 1.05 12.9±0.11ms 2.8 GB/sec 1.00 12.3±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.04 12.8±0.10ms 2.9 GB/sec 1.00 12.3±0.05ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.05 14.8±0.15ms 2.5 GB/sec 1.00 14.1±0.06ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.0±0.12ms 2.8 GB/sec 1.00 12.4±0.06ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 279.9±0.40ms 162.9 MB/sec 1.01 282.1±0.77ms 161.6 MB/sec list_struct_with_list/cdc 1.00 318.2±0.65ms 143.3 MB/sec 1.00 319.2±0.63ms 142.8 MB/sec list_struct_with_list/default 1.00 253.7±0.38ms 179.7 MB/sec 1.00 253.8±0.43ms 179.6 MB/sec list_struct_with_list/parquet_2 1.00 271.1±0.41ms 168.2 MB/sec 1.00 272.1±1.28ms 167.6 MB/sec list_struct_with_list/zstd 1.00 275.7±0.44ms 165.4 MB/sec 1.00 276.3±0.51ms 165.0 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.5±0.48ms 154.8 MB/sec 1.00 295.5±0.59ms 154.3 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.6±0.15ms 6.5 GB/sec 1.06 40.8±0.42ms 6.1 GB/sec primitive/bloom_filter 1.00 146.5±0.55ms 306.2 MB/sec 1.00 146.4±0.81ms 306.5 MB/sec primitive/cdc 1.00 155.3±0.62ms 288.9 MB/sec 1.00 155.3±0.94ms 289.0 MB/sec primitive/default 1.00 114.2±0.39ms 393.1 MB/sec 1.00 114.5±0.66ms 392.0 MB/sec primitive/parquet_2 1.00 129.1±0.32ms 347.6 MB/sec 1.00 129.5±0.70ms 346.6 MB/sec primitive/zstd 1.00 144.0±0.39ms 311.6 MB/sec 1.00 144.4±1.08ms 310.8 MB/sec primitive/zstd_parquet_2 1.00 163.0±0.56ms 275.4 MB/sec 1.00 162.7±0.95ms 275.9 MB/sec primitive_all_null/bloom_filter 1.02 921.5±13.08µs 47.6 GB/sec 1.00 899.5±2.32µs 48.7 GB/sec primitive_all_null/cdc 1.01 19.0±0.25ms 2.3 GB/sec 1.00 18.9±0.23ms 2.3 GB/sec primitive_all_null/default 1.00 272.3±1.45µs 160.9 GB/sec 1.01 274.0±1.39µs 159.9 GB/sec primitive_all_null/parquet_2 1.01 284.7±1.49µs 153.9 GB/sec 1.00 282.4±1.39µs 155.2 GB/sec primitive_all_null/zstd 1.01 427.3±1.81µs 102.6 GB/sec 1.00 422.2±1.39µs 103.8 GB/sec primitive_all_null/zstd_parquet_2 1.00 383.9±1.53µs 114.2 GB/sec 1.00 382.1±1.32µs 114.7 GB/sec primitive_non_null/bloom_filter 1.00 102.2±0.49ms 430.3 MB/sec 1.00 102.3±0.59ms 429.9 MB/sec primitive_non_null/cdc 1.00 85.1±0.35ms 516.9 MB/sec 1.01 86.0±0.39ms 511.9 MB/sec primitive_non_null/default 1.00 62.5±0.23ms 703.9 MB/sec 1.00 62.8±0.41ms 700.6 MB/sec primitive_non_null/parquet_2 1.00 85.1±1.63ms 517.1 MB/sec 1.00 85.2±0.37ms 516.5 MB/sec primitive_non_null/zstd 1.00 93.2±0.29ms 471.9 MB/sec 1.00 93.5±0.27ms 470.4 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.8±0.32ms 373.6 MB/sec 1.00 118.0±0.38ms 372.8 MB/sec primitive_sparse_99pct_null/bloom_filter 1.10 13.5±0.24ms 3.2 GB/sec 1.00 12.2±0.07ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.04 30.8±0.38ms 1458.6 MB/sec 1.00 29.6±0.26ms 1516.1 MB/sec primitive_sparse_99pct_null/default 1.06 11.4±0.11ms 3.8 GB/sec 1.00 10.8±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.05 11.4±0.11ms 3.9 GB/sec 1.00 10.8±0.06ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.05 14.8±0.14ms 3.0 GB/sec 1.00 14.1±0.05ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.05 13.3±0.12ms 3.3 GB/sec 1.00 12.7±0.04ms 3.5 GB/sec short_string_non_null/bloom_filter 1.05 28.9±0.07ms 415.6 MB/sec 1.00 27.4±0.09ms 437.2 MB/sec short_string_non_null/cdc 1.00 19.8±0.05ms 604.9 MB/sec 1.00 19.8±0.04ms 607.4 MB/sec short_string_non_null/default 1.00 15.7±0.05ms 762.5 MB/sec 1.00 15.7±0.06ms 766.1 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.08ms 464.4 MB/sec 1.00 25.8±0.05ms 465.8 MB/sec short_string_non_null/zstd 1.01 36.1±0.08ms 332.6 MB/sec 1.00 35.9±0.09ms 334.4 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.07ms 416.3 MB/sec 1.00 28.8±0.17ms 417.1 MB/sec small_string_distinct/delta_byte_array 1.00 959.4±6.51µs 8.2 GB/sec 1.02 977.1±12.30µs 8.0 GB/sec small_string_distinct/plain 1.00 732.7±4.75µs 10.7 GB/sec 1.05 766.6±5.56µs 10.2 GB/sec small_string_partial_prefix/delta_byte_array 1.00 989.6±3.58µs 7.9 GB/sec 1.02 1014.3±8.12µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 991.1±6.74µs 7.9 GB/sec 1.03 1025.4±6.95µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.00 966.1±3.52µs 8.1 GB/sec 1.01 974.8±2.32µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1105.0±9.94µs 7.1 GB/sec 1.03 1133.9±7.64µs 6.9 GB/sec string/bloom_filter 1.03 218.7±22.56ms 2.3 GB/sec 1.00 211.3±24.53ms 2.4 GB/sec string/cdc 1.02 211.4±11.14ms 2.4 GB/sec 1.00 207.6±10.65ms 2.5 GB/sec string/default 1.06 130.2±24.81ms 3.9 GB/sec 1.00 122.7±21.22ms 4.2 GB/sec string/parquet_2 1.51 175.6±0.48ms 2.9 GB/sec 1.00 116.4±2.02ms 4.4 GB/sec string/zstd 1.00 467.4±11.16ms 1121.5 MB/sec 1.01 472.2±12.41ms 1110.1 MB/sec string/zstd_parquet_2 1.00 390.5±6.30ms 1342.3 MB/sec 1.04 407.6±1.70ms 1286.1 MB/sec string_and_binary_view/bloom_filter 1.04 65.9±0.57ms 489.0 MB/sec 1.00 63.4±0.16ms 508.3 MB/sec string_and_binary_view/cdc 1.01 59.7±0.30ms 540.1 MB/sec 1.00 58.9±0.19ms 547.2 MB/sec string_and_binary_view/default 1.01 48.7±0.11ms 662.6 MB/sec 1.00 48.3±0.10ms 668.2 MB/sec string_and_binary_view/parquet_2 1.01 60.2±0.29ms 536.0 MB/sec 1.00 59.7±0.16ms 540.2 MB/sec string_and_binary_view/zstd 1.00 85.8±0.16ms 376.0 MB/sec 1.00 85.5±0.24ms 377.2 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.9±0.16ms 436.6 MB/sec 1.00 73.6±0.28ms 438.2 MB/sec string_dictionary/bloom_filter 1.03 87.1±1.10ms 3.0 GB/sec 1.00 84.2±0.61ms 3.1 GB/sec string_dictionary/cdc 1.01 47.9±0.22ms 5.4 GB/sec 1.00 47.3±0.53ms 5.5 GB/sec string_dictionary/default 1.02 44.1±0.55ms 5.9 GB/sec 1.00 43.2±0.67ms 6.0 GB/sec string_dictionary/parquet_2 1.00 48.5±0.33ms 5.3 GB/sec 1.00 48.6±0.13ms 5.3 GB/sec string_dictionary/zstd 1.01 209.9±0.63ms 1258.4 MB/sec 1.00 207.8±0.70ms 1270.8 MB/sec string_dictionary/zstd_parquet_2 1.01 192.9±0.14ms 1369.0 MB/sec 1.00 191.9±0.94ms 1376.1 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.01 34.4±0.14ms 116.5 MB/sec 1.00 34.2±0.08ms 117.1 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 27.9±0.14ms 143.5 MB/sec 1.00 27.7±0.08ms 144.7 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.13ms 157.6 MB/sec 1.00 25.3±0.06ms 158.3 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.4±0.12ms 157.5 MB/sec 1.00 25.3±0.07ms 158.1 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 25.9±0.11ms 154.6 MB/sec 1.00 25.7±0.07ms 156.1 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 25.8±0.12ms 155.4 MB/sec 1.00 25.6±0.07ms 156.2 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 33.5±0.16ms 119.7 MB/sec 1.00 32.9±0.05ms 121.7 MB/sec string_dictionary_low_cardinality_20/cdc 1.03 27.9±0.12ms 143.6 MB/sec 1.00 27.1±0.06ms 147.8 MB/sec string_dictionary_low_cardinality_20/default 1.03 25.6±0.13ms 156.6 MB/sec 1.00 24.7±0.06ms 161.9 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.03 25.6±0.13ms 156.7 MB/sec 1.00 24.7±0.05ms 162.0 MB/sec string_dictionary_low_cardinality_20/zstd 1.03 25.7±0.13ms 155.8 MB/sec 1.00 24.8±0.05ms 161.3 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.03 25.7±0.12ms 156.0 MB/sec 1.00 24.8±0.06ms 161.3 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.2±0.16ms 113.9 MB/sec 1.00 34.8±0.10ms 115.3 MB/sec string_dictionary_low_cardinality_400/cdc 1.01 28.4±0.15ms 141.3 MB/sec 1.00 28.0±0.10ms 143.3 MB/sec string_dictionary_low_cardinality_400/default 1.02 26.0±0.16ms 154.5 MB/sec 1.00 25.5±0.07ms 157.4 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.03 26.2±0.16ms 153.3 MB/sec 1.00 25.5±0.08ms 157.5 MB/sec string_dictionary_low_cardinality_400/zstd 1.02 26.6±0.19ms 150.8 MB/sec 1.00 26.1±0.07ms 153.6 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.4±0.13ms 152.0 MB/sec 1.00 26.0±0.09ms 154.2 MB/sec string_non_null/bloom_filter 1.00 238.9±7.31ms 2.1 GB/sec 1.04 248.6±20.76ms 2.1 GB/sec string_non_null/cdc 1.08 253.4±7.23ms 2.0 GB/sec 1.00 234.8±1.15ms 2.2 GB/sec string_non_null/default 1.00 126.9±15.57ms 4.0 GB/sec 1.02 129.4±21.32ms 4.0 GB/sec string_non_null/parquet_2 1.01 121.8±3.65ms 4.2 GB/sec 1.00 120.0±13.02ms 4.3 GB/sec string_non_null/zstd 1.03 545.4±3.59ms 960.8 MB/sec 1.00 529.3±2.77ms 990.0 MB/sec string_non_null/zstd_parquet_2 1.03 501.6±6.82ms 1044.7 MB/sec 1.00 487.9±0.79ms 1074.0 MB/sec string_ree/bloom_filter 1.00 152.4±2.08ms 107.7 MB/sec 1.01 154.4±4.74ms 106.3 MB/sec string_ree/cdc 1.28 224.3±1.28ms 73.1 MB/sec 1.00 175.6±0.61ms 93.4 MB/sec string_ree/default 1.01 126.0±2.10ms 130.2 MB/sec 1.00 124.3±0.76ms 132.0 MB/sec string_ree/parquet_2 1.02 127.8±0.40ms 128.4 MB/sec 1.00 125.2±0.40ms 131.0 MB/sec string_ree/zstd 1.36 185.8±0.67ms 88.3 MB/sec 1.00 137.0±0.54ms 119.8 MB/sec string_ree/zstd_parquet_2 1.51 142.4±0.40ms 115.2 MB/sec 1.00 94.5±0.43ms 173.6 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.3±0.13ms 53.4 MB/sec 1.03 27.1±0.15ms 51.9 MB/sec string_ree_95pct_null/cdc 1.00 32.4±0.11ms 43.4 MB/sec 1.03 33.3±0.11ms 42.2 MB/sec string_ree_95pct_null/default 1.00 24.8±0.14ms 56.7 MB/sec 1.02 25.4±0.05ms 55.3 MB/sec string_ree_95pct_null/parquet_2 1.00 24.9±0.11ms 56.6 MB/sec 1.02 25.5±0.06ms 55.2 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.11ms 54.7 MB/sec 1.03 26.4±0.28ms 53.3 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.6±0.09ms 54.9 MB/sec 1.02 26.2±0.13ms 53.7 MB/sec struct_all_null/bloom_filter 1.00 368.8±1.24µs 42.7 GB/sec 1.01 374.2±1.53µs 42.1 GB/sec struct_all_null/cdc 1.00 7.8±0.06ms 2.0 GB/sec 1.00 7.9±0.10ms 2.0 GB/sec struct_all_null/default 1.00 117.4±0.64µs 134.2 GB/sec 1.01 118.5±0.57µs 132.8 GB/sec struct_all_null/parquet_2 1.00 121.2±0.78µs 130.0 GB/sec 1.00 121.6±0.54µs 129.5 GB/sec struct_all_null/zstd 1.00 182.3±0.72µs 86.4 GB/sec 1.00 181.8±0.62µs 86.6 GB/sec struct_all_null/zstd_parquet_2 1.00 164.9±0.76µs 95.5 GB/sec 1.00 165.5±0.55µs 95.1 GB/sec struct_non_null/bloom_filter 1.00 43.1±0.14ms 370.9 MB/sec 1.03 44.4±0.28ms 360.8 MB/sec struct_non_null/cdc 1.00 43.3±0.55ms 369.7 MB/sec 1.00 43.1±0.19ms 371.0 MB/sec struct_non_null/default 1.00 29.6±0.16ms 540.3 MB/sec 1.00 29.7±0.11ms 539.6 MB/sec struct_non_null/parquet_2 1.00 38.3±0.16ms 418.0 MB/sec 1.01 38.5±0.17ms 415.7 MB/sec struct_non_null/zstd 1.00 38.0±0.11ms 421.5 MB/sec 1.01 38.3±0.15ms 417.9 MB/sec struct_non_null/zstd_parquet_2 1.00 52.0±0.18ms 307.9 MB/sec 1.01 52.2±0.24ms 306.3 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.03ms 2.4 GB/sec 1.05 6.8±0.02ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.11ms 1191.7 MB/sec 1.02 13.8±0.11ms 1170.7 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.03ms 2.6 GB/sec 1.06 6.3±0.03ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.06 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.02ms 2.1 GB/sec 1.05 7.7±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.06 7.1±0.02ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3285.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3178.8s | | CPU sys | 101.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3245.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3146.8s | | CPU sys | 94.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
