adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336638077
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335765514) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 2d2d4adc624a9ffb4a2b850fe86bf0c9df097313 [diff](https://github.com/apache/arrow-rs/compare/2d2d4adc624a9ffb4a2b850fe86bf0c9df097313..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "2d2d4adc624a9ffb4a2b850fe86bf0c9df097313" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.6±0.03ms 19.8 MB/sec 1.00 12.7±0.04ms 19.8 MB/sec bool/cdc 1.00 15.4±0.05ms 16.3 MB/sec 1.01 15.5±0.06ms 16.2 MB/sec bool/default 1.00 10.5±0.04ms 23.8 MB/sec 1.00 10.6±0.04ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.04ms 18.6 MB/sec 1.00 13.5±0.04ms 18.6 MB/sec bool/zstd 1.00 11.1±0.04ms 22.6 MB/sec 1.00 11.1±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.8±0.05ms 18.1 MB/sec 1.00 13.8±0.04ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.2 MB/sec 1.01 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 19.9 MB/sec 1.01 6.4±0.04ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.1 MB/sec 1.01 3.8±0.02ms 32.7 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.5 MB/sec 1.00 7.6±0.03ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.3 MB/sec 1.02 4.2±0.03ms 29.9 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.7 MB/sec 1.01 8.0±0.04ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.1±0.12ms 7.1 MB/sec 1.00 30.0±0.06ms 7.1 MB/sec bool_ree/cdc 1.00 31.5±0.07ms 6.8 MB/sec 1.00 31.4±0.07ms 6.8 MB/sec bool_ree/default 1.00 27.4±0.11ms 7.8 MB/sec 1.00 27.3±0.06ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.13ms 7.4 MB/sec 1.00 28.7±0.05ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.06ms 7.6 MB/sec 1.00 27.9±0.05ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.09ms 7.3 MB/sec 1.00 29.1±0.07ms 7.3 MB/sec decimal/bloom_filter 1.00 117.2±0.35ms 512.0 MB/sec 1.03 120.4±1.41ms 498.2 MB/sec decimal/cdc 1.00 101.1±0.51ms 593.4 MB/sec 1.00 101.1±0.32ms 593.3 MB/sec decimal/default 1.00 78.6±1.09ms 763.1 MB/sec 1.00 78.4±0.35ms 765.7 MB/sec decimal/parquet_2 1.00 177.0±2.22ms 339.0 MB/sec 1.00 177.2±1.79ms 338.7 MB/sec decimal/zstd 1.01 89.6±0.43ms 669.6 MB/sec 1.00 89.1±1.01ms 673.6 MB/sec decimal/zstd_parquet_2 1.00 197.3±1.73ms 304.1 MB/sec 1.00 196.7±2.60ms 305.0 MB/sec fixed_size_binary_ree/bloom_filter 1.03 60.3±0.35ms 16.7 MB/sec 1.00 58.3±1.26ms 17.3 MB/sec fixed_size_binary_ree/cdc 1.01 62.2±0.26ms 16.2 MB/sec 1.00 61.6±0.22ms 16.3 MB/sec fixed_size_binary_ree/default 1.01 52.4±0.27ms 19.2 MB/sec 1.00 51.6±1.54ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.03 68.2±0.28ms 14.8 MB/sec 1.00 66.0±0.93ms 15.3 MB/sec fixed_size_binary_ree/zstd 1.02 58.3±0.95ms 17.3 MB/sec 1.00 57.2±0.21ms 17.6 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.03 69.1±0.24ms 14.6 MB/sec 1.00 66.8±0.92ms 15.1 MB/sec float_with_nans/bloom_filter 1.02 82.7±1.26ms 169.3 MB/sec 1.00 81.4±0.20ms 172.1 MB/sec float_with_nans/cdc 1.00 69.9±0.43ms 200.2 MB/sec 1.01 70.4±0.19ms 198.9 MB/sec float_with_nans/default 1.03 64.9±0.27ms 215.7 MB/sec 1.00 63.1±1.40ms 221.8 MB/sec float_with_nans/parquet_2 1.02 81.7±0.22ms 171.4 MB/sec 1.00 80.2±0.18ms 174.6 MB/sec float_with_nans/zstd 1.01 102.6±1.19ms 136.5 MB/sec 1.00 101.2±0.22ms 138.4 MB/sec float_with_nans/zstd_parquet_2 1.00 117.0±1.77ms 119.6 MB/sec 1.00 117.2±0.24ms 119.5 MB/sec fsb/bloom_filter 1.00 8.0±0.06ms 2013.5 MB/sec 1.00 8.0±0.04ms 2014.2 MB/sec fsb/cdc 1.00 10.3±0.04ms 1560.7 MB/sec 1.00 10.3±0.03ms 1559.0 MB/sec fsb/default 1.00 6.9±0.05ms 2.3 GB/sec 1.00 7.0±0.05ms 2.3 GB/sec fsb/parquet_2 1.00 13.2±0.05ms 1221.9 MB/sec 1.01 13.3±0.07ms 1211.3 MB/sec fsb/zstd 1.00 9.4±0.05ms 1720.1 MB/sec 1.00 9.4±0.06ms 1723.4 MB/sec fsb/zstd_parquet_2 1.00 14.1±0.09ms 1144.9 MB/sec 1.01 14.2±0.08ms 1134.4 MB/sec int32_ree/bloom_filter 1.04 42.5±0.23ms 9.6 MB/sec 1.00 41.0±0.39ms 9.9 MB/sec int32_ree/cdc 1.01 40.8±0.14ms 10.0 MB/sec 1.00 40.4±0.11ms 10.1 MB/sec int32_ree/default 1.01 37.1±0.18ms 11.0 MB/sec 1.00 36.6±0.07ms 11.1 MB/sec int32_ree/parquet_2 1.01 37.1±0.16ms 11.0 MB/sec 1.00 36.6±0.07ms 11.1 MB/sec int32_ree/zstd 1.01 37.7±0.16ms 10.8 MB/sec 1.00 37.2±0.06ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.01 37.6±0.17ms 10.8 MB/sec 1.00 37.1±0.06ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.02 22.3±0.03ms 18.3 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.01 24.2±0.04ms 16.8 MB/sec 1.00 23.9±0.03ms 17.0 MB/sec int32_ree_95pct_null/default 1.01 21.7±0.02ms 18.7 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.8±0.03ms 18.7 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.01 22.0±0.04ms 18.5 MB/sec 1.00 21.8±0.02ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.01 22.0±0.03ms 18.5 MB/sec 1.00 21.7±0.02ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 64.7±0.92ms 3.9 GB/sec 1.03 66.6±0.51ms 3.8 GB/sec large_string_distinct/plain 1.00 59.6±0.60ms 4.2 GB/sec 1.02 60.9±0.33ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.11 60.2±0.34ms 4.2 GB/sec 1.00 54.2±0.69ms 4.6 GB/sec large_string_non_null/bloom_filter 1.00 72.0±0.18ms 3.5 GB/sec 1.07 77.2±0.13ms 3.2 GB/sec large_string_non_null/cdc 1.00 243.3±1.26ms 1052.2 MB/sec 1.00 242.4±1.06ms 1056.0 MB/sec large_string_non_null/default 1.00 54.2±0.15ms 4.6 GB/sec 1.10 59.6±0.19ms 4.2 GB/sec large_string_non_null/parquet_2 1.00 54.2±0.16ms 4.6 GB/sec 1.10 59.4±0.11ms 4.2 GB/sec large_string_non_null/zstd 1.00 54.3±0.14ms 4.6 GB/sec 1.10 59.5±0.12ms 4.2 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.3±0.17ms 4.6 GB/sec 1.10 59.5±0.14ms 4.2 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.9±0.27ms 4.6 GB/sec 1.03 56.6±0.29ms 4.4 GB/sec large_string_shared_prefix/plain 1.00 91.8±0.98ms 2.7 GB/sec 1.02 93.7±0.68ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 54.1±0.26ms 4.6 GB/sec 1.04 56.2±0.41ms 4.4 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.08 51.2±0.19ms 4.9 GB/sec 1.00 47.4±0.38ms 5.3 GB/sec large_string_shared_prefix_nullable/plain 1.00 61.5±0.41ms 4.1 GB/sec 1.03 63.6±0.53ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.7±0.22ms 4.5 GB/sec 1.02 28.3±0.20ms 4.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 51.5±0.11ms 4.9 GB/sec 1.36 69.8±0.93ms 3.6 GB/sec list_nested/bloom_filter 1.01 144.3±0.17ms 200.0 MB/sec 1.00 143.6±0.29ms 201.0 MB/sec list_nested/cdc 1.00 161.1±0.18ms 179.1 MB/sec 1.00 161.4±0.25ms 178.8 MB/sec list_nested/default 1.00 130.1±0.18ms 221.8 MB/sec 1.00 130.0±0.17ms 222.0 MB/sec list_nested/parquet_2 1.00 143.3±0.16ms 201.4 MB/sec 1.00 143.4±0.17ms 201.2 MB/sec list_nested/zstd 1.00 139.3±0.17ms 207.2 MB/sec 1.00 139.3±0.16ms 207.2 MB/sec list_nested/zstd_parquet_2 1.00 156.1±0.17ms 184.9 MB/sec 1.00 156.6±0.32ms 184.2 MB/sec list_primitive/bloom_filter 1.00 276.5±0.90ms 1972.5 MB/sec 1.01 279.6±2.11ms 1950.4 MB/sec list_primitive/cdc 1.00 310.6±0.37ms 1755.7 MB/sec 1.01 312.2±1.27ms 1746.8 MB/sec list_primitive/default 1.00 200.5±1.05ms 2.7 GB/sec 1.01 202.2±0.70ms 2.6 GB/sec list_primitive/parquet_2 1.00 222.1±0.33ms 2.4 GB/sec 1.01 223.3±0.41ms 2.4 GB/sec list_primitive/zstd 1.00 453.3±1.69ms 1203.1 MB/sec 1.01 456.9±1.21ms 1193.7 MB/sec list_primitive/zstd_parquet_2 1.00 443.4±0.76ms 1229.9 MB/sec 1.01 446.1±0.39ms 1222.5 MB/sec list_primitive_non_null/bloom_filter 1.00 343.3±4.29ms 1585.1 MB/sec 1.03 355.3±2.94ms 1531.8 MB/sec list_primitive_non_null/cdc 1.00 385.5±7.31ms 1411.8 MB/sec 1.02 392.2±8.20ms 1387.7 MB/sec list_primitive_non_null/default 1.00 214.1±4.17ms 2.5 GB/sec 1.06 226.3±3.83ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.00 245.3±0.31ms 2.2 GB/sec 1.01 247.8±8.07ms 2.1 GB/sec list_primitive_non_null/zstd 1.00 634.1±2.54ms 858.4 MB/sec 1.01 640.2±1.77ms 850.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 632.4±1.56ms 860.5 MB/sec 1.02 642.7±4.91ms 846.8 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.08ms 2.9 GB/sec 1.00 12.7±0.04ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.3±0.08ms 1540.8 MB/sec 1.00 24.2±0.09ms 1544.0 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.06ms 3.0 GB/sec 1.01 12.4±0.04ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.6±0.04ms 2.9 GB/sec 1.00 12.4±0.04ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.4±0.06ms 2.5 GB/sec 1.00 14.3±0.09ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.01 12.7±0.05ms 2.9 GB/sec 1.00 12.6±0.06ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 280.6±1.01ms 162.5 MB/sec 1.01 283.8±0.58ms 160.6 MB/sec list_struct_with_list/cdc 1.00 318.3±0.64ms 143.2 MB/sec 1.01 320.5±1.15ms 142.3 MB/sec list_struct_with_list/default 1.00 253.9±0.38ms 179.6 MB/sec 1.01 255.6±0.52ms 178.4 MB/sec list_struct_with_list/parquet_2 1.00 271.2±0.36ms 168.1 MB/sec 1.01 272.8±0.55ms 167.1 MB/sec list_struct_with_list/zstd 1.00 275.6±0.34ms 165.4 MB/sec 1.01 277.3±0.62ms 164.4 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.4±0.37ms 154.9 MB/sec 1.01 296.5±0.95ms 153.8 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.05 42.9±0.36ms 5.8 GB/sec 1.00 40.8±0.22ms 6.1 GB/sec primitive/bloom_filter 1.00 144.5±0.75ms 310.5 MB/sec 1.01 146.6±0.57ms 306.1 MB/sec primitive/cdc 1.00 154.0±0.69ms 291.3 MB/sec 1.01 155.0±0.67ms 289.5 MB/sec primitive/default 1.00 113.8±0.38ms 394.4 MB/sec 1.00 114.0±0.37ms 393.6 MB/sec primitive/parquet_2 1.00 129.0±0.48ms 348.0 MB/sec 1.00 128.6±0.53ms 349.0 MB/sec primitive/zstd 1.00 143.6±0.36ms 312.5 MB/sec 1.00 143.2±0.30ms 313.4 MB/sec primitive/zstd_parquet_2 1.00 161.3±0.41ms 278.3 MB/sec 1.00 161.6±0.44ms 277.8 MB/sec primitive_all_null/bloom_filter 1.00 878.1±3.94µs 49.9 GB/sec 1.01 891.1±1.82µs 49.2 GB/sec primitive_all_null/cdc 1.00 19.0±0.26ms 2.3 GB/sec 1.00 19.1±0.36ms 2.3 GB/sec primitive_all_null/default 1.00 272.0±1.47µs 161.1 GB/sec 1.00 273.3±1.52µs 160.3 GB/sec primitive_all_null/parquet_2 1.00 281.0±1.93µs 155.9 GB/sec 1.00 279.9±1.30µs 156.5 GB/sec primitive_all_null/zstd 1.00 424.7±3.00µs 103.2 GB/sec 1.00 425.2±1.45µs 103.1 GB/sec primitive_all_null/zstd_parquet_2 1.00 381.6±2.51µs 114.8 GB/sec 1.00 381.2±1.40µs 115.0 GB/sec primitive_non_null/bloom_filter 1.00 99.7±0.49ms 441.3 MB/sec 1.03 103.1±0.47ms 426.9 MB/sec primitive_non_null/cdc 1.00 84.2±0.37ms 522.3 MB/sec 1.01 85.3±0.39ms 516.1 MB/sec primitive_non_null/default 1.00 61.6±0.29ms 714.5 MB/sec 1.01 62.2±0.20ms 707.2 MB/sec primitive_non_null/parquet_2 1.00 83.3±0.24ms 528.3 MB/sec 1.01 84.5±0.32ms 520.9 MB/sec primitive_non_null/zstd 1.00 92.0±0.18ms 478.1 MB/sec 1.01 93.0±0.34ms 473.1 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.4±0.22ms 378.0 MB/sec 1.01 117.1±0.35ms 375.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.2±0.07ms 3.6 GB/sec 1.01 12.3±0.07ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.7±0.28ms 1510.9 MB/sec 1.01 30.1±0.34ms 1489.4 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.04ms 4.1 GB/sec 1.01 10.8±0.07ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.04ms 4.1 GB/sec 1.01 10.8±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.06ms 3.1 GB/sec 1.01 14.3±0.19ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 3.5 GB/sec 1.00 12.7±0.08ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.5±0.11ms 435.9 MB/sec 1.00 27.6±0.12ms 434.6 MB/sec short_string_non_null/cdc 1.00 19.7±0.05ms 609.7 MB/sec 1.01 19.8±0.04ms 605.0 MB/sec short_string_non_null/default 1.00 15.6±0.06ms 769.2 MB/sec 1.02 15.9±0.09ms 756.7 MB/sec short_string_non_null/parquet_2 1.00 25.9±0.13ms 463.8 MB/sec 1.02 26.3±0.07ms 456.5 MB/sec short_string_non_null/zstd 1.00 35.9±0.08ms 334.6 MB/sec 1.01 36.1±0.09ms 332.1 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.09ms 416.7 MB/sec 1.02 29.2±0.06ms 410.5 MB/sec small_string_distinct/delta_byte_array 1.00 961.5±7.57µs 8.2 GB/sec 1.01 966.6±5.66µs 8.1 GB/sec small_string_distinct/plain 1.00 718.3±4.70µs 10.9 GB/sec 1.05 754.3±4.59µs 10.4 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1015.2±16.87µs 7.7 GB/sec 1.00 1012.5±3.87µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 963.0±8.95µs 8.1 GB/sec 1.06 1017.0±5.83µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.01 973.8±1.21µs 8.1 GB/sec 1.00 967.3±2.26µs 8.1 GB/sec small_string_shared_prefix/plain 1.00 1071.1±8.06µs 7.3 GB/sec 1.04 1113.8±6.49µs 7.0 GB/sec string/bloom_filter 1.08 205.1±19.75ms 2.5 GB/sec 1.00 190.4±1.62ms 2.7 GB/sec string/cdc 1.00 200.4±0.92ms 2.6 GB/sec 1.03 205.8±6.11ms 2.5 GB/sec string/default 1.00 122.7±21.80ms 4.2 GB/sec 1.00 122.3±21.64ms 4.2 GB/sec string/parquet_2 1.49 160.8±0.71ms 3.2 GB/sec 1.00 108.2±0.79ms 4.7 GB/sec string/zstd 1.00 459.9±10.99ms 1140.0 MB/sec 1.01 465.8±13.54ms 1125.6 MB/sec string/zstd_parquet_2 1.00 384.1±4.44ms 1364.9 MB/sec 1.00 384.5±2.14ms 1363.5 MB/sec string_and_binary_view/bloom_filter 1.00 63.6±0.26ms 506.8 MB/sec 1.04 66.1±0.53ms 488.1 MB/sec string_and_binary_view/cdc 1.00 58.8±0.53ms 548.8 MB/sec 1.01 59.2±0.13ms 545.0 MB/sec string_and_binary_view/default 1.00 47.9±0.12ms 673.1 MB/sec 1.01 48.6±0.13ms 663.7 MB/sec string_and_binary_view/parquet_2 1.00 59.1±0.15ms 545.6 MB/sec 1.01 59.7±0.23ms 540.4 MB/sec string_and_binary_view/zstd 1.00 85.4±0.26ms 377.7 MB/sec 1.00 85.6±0.20ms 376.7 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.0±0.20ms 441.5 MB/sec 1.01 73.6±0.22ms 438.3 MB/sec string_dictionary/bloom_filter 1.00 83.7±0.42ms 3.1 GB/sec 1.03 85.9±0.58ms 3.0 GB/sec string_dictionary/cdc 1.00 46.3±0.84ms 5.6 GB/sec 1.03 47.8±0.59ms 5.4 GB/sec string_dictionary/default 1.00 43.1±0.61ms 6.0 GB/sec 1.00 43.0±0.15ms 6.0 GB/sec string_dictionary/parquet_2 1.00 49.0±0.19ms 5.3 GB/sec 1.00 48.8±0.10ms 5.3 GB/sec string_dictionary/zstd 1.00 207.2±0.99ms 1274.5 MB/sec 1.01 209.2±1.05ms 1262.5 MB/sec string_dictionary/zstd_parquet_2 1.00 192.1±0.35ms 1374.6 MB/sec 1.00 192.6±0.57ms 1371.4 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.4±0.14ms 116.4 MB/sec 1.00 34.3±0.15ms 116.9 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 28.0±0.13ms 143.2 MB/sec 1.00 27.8±0.11ms 144.1 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.6±0.12ms 156.3 MB/sec 1.00 25.5±0.13ms 157.1 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.6±0.13ms 156.6 MB/sec 1.00 25.5±0.13ms 157.0 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 26.0±0.12ms 154.2 MB/sec 1.00 25.9±0.15ms 154.7 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 26.0±0.15ms 154.1 MB/sec 1.00 25.9±0.14ms 154.8 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 34.2±0.15ms 117.1 MB/sec 1.00 34.2±0.12ms 117.2 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.7±0.14ms 144.4 MB/sec 1.02 28.2±0.12ms 141.8 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.4±0.15ms 157.6 MB/sec 1.02 25.9±0.11ms 154.4 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.4±0.15ms 157.7 MB/sec 1.02 26.0±0.12ms 154.3 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.5±0.15ms 156.8 MB/sec 1.02 26.1±0.12ms 153.5 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.5±0.14ms 156.9 MB/sec 1.02 26.1±0.12ms 153.7 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.0±0.15ms 114.5 MB/sec 1.00 35.0±0.16ms 114.7 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.2±0.18ms 142.1 MB/sec 1.00 28.1±0.13ms 142.6 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.9±0.16ms 155.2 MB/sec 1.00 25.9±0.16ms 155.2 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.8±0.16ms 155.6 MB/sec 1.00 25.8±0.15ms 155.7 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 26.5±0.18ms 151.2 MB/sec 1.00 26.3±0.13ms 152.5 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.5±0.19ms 151.6 MB/sec 1.00 26.2±0.15ms 152.9 MB/sec string_non_null/bloom_filter 1.00 226.3±12.07ms 2.3 GB/sec 1.01 229.2±14.06ms 2.2 GB/sec string_non_null/cdc 1.02 252.9±6.41ms 2.0 GB/sec 1.00 248.7±5.89ms 2.1 GB/sec string_non_null/default 1.03 115.2±16.39ms 4.4 GB/sec 1.00 111.4±12.86ms 4.6 GB/sec string_non_null/parquet_2 1.00 107.2±0.43ms 4.8 GB/sec 1.01 107.9±0.46ms 4.7 GB/sec string_non_null/zstd 1.04 551.6±7.27ms 950.0 MB/sec 1.00 532.6±4.19ms 983.8 MB/sec string_non_null/zstd_parquet_2 1.02 504.5±2.16ms 1038.6 MB/sec 1.00 496.6±8.06ms 1055.1 MB/sec string_ree/bloom_filter 1.05 112.4±2.03ms 146.0 MB/sec 1.00 107.3±0.78ms 152.9 MB/sec string_ree/cdc 1.02 178.3±1.85ms 92.0 MB/sec 1.00 175.2±0.95ms 93.6 MB/sec string_ree/default 1.05 82.8±0.92ms 198.2 MB/sec 1.00 79.1±1.22ms 207.5 MB/sec string_ree/parquet_2 1.02 81.4±0.48ms 201.5 MB/sec 1.00 79.6±0.28ms 206.1 MB/sec string_ree/zstd 1.05 144.9±1.18ms 113.3 MB/sec 1.00 137.4±0.94ms 119.4 MB/sec string_ree/zstd_parquet_2 1.02 96.0±0.54ms 170.9 MB/sec 1.00 94.3±0.38ms 174.0 MB/sec string_ree_95pct_null/bloom_filter 1.03 27.0±0.17ms 52.0 MB/sec 1.00 26.2±0.11ms 53.7 MB/sec string_ree_95pct_null/cdc 1.03 33.2±0.06ms 42.4 MB/sec 1.00 32.2±0.06ms 43.6 MB/sec string_ree_95pct_null/default 1.03 25.4±0.06ms 55.4 MB/sec 1.00 24.7±0.07ms 56.9 MB/sec string_ree_95pct_null/parquet_2 1.03 25.4±0.06ms 55.4 MB/sec 1.00 24.8±0.18ms 56.8 MB/sec string_ree_95pct_null/zstd 1.02 26.2±0.07ms 53.7 MB/sec 1.00 25.5±0.11ms 55.1 MB/sec string_ree_95pct_null/zstd_parquet_2 1.03 26.1±0.07ms 53.9 MB/sec 1.00 25.4±0.07ms 55.3 MB/sec struct_all_null/bloom_filter 1.00 369.5±1.33µs 42.6 GB/sec 1.01 374.7±1.21µs 42.0 GB/sec struct_all_null/cdc 1.00 7.9±0.08ms 2.0 GB/sec 1.01 7.9±0.17ms 2039.7 MB/sec struct_all_null/default 1.00 118.1±0.91µs 133.4 GB/sec 1.00 117.6±0.58µs 133.9 GB/sec struct_all_null/parquet_2 1.00 121.1±0.71µs 130.0 GB/sec 1.00 120.7±0.57µs 130.4 GB/sec struct_all_null/zstd 1.01 182.5±1.03µs 86.3 GB/sec 1.00 181.4±0.55µs 86.8 GB/sec struct_all_null/zstd_parquet_2 1.01 164.4±0.80µs 95.8 GB/sec 1.00 162.8±0.54µs 96.8 GB/sec struct_non_null/bloom_filter 1.00 43.2±0.20ms 370.7 MB/sec 1.03 44.5±0.13ms 359.8 MB/sec struct_non_null/cdc 1.00 43.0±0.17ms 372.1 MB/sec 1.01 43.3±0.14ms 369.3 MB/sec struct_non_null/default 1.00 29.5±0.12ms 542.6 MB/sec 1.00 29.5±0.12ms 541.7 MB/sec struct_non_null/parquet_2 1.00 38.2±0.18ms 418.4 MB/sec 1.00 38.4±0.15ms 416.9 MB/sec struct_non_null/zstd 1.00 38.0±0.16ms 421.0 MB/sec 1.00 38.2±0.10ms 419.0 MB/sec struct_non_null/zstd_parquet_2 1.00 51.9±0.20ms 308.2 MB/sec 1.01 52.7±0.64ms 303.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.01 6.6±0.03ms 2.4 GB/sec 1.00 6.5±0.02ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.09ms 1197.0 MB/sec 1.01 13.5±0.09ms 1190.5 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.03ms 2.6 GB/sec 1.00 6.0±0.01ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.03ms 2.1 GB/sec 1.00 7.4±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.03ms 2.3 GB/sec 1.00 6.7±0.01ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3210.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3170.4s | | CPU sys | 36.3s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3200.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.7 GiB | | CPU user | 3154.2s | | CPU sys | 40.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
