adriangbot commented on PR #10745: URL: https://github.com/apache/arrow-rs/pull/10745#issuecomment-5337333595
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10745#issuecomment-5336011270) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/byte-array-minmax-copy (477a393bfca1658b56679d71ed149066184e670f) to 177bde8 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/177bde8225b5ffa49c19f3b66109ae3091ef3114..477a393bfca1658b56679d71ed149066184e670f) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_byte-array-minmax-copy main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.6±0.04ms 19.8 MB/sec 1.00 12.6±0.04ms 19.8 MB/sec bool/cdc 1.00 15.2±0.05ms 16.4 MB/sec 1.02 15.6±0.05ms 16.0 MB/sec bool/default 1.00 10.5±0.03ms 23.8 MB/sec 1.00 10.5±0.04ms 23.8 MB/sec bool/parquet_2 1.00 13.5±0.03ms 18.5 MB/sec 1.00 13.5±0.06ms 18.5 MB/sec bool/zstd 1.00 11.1±0.04ms 22.6 MB/sec 1.00 11.1±0.05ms 22.5 MB/sec bool/zstd_parquet_2 1.00 13.9±0.05ms 18.0 MB/sec 1.00 13.9±0.05ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 18.8 MB/sec 1.00 6.6±0.04ms 18.8 MB/sec bool_non_null/cdc 1.01 6.4±0.04ms 19.5 MB/sec 1.00 6.3±0.03ms 19.7 MB/sec bool_non_null/default 1.02 3.9±0.03ms 32.3 MB/sec 1.00 3.8±0.02ms 32.9 MB/sec bool_non_null/parquet_2 1.02 7.8±0.03ms 16.1 MB/sec 1.00 7.7±0.03ms 16.3 MB/sec bool_non_null/zstd 1.02 4.2±0.02ms 29.6 MB/sec 1.00 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.02 8.2±0.03ms 15.3 MB/sec 1.00 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.01 30.5±0.19ms 7.0 MB/sec 1.00 30.1±0.08ms 7.1 MB/sec bool_ree/cdc 1.00 31.4±0.07ms 6.8 MB/sec 1.00 31.3±0.08ms 6.8 MB/sec bool_ree/default 1.02 27.7±0.16ms 7.7 MB/sec 1.00 27.3±0.07ms 7.8 MB/sec bool_ree/parquet_2 1.02 29.3±0.17ms 7.3 MB/sec 1.00 28.8±0.06ms 7.4 MB/sec bool_ree/zstd 1.02 28.4±0.17ms 7.5 MB/sec 1.00 28.0±0.07ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.01 29.5±0.19ms 7.2 MB/sec 1.00 29.1±0.08ms 7.3 MB/sec decimal/bloom_filter 1.01 120.3±1.57ms 498.7 MB/sec 1.00 118.7±1.05ms 505.3 MB/sec decimal/cdc 1.00 101.0±0.31ms 593.8 MB/sec 1.00 101.0±0.32ms 594.3 MB/sec decimal/default 1.00 78.8±0.37ms 761.7 MB/sec 1.00 78.8±0.42ms 761.8 MB/sec decimal/parquet_2 1.00 177.3±1.70ms 338.3 MB/sec 1.00 177.4±1.34ms 338.2 MB/sec decimal/zstd 1.00 89.7±0.42ms 668.7 MB/sec 1.00 89.8±0.32ms 668.1 MB/sec decimal/zstd_parquet_2 1.01 197.8±2.03ms 303.4 MB/sec 1.00 196.5±1.96ms 305.4 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.3±0.40ms 17.3 MB/sec 1.00 58.4±0.32ms 17.2 MB/sec fixed_size_binary_ree/cdc 1.00 61.5±0.27ms 16.4 MB/sec 1.00 61.4±0.21ms 16.4 MB/sec fixed_size_binary_ree/default 1.00 51.6±0.19ms 19.5 MB/sec 1.00 51.8±0.21ms 19.4 MB/sec fixed_size_binary_ree/parquet_2 1.00 65.9±0.38ms 15.3 MB/sec 1.00 66.2±0.32ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.1±0.22ms 17.6 MB/sec 1.00 57.3±0.22ms 17.6 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.6±0.35ms 15.1 MB/sec 1.01 67.3±0.38ms 15.0 MB/sec float_with_nans/bloom_filter 1.01 81.2±0.37ms 172.4 MB/sec 1.00 80.8±0.31ms 173.3 MB/sec float_with_nans/cdc 1.00 70.4±0.44ms 198.9 MB/sec 1.01 70.8±0.78ms 197.7 MB/sec float_with_nans/default 1.00 63.1±0.19ms 221.9 MB/sec 1.00 63.1±0.18ms 221.7 MB/sec float_with_nans/parquet_2 1.00 80.5±0.20ms 173.9 MB/sec 1.00 80.6±0.24ms 173.7 MB/sec float_with_nans/zstd 1.00 101.5±0.38ms 138.0 MB/sec 1.00 101.5±0.25ms 138.0 MB/sec float_with_nans/zstd_parquet_2 1.00 117.3±0.28ms 119.4 MB/sec 1.00 117.5±0.24ms 119.1 MB/sec fsb/bloom_filter 1.01 8.2±0.07ms 1973.3 MB/sec 1.00 8.1±0.04ms 2000.5 MB/sec fsb/cdc 1.00 10.4±0.06ms 1544.6 MB/sec 1.00 10.5±0.05ms 1537.0 MB/sec fsb/default 1.00 7.0±0.05ms 2.2 GB/sec 1.00 7.0±0.04ms 2.2 GB/sec fsb/parquet_2 1.01 13.4±0.09ms 1201.9 MB/sec 1.00 13.3±0.07ms 1212.0 MB/sec fsb/zstd 1.00 9.5±0.07ms 1698.8 MB/sec 1.01 9.6±0.09ms 1688.2 MB/sec fsb/zstd_parquet_2 1.00 14.3±0.09ms 1127.3 MB/sec 1.00 14.3±0.10ms 1130.1 MB/sec int32_ree/bloom_filter 1.01 41.7±0.43ms 9.7 MB/sec 1.00 41.1±0.39ms 9.9 MB/sec int32_ree/cdc 1.01 40.9±0.20ms 9.9 MB/sec 1.00 40.6±0.15ms 10.0 MB/sec int32_ree/default 1.01 37.0±0.17ms 11.0 MB/sec 1.00 36.7±0.13ms 11.1 MB/sec int32_ree/parquet_2 1.01 37.0±0.18ms 11.0 MB/sec 1.00 36.8±0.13ms 11.1 MB/sec int32_ree/zstd 1.00 37.5±0.20ms 10.8 MB/sec 1.00 37.4±0.12ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.5±0.17ms 10.9 MB/sec 1.00 37.4±0.13ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.1±0.08ms 18.4 MB/sec 1.00 21.9±0.08ms 18.5 MB/sec int32_ree_95pct_null/cdc 1.01 24.2±0.05ms 16.8 MB/sec 1.00 23.9±0.07ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.05ms 18.8 MB/sec 1.00 21.6±0.04ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.03ms 18.8 MB/sec 1.00 21.6±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.03ms 18.6 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.05ms 18.7 MB/sec 1.00 21.8±0.04ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.04 74.8±0.82ms 3.3 GB/sec 1.00 72.2±0.89ms 3.5 GB/sec large_string_distinct/plain 1.00 59.5±0.81ms 4.2 GB/sec 1.00 59.6±0.94ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 53.0±0.65ms 4.7 GB/sec 1.00 53.0±0.40ms 4.7 GB/sec large_string_non_null/bloom_filter 1.00 68.8±0.12ms 3.6 GB/sec 1.08 74.1±0.26ms 3.4 GB/sec large_string_non_null/cdc 1.00 240.2±0.83ms 1065.7 MB/sec 1.01 242.7±1.01ms 1055.0 MB/sec large_string_non_null/default 1.00 51.4±0.09ms 4.9 GB/sec 1.09 56.1±0.55ms 4.5 GB/sec large_string_non_null/parquet_2 1.00 51.6±0.21ms 4.8 GB/sec 1.09 56.1±0.53ms 4.5 GB/sec large_string_non_null/zstd 1.00 51.7±0.15ms 4.8 GB/sec 1.08 56.1±0.57ms 4.5 GB/sec large_string_non_null/zstd_parquet_2 1.00 51.5±0.09ms 4.9 GB/sec 1.09 56.1±0.56ms 4.5 GB/sec large_string_shared_prefix/delta_byte_array 1.01 106.0±0.83ms 2.4 GB/sec 1.00 105.2±1.07ms 2.4 GB/sec large_string_shared_prefix/plain 1.00 91.6±0.68ms 2.7 GB/sec 1.01 92.8±0.75ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.01 54.3±0.30ms 4.6 GB/sec 1.00 53.8±0.34ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.01 68.9±0.44ms 3.6 GB/sec 1.00 68.5±0.64ms 3.6 GB/sec large_string_shared_prefix_nullable/plain 1.00 62.7±0.43ms 4.0 GB/sec 1.00 62.7±0.50ms 4.0 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.02 53.3±0.66ms 2.3 GB/sec 1.00 52.3±0.27ms 2.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 66.5±0.45ms 3.8 GB/sec 1.01 67.1±0.35ms 3.7 GB/sec list_nested/bloom_filter 1.01 145.0±0.26ms 199.0 MB/sec 1.00 143.5±0.29ms 201.1 MB/sec list_nested/cdc 1.00 161.1±0.33ms 179.2 MB/sec 1.00 160.9±0.20ms 179.4 MB/sec list_nested/default 1.00 129.5±0.26ms 222.8 MB/sec 1.00 130.1±0.20ms 221.8 MB/sec list_nested/parquet_2 1.00 143.2±0.39ms 201.5 MB/sec 1.00 143.2±0.29ms 201.5 MB/sec list_nested/zstd 1.00 139.0±0.39ms 207.5 MB/sec 1.00 139.1±0.26ms 207.5 MB/sec list_nested/zstd_parquet_2 1.00 156.3±0.55ms 184.6 MB/sec 1.00 155.8±0.22ms 185.3 MB/sec list_primitive/bloom_filter 1.00 280.3±1.10ms 1945.4 MB/sec 1.06 296.1±2.58ms 1841.7 MB/sec list_primitive/cdc 1.00 311.0±1.43ms 1753.4 MB/sec 1.02 317.4±5.06ms 1718.2 MB/sec list_primitive/default 1.00 201.3±0.75ms 2.6 GB/sec 1.09 218.6±2.60ms 2.4 GB/sec list_primitive/parquet_2 1.00 222.6±0.92ms 2.4 GB/sec 1.06 235.2±0.41ms 2.3 GB/sec list_primitive/zstd 1.00 456.3±1.89ms 1195.3 MB/sec 1.00 456.3±1.68ms 1195.3 MB/sec list_primitive/zstd_parquet_2 1.00 444.0±0.49ms 1228.2 MB/sec 1.02 454.6±0.71ms 1199.8 MB/sec list_primitive_non_null/bloom_filter 1.00 363.9±7.64ms 1495.6 MB/sec 1.09 395.3±12.94ms 1376.7 MB/sec list_primitive_non_null/cdc 1.00 393.3±8.50ms 1383.7 MB/sec 1.00 392.7±8.75ms 1385.8 MB/sec list_primitive_non_null/default 1.00 231.3±6.86ms 2.3 GB/sec 1.13 260.4±9.12ms 2.0 GB/sec list_primitive_non_null/parquet_2 1.00 257.0±7.67ms 2.1 GB/sec 1.16 298.2±0.92ms 1825.1 MB/sec list_primitive_non_null/zstd 1.00 651.0±3.78ms 836.1 MB/sec 1.06 688.7±3.82ms 790.3 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 643.3±7.07ms 846.1 MB/sec 1.05 676.6±0.64ms 804.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.10ms 2.9 GB/sec 1.00 12.6±0.10ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.1±0.16ms 1551.4 MB/sec 1.01 24.3±0.13ms 1538.7 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.07ms 3.0 GB/sec 1.00 12.3±0.08ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.01 12.5±0.15ms 2.9 GB/sec 1.00 12.3±0.09ms 3.0 GB/sec list_primitive_sparse_99pct_null/zstd 1.02 14.5±0.10ms 2.5 GB/sec 1.00 14.2±0.11ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.5±0.06ms 2.9 GB/sec 1.02 12.7±0.09ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 282.4±1.23ms 161.5 MB/sec 1.00 279.7±0.90ms 163.0 MB/sec list_struct_with_list/cdc 1.00 318.5±0.62ms 143.2 MB/sec 1.00 317.6±0.42ms 143.5 MB/sec list_struct_with_list/default 1.00 253.8±0.75ms 179.7 MB/sec 1.00 253.5±0.84ms 179.9 MB/sec list_struct_with_list/parquet_2 1.00 271.0±0.54ms 168.2 MB/sec 1.00 270.9±0.86ms 168.3 MB/sec list_struct_with_list/zstd 1.00 275.3±0.60ms 165.6 MB/sec 1.00 276.2±1.51ms 165.1 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.6±0.69ms 154.8 MB/sec 1.00 294.1±0.79ms 155.0 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.2±0.27ms 6.5 GB/sec 1.03 39.3±0.23ms 6.4 GB/sec primitive/bloom_filter 1.00 147.0±0.92ms 305.2 MB/sec 1.00 146.7±2.17ms 305.8 MB/sec primitive/cdc 1.00 155.5±0.84ms 288.5 MB/sec 1.00 155.7±1.19ms 288.1 MB/sec primitive/default 1.00 114.3±0.34ms 392.5 MB/sec 1.00 114.5±0.60ms 391.9 MB/sec primitive/parquet_2 1.00 129.2±0.42ms 347.3 MB/sec 1.00 129.4±1.07ms 346.8 MB/sec primitive/zstd 1.00 143.7±0.33ms 312.3 MB/sec 1.01 144.7±1.26ms 310.2 MB/sec primitive/zstd_parquet_2 1.00 162.4±0.87ms 276.3 MB/sec 1.00 162.9±1.18ms 275.4 MB/sec primitive_all_null/bloom_filter 1.00 887.2±2.32µs 49.4 GB/sec 1.00 885.2±3.27µs 49.5 GB/sec primitive_all_null/cdc 1.01 19.2±0.41ms 2.3 GB/sec 1.00 19.0±0.27ms 2.3 GB/sec primitive_all_null/default 1.00 274.0±1.34µs 160.0 GB/sec 1.01 276.7±1.55µs 158.4 GB/sec primitive_all_null/parquet_2 1.00 283.4±1.11µs 154.6 GB/sec 1.00 284.6±1.30µs 154.0 GB/sec primitive_all_null/zstd 1.00 423.4±1.61µs 103.5 GB/sec 1.01 425.9±1.45µs 102.9 GB/sec primitive_all_null/zstd_parquet_2 1.00 379.2±1.09µs 115.6 GB/sec 1.01 383.0±1.27µs 114.4 GB/sec primitive_non_null/bloom_filter 1.02 104.0±0.66ms 423.0 MB/sec 1.00 101.9±0.36ms 431.6 MB/sec primitive_non_null/cdc 1.00 85.4±0.44ms 515.1 MB/sec 1.02 87.1±1.54ms 505.4 MB/sec primitive_non_null/default 1.00 63.0±0.38ms 698.9 MB/sec 1.01 63.5±1.27ms 693.0 MB/sec primitive_non_null/parquet_2 1.00 84.4±0.23ms 521.3 MB/sec 1.01 85.2±1.06ms 516.2 MB/sec primitive_non_null/zstd 1.00 93.1±0.36ms 472.6 MB/sec 1.01 93.9±1.09ms 468.8 MB/sec primitive_non_null/zstd_parquet_2 1.00 117.5±0.32ms 374.6 MB/sec 1.01 118.6±1.21ms 371.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.3±0.18ms 3.6 GB/sec 1.00 12.3±0.19ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.04 30.9±0.37ms 1451.5 MB/sec 1.00 29.8±0.32ms 1503.9 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.05ms 4.1 GB/sec 1.01 10.9±0.10ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.01 10.9±0.10ms 4.0 GB/sec 1.00 10.8±0.08ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.10ms 3.1 GB/sec 1.01 14.4±0.12ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.08ms 3.4 GB/sec 1.00 12.8±0.14ms 3.4 GB/sec short_string_non_null/bloom_filter 1.01 27.8±0.08ms 431.4 MB/sec 1.00 27.7±0.11ms 433.6 MB/sec short_string_non_null/cdc 1.00 19.7±0.09ms 609.1 MB/sec 1.00 19.7±0.05ms 608.2 MB/sec short_string_non_null/default 1.00 15.5±0.06ms 776.6 MB/sec 1.01 15.7±0.07ms 765.3 MB/sec short_string_non_null/parquet_2 1.00 25.5±0.12ms 469.9 MB/sec 1.01 25.8±0.06ms 464.4 MB/sec short_string_non_null/zstd 1.00 35.7±0.07ms 336.3 MB/sec 1.01 35.9±0.08ms 334.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.3±0.06ms 423.9 MB/sec 1.01 28.7±0.06ms 418.0 MB/sec small_string_distinct/delta_byte_array 1.01 974.0±13.44µs 8.1 GB/sec 1.00 960.7±10.90µs 8.2 GB/sec small_string_distinct/plain 1.00 733.5±8.04µs 10.7 GB/sec 1.01 741.1±8.70µs 10.6 GB/sec small_string_partial_prefix/delta_byte_array 1.00 979.1±7.75µs 8.0 GB/sec 1.00 974.4±8.28µs 8.0 GB/sec small_string_partial_prefix/plain 1.02 989.6±12.25µs 7.9 GB/sec 1.00 974.2±7.05µs 8.1 GB/sec small_string_shared_prefix/delta_byte_array 1.00 966.4±1.96µs 8.1 GB/sec 1.00 963.4±3.14µs 8.1 GB/sec small_string_shared_prefix/plain 1.01 1109.5±10.90µs 7.1 GB/sec 1.00 1103.7±13.35µs 7.1 GB/sec string/bloom_filter 1.09 219.6±23.17ms 2.3 GB/sec 1.00 200.7±18.29ms 2.6 GB/sec string/cdc 1.00 201.7±2.21ms 2.5 GB/sec 1.02 206.1±9.96ms 2.5 GB/sec string/default 1.02 121.8±19.48ms 4.2 GB/sec 1.00 118.9±20.40ms 4.3 GB/sec string/parquet_2 1.09 178.0±0.55ms 2.9 GB/sec 1.00 163.2±0.48ms 3.1 GB/sec string/zstd 1.00 459.7±13.16ms 1140.4 MB/sec 1.00 459.8±10.63ms 1140.3 MB/sec string/zstd_parquet_2 1.00 429.4±0.71ms 1221.0 MB/sec 1.02 439.0±4.96ms 1194.1 MB/sec string_and_binary_view/bloom_filter 1.03 66.7±0.28ms 483.8 MB/sec 1.00 64.7±0.19ms 498.7 MB/sec string_and_binary_view/cdc 1.03 60.6±0.14ms 532.5 MB/sec 1.00 58.9±0.13ms 547.4 MB/sec string_and_binary_view/default 1.04 50.2±0.12ms 642.7 MB/sec 1.00 48.2±0.10ms 668.8 MB/sec string_and_binary_view/parquet_2 1.02 60.7±0.11ms 531.1 MB/sec 1.00 59.5±0.17ms 541.8 MB/sec string_and_binary_view/zstd 1.02 86.8±0.13ms 371.7 MB/sec 1.00 85.4±0.15ms 377.8 MB/sec string_and_binary_view/zstd_parquet_2 1.02 74.6±0.13ms 432.1 MB/sec 1.00 73.5±0.15ms 439.0 MB/sec string_dictionary/bloom_filter 1.01 84.4±0.51ms 3.1 GB/sec 1.00 84.0±0.89ms 3.1 GB/sec string_dictionary/cdc 1.00 47.7±0.80ms 5.4 GB/sec 1.00 47.9±0.74ms 5.4 GB/sec string_dictionary/default 1.02 43.6±1.06ms 5.9 GB/sec 1.00 42.8±0.93ms 6.0 GB/sec string_dictionary/parquet_2 1.00 48.3±0.41ms 5.3 GB/sec 1.00 48.3±0.24ms 5.3 GB/sec string_dictionary/zstd 1.00 205.5±1.57ms 1285.0 MB/sec 1.03 210.8±4.50ms 1253.2 MB/sec string_dictionary/zstd_parquet_2 1.00 191.3±0.20ms 1380.7 MB/sec 1.00 191.9±0.23ms 1376.3 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.01 34.7±0.19ms 115.6 MB/sec 1.00 34.3±0.07ms 116.8 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 27.9±0.14ms 143.4 MB/sec 1.00 27.7±0.07ms 144.8 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.6±0.13ms 156.6 MB/sec 1.00 25.4±0.07ms 157.9 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.01 25.6±0.16ms 156.4 MB/sec 1.00 25.4±0.07ms 157.8 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 26.0±0.13ms 154.1 MB/sec 1.00 25.7±0.07ms 156.0 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 26.0±0.12ms 154.3 MB/sec 1.00 25.7±0.08ms 156.2 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.7±0.18ms 118.8 MB/sec 1.01 34.1±0.25ms 117.6 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.7±0.14ms 144.7 MB/sec 1.01 27.9±0.16ms 143.5 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.3±0.16ms 158.5 MB/sec 1.01 25.6±0.21ms 156.4 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.4±0.20ms 157.4 MB/sec 1.00 25.5±0.21ms 157.3 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.5±0.17ms 157.2 MB/sec 1.00 25.6±0.09ms 156.7 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.5±0.16ms 157.3 MB/sec 1.00 25.6±0.18ms 156.6 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.2±0.20ms 114.0 MB/sec 1.00 35.0±0.07ms 114.6 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.2±0.16ms 142.4 MB/sec 1.01 28.4±0.10ms 141.3 MB/sec string_dictionary_low_cardinality_400/default 1.01 26.2±0.20ms 153.3 MB/sec 1.00 25.9±0.09ms 154.7 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.01 26.3±0.19ms 152.6 MB/sec 1.00 26.0±0.09ms 154.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.02 27.0±0.21ms 148.7 MB/sec 1.00 26.5±0.09ms 151.6 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.6±0.23ms 151.0 MB/sec 1.00 26.4±0.08ms 151.7 MB/sec string_non_null/bloom_filter 1.04 250.9±17.56ms 2.0 GB/sec 1.00 240.5±12.88ms 2.1 GB/sec string_non_null/cdc 1.02 250.5±3.12ms 2.0 GB/sec 1.00 245.3±2.68ms 2.1 GB/sec string_non_null/default 1.04 128.5±19.57ms 4.0 GB/sec 1.00 124.0±14.25ms 4.1 GB/sec string_non_null/parquet_2 1.00 110.3±5.42ms 4.6 GB/sec 1.12 123.9±10.60ms 4.1 GB/sec string_non_null/zstd 1.02 546.3±3.47ms 959.2 MB/sec 1.00 537.9±2.89ms 974.1 MB/sec string_non_null/zstd_parquet_2 1.00 500.2±2.90ms 1047.6 MB/sec 1.00 501.9±3.42ms 1044.0 MB/sec string_ree/bloom_filter 1.05 152.9±0.98ms 107.3 MB/sec 1.00 146.2±1.31ms 112.3 MB/sec string_ree/cdc 1.00 220.6±0.55ms 74.4 MB/sec 1.00 221.5±0.65ms 74.1 MB/sec string_ree/default 1.05 124.9±0.80ms 131.4 MB/sec 1.00 118.5±0.58ms 138.5 MB/sec string_ree/parquet_2 1.00 124.5±0.48ms 131.8 MB/sec 1.04 129.6±0.56ms 126.6 MB/sec string_ree/zstd 1.00 182.4±1.05ms 90.0 MB/sec 1.01 183.9±1.15ms 89.2 MB/sec string_ree/zstd_parquet_2 1.00 139.6±0.58ms 117.5 MB/sec 1.03 144.1±0.57ms 113.9 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.3±0.16ms 53.5 MB/sec 1.00 26.4±0.17ms 53.3 MB/sec string_ree_95pct_null/cdc 1.01 32.7±0.18ms 43.0 MB/sec 1.00 32.4±0.12ms 43.4 MB/sec string_ree_95pct_null/default 1.00 24.8±0.11ms 56.8 MB/sec 1.00 24.9±0.11ms 56.6 MB/sec string_ree_95pct_null/parquet_2 1.00 24.8±0.12ms 56.8 MB/sec 1.00 24.8±0.12ms 56.6 MB/sec string_ree_95pct_null/zstd 1.00 25.6±0.14ms 55.0 MB/sec 1.00 25.7±0.14ms 54.8 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.13ms 55.2 MB/sec 1.01 25.7±0.12ms 54.8 MB/sec struct_all_null/bloom_filter 1.01 372.1±2.55µs 42.3 GB/sec 1.00 369.3±1.36µs 42.6 GB/sec struct_all_null/cdc 1.01 7.9±0.13ms 2.0 GB/sec 1.00 7.8±0.07ms 2.0 GB/sec struct_all_null/default 1.00 117.4±0.62µs 134.2 GB/sec 1.01 118.2±0.67µs 133.2 GB/sec struct_all_null/parquet_2 1.00 121.6±0.45µs 129.5 GB/sec 1.00 121.7±0.60µs 129.4 GB/sec struct_all_null/zstd 1.00 181.2±0.51µs 86.9 GB/sec 1.00 181.0±1.10µs 87.0 GB/sec struct_all_null/zstd_parquet_2 1.00 161.4±0.64µs 97.5 GB/sec 1.02 164.8±0.46µs 95.6 GB/sec struct_non_null/bloom_filter 1.05 45.4±0.21ms 352.2 MB/sec 1.00 43.2±0.21ms 370.0 MB/sec struct_non_null/cdc 1.02 43.4±0.16ms 368.3 MB/sec 1.00 42.6±0.14ms 375.6 MB/sec struct_non_null/default 1.02 30.0±0.13ms 533.9 MB/sec 1.00 29.4±0.13ms 544.6 MB/sec struct_non_null/parquet_2 1.02 38.9±0.16ms 411.6 MB/sec 1.00 38.2±0.14ms 418.8 MB/sec struct_non_null/zstd 1.01 38.6±0.12ms 414.5 MB/sec 1.00 38.1±0.16ms 419.5 MB/sec struct_non_null/zstd_parquet_2 1.01 52.5±0.16ms 304.8 MB/sec 1.00 51.9±0.14ms 308.6 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.08ms 2.4 GB/sec 1.04 6.9±0.06ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.03 14.1±0.12ms 1145.2 MB/sec 1.00 13.7±0.09ms 1176.5 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.04ms 2.6 GB/sec 1.05 6.3±0.04ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.03ms 2.6 GB/sec 1.06 6.3±0.03ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.05ms 2.1 GB/sec 1.05 7.8±0.07ms 2.0 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.05ms 2.3 GB/sec 1.05 7.1±0.05ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3280.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3151.2s | | CPU sys | 123.5s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3260.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3156.9s | | CPU sys | 96.9s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
