adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5338100896
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5337105232) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 2d2d4adc624a9ffb4a2b850fe86bf0c9df097313 (2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) to 2d2d4adc624a9ffb4a2b850fe86bf0c9df097313 [diff](https://github.com/apache/arrow-rs/compare/2d2d4adc624a9ffb4a2b850fe86bf0c9df097313..2d2d4adc624a9ffb4a2b850fe86bf0c9df097313) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "2d2d4adc624a9ffb4a2b850fe86bf0c9df097313" changed: ref: "2d2d4adc624a9ffb4a2b850fe86bf0c9df097313" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.05ms 19.7 MB/sec 1.03 13.0±0.09ms 19.2 MB/sec bool/cdc 1.00 15.4±0.04ms 16.3 MB/sec 1.01 15.5±0.10ms 16.1 MB/sec bool/default 1.00 10.6±0.04ms 23.7 MB/sec 1.03 10.9±0.08ms 23.0 MB/sec bool/parquet_2 1.00 13.4±0.05ms 18.6 MB/sec 1.03 13.8±0.10ms 18.1 MB/sec bool/zstd 1.00 11.1±0.04ms 22.6 MB/sec 1.03 11.4±0.07ms 21.9 MB/sec bool/zstd_parquet_2 1.00 13.8±0.04ms 18.1 MB/sec 1.02 14.1±0.07ms 17.7 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.02ms 19.0 MB/sec 1.00 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.02ms 19.8 MB/sec 1.00 6.3±0.03ms 19.8 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.9 MB/sec 1.00 3.8±0.02ms 32.8 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.5 MB/sec 1.00 7.6±0.02ms 16.5 MB/sec bool_non_null/zstd 1.00 4.2±0.03ms 30.0 MB/sec 1.00 4.2±0.02ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.00 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.0±0.05ms 7.1 MB/sec 1.01 30.5±0.12ms 7.0 MB/sec bool_ree/cdc 1.00 31.3±0.08ms 6.8 MB/sec 1.01 31.6±0.17ms 6.7 MB/sec bool_ree/default 1.00 27.3±0.05ms 7.8 MB/sec 1.02 27.7±0.14ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.7±0.07ms 7.4 MB/sec 1.02 29.2±0.12ms 7.3 MB/sec bool_ree/zstd 1.00 27.9±0.05ms 7.6 MB/sec 1.02 28.3±0.12ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.0±0.05ms 7.3 MB/sec 1.01 29.5±0.11ms 7.2 MB/sec decimal/bloom_filter 1.00 117.4±0.39ms 511.2 MB/sec 1.02 119.3±1.03ms 502.8 MB/sec decimal/cdc 1.00 100.6±0.34ms 596.3 MB/sec 1.02 102.3±3.91ms 586.4 MB/sec decimal/default 1.00 78.3±0.35ms 765.9 MB/sec 1.00 78.5±0.29ms 764.7 MB/sec decimal/parquet_2 1.00 176.6±2.14ms 339.7 MB/sec 1.01 177.6±2.29ms 337.8 MB/sec decimal/zstd 1.00 89.2±1.02ms 672.6 MB/sec 1.00 89.4±0.31ms 671.1 MB/sec decimal/zstd_parquet_2 1.00 196.2±1.91ms 305.8 MB/sec 1.00 197.1±1.83ms 304.4 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.1±0.25ms 17.3 MB/sec 1.01 58.7±0.26ms 17.2 MB/sec fixed_size_binary_ree/cdc 1.00 62.0±0.30ms 16.3 MB/sec 1.01 62.4±1.78ms 16.1 MB/sec fixed_size_binary_ree/default 1.00 51.5±0.23ms 19.6 MB/sec 1.01 51.7±0.22ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 65.8±0.21ms 15.3 MB/sec 1.01 66.4±0.25ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.00 57.1±0.21ms 17.6 MB/sec 1.01 57.6±0.27ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.5±0.24ms 15.1 MB/sec 1.01 67.4±0.30ms 14.9 MB/sec float_with_nans/bloom_filter 1.00 79.8±0.25ms 175.4 MB/sec 1.02 81.2±0.24ms 172.5 MB/sec float_with_nans/cdc 1.00 70.1±0.70ms 199.6 MB/sec 1.01 71.2±1.99ms 196.7 MB/sec float_with_nans/default 1.00 62.9±0.21ms 222.6 MB/sec 1.00 63.0±0.19ms 222.1 MB/sec float_with_nans/parquet_2 1.01 80.6±0.20ms 173.8 MB/sec 1.00 80.1±0.19ms 174.7 MB/sec float_with_nans/zstd 1.00 101.2±1.01ms 138.4 MB/sec 1.00 101.2±0.19ms 138.3 MB/sec float_with_nans/zstd_parquet_2 1.00 117.1±0.96ms 119.6 MB/sec 1.00 117.2±0.20ms 119.5 MB/sec fsb/bloom_filter 1.00 8.0±0.03ms 2013.9 MB/sec 1.00 8.0±0.04ms 2012.1 MB/sec fsb/cdc 1.00 10.3±0.04ms 1560.8 MB/sec 1.01 10.5±0.20ms 1540.6 MB/sec fsb/default 1.00 7.0±0.02ms 2.3 GB/sec 1.00 7.0±0.04ms 2.3 GB/sec fsb/parquet_2 1.00 13.1±0.05ms 1226.4 MB/sec 1.02 13.3±0.06ms 1208.1 MB/sec fsb/zstd 1.00 9.4±0.03ms 1723.0 MB/sec 1.01 9.5±0.05ms 1704.2 MB/sec fsb/zstd_parquet_2 1.00 14.1±0.09ms 1144.6 MB/sec 1.02 14.3±0.09ms 1124.3 MB/sec int32_ree/bloom_filter 1.00 40.4±0.13ms 10.1 MB/sec 1.01 41.0±0.22ms 9.9 MB/sec int32_ree/cdc 1.00 40.3±0.08ms 10.1 MB/sec 1.00 40.5±0.18ms 10.0 MB/sec int32_ree/default 1.00 36.5±0.08ms 11.1 MB/sec 1.01 37.0±0.11ms 11.0 MB/sec int32_ree/parquet_2 1.00 36.5±0.06ms 11.1 MB/sec 1.01 37.0±0.12ms 11.0 MB/sec int32_ree/zstd 1.00 37.2±0.06ms 10.9 MB/sec 1.01 37.5±0.11ms 10.8 MB/sec int32_ree/zstd_parquet_2 1.00 37.0±0.07ms 11.0 MB/sec 1.01 37.5±0.13ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.03ms 18.6 MB/sec 1.00 21.9±0.03ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.03ms 17.0 MB/sec 1.00 23.9±0.04ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.02ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.03ms 18.7 MB/sec 1.00 21.8±0.02ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.02ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 63.9±0.47ms 3.9 GB/sec 1.01 64.2±0.29ms 3.9 GB/sec large_string_distinct/plain 1.00 60.0±0.82ms 4.2 GB/sec 1.00 59.9±0.79ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 52.9±0.30ms 4.7 GB/sec 1.01 53.4±0.31ms 4.7 GB/sec large_string_non_null/bloom_filter 1.00 72.5±0.11ms 3.4 GB/sec 1.04 75.5±0.12ms 3.3 GB/sec large_string_non_null/cdc 1.01 244.0±1.06ms 1049.1 MB/sec 1.00 242.0±0.99ms 1057.7 MB/sec large_string_non_null/default 1.00 54.7±0.10ms 4.6 GB/sec 1.06 57.9±0.12ms 4.3 GB/sec large_string_non_null/parquet_2 1.00 54.7±0.09ms 4.6 GB/sec 1.06 57.9±0.14ms 4.3 GB/sec large_string_non_null/zstd 1.00 54.7±0.09ms 4.6 GB/sec 1.06 58.0±0.13ms 4.3 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.7±0.10ms 4.6 GB/sec 1.06 58.0±0.11ms 4.3 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.4±0.17ms 4.6 GB/sec 1.02 55.3±0.17ms 4.5 GB/sec large_string_shared_prefix/plain 1.00 92.0±0.83ms 2.7 GB/sec 1.01 92.7±0.48ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 54.0±0.19ms 4.6 GB/sec 1.00 54.2±0.27ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 46.5±0.17ms 5.4 GB/sec 1.01 46.8±0.09ms 5.3 GB/sec large_string_shared_prefix_nullable/plain 1.00 60.7±0.25ms 4.1 GB/sec 1.05 63.7±0.37ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.4±0.10ms 4.6 GB/sec 1.02 27.8±0.09ms 4.5 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 66.1±0.21ms 3.8 GB/sec 1.02 67.4±0.29ms 3.7 GB/sec list_nested/bloom_filter 1.01 144.3±0.18ms 200.0 MB/sec 1.00 142.4±0.20ms 202.6 MB/sec list_nested/cdc 1.00 160.9±0.14ms 179.3 MB/sec 1.00 160.3±0.30ms 180.0 MB/sec list_nested/default 1.00 130.0±0.15ms 222.0 MB/sec 1.00 129.3±0.18ms 223.1 MB/sec list_nested/parquet_2 1.00 143.1±0.17ms 201.6 MB/sec 1.00 142.5±0.20ms 202.4 MB/sec list_nested/zstd 1.00 139.1±0.19ms 207.4 MB/sec 1.00 138.5±0.20ms 208.3 MB/sec list_nested/zstd_parquet_2 1.00 155.9±0.18ms 185.1 MB/sec 1.00 155.3±0.18ms 185.8 MB/sec list_primitive/bloom_filter 1.00 277.3±1.06ms 1966.6 MB/sec 1.00 277.7±1.75ms 1963.8 MB/sec list_primitive/cdc 1.00 309.1±1.76ms 1764.3 MB/sec 1.01 311.4±1.58ms 1751.1 MB/sec list_primitive/default 1.00 201.3±0.96ms 2.6 GB/sec 1.01 202.4±2.50ms 2.6 GB/sec list_primitive/parquet_2 1.00 222.9±0.27ms 2.4 GB/sec 1.00 223.3±1.27ms 2.4 GB/sec list_primitive/zstd 1.00 454.2±1.41ms 1200.7 MB/sec 1.00 455.5±1.82ms 1197.2 MB/sec list_primitive/zstd_parquet_2 1.00 445.3±1.15ms 1224.7 MB/sec 1.00 445.5±0.51ms 1224.1 MB/sec list_primitive_non_null/bloom_filter 1.00 363.7±3.59ms 1496.2 MB/sec 1.03 375.3±4.14ms 1450.3 MB/sec list_primitive_non_null/cdc 1.00 388.0±8.46ms 1402.6 MB/sec 1.01 390.9±9.26ms 1392.1 MB/sec list_primitive_non_null/default 1.00 231.4±3.67ms 2.3 GB/sec 1.06 244.5±3.46ms 2.2 GB/sec list_primitive_non_null/parquet_2 1.00 255.6±6.78ms 2.1 GB/sec 1.03 264.3±15.44ms 2.0 GB/sec list_primitive_non_null/zstd 1.00 648.9±2.81ms 838.7 MB/sec 1.04 672.3±1.81ms 809.6 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 644.0±6.33ms 845.1 MB/sec 1.01 652.9±11.16ms 833.5 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.5±0.05ms 2.9 GB/sec 1.00 12.6±0.04ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.0±0.08ms 1557.0 MB/sec 1.00 24.1±0.12ms 1549.9 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.2±0.04ms 3.0 GB/sec 1.00 12.3±0.03ms 3.0 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.2±0.03ms 3.0 GB/sec 1.01 12.4±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.1±0.05ms 2.6 GB/sec 1.01 14.3±0.07ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.4±0.03ms 2.9 GB/sec 1.01 12.5±0.06ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 281.1±1.15ms 162.2 MB/sec 1.01 283.6±0.47ms 160.7 MB/sec list_struct_with_list/cdc 1.00 319.5±0.55ms 142.7 MB/sec 1.00 320.3±1.03ms 142.4 MB/sec list_struct_with_list/default 1.00 254.9±0.54ms 178.9 MB/sec 1.00 255.1±0.51ms 178.7 MB/sec list_struct_with_list/parquet_2 1.00 272.5±0.53ms 167.3 MB/sec 1.00 272.5±0.55ms 167.3 MB/sec list_struct_with_list/zstd 1.00 276.7±0.53ms 164.8 MB/sec 1.00 277.0±0.78ms 164.6 MB/sec list_struct_with_list/zstd_parquet_2 1.00 295.4±0.53ms 154.3 MB/sec 1.00 295.7±0.51ms 154.2 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 39.9±0.69ms 6.3 GB/sec 1.03 41.2±0.25ms 6.1 GB/sec primitive/bloom_filter 1.00 145.8±0.42ms 307.8 MB/sec 1.01 147.4±0.84ms 304.5 MB/sec primitive/cdc 1.00 154.8±0.56ms 289.8 MB/sec 1.00 155.0±0.69ms 289.6 MB/sec primitive/default 1.00 113.6±0.26ms 395.0 MB/sec 1.02 115.8±0.49ms 387.5 MB/sec primitive/parquet_2 1.00 128.8±0.31ms 348.5 MB/sec 1.01 130.7±0.46ms 343.4 MB/sec primitive/zstd 1.00 143.4±0.24ms 313.0 MB/sec 1.01 145.2±0.43ms 309.0 MB/sec primitive/zstd_parquet_2 1.00 162.1±0.55ms 276.8 MB/sec 1.01 163.5±0.52ms 274.4 MB/sec primitive_all_null/bloom_filter 1.00 884.8±2.51µs 49.5 GB/sec 1.00 888.2±2.60µs 49.3 GB/sec primitive_all_null/cdc 1.00 19.1±0.32ms 2.3 GB/sec 1.00 19.1±0.31ms 2.3 GB/sec primitive_all_null/default 1.01 277.5±1.42µs 157.9 GB/sec 1.00 275.1±1.32µs 159.3 GB/sec primitive_all_null/parquet_2 1.01 282.9±1.31µs 154.9 GB/sec 1.00 280.3±1.20µs 156.4 GB/sec primitive_all_null/zstd 1.01 427.6±1.34µs 102.5 GB/sec 1.00 424.5±1.29µs 103.2 GB/sec primitive_all_null/zstd_parquet_2 1.01 384.5±1.29µs 114.0 GB/sec 1.00 381.4±1.41µs 114.9 GB/sec primitive_non_null/bloom_filter 1.01 101.7±0.42ms 432.6 MB/sec 1.00 101.2±0.31ms 434.8 MB/sec primitive_non_null/cdc 1.00 85.1±0.24ms 517.1 MB/sec 1.00 84.7±0.32ms 519.4 MB/sec primitive_non_null/default 1.01 62.3±0.23ms 705.8 MB/sec 1.00 61.9±0.17ms 710.5 MB/sec primitive_non_null/parquet_2 1.00 84.1±0.29ms 523.0 MB/sec 1.00 83.8±0.22ms 525.3 MB/sec primitive_non_null/zstd 1.00 93.0±0.22ms 473.2 MB/sec 1.00 92.6±0.27ms 475.1 MB/sec primitive_non_null/zstd_parquet_2 1.01 117.3±0.21ms 375.2 MB/sec 1.00 116.7±0.21ms 377.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.2±0.08ms 3.6 GB/sec 1.00 12.3±0.08ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.9±0.26ms 1502.3 MB/sec 1.00 29.9±0.25ms 1502.7 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.04ms 4.1 GB/sec 1.00 10.7±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.08ms 4.1 GB/sec 1.00 10.7±0.03ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.1±0.05ms 3.1 GB/sec 1.00 14.1±0.06ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.04ms 3.5 GB/sec 1.00 12.7±0.05ms 3.5 GB/sec short_string_non_null/bloom_filter 1.04 28.1±0.06ms 427.6 MB/sec 1.00 27.1±0.08ms 442.7 MB/sec short_string_non_null/cdc 1.00 19.7±0.04ms 608.4 MB/sec 1.00 19.7±0.04ms 609.6 MB/sec short_string_non_null/default 1.00 15.6±0.03ms 770.9 MB/sec 1.01 15.7±0.06ms 764.4 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.04ms 465.0 MB/sec 1.01 26.0±0.06ms 461.5 MB/sec short_string_non_null/zstd 1.00 35.9±0.09ms 334.5 MB/sec 1.00 36.0±0.12ms 333.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.8±0.08ms 417.1 MB/sec 1.01 29.1±0.11ms 412.4 MB/sec small_string_distinct/delta_byte_array 1.00 986.9±5.49µs 7.9 GB/sec 1.00 982.5±6.86µs 8.0 GB/sec small_string_distinct/plain 1.00 736.4±2.92µs 10.7 GB/sec 1.00 738.6±3.04µs 10.6 GB/sec small_string_partial_prefix/delta_byte_array 1.00 998.7±4.23µs 7.9 GB/sec 1.01 1007.1±4.06µs 7.8 GB/sec small_string_partial_prefix/plain 1.00 988.2±2.98µs 7.9 GB/sec 1.01 995.5±4.75µs 7.9 GB/sec small_string_shared_prefix/delta_byte_array 1.00 964.7±1.77µs 8.1 GB/sec 1.00 961.6±2.46µs 8.2 GB/sec small_string_shared_prefix/plain 1.00 1103.1±6.38µs 7.1 GB/sec 1.00 1102.7±7.88µs 7.1 GB/sec string/bloom_filter 1.13 212.4±17.61ms 2.4 GB/sec 1.00 187.9±1.48ms 2.7 GB/sec string/cdc 1.02 209.6±7.53ms 2.4 GB/sec 1.00 205.2±6.18ms 2.5 GB/sec string/default 1.00 117.6±17.62ms 4.4 GB/sec 1.05 123.2±22.38ms 4.2 GB/sec string/parquet_2 1.08 116.2±1.00ms 4.4 GB/sec 1.00 107.5±0.55ms 4.8 GB/sec string/zstd 1.00 465.9±16.44ms 1125.3 MB/sec 1.00 466.4±13.41ms 1124.0 MB/sec string/zstd_parquet_2 1.02 391.8±7.78ms 1338.0 MB/sec 1.00 384.1±2.15ms 1364.8 MB/sec string_and_binary_view/bloom_filter 1.00 65.1±0.18ms 495.2 MB/sec 1.00 64.9±0.14ms 497.3 MB/sec string_and_binary_view/cdc 1.00 59.2±0.13ms 544.5 MB/sec 1.00 58.9±0.17ms 547.2 MB/sec string_and_binary_view/default 1.01 48.4±0.10ms 665.7 MB/sec 1.00 48.1±0.11ms 669.8 MB/sec string_and_binary_view/parquet_2 1.00 59.6±0.12ms 541.3 MB/sec 1.00 59.3±0.11ms 543.6 MB/sec string_and_binary_view/zstd 1.00 85.6±0.22ms 376.8 MB/sec 1.00 85.3±0.15ms 378.0 MB/sec string_and_binary_view/zstd_parquet_2 1.01 73.6±0.15ms 438.1 MB/sec 1.00 73.2±0.12ms 440.3 MB/sec string_dictionary/bloom_filter 1.01 85.6±1.03ms 3.0 GB/sec 1.00 85.1±2.48ms 3.0 GB/sec string_dictionary/cdc 1.02 47.7±0.16ms 5.4 GB/sec 1.00 46.6±0.49ms 5.5 GB/sec string_dictionary/default 1.00 42.7±1.10ms 6.0 GB/sec 1.01 43.2±0.15ms 6.0 GB/sec string_dictionary/parquet_2 1.00 48.8±0.08ms 5.3 GB/sec 1.00 48.8±0.13ms 5.3 GB/sec string_dictionary/zstd 1.00 205.7±1.43ms 1284.3 MB/sec 1.01 208.5±0.64ms 1266.8 MB/sec string_dictionary/zstd_parquet_2 1.00 192.1±0.14ms 1375.1 MB/sec 1.00 192.5±0.29ms 1372.2 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.3±0.14ms 116.7 MB/sec 1.00 34.4±0.17ms 116.5 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.7±0.12ms 144.4 MB/sec 1.00 27.8±0.13ms 143.9 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.4±0.13ms 157.5 MB/sec 1.00 25.6±0.14ms 156.8 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.5±0.13ms 157.3 MB/sec 1.00 25.6±0.14ms 156.6 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.8±0.12ms 155.0 MB/sec 1.00 26.0±0.15ms 154.3 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.8±0.12ms 155.2 MB/sec 1.00 25.9±0.14ms 154.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 33.9±0.17ms 118.2 MB/sec 1.00 33.3±0.16ms 120.3 MB/sec string_dictionary_low_cardinality_20/cdc 1.01 27.5±0.15ms 145.9 MB/sec 1.00 27.3±0.13ms 146.9 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.1±0.13ms 159.3 MB/sec 1.00 25.0±0.14ms 160.3 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.02 25.6±0.13ms 156.5 MB/sec 1.00 25.0±0.15ms 160.2 MB/sec string_dictionary_low_cardinality_20/zstd 1.01 25.5±0.27ms 157.0 MB/sec 1.00 25.3±0.15ms 158.6 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.02 25.7±0.12ms 155.6 MB/sec 1.00 25.2±0.16ms 158.8 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.01 35.3±0.15ms 113.7 MB/sec 1.00 34.9±0.13ms 115.1 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.1±0.13ms 142.7 MB/sec 1.00 28.1±0.12ms 142.8 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.8±0.16ms 155.4 MB/sec 1.00 25.7±0.12ms 155.8 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.8±0.14ms 155.5 MB/sec 1.00 25.8±0.13ms 155.7 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.3±0.14ms 152.5 MB/sec 1.00 26.3±0.12ms 152.6 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.3±0.14ms 152.4 MB/sec 1.00 26.3±0.14ms 152.7 MB/sec string_non_null/bloom_filter 1.05 234.9±15.12ms 2.2 GB/sec 1.00 224.2±15.08ms 2.3 GB/sec string_non_null/cdc 1.00 236.0±0.51ms 2.2 GB/sec 1.05 248.2±5.25ms 2.1 GB/sec string_non_null/default 1.03 116.9±13.00ms 4.4 GB/sec 1.00 113.0±13.87ms 4.5 GB/sec string_non_null/parquet_2 1.02 109.9±7.37ms 4.7 GB/sec 1.00 107.5±0.37ms 4.8 GB/sec string_non_null/zstd 1.00 543.2±9.08ms 964.7 MB/sec 1.01 548.1±1.75ms 956.1 MB/sec string_non_null/zstd_parquet_2 1.00 498.3±5.39ms 1051.6 MB/sec 1.01 505.8±5.89ms 1036.1 MB/sec string_ree/bloom_filter 1.00 150.3±1.56ms 109.2 MB/sec 1.01 151.9±0.64ms 108.0 MB/sec string_ree/cdc 1.14 221.3±0.86ms 74.1 MB/sec 1.00 194.0±5.86ms 84.6 MB/sec string_ree/default 1.00 121.6±1.97ms 134.9 MB/sec 1.02 123.9±1.93ms 132.4 MB/sec string_ree/parquet_2 1.03 128.7±0.39ms 127.5 MB/sec 1.00 124.9±0.37ms 131.4 MB/sec string_ree/zstd 1.01 183.0±1.17ms 89.6 MB/sec 1.00 181.7±1.98ms 90.3 MB/sec string_ree/zstd_parquet_2 1.03 143.8±0.36ms 114.1 MB/sec 1.00 139.3±0.45ms 117.8 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.3±0.11ms 53.6 MB/sec 1.00 26.2±0.09ms 53.7 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.06ms 43.5 MB/sec 1.00 32.3±0.08ms 43.5 MB/sec string_ree_95pct_null/default 1.00 24.8±0.06ms 56.8 MB/sec 1.00 24.7±0.06ms 56.9 MB/sec string_ree_95pct_null/parquet_2 1.00 24.7±0.06ms 56.8 MB/sec 1.00 24.7±0.07ms 56.9 MB/sec string_ree_95pct_null/zstd 1.00 25.6±0.08ms 55.0 MB/sec 1.00 25.6±0.07ms 55.0 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.06ms 55.1 MB/sec 1.00 25.5±0.06ms 55.2 MB/sec struct_all_null/bloom_filter 1.00 371.2±1.30µs 42.4 GB/sec 1.00 372.7±1.33µs 42.2 GB/sec struct_all_null/cdc 1.00 7.8±0.06ms 2.0 GB/sec 1.02 7.9±0.16ms 2043.1 MB/sec struct_all_null/default 1.01 118.3±0.82µs 133.1 GB/sec 1.00 117.5±0.56µs 134.0 GB/sec struct_all_null/parquet_2 1.01 120.1±0.66µs 131.1 GB/sec 1.00 119.2±0.46µs 132.1 GB/sec struct_all_null/zstd 1.01 182.6±0.55µs 86.3 GB/sec 1.00 181.6±0.54µs 86.7 GB/sec struct_all_null/zstd_parquet_2 1.01 164.2±0.60µs 95.9 GB/sec 1.00 162.8±0.55µs 96.7 GB/sec struct_non_null/bloom_filter 1.00 43.0±0.12ms 372.5 MB/sec 1.03 44.4±0.16ms 360.6 MB/sec struct_non_null/cdc 1.00 42.9±0.13ms 373.0 MB/sec 1.00 43.1±0.14ms 371.6 MB/sec struct_non_null/default 1.00 29.3±0.09ms 546.1 MB/sec 1.00 29.4±0.11ms 544.0 MB/sec struct_non_null/parquet_2 1.03 39.5±1.83ms 405.2 MB/sec 1.00 38.2±0.10ms 418.9 MB/sec struct_non_null/zstd 1.00 37.8±0.10ms 422.9 MB/sec 1.00 38.0±0.10ms 421.3 MB/sec struct_non_null/zstd_parquet_2 1.03 53.4±2.23ms 299.8 MB/sec 1.00 52.0±0.15ms 307.8 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.5±0.03ms 2.4 GB/sec 1.00 6.5±0.03ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.5±0.09ms 1196.1 MB/sec 1.00 13.5±0.08ms 1191.8 MB/sec struct_sparse_99pct_null/default 1.00 5.9±0.01ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.00 6.0±0.02ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.4±0.01ms 2.1 GB/sec 1.00 7.3±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.7±0.02ms 2.3 GB/sec 1.00 6.7±0.03ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3149.1s | | CPU sys | 83.6s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3235.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3144.7s | | CPU sys | 84.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
