adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5337266457
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335768156) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing 7c306e401c0f22a0c39f34989148c018af95ace8 (7c306e401c0f22a0c39f34989148c018af95ace8) to 7c306e401c0f22a0c39f34989148c018af95ace8 [diff](https://github.com/apache/arrow-rs/compare/7c306e401c0f22a0c39f34989148c018af95ace8..7c306e401c0f22a0c39f34989148c018af95ace8) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "7c306e401c0f22a0c39f34989148c018af95ace8" changed: ref: "7c306e401c0f22a0c39f34989148c018af95ace8" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.03 13.0±0.10ms 19.2 MB/sec 1.00 12.7±0.05ms 19.8 MB/sec bool/cdc 1.01 15.5±0.11ms 16.1 MB/sec 1.00 15.4±0.06ms 16.3 MB/sec bool/default 1.04 10.9±0.09ms 22.9 MB/sec 1.00 10.5±0.03ms 23.8 MB/sec bool/parquet_2 1.03 13.9±0.10ms 18.0 MB/sec 1.00 13.5±0.04ms 18.6 MB/sec bool/zstd 1.04 11.4±0.09ms 21.9 MB/sec 1.00 11.0±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.03 14.2±0.10ms 17.6 MB/sec 1.00 13.8±0.04ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.6±0.03ms 19.0 MB/sec 1.00 6.6±0.03ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 19.8 MB/sec 1.00 6.3±0.03ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.03ms 32.9 MB/sec 1.01 3.8±0.02ms 32.7 MB/sec bool_non_null/parquet_2 1.00 7.6±0.03ms 16.4 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.00 4.2±0.03ms 30.0 MB/sec 1.00 4.2±0.02ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.5 MB/sec 1.00 8.1±0.03ms 15.5 MB/sec bool_ree/bloom_filter 1.00 30.1±0.07ms 7.1 MB/sec 1.00 30.0±0.05ms 7.1 MB/sec bool_ree/cdc 1.00 31.3±0.09ms 6.8 MB/sec 1.00 31.3±0.08ms 6.8 MB/sec bool_ree/default 1.01 27.5±0.10ms 7.7 MB/sec 1.00 27.3±0.07ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.9±0.08ms 7.4 MB/sec 1.00 28.8±0.06ms 7.4 MB/sec bool_ree/zstd 1.00 28.0±0.06ms 7.6 MB/sec 1.00 27.9±0.08ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.2±0.08ms 7.3 MB/sec 1.00 29.1±0.06ms 7.3 MB/sec decimal/bloom_filter 1.00 117.3±1.05ms 511.4 MB/sec 1.00 117.7±0.50ms 509.7 MB/sec decimal/cdc 1.00 100.4±0.26ms 597.9 MB/sec 1.01 101.2±0.61ms 592.9 MB/sec decimal/default 1.00 78.2±1.69ms 767.5 MB/sec 1.01 78.6±0.37ms 763.0 MB/sec decimal/parquet_2 1.00 176.3±2.09ms 340.4 MB/sec 1.01 177.7±1.70ms 337.7 MB/sec decimal/zstd 1.00 88.9±0.31ms 674.8 MB/sec 1.01 89.6±0.39ms 670.0 MB/sec decimal/zstd_parquet_2 1.00 196.8±1.88ms 304.8 MB/sec 1.00 197.6±2.37ms 303.7 MB/sec fixed_size_binary_ree/bloom_filter 1.00 57.5±0.93ms 17.5 MB/sec 1.00 57.6±0.35ms 17.5 MB/sec fixed_size_binary_ree/cdc 1.00 61.2±0.23ms 16.5 MB/sec 1.01 61.5±0.23ms 16.4 MB/sec fixed_size_binary_ree/default 1.00 51.2±0.17ms 19.7 MB/sec 1.00 51.2±0.24ms 19.7 MB/sec fixed_size_binary_ree/parquet_2 1.00 65.5±0.22ms 15.4 MB/sec 1.00 65.6±0.92ms 15.3 MB/sec fixed_size_binary_ree/zstd 1.00 57.0±0.18ms 17.7 MB/sec 1.00 56.9±0.28ms 17.7 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 66.1±0.19ms 15.2 MB/sec 1.00 66.2±0.23ms 15.2 MB/sec float_with_nans/bloom_filter 1.00 79.4±0.22ms 176.4 MB/sec 1.02 80.6±1.06ms 173.7 MB/sec float_with_nans/cdc 1.00 69.9±0.27ms 200.4 MB/sec 1.01 70.4±0.26ms 198.9 MB/sec float_with_nans/default 1.00 62.6±0.19ms 223.7 MB/sec 1.01 63.2±0.28ms 221.6 MB/sec float_with_nans/parquet_2 1.00 79.8±0.21ms 175.5 MB/sec 1.01 80.5±0.20ms 173.9 MB/sec float_with_nans/zstd 1.00 100.8±1.04ms 138.9 MB/sec 1.01 101.4±0.21ms 138.1 MB/sec float_with_nans/zstd_parquet_2 1.00 117.0±1.10ms 119.7 MB/sec 1.01 117.7±0.66ms 118.9 MB/sec fsb/bloom_filter 1.00 8.0±0.04ms 2004.6 MB/sec 1.00 8.0±0.06ms 2003.4 MB/sec fsb/cdc 1.00 10.4±0.02ms 1553.8 MB/sec 1.01 10.5±0.05ms 1534.8 MB/sec fsb/default 1.00 6.9±0.03ms 2.3 GB/sec 1.01 7.0±0.04ms 2.2 GB/sec fsb/parquet_2 1.00 13.1±0.07ms 1227.1 MB/sec 1.01 13.3±0.27ms 1211.3 MB/sec fsb/zstd 1.00 9.3±0.03ms 1724.8 MB/sec 1.02 9.5±0.05ms 1691.9 MB/sec fsb/zstd_parquet_2 1.00 14.0±0.06ms 1152.6 MB/sec 1.02 14.3±0.11ms 1130.1 MB/sec int32_ree/bloom_filter 1.00 40.4±0.08ms 10.1 MB/sec 1.00 40.4±0.21ms 10.1 MB/sec int32_ree/cdc 1.00 40.2±0.11ms 10.1 MB/sec 1.00 40.2±0.09ms 10.1 MB/sec int32_ree/default 1.00 36.6±0.06ms 11.1 MB/sec 1.00 36.5±0.10ms 11.1 MB/sec int32_ree/parquet_2 1.00 36.6±0.10ms 11.1 MB/sec 1.00 36.5±0.10ms 11.1 MB/sec int32_ree/zstd 1.00 37.2±0.10ms 10.9 MB/sec 1.00 37.1±0.12ms 11.0 MB/sec int32_ree/zstd_parquet_2 1.00 37.1±0.11ms 11.0 MB/sec 1.00 37.0±0.09ms 11.0 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.8±0.02ms 18.6 MB/sec 1.02 22.2±0.07ms 18.3 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.05ms 17.1 MB/sec 1.00 23.9±0.08ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.02ms 18.9 MB/sec 1.00 21.5±0.04ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.02ms 18.9 MB/sec 1.00 21.6±0.04ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.03ms 18.7 MB/sec 1.00 21.9±0.05ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.02ms 18.7 MB/sec 1.00 21.8±0.04ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 74.0±1.04ms 3.4 GB/sec 1.00 73.8±0.74ms 3.4 GB/sec large_string_distinct/plain 1.00 59.5±0.93ms 4.2 GB/sec 1.00 59.6±0.88ms 4.2 GB/sec large_string_distinct_nullable/delta_byte_array 1.00 52.7±0.36ms 4.7 GB/sec 1.02 53.6±2.98ms 4.7 GB/sec large_string_non_null/bloom_filter 1.00 71.6±0.09ms 3.5 GB/sec 1.02 72.8±0.33ms 3.4 GB/sec large_string_non_null/cdc 1.00 242.3±0.68ms 1056.6 MB/sec 1.00 242.9±1.01ms 1053.9 MB/sec large_string_non_null/default 1.00 54.0±0.08ms 4.6 GB/sec 1.00 53.8±0.21ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 53.9±0.09ms 4.6 GB/sec 1.00 53.9±0.24ms 4.6 GB/sec large_string_non_null/zstd 1.00 53.9±0.08ms 4.6 GB/sec 1.00 53.9±0.17ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 53.9±0.08ms 4.6 GB/sec 1.00 54.0±0.28ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 105.5±0.49ms 2.4 GB/sec 1.00 105.7±0.49ms 2.4 GB/sec large_string_shared_prefix/plain 1.00 91.6±0.98ms 2.7 GB/sec 1.01 92.1±0.90ms 2.7 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 53.6±0.21ms 4.7 GB/sec 1.00 53.9±0.21ms 4.6 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.00 67.8±0.10ms 3.7 GB/sec 1.01 68.2±0.26ms 3.7 GB/sec large_string_shared_prefix_nullable/plain 1.00 61.1±0.33ms 4.1 GB/sec 1.01 61.8±0.79ms 4.0 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 52.8±0.32ms 2.4 GB/sec 1.00 52.9±0.22ms 2.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 65.7±0.12ms 3.8 GB/sec 1.02 66.9±0.22ms 3.7 GB/sec list_nested/bloom_filter 1.01 144.3±0.22ms 200.0 MB/sec 1.00 143.0±0.65ms 201.8 MB/sec list_nested/cdc 1.00 160.6±0.19ms 179.7 MB/sec 1.00 160.5±0.24ms 179.8 MB/sec list_nested/default 1.00 129.7±0.25ms 222.5 MB/sec 1.00 129.4±0.34ms 223.0 MB/sec list_nested/parquet_2 1.00 142.8±0.24ms 202.1 MB/sec 1.00 142.8±0.36ms 202.1 MB/sec list_nested/zstd 1.00 138.8±0.22ms 207.9 MB/sec 1.00 138.8±0.46ms 207.9 MB/sec list_nested/zstd_parquet_2 1.00 155.6±0.25ms 185.5 MB/sec 1.00 155.5±0.35ms 185.6 MB/sec list_primitive/bloom_filter 1.00 277.2±1.54ms 1967.4 MB/sec 1.01 279.4±2.67ms 1952.3 MB/sec list_primitive/cdc 1.00 310.3±1.47ms 1757.7 MB/sec 1.00 310.7±1.98ms 1755.1 MB/sec list_primitive/default 1.00 200.9±1.78ms 2.7 GB/sec 1.01 202.2±2.24ms 2.6 GB/sec list_primitive/parquet_2 1.00 222.9±1.48ms 2.4 GB/sec 1.00 223.3±1.44ms 2.4 GB/sec list_primitive/zstd 1.00 454.3±1.77ms 1200.6 MB/sec 1.01 457.9±2.78ms 1191.1 MB/sec list_primitive/zstd_parquet_2 1.00 444.7±1.45ms 1226.4 MB/sec 1.00 445.5±1.60ms 1224.2 MB/sec list_primitive_non_null/bloom_filter 1.00 379.0±4.64ms 1435.9 MB/sec 1.02 385.3±7.26ms 1412.4 MB/sec list_primitive_non_null/cdc 1.00 388.6±7.97ms 1400.5 MB/sec 1.01 391.4±10.06ms 1390.5 MB/sec list_primitive_non_null/default 1.00 244.1±4.34ms 2.2 GB/sec 1.04 253.0±7.15ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.00 263.0±14.70ms 2.0 GB/sec 1.11 291.3±1.12ms 1868.3 MB/sec list_primitive_non_null/zstd 1.00 668.5±2.47ms 814.1 MB/sec 1.02 679.5±4.10ms 801.0 MB/sec list_primitive_non_null/zstd_parquet_2 1.00 645.6±10.87ms 843.0 MB/sec 1.04 671.0±1.74ms 811.1 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.6±0.08ms 2.9 GB/sec 1.03 13.0±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 23.8±0.03ms 1568.1 MB/sec 1.01 24.1±0.11ms 1549.7 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.07ms 3.0 GB/sec 1.03 12.6±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.3±0.07ms 3.0 GB/sec 1.02 12.5±0.10ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.1±0.07ms 2.6 GB/sec 1.01 14.3±0.11ms 2.6 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.4±0.07ms 2.9 GB/sec 1.01 12.6±0.09ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 279.1±0.50ms 163.4 MB/sec 1.01 282.7±0.76ms 161.3 MB/sec list_struct_with_list/cdc 1.00 317.1±0.52ms 143.8 MB/sec 1.00 318.3±0.45ms 143.3 MB/sec list_struct_with_list/default 1.00 252.7±0.46ms 180.5 MB/sec 1.01 254.0±0.54ms 179.5 MB/sec list_struct_with_list/parquet_2 1.00 270.5±0.67ms 168.6 MB/sec 1.00 271.7±0.99ms 167.8 MB/sec list_struct_with_list/zstd 1.00 274.4±0.46ms 166.2 MB/sec 1.01 276.2±0.78ms 165.1 MB/sec list_struct_with_list/zstd_parquet_2 1.00 293.2±0.49ms 155.5 MB/sec 1.00 294.6±0.54ms 154.8 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.5±0.13ms 6.5 GB/sec 1.02 39.1±0.75ms 6.4 GB/sec primitive/bloom_filter 1.00 147.1±1.01ms 305.1 MB/sec 1.00 146.8±0.93ms 305.7 MB/sec primitive/cdc 1.00 154.7±0.76ms 290.1 MB/sec 1.00 155.3±0.77ms 288.9 MB/sec primitive/default 1.01 116.1±0.52ms 386.6 MB/sec 1.00 114.5±0.47ms 391.9 MB/sec primitive/parquet_2 1.01 131.0±0.54ms 342.5 MB/sec 1.00 129.7±0.49ms 346.1 MB/sec primitive/zstd 1.01 145.5±0.58ms 308.5 MB/sec 1.00 144.1±0.55ms 311.4 MB/sec primitive/zstd_parquet_2 1.00 163.1±0.95ms 275.1 MB/sec 1.00 162.7±0.71ms 275.9 MB/sec primitive_all_null/bloom_filter 1.00 878.5±1.42µs 49.9 GB/sec 1.00 880.2±4.03µs 49.8 GB/sec primitive_all_null/cdc 1.00 19.0±0.28ms 2.3 GB/sec 1.01 19.2±0.34ms 2.3 GB/sec primitive_all_null/default 1.00 274.8±1.29µs 159.5 GB/sec 1.01 276.8±1.88µs 158.3 GB/sec primitive_all_null/parquet_2 1.00 284.2±1.22µs 154.2 GB/sec 1.00 283.4±1.52µs 154.6 GB/sec primitive_all_null/zstd 1.00 424.5±1.59µs 103.2 GB/sec 1.01 428.2±1.97µs 102.3 GB/sec primitive_all_null/zstd_parquet_2 1.00 382.8±1.20µs 114.5 GB/sec 1.00 382.7±1.44µs 114.5 GB/sec primitive_non_null/bloom_filter 1.00 101.1±0.52ms 435.3 MB/sec 1.02 103.3±0.58ms 425.8 MB/sec primitive_non_null/cdc 1.00 84.5±0.26ms 520.8 MB/sec 1.01 85.3±0.41ms 515.8 MB/sec primitive_non_null/default 1.00 61.9±0.23ms 711.0 MB/sec 1.02 63.1±0.40ms 697.8 MB/sec primitive_non_null/parquet_2 1.00 83.4±0.22ms 527.5 MB/sec 1.02 84.9±0.37ms 518.5 MB/sec primitive_non_null/zstd 1.00 92.2±0.23ms 477.1 MB/sec 1.01 93.4±0.37ms 471.3 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.4±0.26ms 378.0 MB/sec 1.01 117.7±0.37ms 374.0 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.0±0.05ms 3.7 GB/sec 1.05 12.6±0.16ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.3±0.21ms 1531.2 MB/sec 1.03 30.2±0.26ms 1486.7 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.03ms 4.1 GB/sec 1.02 10.9±0.07ms 4.0 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.02ms 4.1 GB/sec 1.03 11.0±0.07ms 4.0 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.0±0.03ms 3.1 GB/sec 1.03 14.5±0.13ms 3.0 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.02ms 3.5 GB/sec 1.04 13.0±0.09ms 3.4 GB/sec short_string_non_null/bloom_filter 1.00 27.4±0.05ms 437.4 MB/sec 1.00 27.3±0.12ms 439.3 MB/sec short_string_non_null/cdc 1.00 19.6±0.04ms 612.6 MB/sec 1.02 20.0±0.21ms 600.9 MB/sec short_string_non_null/default 1.00 15.4±0.03ms 779.7 MB/sec 1.02 15.6±0.09ms 768.0 MB/sec short_string_non_null/parquet_2 1.00 25.7±0.06ms 467.8 MB/sec 1.01 25.9±0.07ms 464.1 MB/sec short_string_non_null/zstd 1.00 35.6±0.08ms 337.3 MB/sec 1.01 35.9±0.10ms 334.6 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.6±0.08ms 420.2 MB/sec 1.01 28.7±0.12ms 417.8 MB/sec small_string_distinct/delta_byte_array 1.00 929.3±4.99µs 8.4 GB/sec 1.08 999.3±6.17µs 7.8 GB/sec small_string_distinct/plain 1.07 736.8±1.61µs 10.6 GB/sec 1.00 690.3±6.16µs 11.4 GB/sec small_string_partial_prefix/delta_byte_array 1.00 982.4±1.71µs 8.0 GB/sec 1.02 1004.8±38.40µs 7.8 GB/sec small_string_partial_prefix/plain 1.05 988.9±1.94µs 7.9 GB/sec 1.00 940.8±8.58µs 8.3 GB/sec small_string_shared_prefix/delta_byte_array 1.02 999.4±1.92µs 7.8 GB/sec 1.00 981.6±3.02µs 8.0 GB/sec small_string_shared_prefix/plain 1.03 1093.4±3.89µs 7.2 GB/sec 1.00 1064.4±9.85µs 7.4 GB/sec string/bloom_filter 1.06 217.7±22.94ms 2.4 GB/sec 1.00 205.7±19.71ms 2.5 GB/sec string/cdc 1.00 205.0±6.76ms 2.5 GB/sec 1.01 206.4±10.62ms 2.5 GB/sec string/default 1.07 131.4±22.07ms 3.9 GB/sec 1.00 123.2±21.62ms 4.2 GB/sec string/parquet_2 1.08 181.2±0.51ms 2.8 GB/sec 1.00 168.5±0.65ms 3.0 GB/sec string/zstd 1.00 459.3±14.71ms 1141.4 MB/sec 1.01 465.0±11.34ms 1127.4 MB/sec string/zstd_parquet_2 1.00 384.0±4.70ms 1365.2 MB/sec 1.15 441.7±0.95ms 1186.9 MB/sec string_and_binary_view/bloom_filter 1.00 64.2±0.39ms 502.6 MB/sec 1.00 63.9±0.23ms 504.5 MB/sec string_and_binary_view/cdc 1.00 58.6±0.34ms 550.2 MB/sec 1.00 58.8±0.23ms 548.7 MB/sec string_and_binary_view/default 1.01 48.4±0.28ms 666.9 MB/sec 1.00 47.9±0.13ms 672.7 MB/sec string_and_binary_view/parquet_2 1.00 59.6±0.35ms 541.5 MB/sec 1.00 59.3±0.17ms 544.1 MB/sec string_and_binary_view/zstd 1.00 85.3±0.41ms 378.0 MB/sec 1.00 85.1±0.14ms 378.9 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.6±0.33ms 438.4 MB/sec 1.00 73.3±0.21ms 440.3 MB/sec string_dictionary/bloom_filter 1.00 83.1±0.25ms 3.1 GB/sec 1.01 83.7±1.02ms 3.1 GB/sec string_dictionary/cdc 1.00 46.8±0.53ms 5.5 GB/sec 1.01 47.4±0.53ms 5.4 GB/sec string_dictionary/default 1.00 42.7±0.15ms 6.0 GB/sec 1.01 42.9±1.03ms 6.0 GB/sec string_dictionary/parquet_2 1.00 48.9±0.18ms 5.3 GB/sec 1.01 49.3±0.60ms 5.2 GB/sec string_dictionary/zstd 1.00 206.3±0.77ms 1280.4 MB/sec 1.01 209.3±1.24ms 1261.9 MB/sec string_dictionary/zstd_parquet_2 1.00 191.8±0.17ms 1376.9 MB/sec 1.00 191.7±0.38ms 1378.0 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 33.9±0.07ms 118.1 MB/sec 1.00 34.1±0.10ms 117.5 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 27.6±0.08ms 145.3 MB/sec 1.01 27.8±0.09ms 144.2 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.2±0.06ms 158.7 MB/sec 1.00 25.3±0.08ms 158.6 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.3±0.07ms 158.6 MB/sec 1.00 25.3±0.08ms 158.5 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 25.6±0.06ms 156.4 MB/sec 1.00 25.6±0.07ms 156.4 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 25.6±0.07ms 156.6 MB/sec 1.00 25.6±0.07ms 156.3 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.02 33.8±0.07ms 118.3 MB/sec 1.00 33.3±0.08ms 120.2 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.6±0.07ms 144.9 MB/sec 1.00 27.6±0.09ms 145.0 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.4±0.07ms 158.0 MB/sec 1.00 25.2±0.08ms 158.9 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.01 25.3±0.06ms 158.1 MB/sec 1.00 25.2±0.08ms 158.9 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.5±0.06ms 157.3 MB/sec 1.00 25.4±0.10ms 158.0 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.4±0.07ms 157.4 MB/sec 1.00 25.4±0.11ms 157.9 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 34.6±0.06ms 116.1 MB/sec 1.01 35.0±0.10ms 114.8 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 27.9±0.06ms 144.0 MB/sec 1.01 28.2±0.11ms 142.2 MB/sec string_dictionary_low_cardinality_400/default 1.00 25.4±0.05ms 157.8 MB/sec 1.02 25.8±0.10ms 155.3 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 25.4±0.05ms 157.8 MB/sec 1.01 25.8±0.09ms 155.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.0±0.05ms 154.3 MB/sec 1.01 26.3±0.08ms 152.5 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.0±0.05ms 154.6 MB/sec 1.01 26.3±0.10ms 152.7 MB/sec string_non_null/bloom_filter 1.00 226.9±5.43ms 2.3 GB/sec 1.07 241.9±15.00ms 2.1 GB/sec string_non_null/cdc 1.11 259.2±11.16ms 2021.4 MB/sec 1.00 234.3±0.76ms 2.2 GB/sec string_non_null/default 1.00 114.0±8.80ms 4.5 GB/sec 1.14 129.5±15.20ms 4.0 GB/sec string_non_null/parquet_2 1.00 120.3±12.22ms 4.3 GB/sec 1.04 124.7±8.97ms 4.1 GB/sec string_non_null/zstd 1.02 562.4±8.93ms 931.7 MB/sec 1.00 552.4±3.89ms 948.6 MB/sec string_non_null/zstd_parquet_2 1.02 501.5±7.84ms 1044.9 MB/sec 1.00 492.4±8.15ms 1064.3 MB/sec string_ree/bloom_filter 1.04 157.6±0.42ms 104.1 MB/sec 1.00 152.0±1.02ms 107.9 MB/sec string_ree/cdc 1.00 226.8±0.47ms 72.4 MB/sec 1.00 227.5±0.67ms 72.1 MB/sec string_ree/default 1.06 130.1±0.54ms 126.1 MB/sec 1.00 123.4±1.00ms 133.0 MB/sec string_ree/parquet_2 1.00 130.8±0.32ms 125.5 MB/sec 1.02 133.0±0.64ms 123.4 MB/sec string_ree/zstd 1.00 187.6±0.72ms 87.5 MB/sec 1.01 190.2±1.46ms 86.3 MB/sec string_ree/zstd_parquet_2 1.00 145.8±0.44ms 112.5 MB/sec 1.01 146.6±0.48ms 111.9 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.0±0.04ms 54.2 MB/sec 1.01 26.1±0.12ms 53.9 MB/sec string_ree_95pct_null/cdc 1.00 32.0±0.04ms 43.9 MB/sec 1.00 32.2±0.10ms 43.7 MB/sec string_ree_95pct_null/default 1.00 24.6±0.03ms 57.3 MB/sec 1.00 24.7±0.07ms 57.0 MB/sec string_ree_95pct_null/parquet_2 1.00 24.6±0.03ms 57.3 MB/sec 1.00 24.7±0.07ms 57.0 MB/sec string_ree_95pct_null/zstd 1.00 25.4±0.04ms 55.4 MB/sec 1.00 25.5±0.10ms 55.2 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.3±0.04ms 55.6 MB/sec 1.01 25.5±0.10ms 55.1 MB/sec struct_all_null/bloom_filter 1.00 371.0±0.79µs 42.4 GB/sec 1.01 373.0±3.13µs 42.2 GB/sec struct_all_null/cdc 1.00 7.8±0.11ms 2.0 GB/sec 1.00 7.8±0.17ms 2.0 GB/sec struct_all_null/default 1.01 118.7±0.52µs 132.7 GB/sec 1.00 118.0±0.70µs 133.5 GB/sec struct_all_null/parquet_2 1.00 121.3±0.57µs 129.8 GB/sec 1.01 122.4±0.56µs 128.7 GB/sec struct_all_null/zstd 1.00 182.3±0.52µs 86.4 GB/sec 1.00 181.9±0.57µs 86.6 GB/sec struct_all_null/zstd_parquet_2 1.01 165.8±0.44µs 95.0 GB/sec 1.00 164.6±0.75µs 95.7 GB/sec struct_non_null/bloom_filter 1.00 43.3±0.14ms 369.6 MB/sec 1.03 44.7±0.51ms 357.8 MB/sec struct_non_null/cdc 1.00 42.6±0.16ms 375.6 MB/sec 1.01 42.9±0.12ms 373.0 MB/sec struct_non_null/default 1.00 29.3±0.15ms 546.8 MB/sec 1.01 29.6±0.11ms 539.8 MB/sec struct_non_null/parquet_2 1.00 38.1±0.24ms 420.0 MB/sec 1.01 38.4±0.11ms 417.0 MB/sec struct_non_null/zstd 1.00 37.9±0.13ms 422.3 MB/sec 1.00 38.1±0.10ms 420.3 MB/sec struct_non_null/zstd_parquet_2 1.00 51.8±0.13ms 308.9 MB/sec 1.01 52.2±0.17ms 306.4 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.8±0.01ms 2.3 GB/sec 1.01 6.8±0.03ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.07ms 1180.5 MB/sec 1.01 13.7±0.10ms 1173.2 MB/sec struct_sparse_99pct_null/default 1.00 6.3±0.01ms 2.5 GB/sec 1.01 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.3±0.01ms 2.5 GB/sec 1.01 6.3±0.02ms 2.5 GB/sec struct_sparse_99pct_null/zstd 1.00 7.6±0.01ms 2.1 GB/sec 1.00 7.7±0.02ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 7.0±0.01ms 2.2 GB/sec 1.01 7.1±0.03ms 2.2 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3265.7s | | Peak memory | 3.0 GiB | | Avg memory | 2.6 GiB | | CPU user | 3143.9s | | CPU sys | 118.6s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3250.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3139.4s | | CPU sys | 108.4s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
