adriangbot commented on PR #10626: URL: https://github.com/apache/arrow-rs/pull/10626#issuecomment-5305478853
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10626#issuecomment-5305125250) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing fix/9386-row-group-split-loop (5a9760222a993c347fd13c26fbf18e72ef64003a) to fc16607 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/fc16607ccfdb298557ed6630742941761ac18ce3..5a9760222a993c347fd13c26fbf18e72ef64003a) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group fix_9386-row-group-split-loop main ----- ----------------------------- ---- bool/bloom_filter 1.00 12.5±0.04ms 20.0 MB/sec 1.02 12.7±0.09ms 19.7 MB/sec bool/cdc 1.00 15.2±0.06ms 16.4 MB/sec 1.03 15.6±0.05ms 16.0 MB/sec bool/default 1.00 10.5±0.05ms 23.9 MB/sec 1.01 10.6±0.04ms 23.7 MB/sec bool/parquet_2 1.00 13.4±0.04ms 18.6 MB/sec 1.01 13.5±0.14ms 18.5 MB/sec bool/zstd 1.00 11.0±0.14ms 22.8 MB/sec 1.01 11.1±0.04ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.8±0.07ms 18.1 MB/sec 1.00 13.8±0.04ms 18.1 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.02ms 19.2 MB/sec 1.01 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.00 6.4±0.04ms 19.7 MB/sec 1.00 6.4±0.05ms 19.6 MB/sec bool_non_null/default 1.00 3.7±0.02ms 33.5 MB/sec 1.02 3.8±0.02ms 32.9 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.5 MB/sec 1.00 7.6±0.02ms 16.4 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.5 MB/sec 1.01 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.00 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.0±0.08ms 7.1 MB/sec 1.01 30.2±0.07ms 7.1 MB/sec bool_ree/cdc 1.00 31.2±0.10ms 6.8 MB/sec 1.02 31.7±0.08ms 6.7 MB/sec bool_ree/default 1.00 27.3±0.07ms 7.8 MB/sec 1.01 27.4±0.10ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.09ms 7.4 MB/sec 1.00 28.9±0.07ms 7.4 MB/sec bool_ree/zstd 1.00 27.9±0.09ms 7.6 MB/sec 1.01 28.0±0.07ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.00 29.2±0.08ms 7.3 MB/sec decimal/bloom_filter 1.00 116.9±0.30ms 513.3 MB/sec 1.00 117.1±0.39ms 512.2 MB/sec decimal/cdc 1.00 100.4±0.32ms 597.8 MB/sec 1.01 100.9±0.67ms 594.4 MB/sec decimal/default 1.00 78.0±1.41ms 769.4 MB/sec 1.01 78.7±0.36ms 762.8 MB/sec decimal/parquet_2 1.00 176.1±1.66ms 340.7 MB/sec 1.01 177.9±1.93ms 337.2 MB/sec decimal/zstd 1.00 88.8±0.35ms 675.8 MB/sec 1.00 89.2±0.42ms 672.7 MB/sec decimal/zstd_parquet_2 1.05 206.5±1.76ms 290.6 MB/sec 1.00 197.3±2.00ms 304.1 MB/sec fixed_size_binary_ree/bloom_filter 1.00 58.7±0.99ms 17.2 MB/sec 1.00 58.8±0.28ms 17.1 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.25ms 16.4 MB/sec 1.01 61.9±0.18ms 16.3 MB/sec fixed_size_binary_ree/default 1.01 52.1±1.38ms 19.3 MB/sec 1.00 51.7±0.23ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.00 64.9±0.26ms 15.5 MB/sec 1.00 65.2±0.28ms 15.5 MB/sec fixed_size_binary_ree/zstd 1.00 57.7±0.19ms 17.5 MB/sec 1.00 57.4±0.20ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.00 65.6±1.01ms 15.4 MB/sec 1.00 65.9±0.33ms 15.3 MB/sec float_with_nans/bloom_filter 1.00 78.6±0.28ms 178.0 MB/sec 1.01 79.0±0.34ms 177.1 MB/sec float_with_nans/cdc 1.00 68.8±0.22ms 203.4 MB/sec 1.02 70.2±2.24ms 199.4 MB/sec float_with_nans/default 1.00 61.5±0.22ms 227.6 MB/sec 1.01 62.0±0.25ms 225.8 MB/sec float_with_nans/parquet_2 1.00 77.0±0.18ms 181.9 MB/sec 1.01 77.8±0.24ms 179.9 MB/sec float_with_nans/zstd 1.00 99.9±0.54ms 140.2 MB/sec 1.00 100.3±0.29ms 139.6 MB/sec float_with_nans/zstd_parquet_2 1.00 113.9±0.20ms 122.9 MB/sec 1.01 115.5±1.97ms 121.2 MB/sec fsb/bloom_filter 1.00 8.0±0.05ms 2018.0 MB/sec 1.03 8.2±0.04ms 1959.3 MB/sec fsb/cdc 1.00 10.3±0.04ms 1560.3 MB/sec 1.02 10.6±0.05ms 1526.0 MB/sec fsb/default 1.00 6.9±0.03ms 2.3 GB/sec 1.03 7.1±0.03ms 2.2 GB/sec fsb/parquet_2 1.00 13.0±0.07ms 1239.0 MB/sec 1.03 13.4±0.07ms 1207.8 MB/sec fsb/zstd 1.00 9.4±0.05ms 1722.4 MB/sec 1.02 9.5±0.03ms 1691.4 MB/sec fsb/zstd_parquet_2 1.00 13.9±0.10ms 1160.6 MB/sec 1.03 14.3±0.06ms 1124.6 MB/sec int32_ree/bloom_filter 1.00 39.7±0.30ms 10.2 MB/sec 1.03 40.9±0.22ms 9.9 MB/sec int32_ree/cdc 1.00 39.1±0.12ms 10.4 MB/sec 1.02 39.9±0.20ms 10.2 MB/sec int32_ree/default 1.00 35.5±0.08ms 11.5 MB/sec 1.01 35.9±0.22ms 11.3 MB/sec int32_ree/parquet_2 1.00 35.5±0.11ms 11.5 MB/sec 1.01 35.9±0.23ms 11.3 MB/sec int32_ree/zstd 1.00 36.0±0.11ms 11.3 MB/sec 1.01 36.4±0.22ms 11.2 MB/sec int32_ree/zstd_parquet_2 1.00 36.0±0.11ms 11.3 MB/sec 1.01 36.5±0.25ms 11.2 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.06ms 18.6 MB/sec 1.01 22.1±0.05ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 23.8±0.05ms 17.1 MB/sec 1.00 23.9±0.05ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.6±0.02ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.5±0.03ms 18.9 MB/sec 1.00 21.6±0.02ms 18.8 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.05ms 18.6 MB/sec 1.00 21.9±0.04ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.06ms 18.7 MB/sec 1.00 21.8±0.05ms 18.6 MB/sec large_string_distinct/delta_byte_array 1.00 73.5±0.42ms 3.4 GB/sec 1.03 75.8±1.02ms 3.3 GB/sec large_string_distinct/plain 1.00 59.3±0.29ms 4.2 GB/sec 1.02 60.6±0.62ms 4.1 GB/sec large_string_non_null/bloom_filter 1.00 72.9±0.13ms 3.4 GB/sec 1.00 72.7±0.17ms 3.4 GB/sec large_string_non_null/cdc 1.00 244.9±1.11ms 1045.3 MB/sec 1.00 244.6±1.16ms 1046.7 MB/sec large_string_non_null/default 1.00 54.9±0.10ms 4.6 GB/sec 1.00 54.8±0.19ms 4.6 GB/sec large_string_non_null/parquet_2 1.00 54.9±0.09ms 4.6 GB/sec 1.00 54.9±0.17ms 4.6 GB/sec large_string_non_null/zstd 1.00 55.0±0.10ms 4.5 GB/sec 1.00 54.8±0.14ms 4.6 GB/sec large_string_non_null/zstd_parquet_2 1.00 55.1±0.12ms 4.5 GB/sec 1.00 54.9±0.14ms 4.6 GB/sec large_string_shared_prefix/delta_byte_array 1.00 105.6±1.04ms 2.4 GB/sec 1.03 108.7±0.72ms 2.3 GB/sec large_string_shared_prefix/plain 1.00 91.5±1.07ms 2.7 GB/sec 1.03 94.1±0.78ms 2.7 GB/sec list_nested/bloom_filter 1.00 142.9±0.34ms 201.9 MB/sec 1.01 143.7±0.23ms 200.9 MB/sec list_nested/cdc 1.00 160.1±0.26ms 180.2 MB/sec 1.01 161.0±0.18ms 179.2 MB/sec list_nested/default 1.00 129.6±0.60ms 222.7 MB/sec 1.00 130.0±0.27ms 221.9 MB/sec list_nested/parquet_2 1.00 142.4±0.42ms 202.6 MB/sec 1.01 143.3±0.19ms 201.4 MB/sec list_nested/zstd 1.00 138.4±0.43ms 208.4 MB/sec 1.01 139.3±0.19ms 207.2 MB/sec list_nested/zstd_parquet_2 1.00 155.2±0.41ms 185.9 MB/sec 1.01 156.1±0.19ms 184.9 MB/sec list_primitive/bloom_filter 1.11 310.9±9.72ms 1754.2 MB/sec 1.00 280.3±1.03ms 1945.8 MB/sec list_primitive/cdc 1.03 322.4±12.35ms 1691.4 MB/sec 1.00 312.5±0.78ms 1745.2 MB/sec list_primitive/default 1.14 232.6±8.74ms 2.3 GB/sec 1.00 203.8±0.81ms 2.6 GB/sec list_primitive/parquet_2 1.05 232.9±0.77ms 2.3 GB/sec 1.00 222.5±0.32ms 2.4 GB/sec list_primitive/zstd 1.06 484.7±5.76ms 1125.2 MB/sec 1.00 459.2±1.72ms 1187.5 MB/sec list_primitive/zstd_parquet_2 1.07 477.0±5.38ms 1143.3 MB/sec 1.00 445.2±0.31ms 1225.1 MB/sec list_primitive_non_null/bloom_filter 1.12 402.9±23.03ms 1350.7 MB/sec 1.00 361.1±4.73ms 1507.2 MB/sec list_primitive_non_null/cdc 1.00 389.2±7.54ms 1398.5 MB/sec 1.01 394.2±7.82ms 1380.5 MB/sec list_primitive_non_null/default 1.16 267.7±19.62ms 2033.3 MB/sec 1.00 231.0±7.73ms 2.3 GB/sec list_primitive_non_null/parquet_2 1.03 264.5±15.82ms 2.0 GB/sec 1.00 257.4±1.31ms 2.1 GB/sec list_primitive_non_null/zstd 1.11 714.8±11.58ms 761.4 MB/sec 1.00 641.7±1.82ms 848.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.06 683.3±26.05ms 796.5 MB/sec 1.00 645.3±3.93ms 843.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.7±0.10ms 2.9 GB/sec 1.01 12.9±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.2±0.12ms 1544.1 MB/sec 1.01 24.5±0.05ms 1525.7 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.08ms 3.0 GB/sec 1.02 12.6±0.07ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.4±0.09ms 3.0 GB/sec 1.02 12.5±0.06ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.2±0.10ms 2.6 GB/sec 1.01 14.4±0.06ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.5±0.09ms 2.9 GB/sec 1.02 12.7±0.05ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.00 276.4±0.56ms 165.0 MB/sec 1.02 281.0±0.53ms 162.3 MB/sec list_struct_with_list/cdc 1.00 316.4±0.93ms 144.1 MB/sec 1.01 318.2±0.51ms 143.3 MB/sec list_struct_with_list/default 1.00 251.0±0.46ms 181.6 MB/sec 1.01 253.6±0.94ms 179.8 MB/sec list_struct_with_list/parquet_2 1.00 268.5±0.86ms 169.8 MB/sec 1.01 270.7±0.66ms 168.4 MB/sec list_struct_with_list/zstd 1.00 272.8±0.55ms 167.1 MB/sec 1.01 275.0±0.54ms 165.8 MB/sec list_struct_with_list/zstd_parquet_2 1.00 291.6±0.83ms 156.4 MB/sec 1.01 294.2±0.57ms 155.0 MB/sec primitive/bloom_filter 1.00 141.3±0.38ms 317.5 MB/sec 1.02 144.3±0.84ms 311.1 MB/sec primitive/cdc 1.00 151.2±0.38ms 296.8 MB/sec 1.01 152.8±0.78ms 293.7 MB/sec primitive/default 1.00 110.7±1.08ms 405.3 MB/sec 1.01 112.0±0.32ms 400.8 MB/sec primitive/parquet_2 1.00 125.5±0.28ms 357.7 MB/sec 1.01 126.9±0.34ms 353.6 MB/sec primitive/zstd 1.00 140.3±0.29ms 319.9 MB/sec 1.01 141.8±0.40ms 316.5 MB/sec primitive/zstd_parquet_2 1.00 158.5±0.28ms 283.2 MB/sec 1.01 159.8±0.39ms 280.8 MB/sec primitive_all_null/bloom_filter 1.01 888.2±5.47µs 49.3 GB/sec 1.00 882.5±2.94µs 49.7 GB/sec primitive_all_null/cdc 1.03 19.1±0.25ms 2.3 GB/sec 1.00 18.5±0.43ms 2.4 GB/sec primitive_all_null/default 1.00 275.6±1.74µs 159.0 GB/sec 1.00 275.9±1.54µs 158.9 GB/sec primitive_all_null/parquet_2 1.00 283.6±1.45µs 154.5 GB/sec 1.00 284.7±1.43µs 153.9 GB/sec primitive_all_null/zstd 1.00 423.2±1.49µs 103.6 GB/sec 1.00 422.5±1.61µs 103.7 GB/sec primitive_all_null/zstd_parquet_2 1.01 381.9±1.38µs 114.8 GB/sec 1.00 379.2±1.45µs 115.6 GB/sec primitive_non_null/bloom_filter 1.00 97.1±0.30ms 453.1 MB/sec 1.02 98.9±0.91ms 445.1 MB/sec primitive_non_null/cdc 1.00 81.5±0.26ms 539.8 MB/sec 1.00 81.5±0.26ms 539.9 MB/sec primitive_non_null/default 1.00 58.7±0.21ms 749.4 MB/sec 1.01 59.2±0.39ms 742.9 MB/sec primitive_non_null/parquet_2 1.00 80.3±0.22ms 548.3 MB/sec 1.01 81.3±0.51ms 541.0 MB/sec primitive_non_null/zstd 1.00 89.5±0.18ms 491.7 MB/sec 1.00 89.4±0.23ms 492.0 MB/sec primitive_non_null/zstd_parquet_2 1.00 113.5±0.23ms 387.5 MB/sec 1.00 114.0±0.22ms 386.1 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.2±0.21ms 3.6 GB/sec 1.01 12.4±0.12ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.00 29.6±0.31ms 1517.7 MB/sec 1.01 29.9±0.34ms 1501.6 MB/sec primitive_sparse_99pct_null/default 1.00 10.6±0.05ms 4.1 GB/sec 1.01 10.7±0.05ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.6±0.05ms 4.1 GB/sec 1.01 10.7±0.06ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.0±0.08ms 3.1 GB/sec 1.01 14.1±0.07ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.09ms 3.5 GB/sec 1.01 12.7±0.07ms 3.5 GB/sec short_string_non_null/bloom_filter 1.00 27.4±0.05ms 438.0 MB/sec 1.00 27.4±0.06ms 438.1 MB/sec short_string_non_null/cdc 1.00 19.8±0.05ms 606.5 MB/sec 1.01 19.9±0.03ms 603.4 MB/sec short_string_non_null/default 1.00 15.7±0.03ms 765.0 MB/sec 1.00 15.7±0.02ms 766.4 MB/sec short_string_non_null/parquet_2 1.00 25.8±0.03ms 465.4 MB/sec 1.00 25.7±0.03ms 466.1 MB/sec short_string_non_null/zstd 1.00 35.9±0.08ms 334.7 MB/sec 1.00 36.0±0.10ms 333.5 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.7±0.04ms 418.2 MB/sec 1.00 28.7±0.03ms 418.5 MB/sec small_string_distinct/delta_byte_array 1.00 955.7±8.94µs 8.2 GB/sec 1.02 972.9±6.83µs 8.1 GB/sec small_string_distinct/plain 1.00 763.3±5.32µs 10.3 GB/sec 1.00 761.9±3.13µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 984.0±6.22µs 8.0 GB/sec 1.04 1022.4±6.36µs 7.7 GB/sec small_string_partial_prefix/plain 1.00 999.8±3.32µs 7.8 GB/sec 1.02 1021.0±8.02µs 7.7 GB/sec small_string_shared_prefix/delta_byte_array 1.00 977.8±11.75µs 8.0 GB/sec 1.00 976.7±4.07µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1103.1±8.14µs 7.1 GB/sec 1.03 1140.4±3.21µs 6.9 GB/sec string/bloom_filter 1.04 225.1±24.02ms 2.3 GB/sec 1.00 215.6±24.49ms 2.4 GB/sec string/cdc 1.00 205.3±4.18ms 2.5 GB/sec 1.02 209.9±10.34ms 2.4 GB/sec string/default 1.16 139.8±24.29ms 3.7 GB/sec 1.00 120.9±19.22ms 4.2 GB/sec string/parquet_2 1.00 114.5±1.39ms 4.5 GB/sec 1.01 115.7±0.96ms 4.4 GB/sec string/zstd 1.00 466.5±15.69ms 1123.8 MB/sec 1.02 475.2±12.06ms 1103.3 MB/sec string/zstd_parquet_2 1.00 385.0±2.68ms 1361.7 MB/sec 1.06 408.5±1.54ms 1283.2 MB/sec string_and_binary_view/bloom_filter 1.00 63.6±0.15ms 506.7 MB/sec 1.00 63.4±0.35ms 508.8 MB/sec string_and_binary_view/cdc 1.00 58.7±0.15ms 549.1 MB/sec 1.01 59.0±0.29ms 546.2 MB/sec string_and_binary_view/default 1.00 48.0±0.10ms 672.1 MB/sec 1.00 48.0±0.16ms 671.5 MB/sec string_and_binary_view/parquet_2 1.00 59.2±0.19ms 544.7 MB/sec 1.01 59.6±0.20ms 541.3 MB/sec string_and_binary_view/zstd 1.00 85.0±0.14ms 379.5 MB/sec 1.00 85.0±0.18ms 379.2 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.1±0.15ms 441.5 MB/sec 1.00 73.4±0.34ms 439.4 MB/sec string_dictionary/bloom_filter 1.00 84.7±1.22ms 3.0 GB/sec 1.02 86.4±0.85ms 3.0 GB/sec string_dictionary/cdc 1.00 48.9±0.56ms 5.3 GB/sec 1.00 48.7±0.52ms 5.3 GB/sec string_dictionary/default 1.00 43.4±1.05ms 5.9 GB/sec 1.02 44.4±0.79ms 5.8 GB/sec string_dictionary/parquet_2 1.00 48.9±0.33ms 5.3 GB/sec 1.00 49.0±0.13ms 5.3 GB/sec string_dictionary/zstd 1.00 208.9±0.65ms 1264.6 MB/sec 1.02 212.4±0.72ms 1243.4 MB/sec string_dictionary/zstd_parquet_2 1.00 192.5±0.14ms 1371.8 MB/sec 1.00 192.4±0.22ms 1373.1 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.02 33.7±0.29ms 118.8 MB/sec 1.00 33.0±0.07ms 121.5 MB/sec string_dictionary_low_cardinality_100/cdc 1.02 27.2±0.13ms 147.6 MB/sec 1.00 26.6±0.07ms 150.5 MB/sec string_dictionary_low_cardinality_100/default 1.02 24.8±0.30ms 161.7 MB/sec 1.00 24.2±0.07ms 165.5 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.03 24.8±0.29ms 161.5 MB/sec 1.00 24.2±0.06ms 165.6 MB/sec string_dictionary_low_cardinality_100/zstd 1.03 25.2±0.31ms 159.0 MB/sec 1.00 24.6±0.07ms 163.1 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.03 25.2±0.30ms 159.2 MB/sec 1.00 24.5±0.06ms 163.4 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.03 33.6±0.30ms 119.2 MB/sec 1.00 32.6±0.09ms 123.0 MB/sec string_dictionary_low_cardinality_20/cdc 1.02 27.2±0.13ms 147.1 MB/sec 1.00 26.8±0.07ms 149.3 MB/sec string_dictionary_low_cardinality_20/default 1.02 25.0±0.29ms 160.4 MB/sec 1.00 24.5±0.08ms 163.7 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.02 25.0±0.28ms 160.3 MB/sec 1.00 24.5±0.08ms 163.7 MB/sec string_dictionary_low_cardinality_20/zstd 1.02 25.1±0.27ms 159.3 MB/sec 1.00 24.6±0.08ms 162.5 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.02 25.1±0.27ms 159.4 MB/sec 1.00 24.6±0.08ms 162.8 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.02 34.8±0.37ms 115.4 MB/sec 1.00 34.0±0.06ms 117.8 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 27.4±0.13ms 146.6 MB/sec 1.00 27.3±0.08ms 146.8 MB/sec string_dictionary_low_cardinality_400/default 1.02 25.4±0.39ms 157.8 MB/sec 1.00 25.0±0.06ms 160.8 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.02 25.4±0.38ms 157.8 MB/sec 1.00 25.0±0.05ms 160.8 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 25.9±0.37ms 154.7 MB/sec 1.00 25.6±0.06ms 156.5 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.02 25.9±0.36ms 154.9 MB/sec 1.00 25.5±0.06ms 157.6 MB/sec string_non_null/bloom_filter 1.00 247.3±20.82ms 2.1 GB/sec 1.03 254.9±27.73ms 2.0 GB/sec string_non_null/cdc 1.09 256.4±8.86ms 2043.5 MB/sec 1.00 235.4±0.49ms 2.2 GB/sec string_non_null/default 1.04 136.5±26.51ms 3.7 GB/sec 1.00 131.3±21.59ms 3.9 GB/sec string_non_null/parquet_2 1.03 122.6±10.07ms 4.2 GB/sec 1.00 118.5±8.63ms 4.3 GB/sec string_non_null/zstd 1.00 547.3±2.12ms 957.5 MB/sec 1.01 551.5±2.01ms 950.2 MB/sec string_non_null/zstd_parquet_2 1.02 501.6±5.31ms 1044.6 MB/sec 1.00 492.0±6.98ms 1064.9 MB/sec string_ree/bloom_filter 1.42 155.0±3.90ms 105.8 MB/sec 1.00 109.2±0.73ms 150.3 MB/sec string_ree/cdc 1.36 236.1±7.52ms 69.5 MB/sec 1.00 173.1±1.75ms 94.8 MB/sec string_ree/default 1.58 127.3±3.79ms 128.9 MB/sec 1.00 80.6±0.96ms 203.5 MB/sec string_ree/parquet_2 1.67 133.3±4.07ms 123.1 MB/sec 1.00 79.9±0.39ms 205.3 MB/sec string_ree/zstd 1.35 189.3±3.59ms 86.7 MB/sec 1.00 140.4±1.07ms 116.8 MB/sec string_ree/zstd_parquet_2 1.57 148.4±3.76ms 110.6 MB/sec 1.00 94.3±0.33ms 174.0 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.4±0.13ms 53.3 MB/sec 1.01 26.7±0.04ms 52.7 MB/sec string_ree_95pct_null/cdc 1.00 32.4±0.09ms 43.5 MB/sec 1.01 32.7±0.07ms 43.1 MB/sec string_ree_95pct_null/default 1.00 24.9±0.08ms 56.6 MB/sec 1.01 25.0±0.04ms 56.2 MB/sec string_ree_95pct_null/parquet_2 1.00 24.8±0.08ms 56.7 MB/sec 1.01 25.0±0.04ms 56.2 MB/sec string_ree_95pct_null/zstd 1.00 25.8±0.07ms 54.6 MB/sec 1.00 25.9±0.04ms 54.4 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.6±0.08ms 55.0 MB/sec 1.01 25.8±0.04ms 54.6 MB/sec struct_all_null/bloom_filter 1.00 369.4±1.51µs 42.6 GB/sec 1.03 380.2±1.49µs 41.4 GB/sec struct_all_null/cdc 1.08 7.9±0.10ms 2033.0 MB/sec 1.00 7.4±0.13ms 2.1 GB/sec struct_all_null/default 1.00 117.5±0.65µs 134.0 GB/sec 1.01 118.3±0.66µs 133.1 GB/sec struct_all_null/parquet_2 1.00 121.4±0.58µs 129.7 GB/sec 1.01 122.5±0.56µs 128.6 GB/sec struct_all_null/zstd 1.00 180.0±0.56µs 87.5 GB/sec 1.01 182.1±0.79µs 86.5 GB/sec struct_all_null/zstd_parquet_2 1.00 163.3±0.48µs 96.4 GB/sec 1.00 163.9±0.71µs 96.1 GB/sec struct_non_null/bloom_filter 1.00 41.5±0.23ms 385.2 MB/sec 1.00 41.7±0.12ms 383.7 MB/sec struct_non_null/cdc 1.01 41.3±0.17ms 387.5 MB/sec 1.00 41.0±0.11ms 390.4 MB/sec struct_non_null/default 1.01 27.8±0.12ms 575.5 MB/sec 1.00 27.6±0.11ms 579.3 MB/sec struct_non_null/parquet_2 1.00 36.2±0.11ms 441.6 MB/sec 1.00 36.3±0.09ms 440.2 MB/sec struct_non_null/zstd 1.00 36.2±0.47ms 441.6 MB/sec 1.00 36.1±0.10ms 442.7 MB/sec struct_non_null/zstd_parquet_2 1.00 50.1±0.14ms 319.1 MB/sec 1.01 50.6±0.15ms 316.5 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.4±0.02ms 2.5 GB/sec 1.02 6.5±0.04ms 2.4 GB/sec struct_sparse_99pct_null/cdc 1.00 13.3±0.10ms 1211.6 MB/sec 1.02 13.6±0.16ms 1188.5 MB/sec struct_sparse_99pct_null/default 1.00 5.9±0.01ms 2.7 GB/sec 1.01 5.9±0.02ms 2.7 GB/sec struct_sparse_99pct_null/parquet_2 1.00 5.9±0.01ms 2.7 GB/sec 1.01 6.0±0.03ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.2±0.01ms 2.2 GB/sec 1.03 7.5±0.06ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.6±0.02ms 2.4 GB/sec 1.03 6.9±0.06ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3150.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3096.7s | | CPU sys | 49.9s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3210.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.5 GiB | | CPU user | 3071.3s | | CPU sys | 133.5s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
