adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336657796
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335765117) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 2d2d4adc624a9ffb4a2b850fe86bf0c9df097313 [diff](https://github.com/apache/arrow-rs/compare/2d2d4adc624a9ffb4a2b850fe86bf0c9df097313..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "2d2d4adc624a9ffb4a2b850fe86bf0c9df097313" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.06ms 19.7 MB/sec 1.02 12.9±0.09ms 19.4 MB/sec bool/cdc 1.00 15.4±0.07ms 16.2 MB/sec 1.01 15.6±0.08ms 16.0 MB/sec bool/default 1.00 10.6±0.06ms 23.6 MB/sec 1.02 10.8±0.06ms 23.2 MB/sec bool/parquet_2 1.00 13.5±0.06ms 18.6 MB/sec 1.02 13.7±0.07ms 18.3 MB/sec bool/zstd 1.00 11.1±0.05ms 22.6 MB/sec 1.02 11.3±0.07ms 22.2 MB/sec bool/zstd_parquet_2 1.00 13.9±0.06ms 18.1 MB/sec 1.01 14.0±0.08ms 17.8 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.03ms 19.2 MB/sec 1.01 6.6±0.02ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.03ms 19.9 MB/sec 1.01 6.4±0.03ms 19.7 MB/sec bool_non_null/default 1.00 3.8±0.02ms 33.2 MB/sec 1.01 3.8±0.02ms 32.9 MB/sec bool_non_null/parquet_2 1.00 7.6±0.02ms 16.6 MB/sec 1.00 7.6±0.02ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.02ms 30.3 MB/sec 1.01 4.2±0.02ms 30.1 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.7 MB/sec 1.00 8.0±0.02ms 15.6 MB/sec bool_ree/bloom_filter 1.00 30.2±0.16ms 7.1 MB/sec 1.01 30.4±0.13ms 7.0 MB/sec bool_ree/cdc 1.00 31.3±0.13ms 6.8 MB/sec 1.01 31.6±0.14ms 6.7 MB/sec bool_ree/default 1.00 27.3±0.13ms 7.8 MB/sec 1.01 27.6±0.14ms 7.7 MB/sec bool_ree/parquet_2 1.00 28.8±0.14ms 7.4 MB/sec 1.01 29.1±0.12ms 7.3 MB/sec bool_ree/zstd 1.00 27.9±0.11ms 7.6 MB/sec 1.01 28.2±0.13ms 7.5 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.12ms 7.3 MB/sec 1.01 29.4±0.12ms 7.3 MB/sec decimal/bloom_filter 1.25 145.5±1.18ms 412.5 MB/sec 1.00 116.1±0.37ms 516.7 MB/sec decimal/cdc 1.01 101.2±0.48ms 593.2 MB/sec 1.00 100.6±0.38ms 596.3 MB/sec decimal/default 1.37 106.8±1.87ms 561.9 MB/sec 1.00 78.1±0.39ms 767.8 MB/sec decimal/parquet_2 1.15 204.7±1.16ms 293.2 MB/sec 1.00 177.2±2.26ms 338.5 MB/sec decimal/zstd 1.36 121.3±8.61ms 494.6 MB/sec 1.00 89.3±1.45ms 672.0 MB/sec decimal/zstd_parquet_2 1.17 229.9±8.93ms 261.0 MB/sec 1.00 196.7±2.03ms 305.0 MB/sec fixed_size_binary_ree/bloom_filter 1.29 75.6±0.43ms 13.3 MB/sec 1.00 58.6±0.29ms 17.2 MB/sec fixed_size_binary_ree/cdc 1.00 61.6±0.26ms 16.4 MB/sec 1.01 61.9±0.29ms 16.3 MB/sec fixed_size_binary_ree/default 1.33 68.8±0.37ms 14.7 MB/sec 1.00 51.8±0.26ms 19.5 MB/sec fixed_size_binary_ree/parquet_2 1.25 83.1±0.94ms 12.1 MB/sec 1.00 66.3±0.28ms 15.2 MB/sec fixed_size_binary_ree/zstd 1.29 74.5±0.34ms 13.5 MB/sec 1.00 57.5±0.22ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.25 83.7±0.34ms 12.0 MB/sec 1.00 66.9±0.26ms 15.0 MB/sec float_with_nans/bloom_filter 1.12 89.1±0.78ms 157.2 MB/sec 1.00 79.6±0.24ms 176.0 MB/sec float_with_nans/cdc 1.00 69.9±0.39ms 200.3 MB/sec 1.01 70.5±0.44ms 198.7 MB/sec float_with_nans/default 1.14 71.7±1.01ms 195.2 MB/sec 1.00 62.9±0.20ms 222.8 MB/sec float_with_nans/parquet_2 1.11 89.1±0.64ms 157.1 MB/sec 1.00 80.1±0.25ms 174.8 MB/sec float_with_nans/zstd 1.09 109.9±0.22ms 127.4 MB/sec 1.00 101.1±0.20ms 138.4 MB/sec float_with_nans/zstd_parquet_2 1.08 126.6±0.44ms 110.6 MB/sec 1.00 116.9±0.22ms 119.8 MB/sec fsb/bloom_filter 1.00 8.1±0.09ms 1994.9 MB/sec 1.00 8.1±0.07ms 2003.0 MB/sec fsb/cdc 1.00 10.5±0.08ms 1539.1 MB/sec 1.01 10.6±0.10ms 1522.7 MB/sec fsb/default 1.00 7.0±0.06ms 2.3 GB/sec 1.01 7.0±0.03ms 2.3 GB/sec fsb/parquet_2 1.00 13.2±0.09ms 1221.8 MB/sec 1.01 13.3±0.09ms 1212.9 MB/sec fsb/zstd 1.00 9.5±0.08ms 1704.9 MB/sec 1.01 9.5±0.06ms 1692.4 MB/sec fsb/zstd_parquet_2 1.00 14.1±0.12ms 1141.5 MB/sec 1.01 14.2±0.07ms 1133.0 MB/sec int32_ree/bloom_filter 1.00 40.8±0.29ms 10.0 MB/sec 1.01 41.2±0.60ms 9.9 MB/sec int32_ree/cdc 1.00 40.5±0.15ms 10.0 MB/sec 1.00 40.7±0.14ms 10.0 MB/sec int32_ree/default 1.00 36.8±0.16ms 11.1 MB/sec 1.00 36.9±0.12ms 11.0 MB/sec int32_ree/parquet_2 1.00 36.8±0.17ms 11.1 MB/sec 1.00 36.9±0.12ms 11.0 MB/sec int32_ree/zstd 1.00 37.3±0.14ms 10.9 MB/sec 1.00 37.4±0.12ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.3±0.14ms 10.9 MB/sec 1.00 37.4±0.12ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.00 21.9±0.06ms 18.6 MB/sec 1.00 21.9±0.03ms 18.6 MB/sec int32_ree_95pct_null/cdc 1.00 23.9±0.06ms 17.0 MB/sec 1.00 23.9±0.04ms 17.0 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.04ms 18.9 MB/sec int32_ree_95pct_null/parquet_2 1.00 21.6±0.03ms 18.9 MB/sec 1.00 21.5±0.03ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.8±0.03ms 18.6 MB/sec 1.00 21.8±0.04ms 18.7 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.7±0.03ms 18.7 MB/sec 1.00 21.7±0.03ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.00 65.1±0.82ms 3.8 GB/sec 1.01 66.0±0.45ms 3.8 GB/sec large_string_distinct/plain 1.00 59.9±0.84ms 4.2 GB/sec 1.02 60.8±0.43ms 4.1 GB/sec large_string_distinct_nullable/delta_byte_array 1.12 61.3±0.61ms 4.1 GB/sec 1.00 54.9±0.57ms 4.6 GB/sec large_string_non_null/bloom_filter 1.00 72.2±0.12ms 3.5 GB/sec 1.05 75.9±0.32ms 3.3 GB/sec large_string_non_null/cdc 1.00 243.6±1.32ms 1051.0 MB/sec 1.00 244.0±1.05ms 1049.1 MB/sec large_string_non_null/default 1.00 54.4±0.12ms 4.6 GB/sec 1.06 57.8±0.72ms 4.3 GB/sec large_string_non_null/parquet_2 1.00 54.4±0.12ms 4.6 GB/sec 1.06 57.8±0.69ms 4.3 GB/sec large_string_non_null/zstd 1.00 54.5±0.15ms 4.6 GB/sec 1.06 58.0±0.69ms 4.3 GB/sec large_string_non_null/zstd_parquet_2 1.00 54.5±0.15ms 4.6 GB/sec 1.06 57.8±0.78ms 4.3 GB/sec large_string_shared_prefix/delta_byte_array 1.00 54.9±0.43ms 4.6 GB/sec 1.03 56.7±0.38ms 4.4 GB/sec large_string_shared_prefix/plain 1.00 93.1±1.02ms 2.7 GB/sec 1.02 94.8±1.04ms 2.6 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 54.3±0.35ms 4.6 GB/sec 1.03 55.6±0.32ms 4.5 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.03 50.9±0.32ms 4.9 GB/sec 1.00 49.4±1.66ms 5.1 GB/sec large_string_shared_prefix_nullable/plain 1.00 63.7±0.52ms 3.9 GB/sec 1.02 64.7±0.43ms 3.9 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 27.7±0.34ms 4.5 GB/sec 1.03 28.6±0.21ms 4.4 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 51.4±0.39ms 4.9 GB/sec 1.34 68.9±0.37ms 3.6 GB/sec list_nested/bloom_filter 1.01 144.8±0.35ms 199.3 MB/sec 1.00 144.0±0.60ms 200.4 MB/sec list_nested/cdc 1.00 161.3±0.44ms 178.9 MB/sec 1.00 161.6±0.28ms 178.5 MB/sec list_nested/default 1.00 130.4±0.34ms 221.2 MB/sec 1.00 130.1±0.22ms 221.7 MB/sec list_nested/parquet_2 1.00 143.3±0.26ms 201.4 MB/sec 1.00 143.8±0.23ms 200.6 MB/sec list_nested/zstd 1.00 139.4±0.24ms 206.9 MB/sec 1.00 139.6±0.27ms 206.7 MB/sec list_nested/zstd_parquet_2 1.00 156.2±0.22ms 184.7 MB/sec 1.00 156.3±0.20ms 184.6 MB/sec list_primitive/bloom_filter 1.02 313.2±20.05ms 1741.4 MB/sec 1.00 308.4±9.17ms 1768.7 MB/sec list_primitive/cdc 1.00 316.8±10.80ms 1721.4 MB/sec 1.02 322.6±9.01ms 1690.4 MB/sec list_primitive/default 1.00 226.7±20.00ms 2.3 GB/sec 1.00 227.8±5.52ms 2.3 GB/sec list_primitive/parquet_2 1.03 247.2±5.72ms 2.2 GB/sec 1.00 240.7±3.27ms 2.2 GB/sec list_primitive/zstd 1.02 480.5±8.93ms 1135.0 MB/sec 1.00 469.4±2.57ms 1161.8 MB/sec list_primitive/zstd_parquet_2 1.04 477.6±1.28ms 1141.8 MB/sec 1.00 457.3±2.40ms 1192.5 MB/sec list_primitive_non_null/bloom_filter 1.00 403.8±20.64ms 1347.9 MB/sec 1.02 410.5±7.22ms 1325.9 MB/sec list_primitive_non_null/cdc 1.00 387.0±6.25ms 1406.2 MB/sec 1.01 392.7±9.16ms 1385.8 MB/sec list_primitive_non_null/default 1.03 279.4±20.23ms 1947.9 MB/sec 1.00 272.1±9.30ms 2000.0 MB/sec list_primitive_non_null/parquet_2 1.00 270.8±22.76ms 2009.7 MB/sec 1.05 285.7±1.88ms 1905.3 MB/sec list_primitive_non_null/zstd 1.03 717.7±7.55ms 758.3 MB/sec 1.00 699.4±3.51ms 778.2 MB/sec list_primitive_non_null/zstd_parquet_2 1.02 705.0±1.85ms 772.0 MB/sec 1.00 688.1±1.34ms 791.0 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.6±0.05ms 2.9 GB/sec 1.02 12.9±0.07ms 2.8 GB/sec list_primitive_sparse_99pct_null/cdc 1.00 24.0±0.09ms 1557.1 MB/sec 1.03 24.8±0.06ms 1505.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.3±0.05ms 3.0 GB/sec 1.02 12.5±0.08ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.3±0.04ms 3.0 GB/sec 1.03 12.7±0.13ms 2.9 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.1±0.05ms 2.6 GB/sec 1.02 14.4±0.10ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.4±0.04ms 2.9 GB/sec 1.05 13.0±0.08ms 2.8 GB/sec list_struct_with_list/bloom_filter 1.00 280.7±1.26ms 162.4 MB/sec 1.00 282.1±0.60ms 161.6 MB/sec list_struct_with_list/cdc 1.00 318.2±0.46ms 143.3 MB/sec 1.01 320.4±0.56ms 142.3 MB/sec list_struct_with_list/default 1.00 254.1±0.46ms 179.4 MB/sec 1.01 255.8±0.59ms 178.3 MB/sec list_struct_with_list/parquet_2 1.00 271.5±0.48ms 168.0 MB/sec 1.01 273.2±0.96ms 166.9 MB/sec list_struct_with_list/zstd 1.00 276.0±0.51ms 165.2 MB/sec 1.01 277.7±0.59ms 164.2 MB/sec list_struct_with_list/zstd_parquet_2 1.00 294.5±0.39ms 154.8 MB/sec 1.01 296.3±0.60ms 153.9 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.02 40.7±0.89ms 6.1 GB/sec 1.00 39.9±0.76ms 6.3 GB/sec primitive/bloom_filter 1.00 145.1±0.71ms 309.3 MB/sec 1.01 146.1±1.13ms 307.2 MB/sec primitive/cdc 1.00 154.1±0.71ms 291.2 MB/sec 1.01 156.3±1.21ms 287.1 MB/sec primitive/default 1.00 113.7±0.54ms 394.8 MB/sec 1.01 114.9±0.66ms 390.5 MB/sec primitive/parquet_2 1.00 128.7±0.53ms 348.7 MB/sec 1.01 129.6±0.63ms 346.3 MB/sec primitive/zstd 1.00 143.6±0.56ms 312.4 MB/sec 1.01 144.7±0.58ms 310.2 MB/sec primitive/zstd_parquet_2 1.00 161.8±0.84ms 277.3 MB/sec 1.00 162.6±0.63ms 276.0 MB/sec primitive_all_null/bloom_filter 1.00 882.0±5.10µs 49.7 GB/sec 1.03 911.3±5.72µs 48.1 GB/sec primitive_all_null/cdc 1.00 19.2±0.33ms 2.3 GB/sec 1.00 19.1±0.23ms 2.3 GB/sec primitive_all_null/default 1.00 275.7±1.74µs 158.9 GB/sec 1.00 276.3±1.51µs 158.6 GB/sec primitive_all_null/parquet_2 1.00 283.9±2.03µs 154.4 GB/sec 1.00 283.5±1.46µs 154.6 GB/sec primitive_all_null/zstd 1.01 426.6±2.21µs 102.7 GB/sec 1.00 423.2±1.38µs 103.5 GB/sec primitive_all_null/zstd_parquet_2 1.01 385.1±2.69µs 113.8 GB/sec 1.00 380.3±1.24µs 115.2 GB/sec primitive_non_null/bloom_filter 1.00 100.3±0.60ms 438.6 MB/sec 1.00 100.7±0.37ms 437.0 MB/sec primitive_non_null/cdc 1.00 84.2±0.34ms 522.3 MB/sec 1.01 85.1±0.84ms 517.0 MB/sec primitive_non_null/default 1.00 61.7±0.25ms 713.6 MB/sec 1.01 62.5±0.75ms 703.5 MB/sec primitive_non_null/parquet_2 1.00 83.5±0.40ms 526.9 MB/sec 1.01 84.2±0.34ms 522.8 MB/sec primitive_non_null/zstd 1.00 92.2±0.31ms 477.0 MB/sec 1.00 92.7±0.23ms 474.7 MB/sec primitive_non_null/zstd_parquet_2 1.00 116.5±0.31ms 377.8 MB/sec 1.01 117.2±0.69ms 375.5 MB/sec primitive_sparse_99pct_null/bloom_filter 1.00 12.3±0.16ms 3.6 GB/sec 1.00 12.3±0.14ms 3.6 GB/sec primitive_sparse_99pct_null/cdc 1.00 30.0±0.26ms 1498.0 MB/sec 1.00 30.0±0.36ms 1493.8 MB/sec primitive_sparse_99pct_null/default 1.00 10.7±0.04ms 4.1 GB/sec 1.01 10.8±0.07ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.7±0.03ms 4.1 GB/sec 1.00 10.8±0.04ms 4.1 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.2±0.08ms 3.1 GB/sec 1.00 14.2±0.07ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.7±0.06ms 3.5 GB/sec 1.01 12.7±0.05ms 3.4 GB/sec short_string_non_null/bloom_filter 1.01 27.5±0.06ms 436.3 MB/sec 1.00 27.2±0.06ms 441.2 MB/sec short_string_non_null/cdc 1.00 19.8±0.13ms 605.1 MB/sec 1.00 19.8±0.06ms 605.3 MB/sec short_string_non_null/default 1.01 15.6±0.05ms 767.5 MB/sec 1.00 15.5±0.05ms 772.7 MB/sec short_string_non_null/parquet_2 1.01 26.1±0.29ms 460.0 MB/sec 1.00 25.9±0.07ms 463.4 MB/sec short_string_non_null/zstd 1.00 35.9±0.08ms 334.1 MB/sec 1.00 35.8±0.11ms 334.9 MB/sec short_string_non_null/zstd_parquet_2 1.00 28.9±0.12ms 414.6 MB/sec 1.00 29.0±0.07ms 414.2 MB/sec small_string_distinct/delta_byte_array 1.01 978.8±10.42µs 8.0 GB/sec 1.00 969.8±17.00µs 8.1 GB/sec small_string_distinct/plain 1.00 733.0±5.08µs 10.7 GB/sec 1.04 765.0±5.01µs 10.3 GB/sec small_string_partial_prefix/delta_byte_array 1.00 1009.5±10.70µs 7.8 GB/sec 1.00 1010.7±5.56µs 7.8 GB/sec small_string_partial_prefix/plain 1.00 1013.5±17.37µs 7.7 GB/sec 1.02 1038.6±9.17µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.00 979.3±4.66µs 8.0 GB/sec 1.00 982.3±3.50µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1106.1±11.16µs 7.1 GB/sec 1.03 1136.7±9.13µs 6.9 GB/sec string/bloom_filter 1.00 208.8±21.10ms 2.5 GB/sec 1.01 210.4±22.47ms 2.4 GB/sec string/cdc 1.00 200.7±1.58ms 2.6 GB/sec 1.03 206.4±6.42ms 2.5 GB/sec string/default 1.00 125.1±23.04ms 4.1 GB/sec 1.01 126.8±22.72ms 4.0 GB/sec string/parquet_2 1.00 163.3±0.78ms 3.1 GB/sec 1.07 174.9±0.66ms 2.9 GB/sec string/zstd 1.00 462.7±11.43ms 1133.1 MB/sec 1.00 463.4±14.09ms 1131.3 MB/sec string/zstd_parquet_2 1.00 384.7±5.20ms 1362.7 MB/sec 1.02 391.6±7.35ms 1338.8 MB/sec string_and_binary_view/bloom_filter 1.00 64.0±0.26ms 504.1 MB/sec 1.03 65.9±0.25ms 489.4 MB/sec string_and_binary_view/cdc 1.00 58.7±0.25ms 549.0 MB/sec 1.02 60.0±0.21ms 537.5 MB/sec string_and_binary_view/default 1.00 48.0±0.15ms 671.6 MB/sec 1.02 49.1±0.16ms 656.3 MB/sec string_and_binary_view/parquet_2 1.00 59.2±0.20ms 544.7 MB/sec 1.02 60.5±0.21ms 533.2 MB/sec string_and_binary_view/zstd 1.00 84.9±0.17ms 379.7 MB/sec 1.02 86.3±0.23ms 373.5 MB/sec string_and_binary_view/zstd_parquet_2 1.00 73.1±0.20ms 441.3 MB/sec 1.02 74.5±0.26ms 432.9 MB/sec string_dictionary/bloom_filter 1.00 83.6±0.27ms 3.1 GB/sec 1.04 86.8±0.42ms 3.0 GB/sec string_dictionary/cdc 1.00 46.4±0.93ms 5.6 GB/sec 1.05 48.7±0.75ms 5.3 GB/sec string_dictionary/default 1.00 43.0±0.84ms 6.0 GB/sec 1.03 44.4±1.33ms 5.8 GB/sec string_dictionary/parquet_2 1.00 48.3±0.56ms 5.3 GB/sec 1.00 48.1±0.22ms 5.4 GB/sec string_dictionary/zstd 1.00 207.7±1.44ms 1271.4 MB/sec 1.01 209.0±0.49ms 1264.0 MB/sec string_dictionary/zstd_parquet_2 1.00 191.8±0.23ms 1377.3 MB/sec 1.00 192.7±0.73ms 1371.0 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.3±0.13ms 116.9 MB/sec 1.00 34.1±0.16ms 117.5 MB/sec string_dictionary_low_cardinality_100/cdc 1.01 27.9±0.14ms 143.5 MB/sec 1.00 27.6±0.11ms 144.9 MB/sec string_dictionary_low_cardinality_100/default 1.01 25.5±0.12ms 156.9 MB/sec 1.00 25.3±0.12ms 158.2 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.01 25.5±0.13ms 157.0 MB/sec 1.00 25.3±0.12ms 158.1 MB/sec string_dictionary_low_cardinality_100/zstd 1.01 25.9±0.14ms 154.6 MB/sec 1.00 25.7±0.12ms 155.8 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.01 25.9±0.11ms 155.0 MB/sec 1.00 25.7±0.13ms 156.0 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.00 33.4±0.14ms 119.9 MB/sec 1.01 33.7±0.12ms 119.0 MB/sec string_dictionary_low_cardinality_20/cdc 1.00 27.4±0.12ms 146.3 MB/sec 1.01 27.5±0.12ms 145.5 MB/sec string_dictionary_low_cardinality_20/default 1.00 25.1±0.14ms 159.8 MB/sec 1.01 25.2±0.12ms 158.7 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.00 25.1±0.13ms 159.8 MB/sec 1.01 25.2±0.12ms 158.9 MB/sec string_dictionary_low_cardinality_20/zstd 1.00 25.2±0.13ms 158.9 MB/sec 1.01 25.4±0.11ms 157.9 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.00 25.2±0.13ms 159.0 MB/sec 1.01 25.3±0.13ms 158.1 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.1±0.15ms 114.4 MB/sec 1.00 35.2±0.16ms 113.9 MB/sec string_dictionary_low_cardinality_400/cdc 1.01 28.3±0.15ms 141.6 MB/sec 1.00 28.2±0.13ms 142.3 MB/sec string_dictionary_low_cardinality_400/default 1.01 26.1±0.17ms 153.9 MB/sec 1.00 25.8±0.15ms 155.5 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.01 26.0±0.15ms 154.2 MB/sec 1.00 25.8±0.13ms 155.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.01 26.6±0.15ms 151.1 MB/sec 1.00 26.3±0.13ms 152.3 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.01 26.5±0.14ms 151.4 MB/sec 1.00 26.3±0.13ms 152.7 MB/sec string_non_null/bloom_filter 1.00 233.5±22.18ms 2.2 GB/sec 1.00 234.4±10.50ms 2.2 GB/sec string_non_null/cdc 1.00 235.1±1.55ms 2.2 GB/sec 1.06 250.1±3.69ms 2.0 GB/sec string_non_null/default 1.16 132.2±24.61ms 3.9 GB/sec 1.00 113.9±14.07ms 4.5 GB/sec string_non_null/parquet_2 1.00 118.7±3.95ms 4.3 GB/sec 1.07 126.6±11.85ms 4.0 GB/sec string_non_null/zstd 1.00 531.9±4.10ms 985.2 MB/sec 1.05 557.2±5.29ms 940.4 MB/sec string_non_null/zstd_parquet_2 1.00 487.6±3.07ms 1074.6 MB/sec 1.05 510.5±12.66ms 1026.4 MB/sec string_ree/bloom_filter 1.00 105.4±1.75ms 155.7 MB/sec 1.50 157.6±2.64ms 104.1 MB/sec string_ree/cdc 1.00 225.4±1.78ms 72.8 MB/sec 1.01 226.8±0.84ms 72.3 MB/sec string_ree/default 1.00 77.9±1.32ms 210.6 MB/sec 1.63 126.6±2.48ms 129.6 MB/sec string_ree/parquet_2 1.00 79.5±0.27ms 206.4 MB/sec 1.64 130.5±1.94ms 125.7 MB/sec string_ree/zstd 1.00 186.7±1.21ms 87.9 MB/sec 1.01 188.7±1.60ms 86.9 MB/sec string_ree/zstd_parquet_2 1.01 145.3±0.54ms 112.9 MB/sec 1.00 144.5±0.42ms 113.6 MB/sec string_ree_95pct_null/bloom_filter 1.00 26.3±0.17ms 53.5 MB/sec 1.00 26.2±0.13ms 53.6 MB/sec string_ree_95pct_null/cdc 1.00 32.3±0.08ms 43.5 MB/sec 1.01 32.6±0.18ms 43.1 MB/sec string_ree_95pct_null/default 1.00 24.7±0.08ms 56.9 MB/sec 1.00 24.8±0.08ms 56.8 MB/sec string_ree_95pct_null/parquet_2 1.00 24.7±0.08ms 56.9 MB/sec 1.00 24.7±0.06ms 56.9 MB/sec string_ree_95pct_null/zstd 1.00 25.7±0.14ms 54.7 MB/sec 1.00 25.7±0.10ms 54.8 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.5±0.08ms 55.2 MB/sec 1.00 25.5±0.12ms 55.2 MB/sec struct_all_null/bloom_filter 1.00 371.1±1.86µs 42.4 GB/sec 1.01 374.2±2.70µs 42.1 GB/sec struct_all_null/cdc 1.07 8.3±0.67ms 1932.5 MB/sec 1.00 7.8±0.09ms 2.0 GB/sec struct_all_null/default 1.00 118.1±0.85µs 133.3 GB/sec 1.00 118.2±0.63µs 133.2 GB/sec struct_all_null/parquet_2 1.01 122.3±0.90µs 128.8 GB/sec 1.00 120.8±0.51µs 130.4 GB/sec struct_all_null/zstd 1.01 183.7±0.94µs 85.7 GB/sec 1.00 182.6±0.53µs 86.3 GB/sec struct_all_null/zstd_parquet_2 1.02 166.2±1.04µs 94.7 GB/sec 1.00 163.7±0.59µs 96.2 GB/sec struct_non_null/bloom_filter 1.00 43.1±0.21ms 371.3 MB/sec 1.01 43.4±0.38ms 368.4 MB/sec struct_non_null/cdc 1.00 43.1±0.21ms 371.6 MB/sec 1.00 43.2±0.18ms 370.2 MB/sec struct_non_null/default 1.00 29.4±0.12ms 544.4 MB/sec 1.01 29.8±0.19ms 536.9 MB/sec struct_non_null/parquet_2 1.00 38.2±0.13ms 419.4 MB/sec 1.01 38.5±0.17ms 415.3 MB/sec struct_non_null/zstd 1.00 38.0±0.12ms 421.2 MB/sec 1.00 38.0±0.16ms 420.6 MB/sec struct_non_null/zstd_parquet_2 1.00 51.9±0.17ms 308.5 MB/sec 1.00 51.9±0.16ms 308.3 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.06ms 2.4 GB/sec 1.03 6.8±0.21ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.06 14.7±1.11ms 1093.6 MB/sec 1.00 13.9±0.13ms 1162.3 MB/sec struct_sparse_99pct_null/default 1.00 6.0±0.02ms 2.6 GB/sec 1.01 6.0±0.04ms 2.6 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.0±0.02ms 2.6 GB/sec 1.03 6.2±0.13ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.00 7.3±0.02ms 2.1 GB/sec 1.01 7.4±0.04ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.00 6.8±0.03ms 2.3 GB/sec 1.01 6.8±0.04ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3290.7s | | Peak memory | 2.9 GiB | | Avg memory | 2.6 GiB | | CPU user | 3152.1s | | CPU sys | 133.6s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3280.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3124.6s | | CPU sys | 152.2s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
