adriangbot commented on PR #10554: URL: https://github.com/apache/arrow-rs/pull/10554#issuecomment-5336647342
🤖 Arrow criterion benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/10554#issuecomment-5335765970) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) Comparing claude/parquet-exact-value-windows-10538 (65844079fb9105c97547a081775a7746355203c5) to 2d2d4adc624a9ffb4a2b850fe86bf0c9df097313 [diff](https://github.com/apache/arrow-rs/compare/2d2d4adc624a9ffb4a2b850fe86bf0c9df097313..65844079fb9105c97547a081775a7746355203c5) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer baseline: ref: "2d2d4adc624a9ffb4a2b850fe86bf0c9df097313" ``` </details> <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group claude_parquet-exact-value-windows-10538 main ----- ---------------------------------------- ---- bool/bloom_filter 1.00 12.7±0.06ms 19.7 MB/sec 1.00 12.7±0.05ms 19.7 MB/sec bool/cdc 1.00 15.5±0.09ms 16.1 MB/sec 1.00 15.5±0.10ms 16.1 MB/sec bool/default 1.00 10.6±0.04ms 23.6 MB/sec 1.00 10.6±0.05ms 23.7 MB/sec bool/parquet_2 1.01 13.5±0.07ms 18.5 MB/sec 1.00 13.5±0.04ms 18.6 MB/sec bool/zstd 1.01 11.1±0.06ms 22.4 MB/sec 1.00 11.1±0.05ms 22.6 MB/sec bool/zstd_parquet_2 1.00 13.9±0.05ms 18.0 MB/sec 1.00 13.9±0.09ms 18.0 MB/sec bool_non_null/bloom_filter 1.00 6.5±0.04ms 19.1 MB/sec 1.01 6.6±0.04ms 19.0 MB/sec bool_non_null/cdc 1.00 6.3±0.07ms 19.8 MB/sec 1.02 6.4±0.12ms 19.5 MB/sec bool_non_null/default 1.00 3.8±0.03ms 33.1 MB/sec 1.01 3.8±0.02ms 32.8 MB/sec bool_non_null/parquet_2 1.00 7.6±0.04ms 16.4 MB/sec 1.00 7.6±0.03ms 16.5 MB/sec bool_non_null/zstd 1.00 4.1±0.03ms 30.2 MB/sec 1.01 4.2±0.03ms 30.0 MB/sec bool_non_null/zstd_parquet_2 1.00 8.0±0.03ms 15.6 MB/sec 1.01 8.1±0.05ms 15.5 MB/sec bool_ree/bloom_filter 1.00 30.1±0.11ms 7.1 MB/sec 1.00 30.1±0.10ms 7.1 MB/sec bool_ree/cdc 1.00 31.3±0.12ms 6.8 MB/sec 1.00 31.3±0.10ms 6.8 MB/sec bool_ree/default 1.00 27.3±0.07ms 7.8 MB/sec 1.01 27.5±0.11ms 7.8 MB/sec bool_ree/parquet_2 1.00 28.8±0.11ms 7.4 MB/sec 1.00 28.8±0.07ms 7.4 MB/sec bool_ree/zstd 1.00 27.9±0.08ms 7.6 MB/sec 1.00 27.9±0.07ms 7.6 MB/sec bool_ree/zstd_parquet_2 1.00 29.1±0.08ms 7.3 MB/sec 1.00 29.1±0.06ms 7.3 MB/sec decimal/bloom_filter 1.01 122.1±1.97ms 491.5 MB/sec 1.00 120.5±0.91ms 497.8 MB/sec decimal/cdc 1.00 101.5±0.70ms 591.0 MB/sec 1.01 102.7±1.40ms 584.3 MB/sec decimal/default 1.01 80.0±2.30ms 750.0 MB/sec 1.00 79.0±0.83ms 759.5 MB/sec decimal/parquet_2 1.00 178.2±1.94ms 336.7 MB/sec 1.01 180.1±3.34ms 333.2 MB/sec decimal/zstd 1.02 91.4±2.06ms 656.8 MB/sec 1.00 89.8±2.31ms 668.4 MB/sec decimal/zstd_parquet_2 1.01 198.6±2.28ms 302.2 MB/sec 1.00 197.6±2.28ms 303.7 MB/sec fixed_size_binary_ree/bloom_filter 1.00 59.3±1.64ms 17.0 MB/sec 1.01 59.7±1.72ms 16.9 MB/sec fixed_size_binary_ree/cdc 1.00 61.8±0.38ms 16.3 MB/sec 1.00 61.7±0.33ms 16.3 MB/sec fixed_size_binary_ree/default 1.00 52.0±0.94ms 19.4 MB/sec 1.02 52.9±2.07ms 19.1 MB/sec fixed_size_binary_ree/parquet_2 1.02 68.2±2.02ms 14.8 MB/sec 1.00 66.9±1.42ms 15.1 MB/sec fixed_size_binary_ree/zstd 1.01 58.0±1.29ms 17.4 MB/sec 1.00 57.5±1.00ms 17.5 MB/sec fixed_size_binary_ree/zstd_parquet_2 1.01 67.9±1.80ms 14.8 MB/sec 1.00 67.3±1.21ms 15.0 MB/sec float_with_nans/bloom_filter 1.02 82.9±2.54ms 168.9 MB/sec 1.00 81.4±1.32ms 172.1 MB/sec float_with_nans/cdc 1.01 72.2±1.94ms 194.0 MB/sec 1.00 71.4±0.97ms 196.0 MB/sec float_with_nans/default 1.00 64.1±1.42ms 218.4 MB/sec 1.00 64.0±1.34ms 218.9 MB/sec float_with_nans/parquet_2 1.00 80.8±0.72ms 173.4 MB/sec 1.00 81.1±1.36ms 172.7 MB/sec float_with_nans/zstd 1.00 101.8±0.90ms 137.5 MB/sec 1.00 101.4±0.66ms 138.1 MB/sec float_with_nans/zstd_parquet_2 1.00 117.8±0.88ms 118.9 MB/sec 1.02 119.7±2.19ms 117.0 MB/sec fsb/bloom_filter 1.00 8.3±0.32ms 1932.3 MB/sec 1.03 8.6±0.45ms 1884.8 MB/sec fsb/cdc 1.02 10.6±0.22ms 1515.1 MB/sec 1.00 10.4±0.17ms 1550.2 MB/sec fsb/default 1.01 7.0±0.12ms 2.2 GB/sec 1.00 7.0±0.11ms 2.3 GB/sec fsb/parquet_2 1.00 13.5±0.25ms 1195.4 MB/sec 1.01 13.6±0.47ms 1188.3 MB/sec fsb/zstd 1.01 9.5±0.18ms 1699.7 MB/sec 1.00 9.4±0.12ms 1718.1 MB/sec fsb/zstd_parquet_2 1.05 15.2±0.82ms 1063.6 MB/sec 1.00 14.4±0.31ms 1118.1 MB/sec int32_ree/bloom_filter 1.00 41.4±0.39ms 9.8 MB/sec 1.02 42.1±1.26ms 9.7 MB/sec int32_ree/cdc 1.00 40.4±0.20ms 10.1 MB/sec 1.00 40.4±0.18ms 10.1 MB/sec int32_ree/default 1.00 36.7±0.14ms 11.1 MB/sec 1.00 36.6±0.13ms 11.1 MB/sec int32_ree/parquet_2 1.01 37.0±0.23ms 11.0 MB/sec 1.00 36.8±0.21ms 11.1 MB/sec int32_ree/zstd 1.00 37.4±0.21ms 10.9 MB/sec 1.00 37.2±0.20ms 10.9 MB/sec int32_ree/zstd_parquet_2 1.00 37.2±0.19ms 10.9 MB/sec 1.00 37.2±0.21ms 10.9 MB/sec int32_ree_95pct_null/bloom_filter 1.01 22.3±0.25ms 18.3 MB/sec 1.00 22.1±0.20ms 18.4 MB/sec int32_ree_95pct_null/cdc 1.00 24.0±0.09ms 17.0 MB/sec 1.01 24.1±0.21ms 16.9 MB/sec int32_ree_95pct_null/default 1.00 21.6±0.07ms 18.9 MB/sec 1.01 21.7±0.16ms 18.8 MB/sec int32_ree_95pct_null/parquet_2 1.01 21.7±0.11ms 18.8 MB/sec 1.00 21.6±0.07ms 18.9 MB/sec int32_ree_95pct_null/zstd 1.00 21.9±0.07ms 18.6 MB/sec 1.00 21.9±0.09ms 18.6 MB/sec int32_ree_95pct_null/zstd_parquet_2 1.00 21.8±0.09ms 18.7 MB/sec 1.00 21.8±0.07ms 18.7 MB/sec large_string_distinct/delta_byte_array 1.02 67.4±3.13ms 3.7 GB/sec 1.00 66.4±2.96ms 3.8 GB/sec large_string_distinct/plain 1.07 67.2±8.85ms 3.7 GB/sec 1.00 63.0±2.46ms 4.0 GB/sec large_string_distinct_nullable/delta_byte_array 1.21 69.1±8.12ms 3.6 GB/sec 1.00 57.1±3.57ms 4.4 GB/sec large_string_non_null/bloom_filter 1.00 74.7±2.43ms 3.3 GB/sec 1.03 76.9±1.06ms 3.2 GB/sec large_string_non_null/cdc 1.00 245.4±1.58ms 1043.3 MB/sec 1.00 245.0±1.90ms 1044.7 MB/sec large_string_non_null/default 1.00 55.3±0.55ms 4.5 GB/sec 1.07 59.5±0.96ms 4.2 GB/sec large_string_non_null/parquet_2 1.00 57.4±2.64ms 4.4 GB/sec 1.03 59.3±1.07ms 4.2 GB/sec large_string_non_null/zstd 1.00 55.7±0.99ms 4.5 GB/sec 1.06 59.2±1.00ms 4.2 GB/sec large_string_non_null/zstd_parquet_2 1.00 56.0±0.93ms 4.5 GB/sec 1.10 61.8±2.91ms 4.0 GB/sec large_string_shared_prefix/delta_byte_array 1.00 57.7±3.08ms 4.3 GB/sec 1.01 58.1±2.35ms 4.3 GB/sec large_string_shared_prefix/plain 1.00 95.3±2.74ms 2.6 GB/sec 1.03 98.1±4.93ms 2.5 GB/sec large_string_shared_prefix_list/delta_byte_array 1.00 56.9±2.73ms 4.4 GB/sec 1.11 63.3±6.52ms 3.9 GB/sec large_string_shared_prefix_nullable/delta_byte_array 1.08 55.0±2.61ms 4.5 GB/sec 1.00 51.0±4.58ms 4.9 GB/sec large_string_shared_prefix_nullable/plain 1.00 65.6±2.95ms 3.8 GB/sec 1.08 70.9±7.76ms 3.5 GB/sec large_string_shared_prefix_nullable_dense/delta_byte_array 1.00 29.0±0.98ms 4.3 GB/sec 1.00 29.1±1.19ms 4.3 GB/sec large_string_shared_prefix_nullable_trailing/delta_byte_array 1.00 56.5±5.13ms 4.4 GB/sec 1.25 70.6±3.31ms 3.5 GB/sec list_nested/bloom_filter 1.01 146.2±0.79ms 197.3 MB/sec 1.00 144.9±1.38ms 199.1 MB/sec list_nested/cdc 1.01 162.7±1.40ms 177.4 MB/sec 1.00 161.7±0.65ms 178.5 MB/sec list_nested/default 1.00 130.6±0.62ms 220.9 MB/sec 1.00 131.0±1.19ms 220.3 MB/sec list_nested/parquet_2 1.00 144.6±1.29ms 199.5 MB/sec 1.00 144.0±0.64ms 200.3 MB/sec list_nested/zstd 1.00 139.9±0.67ms 206.3 MB/sec 1.00 139.9±0.92ms 206.3 MB/sec list_nested/zstd_parquet_2 1.00 157.0±0.69ms 183.8 MB/sec 1.00 157.4±1.16ms 183.4 MB/sec list_primitive/bloom_filter 1.00 285.4±5.87ms 1910.7 MB/sec 1.00 285.9±14.09ms 1907.8 MB/sec list_primitive/cdc 1.00 312.7±4.84ms 1744.1 MB/sec 1.01 314.9±2.72ms 1731.9 MB/sec list_primitive/default 1.01 205.2±5.72ms 2.6 GB/sec 1.00 204.0±2.87ms 2.6 GB/sec list_primitive/parquet_2 1.01 225.9±2.80ms 2.4 GB/sec 1.00 224.5±1.52ms 2.4 GB/sec list_primitive/zstd 1.00 459.3±6.87ms 1187.4 MB/sec 1.01 463.2±7.82ms 1177.4 MB/sec list_primitive/zstd_parquet_2 1.00 445.3±1.46ms 1224.8 MB/sec 1.01 447.8±3.22ms 1218.0 MB/sec list_primitive_non_null/bloom_filter 1.00 351.6±19.10ms 1547.7 MB/sec 1.10 388.0±13.22ms 1402.7 MB/sec list_primitive_non_null/cdc 1.00 395.2±11.86ms 1377.2 MB/sec 1.01 399.5±11.25ms 1362.2 MB/sec list_primitive_non_null/default 1.00 204.3±6.77ms 2.6 GB/sec 1.24 253.8±11.90ms 2.1 GB/sec list_primitive_non_null/parquet_2 1.00 231.8±3.78ms 2.3 GB/sec 1.08 250.9±24.26ms 2.1 GB/sec list_primitive_non_null/zstd 1.00 645.1±10.40ms 843.7 MB/sec 1.05 680.2±9.53ms 800.1 MB/sec list_primitive_non_null/zstd_parquet_2 1.04 683.7±20.85ms 796.0 MB/sec 1.00 654.6±13.01ms 831.4 MB/sec list_primitive_sparse_99pct_null/bloom_filter 1.00 12.9±0.28ms 2.8 GB/sec 1.00 12.8±0.21ms 2.9 GB/sec list_primitive_sparse_99pct_null/cdc 1.01 24.7±0.54ms 1513.7 MB/sec 1.00 24.4±0.34ms 1529.8 MB/sec list_primitive_sparse_99pct_null/default 1.00 12.4±0.19ms 2.9 GB/sec 1.01 12.5±0.15ms 2.9 GB/sec list_primitive_sparse_99pct_null/parquet_2 1.00 12.5±0.23ms 2.9 GB/sec 1.03 12.9±0.34ms 2.8 GB/sec list_primitive_sparse_99pct_null/zstd 1.00 14.3±0.19ms 2.6 GB/sec 1.02 14.6±0.34ms 2.5 GB/sec list_primitive_sparse_99pct_null/zstd_parquet_2 1.00 12.6±0.26ms 2.9 GB/sec 1.00 12.7±0.19ms 2.9 GB/sec list_struct_with_list/bloom_filter 1.01 286.9±3.99ms 159.0 MB/sec 1.00 284.0±1.78ms 160.5 MB/sec list_struct_with_list/cdc 1.00 321.1±2.56ms 142.0 MB/sec 1.00 321.2±1.63ms 141.9 MB/sec list_struct_with_list/default 1.00 255.4±1.10ms 178.5 MB/sec 1.01 257.3±2.64ms 177.2 MB/sec list_struct_with_list/parquet_2 1.00 272.8±1.22ms 167.2 MB/sec 1.01 275.5±2.66ms 165.5 MB/sec list_struct_with_list/zstd 1.01 280.2±2.83ms 162.7 MB/sec 1.00 278.2±1.39ms 163.9 MB/sec list_struct_with_list/zstd_parquet_2 1.00 297.7±2.03ms 153.2 MB/sec 1.00 298.2±2.44ms 152.9 MB/sec medium_string_shared_prefix_nullable/delta_byte_array 1.00 38.7±0.69ms 6.5 GB/sec 1.06 41.1±0.75ms 6.1 GB/sec primitive/bloom_filter 1.00 147.3±1.85ms 304.6 MB/sec 1.00 148.0±2.08ms 303.2 MB/sec primitive/cdc 1.03 159.1±2.80ms 282.0 MB/sec 1.00 154.7±1.03ms 290.1 MB/sec primitive/default 1.00 114.5±1.06ms 391.9 MB/sec 1.01 115.8±2.23ms 387.4 MB/sec primitive/parquet_2 1.02 131.7±2.80ms 340.7 MB/sec 1.00 129.0±0.88ms 348.0 MB/sec primitive/zstd 1.00 144.5±1.38ms 310.6 MB/sec 1.01 146.1±3.12ms 307.1 MB/sec primitive/zstd_parquet_2 1.00 162.4±0.99ms 276.4 MB/sec 1.00 162.2±1.08ms 276.6 MB/sec primitive_all_null/bloom_filter 1.00 902.2±17.66µs 48.6 GB/sec 1.00 905.9±15.51µs 48.4 GB/sec primitive_all_null/cdc 1.00 19.1±0.25ms 2.3 GB/sec 1.00 19.1±0.26ms 2.3 GB/sec primitive_all_null/default 1.00 273.3±1.48µs 160.3 GB/sec 1.02 277.5±1.26µs 157.9 GB/sec primitive_all_null/parquet_2 1.00 283.1±1.66µs 154.8 GB/sec 1.00 283.9±1.53µs 154.3 GB/sec primitive_all_null/zstd 1.01 427.0±1.84µs 102.6 GB/sec 1.00 424.3±1.26µs 103.3 GB/sec primitive_all_null/zstd_parquet_2 1.00 385.2±2.02µs 113.8 GB/sec 1.00 383.5±1.98µs 114.3 GB/sec primitive_non_null/bloom_filter 1.00 104.3±2.02ms 421.8 MB/sec 1.02 106.0±3.23ms 415.2 MB/sec primitive_non_null/cdc 1.00 85.7±1.08ms 513.4 MB/sec 1.01 86.1±1.44ms 510.8 MB/sec primitive_non_null/default 1.00 63.2±0.90ms 696.2 MB/sec 1.03 64.9±2.37ms 677.6 MB/sec primitive_non_null/parquet_2 1.00 84.5±0.88ms 520.5 MB/sec 1.01 85.0±1.11ms 517.7 MB/sec primitive_non_null/zstd 1.03 96.2±2.83ms 457.6 MB/sec 1.00 93.3±0.99ms 471.6 MB/sec primitive_non_null/zstd_parquet_2 1.00 118.5±1.10ms 371.4 MB/sec 1.00 118.6±2.24ms 370.9 MB/sec primitive_sparse_99pct_null/bloom_filter 1.02 12.7±0.56ms 3.5 GB/sec 1.00 12.5±0.61ms 3.5 GB/sec primitive_sparse_99pct_null/cdc 1.01 30.5±0.74ms 1469.8 MB/sec 1.00 30.2±0.62ms 1487.5 MB/sec primitive_sparse_99pct_null/default 1.01 10.9±0.22ms 4.0 GB/sec 1.00 10.8±0.17ms 4.1 GB/sec primitive_sparse_99pct_null/parquet_2 1.00 10.9±0.19ms 4.0 GB/sec 1.03 11.2±0.43ms 3.9 GB/sec primitive_sparse_99pct_null/zstd 1.00 14.2±0.22ms 3.1 GB/sec 1.01 14.3±0.28ms 3.1 GB/sec primitive_sparse_99pct_null/zstd_parquet_2 1.04 13.3±0.44ms 3.3 GB/sec 1.00 12.8±0.29ms 3.4 GB/sec short_string_non_null/bloom_filter 1.04 28.8±0.46ms 417.4 MB/sec 1.00 27.7±0.28ms 433.7 MB/sec short_string_non_null/cdc 1.00 19.9±0.17ms 602.1 MB/sec 1.01 20.0±0.30ms 598.9 MB/sec short_string_non_null/default 1.00 15.9±0.12ms 755.6 MB/sec 1.00 15.9±0.21ms 753.3 MB/sec short_string_non_null/parquet_2 1.00 26.4±0.20ms 454.7 MB/sec 1.00 26.3±0.18ms 456.9 MB/sec short_string_non_null/zstd 1.01 36.2±0.16ms 331.1 MB/sec 1.00 36.0±0.16ms 333.2 MB/sec short_string_non_null/zstd_parquet_2 1.00 29.1±0.17ms 413.0 MB/sec 1.01 29.3±0.27ms 410.3 MB/sec small_string_distinct/delta_byte_array 1.00 976.1±42.94µs 8.0 GB/sec 1.15 1120.4±127.63µs 7.0 GB/sec small_string_distinct/plain 1.00 757.2±21.93µs 10.4 GB/sec 1.00 754.7±24.65µs 10.4 GB/sec small_string_partial_prefix/delta_byte_array 1.05 1081.4±134.65µs 7.3 GB/sec 1.00 1034.1±36.39µs 7.6 GB/sec small_string_partial_prefix/plain 1.16 1199.2±151.47µs 6.5 GB/sec 1.00 1033.8±38.80µs 7.6 GB/sec small_string_shared_prefix/delta_byte_array 1.01 992.4±9.98µs 7.9 GB/sec 1.00 981.7±13.85µs 8.0 GB/sec small_string_shared_prefix/plain 1.00 1119.9±26.00µs 7.0 GB/sec 1.08 1207.7±104.64µs 6.5 GB/sec string/bloom_filter 1.18 230.1±29.93ms 2.2 GB/sec 1.00 194.2±8.10ms 2.6 GB/sec string/cdc 1.00 203.4±2.66ms 2.5 GB/sec 1.03 209.2±8.19ms 2.4 GB/sec string/default 1.01 126.7±22.72ms 4.0 GB/sec 1.00 125.4±22.72ms 4.1 GB/sec string/parquet_2 1.48 164.0±1.53ms 3.1 GB/sec 1.00 111.1±3.49ms 4.6 GB/sec string/zstd 1.00 472.5±15.55ms 1109.6 MB/sec 1.00 471.4±14.63ms 1112.0 MB/sec string/zstd_parquet_2 1.01 388.0±5.18ms 1351.1 MB/sec 1.00 385.1±2.76ms 1361.5 MB/sec string_and_binary_view/bloom_filter 1.01 67.2±2.24ms 479.9 MB/sec 1.00 66.2±1.60ms 486.9 MB/sec string_and_binary_view/cdc 1.04 62.3±2.35ms 517.3 MB/sec 1.00 60.2±1.13ms 536.0 MB/sec string_and_binary_view/default 1.05 51.4±2.36ms 627.6 MB/sec 1.00 49.0±0.83ms 658.2 MB/sec string_and_binary_view/parquet_2 1.00 60.1±0.83ms 536.6 MB/sec 1.04 62.5±2.32ms 516.2 MB/sec string_and_binary_view/zstd 1.00 86.2±1.07ms 374.0 MB/sec 1.00 86.5±1.12ms 372.8 MB/sec string_and_binary_view/zstd_parquet_2 1.00 74.2±1.14ms 434.6 MB/sec 1.00 74.2±0.98ms 434.5 MB/sec string_dictionary/bloom_filter 1.00 88.9±4.29ms 2.9 GB/sec 1.10 97.9±12.24ms 2.6 GB/sec string_dictionary/cdc 1.22 59.4±2.18ms 4.3 GB/sec 1.00 48.6±1.62ms 5.3 GB/sec string_dictionary/default 1.02 44.7±1.84ms 5.8 GB/sec 1.00 43.9±1.42ms 5.9 GB/sec string_dictionary/parquet_2 1.20 59.1±0.64ms 4.4 GB/sec 1.00 49.2±0.64ms 5.2 GB/sec string_dictionary/zstd 1.00 212.1±6.25ms 1245.1 MB/sec 1.00 211.1±3.30ms 1251.0 MB/sec string_dictionary/zstd_parquet_2 1.04 201.4±3.34ms 1311.5 MB/sec 1.00 193.9±1.98ms 1362.5 MB/sec string_dictionary_low_cardinality_100/bloom_filter 1.00 34.5±0.16ms 116.0 MB/sec 1.00 34.5±0.20ms 116.1 MB/sec string_dictionary_low_cardinality_100/cdc 1.00 28.0±0.12ms 142.9 MB/sec 1.00 28.0±0.19ms 143.1 MB/sec string_dictionary_low_cardinality_100/default 1.00 25.6±0.15ms 156.3 MB/sec 1.00 25.6±0.15ms 156.2 MB/sec string_dictionary_low_cardinality_100/parquet_2 1.00 25.7±0.14ms 155.8 MB/sec 1.00 25.6±0.16ms 156.2 MB/sec string_dictionary_low_cardinality_100/zstd 1.00 26.0±0.14ms 153.8 MB/sec 1.00 26.0±0.17ms 154.0 MB/sec string_dictionary_low_cardinality_100/zstd_parquet_2 1.00 26.0±0.11ms 154.1 MB/sec 1.00 26.1±0.18ms 153.5 MB/sec string_dictionary_low_cardinality_20/bloom_filter 1.01 33.9±0.14ms 118.2 MB/sec 1.00 33.5±0.12ms 119.5 MB/sec string_dictionary_low_cardinality_20/cdc 1.01 27.8±0.15ms 144.2 MB/sec 1.00 27.4±0.15ms 146.0 MB/sec string_dictionary_low_cardinality_20/default 1.01 25.4±0.14ms 157.7 MB/sec 1.00 25.1±0.13ms 159.4 MB/sec string_dictionary_low_cardinality_20/parquet_2 1.02 25.5±0.15ms 157.3 MB/sec 1.00 25.1±0.13ms 159.8 MB/sec string_dictionary_low_cardinality_20/zstd 1.02 25.6±0.14ms 156.4 MB/sec 1.00 25.2±0.13ms 158.9 MB/sec string_dictionary_low_cardinality_20/zstd_parquet_2 1.01 25.5±0.13ms 156.9 MB/sec 1.00 25.3±0.12ms 158.4 MB/sec string_dictionary_low_cardinality_400/bloom_filter 1.00 35.1±0.17ms 114.2 MB/sec 1.00 35.2±0.17ms 113.9 MB/sec string_dictionary_low_cardinality_400/cdc 1.00 28.4±0.28ms 141.2 MB/sec 1.01 28.7±0.37ms 139.6 MB/sec string_dictionary_low_cardinality_400/default 1.00 26.2±0.23ms 153.2 MB/sec 1.00 26.1±0.19ms 153.5 MB/sec string_dictionary_low_cardinality_400/parquet_2 1.00 26.1±0.23ms 154.0 MB/sec 1.00 26.1±0.21ms 153.6 MB/sec string_dictionary_low_cardinality_400/zstd 1.00 26.7±0.29ms 150.2 MB/sec 1.00 26.6±0.18ms 150.7 MB/sec string_dictionary_low_cardinality_400/zstd_parquet_2 1.00 26.7±0.19ms 150.3 MB/sec 1.00 26.6±0.20ms 150.8 MB/sec string_non_null/bloom_filter 1.08 259.7±30.17ms 2017.8 MB/sec 1.00 241.4±20.79ms 2.1 GB/sec string_non_null/cdc 1.00 238.7±3.06ms 2.1 GB/sec 1.09 259.5±12.63ms 2019.2 MB/sec string_non_null/default 1.11 124.0±18.04ms 4.1 GB/sec 1.00 111.3±11.44ms 4.6 GB/sec string_non_null/parquet_2 1.00 112.8±10.38ms 4.5 GB/sec 1.15 129.8±14.12ms 3.9 GB/sec string_non_null/zstd 1.00 540.2±10.78ms 970.1 MB/sec 1.05 567.9±13.72ms 922.7 MB/sec string_non_null/zstd_parquet_2 1.00 491.0±4.75ms 1067.2 MB/sec 1.04 508.3±9.17ms 1030.8 MB/sec string_ree/bloom_filter 1.00 107.7±5.04ms 152.3 MB/sec 1.50 161.6±7.47ms 101.5 MB/sec string_ree/cdc 1.00 176.9±2.53ms 92.7 MB/sec 1.27 225.0±2.15ms 72.9 MB/sec string_ree/default 1.00 78.7±4.34ms 208.4 MB/sec 1.63 128.4±1.93ms 127.8 MB/sec string_ree/parquet_2 1.00 80.1±0.73ms 204.8 MB/sec 1.59 127.7±1.20ms 128.5 MB/sec string_ree/zstd 1.00 136.8±6.25ms 119.9 MB/sec 1.37 188.0±3.98ms 87.3 MB/sec string_ree/zstd_parquet_2 1.00 96.3±1.92ms 170.5 MB/sec 1.51 145.4±3.41ms 112.8 MB/sec string_ree_95pct_null/bloom_filter 1.01 26.8±0.56ms 52.5 MB/sec 1.00 26.5±0.49ms 53.0 MB/sec string_ree_95pct_null/cdc 1.00 32.5±0.40ms 43.2 MB/sec 1.00 32.4±0.26ms 43.4 MB/sec string_ree_95pct_null/default 1.00 24.8±0.22ms 56.7 MB/sec 1.02 25.3±0.42ms 55.6 MB/sec string_ree_95pct_null/parquet_2 1.02 25.2±0.47ms 55.8 MB/sec 1.00 24.8±0.25ms 56.8 MB/sec string_ree_95pct_null/zstd 1.00 25.9±0.27ms 54.3 MB/sec 1.00 25.8±0.30ms 54.6 MB/sec string_ree_95pct_null/zstd_parquet_2 1.00 25.6±0.27ms 55.0 MB/sec 1.01 25.7±0.30ms 54.7 MB/sec struct_all_null/bloom_filter 1.00 377.4±5.15µs 41.7 GB/sec 1.02 384.1±8.12µs 41.0 GB/sec struct_all_null/cdc 1.00 7.8±0.12ms 2.0 GB/sec 1.01 7.9±0.12ms 2043.3 MB/sec struct_all_null/default 1.00 117.6±0.68µs 133.9 GB/sec 1.01 119.0±0.80µs 132.3 GB/sec struct_all_null/parquet_2 1.01 121.2±0.71µs 129.9 GB/sec 1.00 120.4±0.81µs 130.8 GB/sec struct_all_null/zstd 1.00 182.4±0.80µs 86.3 GB/sec 1.00 183.1±0.55µs 86.0 GB/sec struct_all_null/zstd_parquet_2 1.01 164.6±1.00µs 95.7 GB/sec 1.00 163.7±0.61µs 96.2 GB/sec struct_non_null/bloom_filter 1.00 45.5±0.87ms 352.0 MB/sec 1.01 46.1±2.05ms 347.1 MB/sec struct_non_null/cdc 1.01 43.7±0.45ms 366.2 MB/sec 1.00 43.4±0.33ms 369.0 MB/sec struct_non_null/default 1.01 30.1±0.52ms 532.1 MB/sec 1.00 29.7±0.31ms 538.5 MB/sec struct_non_null/parquet_2 1.00 38.8±0.36ms 412.5 MB/sec 1.00 38.9±0.59ms 411.0 MB/sec struct_non_null/zstd 1.03 39.7±1.26ms 403.2 MB/sec 1.00 38.5±0.45ms 415.7 MB/sec struct_non_null/zstd_parquet_2 1.01 52.9±0.92ms 302.2 MB/sec 1.00 52.5±0.60ms 304.9 MB/sec struct_sparse_99pct_null/bloom_filter 1.00 6.6±0.20ms 2.4 GB/sec 1.04 6.9±0.45ms 2.3 GB/sec struct_sparse_99pct_null/cdc 1.00 13.7±0.25ms 1179.4 MB/sec 1.00 13.7±0.19ms 1174.3 MB/sec struct_sparse_99pct_null/default 1.00 6.1±0.18ms 2.6 GB/sec 1.01 6.2±0.25ms 2.5 GB/sec struct_sparse_99pct_null/parquet_2 1.00 6.1±0.13ms 2.6 GB/sec 1.01 6.1±0.14ms 2.6 GB/sec struct_sparse_99pct_null/zstd 1.03 7.7±0.28ms 2.0 GB/sec 1.00 7.4±0.18ms 2.1 GB/sec struct_sparse_99pct_null/zstd_parquet_2 1.01 6.9±0.24ms 2.3 GB/sec 1.00 6.8±0.18ms 2.3 GB/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 3260.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3162.6s | | CPU sys | 92.2s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 3205.7s | | Peak memory | 2.8 GiB | | Avg memory | 2.6 GiB | | CPU user | 3154.2s | | CPU sys | 47.7s | | Peak spill | 0 B | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
