adriangbot commented on PR #11523: URL: https://github.com/apache/arrow-rs/pull/11523#issuecomment-6123076298
🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/11523#issuecomment-6122480655) **Target:** arrow_writer Comparing min-max-opt-in-parquet-writer (63baa7e894cda4ea0482635c9763f899dff1d004) to 0706d31 (merge-base) [diff](https://github.com/apache/arrow-rs/compare/0706d317a94098cec4b631031efcdf16f51ed1f5..63baa7e894cda4ea0482635c9763f899dff1d004) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_writer env: BENCH_FILTER: default resources: arch: amd64 shards: 1 ``` </details> <details><summary>Details</summary> ``` group base changed ----- ---- ------- bool/default 1.34 10.6±0.20ms 94.6 MElem/sec 1.00 7.9±0.07ms 126.8 MElem/sec bool_dictionary/default 1.43 9.7±0.52ms 102.7 MElem/sec 1.00 6.8±0.07ms 147.4 MElem/sec bool_non_null/default 1.25 2.5±0.03ms 407.6 MElem/sec 1.00 1966.0±44.12µs 508.6 MElem/sec bool_ree/default 1.24 28.3±0.75ms 35.3 MElem/sec 1.00 22.9±0.31ms 43.6 MElem/sec byte_array_sparse_99pct_null/default 1.01 8.2±0.10ms 121.9 MElem/sec 1.00 8.1±0.06ms 122.9 MElem/sec decimal/default 1.33 119.2±7.47ms 8.4 MElem/sec 1.00 89.6±2.00ms 11.2 MElem/sec decimal128_dictionary/default 1.02 34.3±0.96ms 29.1 MElem/sec 1.00 33.8±0.52ms 29.6 MElem/sec decimal128_dictionary_1pct_cardinality/default 1.00 29.2±0.55ms 34.3 MElem/sec 1.01 29.5±0.50ms 34.0 MElem/sec decimal128_sparse/default 1.00 27.2±0.37ms 36.7 MElem/sec 1.00 27.2±0.56ms 36.8 MElem/sec fixed_size_binary_non_null/default 1.00 33.4±0.65ms 29.9 MElem/sec 1.00 33.4±0.42ms 29.9 MElem/sec fixed_size_binary_ree/default 1.32 73.0±3.84ms 13.7 MElem/sec 1.00 55.3±0.80ms 18.1 MElem/sec fixed_size_binary_ree_low_cardinality/default 1.19 52.9±2.83ms 18.9 MElem/sec 1.00 44.5±0.48ms 22.5 MElem/sec float64_dictionary/default 1.58 19.4±0.67ms 51.6 MElem/sec 1.00 12.2±0.41ms 81.8 MElem/sec float64_dictionary_1pct_cardinality/default 1.55 13.1±0.29ms 76.4 MElem/sec 1.00 8.4±0.29ms 118.4 MElem/sec float_with_nans/default 1.16 63.5±1.24ms 15.8 MElem/sec 1.00 54.7±0.99ms 18.3 MElem/sec fsb/default 1.02 10.3±0.27ms 97.0 MElem/sec 1.00 10.1±0.08ms 98.9 MElem/sec int32_ree/default 1.23 35.1±0.94ms 28.5 MElem/sec 1.00 28.5±0.80ms 35.1 MElem/sec int32_ree_95pct_null/default 1.15 23.1±0.71ms 43.3 MElem/sec 1.00 20.0±0.30ms 49.9 MElem/sec int64_dictionary/default 1.54 17.9±0.73ms 56.0 MElem/sec 1.00 11.6±0.12ms 86.2 MElem/sec int64_dictionary_1pct_cardinality/default 1.42 10.9±0.68ms 92.2 MElem/sec 1.00 7.6±0.10ms 130.8 MElem/sec int64_ree_low_cardinality/default 1.15 19.0±0.84ms 52.7 MElem/sec 1.00 16.6±0.23ms 60.4 MElem/sec large_string_non_null/default 1.27 57.1±0.50ms 17.5 KElem/sec 1.00 44.8±0.93ms 22.3 KElem/sec list_int32_ree/default 1.13 98.1±4.29ms 10.2 MElem/sec 1.00 86.4±2.14ms 11.6 MElem/sec list_int32_ree_short_runs/default 1.19 110.5±5.21ms 9.0 MElem/sec 1.00 92.8±2.34ms 10.8 MElem/sec list_nested/default 1.02 133.8±1.65ms 7.5 MElem/sec 1.00 131.1±0.87ms 7.6 MElem/sec list_of_int32_ree/default 1.03 101.3±2.98ms 9.9 MElem/sec 1.00 98.2±1.05ms 10.2 MElem/sec list_of_int32_ree_alt_empty/default 1.00 66.2±1.31ms 15.1 MElem/sec 1.00 66.4±0.94ms 15.1 MElem/sec list_of_int32_ree_alt_null/default 1.00 102.5±2.23ms 9.8 MElem/sec 1.00 102.6±2.67ms 9.8 MElem/sec list_of_list_int32_ree/default 1.14 130.4±5.08ms 7.7 MElem/sec 1.00 114.0±1.29ms 8.8 MElem/sec list_primitive/default 1.00 248.2±3.21ms 4.0 MElem/sec 1.00 247.8±2.89ms 4.0 MElem/sec list_primitive_non_null/default 1.00 323.6±14.71ms 3.1 MElem/sec 1.01 327.2±16.49ms 3.1 MElem/sec list_primitive_sparse_99pct_null/default 1.00 11.2±0.21ms 89.3 MElem/sec 1.00 11.2±0.19ms 89.2 MElem/sec list_string_ree/default 1.05 112.6±6.23ms 8.9 MElem/sec 1.00 107.0±8.59ms 9.3 MElem/sec list_struct_with_list/default 1.01 252.2±3.73ms 4.0 MElem/sec 1.00 248.5±3.02ms 4.0 MElem/sec numeric_ree_of_dict/default 1.23 30.7±0.48ms 32.6 MElem/sec 1.00 25.0±0.30ms 40.0 MElem/sec primitive/default 1.47 125.0±2.32ms 8.0 MElem/sec 1.00 85.1±2.17ms 11.8 MElem/sec primitive_all_null/default 1.00 232.5±6.96µs 4.2 GElem/sec 1.01 234.8±5.80µs 4.2 GElem/sec primitive_dictionary/default 1.53 21.7±0.54ms 46.0 MElem/sec 1.00 14.2±0.15ms 70.2 MElem/sec primitive_dictionary_1pct_cardinality/default 1.45 10.9±0.53ms 91.7 MElem/sec 1.00 7.5±0.23ms 132.7 MElem/sec primitive_non_null/default 1.78 74.0±3.71ms 13.5 MElem/sec 1.00 41.6±0.38ms 24.1 MElem/sec primitive_sparse_99pct_null/default 1.00 9.6±0.14ms 104.7 MElem/sec 1.00 9.6±0.14ms 104.4 MElem/sec ree_list_ree_list/default 1.10 249.8±13.79ms 4.0 MElem/sec 1.00 227.0±3.31ms 4.4 MElem/sec ree_struct_of_dict/default 1.22 53.8±1.44ms 18.6 MElem/sec 1.00 44.1±1.14ms 22.7 MElem/sec short_string_non_null/default 1.53 16.9±0.35ms 59.0 MElem/sec 1.00 11.1±0.15ms 90.4 MElem/sec string/default 1.26 198.4±25.18ms 5.0 MElem/sec 1.00 157.0±5.65ms 6.4 MElem/sec string_and_binary_view/default 1.52 57.4±0.98ms 17.4 MElem/sec 1.00 37.9±0.45ms 26.4 MElem/sec string_dictionary/default 1.32 77.2±1.02ms 13.0 MElem/sec 1.00 58.2±0.66ms 17.2 MElem/sec string_dictionary_1pct_cardinality/default 1.26 17.3±0.28ms 57.8 MElem/sec 1.00 13.7±0.42ms 72.9 MElem/sec string_dictionary_low_cardinality_100/default 1.27 18.8±0.53ms 53.1 MElem/sec 1.00 14.8±0.16ms 67.7 MElem/sec string_dictionary_low_cardinality_20/default 1.30 19.0±0.77ms 52.5 MElem/sec 1.00 14.6±0.19ms 68.5 MElem/sec string_dictionary_low_cardinality_400/default 1.25 19.1±0.39ms 52.4 MElem/sec 1.00 15.3±0.25ms 65.5 MElem/sec string_non_null/default 1.05 199.7±14.38ms 5.0 MElem/sec 1.00 190.0±16.97ms 5.3 MElem/sec string_ree/default 1.17 176.6±3.60ms 5.7 MElem/sec 1.00 151.1±1.81ms 6.6 MElem/sec string_ree_95pct_null/default 1.16 25.9±1.67ms 38.5 MElem/sec 1.00 22.5±0.22ms 44.5 MElem/sec string_ree_int64_run_ends/default 1.17 33.4±1.30ms 30.0 MElem/sec 1.00 28.5±0.33ms 35.1 MElem/sec string_ree_low_cardinality/default 1.14 31.4±1.41ms 31.8 MElem/sec 1.00 27.5±0.99ms 36.4 MElem/sec string_ree_of_dict/default 1.23 39.8±0.85ms 25.1 MElem/sec 1.00 32.3±0.28ms 30.9 MElem/sec struct_all_null/default 1.00 97.1±2.84µs 10.1 GElem/sec 1.03 99.6±2.57µs 9.8 GElem/sec struct_non_null/default 1.11 21.9±0.49ms 45.7 MElem/sec 1.00 19.8±0.18ms 50.5 MElem/sec struct_of_list_of_int32_ree_alt_null/default 1.01 105.0±2.84ms 9.5 MElem/sec 1.00 104.3±2.40ms 9.6 MElem/sec struct_of_list_of_int32_ree_fragmented/default 1.02 102.4±2.29ms 9.8 MElem/sec 1.00 100.8±2.11ms 9.9 MElem/sec struct_of_list_of_int32_ree_single_null/default 1.01 102.4±1.76ms 9.8 MElem/sec 1.00 101.4±1.32ms 9.9 MElem/sec struct_ree/default 1.19 42.1±2.17ms 23.8 MElem/sec 1.00 35.3±0.99ms 28.3 MElem/sec struct_ree_short_runs/default 1.16 53.2±2.55ms 18.8 MElem/sec 1.00 45.8±0.46ms 21.9 MElem/sec struct_sparse_99pct_null/default 1.00 6.0±0.03ms 165.5 MElem/sec 1.01 6.1±0.06ms 163.3 MElem/sec ``` </details> <details><summary>Per-runner information</summary> <details><summary>arrow_writer — shard 1/1</summary> **Node:** gk3-benchmark-cluster-nap-15raeun1-f8dd49b5-bskm **Instance:** c4-standard-24 (12 vCPU / 65 GiB) **uname:** ```text Linux bench-c6122480655-3331-p9mxc 6.12.94+ #1 SMP Fri Aug 21 07:56:42 UTC 2026 x86_64 GNU/Linux ``` **BENCH_COMMAND:** ```sh cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_writer ``` <details><summary>CPU Details (lscpu)</summary> ```text Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 52 bits physical, 57 bits virtual Byte Order: Little Endian CPU(s): 24 On-line CPU(s) list: 0-23 Vendor ID: GenuineIntel Model name: INTEL(R) XEON(R) PLATINUM 8581C CPU @ 2.30GHz CPU family: 6 Model: 207 Thread(s) per core: 2 Core(s) per socket: 12 Socket(s): 1 Stepping: 2 BogoMIPS: 4600.00 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology nonstop_tsc cpuid tsc_known_freq pni pclmulqdq monitor ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ssbd ibrs ibpb stibp ibrs_enhanced fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm avx512f avx512dq rdseed adx smap avx512ifma clflushopt clwb avx512cd sha_ni avx512bw avx512vl xsaveopt xsavec xgetbv1 xsaves avx_vnni avx512_bf16 wbnoinvd arat avx512vbmi umip avx512_vbmi2 gfni vaes vpclmulqdq avx512_vnni avx512_bitalg avx512_vpopcntdq rdpid cldemote movdiri movdir64b fsrm md_clear serialize tsxldtrk amx_bf16 avx512_fp16 amx_tile amx_int8 arch_capabilities Hypervisor vendor: KVM Virtualization type: full L1d cache: 576 KiB (12 instances) L1i cache: 384 KiB (12 instances) L2 cache: 24 MiB (12 instances) L3 cache: 260 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-23 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Enhanced / Automatic IBRS; IBPB conditional; PBRSB-eIBRS SW sequence; BHI BHI_DIS_S Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 875.2s | | Peak memory | 909.0 MiB | | Avg memory | 354.2 MiB | | CPU user | 840.7s | | CPU sys | 30.0s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 865.2s | | Peak memory | 2.0 GiB | | Avg memory | 328.6 MiB | | CPU user | 831.9s | | CPU sys | 30.1s | | Peak spill | 0 B | </details> </details> </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner <!-- benchmark-request:6122480655:finish:1c4183b967f48347f389bbf3a60ca583 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
