adriangbot commented on PR #11423: URL: https://github.com/apache/arrow-rs/pull/11423#issuecomment-6052285585
🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/arrow-rs/pull/11423#issuecomment-6051807101) **Target:** arrow_reader_string_encoding Comparing rich-T-kid/parquet-dict-lowcard-reader (46d1fab9ab7fc93be24b998f9ddefce8da037f37) to a64d97a (merge-base) [diff](https://github.com/apache/arrow-rs/compare/a64d97ace046290d94dcd697cb03dc7ecf3cfdd3..46d1fab9ab7fc93be24b998f9ddefce8da037f37) <details><summary>Run configuration</summary> ```yaml run benchmark arrow_reader_string_encoding shards: 1 ``` </details> <details><summary>Details</summary> ``` group base changed ----- ---- ------- RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.00/len=24 2.47 1099.0±0.41µs 867.8 MElem/sec 1.00 445.1±1.32µs 2.1 GElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.00/len=8 2.47 1097.7±1.32µs 868.8 MElem/sec 1.00 444.7±0.61µs 2.1 GElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.50/len=24 1.56 1777.4±1.94µs 536.5 MElem/sec 1.00 1140.8±0.89µs 836.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=10/nulls=0.50/len=8 1.56 1775.9±2.16µs 537.0 MElem/sec 1.00 1139.1±0.48µs 837.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.00/len=24 2.30 1166.3±1.38µs 817.7 MElem/sec 1.00 506.5±0.37µs 1883.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.00/len=8 2.30 1167.8±0.34µs 816.7 MElem/sec 1.00 508.1±0.31µs 1876.8 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.50/len=24 1.54 1834.6±2.68µs 519.8 MElem/sec 1.00 1187.8±0.85µs 802.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=100/nulls=0.50/len=8 1.53 1827.5±2.50µs 521.8 MElem/sec 1.00 1192.2±0.47µs 799.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.00/len=24 2.09 1231.7±4.51µs 774.3 MElem/sec 1.00 590.5±0.26µs 1615.1 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.00/len=8 2.08 1224.8±4.30µs 778.6 MElem/sec 1.00 590.2±0.13µs 1616.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.50/len=24 1.51 1854.2±4.24µs 514.3 MElem/sec 1.00 1228.9±0.57µs 776.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=1000/nulls=0.50/len=8 1.51 1850.5±4.52µs 515.4 MElem/sec 1.00 1228.0±1.15µs 776.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.00/len=24 1.86 1382.3±3.98µs 689.9 MElem/sec 1.00 743.1±0.38µs 1283.4 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.00/len=8 1.89 1384.2±1.12µs 689.0 MElem/sec 1.00 731.1±3.66µs 1304.5 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.50/len=24 1.47 1980.1±4.69µs 481.6 MElem/sec 1.00 1344.8±1.15µs 709.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=1000000/card=20000/nulls=0.50/len=8 1.49 1983.4±1.20µs 480.8 MElem/sec 1.00 1333.7±3.74µs 715.0 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.00/len=24 2.51 5.6±0.01ms 853.6 MElem/sec 1.00 2.2±0.01ms 2.1 GElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.00/len=8 2.55 5.7±0.03ms 843.4 MElem/sec 1.00 2.2±0.00ms 2.1 GElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.50/len=24 1.56 9.0±0.01ms 528.7 MElem/sec 1.00 5.8±0.01ms 825.5 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=10/nulls=0.50/len=8 1.57 9.1±0.02ms 526.1 MElem/sec 1.00 5.8±0.01ms 825.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.00/len=24 2.33 5.9±0.02ms 801.5 MElem/sec 1.00 2.6±0.01ms 1869.8 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.00/len=8 2.34 5.9±0.02ms 801.4 MElem/sec 1.00 2.5±0.01ms 1876.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.50/len=24 1.54 9.3±0.02ms 511.1 MElem/sec 1.00 6.0±0.01ms 789.4 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=100/nulls=0.50/len=8 1.55 9.3±0.02ms 510.8 MElem/sec 1.00 6.0±0.01ms 790.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.00/len=24 2.11 6.2±0.03ms 764.4 MElem/sec 1.00 3.0±0.01ms 1609.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.00/len=8 2.12 6.3±0.03ms 761.2 MElem/sec 1.00 3.0±0.01ms 1612.7 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.50/len=24 1.51 9.4±0.03ms 507.9 MElem/sec 1.00 6.2±0.01ms 765.4 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=1000/nulls=0.50/len=8 1.52 9.4±0.03ms 505.3 MElem/sec 1.00 6.2±0.02ms 768.2 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.00/len=24 1.88 7.2±0.04ms 664.3 MElem/sec 1.00 3.8±0.04ms 1245.7 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.00/len=8 1.90 7.2±0.04ms 665.6 MElem/sec 1.00 3.8±0.05ms 1264.9 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.50/len=24 1.48 10.2±0.04ms 465.4 MElem/sec 1.00 6.9±0.06ms 686.6 MElem/sec RLE_DICTIONARY_read/Dictionary(Int32,Utf8)/rows=5000000/card=20000/nulls=0.50/len=8 1.49 10.1±0.04ms 469.9 MElem/sec 1.00 6.8±0.04ms 702.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.00/len=24 1.00 1012.0±0.42µs 942.3 MElem/sec 1.00 1012.8±0.62µs 941.6 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.00/len=8 1.00 1013.6±0.48µs 940.9 MElem/sec 1.00 1013.2±2.42µs 941.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.50/len=24 1.03 1415.0±1.13µs 674.0 MElem/sec 1.00 1379.3±0.78µs 691.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=10/nulls=0.50/len=8 1.03 1412.3±1.16µs 675.3 MElem/sec 1.00 1371.8±0.70µs 695.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.00/len=24 1.00 1079.8±0.34µs 883.2 MElem/sec 1.00 1075.1±0.88µs 887.1 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.00/len=8 1.01 1080.8±0.39µs 882.4 MElem/sec 1.00 1074.7±0.74µs 887.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.50/len=24 1.03 1451.1±0.52µs 657.2 MElem/sec 1.00 1408.3±1.44µs 677.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=100/nulls=0.50/len=8 1.03 1451.1±1.50µs 657.2 MElem/sec 1.00 1412.3±1.19µs 675.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.00/len=24 1.00 1154.8±0.96µs 825.9 MElem/sec 1.00 1151.4±0.53µs 828.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.00/len=8 1.00 1153.4±0.94µs 826.8 MElem/sec 1.00 1151.6±0.48µs 828.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.50/len=24 1.03 1494.2±2.65µs 638.3 MElem/sec 1.00 1454.0±0.83µs 655.9 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=1000/nulls=0.50/len=8 1.02 1487.8±1.34µs 641.0 MElem/sec 1.00 1454.3±0.57µs 655.7 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.00/len=24 1.00 1481.4±1.29µs 643.8 MElem/sec 1.01 1489.5±2.71µs 640.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.00/len=8 1.00 1478.1±1.76µs 645.2 MElem/sec 1.00 1482.3±1.04µs 643.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.50/len=24 1.02 1684.9±1.60µs 566.0 MElem/sec 1.00 1656.6±2.27µs 575.7 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=1000000/card=20000/nulls=0.50/len=8 1.02 1672.8±2.47µs 570.1 MElem/sec 1.00 1646.8±1.11µs 579.1 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.00/len=24 1.00 5.0±0.00ms 944.9 MElem/sec 1.00 5.1±0.00ms 941.9 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.00/len=8 1.00 5.1±0.01ms 942.7 MElem/sec 1.00 5.1±0.01ms 943.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.50/len=24 1.02 7.1±0.01ms 669.7 MElem/sec 1.00 7.0±0.01ms 683.2 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=10/nulls=0.50/len=8 1.02 7.2±0.01ms 666.7 MElem/sec 1.00 7.0±0.01ms 680.6 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.00/len=24 1.01 5.4±0.01ms 879.5 MElem/sec 1.00 5.4±0.01ms 887.0 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.00/len=8 1.01 5.4±0.01ms 880.1 MElem/sec 1.00 5.4±0.01ms 887.6 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.50/len=24 1.02 7.3±0.02ms 649.9 MElem/sec 1.00 7.2±0.01ms 661.5 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=100/nulls=0.50/len=8 1.02 7.4±0.01ms 645.2 MElem/sec 1.00 7.2±0.02ms 659.8 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.00/len=24 1.01 5.9±0.03ms 813.0 MElem/sec 1.00 5.8±0.03ms 817.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.00/len=8 1.00 5.9±0.02ms 814.6 MElem/sec 1.00 5.8±0.01ms 818.1 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.50/len=24 1.02 7.6±0.03ms 626.2 MElem/sec 1.00 7.5±0.02ms 638.3 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=1000/nulls=0.50/len=8 1.02 7.6±0.02ms 624.4 MElem/sec 1.00 7.5±0.02ms 639.9 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.00/len=24 1.00 8.2±0.10ms 581.7 MElem/sec 1.00 8.2±0.15ms 581.7 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.00/len=8 1.00 8.2±0.18ms 584.9 MElem/sec 1.02 8.3±0.09ms 574.4 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.50/len=24 1.03 9.0±0.03ms 529.3 MElem/sec 1.00 8.7±0.08ms 545.5 MElem/sec RLE_DICTIONARY_read/Utf8View/rows=5000000/card=20000/nulls=0.50/len=8 1.02 8.8±0.05ms 539.1 MElem/sec 1.00 8.7±0.08ms 547.9 MElem/sec ``` </details> <details><summary>Per-runner information</summary> <details><summary>arrow_reader_string_encoding — shard 1/1</summary> **Node:** gk3-benchmark-cluster-nap-1jjgtw9w-b324e59c-rjj2 **Instance:** c4a-highmem-16-lssd (12 vCPU / 65 GiB) **uname:** ```text Linux bench-c6051807101-3161-w4kfz 6.12.94+ #1 SMP Fri Aug 21 08:00:16 UTC 2026 aarch64 GNU/Linux ``` **BENCH_COMMAND:** ```sh cargo bench --features=arrow,async,test_common,experimental,object_store --bench arrow_reader_string_encoding ``` <details><summary>CPU Details (lscpu)</summary> ```text Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 615.1s | | Peak memory | 171.0 MiB | | Avg memory | 47.8 MiB | | CPU user | 612.6s | | CPU sys | 0.9s | | Peak spill | 0 B | **branch** | Metric | Value | |--------|-------| | Wall time | 620.1s | | Peak memory | 178.2 MiB | | Avg memory | 47.0 MiB | | CPU user | 612.9s | | CPU sys | 0.8s | | Peak spill | 0 B | </details> </details> </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner <!-- benchmark-request:6051807101:finish:352b8cb76ac5fb732f767fab08039c6e --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
