adriangbot commented on PR #21128: URL: https://github.com/apache/datafusion/pull/21128#issuecomment-4148657367
🤖 Criterion benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/21128#issuecomment-4148567065) **Instance:** `c4a-highmem-16` (12 vCPU / 65 GiB) <details><summary>CPU Details (lscpu)</summary> ``` Architecture: aarch64 CPU op-mode(s): 64-bit Byte Order: Little Endian CPU(s): 16 On-line CPU(s) list: 0-15 Vendor ID: ARM Model name: Neoverse-V2 Model: 1 Thread(s) per core: 1 Core(s) per cluster: 16 Socket(s): - Cluster(s): 1 Stepping: r0p1 BogoMIPS: 2000.00 Flags: fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm sb paca pacg dcpodp sve2 sveaes svepmull svebitperm svesha3 svesm4 flagm2 frint svei8mm svebf16 i8mm bf16 dgh rng bti L1d cache: 1 MiB (16 instances) L1i cache: 1 MiB (16 instances) L2 cache: 32 MiB (16 instances) L3 cache: 80 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-15 Vulnerability Gather data sampling: Not affected Vulnerability Indirect target selection: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Reg file data sampling: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Not affected Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl Vulnerability Spectre v1: Mitigation; __user pointer sanitization Vulnerability Spectre v2: Mitigation; CSV2, BHB Vulnerability Srbds: Not affected Vulnerability Tsa: Not affected Vulnerability Tsx async abort: Not affected Vulnerability Vmscape: Not affected ``` </details> <details><summary>Details</summary> <p> ``` group adamg_optimizer-memory-optimizations main ----- ------------------------------------ ---- logical_aggregate_with_join 1.05 453.7±1.33µs ? ?/sec 1.00 432.7±2.28µs ? ?/sec logical_plan_struct_join_agg_sort 1.00 170.4±0.90µs ? ?/sec 1.00 171.2±3.52µs ? ?/sec logical_select_all_from_1000 1.04 8.3±0.03ms ? ?/sec 1.00 7.9±0.04ms ? ?/sec logical_select_one_from_700 1.02 324.5±1.63µs ? ?/sec 1.00 317.9±1.89µs ? ?/sec logical_trivial_join_high_numbered_columns 1.03 270.1±0.87µs ? ?/sec 1.00 261.7±0.72µs ? ?/sec logical_trivial_join_low_numbered_columns 1.03 257.2±0.79µs ? ?/sec 1.00 249.4±0.62µs ? ?/sec physical_intersection 1.01 602.6±1.97µs ? ?/sec 1.00 596.0±2.24µs ? ?/sec physical_join_consider_sort 1.02 1035.8±4.23µs ? ?/sec 1.00 1018.8±3.45µs ? ?/sec physical_join_distinct 1.02 250.8±0.74µs ? ?/sec 1.00 245.3±0.57µs ? ?/sec physical_many_self_joins 1.03 7.7±0.10ms ? ?/sec 1.00 7.5±0.10ms ? ?/sec physical_plan_clickbench_all 1.00 110.1±4.90ms ? ?/sec 1.04 114.1±4.29ms ? ?/sec physical_plan_clickbench_q1 1.00 1108.7±21.47µs ? ?/sec 1.00 1110.1±18.39µs ? ?/sec physical_plan_clickbench_q10 1.00 1821.7±76.67µs ? ?/sec 1.01 1843.9±76.77µs ? ?/sec physical_plan_clickbench_q11 1.00 1891.8±85.97µs ? ?/sec 1.01 1906.8±85.10µs ? ?/sec physical_plan_clickbench_q12 1.00 1990.1±105.93µs ? ?/sec 1.01 2.0±0.10ms ? ?/sec physical_plan_clickbench_q13 1.01 1767.1±71.69µs ? ?/sec 1.00 1744.3±64.02µs ? ?/sec physical_plan_clickbench_q14 1.00 1924.3±70.86µs ? ?/sec 1.01 1950.3±48.04µs ? ?/sec physical_plan_clickbench_q15 1.01 1825.6±88.16µs ? ?/sec 1.00 1807.4±71.81µs ? ?/sec physical_plan_clickbench_q16 1.00 1525.3±47.08µs ? ?/sec 1.00 1521.0±41.74µs ? ?/sec physical_plan_clickbench_q17 1.00 1572.5±50.46µs ? ?/sec 1.01 1592.5±54.24µs ? ?/sec physical_plan_clickbench_q18 1.02 1433.9±36.15µs ? ?/sec 1.00 1403.8±35.27µs ? ?/sec physical_plan_clickbench_q19 1.00 1839.6±74.99µs ? ?/sec 1.03 1894.3±60.35µs ? ?/sec physical_plan_clickbench_q2 1.00 1446.2±43.74µs ? ?/sec 1.01 1463.1±45.18µs ? ?/sec physical_plan_clickbench_q20 1.00 1160.8±23.39µs ? ?/sec 1.00 1159.6±18.96µs ? ?/sec physical_plan_clickbench_q21 1.00 1455.2±40.23µs ? ?/sec 1.00 1457.5±40.43µs ? ?/sec physical_plan_clickbench_q22 1.00 1894.1±90.76µs ? ?/sec 1.01 1912.7±88.25µs ? ?/sec physical_plan_clickbench_q23 1.04 2.2±0.06ms ? ?/sec 1.00 2.1±0.10ms ? ?/sec physical_plan_clickbench_q24 1.00 3.0±0.15ms ? ?/sec 1.06 3.2±0.04ms ? ?/sec physical_plan_clickbench_q25 1.00 1550.3±45.04µs ? ?/sec 1.00 1544.1±39.31µs ? ?/sec physical_plan_clickbench_q26 1.02 1422.9±36.53µs ? ?/sec 1.00 1388.8±34.21µs ? ?/sec physical_plan_clickbench_q27 1.01 1572.6±54.27µs ? ?/sec 1.00 1563.1±42.34µs ? ?/sec physical_plan_clickbench_q28 1.00 2.1±0.12ms ? ?/sec 1.02 2.1±0.13ms ? ?/sec physical_plan_clickbench_q29 1.00 2.3±0.12ms ? ?/sec 1.05 2.4±0.14ms ? ?/sec physical_plan_clickbench_q3 1.00 1410.6±45.54µs ? ?/sec 1.00 1417.2±32.51µs ? ?/sec physical_plan_clickbench_q30 1.00 16.3±0.31ms ? ?/sec 1.02 16.7±0.21ms ? ?/sec physical_plan_clickbench_q31 1.00 2.2±0.13ms ? ?/sec 1.02 2.2±0.14ms ? ?/sec physical_plan_clickbench_q32 1.00 2.2±0.13ms ? ?/sec 1.03 2.2±0.13ms ? ?/sec physical_plan_clickbench_q33 1.00 1810.8±86.66µs ? ?/sec 1.02 1854.1±88.58µs ? ?/sec physical_plan_clickbench_q34 1.01 1550.9±41.76µs ? ?/sec 1.00 1540.8±46.74µs ? ?/sec physical_plan_clickbench_q35 1.00 1605.7±56.21µs ? ?/sec 1.04 1668.5±33.35µs ? ?/sec physical_plan_clickbench_q36 1.00 1957.1±96.94µs ? ?/sec 1.01 1976.8±95.52µs ? ?/sec physical_plan_clickbench_q37 1.00 2.3±0.14ms ? ?/sec 1.00 2.3±0.14ms ? ?/sec physical_plan_clickbench_q38 1.00 2.3±0.15ms ? ?/sec 1.01 2.3±0.14ms ? ?/sec physical_plan_clickbench_q39 1.03 2.3±0.12ms ? ?/sec 1.00 2.2±0.13ms ? ?/sec physical_plan_clickbench_q4 1.00 1215.1±26.66µs ? ?/sec 1.01 1224.8±13.11µs ? ?/sec physical_plan_clickbench_q40 1.00 2.7±0.17ms ? ?/sec 1.01 2.8±0.15ms ? ?/sec physical_plan_clickbench_q41 1.00 2.3±0.14ms ? ?/sec 1.04 2.4±0.07ms ? ?/sec physical_plan_clickbench_q42 1.00 2.3±0.14ms ? ?/sec 1.01 2.3±0.14ms ? ?/sec physical_plan_clickbench_q43 1.00 2.5±0.16ms ? ?/sec 1.00 2.5±0.16ms ? ?/sec physical_plan_clickbench_q44 1.01 1323.9±36.27µs ? ?/sec 1.00 1305.5±26.50µs ? ?/sec physical_plan_clickbench_q45 1.04 1358.7±12.47µs ? ?/sec 1.00 1304.5±30.52µs ? ?/sec physical_plan_clickbench_q46 1.00 1663.9±57.25µs ? ?/sec 1.04 1725.8±51.16µs ? ?/sec physical_plan_clickbench_q47 1.00 2.4±0.14ms ? ?/sec 1.03 2.4±0.14ms ? ?/sec physical_plan_clickbench_q48 1.00 2.4±0.15ms ? ?/sec 1.02 2.5±0.15ms ? ?/sec physical_plan_clickbench_q49 1.00 2.6±0.17ms ? ?/sec 1.02 2.7±0.18ms ? ?/sec physical_plan_clickbench_q5 1.00 1338.7±31.39µs ? ?/sec 1.02 1369.7±32.20µs ? ?/sec physical_plan_clickbench_q50 1.02 2.6±0.17ms ? ?/sec 1.00 2.6±0.17ms ? ?/sec physical_plan_clickbench_q51 1.00 1785.1±53.84µs ? ?/sec 1.01 1811.4±70.34µs ? ?/sec physical_plan_clickbench_q6 1.00 1352.8±37.88µs ? ?/sec 1.00 1346.5±30.93µs ? ?/sec physical_plan_clickbench_q7 1.00 1129.2±25.77µs ? ?/sec 1.00 1130.0±19.44µs ? ?/sec physical_plan_clickbench_q8 1.02 1627.7±62.39µs ? ?/sec 1.00 1600.9±51.85µs ? ?/sec physical_plan_clickbench_q9 1.00 1694.2±35.38µs ? ?/sec 1.03 1736.8±43.78µs ? ?/sec physical_plan_struct_join_agg_sort 1.00 1293.1±9.25µs ? ?/sec 1.03 1335.3±10.88µs ? ?/sec physical_plan_tpcds_all 1.00 745.2±9.45ms ? ?/sec 1.07 795.9±10.79ms ? ?/sec physical_plan_tpch_all 1.00 47.8±1.08ms ? ?/sec 1.02 48.9±1.35ms ? ?/sec physical_plan_tpch_q1 1.00 1529.7±7.78µs ? ?/sec 1.01 1545.0±7.96µs ? ?/sec physical_plan_tpch_q10 1.00 2.8±0.07ms ? ?/sec 1.05 2.9±0.08ms ? ?/sec physical_plan_tpch_q11 1.00 2.5±0.05ms ? ?/sec 1.02 2.6±0.07ms ? ?/sec physical_plan_tpch_q12 1.00 1286.4±5.75µs ? ?/sec 1.03 1324.9±8.05µs ? ?/sec physical_plan_tpch_q13 1.00 993.1±4.65µs ? ?/sec 1.02 1012.5±6.00µs ? ?/sec physical_plan_tpch_q14 1.00 1318.5±9.18µs ? ?/sec 1.01 1335.0±10.46µs ? ?/sec physical_plan_tpch_q16 1.00 1668.8±18.86µs ? ?/sec 1.04 1734.0±22.51µs ? ?/sec physical_plan_tpch_q17 1.00 1799.3±26.30µs ? ?/sec 1.04 1877.8±27.67µs ? ?/sec physical_plan_tpch_q18 1.00 1932.1±21.18µs ? ?/sec 1.07 2.1±0.03ms ? ?/sec physical_plan_tpch_q19 1.00 2.5±0.06ms ? ?/sec 1.03 2.6±0.06ms ? ?/sec physical_plan_tpch_q2 1.00 4.3±0.13ms ? ?/sec 1.05 4.5±0.13ms ? ?/sec physical_plan_tpch_q20 1.00 2.3±0.06ms ? ?/sec 1.03 2.3±0.06ms ? ?/sec physical_plan_tpch_q21 1.00 3.0±0.08ms ? ?/sec 1.07 3.2±0.10ms ? ?/sec physical_plan_tpch_q22 1.00 2.1±0.05ms ? ?/sec 1.02 2.1±0.06ms ? ?/sec physical_plan_tpch_q3 1.00 1884.0±25.43µs ? ?/sec 1.05 1970.9±30.69µs ? ?/sec physical_plan_tpch_q4 1.00 1031.0±5.10µs ? ?/sec 1.04 1070.1±6.31µs ? ?/sec physical_plan_tpch_q5 1.00 2.4±0.05ms ? ?/sec 1.06 2.6±0.06ms ? ?/sec physical_plan_tpch_q6 1.00 636.8±2.20µs ? ?/sec 1.02 648.3±5.46µs ? ?/sec physical_plan_tpch_q7 1.00 3.0±0.09ms ? ?/sec 1.09 3.3±0.12ms ? ?/sec physical_plan_tpch_q8 1.00 3.9±0.14ms ? ?/sec 1.08 4.3±0.16ms ? ?/sec physical_plan_tpch_q9 1.00 2.9±0.08ms ? ?/sec 1.06 3.1±0.09ms ? ?/sec physical_select_aggregates_from_200 1.00 14.6±0.15ms ? ?/sec 1.00 14.6±0.15ms ? ?/sec physical_select_all_from_1000 1.02 18.2±0.10ms ? ?/sec 1.00 17.9±0.08ms ? ?/sec physical_select_one_from_700 1.04 801.2±2.24µs ? ?/sec 1.00 773.8±2.46µs ? ?/sec physical_sorted_union_order_by_10_int64 1.00 4.6±0.09ms ? ?/sec 1.02 4.7±0.09ms ? ?/sec physical_sorted_union_order_by_10_uint64 1.00 11.4±0.16ms ? ?/sec 1.04 11.9±0.16ms ? ?/sec physical_sorted_union_order_by_50_int64 1.00 111.5±1.99ms ? ?/sec 1.03 114.5±2.07ms ? ?/sec physical_sorted_union_order_by_50_uint64 1.00 623.1±13.03ms ? ?/sec 1.06 661.4±12.13ms ? ?/sec physical_theta_join_consider_sort 1.00 1083.8±3.34µs ? ?/sec 1.24 1344.7±4.92µs ? ?/sec physical_unnest_to_join 1.00 1244.3±9.56µs ? ?/sec 1.10 1371.8±8.17µs ? ?/sec physical_window_function_partition_by_12_on_values 1.00 716.6±2.47µs ? ?/sec 1.02 733.6±2.00µs ? ?/sec physical_window_function_partition_by_30_on_values 1.00 1426.6±4.86µs ? ?/sec 1.02 1453.6±6.86µs ? ?/sec physical_window_function_partition_by_4_on_values 1.00 434.9±1.78µs ? ?/sec 1.04 450.7±5.00µs ? ?/sec physical_window_function_partition_by_7_on_values 1.00 542.0±2.01µs ? ?/sec 1.02 553.6±6.29µs ? ?/sec physical_window_function_partition_by_8_on_values 1.00 588.4±3.09µs ? ?/sec 1.00 588.3±1.68µs ? ?/sec with_param_values_many_columns 1.01 467.7±2.07µs ? ?/sec 1.00 464.3±3.05µs ? ?/sec ``` </p> </details> <details><summary>Resource Usage</summary> **base (merge-base)** | Metric | Value | |--------|-------| | Wall time | 1264.5s | | Peak memory | 18.5 GiB | | Avg memory | 18.5 GiB | | CPU user | 1501.3s | | CPU sys | 1.7s | | Disk read | 0 B | | Disk write | 574.3 MiB | **branch** | Metric | Value | |--------|-------| | Wall time | 1271.3s | | Peak memory | 18.5 GiB | | Avg memory | 18.5 GiB | | CPU user | 1510.2s | | CPU sys | 1.4s | | Disk read | 0 B | | Disk write | 25.0 MiB | </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
