zhuqi-lucas commented on PR #16771:
URL: https://github.com/apache/datafusion/pull/16771#issuecomment-3086549129
> 🤖: Benchmark completed
>
> Details
>
> ```
> group main
reduce_expr_size
> ----- ----
----------------
> logical_aggregate_with_join 1.01 619.3±3.99µs
? ?/sec 1.00 615.6±2.26µs ? ?/sec
> logical_select_all_from_1000 1.00 11.2±0.05ms
? ?/sec 1.00 11.2±0.04ms ? ?/sec
> logical_select_one_from_700 1.00 405.8±1.41µs
? ?/sec 1.00 406.5±2.02µs ? ?/sec
> logical_trivial_join_high_numbered_columns 1.00 367.0±7.23µs
? ?/sec 1.00 367.9±2.19µs ? ?/sec
> logical_trivial_join_low_numbered_columns 1.00 351.9±1.27µs
? ?/sec 1.00 352.4±2.69µs ? ?/sec
> physical_intersection 1.00 823.7±13.80µs
? ?/sec 1.00 823.3±7.95µs ? ?/sec
> physical_join_consider_sort 1.00 1352.6±13.56µs
? ?/sec 1.00 1354.6±6.63µs ? ?/sec
> physical_join_distinct 1.00 342.1±1.02µs
? ?/sec 1.00 342.6±3.35µs ? ?/sec
> physical_many_self_joins 1.00 10.0±0.05ms
? ?/sec 1.00 10.0±0.04ms ? ?/sec
> physical_plan_clickbench_all 1.01 188.7±1.84ms
? ?/sec 1.00 187.7±3.23ms ? ?/sec
> physical_plan_clickbench_q1 1.00 2.5±0.02ms
? ?/sec 1.05 2.6±0.02ms ? ?/sec
> physical_plan_clickbench_q10 1.00 3.3±0.03ms
? ?/sec 1.04 3.5±0.04ms ? ?/sec
> physical_plan_clickbench_q11 1.00 3.5±0.03ms
? ?/sec 1.03 3.6±0.05ms ? ?/sec
> physical_plan_clickbench_q12 1.00 3.6±0.03ms
? ?/sec 1.04 3.8±0.04ms ? ?/sec
> physical_plan_clickbench_q13 1.00 3.3±0.03ms
? ?/sec 1.03 3.4±0.04ms ? ?/sec
> physical_plan_clickbench_q14 1.00 3.5±0.03ms
? ?/sec 1.03 3.6±0.07ms ? ?/sec
> physical_plan_clickbench_q15 1.00 3.4±0.04ms
? ?/sec 1.01 3.5±0.03ms ? ?/sec
> physical_plan_clickbench_q16 1.00 3.2±0.04ms
? ?/sec 1.02 3.3±0.02ms ? ?/sec
> physical_plan_clickbench_q17 1.00 3.3±0.03ms
? ?/sec 1.02 3.4±0.04ms ? ?/sec
> physical_plan_clickbench_q18 1.00 2.9±0.02ms
? ?/sec 1.03 2.9±0.02ms ? ?/sec
> physical_plan_clickbench_q19 1.00 3.7±0.03ms
? ?/sec 1.03 3.8±0.03ms ? ?/sec
> physical_plan_clickbench_q2 1.00 2.9±0.02ms
? ?/sec 1.04 3.0±0.07ms ? ?/sec
> physical_plan_clickbench_q20 1.00 2.6±0.02ms
? ?/sec 1.02 2.7±0.03ms ? ?/sec
> physical_plan_clickbench_q21 1.00 2.9±0.02ms
? ?/sec 1.03 3.0±0.03ms ? ?/sec
> physical_plan_clickbench_q22 1.00 3.5±0.03ms
? ?/sec 1.02 3.6±0.03ms ? ?/sec
> physical_plan_clickbench_q23 1.00 3.8±0.04ms
? ?/sec 1.02 3.8±0.03ms ? ?/sec
> physical_plan_clickbench_q24 1.00 4.3±0.04ms
? ?/sec 1.01 4.3±0.03ms ? ?/sec
> physical_plan_clickbench_q25 1.00 3.0±0.03ms
? ?/sec 1.03 3.1±0.03ms ? ?/sec
> physical_plan_clickbench_q26 1.00 2.9±0.03ms
? ?/sec 1.03 3.0±0.03ms ? ?/sec
> physical_plan_clickbench_q27 1.00 3.0±0.03ms
? ?/sec 1.02 3.1±0.03ms ? ?/sec
> physical_plan_clickbench_q28 1.00 3.8±0.12ms
? ?/sec 1.01 3.9±0.04ms ? ?/sec
> physical_plan_clickbench_q29 1.00 4.4±0.04ms
? ?/sec 1.02 4.5±0.04ms ? ?/sec
> physical_plan_clickbench_q3 1.00 2.8±0.03ms
? ?/sec 1.03 2.9±0.03ms ? ?/sec
> physical_plan_clickbench_q30 1.00 12.8±0.12ms
? ?/sec 1.00 12.7±0.15ms ? ?/sec
> physical_plan_clickbench_q31 1.00 3.8±0.03ms
? ?/sec 1.02 3.8±0.03ms ? ?/sec
> physical_plan_clickbench_q32 1.00 3.8±0.04ms
? ?/sec 1.02 3.9±0.04ms ? ?/sec
> physical_plan_clickbench_q33 1.00 3.3±0.03ms
? ?/sec 1.02 3.4±0.03ms ? ?/sec
> physical_plan_clickbench_q34 1.00 3.0±0.03ms
? ?/sec 1.03 3.1±0.02ms ? ?/sec
> physical_plan_clickbench_q35 1.00 3.1±0.03ms
? ?/sec 1.02 3.2±0.03ms ? ?/sec
> physical_plan_clickbench_q36 1.00 3.8±0.03ms
? ?/sec 1.02 3.9±0.03ms ? ?/sec
> physical_plan_clickbench_q37 1.00 3.8±0.06ms
? ?/sec 1.01 3.9±0.04ms ? ?/sec
> physical_plan_clickbench_q38 1.00 3.8±0.04ms
? ?/sec 1.02 3.9±0.03ms ? ?/sec
> physical_plan_clickbench_q39 1.00 3.6±0.03ms
? ?/sec 1.02 3.7±0.03ms ? ?/sec
> physical_plan_clickbench_q4 1.00 2.6±0.05ms
? ?/sec 1.03 2.6±0.02ms ? ?/sec
> physical_plan_clickbench_q40 1.00 4.2±0.05ms
? ?/sec 1.02 4.3±0.05ms ? ?/sec
> physical_plan_clickbench_q41 1.00 3.8±0.04ms
? ?/sec 1.02 3.9±0.03ms ? ?/sec
> physical_plan_clickbench_q42 1.00 3.7±0.03ms
? ?/sec 1.02 3.8±0.04ms ? ?/sec
> physical_plan_clickbench_q43 1.00 4.1±0.03ms
? ?/sec 1.03 4.2±0.03ms ? ?/sec
> physical_plan_clickbench_q44 1.00 2.7±0.02ms
? ?/sec 1.03 2.8±0.02ms ? ?/sec
> physical_plan_clickbench_q45 1.00 2.7±0.02ms
? ?/sec 1.03 2.8±0.03ms ? ?/sec
> physical_plan_clickbench_q46 1.00 3.1±0.03ms
? ?/sec 1.02 3.2±0.04ms ? ?/sec
> physical_plan_clickbench_q47 1.00 3.7±0.04ms
? ?/sec 1.02 3.8±0.05ms ? ?/sec
> physical_plan_clickbench_q48 1.00 4.3±0.03ms
? ?/sec 1.02 4.4±0.04ms ? ?/sec
> physical_plan_clickbench_q49 1.00 4.6±0.04ms
? ?/sec 1.02 4.7±0.05ms ? ?/sec
> physical_plan_clickbench_q5 1.00 2.8±0.02ms
? ?/sec 1.03 2.8±0.02ms ? ?/sec
> physical_plan_clickbench_q50 1.00 4.1±0.04ms
? ?/sec 1.01 4.1±0.03ms ? ?/sec
> physical_plan_clickbench_q51 1.00 3.2±0.03ms
? ?/sec 1.02 3.3±0.03ms ? ?/sec
> physical_plan_clickbench_q6 1.00 2.8±0.03ms
? ?/sec 1.02 2.9±0.03ms ? ?/sec
> physical_plan_clickbench_q7 1.00 2.5±0.02ms
? ?/sec 1.05 2.6±0.02ms ? ?/sec
> physical_plan_clickbench_q8 1.00 3.3±0.03ms
? ?/sec 1.05 3.5±0.05ms ? ?/sec
> physical_plan_clickbench_q9 1.00 3.2±0.04ms
? ?/sec 1.04 3.3±0.04ms ? ?/sec
> physical_plan_tpcds_all 1.01 1031.8±3.36ms
? ?/sec 1.00 1021.7±3.66ms ? ?/sec
> physical_plan_tpch_all 1.01 62.2±0.27ms
? ?/sec 1.00 61.7±0.30ms ? ?/sec
> physical_plan_tpch_q1 1.01 2.0±0.01ms
? ?/sec 1.00 2.0±0.01ms ? ?/sec
> physical_plan_tpch_q10 1.01 3.8±0.02ms
? ?/sec 1.00 3.8±0.02ms ? ?/sec
> physical_plan_tpch_q11 1.01 3.2±0.02ms
? ?/sec 1.00 3.2±0.01ms ? ?/sec
> physical_plan_tpch_q12 1.01 1777.4±9.12µs
? ?/sec 1.00 1766.5±7.68µs ? ?/sec
> physical_plan_tpch_q13 1.00 1445.9±5.98µs
? ?/sec 1.00 1445.9±6.51µs ? ?/sec
> physical_plan_tpch_q14 1.00 1919.2±7.27µs
? ?/sec 1.00 1914.0±8.26µs ? ?/sec
> physical_plan_tpch_q16 1.01 2.4±0.01ms
? ?/sec 1.00 2.4±0.01ms ? ?/sec
> physical_plan_tpch_q17 1.00 2.4±0.01ms
? ?/sec 1.00 2.4±0.01ms ? ?/sec
> physical_plan_tpch_q18 1.00 2.7±0.01ms
? ?/sec 1.00 2.6±0.02ms ? ?/sec
> physical_plan_tpch_q19 1.02 3.2±0.01ms
? ?/sec 1.00 3.1±0.01ms ? ?/sec
> physical_plan_tpch_q2 1.01 5.5±0.03ms
? ?/sec 1.00 5.4±0.02ms ? ?/sec
> physical_plan_tpch_q20 1.01 3.1±0.01ms
? ?/sec 1.00 3.1±0.01ms ? ?/sec
> physical_plan_tpch_q21 1.00 4.1±0.02ms
? ?/sec 1.00 4.0±0.02ms ? ?/sec
> physical_plan_tpch_q22 1.01 2.7±0.01ms
? ?/sec 1.00 2.7±0.01ms ? ?/sec
> physical_plan_tpch_q3 1.00 2.5±0.01ms
? ?/sec 1.00 2.5±0.01ms ? ?/sec
> physical_plan_tpch_q4 1.00 1512.3±7.03µs
? ?/sec 1.00 1511.6±8.29µs ? ?/sec
> physical_plan_tpch_q5 1.00 3.1±0.01ms
? ?/sec 1.00 3.1±0.01ms ? ?/sec
> physical_plan_tpch_q6 1.00 852.0±6.30µs
? ?/sec 1.00 851.5±5.11µs ? ?/sec
> physical_plan_tpch_q7 1.01 4.2±0.02ms
? ?/sec 1.00 4.2±0.02ms ? ?/sec
> physical_plan_tpch_q8 1.01 5.2±0.02ms
? ?/sec 1.00 5.1±0.03ms ? ?/sec
> physical_plan_tpch_q9 1.00 4.1±0.02ms
? ?/sec 1.00 4.1±0.02ms ? ?/sec
> physical_select_aggregates_from_200 1.01 17.7±0.08ms
? ?/sec 1.00 17.5±0.07ms ? ?/sec
> physical_select_all_from_1000 1.00 24.6±0.07ms
? ?/sec 1.00 24.6±0.14ms ? ?/sec
> physical_select_one_from_700 1.00 1034.5±4.94µs
? ?/sec 1.00 1036.4±5.79µs ? ?/sec
> physical_sorted_union_orderby 1.00 41.7±0.28ms
? ?/sec 1.00 41.6±0.31ms ? ?/sec
> physical_theta_join_consider_sort 1.00 1729.3±7.23µs
? ?/sec 1.00 1735.2±20.95µs ? ?/sec
> physical_unnest_to_join 1.00 1282.8±8.18µs
? ?/sec 1.00 1281.4±8.05µs ? ?/sec
> with_param_values_many_columns 1.03 129.1±0.88µs
? ?/sec 1.00 125.5±0.66µs ? ?/sec
> ```
The result is bad, no performance gain from only OuterReferenceColumn
changing to Box, so i guess the improvement coming from Alias changing to Box? 🤔
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
