[
https://issues.apache.org/jira/browse/SPARK-34637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ke Jia updated SPARK-34637:
---------------------------
Description: We have supported DPP in AQE when the join is Broadcast hash
join before applying the AQE rules in SPARK-34168, which has some limitations.
It only apply DPP when the small table side executed firstly and then the big
table side can reuse the broadcast exchange in small table side. This Jira is
to address the above limitations and can apply the DPP when the broadcast
exchange can be reused.
> Support DPP in AQE when the boradcast exchange can reused
> ---------------------------------------------------------
>
> Key: SPARK-34637
> URL: https://issues.apache.org/jira/browse/SPARK-34637
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.1
> Reporter: Ke Jia
> Priority: Major
>
> We have supported DPP in AQE when the join is Broadcast hash join before
> applying the AQE rules in SPARK-34168, which has some limitations. It only
> apply DPP when the small table side executed firstly and then the big table
> side can reuse the broadcast exchange in small table side. This Jira is to
> address the above limitations and can apply the DPP when the broadcast
> exchange can be reused.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
