Zhen Wang created SPARK-48817:
---------------------------------
Summary: MultiInsert is split to multiple sql executions,
resulting in no exchange reuse
Key: SPARK-48817
URL: https://issues.apache.org/jira/browse/SPARK-48817
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.5.1, 4.0.0
Reporter: Zhen Wang
MultiInsert is split to multiple sql executions, resulting in no exchange reuse.
Reproduce sql:
{code:java}
create table wangzhen_t1(c1 int);
create table wangzhen_t2(c1 int);
create table wangzhen_t3(c1 int);from (select /*+ REPARTITION(3) */ c1 from
wangzhen_t1)
insert overwrite table wangzhen_t2 select c1
insert overwrite table wangzhen_t3 select c1; {code}
In Spark 3.1, there is only one SQL execution and there is a reuse exchange.
!image-2024-07-05-14-55-41-889.png!
However, in Spark 3.5, it was split to multiple executions and there was no
ReuseExchange.
!image-2024-07-05-14-58-45-544.png!
!image-2024-07-05-14-58-01-236.png!!image-2024-07-05-14-58-10-089.png!!image-2024-07-05-14-58-29-826.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
