XiDuo You created SPARK-42101:
---------------------------------
Summary: Wrap InMemoryTableScanExec + AQE with QueryStage
Key: SPARK-42101
URL: https://issues.apache.org/jira/browse/SPARK-42101
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.4.0
Reporter: XiDuo You
The first access to the cached plan which is enable AQE is tricky. Currently,
we can not preverse it's output partitioning and ordering.
The whole query plan also missed lots of optimization in AQE framework. Wrap
InMemoryTableScanExec + AQE to query stage can resolve all these issues.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]