Chao Sun created SPARK-56842:
--------------------------------
Summary: Short-circuit AQE when materialized stages are empty
Key: SPARK-56842
URL: https://issues.apache.org/jira/browse/SPARK-56842
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 5.0.0
Reporter: Chao Sun
Adaptive execution can continue planning work after a materialized query stage
proves that a branch is empty, including plans wrapped by sort/project/columnar
conversion operators. This can leave obsolete exchange stages running and may
surface cancellation failures from stages that are no longer relevant to the
final plan.
This issue tracks preserving emptiness propagation through those wrappers,
handling aggregate row-count semantics correctly, and ignoring cancellation
failures from obsolete stages that AQE intentionally replaces.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
