Parth Chandra created SPARK-47289:
-------------------------------------
Summary: Allow extensions to log extended information in explain
plan
Key: SPARK-47289
URL: https://issues.apache.org/jira/browse/SPARK-47289
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 4.0.0
Reporter: Parth Chandra
With session extensions, Spark planning can be extended to apply additional
rules and modify the execution plan. If an extension replaces a node in the
plan, the new node will be displayed in the plan. However, it is sometimes
useful for extensions provided extended information to the end user to explain
the impact of the extension. For instance an extension may automatically
enable/disable some feature that it provides and can provide this extended
information in the plan.
The proposal is to optionally turn on extended plan information from
extensions. Extensions can add additional planning information via a new
interface that internally uses a new TreeNodeTag, say 'explainPlan'.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
