[
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust resolved SPARK-6586.
-------------------------------------
Resolution: Not a Problem
You can already get the original plan from a DataFrame:
{{df.queryExecution.logical}}.
> Add the capability of retrieving original logical plan of DataFrame
> -------------------------------------------------------------------
>
> Key: SPARK-6586
> URL: https://issues.apache.org/jira/browse/SPARK-6586
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Liang-Chi Hsieh
> Priority: Minor
>
> In order to solve a bug, since #5217, {{DataFrame}} now uses analyzed plan
> instead of logical plan. However, by doing that we can't know the logical
> plan of a {{DataFrame}}. But it might be still useful and important to
> retrieve the original logical plan in some use cases.
> In this pr, we introduce the capability of retrieving original logical plan
> of {{DataFrame}}.
> The approach is that we add an {{analyzed}} variable to {{LogicalPlan}}. Once
> {{Analyzer}} finishes analysis, it sets {{analyzed}} of {{LogicalPlan}} as
> {{true}}. In {{QueryExecution}}, we keep the original logical plan in the
> analyzed plan. In {{LogicalPlan}}, a method {{originalPlan}} is added to
> recursively replace the analyzed logical plan with original logical plan and
> retrieve it.
> Besides the capability of retrieving original logical plan, this modification
> also can avoid do plan analysis if it is already analyzed.
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
