[ 
https://issues.apache.org/jira/browse/SPARK-6586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14386009#comment-14386009
 ] 

Liang-Chi Hsieh edited comment on SPARK-6586 at 3/29/15 11:24 PM:
------------------------------------------------------------------

Not true. Because DataFrame now is given analyzed plan after its many 
operations, {{df.queryExecution.logical}} is analyzed plan instead of the 
original logical plan.

You can check the pr #5217 for the modification.


was (Author: viirya):
Not true. Because DataFrame now is given analyzed plan after its many 
operations, {{df.queryExecution.logical}} is analyzed plan instead of the 
original logical plan.

> Add the capability of retrieving original logical plan of DataFrame
> -------------------------------------------------------------------
>
>                 Key: SPARK-6586
>                 URL: https://issues.apache.org/jira/browse/SPARK-6586
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>            Reporter: Liang-Chi Hsieh
>            Priority: Minor
>
> In order to solve a bug, since #5217, {{DataFrame}} now uses analyzed plan 
> instead of logical plan. However, by doing that we can't know the logical 
> plan of a {{DataFrame}}. But it might be still useful and important to 
> retrieve the original logical plan in some use cases.
> In this pr, we introduce the capability of retrieving original logical plan 
> of {{DataFrame}}.
> The approach is that we add an {{analyzed}} variable to {{LogicalPlan}}. Once 
> {{Analyzer}} finishes analysis, it sets {{analyzed}} of {{LogicalPlan}} as 
> {{true}}.  In {{QueryExecution}}, we keep the original logical plan in the 
> analyzed plan. In {{LogicalPlan}}, a method {{originalPlan}} is added to 
> recursively replace the analyzed logical plan with original logical plan and 
> retrieve it.
> Besides the capability of retrieving original logical plan, this modification 
> also can avoid do plan analysis if it is already analyzed.
>  



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to