[
https://issues.apache.org/jira/browse/SPARK-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin resolved SPARK-15438.
---------------------------------
Resolution: Fixed
Fix Version/s: 2.0.0
> Improve the explain of whole-stage codegen
> ------------------------------------------
>
> Key: SPARK-15438
> URL: https://issues.apache.org/jira/browse/SPARK-15438
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Davies Liu
> Assignee: Davies Liu
> Fix For: 2.0.0
>
>
> Currently, the explain of a query with whole-stage codegen looks like this
> {code}
> >>> df = sqlCtx.range(1000);df2 =
> >>> sqlCtx.range(1000);df.join(pyspark.sql.functions.broadcast(df2),
> >>> 'id').explain()
> == Physical Plan ==
> WholeStageCodegen
> : +- Project [id#1L]
> : +- BroadcastHashJoin [id#1L], [id#4L], Inner, BuildRight, None
> : :- Range 0, 1, 4, 1000, [id#1L]
> : +- INPUT
> +- BroadcastExchange HashedRelationBroadcastMode(List(input[0, bigint]))
> +- WholeStageCodegen
> : +- Range 0, 1, 4, 1000, [id#4L]
> {code}
> The problem is that the plan looks much different than logical plan, make us
> hard to understand the plan (especially when the logical plan is not showed
> together).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
