[
https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055499#comment-16055499
]
Liang-Chi Hsieh commented on SPARK-21134:
-----------------------------------------
Due to the discussion on the PR, we may remove CodegenFallback. So labeling
this as won't fix now.
> Codegen-only expressions should not be collapsed with upper CodegenFallback
> expression
> --------------------------------------------------------------------------------------
>
> Key: SPARK-21134
> URL: https://issues.apache.org/jira/browse/SPARK-21134
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.1.1
> Reporter: Liang-Chi Hsieh
>
> The rule {{CollapseProject}} in optimizer collapses lower and upper
> expressions if they have common expressions.
> We have seen a use case that a codegen-only expression has been collapsed
> with an upper {{CodegenFallback}} expression. Because all children
> expressions under {{CodegenFallback}} will be evaluated with non-codegen path
> {{eval}}, it causes an exception in runtime.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
