[ https://issues.apache.org/jira/browse/SPARK-21134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16055499#comment-16055499 ]
Liang-Chi Hsieh commented on SPARK-21134: ----------------------------------------- Due to the discussion on the PR, we may remove CodegenFallback. So labeling this as won't fix now. > Codegen-only expressions should not be collapsed with upper CodegenFallback > expression > -------------------------------------------------------------------------------------- > > Key: SPARK-21134 > URL: https://issues.apache.org/jira/browse/SPARK-21134 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.1.1 > Reporter: Liang-Chi Hsieh > > The rule {{CollapseProject}} in optimizer collapses lower and upper > expressions if they have common expressions. > We have seen a use case that a codegen-only expression has been collapsed > with an upper {{CodegenFallback}} expression. Because all children > expressions under {{CodegenFallback}} will be evaluated with non-codegen path > {{eval}}, it causes an exception in runtime. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org