[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003536#comment-15003536 ]
Xiao Li commented on SPARK-11637: --------------------------------- https://github.com/apache/spark/pull/9343 has already fixed the problem. You can verify your issue using the latest master build or the nearly released 1.6 build. > Alias do not work with udf with * parameter > ------------------------------------------- > > Key: SPARK-11637 > URL: https://issues.apache.org/jira/browse/SPARK-11637 > Project: Spark > Issue Type: Bug > Components: SQL > Affects Versions: 1.5.0, 1.5.1, 1.5.2 > Reporter: Pierre Borckmans > > In Spark < 1.5.0, this used to work : > {code:java|title=Spark <1.5.0|borderStyle=solid} > scala> sqlContext.sql("select hash(*) as x from T") > res2: org.apache.spark.sql.DataFrame = [x: int] > {code} > From Spark 1.5.0+, it fails: > {code:java|title=Spark>=1.5.0|borderStyle=solid} > scala> sqlContext.sql("select hash(*) as x from T") > org.apache.spark.sql.AnalysisException: unresolved operator 'Project > ['hash(*) AS x#1]; > at > org.apache.spark.sql.catalyst.analysis.CheckAnalysis$class.failAnalysis(CheckAnalysis.scala:37) > at > org.apache.spark.sql.catalyst.analysis.Analyzer.failAnalysis(Analyzer.scala:44) > at > org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:174) > at > org.apache.spark.sql.catalyst.analysis.CheckAnalysis$$anonfun$checkAnalysis$1.apply(CheckAnalysis.scala:49) > at > org.apache.spark.sql.catalyst.trees.TreeNode.foreachUp(TreeNode.scala:103) > ... > {code} > This is not specific to the `hash` udf. It also applies to user defined > functions. > The `*` seems to be the issue. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org