RE: IF statement doesn't work in Spark-SQL?

[Wang, Daoyuan]

Hi Xuelin,

What version of Spark are you using?

Thanks,
Daoyuan

From: Xuelin Cao [mailto:xuelincao2...@gmail.com]
Sent: Tuesday, January 20, 2015 5:22 PM
To: User
Subject: IF statement doesn't work in Spark-SQL?


Hi,

      I'm trying to migrate some hive scripts to Spark-SQL. However, I found 
some statement is incompatible in Spark-sql.

      Here is my SQL. And the same SQL works fine in HIVE environment.

    SELECT
      if(ad_user_id>1000, 1000, ad_user_id) as user_id
    FROM
      ad_search_keywords

     What I found is, the parser reports error on the "if" statement:

No function to evaluate expression. type: AttributeReference, tree: ad_user_id#4


     Anyone have any idea about this?