[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-21 Thread Wenchen Fan (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wenchen Fan updated SPARK-34421:

Fix Version/s: 3.0.3

> Custom functions can't be used in temporary views with CTEs
> ---
>
> Key: SPARK-34421
> URL: https://issues.apache.org/jira/browse/SPARK-34421
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.1.0
> Environment: Databricks Runtime 8.0
>Reporter: Lauri Koobas
>Assignee: Peter Toth
>Priority: Blocker
> Fix For: 3.1.1, 3.0.3
>
>
> The following query works in Spark 3.0 not Spark 3.1.
>   
>  Start with:
>  {{spark.udf.registerJavaFunction("custom_func", 
> "com.stuff.path.custom_func", LongType())}}
>   
>  Works: * {{select custom_func()}}
>  * {{create temporary view blaah as select custom_func()}}
>  * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
>  {{create temporary view blaah as with step_1 as ( select custom_func() ) 
> select * from step_1}}
>   
>  followed by:
>  {{select * from blaah}}
>   
>  Error:
>  {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
> '}}{{com.stuff.path.custom_func}}{{';}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-19 Thread Wenchen Fan (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wenchen Fan updated SPARK-34421:

Description: 
The following query works in Spark 3.0 not Spark 3.1.
  
 Start with:
 {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", 
LongType())}}
  
 Works: * {{select custom_func()}}
 * {{create temporary view blaah as select custom_func()}}
 * {{with step_1 as ( select custom_func() ) select * from step_1}}

Broken:
 {{create temporary view blaah as with step_1 as ( select custom_func() ) 
select * from step_1}}
  
 followed by:
 {{select * from blaah}}
  
 Error:
 {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
'}}{{com.stuff.path.custom_func}}{{';}}

  was:
Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is Spark 
3.1.
 
Start with:
{{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", 
LongType())}}
 
Works: * {{select custom_func()}}
 * {{create temporary view blaah as select custom_func()}}
 * {{with step_1 as ( select custom_func() ) select * from step_1}}


Broken:
{{create temporary view blaah as with step_1 as ( select custom_func() ) select 
* from step_1}}
 
followed by:
{{select * from blaah}}
 
Error:
{{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
'}}{{com.stuff.path.custom_func}}{{';}}


> Custom functions can't be used in temporary views with CTEs
> ---
>
> Key: SPARK-34421
> URL: https://issues.apache.org/jira/browse/SPARK-34421
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.1.0
> Environment: Databricks Runtime 8.0
>Reporter: Lauri Koobas
>Assignee: Peter Toth
>Priority: Blocker
> Fix For: 3.1.1
>
>
> The following query works in Spark 3.0 not Spark 3.1.
>   
>  Start with:
>  {{spark.udf.registerJavaFunction("custom_func", 
> "com.stuff.path.custom_func", LongType())}}
>   
>  Works: * {{select custom_func()}}
>  * {{create temporary view blaah as select custom_func()}}
>  * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
>  {{create temporary view blaah as with step_1 as ( select custom_func() ) 
> select * from step_1}}
>   
>  followed by:
>  {{select * from blaah}}
>   
>  Error:
>  {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
> '}}{{com.stuff.path.custom_func}}{{';}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Li updated SPARK-34421:

Target Version/s: 3.1.0

> Custom functions can't be used in temporary views with CTEs
> ---
>
> Key: SPARK-34421
> URL: https://issues.apache.org/jira/browse/SPARK-34421
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.1.0
> Environment: Databricks Runtime 8.0
>Reporter: Lauri Koobas
>Priority: Blocker
>
> Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is 
> Spark 3.1.
>  
> Start with:
> {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", 
> LongType())}}
>  
> Works: * {{select custom_func()}}
>  * {{create temporary view blaah as select custom_func()}}
>  * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
> {{create temporary view blaah as with step_1 as ( select custom_func() ) 
> select * from step_1}}
>  
> followed by:
> {{select * from blaah}}
>  
> Error:
> {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
> '}}{{com.stuff.path.custom_func}}{{';}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

[jira] [Updated] (SPARK-34421) Custom functions can't be used in temporary views with CTEs

2021-02-11 Thread Xiao Li (Jira) 


 [ 
https://issues.apache.org/jira/browse/SPARK-34421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiao Li updated SPARK-34421:

Priority: Blocker  (was: Major)

> Custom functions can't be used in temporary views with CTEs
> ---
>
> Key: SPARK-34421
> URL: https://issues.apache.org/jira/browse/SPARK-34421
> Project: Spark
>  Issue Type: Bug
>  Components: SQL
>Affects Versions: 3.1.0
> Environment: Databricks Runtime 8.0
>Reporter: Lauri Koobas
>Priority: Blocker
>
> Works in DBR 7.4, which is Spark 3.0.1. Breaks in DBR8.0(beta), which is 
> Spark 3.1.
>  
> Start with:
> {{spark.udf.registerJavaFunction("custom_func", "com.stuff.path.custom_func", 
> LongType())}}
>  
> Works: * {{select custom_func()}}
>  * {{create temporary view blaah as select custom_func()}}
>  * {{with step_1 as ( select custom_func() ) select * from step_1}}
> Broken:
> {{create temporary view blaah as with step_1 as ( select custom_func() ) 
> select * from step_1}}
>  
> followed by:
> {{select * from blaah}}
>  
> Error:
> {{Error in SQL statement: AnalysisException: No handler for UDF/UDAF/UDTF 
> '}}{{com.stuff.path.custom_func}}{{';}}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org