[
https://issues.apache.org/jira/browse/SPARK-49004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Herman van Hövell resolved SPARK-49004.
---------------------------------------
Fix Version/s: 4.0.0
Resolution: Fixed
Issue resolved by pull request 47572
[https://github.com/apache/spark/pull/47572]
> Create a function lookup registry for non-sql functions
> -------------------------------------------------------
>
> Key: SPARK-49004
> URL: https://issues.apache.org/jira/browse/SPARK-49004
> Project: Spark
> Issue Type: New Feature
> Components: Connect, SQL
> Affects Versions: 4.0.0
> Reporter: Herman van Hövell
> Assignee: Herman van Hövell
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
>
> Create a dedicated function registry for Column API functions that are not
> supposed to be exposed through the regular SQL API.
>
> A list of names and expressions:
> * years -> org.apache.spark.sql.catalyst.expressions.Years
> * months -> org.apache.spark.sql.catalyst.expressions.Months
> * days -> org.apache.spark.sql.catalyst.expressions.Days
> * hours -> org.apache.spark.sql.catalyst.expressions.Hours
> * bucket -> org.apache.spark.sql.catalyst.expressions.Bucket
> * unwrap_udt -> org.apache.spark.sql.catalyst.expressions.UnwrapUDT
> * timestampadd -> org.apache.spark.sql.catalyst.expressions.TimestampAdd
> * timestampdiff -> org.apache.spark.sql.catalyst.expressions.TimestampDiff
> * collect_top_k ->
> org.apache.spark.sql.catalyst.expressions.aggregate.CollectTopK
> * product -> org.apache.spark.sql.catalyst.expressions.aggregate.Product
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
