[
https://issues.apache.org/jira/browse/SPARK-22314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16211497#comment-16211497
]
Sean Owen commented on SPARK-22314:
-----------------------------------
If it's on the classpath, it's visible to the user. This is just two ways to
get a UDF on a classpath. I don't think this relates to what you're trying to
accomplish.
> Accessing Hive UDFs defined without 'USING JAR' from Spark
> -----------------------------------------------------------
>
> Key: SPARK-22314
> URL: https://issues.apache.org/jira/browse/SPARK-22314
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.2.0
> Reporter: Matyas Orhidi
>
> When defining UDF functions in Hive it is possible to load the UDF jar(s)
> from a shared location e.g. from hive.reloadable.aux.jars.path, and then use
> the CREATE FUNCTION statement:
> {{CREATE FUNCTION <your_function_name> AS '<fully_qualified_class_name>';}}
> These UDFs are not working from Spark unless you use the
> {{CREATE FUNCTION <your_function_name> AS '<fully_qualified_class_name>'
> USING JAR 'hdfs:///<path/to/jar/in/hdfs>';}}
> command to create the Hive UDF function.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
