marin-ma opened a new issue, #7015: URL: https://github.com/apache/incubator-gluten/issues/7015
### Description Currently, the loaded native udf will be registered into Spark's FunctionRegistry to make the udf pass SQL analysis. However, the registration is opaque to the users, also it's not the way to use Java UDF in spark. The native udf framework should be improved to only allow the native udf usable by explicitly registering the function through `CREATE TEMPORARY FUNCTION`. This approach not only expose the udf registration process to users, it also guarantee there's an available Java version UDF in case of fallback. At runtime, native UDFs should be registered alongside their Java implementations via `CREATE TEMPORARY FUNCTION`. Once registered, Gluten can parse and offload these UDFs to Velox during execution, meanwhile ensuring proper fallback to Java UDFs when necessary. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
