HyukjinKwon opened a new pull request, #39916: URL: https://github.com/apache/spark/pull/39916
### What changes were proposed in this pull request? This PR proposes to remove `SparkSession.register_udf` and `pyspark.sql.connect.function_builder`. ### Why are the changes needed? - For API parity w/ regular PySpark. - They have to be implemented via `SparkSession.udf` (SPARK-41843). - For non-registered Python and Pandas UDFs, they are implemented at SPARK-42124 and SPARK-42125. - We implemented all functions so we do not need `pyspark.sql.connect.function_builder` workaround anymore. ### Does this PR introduce _any_ user-facing change? No to end users. Yee to the dev because it removes an API `SparkSession.register_udf` and `pyspark.sql.connect.function_builder`. ### How was this patch tested? CI in this PR should verify them -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
