HyukjinKwon commented on a change in pull request #27466:
[SPARK-30722][PYTHON][DOCS] Update documentation for Pandas UDF with Python
type hints
URL: https://github.com/apache/spark/pull/27466#discussion_r375218796
##########
File path: python/pyspark/sql/udf.py
##########
@@ -414,6 +415,9 @@ def _test():
.appName("sql.udf tests")\
.getOrCreate()
globs['spark'] = spark
+ # Hack to skip the unit tests in register. These are currently being
tested in proper tests.
+ # We should reenable this test once we completely drop Python 2.
+ pyspark.sql.udf.register.__doc__ = ""
Review comment:
To doubly make sure, I tested that it doesn't affect the main codes:
```
>>> help(spark.udf.register)
```
```
Help on method register in module pyspark.sql.udf:
register(name, f, returnType=None) method of pyspark.sql.udf.UDFRegistration
instance
Register a Python function (including lambda function) or a user-defined
function
as a SQL function.
:param name: name of the user-defined function in SQL statements.
:param f: a Python function, or a user-defined function. The
user-defined function can
be either row-at-a-time or vectorized. See
:meth:`pyspark.sql.functions.udf` and
:meth:`pyspark.sql.functions.pandas_udf`.
:param returnType: the return type of the registered user-defined fun
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
