Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/19505#discussion_r144915012
--- Diff: python/pyspark/sql/functions.py ---
@@ -2038,13 +2038,19 @@ def _wrap_function(sc, func, returnType):
sc.pythonVer, broadcast_vars,
sc._javaAccumulator)
+class PythonUdfType(object):
--- End diff --
Could you also add the descriptions about these three UDF types?
- NORMAL_UDF: row-based UDFs
- PANDAS_UDF: single-row vectorized UDFs
- PANDAS_GROUPED_UDF: grouped vectorized UDFs
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
