Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/22620#discussion_r222698014
--- Diff: python/pyspark/sql/udf.py ---
@@ -310,9 +319,11 @@ def register(self, name, f, returnType=None):
"Invalid returnType: data type can not be specified
when f is"
"a user-defined function, but got %s." % returnType)
if f.evalType not in [PythonEvalType.SQL_BATCHED_UDF,
- PythonEvalType.SQL_SCALAR_PANDAS_UDF]:
+ PythonEvalType.SQL_SCALAR_PANDAS_UDF,
+
PythonEvalType.SQL_GROUPED_AGG_PANDAS_UDF]:
--- End diff --
I opened https://issues.apache.org/jira/browse/SPARK-25640 to track this.
To be clear, this is transparent to end users, but I agree it can be
confusing to developers.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
