Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21082#discussion_r184874826
--- Diff: python/pyspark/sql/functions.py ---
@@ -2301,10 +2301,12 @@ def pandas_udf(f=None, returnType=None,
functionType=None):
The returned scalar can be either a python primitive type, e.g.,
`int` or `float`
or a numpy data type, e.g., `numpy.int64` or `numpy.float64`.
- :class:`ArrayType`, :class:`MapType` and :class:`StructType` are
currently not supported as
- output types.
+ :class:`MapType` and :class:`StructType` are currently not
supported as output types.
--- End diff --
@icexelloss, actually should we keep this note? I think this is matched
with
https://spark.apache.org/docs/latest/sql-programming-guide.html#supported-sql-types
which we documented there and SQLConf.
Probably, just leaving a link could be fine. Removing out is okay to me too.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
