Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/21383#discussion_r190666626
--- Diff: python/pyspark/sql/udf.py ---
@@ -92,7 +92,7 @@ def __init__(self, func,
raise TypeError(
"Invalid evalType: evalType should be an int but is
{}".format(evalType))
- self.func = func
+ self.func = fail_on_stopiteration(func)
--- End diff --
see
https://github.com/e-dorigatti/spark/blob/b0af18e400c01095dd87589260ce80e9712a9f07/python/pyspark/sql/udf.py#L175-L201
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
