Github user e-dorigatti commented on a diff in the pull request:
https://github.com/apache/spark/pull/21467#discussion_r192114498
--- Diff: python/pyspark/worker.py ---
@@ -69,6 +69,7 @@ def chain(f, g):
def wrap_udf(f, return_type):
+ f = fail_on_stopiteration(f)
--- End diff --
`wrap_grouped_map_pandas_udf` needs to call `argspec`, so we would need to
check `evalType` twice in `read_single_udf`. But it's possible, yea
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]