Github user icexelloss commented on a diff in the pull request:
https://github.com/apache/spark/pull/21467#discussion_r192116173
--- Diff: python/pyspark/worker.py ---
@@ -69,6 +69,7 @@ def chain(f, g):
def wrap_udf(f, return_type):
+ f = fail_on_stopiteration(f)
--- End diff --
Can we wrap `fail_on_stopiteration` after `wrap*_udf`?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
