Github user viirya commented on a diff in the pull request:
https://github.com/apache/spark/pull/21467#discussion_r192279606
--- Diff: python/pyspark/worker.py ---
@@ -140,15 +139,18 @@ def read_single_udf(pickleSer, infile, eval_type):
else:
row_func = chain(row_func, f)
+ func = fail_on_stopiteration(row_func)
--- End diff --
Add few comments for it?
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
