Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21383#discussion_r190666626 --- Diff: python/pyspark/sql/udf.py --- @@ -92,7 +92,7 @@ def __init__(self, func, raise TypeError( "Invalid evalType: evalType should be an int but is {}".format(evalType)) - self.func = func + self.func = fail_on_stopiteration(func) --- End diff -- see https://github.com/e-dorigatti/spark/blob/b0af18e400c01095dd87589260ce80e9712a9f07/python/pyspark/sql/udf.py#L175-L201
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org