Github user kxepal commented on a diff in the pull request:
https://github.com/apache/spark/pull/17671#discussion_r154892410
--- Diff: python/pyspark/worker.py ---
@@ -160,6 +166,24 @@ def read_udfs(pickleSer, infile, eval_type):
def main(infile, outfile):
+ if raven:
--- End diff --
Ah, I get your point. Well, indeed, it's possible to move that branch into
the `except Exception` branch. In the end, if exception happens, pyspark worker
will get terminated, so raven client is for one time usage and no need to keep
it around all the time.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
