Github user holdenk commented on a diff in the pull request:
https://github.com/apache/spark/pull/17671#discussion_r154874847
--- Diff: python/pyspark/worker.py ---
@@ -160,6 +166,24 @@ def read_udfs(pickleSer, infile, eval_type):
def main(infile, outfile):
+ if raven:
--- End diff --
This adds overhead to all instances but we only seem to use this if an
exception is thrown (or does the raven client record other information if its
set up?)
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
