Github user kxepal commented on a diff in the pull request:
https://github.com/apache/spark/pull/17671#discussion_r154886723
--- Diff: python/pyspark/worker.py ---
@@ -160,6 +166,24 @@ def read_udfs(pickleSer, infile, eval_type):
def main(infile, outfile):
+ if raven:
--- End diff --
This adds tiny overhead for worker startup, but not such to care about. The
main overhead comes on exception catch and send it to Sentry (HTTP request and
traceback formation and etc.), but at that moment you don't actually care about
speed since code on worker is already broken and won't be executed anymore.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
