gaogaotiantian commented on code in PR #53513:
URL: https://github.com/apache/spark/pull/53513#discussion_r2761371451
##########
python/pyspark/util.py:
##########
@@ -1008,10 +1014,21 @@ def wrapper(*args: Any, **kwargs: Any) -> Any:
return wrapper
+ @contextmanager
+ def enable_faulthandler(self, start_periodic_traceback: bool = True) ->
Iterator[None]:
Review Comment:
`start_periodic_traceback` does not really start periodic traceback. Maybe
that's a bad method name. It will check the environment variables and will only
start it if the env var indicates so.
The periodic traceback and faulthandler will not be disabled after
`worker.main` ends. I made this object re-entriable so it will only respect the
outmost decorator/context.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]