yeshengm commented on pull request #24595: URL: https://github.com/apache/spark/pull/24595#issuecomment-715140507
@jiangxb1987 Just out of curiosity, the timeout mechanism was added because we have no way to track the lineage of such broadcast sub job right? Even if the "main" RDD action was cancelled, these broadcast jobs running in other threads will just keep running until it fails or timed out (which was added in this diff). ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
