tgravescs commented on PR #36207: URL: https://github.com/apache/spark/pull/36207#issuecomment-1177732373
That doesn't really answer my question. I get that it won't clean the staging directory, but I'm less concerned with that then it not retrying when it should. In your case, what is the yarn final application status when the unregister fails? the unregister is what gives YARN the final status of the application, without that is YARN assuming its successful if the application master goes away? For unmanaged AM case the final status may not be success, so what happens there? Note, I also have issues with the description here, in the jira you should describe the problem, not point to where you think there is a problem. So if you see an exception state that, put the exception in there, description on reproducing, etc. Then we can look for solution or what causes it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
