sqlwindspeaker opened a new pull request #30617:
URL: https://github.com/apache/spark/pull/30617


   ### What changes were proposed in this pull request?
   This change make InterruptedIOException to be treated as 
InterruptedException when closing YarnClientSchedulerBackend, which doesn't log 
error with "YARN application has exited unexpectedly xxx"
   
   
   ### Why are the changes needed?
   For YarnClient mode, when stopping YarnClientSchedulerBackend, it first 
tries to interrupt Yarn application monitor thread. In MonitorThread.run() it 
catches InterruptedException to gracefully response to stopping request.
   
   But client.monitorApplication method also throws InterruptedIOException when 
the hadoop rpc call is calling. In this case, MonitorThread will not know it is 
interrupted, a Yarn App failed is returned with "Failed to contact YARN for 
application xxxxx;  YARN application has exited unexpectedly with state xxxxx" 
is logged with error level. which confuse user a lot.
   
   
   ### Does this PR introduce _any_ user-facing change?
   Yes
   
   ### How was this patch tested?
   very simple patch, seems no need?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to