warrenzhu25 opened a new pull request, #41906:
URL: https://github.com/apache/spark/pull/41906

   ### What changes were proposed in this pull request?
   Only log unknown shuffle map output as error when shuffle migration disabled
   
   ### Why are the changes needed?
   When decommission and shuffle migration is enabled, there're lots of error 
message like `Asked to update map output for unknown shuffle` .
   
   As shuffle clean and unregister is done by `ContextCleaner` in an async way, 
when target block manager received the shuffle block from decommissioned block 
manager, then update shuffle location to map output tracker, but at that time, 
shuffle might have been unregistered. This should not consider as error.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Manually tested.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to