gedeh opened a new pull request, #42870:
URL: https://github.com/apache/spark/pull/42870

   ### What changes were proposed in this pull request?
   
   Uptake `--bind-address` parameter in `YarnCoarseGrainedExecutorBackend` when 
launching new container in Yarn cluster. This PR also ensure `YarnAllocator` 
uses default hostname when its not configured.
   
   ### Why are the changes needed?
   We've came across https://github.com/istio/istio/issues/27900 with Spark 
running on Yarn in Istio enabled Kubernetes cluster. Previous PR 
https://github.com/apache/spark/pull/32633 is not merged because Spark 2.4 was 
EOL.
   
   ### Does this PR introduce any user-facing change?
   Yes, new config specifically for Yarn cluster mode is added and relevant doc 
is updated.
   
   ### How was this patch tested?
   Tested in Kubenetes with Istio and added tests to `YarnAllocatorSuite`
   
   Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to