zwangsheng commented on PR #36358:
URL: https://github.com/apache/spark/pull/36358#issuecomment-1110650530
> You may use {{APPID}} as a placeholder in the template. See
https://github.com/apache/spark/pull/35704
I see. Thank you for your introduction!
Currently, I consider that shuffle skew caused by Kubernetes scheduling
occurs frequently during spark on kubernetes. If using Pod-template way, users
may need to know about this, rather than learn about it through Spark
configurations Doc. Can help alleviate the problem by turning on parameters
rather than learning and using Pod templates. This may make it difficult for
the user to ease the shuffle skew On Kubernetes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
