Github user foxish commented on the issue:
https://github.com/apache/spark/pull/19954
@mridulm We did have some discussions on resource localization at some
point. This is a powerful mechanism when coupled with a resource staging server
(in the future). There is a cost per-pod when using localization in this
manner, but there is an alternative - using a docker image baked with
dependencies accomplishes that, since k8s does node-level caching of the
downloaded images, so, one would pay the cost only once per node.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
