[
https://issues.apache.org/jira/browse/SPARK-15271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-15271.
-------------------------------
Resolution: Fixed
Fix Version/s: 2.1.0
Issue resolved by pull request 13051
[https://github.com/apache/spark/pull/13051]
> Allow force pulling executor docker images
> ------------------------------------------
>
> Key: SPARK-15271
> URL: https://issues.apache.org/jira/browse/SPARK-15271
> Project: Spark
> Issue Type: New Feature
> Components: Mesos
> Affects Versions: 1.6.1
> Reporter: Philipp Hoffmann
> Fix For: 2.1.0
>
>
> Mesos agents by default will not pull docker images which are cached locally
> already.
> Because of this, in order to run a mutable tag (like {{...:latest}}) from the
> current version on the docker repository you have to explicitly tell the
> Mesos agent to pull the image (force pull). Otherwise the Mesos agent will
> run an old (cached version).
> The feature for force pulling the image was introduced in Mesos 0.22:
> https://github.com/apache/mesos/commit/8682569df528717ff5efb64da26b1b49c39c4efd
> This ticket is about making use of this feature in Spark in order to force
> Mesos agents to pull the executors docker image.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
