[
https://issues.apache.org/jira/browse/SPARK-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933353#comment-14933353
]
Chris Heller commented on SPARK-8734:
-------------------------------------
For something like marathon, it models parameters as a list of key, value pairs
-- so it nicely sidesteps this issue.
Looking at the current documentation for `docker run` even with this approach
of embedding part of the parameter in the property name won't work for the
`--security-opt` setting:
https://docs.docker.com/reference/run/#security-configuration
It sounds like special casing parameters which cannot be modeled as a single
property is the only approach that can support all possible parameters without
resorting to data embeddings or reworking the entire Spark conf model to not
use Java property files!
> Expose all Mesos DockerInfo options to Spark
> --------------------------------------------
>
> Key: SPARK-8734
> URL: https://issues.apache.org/jira/browse/SPARK-8734
> Project: Spark
> Issue Type: Improvement
> Components: Mesos
> Reporter: Chris Heller
> Priority: Minor
> Attachments: network.diff
>
>
> SPARK-2691 only exposed a few options from the DockerInfo message. It would
> be reasonable to expose them all, especially given one can now specify
> arbitrary parameters to docker.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
