[
https://issues.apache.org/jira/browse/SPARK-22404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16306392#comment-16306392
]
Imran Rashid commented on SPARK-22404:
--------------------------------------
can you provide a little more explanation for the point of this? how much time
does this save for you? What's the downside of an unmanaged AM? (AM failure
becomes fatal, but then again that would happen anyway if the driver failed.)
the idea makes sense, but the yarn interaction and client mode is already
pretty complicated so I'd like good justication for this
> Provide an option to use unmanaged AM in yarn-client mode
> ---------------------------------------------------------
>
> Key: SPARK-22404
> URL: https://issues.apache.org/jira/browse/SPARK-22404
> Project: Spark
> Issue Type: Improvement
> Components: YARN
> Affects Versions: 2.2.0
> Reporter: Devaraj K
>
> There was an issue SPARK-1200 to provide an option but was closed without
> fixing.
> Using an unmanaged AM in yarn-client mode would allow apps to start up
> faster, but not requiring the container launcher AM to be launched on the
> cluster.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]