That happens per session or if certain configs are changed in the session. On Mon, Aug 22, 2016 at 5:53 PM, Tao Li <t...@hortonworks.com> wrote:
> Hi, > > Looks like the Spark client (SparkClientImpl class) submits Sparks jobs to > the YARN cluster by forking a process and kicking off spark-submit script. > Are we provisioning new containers every time we submit a job? There could > be a perf hit by doing that. > > Thanks. >
