the issue if it’s the same use case :)
Also – make sure that you have resources available in YARN, if the cluster is
shared.
-adrian
From: Alexander Pivovarov
Date: Tuesday, September 29, 2015 at 1:38 AM
To: "user@spark.apache.org<mailto:user@spark.apache.org>"
Subject: Does YARN st
Hello Everyone
I use Spark on YARN on EMR-4
The spark program which I run has several jobs/stages and run for about 10
hours
During the execution some executors might fail for some reason.
BUT I do not see that new executor are started in place of the failed ones
So, what I see in spark UI is
