t;user@spark.apache.org<mailto:user@spark.apache.org>"
mailto:user@spark.apache.org>>
Subject: Re: cluster randomly re-starting jobs
Never used Ambari and I don't know if this is your problem, but I have seen
similar behavior. In my case, my application failed and Hadoop kicked off
Never used Ambari and I don't know if this is your problem, but I have seen
similar behavior. In my case, my application failed and Hadoop kicked off a
second attempt. I didn't realize this, but when I refreshed the Spark UI,
suddenly everything seemed reset! This is because the application ID is
p
Can you provide a bit more information ?
Release of Spark and YARN
Have you checked Spark UI / YARN job log to see if there is some clue ?
Cheers
On Mon, Mar 21, 2016 at 6:21 AM, Roberto Pagliari wrote:
> I noticed that sometimes the spark cluster seems to restart the job
> completely.
>
> In
I noticed that sometimes the spark cluster seems to restart the job completely.
In the Ambari UI (where I can check jobs/stages) everything that was done up to
a certain point is removed, and the job is restarted.
Does anyone know what the issue could be?
Thank you,
