Interesting, I run on my local one node cluster using apache hadoop
On Tue, Jul 15, 2014 at 7:55 AM, Jerry Lam wrote:
> For your information, the SparkSubmit runs at the host you executed the
> spark-submit shell script (which in turns invoke the SparkSubmit program).
> Since you are running in
For your information, the SparkSubmit runs at the host you executed the
spark-submit shell script (which in turns invoke the SparkSubmit program).
Since you are running in yarn-cluster mode, the SparkSubmit program just
reported the status of the job submitted to Yarn. So when you killed the
Applic
when I use yarn application -kill, both SparkSubmit and ApplicationMaster
are killed. I also checked jps at the machine that has SparkSubmit running,
it is terminated as well. Sorry, I cannot reproduce it.
On Mon, Jul 14, 2014 at 7:36 PM, hsy...@gmail.com wrote:
> Before "yarn application -kill
Before "yarn application -kill" If you do jps You'll have a list
of SparkSubmit and ApplicationMaster
After you use yarn applicaton -kill you only kill the SparkSubmit
On Mon, Jul 14, 2014 at 4:29 PM, Jerry Lam wrote:
> Then yarn application -kill appid should work. This is what I did 2 hours
Then yarn application -kill appid should work. This is what I did 2 hours ago.
Sorry I cannot provide more help.
Sent from my iPhone
> On 14 Jul, 2014, at 6:05 pm, "hsy...@gmail.com" wrote:
>
> yarn-cluster
>
>
>> On Mon, Jul 14, 2014 at 2:44 PM, Jerry Lam wrote:
>> Hi Siyuan,
>>
>> I won
yarn-cluster
On Mon, Jul 14, 2014 at 2:44 PM, Jerry Lam wrote:
> Hi Siyuan,
>
> I wonder if you --master yarn-cluster or yarn-client?
>
> Best Regards,
>
> Jerry
>
>
> On Mon, Jul 14, 2014 at 5:08 PM, hsy...@gmail.com
> wrote:
>
>> Hi all,
>>
>> A newbie question, I start a spark yarn applicat
Hi Siyuan,
I wonder if you --master yarn-cluster or yarn-client?
Best Regards,
Jerry
On Mon, Jul 14, 2014 at 5:08 PM, hsy...@gmail.com wrote:
> Hi all,
>
> A newbie question, I start a spark yarn application through spark-submit
>
> How do I kill this app. I can kill the yarn app by "ya
Hi all,
A newbie question, I start a spark yarn application through spark-submit
How do I kill this app. I can kill the yarn app by "yarn application -kill
appid" but the application master is still running. What's the proper way
to shutdown the entire app?
Best,
Siyuan
