GitHub user guoxiaolongzte opened a pull request:
https://github.com/apache/spark/pull/19351
[SPARK-22127][CORE]The Master Register Application Function requires an
warn log to increase the waiting status
## What changes were proposed in this pull request?
The Master register application function requires an alarm log to increase
the waiting status.
When I create a spark application, I apply for the resources to reach the
ceiling, the current Worker does not have enough resources to allocate
Executor, this time spark application state is waiting.
But I can not know from the spark master log this situation, which led to
my positioning problems difficult, I mistakenly thought that the master or
worker process dead.
All that I added to the warting state of the warn log, which better helps
us locate this kind of problem.
1.WAITING app:
2.master log:
## How was this patch tested?
manual tests
Please review http://spark.apache.org/contributing.html before opening a
pull request.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/guoxiaolongzte/spark SPARK-22127
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/19351.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #19351
----
commit 3a756caf6c9015f32068b8c28c65ade151411392
Author: guoxiaolong <[email protected]>
Date: 2017-09-26T11:37:40Z
[SPARK-22127]The Master Register Application Function requires an warn log
to increase the waiting status
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
