[GitHub] spark issue #22876: [SPARK-25869] [YARN] the original diagnostics is missing...
Github user Cangyl commented on the issue:
https://github.com/apache/spark/pull/22876
What changes were proposed in this pull request?
When set configs in yarn as below:
yarn.scheduler.minimum-allocation-mb 50mb
yarn.scheduler.increment-allocation-mb 50mb
And submit spark on yarn job using the command below:
In ApplicationMaster.scala, when a spark applicaiton failed in the
LastAttempt, it will try to unregister itself from yarn resourcemanager.
Normally, during ${spark.yarn.report.interval}, the unregister event will be
sent to resourcemanager before the failed container event, and overwrite the
container failded diagnostics with "Shutdown hook called before final status
was reported." This is the prolem code in Application.scala
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #22876: [SPARK-25869] [YARN] the original diagnostics is missing...
Github user ouyangxiaochen commented on the issue: https://github.com/apache/spark/pull/22876 @srowen CC --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #22876: [SPARK-25869] [YARN] the original diagnostics is missing...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22876 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #22876: [SPARK-25869] [YARN] the original diagnostics is missing...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22876 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark issue #22876: [SPARK-25869] [YARN] the original diagnostics is missing...
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/22876 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
