GitHub user vanzin opened a pull request:
https://github.com/apache/spark/pull/7431
[SPARK-8297] [YARN] Scheduler backend is not notified in case node fails
in YARN
This change adds code to notify the scheduler backend when a container dies
in YARN.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/vanzin/spark SPARK-8297
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7431.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7431
----
commit a3a0f016e409026805c3960063a708ffbc3e2488
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-06T19:41:33Z
Fix SPARK-8297
commit 9ee1307ea2c6b498625145d224ce57049acad038
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-06T19:41:33Z
Fix SPARK-8297
commit bbf8811470cbab58e84ba82b704e717e641fea7b
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-06T22:22:03Z
Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into
fix_yarn_scheduler_bug
commit 62ad0cc1d67272002c7c68a49035c4079a38cc2a
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-06T22:22:03Z
Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into
fix_yarn_scheduler_bug
commit 362d64aed76943acc8a71ba822dc97d24e411e72
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-06T22:23:16Z
Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into
fix_yarn_scheduler_bug
commit 9218fcc6f87c5eb0ea2f3e3f4f3ea60cab7cfaa8
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-07T02:33:28Z
Fix failing testcase
commit e1b00673876f99217661758c2afba8d5da470308
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-07T02:33:28Z
Fix failing testcase, fix merge issue from our 1.3 -> master
commit 687790f64d3052e04a8ee73d1494a4b1b8b8a3f2
Author: Mridul Muralidharan <[email protected]>
Date: 2015-07-07T22:28:46Z
Merge branch 'fix_yarn_scheduler_bug' of github.com:mridulm/spark into
fix_yarn_scheduler_bug
commit 8855b97b4c42d08c308ea08ccebfb7fb0064576c
Author: Marcelo Vanzin <[email protected]>
Date: 2015-07-15T18:56:19Z
Merge remote-tracking branch 'mridul/fix_yarn_scheduler_bug' into SPARK-8297
commit 04dc11200b87b87ac53d371319ee494726f87923
Author: Marcelo Vanzin <[email protected]>
Date: 2015-07-15T20:48:12Z
Use driver <-> AM communication to send "remove executor" request.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
