GitHub user squito opened a pull request:
https://github.com/apache/spark/pull/16376
[SPARK-18967][SCHEDULER] compute locality levels even if delay = 0
## What changes were proposed in this pull request?
Before this change, with delay scheduling off, spark would effectively
ignore locality preferences for bulk scheduling. With this change,
locality preferences are used when multiple offers are made
simultaneously.
## How was this patch tested?
Test case added which fails without this change. All unit tests run via
jenkins.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/squito/spark locality_without_delay
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16376.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16376
----
commit 341b73a9255bb159af82b855df1a628caf3ec152
Author: Imran Rashid <[email protected]>
Date: 2016-12-21T18:52:19Z
[SPARK-18967][SCHEDULER] compute locality levels even if delay = 0
Before this change, with delay scheduling off, spark would effectively
ignore locality preferences for bulk scheduling. This ensures that
locality preferences are used when multiple offers are made
simultaneously, and adds a test case for it.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
