Github user tdas commented on the pull request:
https://github.com/apache/spark/pull/9075#issuecomment-148657044
What is the implication of this bug in case for the scheduling? We are
trying to evenly distribute receivers to executors. But if we set the
preferredLocations to only the granularity of hosts, then the following could
happen. Two executors can be in the same host (through YARN). We set the
preferred locations for two receivers for that same host even though we want
them to be in two different executors. It may so happen that both executors get
scheduled at the same executor. Isnt it?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
