Github user sryza commented on the pull request:
https://github.com/apache/spark/pull/6082#issuecomment-101816303
@tgravescs that was going to be my feedback as well. However, what about
situations where someone requests more containers than YARN can allocate? I
think this is a pretty reasonable thing to do because it's fairly cumbersome
for users to check the size of the YARN pool they're running and then
triangulate with their --executor-cores and --executor-memory to pick the exact
number of executors they're allowed. We would end up always heartbeating at
the fast rate.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
