Github user tgravescs commented on the pull request:
https://github.com/apache/spark/pull/6082#issuecomment-101815176
so do we really want the backoff here? It complicates the logic and
makes it unpredictable as to when exactly it heartbeats. It also becomes
useless very quickly. If I just get in a queue that doesn't have space
immediately then I stop asking quicker but I still needs containers.
It seems to me if we just have one for when we want containers and one for
when we don't it should be good. If after that we still run into problems we
can revisit it. Also having YARN tell us when to backoff would be best:
https://issues.apache.org/jira/browse/YARN-3630
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
