Github user shivaram commented on the pull request:
https://github.com/apache/spark/pull/3195#issuecomment-63551750
Yeah this makes sense, thanks for clarifying.
One thing I am still thinking about is if it makes sense to do constant
poll vs. linear back-off. From what I can see we make the EC2 status checks
now every 5 seconds. I think that should be fine, though in the past I have run
into cases where EC2 requests get rate-limited and start failing.
@JoshRosen any other thoughts ?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
