Github user nchammas commented on the pull request:
https://github.com/apache/spark/pull/3195#issuecomment-63524432
`spark-ec2` currently blocks on SSH availability correctly, but it tests
SSH more often than is necessary. As [you suggested
here](https://github.com/apache/spark/pull/2339#issuecomment-55546927), this PR
[reintroduces](https://github.com/apache/spark/pull/3195/files#diff-ada66bbeb2f1327b508232ef6c3805a5R680)
a change that makes `spark-ec2` check the EC2 status checks _before_ trying
SSH. This change was already in #2339, but someone got dropped. I'm not sure
how.
Remember we were
[concerned](https://github.com/apache/spark/pull/2339#issuecomment-55481878)
about forking too many processes to test SSH. Without this patch, `spark-ec2`
tests SSH the moment the instances are marked as online. With this patch,
`spark-ec2` waits until the EC2 status checks additionally clear before testing
SSH.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
