GitHub user nchammas opened a pull request:
https://github.com/apache/spark/pull/4262
[EC2] Expose SSH failures after status checks pass
If there is some fatal problem with launching a cluster, `spark-ec2` just
hangs without giving the user useful feedback on what the problem is.
This PR exposes the output of the SSH calls to the user if the SSH test
fails during cluster launch for any reason but the instance status checks are
all green. It also removes the growing trail of dots while waiting in favor of
a fixed 3 dots.
For example:
```
$ ./ec2/spark-ec2 -k key -i /incorrect/path/identity.pem --instance-type
m3.medium --slaves 1 --zone us-east-1c launch "spark-test"
Setting up security groups...
Searching for existing cluster spark-test...
Spark AMI: ami-35b1885c
Launching instances...
Launched 1 slaves in us-east-1c, regid = r-7dadd096
Launched master in us-east-1c, regid = r-fcadd017
Waiting for cluster to enter 'ssh-ready' state...
Warning: SSH connection error. (This could be temporary.)
Host: 127.0.0.1
SSH return code: 255
SSH output: Warning: Identity file /incorrect/path/identity.pem not
accessible: No such file or directory.
Warning: Permanently added '127.0.0.1' (RSA) to the list of known hosts.
Permission denied (publickey).
```
This should give users enough information when some unrecoverable error
occurs during launch so they can know to abort the launch. This will help avoid
situations like the one [reported here](http://stackoverflow.com/q/28002443/),
where the user couldn't tell what the problem was because it was being hidden
by `spark-ec2`.
This is a usability improvement that should be backported to 1.2.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/nchammas/spark expose-ssh-failure
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/4262.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #4262
----
commit d4c5f438f4bb46d223f36f28c7394210c9d2fa2b
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-06T03:21:16Z
Merge pull request #6 from apache/master
merge upstream changes
commit 03180a4e9dc8f949b8d3372c54738547ca3813c1
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-10T23:39:14Z
Merge branch 'master' of github.com:nchammas/spark
commit 8051486bbfd13dbab17b30c89ef5b4ce49d3460b
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-16T02:22:18Z
Merge pull request #1 from apache/master
merge upstream changes
commit 0b47ca4b8c3497913c3eb5db3c30e63248491938
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-16T02:27:19Z
Merge branch 'master' of github.com:nchammas/spark
commit e33b9787d24c52dd33b71a83c42b0a8f7033ff5e
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-17T20:48:48Z
Merge pull request #2 from apache/master
merge upstream changes
commit ce1a3ebe63fc49e6ce17968f5b220122e3c1ff97
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-19T18:27:16Z
Merge pull request #3 from apache/master
merge upstream changes
commit 222ae4e313ad594673109ab2ee2eb56425afda34
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-23T17:16:48Z
Merge pull request #4 from apache/master
merge upstream changes
commit df33cbb0bc317774a78022840c1a346a904617f3
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-23T19:17:23Z
Merge pull request #5 from apache/master
merge upstream changes
commit 7b2e9712442ef1aaa0bce701e2a486f6a04e113c
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-26T20:53:55Z
Merge pull request #6 from apache/master
merge upstream changes
commit f47188329b388e878626cbfd05412500b63284e1
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-29T15:28:12Z
Merge pull request #7 from apache/master
merge upstream changes
commit c5d073d427b529ad53cb0c26961fe7cadfd873a2
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-30T17:41:03Z
Merge pull request #8 from apache/master
merge upstream changes
commit 088645af68f2ddde22f88a8dfb9aa10673d35b6a
Author: Nicholas Chammas <[email protected]>
Date: 2014-09-30T22:30:04Z
Merge pull request #9 from apache/master
merge upstream changes
commit 6b273648505c4dd31d7417952068053b6015fcc5
Author: Nicholas Chammas <[email protected]>
Date: 2014-10-06T21:00:36Z
Merge pull request #10 from apache/master
merge upstream changes
commit 410e75670d92f091e6a14f8fbae158d5ac0039bc
Author: Nicholas Chammas <[email protected]>
Date: 2014-10-08T01:06:32Z
Merge pull request #11 from apache/master
merge upstream changes
commit 0a0f2a0d39f008861dd60d25e60eb591dfd2c5e1
Author: Nicholas Chammas <[email protected]>
Date: 2014-10-29T02:35:23Z
Merge pull request #12 from apache/master
merge upstream changes
commit 25fd10b3ea6f0ae1d52412f644f120d542717816
Author: Nicholas Chammas <[email protected]>
Date: 2014-11-03T17:14:08Z
Merge pull request #13 from apache/master
merge upstream changes
commit f475dd50dd8a75703b0d921a8a5a5fba91eb68a9
Author: Nicholas Chammas <[email protected]>
Date: 2014-11-10T22:49:34Z
Merge pull request #14 from apache/master
merge upstream changes
commit 4e2c34379a60ae64b711bb31efa71133a5bd3bba
Author: Nicholas Chammas <[email protected]>
Date: 2014-12-02T17:55:51Z
Merge pull request #15 from apache/master
merge upstream changes
commit b9bde9800cf4412e15a1dfa91c6d9ef0a6686481
Author: Nicholas Chammas <[email protected]>
Date: 2014-12-08T19:39:17Z
Merge pull request #16 from apache/master
merge upstream changes
commit 6b70ba4cd620e85784f12f24cfef54df153a9637
Author: Nicholas Chammas <[email protected]>
Date: 2014-12-21T07:35:35Z
Merge pull request #18 from apache/master
merge upstream changes
commit e1bf63a0d2d9e0ce259bfbc3dca2f919fdbac746
Author: Nicholas Chammas <[email protected]>
Date: 2014-12-24T03:40:05Z
Merge pull request #19 from apache/master
merge upstream changes
commit aa7222c10d0a1861bb53285d1aa1daafb09984a0
Author: Nicholas Chammas <[email protected]>
Date: 2014-12-26T01:10:18Z
Merge pull request #20 from apache/master
merge upstream changes
commit d208eaeed8f6dfcbccc09a9db150f71c65d7703d
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-07T04:09:53Z
Merge pull request #21 from apache/master
merge upstream changes
commit 5985bb1de2ca8600e4baca3149faeec702eca5c4
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-07T21:32:40Z
Merge pull request #22 from apache/master
merge upstream
commit 32411971a0f5cfb17083acef2026585cda4dcf62
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-10T04:42:29Z
Merge pull request #23 from apache/master
merge upstream
commit 69a7dac4223bfe6f052c9f61052177f1c67bbdfa
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-23T22:44:19Z
Merge pull request #24 from apache/master
merge upstream
commit f293cf6ef7fcbd2fa5d309d5a95119f8b57f4840
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-28T20:53:01Z
Merge pull request #25 from apache/master
merge upstream
commit c109c8ef6dd0a7c97e0ce21e4c23aed0715d697f
Author: Nicholas Chammas <[email protected]>
Date: 2015-01-29T04:33:17Z
show SSH output after status check pass
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
