I run the follwoing command and it correctly starts one head and one master but then it fails because it can't log onto the head with the ssh key. The wierd thing is that I can log onto the head with that same public key. (ssh -i myamazonkey.pem r...@ec2-54-86-3-208.compute-1.amazonaws.com)
Thanks in advance! $ spark-0.9.1-bin-hadoop2/ec2/spark-ec2 -k myamazonkey -i ~/myamazonkey.pem -s 1 launch spark-test-cluster Setting up security groups... Searching for existing cluster spark-test-cluster... Spark AMI: ami-5bb18832 Launching instances... Launched 1 slaves in us-east-1c, regid = r-8b73b4a8 Launched master in us-east-1c, regid = r-ea76b1c9 Waiting for instances to start up... Waiting 120 more seconds... Generating cluster's SSH key on master... ssh: connect to host ec2-54-86-3-208.compute-1.amazonaws.com port 22: Connection refused Error executing remote command, retrying after 30 seconds: Command '['ssh', '-o', 'StrictHostKeyChecking=no', '-i', '/home/ec2-user/myamazonkey.pem', '-t', '-t', u'r...@ec2-54-86-3-208.compute-1.amazonaws.com', "\n [ -f ~/.ssh/id_rsa ] ||\n (ssh-keygen -q -t rsa -N '' -f ~/.ssh/id_rsa &&\n cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys)\n "]' returned non-zero exit status 255 ssh: connect to host ec2-54-86-3-208.compute-1.amazonaws.com port 22: Connection refused Error executing remote command, retrying after 30 seconds: Command '['ssh', '-o', 'StrictHostKeyChecking=no', '-i', '/home/ec2-user/myamazonkey.pem', '-t', '-t', u'r...@ec2-54-86-3-208.compute-1.amazonaws.com', "\n [ -f ~/.ssh/id_rsa ] ||\n (ssh-keygen -q -t rsa -N '' -f ~/.ssh/id_rsa &&\n cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys)\n "]' returned non-zero exit status 255 ssh: connect to host ec2-54-86-3-208.compute-1.amazonaws.com port 22: Connection refused Error executing remote command, retrying after 30 seconds: Command '['ssh', '-o', 'StrictHostKeyChecking=no', '-i', '/home/ec2-user/myamazonkey.pem', '-t', '-t', u'r...@ec2-54-86-3-208.compute-1.amazonaws.com', "\n [ -f ~/.ssh/id_rsa ] ||\n (ssh-keygen -q -t rsa -N '' -f ~/.ssh/id_rsa &&\n cat ~/.ssh/id_rsa.pub >> ~/.ssh/authorized_keys)\n "]' returned non-zero exit status 255 ssh: connect to host ec2-54-86-3-208.compute-1.amazonaws.com port 22: Connection refused Error: Failed to SSH to remote host ec2-54-86-3-208.compute-1.amazonaws.com. Please check that you have provided the correct --identity-file and --key-pair parameters and try again.
