[
https://issues.apache.org/jira/browse/SPARK-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698516#comment-14698516
]
Kai Sasaki commented on SPARK-10002:
------------------------------------
[~deepalib] Can you login via SSH not ping? Ping does not confirm the state of
SSH port. So it might be the problem of security group.
> SSH problem during Setup of Spark(1.3.0) cluster on EC2
> -------------------------------------------------------
>
> Key: SPARK-10002
> URL: https://issues.apache.org/jira/browse/SPARK-10002
> Project: Spark
> Issue Type: Bug
> Components: EC2
> Affects Versions: 1.3.0
> Environment: EC2, SPARK 1.3.0 cluster setup in vpc/subnet.
> Reporter: Deepali Bhandari
>
> Steps to start a Spark cluster with EC2 scripts
> 1. I created an ec2 instance in the vpc, and subnet. Amazon Linux
> 2. I dowloaded spark-1.3.0
> 3. chmod 400 key file
> 4. Export aws access and secret keys
> 5. Now ran the command
> ./spark-ec2 --key-pair=deepali-ec2-keypair
> --identity-file=/home/ec2-user/Spark/deepali-ec2-keypair.pem
> --region=us-west-2 --zone=us-west-2b --vpc-id=vpc-03d67b66
> --subnet-id=subnet-72fd5905 --resume launch deepali-spark-nodocker
> 6. The master and slave instances are created but cannot ssh says host not
> resolved.
> 7. I can ping the master and slave, I can ssh from the command line, but not
> from the ec2 scripts.
> 8. I have spent more than 2 days now. But no luck yet.
> 9. The ec2 scripts dont work .. code has a bug in referencing the cluster
> nodes via the wrong hostnames
>
> SCREEN CONSOLE log
> ./spark-ec2 --key-pair=deepali-ec2-keypair --identity-file=/home
>
>
> /ec2-user/Spark/deepali-ec2-keypair.pem --region=us-west-2 --zone=us-west-2b
> --vpc-id=vpc-03d67b6
>
> 6 --subnet-id=subnet-72fd5905 launch deepali-spark-nodocker
> Downloading Boto from PyPi
> Finished downloading Boto
> Setting up security groups...
> Creating security group deepali-spark-nodocker-master
> Creating security group deepali-spark-nodocker-slaves
> Searching for existing cluster deepali-spark-nodocker...
> Spark AMI: ami-9a6e0daa
> Launching instances...
> Launched 1 slaves in us-west-2b, regid = r-0d2088fb
> Launched master in us-west-2b, regid = r-312088c7
> Waiting for AWS to propagate instance metadata...
> Waiting for cluster to enter 'ssh-ready' state...........
> Warning: SSH connection error. (This could be temporary.)
> Host: None
> SSH return code: 255
> SSH output: ssh: Could not resolve hostname None: Name or service not known
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
