[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308133#comment-14308133 ]
Nicholas Chammas edited comment on SPARK-5335 at 2/6/15 1:15 AM: ----------------------------------------------------------------- For the record: [AWS says|https://forums.aws.amazon.com/thread.jspa?messageID=572559] you must use the group ID (as opposed to the name) when deleting groups within a VPC. That appears to be the root cause of the issue reported here. was (Author: nchammas): For the record: [AWS says|https://forums.aws.amazon.com/thread.jspa?messageID=572559] you must use the group ID (as opposed to the name) when deleting groups within a VPC. > Destroying cluster in VPC with "--delete-groups" fails to remove security > groups > -------------------------------------------------------------------------------- > > Key: SPARK-5335 > URL: https://issues.apache.org/jira/browse/SPARK-5335 > Project: Spark > Issue Type: Bug > Components: EC2 > Reporter: Vladimir Grigor > > When I try to remove security groups using option of the script, it fails > because in VPC one should remove security groups by id, not name as it is now. > {code} > $ ./spark-ec2 -k key20141114 -i ~/key.pem --region=eu-west-1 --delete-groups > destroy SparkByScript > Are you sure you want to destroy the cluster SparkByScript? > The following instances will be terminated: > Searching for existing cluster SparkByScript... > ALL DATA ON ALL NODES WILL BE LOST!! > Destroy cluster SparkByScript (y/N): y > Terminating master... > Terminating slaves... > Deleting security groups (this will take some time)... > Waiting for cluster to enter 'terminated' state. > Cluster is now in 'terminated' state. Waited 0 seconds. > Attempt 1 > Deleting rules in security group SparkByScript-slaves > Deleting rules in security group SparkByScript-master > ERROR:boto:400 Bad Request > ERROR:boto:<?xml version="1.0" encoding="UTF-8"?> > <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid > value 'SparkByScript-slaves' for groupName. You may not reference Amazon VPC > security groups by name. Please use the corresponding id for this > operation.</Message></Error></Errors><RequestID>60313fac-5d47-48dd-a8bf-e9832948c0a6</RequestID></Response> > Failed to delete security group SparkByScript-slaves > ERROR:boto:400 Bad Request > ERROR:boto:<?xml version="1.0" encoding="UTF-8"?> > <Response><Errors><Error><Code>InvalidParameterValue</Code><Message>Invalid > value 'SparkByScript-master' for groupName. You may not reference Amazon VPC > security groups by name. Please use the corresponding id for this > operation.</Message></Error></Errors><RequestID>74ff8431-c0c1-4052-9ecb-c0adfa7eeeac</RequestID></Response> > Failed to delete security group SparkByScript-master > Attempt 2 > .... > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org