[jira] [Commented] (SPARK-5335) Destroying cluster in VPC with --delete-groups fails to remove security groups
[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308133#comment-14308133 ] Nicholas Chammas commented on SPARK-5335: - For the record: [AWS says|https://forums.aws.amazon.com/thread.jspa?messageID=572559] you must use the group ID (as opposed to the name) when deleting groups within a VPC. Destroying cluster in VPC with --delete-groups fails to remove security groups Key: SPARK-5335 URL: https://issues.apache.org/jira/browse/SPARK-5335 Project: Spark Issue Type: Bug Components: EC2 Reporter: Vladimir Grigor When I try to remove security groups using option of the script, it fails because in VPC one should remove security groups by id, not name as it is now. {code} $ ./spark-ec2 -k key20141114 -i ~/key.pem --region=eu-west-1 --delete-groups destroy SparkByScript Are you sure you want to destroy the cluster SparkByScript? The following instances will be terminated: Searching for existing cluster SparkByScript... ALL DATA ON ALL NODES WILL BE LOST!! Destroy cluster SparkByScript (y/N): y Terminating master... Terminating slaves... Deleting security groups (this will take some time)... Waiting for cluster to enter 'terminated' state. Cluster is now in 'terminated' state. Waited 0 seconds. Attempt 1 Deleting rules in security group SparkByScript-slaves Deleting rules in security group SparkByScript-master ERROR:boto:400 Bad Request ERROR:boto:?xml version=1.0 encoding=UTF-8? ResponseErrorsErrorCodeInvalidParameterValue/CodeMessageInvalid value 'SparkByScript-slaves' for groupName. You may not reference Amazon VPC security groups by name. Please use the corresponding id for this operation./Message/Error/ErrorsRequestID60313fac-5d47-48dd-a8bf-e9832948c0a6/RequestID/Response Failed to delete security group SparkByScript-slaves ERROR:boto:400 Bad Request ERROR:boto:?xml version=1.0 encoding=UTF-8? ResponseErrorsErrorCodeInvalidParameterValue/CodeMessageInvalid value 'SparkByScript-master' for groupName. You may not reference Amazon VPC security groups by name. Please use the corresponding id for this operation./Message/Error/ErrorsRequestID74ff8431-c0c1-4052-9ecb-c0adfa7eeeac/RequestID/Response Failed to delete security group SparkByScript-master Attempt 2 {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5335) Destroying cluster in VPC with --delete-groups fails to remove security groups
[ https://issues.apache.org/jira/browse/SPARK-5335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283936#comment-14283936 ] Apache Spark commented on SPARK-5335: - User 'voukka' has created a pull request for this issue: https://github.com/apache/spark/pull/4122 Destroying cluster in VPC with --delete-groups fails to remove security groups Key: SPARK-5335 URL: https://issues.apache.org/jira/browse/SPARK-5335 Project: Spark Issue Type: Bug Components: EC2 Reporter: Vladimir Grigor When I try to remove security groups using option of the script, it fails because in VPC one should remove security groups by id, not name as it is now. {code} $ ./spark-ec2 -k key20141114 -i ~/key.pem --region=eu-west-1 --delete-groups destroy SparkByScript Are you sure you want to destroy the cluster SparkByScript? The following instances will be terminated: Searching for existing cluster SparkByScript... ALL DATA ON ALL NODES WILL BE LOST!! Destroy cluster SparkByScript (y/N): y Terminating master... Terminating slaves... Deleting security groups (this will take some time)... Waiting for cluster to enter 'terminated' state. Cluster is now in 'terminated' state. Waited 0 seconds. Attempt 1 Deleting rules in security group SparkByScript-slaves Deleting rules in security group SparkByScript-master ERROR:boto:400 Bad Request ERROR:boto:?xml version=1.0 encoding=UTF-8? ResponseErrorsErrorCodeInvalidParameterValue/CodeMessageInvalid value 'SparkByScript-slaves' for groupName. You may not reference Amazon VPC security groups by name. Please use the corresponding id for this operation./Message/Error/ErrorsRequestID60313fac-5d47-48dd-a8bf-e9832948c0a6/RequestID/Response Failed to delete security group SparkByScript-slaves ERROR:boto:400 Bad Request ERROR:boto:?xml version=1.0 encoding=UTF-8? ResponseErrorsErrorCodeInvalidParameterValue/CodeMessageInvalid value 'SparkByScript-master' for groupName. You may not reference Amazon VPC security groups by name. Please use the corresponding id for this operation./Message/Error/ErrorsRequestID74ff8431-c0c1-4052-9ecb-c0adfa7eeeac/RequestID/Response Failed to delete security group SparkByScript-master Attempt 2 {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org