Josh Rosen created SPARK-4888:
---------------------------------
Summary: Spark EC2 doesn't mount local disks for i2.8xlarge
instances
Key: SPARK-4888
URL: https://issues.apache.org/jira/browse/SPARK-4888
Project: Spark
Issue Type: Bug
Components: EC2
Affects Versions: 1.1.1, 1.0.2, 1.2.0
Reporter: Josh Rosen
Priority: Critical
When launching a cluster using {{spark-ec2}} with i8.2xlarge instances, the
local disks aren't mounted. The AWS console doesn't show the disks as
mounted, either
I think that the issue is that EC2 won't auto-mount the SSDs. We have some
code that handles this for some of the {{r3*}} instance types, and I think the
right fix is to extend this for {{i8}} instance types, too:
https://github.com/mesos/spark-ec2/blob/v4/setup-slave.sh#L37
/cc [~adav], who originally found this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
