Hi, 1. It seems by default spark ec2 uses ephemeral hdfs, how to switch this to persistent hdfs?
2. By default persistent hdfs server is not up, is this meant to be like this? Unless I'm missing something, the docs ( https://spark.incubator.apache.org/docs/0.8.1/ec2-scripts.html) do not point to these issues.
