If your problem is that stopping/starting the cluster resets configs, then you may be running into this issue:
https://issues.apache.org/jira/browse/SPARK-4977 Nick On Thu, Jun 4, 2015 at 2:46 PM barmaley <o...@solver.com> wrote: > Hi - I'm having similar problem with switching from ephemeral to persistent > HDFS - it always looks for 9000 port regardless of options I set for 9010 > persistent HDFS. Have you figured out a solution? Thanks > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Required-settings-for-permanent-HDFS-Spark-on-EC2-tp22860p23157.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
