[
https://issues.apache.org/jira/browse/SPARK-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Grzegorz Dubicki updated SPARK-5298:
------------------------------------
Environment: I use Spark 1.2.0 + this PR
https://github.com/mesos/spark-ec2/pull/76 from my fork
https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the same
fix from https://github.com/grzegorz-dubicki/spark-ec2
Affects Version/s: 1.2.0
> Spark not starting on EC2 using spark-ec2
> -----------------------------------------
>
> Key: SPARK-5298
> URL: https://issues.apache.org/jira/browse/SPARK-5298
> Project: Spark
> Issue Type: Bug
> Affects Versions: 1.2.0
> Environment: I use Spark 1.2.0 + this PR
> https://github.com/mesos/spark-ec2/pull/76 from my fork
> https://github.com/grzegorz-dubicki/spark and v4 Spark EC2 script with the
> same fix from https://github.com/grzegorz-dubicki/spark-ec2
> Reporter: Grzegorz Dubicki
>
> Spark doesn't start after creating it with:
> {noformat}
> ./spark-ec2 -k * -i * -s 1 --region=eu-west-1 --instance-type=t2.micro
> --spark-version=1.2.0 launch test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/f15caf9ff6c96ec69fee)
> ..or after stopping the instances on EC2 via AWS Console and starting the
> cluster with:
> {noformat}
> ./spark-ec2 -k * -i * --region=eu-west-1 start test2
> {noformat}
> (Output: https://gist.github.com/grzegorz-dubicki/8b87192b3aa4e0ed028c)
> Please note these errors in launch output:
> {noformat}
> ~/spark-ec2
> Initializing spark
> ~ ~/spark-ec2
> ERROR: Unknown Spark version
> Initializing shark
> ~ ~/spark-ec2 ~/spark-ec2
> ERROR: Unknown Shark version
> {noformat}
> ..and then these in start output:
> {noformat}
> ./spark-standalone/setup.sh: line 26: /root/spark/sbin/stop-all.sh: Nie ma
> takiego pliku ani katalogu
> ./spark-standalone/setup.sh: line 31: /root/spark/sbin/start-master.sh: Nie
> ma takiego pliku ani katalogu
> ./spark-standalone/setup.sh: line 37: /root/spark/sbin/start-slaves.sh: Nie
> ma takiego pliku ani katalogu
> {noformat}
> (the error message is "No such file or directory", in Polish)
> It seems to be related with
> http://mail-archives.us.apache.org/mod_mbox/spark-user/201412.mbox/%3cCAJ5A9B_U=mdcxyftdkbk+sljzbcdpcb0qqs83u0grozfgkc...@mail.gmail.com%3e
> - I also have almost empty Spark and Shark dirs on the master of test2
> cluster:
> {noformat}
> root@ip-172-31-7-179 ~]$ ls spark
> conf work
> root@ip-172-31-7-179 ~]$ ls shark/
> conf
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
