be very useful to have the ability to submit
jobs remotely.
Thanks,
Oleg
-Original Message-
From: Patrick Wendell [mailto:pwend...@gmail.com]
Sent: Monday, February 23, 2015 1:22 AM
To: Oleg Shirokikh
Cc: user@spark.apache.org
Subject: Re: FW: Submitting jobs to Spark EC2 cluster remotely
with ERROR state...
Thanks,
Oleg
-Original Message-
From: Patrick Wendell [mailto:pwend...@gmail.com]
Sent: Monday, February 23, 2015 12:59 AM
To: Oleg Shirokikh
Cc: user@spark.apache.org
Subject: Re: Submitting jobs to Spark EC2 cluster remotely
Can you list other configs that you are setting
@spark.apache.org
Subject: Re: Submitting jobs to Spark EC2 cluster remotely
Can you list other configs that you are setting? It looks like the executor
can't communicate back to the driver. I'm actually not sure it's a good idea
to set spark.driver.host here, you want to let spark set that automatically
pointers on what is going wrong and some guidance
how to deploy jobs from remote client. Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Submitting-jobs-to-Spark-EC2-cluster-remotely-tp21762.html
Sent from the Apache Spark User List mailing list archive
Shirokikh
Cc: user@spark.apache.org
Subject: Re: FW: Submitting jobs to Spark EC2 cluster remotely
What happens if you submit from the master node itself on ec2 (in client
mode), does that work? What about in cluster mode?
It would be helpful if you could print the full command
and some guidance
how to deploy jobs from remote client. Thanks.
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Submitting-jobs-to-Spark-EC2-cluster-remotely-tp21762.html
Sent from the Apache Spark User List mailing list archive at Nabble.com