Re: issue Running Spark Job on Yarn Cluster

[sivasonai]

Come across such issue in our project and got it resolved by clearing the
space under hdfs directory - "/user/spark". Please check if you have enough
space/privileges for this hdfs directory - "/user/spark"



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

Re: issue Running Spark Job on Yarn Cluster

[stark_summer]

Please  look at more about  hadoop logs, such as  yarn logs -applicationId
xxx
attach more logs to this topic 



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21779p24350.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[MooseSpark]

Please check logs in your hadoop yarn cluster, there you would get precise
error or exception. 



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21779p24308.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[poolis]

Did you resolve this issue?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21779p24300.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[roni]

look at the logs
yarn logs --applicationId 
That should give the error.

On Wed, Mar 4, 2015 at 9:21 AM, sachin Singh 
wrote:

> Not yet,
> Please let. Me know if you found solution,
>
> Regards
> Sachin
> On 4 Mar 2015 21:45, "mael2210 [via Apache Spark User List]" <[hidden
> email] <http:///user/SendEmail.jtp?type=node&node=21912&i=0>> wrote:
>
>> Hello,
>>
>> I am facing the exact same issue. Could you solve the problem ?
>>
>> Kind regards
>>
>> --
>>  If you reply to this email, your message will be added to the
>> discussion below:
>>
>> http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697p21909.html
>>  To unsubscribe from issue Running Spark Job on Yarn Cluster, click here.
>> NAML
>> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
> --
> View this message in context: Re: issue Running Spark Job on Yarn Cluster
> <http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697p21912.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>

Re: issue Running Spark Job on Yarn Cluster

[sachin Singh]

Not yet,
Please let. Me know if you found solution,

Regards
Sachin
On 4 Mar 2015 21:45, "mael2210 [via Apache Spark User List]" <
ml-node+s1001560n21909...@n3.nabble.com> wrote:

> Hello,
>
> I am facing the exact same issue. Could you solve the problem ?
>
> Kind regards
>
> --
>  If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697p21909.html
>  To unsubscribe from issue Running Spark Job on Yarn Cluster, click here
> 
> .
> NAML
> 
>




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697p21912.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: issue Running Spark Job on Yarn Cluster

[avilevi3]

you should fetch the complete logs for the application using 'yarn logs'
command, like so:

yarn logs -applicationId [the application's id]

and look for the real error info



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21779p21788.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[sachin Singh]

I am using CDH5.3.1



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21779p21780.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[Marcelo Vanzin]

You'll need to look at your application's logs. You can use "yarn logs
--applicationId [id]" to see them.

On Wed, Feb 18, 2015 at 2:39 AM, sachin Singh  wrote:
> Hi,
> I want to run my spark Job in Hadoop yarn Cluster mode,
> I am using below command -
> spark-submit --master yarn-cluster --driver-memory 1g --executor-memory 1g
> --executor-cores 1 --class com.dc.analysis.jobs.AggregationJob
> sparkanalitic.jar param1 param2 param3
> I am getting error as under, kindly suggest whats going wrong ,is command is
> proper or not ,thanks in advance,
>
> Exception in thread "main" org.apache.spark.SparkException: Application
> finished with failed status
> at
> org.apache.spark.deploy.yarn.ClientBase$class.run(ClientBase.scala:509)
> at org.apache.spark.deploy.yarn.Client.run(Client.scala:35)
> at org.apache.spark.deploy.yarn.Client$.main(Client.scala:139)
> at org.apache.spark.deploy.yarn.Client.main(Client.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
>
>
> --
> View this message in context: 
> http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>



-- 
Marcelo

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: issue Running Spark Job on Yarn Cluster

[Sachin Singh]

Yes.
On 19 Feb 2015 23:40, "Harshvardhan Chauhan"  wrote:

> Is this the full stack trace ?
>
> On Wed, Feb 18, 2015 at 2:39 AM, sachin Singh 
> wrote:
>
>> Hi,
>> I want to run my spark Job in Hadoop yarn Cluster mode,
>> I am using below command -
>> spark-submit --master yarn-cluster --driver-memory 1g --executor-memory 1g
>> --executor-cores 1 --class com.dc.analysis.jobs.AggregationJob
>> sparkanalitic.jar param1 param2 param3
>> I am getting error as under, kindly suggest whats going wrong ,is command
>> is
>> proper or not ,thanks in advance,
>>
>> Exception in thread "main" org.apache.spark.SparkException: Application
>> finished with failed status
>> at
>> org.apache.spark.deploy.yarn.ClientBase$class.run(ClientBase.scala:509)
>> at org.apache.spark.deploy.yarn.Client.run(Client.scala:35)
>> at org.apache.spark.deploy.yarn.Client$.main(Client.scala:139)
>> at org.apache.spark.deploy.yarn.Client.main(Client.scala)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>>
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>> at
>>
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>> at java.lang.reflect.Method.invoke(Method.java:606)
>> at
>> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
>> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
>> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>>
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> -
>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
>> For additional commands, e-mail: user-h...@spark.apache.org
>>
>>
>
>
> --
> *Harshvardhan Chauhan*  |  Software Engineer
> *GumGum*   |  *Ads that stick*
> 310-260-9666  |  ha...@gumgum.com
>

Re: issue Running Spark Job on Yarn Cluster

[Harshvardhan Chauhan]

Is this the full stack trace ?

On Wed, Feb 18, 2015 at 2:39 AM, sachin Singh 
wrote:

> Hi,
> I want to run my spark Job in Hadoop yarn Cluster mode,
> I am using below command -
> spark-submit --master yarn-cluster --driver-memory 1g --executor-memory 1g
> --executor-cores 1 --class com.dc.analysis.jobs.AggregationJob
> sparkanalitic.jar param1 param2 param3
> I am getting error as under, kindly suggest whats going wrong ,is command
> is
> proper or not ,thanks in advance,
>
> Exception in thread "main" org.apache.spark.SparkException: Application
> finished with failed status
> at
> org.apache.spark.deploy.yarn.ClientBase$class.run(ClientBase.scala:509)
> at org.apache.spark.deploy.yarn.Client.run(Client.scala:35)
> at org.apache.spark.deploy.yarn.Client$.main(Client.scala:139)
> at org.apache.spark.deploy.yarn.Client.main(Client.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
>
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.launch(SparkSubmit.scala:358)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:75)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/issue-Running-Spark-Job-on-Yarn-Cluster-tp21697.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
>


-- 
*Harshvardhan Chauhan*  |  Software Engineer
*GumGum*   |  *Ads that stick*
310-260-9666  |  ha...@gumgum.com