abhishek bharani created YARN-6914:
--------------------------------------
Summary: Application application_1501553373419_0001 failed 2 times
due to AM Container for appattempt_1501553373419_0001_000002 exited with
exitCode: -1000
Key: YARN-6914
URL: https://issues.apache.org/jira/browse/YARN-6914
Project: Hadoop YARN
Issue Type: Bug
Components: yarn
Affects Versions: 2.7.3
Environment: Mac OS
Reporter: abhishek bharani
Priority: Critical
I am getting below error while running
spark-shell --master yarn
Application application_1501553373419_0001 failed 2 times due to AM Container
for appattempt_1501553373419_0001_000002 exited with exitCode: -1000
For more detailed output, check application tracking
page:http://abhisheks-mbp:8088/cluster/app/application_1501553373419_0001Then,
click on links to logs of each attempt.
Diagnostics: null
Failing this attempt. Failing the application.
Below are the contents of yarn-site.xml :
<configuration>
<!-- Site specific YARN configuration properties -->
<property>
<name>yarn.nodemanager.aux-services</name>
<value>mapreduce_shuffle</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
<value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>
<property>
<name>yarn.nodemanager.aux-services.spark_shuffle.class</name>
<value>org.apache.spark.network.yarn.YarnShuffleService</value>
</property>
<property>
<name>yarn.log-aggregation-enable</name>
<value>true</value>
</property>
<property>
<name>yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds</name>
<value>3600</value>
</property>
<property>
<name>yarn.resourcemanager.hostname</name>
<value>localhost</value>
</property>
<property>
<name>yarn.resourcemanager.resourcetracker.address</name>
<value>${yarn.resourcemanager.hostname}:8025</value>
<description>Enter your ResourceManager
hostname.</description>
</property>
<property>
<name>yarn.resourcemanager.scheduler.address</name>
<value>${yarn.resourcemanager.hostname}:8035</value>
<description>Enter your ResourceManager
hostname.</description>
</property>
<property>
<name>yarn.resourcemanager.address</name>
<value>${yarn.resourcemanager.hostname}:8055</value>
<description>Enter your ResourceManager
hostname.</description>
</property>
<property>
<description>The http address of the RM web
application.</description>
<name>yarn.resourcemanager.webapp.address</name>
<value>${yarn.resourcemanager.hostname}:8088</value>
</property>
I tried many solutions but none of them is working :
1.Added property
yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage
to yarn-site.xml with value as 98.5
2.added below property to yarn-site.xml
yarn.nodemanager.aux-services.spark_shuffle.class
org.apache.spark.network.yarn.YarnShuffleService
3.Added property in spark-defaults.conf
spark.yarn.jars=hdfs://localhost:50010/users/spark/jars/*.jar
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
