abhishek bharani created YARN-6914: -------------------------------------- Summary: Application application_1501553373419_0001 failed 2 times due to AM Container for appattempt_1501553373419_0001_000002 exited with exitCode: -1000 Key: YARN-6914 URL: https://issues.apache.org/jira/browse/YARN-6914 Project: Hadoop YARN Issue Type: Bug Components: yarn Affects Versions: 2.7.3 Environment: Mac OS Reporter: abhishek bharani Priority: Critical
I am getting below error while running spark-shell --master yarn Application application_1501553373419_0001 failed 2 times due to AM Container for appattempt_1501553373419_0001_000002 exited with exitCode: -1000 For more detailed output, check application tracking page:http://abhisheks-mbp:8088/cluster/app/application_1501553373419_0001Then, click on links to logs of each attempt. Diagnostics: null Failing this attempt. Failing the application. Below are the contents of yarn-site.xml : <configuration> <!-- Site specific YARN configuration properties --> <property> <name>yarn.nodemanager.aux-services</name> <value>mapreduce_shuffle</value> </property> <property> <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> <value>org.apache.hadoop.mapred.ShuffleHandler</value> </property> <property> <name>yarn.nodemanager.aux-services.spark_shuffle.class</name> <value>org.apache.spark.network.yarn.YarnShuffleService</value> </property> <property> <name>yarn.log-aggregation-enable</name> <value>true</value> </property> <property> <name>yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds</name> <value>3600</value> </property> <property> <name>yarn.resourcemanager.hostname</name> <value>localhost</value> </property> <property> <name>yarn.resourcemanager.resourcetracker.address</name> <value>${yarn.resourcemanager.hostname}:8025</value> <description>Enter your ResourceManager hostname.</description> </property> <property> <name>yarn.resourcemanager.scheduler.address</name> <value>${yarn.resourcemanager.hostname}:8035</value> <description>Enter your ResourceManager hostname.</description> </property> <property> <name>yarn.resourcemanager.address</name> <value>${yarn.resourcemanager.hostname}:8055</value> <description>Enter your ResourceManager hostname.</description> </property> <property> <description>The http address of the RM web application.</description> <name>yarn.resourcemanager.webapp.address</name> <value>${yarn.resourcemanager.hostname}:8088</value> </property> I tried many solutions but none of them is working : 1.Added property yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage to yarn-site.xml with value as 98.5 2.added below property to yarn-site.xml yarn.nodemanager.aux-services.spark_shuffle.class org.apache.spark.network.yarn.YarnShuffleService 3.Added property in spark-defaults.conf spark.yarn.jars=hdfs://localhost:50010/users/spark/jars/*.jar -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org