[
https://issues.apache.org/jira/browse/YARN-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16110239#comment-16110239
]
Naganarasimha G R commented on YARN-6914:
-----------------------------------------
Hi [~bharaniabhishek123],
Generally the approach which is followed is raise your issue in the forum and
if in the forum it gets confirmed to be a defect then raise it in jira. Please
ensure next time we follow this procedure else every query will become a jira !
Will close this issue, please raise this in the forum and if required lets
reopen this issue.
And coming to the logs, has the NM started ? seems to be a spark issue may be
you can check in the spark forum.
One possible reason would be spark aux service leveldb files might have got
corrupted, if not production cluster please empty/backup the dir "
/usr/local/hadoop/tmp/nm-local-dir/" and then try.
> Application application_1501553373419_0001 failed 2 times due to AM Container
> for appattempt_1501553373419_0001_000002 exited with exitCode: -1000
> --------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-6914
> URL: https://issues.apache.org/jira/browse/YARN-6914
> Project: Hadoop YARN
> Issue Type: Bug
> Components: yarn
> Affects Versions: 2.7.3
> Environment: Mac OS
> Reporter: abhishek bharani
> Priority: Critical
> Original Estimate: 336h
> Remaining Estimate: 336h
>
> I am getting below error while running
> spark-shell --master yarn
> Application application_1501553373419_0001 failed 2 times due to AM Container
> for appattempt_1501553373419_0001_000002 exited with exitCode: -1000
> For more detailed output, check application tracking
> page:http://abhisheks-mbp:8088/cluster/app/application_1501553373419_0001Then,
> click on links to logs of each attempt.
> Diagnostics: null
> Failing this attempt. Failing the application.
> Below are the contents of yarn-site.xml :
> <configuration>
> <!-- Site specific YARN configuration properties -->
> <property>
> <name>yarn.nodemanager.aux-services</name>
> <value>mapreduce_shuffle</value>
> </property>
> <property>
>
> <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
> <value>org.apache.hadoop.mapred.ShuffleHandler</value>
> </property>
> <property>
> <name>yarn.nodemanager.aux-services.spark_shuffle.class</name>
>
> <value>org.apache.spark.network.yarn.YarnShuffleService</value>
> </property>
> <property>
> <name>yarn.log-aggregation-enable</name>
> <value>true</value>
> </property>
> <property>
>
> <name>yarn.nodemanager.log-aggregation.roll-monitoring-interval-seconds</name>
> <value>3600</value>
> </property>
> <property>
> <name>yarn.resourcemanager.hostname</name>
> <value>localhost</value>
> </property>
> <property>
>
> <name>yarn.resourcemanager.resourcetracker.address</name>
> <value>${yarn.resourcemanager.hostname}:8025</value>
> <description>Enter your ResourceManager
> hostname.</description>
> </property>
> <property>
> <name>yarn.resourcemanager.scheduler.address</name>
> <value>${yarn.resourcemanager.hostname}:8035</value>
> <description>Enter your ResourceManager
> hostname.</description>
> </property>
> <property>
> <name>yarn.resourcemanager.address</name>
> <value>${yarn.resourcemanager.hostname}:8055</value>
> <description>Enter your ResourceManager
> hostname.</description>
> </property>
> <property>
> <description>The http address of the RM web
> application.</description>
> <name>yarn.resourcemanager.webapp.address</name>
> <value>${yarn.resourcemanager.hostname}:8088</value>
> </property>
> I tried many solutions but none of them is working :
> 1.Added property
> yarn.nodemanager.disk-health-checker.max-disk-utilization-per-disk-percentage
> to yarn-site.xml with value as 98.5
> 2.added below property to yarn-site.xml
> yarn.nodemanager.aux-services.spark_shuffle.class
> org.apache.spark.network.yarn.YarnShuffleService
> 3.Added property in spark-defaults.conf
> spark.yarn.jars=hdfs://localhost:50010/users/spark/jars/*.jar
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
