Gao Pan created YARN-8562:
-----------------------------
Summary: Spark Application fails due to resource file timestamp
difference
Key: YARN-8562
URL: https://issues.apache.org/jira/browse/YARN-8562
Project: Hadoop YARN
Issue Type: Bug
Components: yarn
Affects Versions: 2.8.4, 2.9.1
Environment: Spark 2.3.1 (build with Hadoop 2.7)
Hadoop 2.8.4 & 2.9.1
Reporter: Gao Pan
Application was submitted to YARN by spark-submit and accepted but alway failed
with following exception. The expected timestamp alway comes with 000 as the
right most digits and other digits always match.
2018-07-21 18:16:16 INFO Client:54 -
client token: N/A
diagnostics: Application application_1532213527145_0003 failed 2 times due to
AM Container for appattempt_1532213527145_0003_000002 exited with exitCode:
-1000
Failing this attempt.Diagnostics: [2018-07-21 18:16:15.668]Resource
file:/Users/gpan/.sparkStaging/application_1532213527145_0003/com.amazonaws_aws-java-sdk-kms-1.11.76.jar
changed on src filesystem (expected 1532222173000, was 1532222173543
java.io.IOException: Resource
file:/Users/gpan/.sparkStaging/application_1532213527145_0003/com.amazonaws_aws-java-sdk-kms-1.11.76.jar
changed on src filesystem (expected 1532222173000, was 1532222173543
at org.apache.hadoop.yarn.util.FSDownload.copy(FSDownload.java:255)
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
