[
https://issues.apache.org/jira/browse/YARN-7712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16319359#comment-16319359
]
Chris Douglas commented on YARN-7712:
-------------------------------------
bq. I would like to keep this jira simple, all it is about is to ignore the
timestamp check on downloads
Is the intent to accommodate a) modifications to files or b) completely
different files- or files that don't exist during submission- as dependencies?
What problem is this solving?
Ignoring the timestamp makes localization non-deterministic. A reexecution of a
task could download and use a different dependency. Speculatively executed
tasks could use different dependencies, depending on which machine they run on.
It's a rare user who can safely disable this check in YARN, but can't work
around the timestamp check...
> Add ability to ignore timestamps in localized files
> ---------------------------------------------------
>
> Key: YARN-7712
> URL: https://issues.apache.org/jira/browse/YARN-7712
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Reporter: Miklos Szegedi
> Assignee: Miklos Szegedi
>
> YARN currently requires and checks the timestamp of localized files and
> fails, if the file on HDFS does not match to the one requested. This jira
> adds the ability to ignore the timestamp based on the request of the client.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
