[
https://issues.apache.org/jira/browse/HADOOP-9750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daryn Sharp updated HADOOP-9750:
--------------------------------
Resolution: Invalid
Status: Resolved (was: Patch Available)
The overall premise of this change is just wrong. What you are trying to avoid
is:
* Running a MR job with data actively being copied
* Running a MR job with data that failed to copy
The result is a nondeterministic job. That's bad.
I'm marking as invalid.
> '._COPYING_' sufix temp file could prevent from running MapReduce job
> ----------------------------------------------------------------------
>
> Key: HADOOP-9750
> URL: https://issues.apache.org/jira/browse/HADOOP-9750
> Project: Hadoop Common
> Issue Type: Bug
> Affects Versions: 3.0.0
> Reporter: Kousuke Saruta
> Fix For: 3.0.0
>
> Attachments: HADOOP-9750.patch
>
>
> FsShell copy/put creates staging files with '._COPYING_' suffix.
> When we run MapReduce job during being the temp file, the job could fail
> because the temp file is not invisible from MapReduce job.
> Now, I suggest to rename the temp file with '_' suffix such like
> '_*._COPYING_'.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
