[
https://issues.apache.org/jira/browse/HADOOP-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Mingliang Liu updated HADOOP-12473:
-----------------------------------
Description: In {{CopyMapper::handleFailure}}, the mapper handles failures
Ignoring failures should be mutually exclusive with the atomic option otherwise
an incomplete dir is eligible for commit defeating the purpose. (was:
{{RetriableFileCopyCommand.CopyReadException}} is double-wrapped via
# via {{RetriableCommand::execute}}
# via {{CopyMapper#copyFileWithRetry}}
before {{CopyMapper::handleFailure}} tests
{code}
if (ignoreFailures && exception.getCause() instanceof
RetriableFileCopyCommand.CopyReadException
{code}
which is always false.
Orthogonally, ignoring failures should be mutually exclusive with the atomic
option otherwise an incomplete dir is eligible for commit defeating the purpose.
)
> distcp's ignoring failures should be mutually exclusive with the atomic option
> ------------------------------------------------------------------------------
>
> Key: HADOOP-12473
> URL: https://issues.apache.org/jira/browse/HADOOP-12473
> Project: Hadoop Common
> Issue Type: Bug
> Components: tools/distcp
> Affects Versions: 2.7.1
> Reporter: Mingliang Liu
> Assignee: Mingliang Liu
> Priority: Critical
> Fix For: 2.8.0
>
>
> In {{CopyMapper::handleFailure}}, the mapper handles failures Ignoring
> failures should be mutually exclusive with the atomic option otherwise an
> incomplete dir is eligible for commit defeating the purpose.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
