[
https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364308#comment-14364308
]
Gera Shegalov commented on MAPREDUCE-6275:
------------------------------------------
[~l201514], thanks for v1. We need a regression test for this patch, we can
start with a scenario we seem to understand.
The fix should be always force the merge code path for the less common case
when a task outputs to an extra subdir instead of doing any renames.
Note that mkdirs does not throw exception if the directory exists. Let us
minimize {{exists}} because it's an extra RPC for getFileStatus.
> Potential race condition of mutiple file system rename in FileOutputCommiter
> v2
> -------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6275
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6275
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siqi Li
> Priority: Critical
> Attachments: MAPREDUCE-6275.v1.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
