[
https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gera Shegalov updated MAPREDUCE-6275:
-------------------------------------
Attachment: MAPREDUCE-6275.002.patch
Here is 002 patch. I have a reliable reproducer of my understanding of the
problem. Without the product code fix the test fails as follows:
{code}
testConcurrentCommitTaskWithSubDirV2(org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter)
Time elapsed: 249.209 sec <<< FAILURE!
junit.framework.AssertionFailedError: Must not end up with sub_dir/sub_dir
at junit.framework.Assert.fail(Assert.java:57)
at junit.framework.Assert.assertTrue(Assert.java:22)
at junit.framework.Assert.assertFalse(Assert.java:39)
at junit.framework.TestCase.assertFalse(TestCase.java:210)
at
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter.testConcurrentCommitTaskWithSubDir(TestFileOutputCommitter.java:542)
at
org.apache.hadoop.mapreduce.lib.output.TestFileOutputCommitter.testConcurrentCommitTaskWithSubDirV2(TestFileOutputCommitter.java:555)
{code}
[~ivan.bella], [~jlowe], [~dlmarion], please review.
> Race condition in FileOutputCommitter v2 for user-specified task output
> subdirs
> -------------------------------------------------------------------------------
>
> Key: MAPREDUCE-6275
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6275
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Siqi Li
> Assignee: Gera Shegalov
> Priority: Critical
> Attachments: MAPREDUCE-6275.002.patch, MAPREDUCE-6275.v1.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
