[
https://issues.apache.org/jira/browse/HADOOP-12589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024858#comment-15024858
]
Chris Nauroth commented on HADOOP-12589:
----------------------------------------
bq. all the tests use the same test path.
In theory, that should be OK. An {{@After}} method deletes the directory
between each test run. Tests are parallelized at the suite level, but
individual methods within a suite run serially, so they shouldn't collide with
each other.
It's odd that the automatic {{mkdirs}} triggered from {{createNewFile}} is
failing. This recursively creates all directories in the path, but without a
guarantee of atomicity. If the previously created directories in the ancestry
got deleted concurrently in the middle of this {{mkdirs}}, then that could
cause it. Perhaps we have a situation where a concurrent test suite is being
naughty and deleting the whole test.build.data structure, not isolating itself
to that JUnit process's workspace (the "2" directory component shown in the
description).
An interesting first step might be to make a troubleshooting patch that just
catches the error and prints the directory diagnostics, similar to what
{{MiniDFSCluster}} does. Then, we could submit a few Jenkins runs to try to
repro. That might give us a firmer lead about root cause.
> Fix intermittent test failure of TestCopyPreserveFlag
> ------------------------------------------------------
>
> Key: HADOOP-12589
> URL: https://issues.apache.org/jira/browse/HADOOP-12589
> Project: Hadoop Common
> Issue Type: Bug
> Components: test
> Environment: jenkins
> Reporter: Tsuyoshi Ozawa
>
> Found this issue on HADOOP-11149.
> {quote}
> Tests run: 8, Failures: 0, Errors: 8, Skipped: 0, Time elapsed: 0.949 sec <<<
> FAILURE! - in org.apache.hadoop.fs.shell.TestCopyPreserveFlag
> testDirectoryCpWithP(org.apache.hadoop.fs.shell.TestCopyPreserveFlag) Time
> elapsed: 0.616 sec <<< ERROR!
> java.io.IOException: Mkdirs failed to create d0 (exists=false,
> cwd=/testptch/hadoop/hadoop-common-project/hadoop-common/target/test/data/2/testStat)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:449)
> at
> org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:435)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:913)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:894)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:856)
> at org.apache.hadoop.fs.FileSystem.createNewFile(FileSystem.java:1150)
> at
> org.apache.hadoop.fs.shell.TestCopyPreserveFlag.initialize(TestCopyPreserveFlag.java:72)
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
