[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068935#comment-14068935
]
Colin Patrick McCabe commented on HDFS-6707:
Good find, Yongjun.
Parsing the output of this shell command is definitely worrisome. It has been
the source of bunch of bugs in the past. Unfortunately, even if we came up
with a JNI method to do this, not everyone would use it, so here we are.
Can we do this by skipping over the first code point following the comma,
rather than by looking for a specific quote type? That seems more flexible in
case there are any more wacky variants.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068965#comment-14068965
]
Yongjun Zhang commented on HDFS-6707:
-
HI Colin, thanks for the comments. Same feelings on my side that I wish we
don't have to depend on parsing shell output.
If you look at the patch, you can see that I've already got rid of the
dependency on quote type, I used - as the separator to find the link target,
which hopefully is more robust.
Thanks.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068990#comment-14068990
]
Colin Patrick McCabe commented on HDFS-6707:
+1 once you add a unit test to TestStat.java (and pending Jenkins, of course)
Thanks, Yongjun.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069032#comment-14069032
]
Yongjun Zhang commented on HDFS-6707:
-
Thanks Colin, will do!
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067812#comment-14067812
]
Yongjun Zhang commented on HDFS-6707:
-
https://builds.apache.org/job/PreCommit-HDFS-Build/7392//testReport/ and
https://builds.apache.org/job/PreCommit-HDFS-Build/7405//testReport/ were
results from two runs on the same host
Slave H4 (Build slave for Hadoop project builds : asf904.gq1.ygridcore.net).
The latter one is with patch 004, which resolved all symlinks failures reported
in run 7392.
The root cause is that on this kind of host, the command {{stat -c
%s,%F,%Y,%X,%a,%U,%G,%N target}} gives
{code}
6,symbolic link,6,1373584236,1373584236,lrwxrwxrwx,andrew,andrew,'link' -
'target'
{code}
kind of result instead of
{code}
6,symbolic link,6,1373584236,1373584236,lrwxrwxrwx,andrew,andrew,`link' -
`target'
{code}.
The former is not handled currently. The patch is introduced to handle both.
Since this fix is to fix existing tests, I didn't try to introduce additional
tests.
Hi [~cmccabe], would you please help review again? thanks.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067431#comment-14067431
]
Hadoop QA commented on HDFS-6707:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12656709/HDFS-6707.002.dbg.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.fs.TestDFVariations
org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
org.apache.hadoop.ipc.TestIPC
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/7400//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7400//console
This message is automatically generated.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067597#comment-14067597
]
Hadoop QA commented on HDFS-6707:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12656732/HDFS-6707.003.dbg.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.fs.shell.TestCopyPreserveFlag
org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
org.apache.hadoop.fs.shell.TestTextCommand
org.apache.hadoop.ipc.TestIPC
org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
org.apache.hadoop.fs.shell.TestPathData
org.apache.hadoop.fs.TestDFVariations
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/7402//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7402//console
This message is automatically generated.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067810#comment-14067810
]
Hadoop QA commented on HDFS-6707:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12656775/HDFS-6707.004.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:red}-1 tests included{color}. The patch doesn't appear to include
any new or modified tests.
Please justify why no new tests are needed for this
patch.
Also please list what manual steps were performed to
verify this patch.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.ipc.TestIPC
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/7405//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7405//console
This message is automatically generated.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch, HDFS-6707.002.dbg.patch,
HDFS-6707.003.dbg.patch, HDFS-6707.004.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067077#comment-14067077
]
Colin Patrick McCabe commented on HDFS-6707:
I hope I didn't miss anything when reading the patch, but if you create the
file that the symlink is pointing to, isn't this no longer testing dangling
symlinks? Try making the delete the first thing you do, and see if that helps
you reliably reproduce the problem.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067183#comment-14067183
]
Hadoop QA commented on HDFS-6707:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12656590/HDFS-6707.001.patch
against trunk revision .
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 1 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-common-project/hadoop-common:
org.apache.hadoop.fs.TestSymlinkLocalFSFileSystem
org.apache.hadoop.metrics2.impl.TestMetricsSystemImpl
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext
org.apache.hadoop.ipc.TestIPC
{color:green}+1 contrib tests{color}. The patch passed contrib unit tests.
Test results:
https://builds.apache.org/job/PreCommit-HDFS-Build/7392//testReport/
Console output: https://builds.apache.org/job/PreCommit-HDFS-Build/7392//console
This message is automatically generated.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067198#comment-14067198
]
Yongjun Zhang commented on HDFS-6707:
-
Thanks [~cmccabe].
The problem I saw is, without creating the file, the first call
{{wrapper.createSymlink(fileAbs, link, false);}} would fail because the source
file doesn't exist. The patch I did was, to create the file first, then create
the link, then delete the file, then check the danglng link. I thought that's
what the test intended to do.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067213#comment-14067213
]
Yongjun Zhang commented on HDFS-6707:
-
Though jenkins has sent out email notification of the test result, clicking on
https://builds.apache.org/job/PreCommit-HDFS-Build/7392// shows that the test
job is stuck at:
{quote}
Description set: HDFS-6707
Recording test results
Publish JUnit test result report is waiting for a checkpoint on
PreCommit-HDFS-Build #7389
{code}
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067240#comment-14067240
]
Yongjun Zhang commented on HDFS-6707:
-
Sorry I was mistaken, linking with missing source file actually will create a
link... let me look further. thanks.
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
[jira] [Commented] (HDFS-6707) Intermittent failure of Symlink tests TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
[
https://issues.apache.org/jira/browse/HDFS-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067281#comment-14067281
]
Yongjun Zhang commented on HDFS-6707:
-
The real problem is, somehow on the machine used upstream, the isSymlink() in
the code below returned false (it returns true when I ran locally)
{code}
/**
* @return The contents of the symbolic link.
*/
public Path getSymlink() throws IOException {
if (!isSymlink()) {
throw new IOException(Path + path + is not a symbolic link);
}
return symlink;
}
{code}
I wonder if anything is special about this type of test slave Slave {{H4 (Build
slave for Hadoop project builds : asf904.gq1.ygridcore.net)}}
Intermittent failure of Symlink tests
TestSymlinkLocalFSFileContext,TestSymlinkLocalFSFileSystem
-
Key: HDFS-6707
URL: https://issues.apache.org/jira/browse/HDFS-6707
Project: Hadoop HDFS
Issue Type: Bug
Components: symlinks
Affects Versions: 2.5.0
Reporter: Yongjun Zhang
Assignee: Yongjun Zhang
Attachments: HDFS-6707.001.patch
Symlink tests failure happened from time to time,
https://builds.apache.org/job/PreCommit-HDFS-Build/7383//testReport/
https://builds.apache.org/job/PreCommit-HDFS-Build/7376/testReport/
{code}
Failed
org.apache.hadoop.fs.TestSymlinkLocalFSFileContext.testDanglingLink
Failing for the past 1 build (Since Failed#7376 )
Took 83 ms.
Error Message
Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
Stacktrace
java.io.IOException: Path
file:/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile
is not a symbolic link
at org.apache.hadoop.fs.FileStatus.getSymlink(FileStatus.java:266)
at
org.apache.hadoop.fs.TestSymlinkLocalFS.testDanglingLink(TestSymlinkLocalFS.java:163)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Standard Output
2014-07-17 23:31:37,770 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test2/linkToFile':
No such file or directory
2014-07-17 23:31:38,109 WARN fs.FileUtil (FileUtil.java:symLink(829)) -
Command 'ln -s
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/file
/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile'
failed 1 with: ln: failed to create symbolic link
'/home/jenkins/jenkins-slave/workspace/PreCommit-HDFS-Build/trunk/hadoop-common-project/hadoop-common/target/test/data/RtGBheUh4y/test1/linkToFile':
File exists
{code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
