[
https://issues.apache.org/jira/browse/HDFS-13503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16457176#comment-16457176
]
Xiao Liang commented on HDFS-13503:
-----------------------------------
Sure, added [^HDFS-13503.000.patch] for trunk.
Before [^HDFS-13503.000.patch] the test result for trunk is:
{color:#d04437}[INFO]
-------------------------------------------------------{color}
{color:#d04437}[INFO] T E S T S{color}
{color:#d04437}[INFO]
-------------------------------------------------------{color}
{color:#d04437}[INFO] Running
org.apache.hadoop.hdfs.server.namenode.TestFsck{color}
{color:#d04437}[ERROR] Tests run: 32, Failures: 0, Errors: 1, Skipped: 0, Time
elapsed: 209.85 s <<< FAILURE! - in
org.apache.hadoop.hdfs.server.namenode.TestFsck{color}
{color:#d04437}[ERROR]
testFsckUpgradeDomain(org.apache.hadoop.hdfs.server.namenode.TestFsck) Time
elapsed: 1.943 s <<< ERROR!{color}
{color:#d04437}java.io.IOException: Could not fully delete
D:\Git\Hadoop\hadoop-hdfs-project\hadoop-hdfs\target\test\data\dfs\name-0-1{color}
{color:#d04437} at
org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1031){color}
{color:#d04437} at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:952){color}
{color:#d04437} at
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:884){color}
{color:#d04437} at
org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:517){color}
{color:#d04437} at
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:476){color}
{color:#d04437} at
org.apache.hadoop.hdfs.server.namenode.TestFsck.testUpgradeDomain(TestFsck.java:2255){color}
{color:#d04437} at
org.apache.hadoop.hdfs.server.namenode.TestFsck.testFsckUpgradeDomain(TestFsck.java:2230){color}
{color:#d04437} at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method){color}
{color:#d04437} at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62){color}
{color:#d04437} at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43){color}
{color:#d04437} at java.lang.reflect.Method.invoke(Method.java:498){color}
{color:#d04437} at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47){color}
{color:#d04437} at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12){color}
{color:#d04437} at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44){color}
{color:#d04437} at
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17){color}
{color:#d04437} at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74){color}
{color:#d04437}[INFO]{color}
{color:#d04437}[INFO] Results:{color}
{color:#d04437}[INFO]{color}
{color:#d04437}[ERROR] Errors:{color}
{color:#d04437}[ERROR]
TestFsck.testFsckUpgradeDomain:2230->testUpgradeDomain:2255 » IO Could not
ful...{color}
{color:#d04437}[INFO]{color}
{color:#d04437}[ERROR] Tests run: 32, Failures: 0, Errors: 1, Skipped: 0{color}
{color:#d04437}[INFO]{color}
{color:#d04437}[INFO]
------------------------------------------------------------------------{color}
{color:#d04437}[INFO] BUILD FAILURE{color}
{color:#d04437}[INFO]
------------------------------------------------------------------------{color}
{color:#d04437}[INFO] Total time: 03:41 min{color}
{color:#d04437}[INFO] Finished at: 2018-04-27T14:33:26-07:00{color}
{color:#d04437}[INFO] Final Memory: 34M/651M{color}
{color:#d04437}[INFO]
------------------------------------------------------------------------{color}
{color:#d04437}[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.21.0:test (default-test) on
project hadoop-hdfs: There are test failures.{color}
{color:#d04437}[ERROR]{color}
{color:#d04437}[ERROR] Please refer to
D:\Git\Hadoop\hadoop-hdfs-project\hadoop-hdfs\target\surefire-reports for the
individual test results.{color}
{color:#d04437}[ERROR] Please refer to dump files (if any exist)
[date]-jvmRun[N].dump, [date].dumpstream and [date]-jvmRun[N].dumpstream.{color}
{color:#d04437}[ERROR] -> [Help 1]{color}
{color:#d04437}[ERROR]{color}
{color:#d04437}[ERROR] To see the full stack trace of the errors, re-run Maven
with the -e switch.{color}
{color:#d04437}[ERROR] Re-run Maven using the -X switch to enable full debug
logging.{color}
{color:#d04437}[ERROR]{color}
{color:#d04437}[ERROR] For more information about the errors and possible
solutions, please read the following articles:{color}
{color:#d04437}[ERROR] [Help 1]
[http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException]{color}
With [^HDFS-13503.000.patch] it's:
{color:#14892c}[INFO]
-------------------------------------------------------{color}
{color:#14892c}[INFO] T E S T S{color}
{color:#14892c}[INFO]
-------------------------------------------------------{color}
{color:#14892c}[INFO] Running
org.apache.hadoop.hdfs.server.namenode.TestFsck{color}
{color:#14892c}[INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0, Time
elapsed: 198.985 s - in org.apache.hadoop.hdfs.server.namenode.TestFsck{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Results:{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] Tests run: 32, Failures: 0, Errors: 0, Skipped: 0{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO]{color}
{color:#14892c}[INFO] --- maven-antrun-plugin:1.7:run (hdfs-test-bats-driver) @
hadoop-hdfs ---{color}
{color:#14892c}[INFO] Executing tasks{color}
{color:#14892c}main:{color}
{color:#14892c} [exec] which: no bats in
(/mingw64/bin:/usr/bin:/c/Users/helian/bin:/d/Git/MT/Tools/java/bin:/d/Git/MT/Tools/java/jre/bin/server:/d/Git{color}
{color:#14892c} [exec]{color}
{color:#14892c} [exec]{color}
{color:#14892c} [exec] ERROR: bats not installed. Skipping bash tests.{color}
{color:#14892c} [exec] ERROR: Please install bats as soon as possible.{color}
{color:#14892c} [exec]{color}
{color:#14892c} [exec]{color}
{color:#14892c} [exec]
/MT/Tools/Maven/bin:/d/Git/MT/Tools/protobuf/bin:/d/Git/MT/Tools/Cmake/bin:/d/Git/MT/Tools/zlib128:/d/Git/MT/Tools/Python34:/bin/git.exe:/d/Git/MT/Tools/Python34/Scripts:/c/Windows/Microsoft.NET/Framework64/v4.0.30319:/bin:/c/Program
Files/Microsoft MPI/Bin:/c/ProgramData/Oracle/Java/javapath:/c/Program Files
(x86)/Intel/iCLS Client:/c/Program Files/Intel/iCLS Client:/c/Program
Files/Common Files/Microsoft Shared/Microsoft Online Services:/c/Program Files
(x86)/Common Files/Microsoft Shared/Microsoft Online
Services:/c/windows/system32:/c/windows:/c/windows/System32/Wbem:/c/windows/System32/WindowsPowerShell/v1.0:/c/Program
Files/Intel/Intel(R) Management Engine Components/DAL:/c/Program
Files/Intel/Intel(R) Management Engine Components/IPT:/c/Program Files
(x86)/Intel/Intel(R) Management Engine Components/DAL:/c/Program Files
(x86)/Intel/Intel(R) Management Engine Components/IPT:/c/Program Files
(x86)/ATI Technologies/ATI.ACE/Core-Static:/c/Users/helian/.dnx/bin:/c/Program
Files/Microsoft DNX/Dnvm:/c/Program Files/Microsoft SQL
Server/120/Tools/Binn:/c/Program Files (x86)/nodejs:/c/Program
Files/Microsoft/Web Platform Installer:/c/Program Files (x86)/Magellan Toolset
4.75:/tmp/pipelinetools:/c/WINDOWS/system32:/c/WINDOWS:/c/WINDOWS/System32/Wbem:/c/WINDOWS/System32/WindowsPowerShell/v1.0:/c/Program
Files (x86)/Skype/Phone:/c/Program Files/Microsoft SQL
Server/130/Tools/Binn:/c/GITCF:/c/WINDOWS/system32:/c/WINDOWS:/c/WINDOWS/System32/Wbem:/c/WINDOWS/System32/WindowsPowerShell/v1.0:/c/Program
Files (x86)/Microsoft SQL Server/100/Tools/Binn:/c/Program Files/Microsoft SQL
Server/100/Tools/Binn:/c/Program Files/Microsoft SQL
Server/100/DTS/Binn:/c/Program Files (x86)/scala/bin:/c/Program
Files/WIDCOMM/Bluetooth Software:/c/Program Files/WIDCOMM/Bluetooth
Software/syswow64:/c/Program Files/dotnet:/c/Program Files
(x86)/GtkSharp/2.12/bin:/cmd:/c/Program Files
(x86)/Gow/bin:/c/Users/helian/.dnx/bin:/c/Users/helian/AppData/Roaming/npm:/e/ClientGoldEnlistment:/c/Program
Files (x86)/Microsoft VS
Code/bin:/c/Users/helian/AppData/Local/Microsoft/WindowsApps:/c/Program Files
(x86)/Microsoft Visual Studio 14.0/Common7/IDE){color}
{color:#14892c}[INFO] Executed tasks{color}
{color:#14892c}[INFO]
------------------------------------------------------------------------{color}
{color:#14892c}[INFO] BUILD SUCCESS{color}
{color:#14892c}[INFO]
------------------------------------------------------------------------{color}
{color:#14892c}[INFO] Total time: 03:29 min{color}
{color:#14892c}[INFO] Finished at: 2018-04-27T15:14:55-07:00{color}
{color:#14892c}[INFO] Final Memory: 35M/722M{color}
{color:#14892c}[INFO]
------------------------------------------------------------------------{color}
> Fix TestFsck test failures on Windows
> -------------------------------------
>
> Key: HDFS-13503
> URL: https://issues.apache.org/jira/browse/HDFS-13503
> Project: Hadoop HDFS
> Issue Type: Test
> Components: hdfs
> Reporter: Xiao Liang
> Assignee: Xiao Liang
> Priority: Major
> Labels: windows
> Attachments: HDFS-13503-branch-2.000.patch, HDFS-13503.000.patch
>
>
> Test failures on Windows caused by the same reason as HDFS-13336, similar fix
> needed for TestFsck basing on HDFS-13408.
> MiniDFSCluster also needs a small fix for the getStorageDir() interface,
> which should use determineDfsBaseDir() to get the correct path of the data
> directory.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
