[jira] [Commented] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951903#comment-14951903
]
Brahma Reddy Battula commented on HDFS-9224:
testcase failures and release auditwarnings are unrelated..Kindly review...
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
>Affects Versions: 3.0.0
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
> at
> org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951891#comment-14951891
]
Hadoop QA commented on HDFS-9224:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 8m 53s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 8m 37s | There were no new javac warning
messages. |
| {color:red}-1{color} | release audit | 0m 17s | The applied patch generated
1 release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 31s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 37s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 36s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 2m 41s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 1m 10s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 193m 24s | Tests failed in hadoop-hdfs. |
| | | 218m 50s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.server.namenode.TestFSNamesystem |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765981/HDFS-9224.patch |
| Optional Tests | javac unit findbugs checkstyle |
| git revision | trunk / 7e2c971 |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12922/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12922/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12922/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12922/console |
This message was automatically generated.
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
>Affects Versions: 3.0.0
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
>
[jira] [Commented] (HDFS-9170) Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client
[ https://issues.apache.org/jira/browse/HDFS-9170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951920#comment-14951920 ] Eric Payne commented on HDFS-9170: -- [~wheat9], yes, changing the value in CMakeLists.txt to 2.6 allowed me to build with cmake 2.6. > Move libhdfs / fuse-dfs / libwebhdfs to hdfs-client > --- > > Key: HDFS-9170 > URL: https://issues.apache.org/jira/browse/HDFS-9170 > Project: Hadoop HDFS > Issue Type: Sub-task >Reporter: Haohui Mai >Assignee: Haohui Mai > Fix For: 2.8.0 > > Attachments: HDFS-9170.000.patch, HDFS-9170.001.patch, > HDFS-9170.002.patch, HDFS-9170.003.patch, HDFS-9170.004.patch, > native-package-build-fails-with-cmake-2.5.log > > > After HDFS-6200 the Java implementation of hdfs-client has be moved to a > separate hadoop-hdfs-client module. > libhdfs, fuse-dfs and libwebhdfs still reside in the hadoop-hdfs module. > Ideally these modules should reside in the hadoop-hdfs-client. However, to > write unit tests for these components, it is often necessary to run > MiniDFSCluster which resides in the hadoop-hdfs module. > This jira is to discuss how these native modules should layout after > HDFS-6200. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Updated] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
[
https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki updated HDFS-9225:
---
Attachment: HDFS-9225.001.patch
The cause seems to be {{TestBlockManager#addBlockOnNodes}} mocking FSNamesytem
while the thread launched by {{BlockManager#processMisReplicatedBlocks}} is
accessing it.
There are another problems to use {{BlockManager#processMisReplicatedBlocks}}
in the test.
* It is asynchronous and there is no way to wait for it finishes.
* It is no-op if {{FSNamesystem#isRunning}} returns false.
The patch makes test checks the condition by itself instead of calling
{{BlockManager#processMisReplicatedBlocks}}.
> Fix intermittent test failure of
> TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
> -
>
> Key: HDFS-9225
> URL: https://issues.apache.org/jira/browse/HDFS-9225
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
> Attachments: HDFS-9225.001.patch
>
>
> TestBlockManager#testBlocksAreNotUnderreplicatedInSingleRack sometimes fails
> in QA build due to mocking.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
[ https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-9225: --- Status: Patch Available (was: Open) > Fix intermittent test failure of > TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack > - > > Key: HDFS-9225 > URL: https://issues.apache.org/jira/browse/HDFS-9225 > Project: Hadoop HDFS > Issue Type: Bug > Components: test >Reporter: Masatake Iwasaki >Assignee: Masatake Iwasaki >Priority: Minor > Attachments: HDFS-9225.001.patch > > > TestBlockManager#testBlocksAreNotUnderreplicatedInSingleRack sometimes fails > in QA build due to mocking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8676) Delayed rolling upgrade finalization can cause heartbeat expiration
[
https://issues.apache.org/jira/browse/HDFS-8676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952163#comment-14952163
]
Hadoop QA commented on HDFS-8676:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 25m 11s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 9m 37s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 54s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 17s | The applied patch generated
1 release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 45s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 37s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 37s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 2m 38s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 28s | Pre-build of native portion |
| {color:green}+1{color} | hdfs tests | 224m 30s | Tests passed in hadoop-hdfs.
|
| | | 280m 37s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765752/HDFS-8676.02.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 7e2c971 |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12923/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12923/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12923/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf909.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12923/console |
This message was automatically generated.
> Delayed rolling upgrade finalization can cause heartbeat expiration
> ---
>
> Key: HDFS-8676
> URL: https://issues.apache.org/jira/browse/HDFS-8676
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Kihwal Lee
>Assignee: Walter Su
>Priority: Critical
> Attachments: HDFS-8676.01.patch, HDFS-8676.02.patch
>
>
> In big busy clusters where the deletion rate is also high, a lot of blocks
> can pile up in the datanode trash directories until an upgrade is finalized.
> When it is finally finalized, the deletion of trash is done in the service
> actor thread's context synchronously. This blocks the heartbeat and can
> cause heartbeat expiration.
> We have seen a namenode losing hundreds of nodes after a delayed upgrade
> finalization. The deletion of trash directories should be made asynchronous.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
[
https://issues.apache.org/jira/browse/HDFS-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14952155#comment-14952155
]
Masatake Iwasaki commented on HDFS-9225:
{noformat}
org.mockito.exceptions.misusing.WrongTypeOfReturnValue:
BlockCollection$$EnhancerByMockitoWithCGLIB$$da353aed cannot be returned by
isRunning()
isRunning() should return boolean
at
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.addBlockOnNodes(TestBlockManager.java:443)
at
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.doTestSingleRackClusterIsSufficientlyReplicated(TestBlockManager.java:376)
at
org.apache.hadoop.hdfs.server.blockmanagement.TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack(TestBlockManager.java:368)
{noformat}
> Fix intermittent test failure of
> TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
> -
>
> Key: HDFS-9225
> URL: https://issues.apache.org/jira/browse/HDFS-9225
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
>Reporter: Masatake Iwasaki
>Assignee: Masatake Iwasaki
>Priority: Minor
>
> TestBlockManager#testBlocksAreNotUnderreplicatedInSingleRack sometimes fails
> in QA build due to mocking.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HDFS-9225) Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack
Masatake Iwasaki created HDFS-9225: -- Summary: Fix intermittent test failure of TestBlockManager.testBlocksAreNotUnderreplicatedInSingleRack Key: HDFS-9225 URL: https://issues.apache.org/jira/browse/HDFS-9225 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Masatake Iwasaki Assignee: Masatake Iwasaki Priority: Minor TestBlockManager#testBlocksAreNotUnderreplicatedInSingleRack sometimes fails in QA build due to mocking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-8438) Erasure Coding: Allow concat striped files if they have the same ErasureCodingPolicy
[
https://issues.apache.org/jira/browse/HDFS-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951717#comment-14951717
]
Hadoop QA commented on HDFS-8438:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 20m 16s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 9m 3s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 11m 40s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 21s | The applied patch generated
1 release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 34s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 41s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 37s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 2m 53s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 37s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 209m 59s | Tests failed in hadoop-hdfs. |
| | | 261m 45s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.server.namenode.TestFSNamesystem |
| | hadoop.hdfs.server.namenode.TestDeleteRace |
| Timed out tests | org.apache.hadoop.hdfs.server.namenode.TestFsck |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765961/HDFS-8438.01.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / def374e |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12913/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12913/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12913/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf901.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12913/console |
This message was automatically generated.
> Erasure Coding: Allow concat striped files if they have the same
> ErasureCodingPolicy
>
>
> Key: HDFS-8438
> URL: https://issues.apache.org/jira/browse/HDFS-8438
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Walter Su
>Assignee: Walter Su
> Attachments: HDFS-8438.01.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951637#comment-14951637 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2453 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2453/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs/pom.xml * LICENSE.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951657#comment-14951657 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #519 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/519/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951671#comment-14951671 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1245 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1245/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs/pom.xml * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * LICENSE.txt * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951672#comment-14951672 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1245 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/1245/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951738#comment-14951738 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #480 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/480/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951737#comment-14951737 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #480 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/480/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs/pom.xml * LICENSE.txt * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951755#comment-14951755 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2418 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2418/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951754#comment-14951754 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2418 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2418/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/pom.xml * LICENSE.txt * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HDFS-8558) Remove the use of hard-coded cell size value in balancer Dispatcher
[
https://issues.apache.org/jira/browse/HDFS-8558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Walter Su resolved HDFS-8558.
-
Resolution: Duplicate
fixed by HDFS-8882.
> Remove the use of hard-coded cell size value in balancer Dispatcher
> ---
>
> Key: HDFS-8558
> URL: https://issues.apache.org/jira/browse/HDFS-8558
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: Kai Zheng
>Assignee: Walter Su
> Fix For: HDFS-7285
>
>
> This is part of work in HDFS-8494. To make it easy and discuss this case
> better, open this issue to remove the use of hard-coded cell size value in
> balancer Dispatcher separately. Also copied some good comments here:
> From [~walter.k.su]:
> {quote}
> It's easy to pass cellSize from BlockInfoStriped to Dispatcher. But the
> question is BlockInfoStriped doesn't have it.
> You have to get it by: BlockInfoStriped --> getBlockCollection --> getZone
> --> getCellSize. A bit complicated, isn't it?
> I think BlockInfoStriped needs to keep cellSize.
> {quote}
> From [~vinayrpet]:
> {quote}
> I too was thinking the same when the FSImageLoader problem has came up. This
> will increase the memory usage by ~4bytes for each block though.
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9184) Logging HDFS operation's caller context into audit logs
[
https://issues.apache.org/jira/browse/HDFS-9184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951646#comment-14951646
]
Hadoop QA commented on HDFS-9184:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 26m 16s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | javac | 12m 17s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 12m 56s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 23s | The applied patch generated
1 release audit warnings. |
| {color:red}-1{color} | checkstyle | 2m 39s | The applied patch generated 9
new checkstyle issues (total was 229, now 237). |
| {color:green}+1{color} | whitespace | 0m 1s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 2m 3s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 45s | The patch built with
eclipse:eclipse. |
| {color:red}-1{color} | findbugs | 6m 33s | The patch appears to introduce 2
new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | common tests | 10m 28s | Tests failed in
hadoop-common. |
| {color:red}-1{color} | hdfs tests | 149m 16s | Tests failed in hadoop-hdfs. |
| | | 224m 4s | |
\\
\\
|| Reason || Tests ||
| FindBugs | module:hadoop-hdfs |
| Failed unit tests | hadoop.fs.shell.find.TestName |
| | hadoop.fs.shell.find.TestIname |
| | hadoop.fs.TestLocalFsFCStatistics |
| | hadoop.fs.shell.find.TestFind |
| | hadoop.ipc.TestIPC |
| | hadoop.ha.TestZKFailoverController |
| | hadoop.security.ssl.TestReloadingX509TrustManager |
| | hadoop.test.TestTimedOutTestsListener |
| | hadoop.fs.shell.find.TestPrint |
| | hadoop.hdfs.TestWriteRead |
| | hadoop.hdfs.server.namenode.snapshot.TestCheckpointsWithSnapshots |
| | hadoop.hdfs.server.namenode.ha.TestDNFencing |
| | hadoop.hdfs.server.namenode.ha.TestStandbyIsHot |
| | hadoop.hdfs.TestRollingUpgrade |
| | hadoop.hdfs.TestHFlush |
| | hadoop.hdfs.TestParallelRead |
| | hadoop.hdfs.TestBlockReaderLocalLegacy |
| | hadoop.hdfs.server.namenode.TestAuditLogger |
| | hadoop.hdfs.server.namenode.TestXAttrConfigFlag |
| | hadoop.hdfs.TestPread |
| | hadoop.hdfs.TestDFSStripedOutputStream |
| | hadoop.hdfs.TestWriteConfigurationToDFS |
| | hadoop.hdfs.TestDFSRollback |
| | hadoop.hdfs.TestDataTransferKeepalive |
| | hadoop.hdfs.TestDFSFinalize |
| | hadoop.hdfs.server.namenode.ha.TestDNFencingWithReplication |
| | hadoop.hdfs.server.namenode.metrics.TestNNMetricFilesInGetListingOps |
| | hadoop.hdfs.server.namenode.snapshot.TestNestedSnapshots |
| | hadoop.hdfs.server.namenode.ha.TestHASafeMode |
| | hadoop.hdfs.TestDFSShell |
| | hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA |
| | hadoop.hdfs.TestSeekBug |
| | hadoop.hdfs.TestCrcCorruption |
| | hadoop.hdfs.server.namenode.TestStorageRestore |
| | hadoop.hdfs.TestAbandonBlock |
| | hadoop.hdfs.TestGetFileChecksum |
| | hadoop.hdfs.server.namenode.TestBlockUnderConstruction |
| | hadoop.hdfs.TestSafeModeWithStripedFile |
| |
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary |
| | hadoop.hdfs.TestFileCreationDelete |
| | hadoop.hdfs.TestReadWhileWriting |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 |
| | hadoop.hdfs.security.TestDelegationToken |
| | hadoop.hdfs.server.namenode.ha.TestHAAppend |
| | hadoop.hdfs.TestMissingBlocksAlert |
| | hadoop.hdfs.TestBlocksScheduledCounter |
| | hadoop.hdfs.TestSmallBlock |
| | hadoop.hdfs.TestDFSClientRetries |
| | hadoop.hdfs.TestDFSMkdirs |
| | hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd |
| | hadoop.hdfs.server.namenode.ha.TestFailureToReadEdits |
| | hadoop.hdfs.server.namenode.TestNameNodeMXBean |
| | hadoop.hdfs.server.namenode.TestLargeDirectoryDelete |
| | hadoop.hdfs.server.namenode.TestDeleteRace |
| | hadoop.hdfs.TestFSInputChecker |
| | hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA |
| | hadoop.hdfs.server.namenode.ha.TestHAMetrics |
| | hadoop.hdfs.TestRollingUpgradeRollback |
| | hadoop.hdfs.TestRemoteBlockReader |
| | hadoop.hdfs.TestBlockStoragePolicy |
| | hadoop.hdfs.TestLeaseRecovery |
| | hadoop.hdfs.server.namenode.TestBackupNode |
| | hadoop.hdfs.TestBlockReaderLocal |
| | hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForXAttr |
| | hadoop.hdfs.tools.TestDebugAdmin |
| | hadoop.hdfs.TestReadStripedFileWithDecoding |
| | hadoop.hdfs.TestLargeBlock |
| | hadoop.hdfs.server.namenode.TestFSNamesystemMBean |
| |
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951648#comment-14951648 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #508 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/508/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951647#comment-14951647 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #508 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/508/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * LICENSE.txt * hadoop-hdfs-project/hadoop-hdfs/pom.xml > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9222) Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client
[ https://issues.apache.org/jira/browse/HDFS-9222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951666#comment-14951666 ] Hudson commented on HDFS-9222: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2454 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2454/]) HDFS-9222. Add hadoop-hdfs-client as a dependency of (wheat9: rev 18950c0a551e4af973981d6de507efd90a2a0454) * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml > Add hadoop-hdfs-client as a dependency of hadoop-hdfs-native-client > --- > > Key: HDFS-9222 > URL: https://issues.apache.org/jira/browse/HDFS-9222 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Mingliang Liu > Fix For: 2.8.0 > > Attachments: HDFS-9222.000.patch > > > libhdfs requires the jars in hadoop-hdfs-client in order to work. This jira > proposes to add the missing dependency in hadoop-hdfs-native-client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Issue Comment Deleted] (HDFS-9053) Support large directories efficiently using B-Tree
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yi Liu updated HDFS-9053:
-
Comment: was deleted
(was: \\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 22m 41s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 8 new or modified test files. |
| {color:green}+1{color} | javac | 8m 55s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 11m 28s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 22s | The applied patch generated
1 release audit warnings. |
| {color:red}-1{color} | checkstyle | 2m 6s | The applied patch generated 8
new checkstyle issues (total was 0, now 8). |
| {color:red}-1{color} | whitespace | 0m 10s | The patch has 1 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 47s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 38s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 4m 47s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | common tests | 7m 48s | Tests passed in
hadoop-common. |
| {color:red}-1{color} | hdfs tests | 120m 50s | Tests failed in hadoop-hdfs. |
| | | 181m 56s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.TestWriteRead |
| | hadoop.hdfs.server.namenode.ha.TestDNFencing |
| | hadoop.hdfs.TestHFlush |
| | hadoop.security.TestPermission |
| | hadoop.hdfs.TestParallelRead |
| | hadoop.fs.viewfs.TestViewFsHdfs |
| | hadoop.hdfs.TestBlockReaderLocalLegacy |
| | hadoop.hdfs.server.namenode.TestXAttrConfigFlag |
| | hadoop.hdfs.TestPread |
| | hadoop.hdfs.TestMiniDFSCluster |
| | hadoop.hdfs.TestDFSStripedOutputStream |
| | hadoop.hdfs.TestWriteConfigurationToDFS |
| | hadoop.hdfs.TestDatanodeRegistration |
| | hadoop.hdfs.web.TestWebHDFSXAttr |
| | hadoop.hdfs.TestDFSRollback |
| | hadoop.hdfs.TestDataTransferKeepalive |
| | hadoop.hdfs.server.namenode.ha.TestDelegationTokensWithHA |
| | hadoop.hdfs.TestDatanodeConfig |
| | hadoop.hdfs.TestDFSFinalize |
| | hadoop.hdfs.server.namenode.ha.TestGetGroupsWithHA |
| | hadoop.fs.TestWebHdfsFileContextMainOperations |
| | hadoop.fs.TestGlobPaths |
| | hadoop.hdfs.TestDFSShell |
| | hadoop.hdfs.tools.TestDFSHAAdminMiniCluster |
| | hadoop.hdfs.TestSeekBug |
| | hadoop.fs.loadGenerator.TestLoadGenerator |
| | hadoop.hdfs.TestCrcCorruption |
| | hadoop.fs.contract.hdfs.TestHDFSContractMkdir |
| | hadoop.hdfs.TestAbandonBlock |
| | hadoop.hdfs.TestGetFileChecksum |
| | hadoop.hdfs.TestSafeModeWithStripedFile |
| |
hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewerForContentSummary |
| | hadoop.hdfs.TestFileCreationDelete |
| | hadoop.hdfs.TestReadWhileWriting |
| | hadoop.fs.viewfs.TestViewFileSystemWithAcls |
| | hadoop.fs.contract.hdfs.TestHDFSContractConcat |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 |
| | hadoop.hdfs.util.TestDiff |
| | hadoop.hdfs.security.TestDelegationToken |
| | hadoop.fs.TestSymlinkHdfsDisable |
| | hadoop.fs.contract.hdfs.TestHDFSContractRootDirectory |
| | hadoop.hdfs.TestMissingBlocksAlert |
| | hadoop.hdfs.TestBlocksScheduledCounter |
| | hadoop.hdfs.TestSmallBlock |
| | hadoop.cli.TestDeleteCLI |
| | hadoop.hdfs.TestDFSClientRetries |
| | hadoop.fs.viewfs.TestViewFsWithXAttrs |
| | hadoop.hdfs.TestDFSMkdirs |
| | hadoop.hdfs.tools.TestDFSAdmin |
| | hadoop.hdfs.server.namenode.TestFavoredNodesEndToEnd |
| | hadoop.hdfs.server.namenode.TestNameNodeMXBean |
| | hadoop.hdfs.web.TestWebHDFSForHA |
| | hadoop.fs.viewfs.TestViewFsDefaultValue |
| | hadoop.fs.contract.hdfs.TestHDFSContractOpen |
| | hadoop.hdfs.server.namenode.TestDeleteRace |
| | hadoop.hdfs.TestFSInputChecker |
| | hadoop.hdfs.web.TestWebHdfsWithAuthenticationFilter |
| | hadoop.fs.contract.hdfs.TestHDFSContractRename |
| | hadoop.hdfs.server.namenode.ha.TestXAttrsWithHA |
| | hadoop.hdfs.server.namenode.ha.TestHAMetrics |
| | hadoop.cli.TestErasureCodingCLI |
| | hadoop.hdfs.TestRollingUpgradeRollback |
| | hadoop.hdfs.TestRemoteBlockReader |
| | hadoop.hdfs.server.namenode.TestNameNodeResourceChecker |
| | hadoop.hdfs.tools.TestDFSAdminWithHA |
| | hadoop.hdfs.TestBlockStoragePolicy |
| | hadoop.hdfs.TestLeaseRecovery |
| | hadoop.fs.viewfs.TestViewFsAtHdfsRoot |
| | hadoop.hdfs.TestBlockReaderLocal |
| | hadoop.fs.contract.hdfs.TestHDFSContractGetFileStatus |
| | hadoop.cli.TestCryptoAdminCLI |
| |
[jira] [Commented] (HDFS-9215) Suppress the RAT warnings in hdfs-native-client module
[ https://issues.apache.org/jira/browse/HDFS-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951656#comment-14951656 ] Hudson commented on HDFS-9215: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #519 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/519/]) HDFS-9215. Suppress the RAT warnings in hdfs-native-client module. (wheat9: rev d0c1e5fec4155cb8abb3e3b8cc9c049e239e1246) * hadoop-hdfs-project/hadoop-hdfs-native-client/pom.xml * hadoop-hdfs-project/hadoop-hdfs/pom.xml * hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * LICENSE.txt > Suppress the RAT warnings in hdfs-native-client module > -- > > Key: HDFS-9215 > URL: https://issues.apache.org/jira/browse/HDFS-9215 > Project: Hadoop HDFS > Issue Type: Bug >Reporter: Haohui Mai >Assignee: Haohui Mai >Priority: Minor > Fix For: 2.8.0 > > Attachments: HDFS-9215.000.patch, HDFS-9215.001.patch, > HDFS-9215.002.patch, HDFS-9215.003.patch > > > HDFS-9170 moves the native client implementation to the hdfs-native-client > module. This is a follow-up jira to suppress the RAT warning that was > suppressed in the original hadoop-hdfs module. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-9053) Support large directories efficiently using B-Tree
[
https://issues.apache.org/jira/browse/HDFS-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951674#comment-14951674
]
Hadoop QA commented on HDFS-9053:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | pre-patch | 17m 35s | Findbugs (version ) appears to
be broken on trunk. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 8 new or modified test files. |
| {color:green}+1{color} | javac | 7m 55s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 33s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 20s | The applied patch generated
1 release audit warnings. |
| {color:red}-1{color} | checkstyle | 1m 13s | The applied patch generated 8
new checkstyle issues (total was 0, now 8). |
| {color:red}-1{color} | whitespace | 0m 10s | The patch has 1 line(s) that
end in whitespace. Use git apply --whitespace=fix. |
| {color:green}+1{color} | install | 1m 30s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 35s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 4m 25s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | common tests | 7m 7s | Tests passed in
hadoop-common. |
| {color:green}+1{color} | hdfs tests | 190m 7s | Tests passed in hadoop-hdfs.
|
| | | 241m 41s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765801/HDFS-9053.006.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / def374e |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/artifact/patchprocess/diffcheckstylehadoop-common.txt
|
| whitespace |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/artifact/patchprocess/whitespace.txt
|
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/artifact/patchprocess/testrun_hadoop-common.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf902.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12911/console |
This message was automatically generated.
> Support large directories efficiently using B-Tree
> --
>
> Key: HDFS-9053
> URL: https://issues.apache.org/jira/browse/HDFS-9053
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: namenode
>Reporter: Yi Liu
>Assignee: Yi Liu
>Priority: Critical
> Attachments: HDFS-9053 (BTree with simple benchmark).patch, HDFS-9053
> (BTree).patch, HDFS-9053.001.patch, HDFS-9053.002.patch, HDFS-9053.003.patch,
> HDFS-9053.004.patch, HDFS-9053.005.patch, HDFS-9053.006.patch
>
>
> This is a long standing issue, we were trying to improve this in the past.
> Currently we use an ArrayList for the children under a directory, and the
> children are ordered in the list, for insert/delete, the time complexity is
> O\(n), (the search is O(log n), but insertion/deleting causes re-allocations
> and copies of arrays), for large directory, the operations are expensive. If
> the children grow to 1M size, the ArrayList will resize to > 1M capacity, so
> need > 1M * 8bytes = 8M (the reference size is 8 for 64-bits system/JVM)
> continuous heap memory, it easily causes full GC in HDFS cluster where
> namenode heap memory is already highly used. I recap the 3 main issues:
> # Insertion/deletion operations in large directories are expensive because
> re-allocations and copies of big arrays.
> # Dynamically allocate several MB continuous heap memory which will be
> long-lived can easily cause full GC problem.
> # Even most children are removed later, but the directory INode still
> occupies same size heap memory, since the ArrayList will never shrink.
> This JIRA is similar to HDFS-7174 created by [~kihwal], but use B-Tree to
> solve the problem suggested by [~shv].
> So the target of this JIRA is to implement a low memory footprint B-Tree and
> use it to replace ArrayList.
> If the elements size is not large (less than the maximum degree of B-Tree
> node), the B-Tree only has
[jira] [Updated] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option
[
https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
nijel updated HDFS-9157:
Attachment: HDFS-9157_3.patch
Patch updated to remove white space
Removed unwanted file in patch
please review
> [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option
> is specified as the only option
> ---
>
> Key: HDFS-9157
> URL: https://issues.apache.org/jira/browse/HDFS-9157
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: nijel
>Assignee: nijel
> Attachments: HDFS-9157_1.patch, HDFS-9157_2.patch, HDFS-9157_3.patch
>
>
> In both tools, if "-h" is specified as the only option, it throws error as
> input and output not specified.
> {noformat}
> master:/home/nijel/hadoop-3.0.0-SNAPSHOT/bin # ./hdfs oev -h
> Error parsing command-line options: Missing required options: o, i
> Usage: bin/hdfs oev [OPTIONS] -i INPUT_FILE -o OUTPUT_FILE
> {noformat}
> In code the parsing is happening before the "-h" option is verified
> Can add code to return after initial check.
> {code}
> if (argv.length == 1 && argv[1] == "-h") {
> printHelp();
> return 0;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8988) Use LightWeightHashSet instead of LightWeightLinkedSet in BlockManager#excessReplicateMap
[
https://issues.apache.org/jira/browse/HDFS-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951775#comment-14951775
]
Hadoop QA commented on HDFS-8988:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 18m 56s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 8m 15s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 38s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 19s | The applied patch generated
1 release audit warnings. |
| {color:red}-1{color} | checkstyle | 1m 26s | The applied patch generated 2
new checkstyle issues (total was 283, now 283). |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 32s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 36s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 2m 33s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 20s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 231m 49s | Tests failed in hadoop-hdfs. |
| | | 279m 27s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.hdfs.server.blockmanagement.TestNodeCount |
| | hadoop.hdfs.TestReplaceDatanodeOnFailure |
| | hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765949/HDFS-8988.002.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / fa5a54c |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12917/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| checkstyle |
https://builds.apache.org/job/PreCommit-HDFS-Build/12917/artifact/patchprocess/diffcheckstylehadoop-hdfs.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12917/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12917/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf905.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12917/console |
This message was automatically generated.
> Use LightWeightHashSet instead of LightWeightLinkedSet in
> BlockManager#excessReplicateMap
> -
>
> Key: HDFS-8988
> URL: https://issues.apache.org/jira/browse/HDFS-8988
> Project: Hadoop HDFS
> Issue Type: Improvement
>Reporter: Yi Liu
>Assignee: Yi Liu
> Attachments: HDFS-8988.001.patch, HDFS-8988.002.patch
>
>
> {code}
> public final Map excessReplicateMap =
> new HashMap<>();
> {code}
> {{LightWeightLinkedSet}} extends {{LightWeightHashSet}} and in addition it
> stores elements in double linked list to ensure ordered traversal. So it
> requires more memory for each entry (2 references = 8 + 8 bytes = 16 bytes,
> assume 64-bits system/JVM).
> I have traversed the source code, and we don't need ordered traversal for
> excess replicated blocks, so could use {{LightWeightHashSet}} to save memory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option
[
https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951794#comment-14951794
]
nijel commented on HDFS-9157:
-
bq. -1 release audit
As per my analysis this is not related to this patch.
bq.-1 hdfs tests
skipped tests are not related to this patch
thanks
> [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option
> is specified as the only option
> ---
>
> Key: HDFS-9157
> URL: https://issues.apache.org/jira/browse/HDFS-9157
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: nijel
>Assignee: nijel
> Attachments: HDFS-9157_1.patch, HDFS-9157_2.patch, HDFS-9157_3.patch
>
>
> In both tools, if "-h" is specified as the only option, it throws error as
> input and output not specified.
> {noformat}
> master:/home/nijel/hadoop-3.0.0-SNAPSHOT/bin # ./hdfs oev -h
> Error parsing command-line options: Missing required options: o, i
> Usage: bin/hdfs oev [OPTIONS] -i INPUT_FILE -o OUTPUT_FILE
> {noformat}
> In code the parsing is happening before the "-h" option is verified
> Can add code to return after initial check.
> {code}
> if (argv.length == 1 && argv[1] == "-h") {
> printHelp();
> return 0;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HDFS-9224:
---
Status: Patch Available (was: Open)
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
> at
> org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9157) [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option is specified as the only option
[
https://issues.apache.org/jira/browse/HDFS-9157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951765#comment-14951765
]
Hadoop QA commented on HDFS-9157:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 18m 25s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 2 new or modified test files. |
| {color:green}+1{color} | javac | 8m 5s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 18s | There were no new javadoc
warning messages. |
| {color:red}-1{color} | release audit | 0m 19s | The applied patch generated
1 release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 25s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 29s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 2m 33s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:green}+1{color} | native | 3m 11s | Pre-build of native portion |
| {color:red}-1{color} | hdfs tests | 194m 36s | Tests failed in hadoop-hdfs. |
| | | 240m 58s | |
\\
\\
|| Reason || Tests ||
| Timed out tests |
org.apache.hadoop.hdfs.TestDFSStripedOutputStreamWithFailure010 |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12765971/HDFS-9157_3.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / fa5a54c |
| Release Audit |
https://builds.apache.org/job/PreCommit-HDFS-Build/12918/artifact/patchprocess/patchReleaseAuditProblems.txt
|
| hadoop-hdfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/12918/artifact/patchprocess/testrun_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/12918/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf903.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/12918/console |
This message was automatically generated.
> [OEV and OIV] : Unnecessary parsing for mandatory arguements if "-h" option
> is specified as the only option
> ---
>
> Key: HDFS-9157
> URL: https://issues.apache.org/jira/browse/HDFS-9157
> Project: Hadoop HDFS
> Issue Type: Sub-task
>Reporter: nijel
>Assignee: nijel
> Attachments: HDFS-9157_1.patch, HDFS-9157_2.patch, HDFS-9157_3.patch
>
>
> In both tools, if "-h" is specified as the only option, it throws error as
> input and output not specified.
> {noformat}
> master:/home/nijel/hadoop-3.0.0-SNAPSHOT/bin # ./hdfs oev -h
> Error parsing command-line options: Missing required options: o, i
> Usage: bin/hdfs oev [OPTIONS] -i INPUT_FILE -o OUTPUT_FILE
> {noformat}
> In code the parsing is happening before the "-h" option is verified
> Can add code to return after initial check.
> {code}
> if (argv.length == 1 && argv[1] == "-h") {
> printHelp();
> return 0;
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HDFS-9224) TestFileTruncate fails intermittently
Brahma Reddy Battula created HDFS-9224:
--
Summary: TestFileTruncate fails intermittently
Key: HDFS-9224
URL: https://issues.apache.org/jira/browse/HDFS-9224
Project: Hadoop HDFS
Issue Type: Bug
Reporter: Brahma Reddy Battula
Assignee: Brahma Reddy Battula
https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
{noformat}
java.net.BindException: Problem binding to [localhost:8020]
java.net.BindException: Address already in use; For more details see:
http://wiki.apache.org/hadoop/BindException
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:414)
at sun.nio.ch.Net.bind(Net.java:406)
at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.apache.hadoop.ipc.Server.bind(Server.java:469)
at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
at org.apache.hadoop.ipc.Server.(Server.java:2399)
at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
at
org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
at
org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
at
org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
at
org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
at
org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
at
org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HDFS-9224:
---
Attachment: HDFS-9224.patch
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
> at
> org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14951798#comment-14951798
]
Brahma Reddy Battula commented on HDFS-9224:
Uploaded the patch to get random port.. Kindly review..
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
> at
> org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (HDFS-9224) TestFileTruncate fails intermittently
[
https://issues.apache.org/jira/browse/HDFS-9224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HDFS-9224:
-
Affects Version/s: 3.0.0
Component/s: test
> TestFileTruncate fails intermittently
> -
>
> Key: HDFS-9224
> URL: https://issues.apache.org/jira/browse/HDFS-9224
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: test
>Affects Versions: 3.0.0
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
> Attachments: HDFS-9224.patch
>
>
> https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/478/#showFailuresLink
> {noformat}
> java.net.BindException: Problem binding to [localhost:8020]
> java.net.BindException: Address already in use; For more details see:
> http://wiki.apache.org/hadoop/BindException
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:414)
> at sun.nio.ch.Net.bind(Net.java:406)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:214)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.apache.hadoop.ipc.Server.bind(Server.java:469)
> at org.apache.hadoop.ipc.Server$Listener.(Server.java:646)
> at org.apache.hadoop.ipc.Server.(Server.java:2399)
> at org.apache.hadoop.ipc.RPC$Server.(RPC.java:945)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server.(ProtobufRpcEngine.java:535)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine.getServer(ProtobufRpcEngine.java:510)
> at org.apache.hadoop.ipc.RPC$Builder.build(RPC.java:787)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.(NameNodeRpcServer.java:358)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createRpcServer(NameNode.java:692)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:630)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:833)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:812)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1505)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1248)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1017)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:889)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:821)
> at org.apache.hadoop.hdfs.MiniDFSCluster.(MiniDFSCluster.java:480)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:439)
> at
> org.apache.hadoop.hdfs.server.namenode.TestFileTruncate.setUp(TestFileTruncate.java:107)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
