[jira] [Updated] (HDFS-9226) MiniDFSCluster leaks dependency Mockito via DataNodeTestUtils

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9226: -- Component/s: (was: HDFS) > MiniDFSCluster leaks dependency Mockito via

[jira] [Updated] (HDFS-9188) Make block corruption related tests FsDataset-agnostic.

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9188: -- Component/s: (was: HDFS) > Make block corruption related tests FsDataset-agnostic.

[jira] [Created] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
Kuhu Shukla created HDFS-9463: - Summary: The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI Key: HDFS-9463 URL:

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9294: -- Component/s: (was: HDFS) > DFSClient deadlock when close file and failed to renew

[jira] [Commented] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025635#comment-15025635 ] James Clampffer commented on HDFS-9359: --- I just committed this. Thanks Stephen! > Test libhdfs++

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025631#comment-15025631 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- > ... and it seems not solved at Hadoop 2.7.1 .If

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Resolution: Duplicate Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Updated] (HDFS-8159) [HDFS-Quota] Verification is not done while setting dir namequota and size

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8159: -- Component/s: (was: HDFS) > [HDFS-Quota] Verification is not done while setting dir

[jira] [Updated] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9429: -- Component/s: (was: HDFS) test > Tests in TestDFSAdminWithHA

[jira] [Updated] (HDFS-9308) Add truncateMeta() and deleteMeta() to MiniDFSCluster

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9308: -- Component/s: (was: HDFS) > Add truncateMeta() and deleteMeta() to MiniDFSCluster >

[jira] [Updated] (HDFS-9302) WebHDFS truncate throws NullPointerException if newLength is not provided

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9302: -- Component/s: (was: HDFS) webhdfs Summary: WebHDFS truncate

[jira] [Updated] (HDFS-9291) Fix TestInterDatanodeProtocol to be FsDataset-agnostic.

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9291: -- Component/s: (was: HDFS) > Fix TestInterDatanodeProtocol to be FsDataset-agnostic. >

[jira] [Updated] (HDFS-9191) Typo in Hdfs.java. NoSuchElementException is misspelled

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9191: -- Component/s: (was: HDFS) documentation > Typo in Hdfs.java.

[jira] [Updated] (HDFS-9410) Some tests should always reset sysout and syserr

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9410: -- Component/s: (was: HDFS) test > Some tests should always reset

[jira] [Updated] (HDFS-9363) Add fetchReplica() to FsDatasetTestUtils to return FsDataset-agnostic Replica.

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9363: -- Component/s: (was: HDFS) > Add fetchReplica() to FsDatasetTestUtils to return

[jira] [Commented] (HDFS-9416) Respect OpenSSL and protobuf definitions in maven configuration when building libhdfspp

2015-11-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025796#comment-15025796 ] Allen Wittenauer commented on HDFS-9416: bq. Closed this since the build is good now. Reopen it if

[jira] [Created] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-9461: --- Summary: DiskBalancer: Add Report Command Key: HDFS-9461 URL: https://issues.apache.org/jira/browse/HDFS-9461 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Component/s: balancer & mover > DiskBalancer: Add Report Command >

[jira] [Updated] (HDFS-9230) Report space overhead of unfinalized upgrade/rollingUpgrade

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9230: -- Component/s: (was: HDFS) namenode > Report space overhead of

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Affects Version/s: 2.8.0 > DiskBalancer: Add Report Command > > >

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Status: Patch Available (was: Open) > The 'decommissioned' and 'decommissionedAndDead' icons do not

[jira] [Updated] (HDFS-9339) Extend full test of KMS ACLs

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9339: -- Component/s: (was: HDFS) test > Extend full test of KMS ACLs >

[jira] [Updated] (HDFS-9463) The 'decommissioned' and 'decommissionedAndDead' icons do not show up alongside relevant Datanodes on the NN-UI

2015-11-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated HDFS-9463: -- Attachment: Screen Shot 2015-11-24 at 3.23.00 PM.png This is a screenshot exhibiting the problem. > The

[jira] [Updated] (HDFS-8177) When the dfs -appendToFile - / is used concurrently in different process simultaneously pointing to the same hadoop file. It produces a exception stating

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8177: -- Component/s: (was: HDFS) > When the dfs -appendToFile - / is used concurrently in >

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9436: Attachment: HDFS-9436.001.patch Thanks for your review and comment. No, the change was not

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025833#comment-15025833 ] Allen Wittenauer commented on HDFS-9438: Do we actually need whoami support? I don't think any

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025841#comment-15025841 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-trunk-Commit #8882 (See

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025853#comment-15025853 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- The test looks reasonable. You may also take a look

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025870#comment-15025870 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025872#comment-15025872 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025874#comment-15025874 ] Hudson commented on HDFS-5165: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-6101) TestReplaceDatanodeOnFailure fails occasionally

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025876#comment-15025876 ] Hudson commented on HDFS-6101: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025869#comment-15025869 ] Hudson commented on HDFS-9314: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025873#comment-15025873 ] Hudson commented on HDFS-9434: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2576 (See

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025881#comment-15025881 ] Yongjun Zhang commented on HDFS-9438: - Thanks [~jzhuge] for the new rev and [~aw] for the review. One

[jira] [Commented] (HDFS-7076) Allow users to define custom storage policies

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025887#comment-15025887 ] Hadoop QA commented on HDFS-7076: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025889#comment-15025889 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2660 (See

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025900#comment-15025900 ] Allen Wittenauer commented on HDFS-9438: bq. I do see other code also refers to whoami a) All of

[jira] [Commented] (HDFS-5165) Remove the TotalFiles metrics

2015-11-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025963#comment-15025963 ] Akira AJISAKA commented on HDFS-5165: - Thanks [~wheat9] for reviewing and committing the patch! >

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025922#comment-15025922 ] Hadoop QA commented on HDFS-9449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025920#comment-15025920 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1451 (See

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.005.patch Thanks everyone for the code reviews. Incorporate Yongjun's

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025935#comment-15025935 ] Yongjun Zhang commented on HDFS-9438: - Thanks Allen. My original thinking was, if someone reports that

[jira] [Commented] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025932#comment-15025932 ] Hadoop QA commented on HDFS-8512: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8512) storage type inside LocatedBlock object is not fully exposed for GETFILESTATUS

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025941#comment-15025941 ] Tsz Wo Nicholas Sze commented on HDFS-8512: --- +1 on the new patch. > storage type inside

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025914#comment-15025914 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #719 (See

[jira] [Commented] (HDFS-6945) BlockManager should remove a block from excessReplicateMap and decrement ExcessBlocks metric when the block is removed

2015-11-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025946#comment-15025946 ] Akira AJISAKA commented on HDFS-6945: - This issue exists in 2.6.x, so this should be backported to

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

2015-11-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026008#comment-15026008 ] Brahma Reddy Battula commented on HDFS-9038: Thanks you guys.. soon will update the patch based

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026024#comment-15026024 ] Konstantin Shvachko commented on HDFS-9407: --- Actually, could you please also revert the change of

[jira] [Created] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
Wei-Chiu Chuang created HDFS-9466: - Summary: TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky Key: HDFS-9466 URL: https://issues.apache.org/jira/browse/HDFS-9466 Project: Hadoop

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026033#comment-15026033 ] Hadoop QA commented on HDFS-9438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026035#comment-15026035 ] Wei-Chiu Chuang commented on HDFS-9466: --- This is a regression of HDFS-7915. >

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-11-24 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026030#comment-15026030 ] Jing Zhao commented on HDFS-9145: - Actually the value of {{writeLockInterval}} should be captured within

[jira] [Commented] (HDFS-9466) TestShortCircuitCache#testDataXceiverCleansUpSlotsOnFailure is flaky

2015-11-24 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026038#comment-15026038 ] Wei-Chiu Chuang commented on HDFS-9466: --- >From what I can see, the assertion failed when the expected

[jira] [Commented] (HDFS-9034) "StorageTypeStats" Metric should not count failed storage.

2015-11-24 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026044#comment-15026044 ] Benoy Antony commented on HDFS-9034: Sure, I will review tomorrow. > "StorageTypeStats" Metric should

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026045#comment-15026045 ] Konstantin Shvachko commented on HDFS-9407: --- I meant not revert HDFS-9224, but rather remove the

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026069#comment-15026069 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #729 (See

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026085#comment-15026085 ] Hadoop QA commented on HDFS-9451: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-24 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9381: -- Attachment: HDFS-9381-02.patch Thanks a lot Zhe and Rakesh for the reviews. Attached the

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026102#comment-15026102 ] Yongjun Zhang commented on HDFS-9438: - +1 on rev 005, will commit soon. Thanks. >

[jira] [Updated] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9407: --- Attachment: HDFS-9407-003.patch > TestFileTruncate fails with BindException >

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-24 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026112#comment-15026112 ] Brahma Reddy Battula commented on HDFS-9407: [~shv] updated the patch..Kindly Review.. thanks..

[jira] [Created] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
Mingliang Liu created HDFS-9467: --- Summary: Fix data race accessing writeLockHeldTimeStamp in FSNamesystem Key: HDFS-9467 URL: https://issues.apache.org/jira/browse/HDFS-9467 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9145) Tracking methods that hold FSNamesytemLock for too long

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026129#comment-15026129 ] Mingliang Liu commented on HDFS-9145: - Sure. Nice catch! I filed [HDFS-9467] to track this. Thanks for

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Affects Version/s: 2.8.0 > Fix data race accessing writeLockHeldTimeStamp in FSNamesystem >

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026141#comment-15026141 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2577 (See

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Status: Patch Available (was: Open) > Fix data race accessing writeLockHeldTimeStamp in

[jira] [Updated] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9467: Attachment: HDFS-9467.000.patch > Fix data race accessing writeLockHeldTimeStamp in FSNamesystem >

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026152#comment-15026152 ] BELUGA BEHR commented on HDFS-9457: --- Thank you for your sincere interest! I will work to review all

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026158#comment-15026158 ] Mingliang Liu commented on HDFS-9457: - Thanks for your further effort. I meant to remove {{if

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9457: Assignee: BELUGA BEHR > Datanode Logging Improvement > > >

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9457: Priority: Minor (was: Trivial) > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-24 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026160#comment-15026160 ] BELUGA BEHR commented on HDFS-9457: --- Would you prefer option 1 or option 2? :) {code} if (info != null)

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026196#comment-15026196 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #640 (See

[jira] [Commented] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026195#comment-15026195 ] Hudson commented on HDFS-8807: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #640 (See

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026220#comment-15026220 ] Hadoop QA commented on HDFS-9436: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026225#comment-15026225 ] Hadoop QA commented on HDFS-9438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9355) Support colocation in HDFS.

2015-11-24 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026254#comment-15026254 ] nijel commented on HDFS-9355: - Idea looks good But co-location is a very broad topic. So i suggest to focus on

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026296#comment-15026296 ] Hadoop QA commented on HDFS-9381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9336) deleteSnapshot throws NPE when snapshotname is null

2015-11-24 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026317#comment-15026317 ] Akira AJISAKA commented on HDFS-9336: - Thanks [~brahmareddy] for updating the patch. 1. I'm thinking

[jira] [Updated] (HDFS-9434) Recommission a datanode with 500k blocks may pause NN for 30 seconds

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9434: -- Attachment: h9434_20151116_branch-2.6.patch h9434_20151116_branch-2.6.patch: for 2.6. >

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Component/s: (was: HDFS) > DiskBalancer: Add Report Command > >

[jira] [Updated] (HDFS-9236) Missing sanity check for block size during block recovery

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9236: -- Component/s: (was: HDFS) datanode > Missing sanity check for block

[jira] [Updated] (HDFS-9461) DiskBalancer: Add Report Command

2015-11-24 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9461: Description: It's quite helpful to do: 1) report node information for the top X of DataNodes that

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-24 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated HDFS-9438: - Attachment: HDFS-9438-hdfs-9438.004.patch The method has "debug" section and the test section. What we

[jira] [Updated] (HDFS-9359) Test libhdfs++ with existing libhdfs tests

2015-11-24 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9359: -- Resolution: Fixed Status: Resolved (was: Patch Available) Note: Until HDFS-9452 is

[jira] [Updated] (HDFS-9361) Default block placement policy causes TestReplaceDataNodeOnFailure to fail intermittently

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9361: -- Component/s: (was: HDFS) namenode > Default block placement policy

[jira] [Updated] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8763: -- Component/s: (was: HDFS) > After file closed, a race condition between IBR of 3rd

[jira] [Updated] (HDFS-8761) Windows HDFS daemon - datanode.DirectoryScanner: Error compiling report (...) XXX is not a prefix of YYY

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8761: -- Component/s: (was: HDFS) datanode > Windows HDFS daemon -

[jira] [Updated] (HDFS-9065) Include commas on # of files, blocks, total filesystem objects in NN Web UI

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9065: -- Component/s: (was: HDFS) namenode > Include commas on # of files,

[jira] [Updated] (HDFS-9278) Fix preferredBlockSize typo in OIV XML output

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9278: -- Component/s: (was: HDFS) tools > Fix preferredBlockSize typo in OIV

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-24 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025752#comment-15025752 ] Zhe Zhang commented on HDFS-9429: - Thanks Xiao for the work. {{MiniJournalCluster#waitActive}} LGTM.

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-11-24 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025772#comment-15025772 ] Mingliang Liu commented on HDFS-7435: - In {{NNThroughputBenchmark}} class, the change {code} void

[jira] [Reopened] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth reopened HDFS-9370: - > TestDataNodeUGIProvider fails intermittently due to non-deterministic cache > expiry. >

[jira] [Resolved] (HDFS-9370) TestDataNodeUGIProvider fails intermittently due to non-deterministic cache expiry.

2015-11-24 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-9370. - Resolution: Duplicate > TestDataNodeUGIProvider fails intermittently due to non-deterministic

[jira] [Updated] (HDFS-8807) dfs.datanode.data.dir does not handle spaces between storageType and URI correctly

2015-11-24 Thread Anu Engineer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8807: --- Attachment: HDFS-8807.002.patch Fix removing space from lic. header > dfs.datanode.data.dir does not

[jira] [Updated] (HDFS-9351) checkNNStartup() need to be called when fsck calls FSNamesystem.getSnapshottableDirs()

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9351: -- Component/s: (was: HDFS) namenode > checkNNStartup() need to be

[jira] [Commented] (HDFS-8335) FSNamesystem should construct FSPermissionChecker only if permission is enabled

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025666#comment-15025666 ] Hudson commented on HDFS-8335: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2659 (See

[jira] [Commented] (HDFS-8855) Webhdfs client leaks active NameNode connections

2015-11-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025665#comment-15025665 ] Hudson commented on HDFS-8855: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2659 (See

[jira] [Updated] (HDFS-9240) Use Builder pattern for BlockLocation constructors

2015-11-24 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9240: -- Component/s: (was: HDFS) > Use Builder pattern for BlockLocation constructors >

  1   2   3   4   >