[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642579#comment-14642579 ] kanaka kumar avvaru commented on HDFS-8695: --- Thanks [~anu] for updating the patch

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642624#comment-14642624 ] Hudson commented on HDFS-8810: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #999 (See

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642614#comment-14642614 ] Hudson commented on HDFS-8810: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #269 (See

[jira] [Commented] (HDFS-8799) Erasure Coding: add tests for namenode processing corrupt striped blocks

[ https://issues.apache.org/jira/browse/HDFS-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642686#comment-14642686 ] Takanobu Asanuma commented on HDFS-8799: Thanks for the great work, [~walter.k.su]!

[jira] [Commented] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642823#comment-14642823 ] Sangjin Lee commented on HDFS-7788: --- The backport to 2.6.0 is pretty trivial but the test

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642815#comment-14642815 ] Hudson commented on HDFS-8785: -- FAILURE: Integrated in Hadoop-trunk-Commit #8225 (See

[jira] [Updated] (HDFS-7930) commitBlockSynchronization() does not remove locations

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7930: -- Labels: 2.6.1-candidate (was: ) commitBlockSynchronization() does not remove locations

[jira] [Updated] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7788: -- Attachment: HDFS-7788-2.6.0.patch Post-2.6 namenode may not start up with an image containing inodes

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642854#comment-14642854 ] Hudson commented on HDFS-8810: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #266 (See

[jira] [Updated] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7788: -- Attachment: image-with-zero-block-size.tar.gz Post-2.6 namenode may not start up with an image

[jira] [Updated] (HDFS-7788) Post-2.6 namenode may not start up with an image containing inodes created with an old release.

[ https://issues.apache.org/jira/browse/HDFS-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7788: -- Labels: 2.6.1-candidate (was: ) Post-2.6 namenode may not start up with an image containing inodes

[jira] [Updated] (HDFS-8399) Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks

[ https://issues.apache.org/jira/browse/HDFS-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8399: --- Summary: Erasure Coding: unit test the behaviour of BlockManager recovery work for the deleted blocks (was:

[jira] [Updated] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7884: -- Labels: 2.6.1-candidate (was: ) NullPointerException in BlockSender

[jira] [Commented] (HDFS-7884) NullPointerException in BlockSender

[ https://issues.apache.org/jira/browse/HDFS-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642799#comment-14642799 ] Sangjin Lee commented on HDFS-7884: --- The patch applies to 2.6.0 cleanly.

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642810#comment-14642810 ] Hudson commented on HDFS-8810: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #258 (See

[jira] [Commented] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642766#comment-14642766 ] Xiaoyu Yao commented on HDFS-8785: -- Thanks all for the review. I will commit the latest

[jira] [Updated] (HDFS-8785) TestDistributedFileSystem is failing in trunk

[ https://issues.apache.org/jira/browse/HDFS-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-8785: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-7930) commitBlockSynchronization() does not remove locations

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642820#comment-14642820 ] Sangjin Lee commented on HDFS-7930: --- The backport to 2.6.0 is more or less

[jira] [Updated] (HDFS-8658) Improve retry attempt log in DFSOutputStream#completeFile with current attempt number

[ https://issues.apache.org/jira/browse/HDFS-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kanaka kumar avvaru updated HDFS-8658: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-6185 Improve retry

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642769#comment-14642769 ] Hudson commented on HDFS-8810: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2196 (See

[jira] [Updated] (HDFS-7930) commitBlockSynchronization() does not remove locations

[ https://issues.apache.org/jira/browse/HDFS-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated HDFS-7930: -- Attachment: HDFS-7930-2.6.0.patch commitBlockSynchronization() does not remove locations

[jira] [Commented] (HDFS-8810) Correct assertions in TestDFSInotifyEventInputStream class.

[ https://issues.apache.org/jira/browse/HDFS-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642885#comment-14642885 ] Hudson commented on HDFS-8810: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2215 (See

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643086#comment-14643086 ] Anu Engineer commented on HDFS-8695: bq. VolumeHandler#getVolumeInfo requires volume

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643126#comment-14643126 ] Ravi Prakash commented on HDFS-8344: Thanks a lot Masatake! Much appreciated. [~wheat9]

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643102#comment-14643102 ] Arpit Agarwal commented on HDFS-7858: - I am +1 on the v11 patch.

[jira] [Updated] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-8695: --- Attachment: hdfs-8695-HDFS-7240.003.patch Removed spurious edit in volumehandler.java OzoneHandler :

[jira] [Updated] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8816: - Attachment: HDFS-8816.003.patch Improve visualization for the Datanode tab in the NN UI

[jira] [Updated] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7858: -- Attachment: HDFS-7858.12.patch Thanks for the rev [~arpitagarwal], Updated patch : * Incorporated your

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643274#comment-14643274 ] Jitendra Nath Pandey commented on HDFS-8818: +1 conditional on addressing

[jira] [Commented] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643166#comment-14643166 ] Haohui Mai commented on HDFS-8816: -- Thanks [~raviprak] for the reviews. The v3 patch

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643455#comment-14643455 ] Hadoop QA commented on HDFS-8695: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643339#comment-14643339 ] Jing Zhao commented on HDFS-7858: - Thanks for working on this, [~asuresh]! The latest patch

[jira] [Commented] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643473#comment-14643473 ] Hadoop QA commented on HDFS-8816: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643586#comment-14643586 ] Andrew Wang commented on HDFS-8823: --- Any comment on additional memory consumption? Move

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643603#comment-14643603 ] Hadoop QA commented on HDFS-7858: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8816) Improve visualization for the Datanode tab in the NN UI

[ https://issues.apache.org/jira/browse/HDFS-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643562#comment-14643562 ] Haohui Mai commented on HDFS-8816: -- [~raviprak] does the latest patch look good to you?

[jira] [Commented] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643569#comment-14643569 ] Haohui Mai commented on HDFS-8823: -- The WIP patch demonstrates the approach for the

[jira] [Created] (HDFS-8824) Do not use small blocks for balancing the cluster

Tsz Wo Nicholas Sze created HDFS-8824: - Summary: Do not use small blocks for balancing the cluster Key: HDFS-8824 URL: https://issues.apache.org/jira/browse/HDFS-8824 Project: Hadoop HDFS

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8818: -- Attachment: h8818_20150727.patch h8818_20150727.patch: fixes the findbugs warning and

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: HDFS-8823.WIP.patch Move replication factor into individual blocks

[jira] [Commented] (HDFS-8695) OzoneHandler : Add Bucket REST Interface

[ https://issues.apache.org/jira/browse/HDFS-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643503#comment-14643503 ] Arpit Agarwal commented on HDFS-8695: - Hi [~anu], the patch looks great. One comment -

[jira] [Created] (HDFS-8823) Move replication factor into individual blocks

Haohui Mai created HDFS-8823: Summary: Move replication factor into individual blocks Key: HDFS-8823 URL: https://issues.apache.org/jira/browse/HDFS-8823 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster

[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8824: -- Status: Patch Available (was: Open) Do not use small blocks for balancing the cluster

[jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster

[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8824: -- Attachment: h8824_20150727b.patch h8824_20150727b.patch: add minBlockSize to

[jira] [Created] (HDFS-8825) Enhancements to Balancer

Tsz Wo Nicholas Sze created HDFS-8825: - Summary: Enhancements to Balancer Key: HDFS-8825 URL: https://issues.apache.org/jira/browse/HDFS-8825 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-8826) Balancer may not move blocks efficiently in some cases

Tsz Wo Nicholas Sze created HDFS-8826: - Summary: Balancer may not move blocks efficiently in some cases Key: HDFS-8826 URL: https://issues.apache.org/jira/browse/HDFS-8826 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6861) Separate Balancer specific logic form Dispatcher

[ https://issues.apache.org/jira/browse/HDFS-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6861: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Separate Balancer

[jira] [Resolved] (HDFS-852) Balancer shutdown synchronisation could do with a review

[ https://issues.apache.org/jira/browse/HDFS-852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-852. -- Resolution: Not A Problem I think this issue got stale. Resolving as Not a Problem.

[jira] [Commented] (HDFS-6861) Separate Balancer specific logic form Dispatcher

[ https://issues.apache.org/jira/browse/HDFS-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643711#comment-14643711 ] Hadoop QA commented on HDFS-6861: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8768) Erasure Coding: block group ID displayed in WebUI is not consistent with fsck

[ https://issues.apache.org/jira/browse/HDFS-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643719#comment-14643719 ] GAO Rui commented on HDFS-8768: --- Yes, I think so too. But It seems like that I could not make

[jira] [Commented] (HDFS-5958) One very large node in a cluster prevents balancer from balancing data

[ https://issues.apache.org/jira/browse/HDFS-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643750#comment-14643750 ] Tsz Wo Nicholas Sze commented on HDFS-5958: --- ... in my case I had a 20%

[jira] [Resolved] (HDFS-1676) DateFormat.getDateTimeInstance() is very expensive, we can cache it to improve performance

[ https://issues.apache.org/jira/browse/HDFS-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-1676. --- Resolution: Not A Problem Resolving this as not-a-problem. Please feel free to reopen

[jira] [Commented] (HDFS-3619) isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3

[ https://issues.apache.org/jira/browse/HDFS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643679#comment-14643679 ] Tsz Wo Nicholas Sze commented on HDFS-3619: --- Does this constraint looks too

[jira] [Resolved] (HDFS-3619) isGoodBlockCandidate() in Balancer is not handling properly if replica factor 3

[ https://issues.apache.org/jira/browse/HDFS-3619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3619. --- Resolution: Not A Problem Resolving as not-a-problem. Please feel free to reopen if

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on DFS Space Used % as that ignores non-DFS used space

[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643695#comment-14643695 ] Tsz Wo Nicholas Sze commented on HDFS-3570: --- Have you set

[jira] [Updated] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated HDFS-7858: -- Attachment: HDFS-7858.13.patch The testcase failures seem spurious. Attaching a patch to fix the javac

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643733#comment-14643733 ] Tsz Wo Nicholas Sze commented on HDFS-8287: --- I think we should have double

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643747#comment-14643747 ] Tsz Wo Nicholas Sze commented on HDFS-8499: --- I was pointing out that

[jira] [Updated] (HDFS-8824) Do not use small blocks for balancing the cluster

[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8824: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Do not use small

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643645#comment-14643645 ] Haohui Mai commented on HDFS-8344: -- Sorry for the delay. Will do it in the next couple

[jira] [Updated] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8818: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Allow Balancer to

[jira] [Commented] (HDFS-742) A down DataNode makes Balancer to hang on repeatingly asking NameNode its partial block list

[ https://issues.apache.org/jira/browse/HDFS-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643655#comment-14643655 ] Tsz Wo Nicholas Sze commented on HDFS-742: -- [~mitdesai], sorry for the late review.

[jira] [Commented] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.

[ https://issues.apache.org/jira/browse/HDFS-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643677#comment-14643677 ] Tsz Wo Nicholas Sze commented on HDFS-3411: --- {quote} Now DN1 is added into

[jira] [Resolved] (HDFS-3411) Balancer fails to balance blocks between aboveAvgUtilized and belowAvgUtilized datanodes.

[ https://issues.apache.org/jira/browse/HDFS-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-3411. --- Resolution: Not A Problem Resolving as not-a-problem. Please feel free to reopen if

[jira] [Updated] (HDFS-4664) HDFS for heterogeneous environment

[ https://issues.apache.org/jira/browse/HDFS-4664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-4664: -- Component/s: (was: balancer mover) HDFS for heterogeneous environment

[jira] [Updated] (HDFS-7639) Remove the limitation imposed by dfs.balancer.moverThreads

[ https://issues.apache.org/jira/browse/HDFS-7639?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7639: -- Issue Type: Sub-task (was: Improvement) Parent: HDFS-8825 Remove the

[jira] [Updated] (HDFS-8278) HDFS Balancer should consider remaining storage % when checking for under-utilized machines

[ https://issues.apache.org/jira/browse/HDFS-8278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8278: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-8825 HDFS Balancer should

[jira] [Commented] (HDFS-8287) DFSStripedOutputStream.writeChunk should not wait for writing parity

[ https://issues.apache.org/jira/browse/HDFS-8287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643743#comment-14643743 ] Kai Sasaki commented on HDFS-8287: -- [~szetszwo] Thank you so much for detailed

[jira] [Commented] (HDFS-5958) One very large node in a cluster prevents balancer from balancing data

[ https://issues.apache.org/jira/browse/HDFS-5958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643755#comment-14643755 ] Tsz Wo Nicholas Sze commented on HDFS-5958: --- BTW, your case may be similar to

[jira] [Commented] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642558#comment-14642558 ] Hadoop QA commented on HDFS-8822: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8769) Erasure Coding: unit test for SequentialBlockGroupIdGenerator

[ https://issues.apache.org/jira/browse/HDFS-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642563#comment-14642563 ] Rakesh R commented on HDFS-8769: Thank you [~walter.k.su] for reviewing and committing the

[jira] [Commented] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643866#comment-14643866 ] Zhe Zhang commented on HDFS-8499: - To be able to proceed with EC branch merging I'm OK with

[jira] [Reopened] (HDFS-8499) Refactor BlockInfo class hierarchy with static helper class

[ https://issues.apache.org/jira/browse/HDFS-8499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-8499: - Refactor BlockInfo class hierarchy with static helper class

[jira] [Commented] (HDFS-7858) Improve HA Namenode Failover detection on the client

[ https://issues.apache.org/jira/browse/HDFS-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643869#comment-14643869 ] Hadoop QA commented on HDFS-7858: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

Takuya Fukudome created HDFS-8827: - Summary: Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor Key: HDFS-8827 URL:

[jira] [Updated] (HDFS-8827) Erasure Coding: When namenode processes over replicated striped block, NPE will be occur in ReplicationMonitor

[ https://issues.apache.org/jira/browse/HDFS-8827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Fukudome updated HDFS-8827: -- Attachment: processing-over-replica-npe.log The log which includes null pointer exception

[jira] [Commented] (HDFS-3570) Balancer shouldn't rely on DFS Space Used % as that ignores non-DFS used space

[ https://issues.apache.org/jira/browse/HDFS-3570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643825#comment-14643825 ] Akira AJISAKA commented on HDFS-3570: - bq. Have you set dfs.datanode.du.reserved for

[jira] [Commented] (HDFS-8824) Do not use small blocks for balancing the cluster

[ https://issues.apache.org/jira/browse/HDFS-8824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643834#comment-14643834 ] Hadoop QA commented on HDFS-8824: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8818) Allow Balancer to run faster

[ https://issues.apache.org/jira/browse/HDFS-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14643788#comment-14643788 ] Hadoop QA commented on HDFS-8818: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: (was: HDFS-8823.WIP.patch) Move replication factor into individual blocks

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Status: Patch Available (was: Open) Move replication factor into individual blocks

[jira] [Updated] (HDFS-8823) Move replication factor into individual blocks

[ https://issues.apache.org/jira/browse/HDFS-8823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8823: - Attachment: HDFS-8823.000.patch Move replication factor into individual blocks

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642325#comment-14642325 ] Akira AJISAKA commented on HDFS-8388: - Thanks [~surendrasingh] for updating the patch.

[jira] [Updated] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-8388: Attachment: ScreenShot-InvalidDate.png Attaching a screenshot. !ScreenShot-InvalidDate.png! Time

[jira] [Commented] (HDFS-8388) Time and Date format need to be in sync in Namenode UI page

[ https://issues.apache.org/jira/browse/HDFS-8388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642351#comment-14642351 ] Akira AJISAKA commented on HDFS-8388: - bq. 1. Started time looks invalid. Would you fix

[jira] [Created] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

Vinayakumar B created HDFS-8822: --- Summary: Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies Key: HDFS-8822 URL: https://issues.apache.org/jira/browse/HDFS-8822 Project: Hadoop

[jira] [Updated] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8822: Status: Patch Available (was: Open) Add SSD storagepolicy tests in

[jira] [Updated] (HDFS-8822) Add SSD storagepolicy tests in TestBlockStoragePolicy#testDefaultPolicies

[ https://issues.apache.org/jira/browse/HDFS-8822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8822: Attachment: HDFS-8822-01.patch Attaching patch for same. Please review Add SSD storagepolicy

[jira] [Commented] (HDFS-8811) Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java

[ https://issues.apache.org/jira/browse/HDFS-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642517#comment-14642517 ] Vinayakumar B commented on HDFS-8811: - Checkstyle and test failures are unrelated

[jira] [Commented] (HDFS-8811) Move BlockStoragePolicy name's constants from HdfsServerConstants.java to HdfsConstants.java

[ https://issues.apache.org/jira/browse/HDFS-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14642478#comment-14642478 ] Hadoop QA commented on HDFS-8811: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||