[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034634#comment-15034634 ] Wei-Chiu Chuang commented on HDFS-6533: --- Thanks [~arpitagarwal] for the code review and commit.

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8791: --- Status: Open (was: Patch Available) > block ID-based DN storage layout can be very slow for datanode

[jira] [Commented] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034548#comment-15034548 ] Wei-Chiu Chuang commented on HDFS-6533: --- Test failures are unrelated. > intermittent >

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034597#comment-15034597 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034758#comment-15034758 ] Kihwal Lee commented on HDFS-9269: -- [~zhz] branch-2.8 has been created. branch-2 is now 2.9. You might

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034481#comment-15034481 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034699#comment-15034699 ] Tsz Wo Nicholas Sze commented on HDFS-9449: --- +1 on the patch. Just a very minor point: there are

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.15.patch Updating the patch to harden the handling of expired tokens. > Erasure

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8791: --- Status: Patch Available (was: Open) > block ID-based DN storage layout can be very slow for datanode

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9485: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034593#comment-15034593 ] Mingliang Liu commented on HDFS-9485: - Thanks [~jingzhao] for your review and commit. > Make

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034594#comment-15034594 ] Hudson commented on HDFS-9485: -- FAILURE: Integrated in Hadoop-trunk-Commit #8906 (See

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034741#comment-15034741 ] Kihwal Lee commented on HDFS-6533: -- [~arpitagarwal] Vinod has created branch-2.8. So branch-2 is 2.9 now.

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034491#comment-15034491 ] Hadoop QA commented on HDFS-9430: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034489#comment-15034489 ] Xiao Chen commented on HDFS-8647: - Thanks [~zhz] and [~mingma], I'll provide patches for 2.6/2.7 and post

[jira] [Updated] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6533: Summary: TestBPOfferService#testBasicFunctionalitytest fails intermittently (was: intermittent

[jira] [Commented] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034503#comment-15034503 ] Hadoop QA commented on HDFS-6533: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034662#comment-15034662 ] Chris Trezzo commented on HDFS-8791: I re-kicked another build:

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034695#comment-15034695 ] Hudson commented on HDFS-6533: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8907 (See

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034579#comment-15034579 ] Tsz Wo Nicholas Sze commented on HDFS-9449: --- Hi Anu, the 003 patch did not change the clusterURI

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.002.patch > Enable valgrind for libhdfspp unit tests >

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034616#comment-15034616 ] Anu Engineer commented on HDFS-9449: I started using that variable, earlier it was unused in this

[jira] [Updated] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6533: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034636#comment-15034636 ] Kihwal Lee commented on HDFS-8791: -- This ran for 5 hours and got aborted (jenkins timeout). It ran the

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034673#comment-15034673 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- Hi Gao, the diagram looks good. It seems that the

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034761#comment-15034761 ] Zhe Zhang commented on HDFS-9269: - Thanks for the reminder! > Update the documentation and wrapper for

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034760#comment-15034760 ] Hadoop QA commented on HDFS-9491: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034778#comment-15034778 ] Kihwal Lee commented on HDFS-9426: -- cherry-picked to 2.8. > Rollingupgrade finalization is not backward

[jira] [Commented] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034816#comment-15034816 ] Zhe Zhang commented on HDFS-8031: - Looks great! Thanks much for the work. > Follow-on work for erasure

[jira] [Updated] (HDFS-9300) TestDirectoryScanner.testThrottle() is still a little flakey

[ https://issues.apache.org/jira/browse/HDFS-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9300: Summary: TestDirectoryScanner.testThrottle() is still a little flakey (was:

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034856#comment-15034856 ] Arpit Agarwal commented on HDFS-6533: - Done. Thanks [~kihwal]. >

[jira] [Commented] (HDFS-9341) Simulated slow disk in SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034868#comment-15034868 ] Lei (Eddy) Xu commented on HDFS-9341: - Hi, [~zhz]. Thanks for working on this. This is an interesting

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034931#comment-15034931 ] Junping Du commented on HDFS-8791: -- bq. If you want to pull this in 2.6.3, it might make sense to push it

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034775#comment-15034775 ] Zhe Zhang commented on HDFS-9269: - Thanks Kihwal for the reminder. I just committed the patch to

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8647: Attachment: HDFS-8647-branch27.patch > Abstract BlockManager's rack policy into BlockPlacementPolicy >

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034809#comment-15034809 ] Xiao Chen commented on HDFS-8647: - Attached patch for branch2.7. Will work on 2.6 later. Conflict list and

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9294: -- Assignee: Brahma Reddy Battula (was: 邓飞) Status: Patch Available (was: Open) >

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Attachment: HDFS-9267.05.patch Fix {{findbugs}} warning. Ran the failed tests locally using JDK8

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034991#comment-15034991 ] Hudson commented on HDFS-9129: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8908 (See

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034932#comment-15034932 ] Jing Zhao commented on HDFS-9129: - The 025 patch looks good to me. +1. I will commit it first to trunk. >

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9129: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was:

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034803#comment-15034803 ] Mingliang Liu commented on HDFS-9484: - Failing tests are not related and can not re-produce locally. >

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034880#comment-15034880 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Also, let's move dfsClient.endFileLease(fileId);

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8647: Attachment: HDFS-8647-branch26.patch Patch for 2.6 didn't seem to need any specific change for HDFS-7086.

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034935#comment-15034935 ] Haohui Mai commented on HDFS-9371: -- Looks good to me overall. >From BlockManager's prospective the

[jira] [Updated] (HDFS-9492) RoundRobinVolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9492: -- Attachment: RoundRobinVolumeChoosingPolicy.patch > RoundRobinVolumeChoosingPolicy >

[jira] [Created] (HDFS-9492) RoundRobinVolumeChoosingPolicy

BELUGA BEHR created HDFS-9492: - Summary: RoundRobinVolumeChoosingPolicy Key: HDFS-9492 URL: https://issues.apache.org/jira/browse/HDFS-9492 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034988#comment-15034988 ] Hudson commented on HDFS-9269: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #655 (See

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034996#comment-15034996 ] Hadoop QA commented on HDFS-9294: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034762#comment-15034762 ] Kihwal Lee commented on HDFS-9426: -- [~vinayrpet] Looks like it just missed branch-2.8. > Rollingupgrade

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9449: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-1312

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034788#comment-15034788 ] Hadoop QA commented on HDFS-9484: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034818#comment-15034818 ] Arpit Agarwal commented on HDFS-9038: - Thanks for the updated patch [~brahmareddy]. bq. 3. I think we

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034867#comment-15034867 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Thanks [~brahmareddy]. We also need a similar fix

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034910#comment-15034910 ] Xiao Chen commented on HDFS-8647: - Attached patch for branch 2.6. This is cherry-picked from the 2.7 patch

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034944#comment-15034944 ] Andrew Wang commented on HDFS-8791: --- I really don't think we should include this in any maintenance

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034993#comment-15034993 ] Hadoop QA commented on HDFS-8791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9441) Do not construct path string when choosing block placement targets

[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035055#comment-15035055 ] Tsz Wo Nicholas Sze commented on HDFS-9441: --- > ... but it is a bit odd to make an argument so

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035061#comment-15035061 ] GAO Rui commented on HDFS-7661: --- Hi [~szetszwo], the diagram is showing the situation:

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: (was: HDFS-9469-HDFS-1312.001.patch) > DiskBalancer : Add Planner >

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035129#comment-15035129 ] Xiao Chen commented on HDFS-9429: - The test failures are unrelated - The TestUpdatePipelineWithSnapshots

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035142#comment-15035142 ] Tony Wu commented on HDFS-9491: --- Manually ran the failed tests: TestWriteReadStripedFile,

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9381: -- Attachment: HDFS-9381-04.patch > When same block came for replication for Striped mode,

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035178#comment-15035178 ] Ming Ma commented on HDFS-9430: --- Thanks [~brahmareddy]. Overall looks good. In addition, should we remove the

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129-branch-2.025.patch Thank you very much [~jingzhao] for your review, discussion

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035067#comment-15035067 ] Chris Nauroth commented on HDFS-9038: - bq. Brahma changed this at my suggestion. Exposing reserved

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035072#comment-15035072 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- It makes sense. Then, how do the readers access the

[jira] [Commented] (HDFS-4861) BlockPlacementPolicyDefault does not consider decommissioning racks

[ https://issues.apache.org/jira/browse/HDFS-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035094#comment-15035094 ] Walter Su commented on HDFS-4861: - bq. In BlockPlacementPolicyDefault#chooseRandom we can get a list of the

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035103#comment-15035103 ] GAO Rui commented on HDFS-7661: --- I got the point of our problem :) My proposal is we might could define a

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035185#comment-15035185 ] Uma Maheswara Rao G commented on HDFS-9381: --- Thanks a lot for the discussions Zhe, Jing and

[jira] [Created] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

Mingliang Liu created HDFS-9493: --- Summary: Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk Key: HDFS-9493 URL: https://issues.apache.org/jira/browse/HDFS-9493 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035075#comment-15035075 ] Allen Wittenauer commented on HDFS-9038: I wonder how these various methods react with pooled

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: HDFS-9469-HDFS-1312.001.patch > DiskBalancer : Add Planner > ---

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Status: Patch Available (was: Open) > DiskBalancer : Add Planner > --- > >

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035134#comment-15035134 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- > My proposal is we might could define a mark flag

[jira] [Updated] (HDFS-9488) When dfsadmin -refreshUserToGroupsMappings, It does not reload hadoop.user.group.static.mapping.overrides config.

[ https://issues.apache.org/jira/browse/HDFS-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KWON BYUNGCHANG updated HDFS-9488: -- Description: My environment does not allow add user/group. I can't rely os user/group

[jira] [Commented] (HDFS-9445) Deadlock in datanode

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035016#comment-15035016 ] Mingliang Liu commented on HDFS-9445: - The _bposLock --> FSDatasetLock_ locking order looks good to me.

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035052#comment-15035052 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

GAO Rui created HDFS-9494: - Summary: Parallel optimization of DFSStripedOutputStream#flushAllInternals( ) Key: HDFS-9494 URL: https://issues.apache.org/jira/browse/HDFS-9494 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035145#comment-15035145 ] Lei (Eddy) Xu commented on HDFS-9490: - Hi, [~twu] Thanks for working on this. Could you change

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035153#comment-15035153 ] GAO Rui commented on HDFS-7661: --- bq. The data length could be used as the flag. Parities correspond to data

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.005.patch The v5 patch rebases from {{trunk}} branch and fixes conflicts. >

[jira] [Updated] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9430: --- Status: Patch Available (was: Open) > waitforloadingfsimage() can be removed since

[jira] [Commented] (HDFS-9460) libhdfs++: suppress warnings from third-party libraries

[ https://issues.apache.org/jira/browse/HDFS-9460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034043#comment-15034043 ] Hadoop QA commented on HDFS-9460: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9430: --- Attachment: HDFS-9430.patch > waitforloadingfsimage() can be removed since

[jira] [Updated] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9269: Component/s: fuse-dfs > Need to update the documentation and wrapper for fuse-dfs >

[jira] [Commented] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034128#comment-15034128 ] Arpit Agarwal commented on HDFS-6533: - +1 for the v4 patch, pending Jenkins. > intermittent >

[jira] [Updated] (HDFS-9464) Documentation needs to be exposed

[ https://issues.apache.org/jira/browse/HDFS-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9464: -- Assignee: (was: James Clampffer) > Documentation needs to be exposed >

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034079#comment-15034079 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034067#comment-15034067 ] Brahma Reddy Battula commented on HDFS-9430: [~mingma] Uploaded the patch..Kindly

[jira] [Updated] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-6533: -- Attachment: HDFS-6533.004.patch Rev04: code refactoring per [~arpitagarwal]. I am running

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034287#comment-15034287 ] Kihwal Lee commented on HDFS-4015: -- [~anu],I have seen intermittent test failures in precommit builds. Do

[jira] [Updated] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9269: Affects Version/s: 2.7.1 Target Version/s: 2.8.0 > Need to update the documentation and wrapper for

[jira] [Updated] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9269: Summary: Update the documentation and wrapper for fuse-dfs (was: Need to update the documentation and

[jira] [Updated] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9269: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was:

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.001.patch New patch: skips valgrind tests if valgrind is not present or

[jira] [Commented] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034234#comment-15034234 ] Zhe Zhang commented on HDFS-9269: - +1, thanks Wei-Chiu for the work! I'll commit the patch shortly. Could

[jira] [Commented] (HDFS-9444) TestEditLogTailer#testNN1TriggersLogRolls fails bind exception.

[ https://issues.apache.org/jira/browse/HDFS-9444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034252#comment-15034252 ] Xiao Chen commented on HDFS-9444: - Thanks [~iwasakims], yeah I think that's fine. IMO it'd be nice to fix

[jira] [Commented] (HDFS-9269) Need to update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034253#comment-15034253 ] Wei-Chiu Chuang commented on HDFS-9269: --- This is a follow-up of HDFS-9268 so target 2.8.0 should be

[jira] [Commented] (HDFS-4015) Safemode should count and report orphaned blocks

[ https://issues.apache.org/jira/browse/HDFS-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15034292#comment-15034292 ] Anu Engineer commented on HDFS-4015: Could be, let me take a look. Thanks for letting me know. >

  1   2   >