[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035432#comment-15035432 ] Brahma Reddy Battula commented on HDFS-9294: [~szetszwo] thanks a lot for your

[jira] [Updated] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-9429: --- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch A

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated HDFS-9294: --- Attachment: HDFS-9294-branch-2.patch HDFS-9294-branch-2.7.patch

[jira] [Commented] (HDFS-7764) DirectoryScanner shouldn't abort the scan if one directory had an error

[ https://issues.apache.org/jira/browse/HDFS-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035425#comment-15035425 ] Rakesh R commented on HDFS-7764: Note: Looks like test failures are not related to my patch

[jira] [Commented] (HDFS-8905) Refactor DFSInputStream#ReaderStrategy

[ https://issues.apache.org/jira/browse/HDFS-8905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035404#comment-15035404 ] Kai Zheng commented on HDFS-8905: - Thanks [~zhz] for the one more time review and I will up

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035397#comment-15035397 ] Colin Patrick McCabe commented on HDFS-9429: +1. Thanks, [~xiaochen]. > Tests

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035385#comment-15035385 ] Walter Su commented on HDFS-7661: - bq. We may need to change DN to support over writing par

[jira] [Commented] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035382#comment-15035382 ] Hadoop QA commented on HDFS-9442: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9393: - Status: Patch Available (was: Open) > After choosing favored nodes, choosing nodes for remaining replicas

[jira] [Updated] (HDFS-9393) After choosing favored nodes, choosing nodes for remaining replicas should go through BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-9393: - Attachment: HDFS-9393.1.patch uploaded a patch , where changes are done by passing a fresh {{chosenNodes}}

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035344#comment-15035344 ] Vinayakumar B commented on HDFS-9430: - +1 for the current patch, unless [~szetszwo] or

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035342#comment-15035342 ] Vinayakumar B commented on HDFS-9430: - bq. In addition, should we remove the tracking o

[jira] [Commented] (HDFS-9495) Data node opens random port for HTTPServer, not configurable

[ https://issues.apache.org/jira/browse/HDFS-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035334#comment-15035334 ] J.Andreina commented on HDFS-9495: -- Currently in DatanodeHttpServer, we are passing the po

[jira] [Moved] (HDFS-9495) Data node opens random port for HTTPServer, not configurable

[ https://issues.apache.org/jira/browse/HDFS-9495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] neha moved ZOOKEEPER-2333 to HDFS-9495: --- Key: HDFS-9495 (was: ZOOKEEPER-2333) Project: Hadoop HDFS (was: ZooKeeper) >

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035325#comment-15035325 ] Hadoop QA commented on HDFS-9381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035317#comment-15035317 ] Joep Rottinghuis commented on HDFS-8791: Totally agree that if the patch goes into

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035300#comment-15035300 ] Hudson commented on HDFS-9485: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #656 (See [htt

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035299#comment-15035299 ] Hudson commented on HDFS-9129: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #656 (See [htt

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035298#comment-15035298 ] Hudson commented on HDFS-6533: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #656 (See [htt

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035261#comment-15035261 ] Hadoop QA commented on HDFS-9490: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035249#comment-15035249 ] Hadoop QA commented on HDFS-9469: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035208#comment-15035208 ] Hadoop QA commented on HDFS-9267: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035185#comment-15035185 ] Uma Maheswara Rao G commented on HDFS-9381: --- Thanks a lot for the discussions Zhe

[jira] [Commented] (HDFS-9430) waitforloadingfsimage() can be removed since checknnstartup() already ensures image loaded and namenode started.

[ https://issues.apache.org/jira/browse/HDFS-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035178#comment-15035178 ] Ming Ma commented on HDFS-9430: --- Thanks [~brahmareddy]. Overall looks good. In addition, shou

[jira] [Updated] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-9381: -- Attachment: HDFS-9381-04.patch > When same block came for replication for Striped mode, w

[jira] [Updated] (HDFS-9488) When dfsadmin -refreshUserToGroupsMappings, It does not reload hadoop.user.group.static.mapping.overrides config.

[ https://issues.apache.org/jira/browse/HDFS-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KWON BYUNGCHANG updated HDFS-9488: -- Description: My environment does not allow add user/group. I can't rely os user/group mechanism

[jira] [Updated] (HDFS-9442) Move block replication logic from BlockManager to a new class ReplicationManager

[ https://issues.apache.org/jira/browse/HDFS-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9442: Attachment: HDFS-9442.005.patch The v5 patch rebases from {{trunk}} branch and fixes conflicts. > Mo

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035153#comment-15035153 ] GAO Rui commented on HDFS-7661: --- bq. The data length could be used as the flag. Parities corr

[jira] [Commented] (HDFS-9490) MiniDFSCluster should change block generation stamp via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035145#comment-15035145 ] Lei (Eddy) Xu commented on HDFS-9490: - Hi, [~twu] Thanks for working on this. Could yo

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035142#comment-15035142 ] Tony Wu commented on HDFS-9491: --- Manually ran the failed tests: TestWriteReadStripedFile, Te

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035134#comment-15035134 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- > My proposal is we might could defi

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035129#comment-15035129 ] Xiao Chen commented on HDFS-9429: - The test failures are unrelated - The TestUpdatePipeline

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035103#comment-15035103 ] GAO Rui commented on HDFS-7661: --- I got the point of our problem :) My proposal is we might

[jira] [Commented] (HDFS-4861) BlockPlacementPolicyDefault does not consider decommissioning racks

[ https://issues.apache.org/jira/browse/HDFS-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035094#comment-15035094 ] Walter Su commented on HDFS-4861: - bq. In BlockPlacementPolicyDefault#chooseRandom we can g

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: HDFS-9469-HDFS-1312.001.patch > DiskBalancer : Add Planner > --- >

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Status: Patch Available (was: Open) > DiskBalancer : Add Planner > --- > >

[jira] [Updated] (HDFS-9469) DiskBalancer : Add Planner

[ https://issues.apache.org/jira/browse/HDFS-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer updated HDFS-9469: --- Attachment: (was: HDFS-9469-HDFS-1312.001.patch) > DiskBalancer : Add Planner > --

[jira] [Created] (HDFS-9494) Parallel optimization of DFSStripedOutputStream#flushAllInternals( )

GAO Rui created HDFS-9494: - Summary: Parallel optimization of DFSStripedOutputStream#flushAllInternals( ) Key: HDFS-9494 URL: https://issues.apache.org/jira/browse/HDFS-9494 Project: Hadoop HDFS Iss

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035075#comment-15035075 ] Allen Wittenauer commented on HDFS-9038: I wonder how these various methods react w

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035072#comment-15035072 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- It makes sense. Then, how do the re

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035067#comment-15035067 ] Chris Nauroth commented on HDFS-9038: - bq. Brahma changed this at my suggestion. Exposi

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035061#comment-15035061 ] GAO Rui commented on HDFS-7661: --- Hi [~szetszwo], the diagram is showing the situation: p

[jira] [Commented] (HDFS-9441) Do not construct path string when choosing block placement targets

[ https://issues.apache.org/jira/browse/HDFS-9441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035055#comment-15035055 ] Tsz Wo Nicholas Sze commented on HDFS-9441: --- > ... but it is a bit odd to make an

[jira] [Commented] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035052#comment-15035052 ] Hadoop QA commented on HDFS-9079: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129-branch-2.025.patch Thank you very much [~jingzhao] for your review, discussion

[jira] [Commented] (HDFS-9445) Deadlock in datanode

[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15035016#comment-15035016 ] Mingliang Liu commented on HDFS-9445: - The _bposLock --> FSDatasetLock_ locking order l

[jira] [Created] (HDFS-9493) Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk

Mingliang Liu created HDFS-9493: --- Summary: Test o.a.h.hdfs.server.namenode.TestMetaSave fails in trunk Key: HDFS-9493 URL: https://issues.apache.org/jira/browse/HDFS-9493 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034996#comment-15034996 ] Hadoop QA commented on HDFS-9294: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034993#comment-15034993 ] Hadoop QA commented on HDFS-8791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034991#comment-15034991 ] Hudson commented on HDFS-9129: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8908 (See [https:

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034988#comment-15034988 ] Hudson commented on HDFS-9269: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #655 (See [htt

[jira] [Updated] (HDFS-9492) RoundRobinVolumeChoosingPolicy

[ https://issues.apache.org/jira/browse/HDFS-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9492: -- Attachment: RoundRobinVolumeChoosingPolicy.patch > RoundRobinVolumeChoosingPolicy > -

[jira] [Created] (HDFS-9492) RoundRobinVolumeChoosingPolicy

BELUGA BEHR created HDFS-9492: - Summary: RoundRobinVolumeChoosingPolicy Key: HDFS-9492 URL: https://issues.apache.org/jira/browse/HDFS-9492 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034944#comment-15034944 ] Andrew Wang commented on HDFS-8791: --- I really don't think we should include this in any m

[jira] [Commented] (HDFS-9371) Code cleanup for DatanodeManager

[ https://issues.apache.org/jira/browse/HDFS-9371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034935#comment-15034935 ] Haohui Mai commented on HDFS-9371: -- Looks good to me overall. >From BlockManager's prospe

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9129: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved (was: P

[jira] [Commented] (HDFS-9129) Move the safemode block count into BlockManager

[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034932#comment-15034932 ] Jing Zhao commented on HDFS-9129: - The 025 patch looks good to me. +1. I will commit it fir

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034931#comment-15034931 ] Junping Du commented on HDFS-8791: -- bq. If you want to pull this in 2.6.3, it might make s

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8647: Attachment: HDFS-8647-branch26.patch Patch for 2.6 didn't seem to need any specific change for HDFS-7086. But

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034910#comment-15034910 ] Xiao Chen commented on HDFS-8647: - Attached patch for branch 2.6. This is cherry-picked fro

[jira] [Updated] (HDFS-9267) TestDiskError should get stored replicas through FsDatasetTestUtils.

[ https://issues.apache.org/jira/browse/HDFS-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-9267: Attachment: HDFS-9267.05.patch Fix {{findbugs}} warning. Ran the failed tests locally using JDK8 and

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034880#comment-15034880 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Also, let's move dfsClient.endFileLe

[jira] [Updated] (HDFS-9300) TestDirectoryScanner.testThrottle() is still a little flakey

[ https://issues.apache.org/jira/browse/HDFS-9300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9300: Summary: TestDirectoryScanner.testThrottle() is still a little flakey (was: DirectoryScanner.testThr

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034856#comment-15034856 ] Arpit Agarwal commented on HDFS-6533: - Done. Thanks [~kihwal]. > TestBPOfferService#te

[jira] [Commented] (HDFS-9341) Simulated slow disk in SimulatedFSDataset

[ https://issues.apache.org/jira/browse/HDFS-9341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034868#comment-15034868 ] Lei (Eddy) Xu commented on HDFS-9341: - Hi, [~zhz]. Thanks for working on this. This is

[jira] [Commented] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034867#comment-15034867 ] Tsz Wo Nicholas Sze commented on HDFS-9294: --- Thanks [~brahmareddy]. We also nee

[jira] [Updated] (HDFS-9294) DFSClient deadlock when close file and failed to renew lease

[ https://issues.apache.org/jira/browse/HDFS-9294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9294: -- Assignee: Brahma Reddy Battula (was: 邓飞) Status: Patch Available (was: Open) > DF

[jira] [Commented] (HDFS-9038) Reserved space is erroneously counted towards non-DFS used.

[ https://issues.apache.org/jira/browse/HDFS-9038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034818#comment-15034818 ] Arpit Agarwal commented on HDFS-9038: - Thanks for the updated patch [~brahmareddy]. bq

[jira] [Commented] (HDFS-8031) Follow-on work for erasure coding phase I (striping layout)

[ https://issues.apache.org/jira/browse/HDFS-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034816#comment-15034816 ] Zhe Zhang commented on HDFS-8031: - Looks great! Thanks much for the work. > Follow-on work

[jira] [Commented] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034809#comment-15034809 ] Xiao Chen commented on HDFS-8647: - Attached patch for branch2.7. Will work on 2.6 later. Co

[jira] [Updated] (HDFS-8647) Abstract BlockManager's rack policy into BlockPlacementPolicy

[ https://issues.apache.org/jira/browse/HDFS-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-8647: Attachment: HDFS-8647-branch27.patch > Abstract BlockManager's rack policy into BlockPlacementPolicy > --

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034803#comment-15034803 ] Mingliang Liu commented on HDFS-9484: - Failing tests are not related and can not re-pro

[jira] [Commented] (HDFS-9484) NNThroughputBenchmark$BlockReportStats should not send empty block reports

[ https://issues.apache.org/jira/browse/HDFS-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034788#comment-15034788 ] Hadoop QA commented on HDFS-9484: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9449: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: HDFS-1312 S

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034778#comment-15034778 ] Kihwal Lee commented on HDFS-9426: -- cherry-picked to 2.8. > Rollingupgrade finalization i

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034775#comment-15034775 ] Zhe Zhang commented on HDFS-9269: - Thanks Kihwal for the reminder. I just committed the pat

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034762#comment-15034762 ] Kihwal Lee commented on HDFS-9426: -- [~vinayrpet] Looks like it just missed branch-2.8. >

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034761#comment-15034761 ] Zhe Zhang commented on HDFS-9269: - Thanks for the reminder! > Update the documentation and

[jira] [Commented] (HDFS-9491) Tests should get the number of pending async delets via FsDatasetTestUtils

[ https://issues.apache.org/jira/browse/HDFS-9491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034760#comment-15034760 ] Hadoop QA commented on HDFS-9491: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9269) Update the documentation and wrapper for fuse-dfs

[ https://issues.apache.org/jira/browse/HDFS-9269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034758#comment-15034758 ] Kihwal Lee commented on HDFS-9269: -- [~zhz] branch-2.8 has been created. branch-2 is now 2.

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034741#comment-15034741 ] Kihwal Lee commented on HDFS-6533: -- [~arpitagarwal] Vinod has created branch-2.8. So branc

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.15.patch Updating the patch to harden the handling of expired tokens. > Erasure coding

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034699#comment-15034699 ] Tsz Wo Nicholas Sze commented on HDFS-9449: --- +1 on the patch. Just a very minor

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034695#comment-15034695 ] Hudson commented on HDFS-6533: -- SUCCESS: Integrated in Hadoop-trunk-Commit #8907 (See [https:

[jira] [Commented] (HDFS-7661) Support read when a EC file is being written

[ https://issues.apache.org/jira/browse/HDFS-7661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034673#comment-15034673 ] Tsz Wo Nicholas Sze commented on HDFS-7661: --- Hi Gao, the diagram looks good. It

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034662#comment-15034662 ] Chris Trezzo commented on HDFS-8791: I re-kicked another build: https://builds.apache.

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034636#comment-15034636 ] Kihwal Lee commented on HDFS-8791: -- This ran for 5 hours and got aborted (jenkins timeout)

[jira] [Commented] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034634#comment-15034634 ] Wei-Chiu Chuang commented on HDFS-6533: --- Thanks [~arpitagarwal] for the code review a

[jira] [Updated] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6533: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Updated] (HDFS-6533) TestBPOfferService#testBasicFunctionalitytest fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6533: Summary: TestBPOfferService#testBasicFunctionalitytest fails intermittently (was: intermittent org.

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034616#comment-15034616 ] Anu Engineer commented on HDFS-9449: I started using that variable, earlier it was unus

[jira] [Commented] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034597#comment-15034597 ] Hadoop QA commented on HDFS-9448: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034594#comment-15034594 ] Hudson commented on HDFS-9485: -- FAILURE: Integrated in Hadoop-trunk-Commit #8906 (See [https:

[jira] [Commented] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034593#comment-15034593 ] Mingliang Liu commented on HDFS-9485: - Thanks [~jingzhao] for your review and commit.

[jira] [Updated] (HDFS-9485) Make BlockManager#removeFromExcessReplicateMap accept BlockInfo instead of Block

[ https://issues.apache.org/jira/browse/HDFS-9485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9485: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved (was: P

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034579#comment-15034579 ] Tsz Wo Nicholas Sze commented on HDFS-9449: --- Hi Anu, the 003 patch did not change

[jira] [Commented] (HDFS-6533) intermittent org.apache.hadoop.hdfs.server.datanode.TestBPOfferService.testBasicFunctionalitytest failure

[ https://issues.apache.org/jira/browse/HDFS-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15034548#comment-15034548 ] Wei-Chiu Chuang commented on HDFS-6533: --- Test failures are unrelated. > intermittent

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8791: --- Status: Patch Available (was: Open) > block ID-based DN storage layout can be very slow for datanode o

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8791: --- Status: Open (was: Patch Available) > block ID-based DN storage layout can be very slow for datanode o

[jira] [Updated] (HDFS-9448) Enable valgrind for libhdfspp unit tests

[ https://issues.apache.org/jira/browse/HDFS-9448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9448: - Attachment: HDFS-9448.HDFS-8707.002.patch > Enable valgrind for libhdfspp unit tests >

  1   2   >