[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352282#comment-17352282 ] Hui Fei commented on HDFS-13671: [~sodonnell] Thanks for your comments, This issue continued for several

[jira] [Updated] (HDFS-16043) HDFS : Delete performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu updated HDFS-16043: --- Attachment: 20210527-before.svg 20210527-after.svg > HDFS : Delete performance

[jira] [Assigned] (HDFS-16043) HDFS : Delete performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu reassigned HDFS-16043: -- Assignee: Xiangyi Zhu > HDFS : Delete performance optimization >

[jira] [Created] (HDFS-16043) HDFS : Delete performance optimization

Xiangyi Zhu created HDFS-16043: -- Summary: HDFS : Delete performance optimization Key: HDFS-16043 URL: https://issues.apache.org/jira/browse/HDFS-16043 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-16043) HDFS : Delete performance optimization

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangyi Zhu updated HDFS-16043: --- Description: The deletion of the large directory caused NN to hold the lock for too long, which

[jira] [Work logged] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

[ https://issues.apache.org/jira/browse/HDFS-16042?focusedWorklogId=602713=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602713 ] ASF GitHub Bot logged work on HDFS-16042: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-13729) Fix broken links to RBF documentation

[ https://issues.apache.org/jira/browse/HDFS-13729?focusedWorklogId=602711=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602711 ] ASF GitHub Bot logged work on HDFS-13729: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352237#comment-17352237 ] Hadoop QA commented on HDFS-16040: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15973) RBF: Add permission check before doting router federation rename.

[ https://issues.apache.org/jira/browse/HDFS-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352232#comment-17352232 ] Jinglun commented on HDFS-15973: Wait one day for further comments. After that I'll commit this. > RBF:

[jira] [Updated] (HDFS-13729) Fix broken links to RBF documentation

[ https://issues.apache.org/jira/browse/HDFS-13729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-13729: -- Labels: pull-request-available (was: ) > Fix broken links to RBF documentation >

[jira] [Work logged] (HDFS-13729) Fix broken links to RBF documentation

[ https://issues.apache.org/jira/browse/HDFS-13729?focusedWorklogId=602700=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602700 ] ASF GitHub Bot logged work on HDFS-13729: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15973) RBF: Add permission check before doting router federation rename.

[ https://issues.apache.org/jira/browse/HDFS-15973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352216#comment-17352216 ] Íñigo Goiri commented on HDFS-15973: +1 on [^HDFS-15973.010.patch]. > RBF: Add permission check

[jira] [Updated] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-15915: --- Fix Version/s: 3.3.2 3.2.3 2.10.2

[jira] [Work logged] (HDFS-15971) Make mkstemp cross platform

[ https://issues.apache.org/jira/browse/HDFS-15971?focusedWorklogId=602576=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602576 ] ASF GitHub Bot logged work on HDFS-15971: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-15971) Make mkstemp cross platform

[ https://issues.apache.org/jira/browse/HDFS-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-15971. Fix Version/s: 3.4.0 Resolution: Fixed > Make mkstemp cross platform >

[jira] [Commented] (HDFS-15971) Make mkstemp cross platform

[ https://issues.apache.org/jira/browse/HDFS-15971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352081#comment-17352081 ] Íñigo Goiri commented on HDFS-15971: I'm merging this again as the Docker image seems to work fine.

[jira] [Updated] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16042: -- Labels: pull-request-available (was: ) > DatanodeAdminMonitor scan should be delay based >

[jira] [Work logged] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

[ https://issues.apache.org/jira/browse/HDFS-16042?focusedWorklogId=602549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602549 ] ASF GitHub Bot logged work on HDFS-16042: - Author: ASF GitHub Bot

[jira] [Work started] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

[ https://issues.apache.org/jira/browse/HDFS-16042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16042 started by Ahmed Hussein. > DatanodeAdminMonitor scan should be delay based >

[jira] [Created] (HDFS-16042) DatanodeAdminMonitor scan should be delay based

Ahmed Hussein created HDFS-16042: Summary: DatanodeAdminMonitor scan should be delay based Key: HDFS-16042 URL: https://issues.apache.org/jira/browse/HDFS-16042 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352032#comment-17352032 ] Simbarashe Dzinamarira edited comment on HDFS-16040 at 5/26/21, 7:39 PM:

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352032#comment-17352032 ] Simbarashe Dzinamarira commented on HDFS-16040: --- Took a second look to check is the

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602511=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602511 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16040: -- Attachment: HDFS-16040.003.patch Status: Patch Available (was: Open)

[jira] [Updated] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-16040: -- Status: Open (was: Patch Available) > RpcQueueTime metric counts requeued

[jira] [Commented] (HDFS-15915) Race condition with async edits logging due to updating txId outside of the namesystem log

[ https://issues.apache.org/jira/browse/HDFS-15915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17352023#comment-17352023 ] Konstantin Shvachko commented on HDFS-15915: Ran unit tests that failed on Jenkins. All

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602459=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602459 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602457=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602457 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16024) RBF: Rename data to the Trash should be based on src locations

[ https://issues.apache.org/jira/browse/HDFS-16024?focusedWorklogId=602304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602304 ] ASF GitHub Bot logged work on HDFS-16024: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15979) Move within EZ fails and cannot remove nested EZs

[ https://issues.apache.org/jira/browse/HDFS-15979?focusedWorklogId=602277=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602277 ] ASF GitHub Bot logged work on HDFS-15979: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?focusedWorklogId=602264=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602264 ] ASF GitHub Bot logged work on HDFS-16041: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takanobu Asanuma resolved HDFS-16041. - Fix Version/s: 3.4.0 Resolution: Fixed > TestErasureCodingCLI fails >

[jira] [Work logged] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?focusedWorklogId=602253=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602253 ] ASF GitHub Bot logged work on HDFS-16041: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?focusedWorklogId=602252=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602252 ] ASF GitHub Bot logged work on HDFS-16041: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-14849) Erasure Coding: the internal block is replicated many times when datanode is decommissioning

[ https://issues.apache.org/jira/browse/HDFS-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengchenyu updated HDFS-14849: --- Description: colored textWhen the datanode keeping in DECOMMISSION_INPROGRESS status, the EC

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602225=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602225 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?focusedWorklogId=60=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-60 ] ASF GitHub Bot logged work on HDFS-16041: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15850) Superuser actions should be reported to external enforcers

[ https://issues.apache.org/jira/browse/HDFS-15850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15850: --- Target Version/s: 3.3.2 (was: 3.3.1) > Superuser actions should be reported to external

[jira] [Commented] (HDFS-16032) DFSClient#delete supports Trash

[ https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351669#comment-17351669 ] Xiangyi Zhu commented on HDFS-16032: [~ayushtkn],[~sodonnell] Thanks a lot for your comments, I use

[jira] [Commented] (HDFS-16032) DFSClient#delete supports Trash

[ https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351659#comment-17351659 ] Stephen O'Donnell commented on HDFS-16032: -- I agree with [~ayushtkn]. It does not feel correct

[jira] [Commented] (HDFS-13671) Namenode deletes large dir slowly caused by FoldedTreeSet#removeAndGet

[ https://issues.apache.org/jira/browse/HDFS-13671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351652#comment-17351652 ] Stephen O'Donnell commented on HDFS-13671: -- Did anyone spend any time trying to understand what

[jira] [Work logged] (HDFS-16041) TestErasureCodingCLI fails

[ https://issues.apache.org/jira/browse/HDFS-16041?focusedWorklogId=602198=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602198 ] ASF GitHub Bot logged work on HDFS-16041: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351641#comment-17351641 ] Wei-Chiu Chuang commented on HDFS-15916: Branch-3.3 backport PR #3054

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602193=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602193 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602192=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602192 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=602181=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-602181 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351570#comment-17351570 ] Hadoop QA commented on HDFS-16040: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351568#comment-17351568 ] Hadoop QA commented on HDFS-16040: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-16032) DFSClient#delete supports Trash

[ https://issues.apache.org/jira/browse/HDFS-16032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351543#comment-17351543 ] Ayush Saxena commented on HDFS-16032: - Trash is a FsShell concept, I would argue if it belongs to

[jira] [Commented] (HDFS-16040) RpcQueueTime metric counts requeued calls as unique events.

[ https://issues.apache.org/jira/browse/HDFS-16040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17351510#comment-17351510 ] Konstantin Shvachko commented on HDFS-16040: I checked that the test is fails without the fix