[jira] [Commented] (HDFS-15756) RBF: Cannot get updated delegation token from zookeeper

2021-04-08 Thread Fengnan Li (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317683#comment-17317683 ] Fengnan Li commented on HDFS-15756: --- This was discussed in

[jira] [Work logged] (HDFS-15423) RBF: WebHDFS create shouldn't choose DN from all sub-clusters

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15423?focusedWorklogId=579770=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579770 ] ASF GitHub Bot logged work on HDFS-15423: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15887) Make LogRoll and TailEdits execute in parallel

2021-04-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317645#comment-17317645 ] Wei-Chiu Chuang commented on HDFS-15887: Not an expert here, but makes sense to me. > Make

[jira] [Updated] (HDFS-15243) Add an option to prevent sub-directories of protected directories from deletion

2021-04-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15243: --- Fix Version/s: 3.3.1 > Add an option to prevent sub-directories of protected directories

[jira] [Commented] (HDFS-15887) Make LogRoll and TailEdits execute in parallel

2021-04-08 Thread JiangHua Zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317614#comment-17317614 ] JiangHua Zhu commented on HDFS-15887: - [~weichiu] [~hexiaoqiao], I submitted some code. Can you give

[jira] [Updated] (HDFS-15960) Router NamenodeHeartbeatService fails to authenticate with namenode in a kerberized envi

2021-04-08 Thread Borislav Iordanov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Borislav Iordanov updated HDFS-15960: - Description: We use http.hadoop.authentication.type = "kerberos" and when the 

[jira] [Created] (HDFS-15960) Router NamenodeHeartbeatService fails to authenticate with namenode in a kerberized envi

2021-04-08 Thread Borislav Iordanov (Jira)
Borislav Iordanov created HDFS-15960: Summary: Router NamenodeHeartbeatService fails to authenticate with namenode in a kerberized envi Key: HDFS-15960 URL: https://issues.apache.org/jira/browse/HDFS-15960

[jira] [Work logged] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?focusedWorklogId=579694=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579694 ] ASF GitHub Bot logged work on HDFS-15940: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?focusedWorklogId=579692=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579692 ] ASF GitHub Bot logged work on HDFS-15940: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15958) TestBPOfferService.testMissBlocksWhenReregister is flaky

2021-04-08 Thread Borislav Iordanov (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Borislav Iordanov updated HDFS-15958: - Priority: Minor (was: Major) > TestBPOfferService.testMissBlocksWhenReregister is flaky

[jira] [Created] (HDFS-15959) Add support to digest based authentication in ZKDelegationTokenSecretManager

2021-04-08 Thread Borislav Iordanov (Jira)
Borislav Iordanov created HDFS-15959: Summary: Add support to digest based authentication in ZKDelegationTokenSecretManager Key: HDFS-15959 URL: https://issues.apache.org/jira/browse/HDFS-15959

[jira] [Work logged] (HDFS-15621) Datanode DirectoryScanner uses excessive memory

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15621?focusedWorklogId=579626=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579626 ] ASF GitHub Bot logged work on HDFS-15621: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15958) TestBPOfferService.testMissBlocksWhenReregister is flaky

2021-04-08 Thread Borislav Iordanov (Jira)
Borislav Iordanov created HDFS-15958: Summary: TestBPOfferService.testMissBlocksWhenReregister is flaky Key: HDFS-15958 URL: https://issues.apache.org/jira/browse/HDFS-15958 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15957) The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15957: -- Labels: pull-request-available (was: ) > The ignored IOException in the RPC response sent by

[jira] [Work logged] (HDFS-15957) The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15957?focusedWorklogId=579611=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579611 ] ASF GitHub Bot logged work on HDFS-15957: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15957) The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang

2021-04-08 Thread Haoze Wu (Jira)
Haoze Wu created HDFS-15957: --- Summary: The ignored IOException in the RPC response sent by FSEditLogAsync can cause the HDFS client to hang Key: HDFS-15957 URL: https://issues.apache.org/jira/browse/HDFS-15957

[jira] [Commented] (HDFS-15955) Make explicit_bzero cross platform

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317336#comment-17317336 ] Íñigo Goiri commented on HDFS-15955: Thanks [~gautham] for the patch. Merged PR 2875. > Make

[jira] [Resolved] (HDFS-15955) Make explicit_bzero cross platform

2021-04-08 Thread Jira
[ https://issues.apache.org/jira/browse/HDFS-15955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri resolved HDFS-15955. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed > Make explicit_bzero

[jira] [Work logged] (HDFS-15955) Make explicit_bzero cross platform

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15955?focusedWorklogId=579354=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579354 ] ASF GitHub Bot logged work on HDFS-15955: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15956) Provide utility class for FSNamesystem

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15956?focusedWorklogId=579345=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579345 ] ASF GitHub Bot logged work on HDFS-15956: - Author: ASF GitHub Bot

[jira] [Resolved] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-04-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved HDFS-15916. - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk.

[jira] [Assigned] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-04-08 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reassigned HDFS-15916: --- Assignee: Ayush Saxena > DistCp: Backward compatibility: Distcp fails from Hadoop 3 to

[jira] [Work logged] (HDFS-15916) DistCp: Backward compatibility: Distcp fails from Hadoop 3 to Hadoop 2 for snapshotdiff

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15916?focusedWorklogId=579294=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579294 ] ASF GitHub Bot logged work on HDFS-15916: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15956) Provide utility class for FSNamesystem

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15956?focusedWorklogId=579285=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579285 ] ASF GitHub Bot logged work on HDFS-15956: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

2021-04-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15942: - Fix Version/s: 3.3.1 > Increase Quota initialization threads >

[jira] [Resolved] (HDFS-15937) Reduce memory used during datanode layout upgrade

2021-04-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell resolved HDFS-15937. -- Resolution: Fixed > Reduce memory used during datanode layout upgrade >

[jira] [Commented] (HDFS-15937) Reduce memory used during datanode layout upgrade

2021-04-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317117#comment-17317117 ] Stephen O'Donnell commented on HDFS-15937: -- Committed this from 3.1 up to trunk. > Reduce

[jira] [Updated] (HDFS-15937) Reduce memory used during datanode layout upgrade

2021-04-08 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen O'Donnell updated HDFS-15937: - Fix Version/s: 3.2.3 3.1.5 3.4.0

[jira] [Work logged] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?focusedWorklogId=579110=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579110 ] ASF GitHub Bot logged work on HDFS-15940: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15937) Reduce memory used during datanode layout upgrade

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15937?focusedWorklogId=579081=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579081 ] ASF GitHub Bot logged work on HDFS-15937: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15940) Some tests in TestBlockRecovery are consistently failing

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15940?focusedWorklogId=579046=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-579046 ] ASF GitHub Bot logged work on HDFS-15940: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15759) EC: Verify EC reconstruction correctness on DataNode

2021-04-08 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-15759: --- Fix Version/s: 3.3.1 > EC: Verify EC reconstruction correctness on DataNode >

[jira] [Comment Edited] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-04-08 Thread Max Xie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316997#comment-17316997 ] Max Xie edited comment on HDFS-15175 at 4/8/21, 9:01 AM: -- We encountered this

[jira] [Commented] (HDFS-15175) Multiple CloseOp shared block instance causes the standby namenode to crash when rolling editlog

2021-04-08 Thread Max Xie (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316997#comment-17316997 ] Max Xie commented on HDFS-15175: - ping [~hexiaoqiao] [~wanchang] .  > Multiple CloseOp shared block

[jira] [Commented] (HDFS-15788) Correct the statement for pmem cache to reflect cache persistence support

2021-04-08 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316912#comment-17316912 ] Hadoop QA commented on HDFS-15788: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HDFS-15788) Correct the statement for pmem cache to reflect cache persistence support

2021-04-08 Thread Feilong He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316901#comment-17316901 ] Feilong He commented on HDFS-15788: --- Hi [~ayushtkn], sorry for this late reply. This issue is relevant

[jira] [Updated] (HDFS-15788) Correct the statement for pmem cache to reflect cache persistence support

2021-04-08 Thread Feilong He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feilong He updated HDFS-15788: -- Target Version/s: 3.3.1, 3.4.0 (was: 3.3.1, 3.4.0, 3.1.5, 3.2.3) > Correct the statement for pmem

[jira] [Work logged] (HDFS-15956) Provide utility class for FSNamesystem

2021-04-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15956?focusedWorklogId=578931=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-578931 ] ASF GitHub Bot logged work on HDFS-15956: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15788) Correct the statement for pmem cache to reflect cache persistence support

2021-04-08 Thread Feilong He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feilong He updated HDFS-15788: -- Attachment: HDFS-15788-02.patch > Correct the statement for pmem cache to reflect cache persistence