[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=504972=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504972 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=504987=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504987 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=504988=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504988 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-15654) TestBPOfferService#testMissBlocksWhenReregister is flaky

Ahmed Hussein created HDFS-15654: Summary: TestBPOfferService#testMissBlocksWhenReregister is flaky Key: HDFS-15654 URL: https://issues.apache.org/jira/browse/HDFS-15654 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Resolved] (HDFS-15294) Federation balance tool

[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin resolved HDFS-15294. -- Resolution: Fixed > Federation balance tool > --- > > Key:

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=504983=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504983 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15640) Add snapshot diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Summary: Add snapshot diff threshold to FedBalance (was: RBF: Add fast distcp threshold to FedBalance.)

[jira] [Commented] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221114#comment-17221114 ] Uma Maheswara Rao G commented on HDFS-15289: [~zuston] Yes, it will support. For specific to

[jira] [Commented] (HDFS-15654) TestBPOfferService#testMissBlocksWhenReregister is flaky

[ https://issues.apache.org/jira/browse/HDFS-15654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221146#comment-17221146 ] Xiaoqiao He commented on HDFS-15654: Thanks [~ahussein] for your dig and detailed description. Would

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=505042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-505042 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221089#comment-17221089 ] Yiqun Lin edited comment on HDFS-15640 at 10/27/20, 2:48 AM: - Committed this

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221107#comment-17221107 ] Xiaoqiao He commented on HDFS-15651: {quote}The blocktoken key will be updated for every

[jira] [Work logged] (HDFS-15635) ViewFileSystemOverloadScheme support specifying mount table loader imp through conf

[ https://issues.apache.org/jira/browse/HDFS-15635?focusedWorklogId=504993=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504993 ] ASF GitHub Bot logged work on HDFS-15635: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=505008=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-505008 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=505036=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-505036 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=505035=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-505035 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-14090) RBF: Improved isolation for downstream name nodes. {Static}

[ https://issues.apache.org/jira/browse/HDFS-14090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221156#comment-17221156 ] Hui Fei commented on HDFS-14090: [~crh] Thanks for great work here, and [~fengnanli] thanks for taking

[jira] [Updated] (HDFS-15640) Add diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Summary: Add diff threshold to FedBalance (was: Add snapshot diff threshold to FedBalance) > Add diff

[jira] [Updated] (HDFS-15640) Add snapshot diff threshold to FedBalance

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15640: - Description: Currently in the DistCpProcedure it must submit distcp round by round until there is no

[jira] [Work logged] (HDFS-15635) ViewFileSystemOverloadScheme support specifying mount table loader imp through conf

[ https://issues.apache.org/jira/browse/HDFS-15635?focusedWorklogId=504994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504994 ] ASF GitHub Bot logged work on HDFS-15635: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15640: --- Attachment: HDFS-15640.004.patch > RBF: Add fast distcp threshold to FedBalance. >

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220588#comment-17220588 ] Jinglun commented on HDFS-15640: Hi [~linyiqun], thanks your comments ! Upload v04. > RBF: Add fast

[jira] [Created] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

Yiqun Lin created HDFS-15651: Summary: Client could not obtain block when DN CommandProcessingThread exit Key: HDFS-15651 URL: https://issues.apache.org/jira/browse/HDFS-15651 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220616#comment-17220616 ] Hadoop QA commented on HDFS-15640: -- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Work logged] (HDFS-15548) Allow configuring DISK/ARCHIVE storage types on same device mount

[ https://issues.apache.org/jira/browse/HDFS-15548?focusedWorklogId=504671=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504671 ] ASF GitHub Bot logged work on HDFS-15548: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Commented] (HDFS-13965) hadoop.security.kerberos.ticket.cache.path setting is not honored when KMS encryption is enabled.

[ https://issues.apache.org/jira/browse/HDFS-13965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220582#comment-17220582 ] István Fajth commented on HDFS-13965: - I believe you should not use the default ticket cache path for

[jira] [Updated] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15651: - Description: In our cluster, we applied the HDFS-14997 improvement. We find one case that

[jira] [Comment Edited] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220611#comment-17220611 ] Yiqun Lin edited comment on HDFS-15640 at 10/26/20, 10:33 AM: -- Latest patch

[jira] [Commented] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

[ https://issues.apache.org/jira/browse/HDFS-15640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220611#comment-17220611 ] Yiqun Lin commented on HDFS-15640: -- Latest patch LGTM, +1. Will commit this tomorrow once there is

[jira] [Work logged] (HDFS-15643) TestFileChecksumCompositeCrc fails on trunk

[ https://issues.apache.org/jira/browse/HDFS-15643?focusedWorklogId=504719=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504719 ] ASF GitHub Bot logged work on HDFS-15643: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220744#comment-17220744 ] Xiaoqiao He commented on HDFS-15641: Thanks [~wanghongbing],[~ferhui] for your works here, and sorry

[jira] [Created] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

Hui Fei created HDFS-15652: -- Summary: Make block size from NNThroughputBenchmark configurable Key: HDFS-15652 URL: https://issues.apache.org/jira/browse/HDFS-15652 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15652: --- Status: Patch Available (was: Open) > Make block size from NNThroughputBenchmark configurable >

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220650#comment-17220650 ] Hongbing Wang commented on HDFS-15641: -- Thanks! Expect it to be merged!:D > DataNode could meet

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=504723=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504723 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-15652: -- Labels: pull-request-available (was: ) > Make block size from NNThroughputBenchmark

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220726#comment-17220726 ] Hui Fei commented on HDFS-15641: Push to trunk. [~wanghongbing] Thanks for your report and work here.

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15641: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > DataNode

[jira] [Work logged] (HDFS-15652) Make block size from NNThroughputBenchmark configurable

[ https://issues.apache.org/jira/browse/HDFS-15652?focusedWorklogId=504815=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504815 ] ASF GitHub Bot logged work on HDFS-15652: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15460?focusedWorklogId=504836=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504836 ] ASF GitHub Bot logged work on HDFS-15460: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220819#comment-17220819 ] Hadoop QA commented on HDFS-15644: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Work logged] (HDFS-15460) TestFileCreation#testServerDefaultsWithMinimalCaching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-15460?focusedWorklogId=504813=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504813 ] ASF GitHub Bot logged work on HDFS-15460: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220749#comment-17220749 ] Xiaoqiao He commented on HDFS-15651: Thanks [~linyiqun] for your report. Catch the error and loop

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220747#comment-17220747 ] Hui Fei commented on HDFS-15641: Cherry-pick to branch3.1, branch-3.2,branch-3.3 > DataNode could meet

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15641: --- Fix Version/s: 3.1.5 3.3.1 3.2.2 > DataNode could meet deadlock if

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15641: --- Fix Version/s: (was: 3.2.2) 3.2.3 > DataNode could meet deadlock if invoke

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=504765=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504765 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220794#comment-17220794 ] Yiqun Lin commented on HDFS-15651: -- Thanks for the comments, [~hexiaoqiao]. {quote}Catch the error and

[jira] [Comment Edited] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220794#comment-17220794 ] Yiqun Lin edited comment on HDFS-15651 at 10/26/20, 4:21 PM: - Thanks for the

[jira] [Updated] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmed Hussein updated HDFS-15644: - Attachment: HDFS-15644-branch-2.10.002.patch > Failed volumes can cause DNs to stop block

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220765#comment-17220765 ] Xiaoqiao He commented on HDFS-15644: Hi [~weichiu],[~ahussein], Just found that fix versions include

[jira] [Reopened] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reopened HDFS-15641: > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Commented] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220753#comment-17220753 ] Hui Fei commented on HDFS-15641: [~hexiaoqiao] I have a mistake as above comment {quote} Sorry, i miss

[jira] [Resolved] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei resolved HDFS-15641. Resolution: Fixed > DataNode could meet deadlock if invoke refreshNameNode >

[jira] [Updated] (HDFS-15641) DataNode could meet deadlock if invoke refreshNameNode

[ https://issues.apache.org/jira/browse/HDFS-15641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-15641: --- Target Version/s: 3.3.1, 3.4.0, 3.1.5, 3.2.3 (was: 3.2.2, 3.3.1, 3.4.0, 3.2.3) > DataNode could meet

[jira] [Commented] (HDFS-15644) Failed volumes can cause DNs to stop block reporting

[ https://issues.apache.org/jira/browse/HDFS-15644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17220759#comment-17220759 ] Ahmed Hussein commented on HDFS-15644: -- Thanks [~weichiu] for committing the patch into 3.x. It is

[jira] [Work logged] (HDFS-15580) [JDK 12] DFSTestUtil#addDataNodeLayoutVersion fails

[ https://issues.apache.org/jira/browse/HDFS-15580?focusedWorklogId=504766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-504766 ] ASF GitHub Bot logged work on HDFS-15580: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-15653) dfshealth.html#tab-overview is not working

[ https://issues.apache.org/jira/browse/HDFS-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yakir Gibraltar updated HDFS-15653: --- Summary: dfshealth.html#tab-overview is not working (was: dfshealth.html#tab-overview not

[jira] [Created] (HDFS-15653) dfshealth.html#tab-overview not working

Yakir Gibraltar created HDFS-15653: -- Summary: dfshealth.html#tab-overview not working Key: HDFS-15653 URL: https://issues.apache.org/jira/browse/HDFS-15653 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-15653) dfshealth.html#tab-overview is not working

[ https://issues.apache.org/jira/browse/HDFS-15653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yakir Gibraltar resolved HDFS-15653. Resolution: Fixed Hard reload fixed the issue. > dfshealth.html#tab-overview is not