[jira] [Created] (HDFS-15973) RBF: Add permission check before doting router federation rename.

2021-04-14 Thread Jinglun (Jira)
Jinglun created HDFS-15973: -- Summary: RBF: Add permission check before doting router federation rename. Key: HDFS-15973 URL: https://issues.apache.org/jira/browse/HDFS-15973 Project: Hadoop HDFS

[jira] [Created] (HDFS-15899) Remove rpcThreadPool from DeadNodeDetector.

2021-03-16 Thread Jinglun (Jira)
Jinglun created HDFS-15899: -- Summary: Remove rpcThreadPool from DeadNodeDetector. Key: HDFS-15899 URL: https://issues.apache.org/jira/browse/HDFS-15899 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15809) DeadNodeDetector doesn't remove live nodes from dead node set.

2021-02-01 Thread Jinglun (Jira)
Jinglun created HDFS-15809: -- Summary: DeadNodeDetector doesn't remove live nodes from dead node set. Key: HDFS-15809 URL: https://issues.apache.org/jira/browse/HDFS-15809 Project: Hadoop HDFS

[jira] [Created] (HDFS-15806) DeadNodeDetector should close all the threads when it is closed.

2021-01-31 Thread Jinglun (Jira)
Jinglun created HDFS-15806: -- Summary: DeadNodeDetector should close all the threads when it is closed. Key: HDFS-15806 URL: https://issues.apache.org/jira/browse/HDFS-15806 Project: Hadoop HDFS

[jira] [Created] (HDFS-15784) RBF: Expose router federation rename metrics in the Web UI.

2021-01-21 Thread Jinglun (Jira)
Jinglun created HDFS-15784: -- Summary: RBF: Expose router federation rename metrics in the Web UI. Key: HDFS-15784 URL: https://issues.apache.org/jira/browse/HDFS-15784 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-15767) RBF: Router federation rename of directory.

2021-01-06 Thread Jinglun (Jira)
Jinglun created HDFS-15767: -- Summary: RBF: Router federation rename of directory. Key: HDFS-15767 URL: https://issues.apache.org/jira/browse/HDFS-15767 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-15766) RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver.

2021-01-06 Thread Jinglun (Jira)
Jinglun created HDFS-15766: -- Summary: RBF: MockResolver.getMountPoints() breaks the semantic of FileSubclusterResolver. Key: HDFS-15766 URL: https://issues.apache.org/jira/browse/HDFS-15766 Project: Hadoop

[jira] [Created] (HDFS-15748) RBF: Move hadoop-federation-balance module to hadoop-hdfs-rbf.

2020-12-23 Thread Jinglun (Jira)
Jinglun created HDFS-15748: -- Summary: RBF: Move hadoop-federation-balance module to hadoop-hdfs-rbf. Key: HDFS-15748 URL: https://issues.apache.org/jira/browse/HDFS-15748 Project: Hadoop HDFS

[jira] [Created] (HDFS-15747) RBF: Rename across sub-namespaces.

2020-12-23 Thread Jinglun (Jira)
Jinglun created HDFS-15747: -- Summary: RBF: Rename across sub-namespaces. Key: HDFS-15747 URL: https://issues.apache.org/jira/browse/HDFS-15747 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Created] (HDFS-15730) Erasure Coding: Fix unit test bug of TestAddOverReplicatedStripedBlocks.testProcessOverReplicatedAndCorruptStripedBlock.

2020-12-17 Thread Jinglun (Jira)
Jinglun created HDFS-15730: -- Summary: Erasure Coding: Fix unit test bug of TestAddOverReplicatedStripedBlocks.testProcessOverReplicatedAndCorruptStripedBlock. Key: HDFS-15730 URL:

[jira] [Created] (HDFS-15662) Complete the javadoc of hadoop-federation-balance.

2020-10-30 Thread Jinglun (Jira)
Jinglun created HDFS-15662: -- Summary: Complete the javadoc of hadoop-federation-balance. Key: HDFS-15662 URL: https://issues.apache.org/jira/browse/HDFS-15662 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15661) The DeadNodeDetector shouldn't be shared by different DFSClients.

2020-10-29 Thread Jinglun (Jira)
Jinglun created HDFS-15661: -- Summary: The DeadNodeDetector shouldn't be shared by different DFSClients. Key: HDFS-15661 URL: https://issues.apache.org/jira/browse/HDFS-15661 Project: Hadoop HDFS

[jira] [Created] (HDFS-15645) DatanodeManager.getNumOfDataNodes should consider the include set of host config.

2020-10-21 Thread Jinglun (Jira)
Jinglun created HDFS-15645: -- Summary: DatanodeManager.getNumOfDataNodes should consider the include set of host config. Key: HDFS-15645 URL: https://issues.apache.org/jira/browse/HDFS-15645 Project: Hadoop

[jira] [Reopened] (HDFS-15294) Federation balance tool

2020-10-19 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-15294: > Federation balance tool > --- > > Key: HDFS-15294 > URL:

[jira] [Created] (HDFS-15640) RBF: Add fast distcp threshold to FedBalance.

2020-10-19 Thread Jinglun (Jira)
Jinglun created HDFS-15640: -- Summary: RBF: Add fast distcp threshold to FedBalance. Key: HDFS-15640 URL: https://issues.apache.org/jira/browse/HDFS-15640 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15636. Resolution: Duplicate Duplicate with HDFS-14383 > NameNode computes load by group when choosing

[jira] [Created] (HDFS-15636) NameNode computes load by group when choosing datanodes.

2020-10-16 Thread Jinglun (Jira)
Jinglun created HDFS-15636: -- Summary: NameNode computes load by group when choosing datanodes. Key: HDFS-15636 URL: https://issues.apache.org/jira/browse/HDFS-15636 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15605) DeadNodeDetector supports getting deadnode from NameNode.

2020-09-29 Thread Jinglun (Jira)
Jinglun created HDFS-15605: -- Summary: DeadNodeDetector supports getting deadnode from NameNode. Key: HDFS-15605 URL: https://issues.apache.org/jira/browse/HDFS-15605 Project: Hadoop HDFS Issue

[jira] [Resolved] (HDFS-14813) RBF: Make Global quota and Remote quota consistent.

2020-09-24 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14813. Resolution: Fixed Resolve this issue. > RBF: Make Global quota and Remote quota consistent. >

[jira] [Created] (HDFS-15582) Reduce NameNode audit log

2020-09-17 Thread Jinglun (Jira)
Jinglun created HDFS-15582: -- Summary: Reduce NameNode audit log Key: HDFS-15582 URL: https://issues.apache.org/jira/browse/HDFS-15582 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15410) Add separated config file fedbalance-default.xml for fedbalance tool.

2020-06-12 Thread Jinglun (Jira)
Jinglun created HDFS-15410: -- Summary: Add separated config file fedbalance-default.xml for fedbalance tool. Key: HDFS-15410 URL: https://issues.apache.org/jira/browse/HDFS-15410 Project: Hadoop HDFS

[jira] [Created] (HDFS-15374) Add documentation for command `fedbalance`

2020-05-24 Thread Jinglun (Jira)
Jinglun created HDFS-15374: -- Summary: Add documentation for command `fedbalance` Key: HDFS-15374 URL: https://issues.apache.org/jira/browse/HDFS-15374 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-15346) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance.

2020-05-08 Thread Jinglun (Jira)
Jinglun created HDFS-15346: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 2: The DistCpFedBalance. Key: HDFS-15346 URL: https://issues.apache.org/jira/browse/HDFS-15346

[jira] [Created] (HDFS-15340) RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler)

2020-05-06 Thread Jinglun (Jira)
Jinglun created HDFS-15340: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff / Step 1: The State Machine(BalanceProcedureScheduler) Key: HDFS-15340 URL:

[jira] [Created] (HDFS-15338) listOpenFiles() should throw InvalidPathException to remind the admin.

2020-05-06 Thread Jinglun (Jira)
Jinglun created HDFS-15338: -- Summary: listOpenFiles() should throw InvalidPathException to remind the admin. Key: HDFS-15338 URL: https://issues.apache.org/jira/browse/HDFS-15338 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-15314) Add concat fs command

2020-04-30 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-15314. Resolution: Invalid Jira should in hadoop-common > Add concat fs command > - > >

[jira] [Created] (HDFS-15314) Add concat fs command

2020-04-30 Thread Jinglun (Jira)
Jinglun created HDFS-15314: -- Summary: Add concat fs command Key: HDFS-15314 URL: https://issues.apache.org/jira/browse/HDFS-15314 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] [Created] (HDFS-15295) AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance.

2020-04-22 Thread Jinglun (Jira)
Jinglun created HDFS-15295: -- Summary: AvailableSpaceBlockPlacementPolicy should use chooseRandomWithStorageTypeTwoTrial() for better performance. Key: HDFS-15295 URL: https://issues.apache.org/jira/browse/HDFS-15295

[jira] [Created] (HDFS-15294) RBF: Balance data across federation namespaces with DistCp and snapshot diff

2020-04-22 Thread Jinglun (Jira)
Jinglun created HDFS-15294: -- Summary: RBF: Balance data across federation namespaces with DistCp and snapshot diff Key: HDFS-15294 URL: https://issues.apache.org/jira/browse/HDFS-15294 Project: Hadoop HDFS

[jira] [Created] (HDFS-15176) Enable GcTimePercentage Metric in NameNode's JvmMetrics.

2020-02-17 Thread Jinglun (Jira)
Jinglun created HDFS-15176: -- Summary: Enable GcTimePercentage Metric in NameNode's JvmMetrics. Key: HDFS-15176 URL: https://issues.apache.org/jira/browse/HDFS-15176 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15120) Refresh BlockPlacementPolicy at runtime.

2020-01-13 Thread Jinglun (Jira)
Jinglun created HDFS-15120: -- Summary: Refresh BlockPlacementPolicy at runtime. Key: HDFS-15120 URL: https://issues.apache.org/jira/browse/HDFS-15120 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15106) Remove unused code.

2020-01-09 Thread Jinglun (Jira)
Jinglun created HDFS-15106: -- Summary: Remove unused code. Key: HDFS-15106 URL: https://issues.apache.org/jira/browse/HDFS-15106 Project: Hadoop HDFS Issue Type: Improvement Reporter:

[jira] [Created] (HDFS-15087) RBF: Balance/Rename across federation namespaces

2019-12-30 Thread Jinglun (Jira)
Jinglun created HDFS-15087: -- Summary: RBF: Balance/Rename across federation namespaces Key: HDFS-15087 URL: https://issues.apache.org/jira/browse/HDFS-15087 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15049) Fix annotation of RouterWebServices

2019-12-11 Thread Jinglun (Jira)
Jinglun created HDFS-15049: -- Summary: Fix annotation of RouterWebServices Key: HDFS-15049 URL: https://issues.apache.org/jira/browse/HDFS-15049 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15020) Add a test case of storage type quota to TestHdfsAdmin.

2019-11-27 Thread Jinglun (Jira)
Jinglun created HDFS-15020: -- Summary: Add a test case of storage type quota to TestHdfsAdmin. Key: HDFS-15020 URL: https://issues.apache.org/jira/browse/HDFS-15020 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-15003) RBF: Make Router support storage type quota.

2019-11-21 Thread Jinglun (Jira)
Jinglun created HDFS-15003: -- Summary: RBF: Make Router support storage type quota. Key: HDFS-15003 URL: https://issues.apache.org/jira/browse/HDFS-15003 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-15002) RBF: Fix annotation in RouterAdmin

2019-11-21 Thread Jinglun (Jira)
Jinglun created HDFS-15002: -- Summary: RBF: Fix annotation in RouterAdmin Key: HDFS-15002 URL: https://issues.apache.org/jira/browse/HDFS-15002 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14964) Race between RouterUpdateService and RouterAdmin -setQuota

2019-11-07 Thread Jinglun (Jira)
Jinglun created HDFS-14964: -- Summary: Race between RouterUpdateService and RouterAdmin -setQuota Key: HDFS-14964 URL: https://issues.apache.org/jira/browse/HDFS-14964 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-14955) RBF: getQuotaUsage() on mount point should return global quota.

2019-11-06 Thread Jinglun (Jira)
Jinglun created HDFS-14955: -- Summary: RBF: getQuotaUsage() on mount point should return global quota. Key: HDFS-14955 URL: https://issues.apache.org/jira/browse/HDFS-14955 Project: Hadoop HDFS

[jira] [Created] (HDFS-14908) LeaseManager should check parent-child relationship when filter open files.

2019-10-15 Thread Jinglun (Jira)
Jinglun created HDFS-14908: -- Summary: LeaseManager should check parent-child relationship when filter open files. Key: HDFS-14908 URL: https://issues.apache.org/jira/browse/HDFS-14908 Project: Hadoop HDFS

[jira] [Created] (HDFS-14868) Fix typo in TestRouterQuota

2019-09-23 Thread Jinglun (Jira)
Jinglun created HDFS-14868: -- Summary: Fix typo in TestRouterQuota Key: HDFS-14868 URL: https://issues.apache.org/jira/browse/HDFS-14868 Project: Hadoop HDFS Issue Type: Bug Reporter:

[jira] [Created] (HDFS-14867) RBF: RouterRpcServer.getListing() returns wrong owner, group and permission.

2019-09-22 Thread Jinglun (Jira)
Jinglun created HDFS-14867: -- Summary: RBF: RouterRpcServer.getListing() returns wrong owner, group and permission. Key: HDFS-14867 URL: https://issues.apache.org/jira/browse/HDFS-14867 Project: Hadoop HDFS

[jira] [Created] (HDFS-14815) RBF: Update the quota in MountTable when calling setQuota on a MountTable src.

2019-09-03 Thread Jinglun (Jira)
Jinglun created HDFS-14815: -- Summary: RBF: Update the quota in MountTable when calling setQuota on a MountTable src. Key: HDFS-14815 URL: https://issues.apache.org/jira/browse/HDFS-14815 Project: Hadoop

[jira] [Created] (HDFS-14814) RBF: The quota should be set the same as the nearest parent in Global Quota.

2019-09-03 Thread Jinglun (Jira)
Jinglun created HDFS-14814: -- Summary: RBF: The quota should be set the same as the nearest parent in Global Quota. Key: HDFS-14814 URL: https://issues.apache.org/jira/browse/HDFS-14814 Project: Hadoop HDFS

[jira] [Created] (HDFS-14813) RBF: Some improvements on Global Quota.

2019-09-03 Thread Jinglun (Jira)
Jinglun created HDFS-14813: -- Summary: RBF: Some improvements on Global Quota. Key: HDFS-14813 URL: https://issues.apache.org/jira/browse/HDFS-14813 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14782) Add a new fsck command to get detailed decommission information.

2019-08-27 Thread Jinglun (Jira)
Jinglun created HDFS-14782: -- Summary: Add a new fsck command to get detailed decommission information. Key: HDFS-14782 URL: https://issues.apache.org/jira/browse/HDFS-14782 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-08-07 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-14631: upload patch for branch-2.x > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Resolved] (HDFS-14542) Remove redundant code when verify quota

2019-07-30 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14542. Resolution: Duplicate Thanks [~jojochuang] for your reminding, I'll close this with Resolution:

[jira] [Reopened] (HDFS-14631) The DirectoryScanner doesn't fix the wrongly placed replica.

2019-07-30 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-14631: > The DirectoryScanner doesn't fix the wrongly placed replica. >

[jira] [Created] (HDFS-14633) The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc.

2019-07-06 Thread Jinglun (JIRA)
Jinglun created HDFS-14633: -- Summary: The StorageType consume in QuotaFeature is not handled when addBlock, delete, rename, setStoragePolicy etc. Key: HDFS-14633 URL: https://issues.apache.org/jira/browse/HDFS-14633

[jira] [Resolved] (HDFS-14591) NameNode should move the replicas to the correct storages after the storage policy is changed.

2019-06-21 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-14591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun resolved HDFS-14591. Resolution: Fixed redundant with HDFS-10285, HDFS-7343 > NameNode should move the replicas to the correct

[jira] [Created] (HDFS-14591) NameNode should move the replicas to the correct storages after the storage policy is changed.

2019-06-20 Thread Jinglun (JIRA)
Jinglun created HDFS-14591: -- Summary: NameNode should move the replicas to the correct storages after the storage policy is changed. Key: HDFS-14591 URL: https://issues.apache.org/jira/browse/HDFS-14591

[jira] [Created] (HDFS-14568) The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed.

2019-06-14 Thread Jinglun (JIRA)
Jinglun created HDFS-14568: -- Summary: The quota and consume of the file's ancestors are not handled when the storage policy of the file is changed. Key: HDFS-14568 URL: https://issues.apache.org/jira/browse/HDFS-14568

[jira] [Created] (HDFS-14566) Quota improvment in HDFS

2019-06-13 Thread Jinglun (JIRA)
Jinglun created HDFS-14566: -- Summary: Quota improvment in HDFS Key: HDFS-14566 URL: https://issues.apache.org/jira/browse/HDFS-14566 Project: Hadoop HDFS Issue Type: Improvement Affects

[jira] [Created] (HDFS-14562) The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable.

2019-06-12 Thread Jinglun (JIRA)
Jinglun created HDFS-14562: -- Summary: The behaviour of getContentSummaryInt() in getQuotaUsage() should be configurable. Key: HDFS-14562 URL: https://issues.apache.org/jira/browse/HDFS-14562 Project: Hadoop

[jira] [Created] (HDFS-14547) DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set.

2019-06-04 Thread Jinglun (JIRA)
Jinglun created HDFS-14547: -- Summary: DirectoryWithQuotaFeature.quota costs additional memory even the storage type quota is not set. Key: HDFS-14547 URL: https://issues.apache.org/jira/browse/HDFS-14547

[jira] [Created] (HDFS-14542) Remove redundant code when verify quota

2019-06-04 Thread Jinglun (JIRA)
Jinglun created HDFS-14542: -- Summary: Remove redundant code when verify quota Key: HDFS-14542 URL: https://issues.apache.org/jira/browse/HDFS-14542 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-14515) The proto type of quota should change to int64.

2019-05-27 Thread Jinglun (JIRA)
Jinglun created HDFS-14515: -- Summary: The proto type of quota should change to int64. Key: HDFS-14515 URL: https://issues.apache.org/jira/browse/HDFS-14515 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-13901) INode access time is ignored because of race between open and rename

2018-09-06 Thread Jinglun (JIRA)
Jinglun created HDFS-13901: -- Summary: INode access time is ignored because of race between open and rename Key: HDFS-13901 URL: https://issues.apache.org/jira/browse/HDFS-13901 Project: Hadoop HDFS

[jira] [Reopened] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-11 Thread Jinglun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-13388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun reopened HDFS-13388: There is a problem with the patch. When it uses reflection to call the method, the InvocationTargetException

[jira] [Created] (HDFS-13388) RequestHedgingProxyProvider calls multiple configured NNs all the time

2018-04-03 Thread Jinglun (JIRA)
Jinglun created HDFS-13388: -- Summary: RequestHedgingProxyProvider calls multiple configured NNs all the time Key: HDFS-13388 URL: https://issues.apache.org/jira/browse/HDFS-13388 Project: Hadoop HDFS