[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366727#comment-17366727 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] for your update. {quote}A.

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17366728#comment-17366728 ] Xiaoqiao He commented on HDFS-16044: Please check report by Yetus, include checkstyle

[jira] [Commented] (HDFS-16044) getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367419#comment-17367419 ] Xiaoqiao He commented on HDFS-16044: [^HDFS-16044.03.patch] LGTM. +1 from my side. cc

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17368932#comment-17368932 ] Xiaoqiao He commented on HDFS-16067: Try to check failed unit tests at local, both of

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Summary: Fix getListing call getLocatedBlocks even source is a directory (was: getListing call getLo

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369506#comment-17369506 ] Xiaoqiao He commented on HDFS-16044: This PR seems broken unit test but not reported

[jira] [Reopened] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reopened HDFS-16044: > Fix getListing call getLocatedBlocks even source is a directory > ---

[jira] [Updated] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16044: --- Fix Version/s: (was: 3.4.0) > Fix getListing call getLocatedBlocks even source is a directory > -

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17369515#comment-17369515 ] Xiaoqiao He commented on HDFS-16067: Most of failed unit tests is related with https

[jira] [Assigned] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16100: -- Assignee: wudeyu > HA: Improve performance of Standby node transition to Active > ---

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372103#comment-17372103 ] Xiaoqiao He commented on HDFS-16100: Thanks [~g20141821] for your report. Add [~g201

[jira] [Assigned] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16097: -- Assignee: lei w > Datanode receives ipc requests will throw NPE when datanode quickly restart

[jira] [Updated] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16097: --- Status: Patch Available (was: Open) > Datanode receives ipc requests will throw NPE when datanode qu

[jira] [Commented] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372105#comment-17372105 ] Xiaoqiao He commented on HDFS-16097: Thanks [~lei w] for your report. It is good impr

[jira] [Commented] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372114#comment-17372114 ] Xiaoqiao He commented on HDFS-16102: Thanks [~lei w] for your report, It seems that y

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372116#comment-17372116 ] Xiaoqiao He commented on HDFS-16093: -1 to remove DECOMMISSIONING state node from `Lo

[jira] [Commented] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372119#comment-17372119 ] Xiaoqiao He commented on HDFS-16088: Thanks [~tomscut] involve me here. It makes sens

[jira] [Resolved] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16099. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17372912#comment-17372912 ] Xiaoqiao He commented on HDFS-16100: I am not familiar to this logic, but it sounds r

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17374323#comment-17374323 ] Xiaoqiao He commented on HDFS-16100: Thanks [~ayushtkn] for your comments. IMO, it is

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375741#comment-17375741 ] Xiaoqiao He commented on HDFS-16115: [~Daniel Ma] Thanks for your report. I am not su

[jira] [Commented] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

[ https://issues.apache.org/jira/browse/HDFS-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17375756#comment-17375756 ] Xiaoqiao He commented on HDFS-16095: [~zhuxiangyi] Thanks for involving me here. {qu

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376251#comment-17376251 ] Xiaoqiao He commented on HDFS-16100: [^HDFS-16100.001.patch] it is safe to checkin an

[jira] [Commented] (HDFS-16115) Asynchronously handle BPServiceActor command mechanism may result in BPServiceActor never fails even CommandProcessingThread is closed with fatal error.

[ https://issues.apache.org/jira/browse/HDFS-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17376556#comment-17376556 ] Xiaoqiao He commented on HDFS-16115: I agree with you that HDFS-15651 is rough soluti

[jira] [Commented] (HDFS-16379) Reset fullBlockReportLeaseId after any exceptions

[ https://issues.apache.org/jira/browse/HDFS-16379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17457537#comment-17457537 ] Xiaoqiao He commented on HDFS-16379: Thanks [~tomscut] involve me here. I am not sure

[jira] [Commented] (HDFS-16261) Configurable grace period around invalidation of replaced blocks

[ https://issues.apache.org/jira/browse/HDFS-16261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17457543#comment-17457543 ] Xiaoqiao He commented on HDFS-16261: Thanks [~bbeaudreault] for your detailed analysi

[jira] [Resolved] (HDFS-16378) Add datanode address to BlockReportLeaseManager logs

[ https://issues.apache.org/jira/browse/HDFS-16378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16378. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Resolved] (HDFS-16352) return the real datanode numBlocks in #getDatanodeStorageReport

[ https://issues.apache.org/jira/browse/HDFS-16352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16352. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16404) Fix typo for CachingGetSpaceUsed

[ https://issues.apache.org/jira/browse/HDFS-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16404: --- Issue Type: Improvement (was: Bug) > Fix typo for CachingGetSpaceUsed >

[jira] [Resolved] (HDFS-16404) Fix typo for CachingGetSpaceUsed

[ https://issues.apache.org/jira/browse/HDFS-16404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16404. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16044) Fix getListing call getLocatedBlocks even source is a directory

[ https://issues.apache.org/jira/browse/HDFS-16044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17471308#comment-17471308 ] Xiaoqiao He commented on HDFS-16044: Thanks [~ayushtkn] for your comments. This is va

[jira] [Resolved] (HDFS-16418) task

[ https://issues.apache.org/jira/browse/HDFS-16418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16418. Resolution: Invalid Close as it is invalid JIRA. [~sundasibrar] Please feel free to reopen it if of

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17472752#comment-17472752 ] Xiaoqiao He commented on HDFS-16043: Thanks [~mofei] for your information. Not sure i

[jira] [Resolved] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16043. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Will

[jira] [Updated] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16043: --- Fix Version/s: 3.3.2 > Add markedDeleteBlockScrubberThread to delete blocks asynchronously >

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17476645#comment-17476645 ] Xiaoqiao He commented on HDFS-16043: Committed to branch-3.3. {quote}Now it is prelim

[jira] [Updated] (HDFS-16402) Improve HeartbeatManager logic to avoid incorrect stats

[ https://issues.apache.org/jira/browse/HDFS-16402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16402: --- Summary: Improve HeartbeatManager logic to avoid incorrect stats (was: HeartbeatManager may cause in

[jira] [Resolved] (HDFS-16402) Improve HeartbeatManager logic to avoid incorrect stats

[ https://issues.apache.org/jira/browse/HDFS-16402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16402. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16429) Add DataSetLockManager to maintain locks for FsDataSetImpl

[ https://issues.apache.org/jira/browse/HDFS-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16429: --- Fix Version/s: (was: 3.2.0) Target Version/s: (was: 3.2.0) Affects Version/s: (

[jira] [Updated] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16428: --- Summary: Source path with storagePolicy cause wrong typeConsumed while rename (was: Source path sett

[jira] [Resolved] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16428. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16429) Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl

[ https://issues.apache.org/jira/browse/HDFS-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16429: --- Summary: Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl (was: Add DataSetLockMa

[jira] [Resolved] (HDFS-16429) Add DataSetLockManager to manage fine-grain locks for FsDataSetImpl

[ https://issues.apache.org/jira/browse/HDFS-16429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16429. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17495328#comment-17495328 ] Xiaoqiao He commented on HDFS-15382: Thanks [~yuanbo] for your feedback. [~Aiphag0] i

[jira] [Updated] (HDFS-15382) Split one FsDatasetImpl lock to block pool grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15382: --- Summary: Split one FsDatasetImpl lock to block pool grain locks. (was: Split FsDatasetImpl from bloc

[jira] [Resolved] (HDFS-15382) Split one FsDatasetImpl lock to block pool grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15382. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16214) Asynchronously collect blocks and update quota when deleting

[ https://issues.apache.org/jira/browse/HDFS-16214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505255#comment-17505255 ] Xiaoqiao He commented on HDFS-16214: Thanks [~zhuxiangyi] for your proposal. It is a

[jira] [Updated] (HDFS-16428) Source path with storagePolicy cause wrong typeConsumed while rename

[ https://issues.apache.org/jira/browse/HDFS-16428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16428: --- Fix Version/s: 3.2.3 3.3.3 Thanks [~prasad-acit] for your reminder, cherry-pick to

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15273: --- Attachment: HDFS-15273.002.patch > CacheReplicationMonitor hold lock for long time and lead to NN out

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505270#comment-17505270 ] Xiaoqiao He commented on HDFS-15273: Thanks [~weichiu] for your reminder. update the

[jira] [Resolved] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16494. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16494) Removed reuse of AvailableSpaceVolumeChoosingPolicy#initLocks()

[ https://issues.apache.org/jira/browse/HDFS-16494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16494: --- Affects Version/s: (was: 2.9.2) (was: 3.4.0) > Removed reuse of Availa

[jira] [Updated] (HDFS-16504) Add parameter for NameNode to process getBloks request

[ https://issues.apache.org/jira/browse/HDFS-16504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16504: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Summary: Add parameter for NameNode to proc

[jira] [Resolved] (HDFS-16504) Add parameter for NameNode to process getBloks request

[ https://issues.apache.org/jira/browse/HDFS-16504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16504. Resolution: Fixed > Add parameter for NameNode to process getBloks request > --

[jira] [Resolved] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-15987. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-15987) Improve oiv tool to parse fsimage file in parallel with delimited format

[ https://issues.apache.org/jira/browse/HDFS-15987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17510993#comment-17510993 ] Xiaoqiao He commented on HDFS-15987: revert and re-check in to correct the git messag

[jira] [Updated] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15273: --- Attachment: HDFS-15273.003.patch > CacheReplicationMonitor hold lock for long time and lead to NN out

[jira] [Commented] (HDFS-15273) CacheReplicationMonitor hold lock for long time and lead to NN out of service

[ https://issues.apache.org/jira/browse/HDFS-15273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17511029#comment-17511029 ] Xiaoqiao He commented on HDFS-15273: Submit v003 patch and trigger Yetus again. [~wei

[jira] [Resolved] (HDFS-16498) Fix NPE for checkBlockReportLease

[ https://issues.apache.org/jira/browse/HDFS-16498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16498. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16511) Improve lock type for ReplicaMap under fine-grain lock mode.

[ https://issues.apache.org/jira/browse/HDFS-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16511: --- Summary: Improve lock type for ReplicaMap under fine-grain lock mode. (was: Change some frequent met

[jira] [Updated] (HDFS-16511) Improve lock type for ReplicaMap under fine-grain lock mode.

[ https://issues.apache.org/jira/browse/HDFS-16511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16511: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Assigned] (HDFS-16516) fix filesystemshell wrong params

[ https://issues.apache.org/jira/browse/HDFS-16516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16516: -- Assignee: guophilipse > fix filesystemshell wrong params > >

[jira] [Resolved] (HDFS-16516) fix filesystemshell wrong params

[ https://issues.apache.org/jira/browse/HDFS-16516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16516. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Resolved] (HDFS-16509) Fix decommission UnsupportedOperationException: Remove unsupported

[ https://issues.apache.org/jira/browse/HDFS-16509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16509. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Resolved] (HDFS-16534) Split datanode block pool locks to volume grain.

[ https://issues.apache.org/jira/browse/HDFS-16534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16534. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-15382) Split one FsDatasetImpl lock to volume grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15382: --- Release Note: Throughput is one of the core performance evaluation for DataNode instance. However it

[jira] [Commented] (HDFS-15382) Split one FsDatasetImpl lock to volume grain locks.

[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1752#comment-1752 ] Xiaoqiao He commented on HDFS-15382: This big improvement has been ready completely n

[jira] [Resolved] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16531. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Commented] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525408#comment-17525408 ] Xiaoqiao He commented on HDFS-16531: Thanks [~ayushtkn] for your kind information. Ba

[jira] [Resolved] (HDFS-16500) Make asynchronous blocks deletion lock and unlock durtion threshold configurable

[ https://issues.apache.org/jira/browse/HDFS-16500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16500. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: (was: 3.3.1, 3.3.2)

[jira] [Commented] (HDFS-16531) Avoid setReplication logging an edit record if old replication equals the new value

[ https://issues.apache.org/jira/browse/HDFS-16531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525415#comment-17525415 ] Xiaoqiao He commented on HDFS-16531: [~hemanthboyina], Thanks very much for your remi

[jira] [Resolved] (HDFS-16554) Remove unused configuration dfs.namenode.block.deletion.increment.

[ https://issues.apache.org/jira/browse/HDFS-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16554. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: (was: 3.4.0)

[jira] [Updated] (HDFS-16554) Remove unused configuration dfs.namenode.block.deletion.increment.

[ https://issues.apache.org/jira/browse/HDFS-16554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16554: --- Component/s: namenode > Remove unused configuration dfs.namenode.block.deletion.increment. > ---

[jira] [Updated] (HDFS-16553) Fix checkstyle for the length of BlockManager construction method over limit.

[ https://issues.apache.org/jira/browse/HDFS-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16553: --- Component/s: namenode > Fix checkstyle for the length of BlockManager construction method over limit.

[jira] [Resolved] (HDFS-16553) Fix checkstyle for the length of BlockManager construction method over limit.

[ https://issues.apache.org/jira/browse/HDFS-16553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16553. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Target Version/s: (was: 3.4.0)

[jira] [Commented] (HDFS-16569) Consider attaching block location info from client when closing a completed file

[ https://issues.apache.org/jira/browse/HDFS-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532747#comment-17532747 ] Xiaoqiao He commented on HDFS-16569: [~yuanbo] Thanks for your report. Do you mean th

[jira] [Commented] (HDFS-16565) DataNode holds a large number of CLOSE_WAIT connections that are not released

[ https://issues.apache.org/jira/browse/HDFS-16565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532755#comment-17532755 ] Xiaoqiao He commented on HDFS-16565: [~jianghuazhu] Thanks for your report. Is it pos

[jira] [Commented] (HDFS-16569) Consider attaching block location info from client when closing a completed file

[ https://issues.apache.org/jira/browse/HDFS-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532790#comment-17532790 ] Xiaoqiao He commented on HDFS-16569: Thanks [~yuanbo] for your detailed explanation.

[jira] [Comment Edited] (HDFS-16569) Consider attaching block location info from client when closing a completed file

[ https://issues.apache.org/jira/browse/HDFS-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17532790#comment-17532790 ] Xiaoqiao He edited comment on HDFS-16569 at 5/6/22 11:22 AM: -

[jira] [Commented] (HDFS-16569) Consider attaching block location info from client when closing a completed file

[ https://issues.apache.org/jira/browse/HDFS-16569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534276#comment-17534276 ] Xiaoqiao He commented on HDFS-16569: {quote}Regarding Tectonic, seperating deamon thr

[jira] [Commented] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17381178#comment-17381178 ] Xiaoqiao He commented on HDFS-16067: Thanks [~prasad-acit] for your update. {code:j

[jira] [Updated] (HDFS-16067) Support Append API in NNThroughputBenchmark

[ https://issues.apache.org/jira/browse/HDFS-16067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16067: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Commented] (HDFS-15651) Client could not obtain block when DN CommandProcessingThread exit

[ https://issues.apache.org/jira/browse/HDFS-15651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383261#comment-17383261 ] Xiaoqiao He commented on HDFS-15651: Thanks [~hemanthboyina] for your information. I

[jira] [Updated] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15942: --- Fix Version/s: 3.2.3 > Increase Quota initialization threads > -

[jira] [Commented] (HDFS-15942) Increase Quota initialization threads

[ https://issues.apache.org/jira/browse/HDFS-15942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17383264#comment-17383264 ] Xiaoqiao He commented on HDFS-15942: cherry-pick to branch-3.2. > Increase Quota ini

[jira] [Resolved] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16087. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Assigned] (HDFS-16087) RBF balance process is stuck at DisableWrite stage

[ https://issues.apache.org/jira/browse/HDFS-16087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16087: -- Assignee: Eric Yin > RBF balance process is stuck at DisableWrite stage >

[jira] [Commented] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386822#comment-17386822 ] Xiaoqiao He commented on HDFS-16139: Thanks [~vjasani] for your report and contributi

[jira] [Commented] (HDFS-16138) BlockReportProcessingThread exit doesnt print the acutal stack

[ https://issues.apache.org/jira/browse/HDFS-16138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386824#comment-17386824 ] Xiaoqiao He commented on HDFS-16138: Thanks [~prasad-acit] involve me here. Which ver

[jira] [Commented] (HDFS-16137) Improve the comments related to FairCallQueue#queues

[ https://issues.apache.org/jira/browse/HDFS-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386825#comment-17386825 ] Xiaoqiao He commented on HDFS-16137: +1. Thanks. > Improve the comments related to F

[jira] [Assigned] (HDFS-16134) Optimize RPC throughput

[ https://issues.apache.org/jira/browse/HDFS-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16134: -- Assignee: JiangHua Zhu > Optimize RPC throughput > --- > >

[jira] [Commented] (HDFS-16134) Optimize RPC throughput

[ https://issues.apache.org/jira/browse/HDFS-16134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386828#comment-17386828 ] Xiaoqiao He commented on HDFS-16134: Thanks [~jianghuazhu] involve me here. HDFS-1548

[jira] [Commented] (HDFS-16118) Improve the number of handlers that initialize NameNodeRpcServer#clientRpcServer

[ https://issues.apache.org/jira/browse/HDFS-16118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386831#comment-17386831 ] Xiaoqiao He commented on HDFS-16118: Thanks [~jianghuazhu] involve me here. IMO it is

[jira] [Commented] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17386833#comment-17386833 ] Xiaoqiao He commented on HDFS-16139: Make sense to me. +1 from my side. > Update BPS

[jira] [Resolved] (HDFS-16131) Show storage type for failed volumes on namenode web

[ https://issues.apache.org/jira/browse/HDFS-16131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He resolved HDFS-16131. Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Committed to trunk. Thank

[jira] [Updated] (HDFS-16139) Update BPServiceActor Scheduler's nextBlockReportTime atomically

[ https://issues.apache.org/jira/browse/HDFS-16139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16139: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed Status: Resolved

[jira] [Updated] (HDFS-16014) Issue in checking native pmdk lib by 'hadoop checknative' command

[ https://issues.apache.org/jira/browse/HDFS-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16014: --- Target Version/s: 3.4.0, 3.2.4 (was: 3.4.0, 3.2.3) ===Bulk update=== planning to cut the branch for

[jira] [Updated] (HDFS-15289) Allow viewfs mounts with HDFS/HCFS scheme and centralized mount table

[ https://issues.apache.org/jira/browse/HDFS-15289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-15289: --- Target Version/s: 3.4.0, 3.3.2, 3.2.4 (was: 3.4.0, 3.2.3, 3.3.2) ===Bulk update=== planning to cut

[jira] [Updated] (HDFS-16022) matlab mapreduce v95 demos can't run hadoop-3.2.2 run time

[ https://issues.apache.org/jira/browse/HDFS-16022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16022: --- Target Version/s: 3.2.4 (was: 3.2.2) ===Bulk update=== planning to cut the branch for Hadoop 3.2.3

<    2   3   4   5   6   7   8   9   10   11   >