[jira] [Commented] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372299#comment-17372299 ] tomscut commented on HDFS-16088: Thanks [~hexiaoqiao] for your comment and thoughtful consideration. IMO

[jira] [Work logged] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

[ https://issues.apache.org/jira/browse/HDFS-16104?focusedWorklogId=617355=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617355 ] ASF GitHub Bot logged work on HDFS-16104: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=617410=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617410 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372307#comment-17372307 ] lei w commented on HDFS-16102: -- Thanks [~hexiaoqiao] for your reply. I will update it. > Remove redundant

[jira] [Work logged] (HDFS-16105) Edit log corruption due to mismatch between fileId and path

[ https://issues.apache.org/jira/browse/HDFS-16105?focusedWorklogId=617423=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617423 ] ASF GitHub Bot logged work on HDFS-16105: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16105) Edit log corruption due to mismatch between fileId and path

[ https://issues.apache.org/jira/browse/HDFS-16105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16105: -- Labels: pull-request-available (was: ) > Edit log corruption due to mismatch between fileId

[jira] [Updated] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tomscut updated HDFS-16088: --- Description: As with HDFS-13183, NameNodeConnector#getLiveDatanodeStorageReport() can also request to SNN

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=617409=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617409 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16105) Edit log corruption due to mismatch between fileId and path

[ https://issues.apache.org/jira/browse/HDFS-16105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16105: -- Assignee: Hui Fei > Edit log corruption due to mismatch between fileId and path >

[jira] [Created] (HDFS-16105) Edit log corruption due to mismatch between fileId and path

Hui Fei created HDFS-16105: -- Summary: Edit log corruption due to mismatch between fileId and path Key: HDFS-16105 URL: https://issues.apache.org/jira/browse/HDFS-16105 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

[ https://issues.apache.org/jira/browse/HDFS-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372310#comment-17372310 ] lei w commented on HDFS-16101: -- Thanks [~ayushtkn] for your reply. > Remove unuse variable and IoException

[jira] [Resolved] (HDFS-16086) Add volume information to datanode log for tracing

[ https://issues.apache.org/jira/browse/HDFS-16086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16086. Fix Version/s: 3.4.0 Resolution: Fixed > Add volume information to datanode log for

[jira] [Work logged] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?focusedWorklogId=616932=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616932 ] ASF GitHub Bot logged work on HDFS-16099: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuyan Zhang updated HDFS-16099: Description: BPOfferService#bpServiceToActive is not volatile, which may cause

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=616947=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616947 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16099) Make bpServiceToActive to be volatile

Shuyan Zhang created HDFS-16099: --- Summary: Make bpServiceToActive to be volatile Key: HDFS-16099 URL: https://issues.apache.org/jira/browse/HDFS-16099 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-16100) HA: Improve performance of Standby node transition to Active

wudeyu created HDFS-16100: - Summary: HA: Improve performance of Standby node transition to Active Key: HDFS-16100 URL: https://issues.apache.org/jira/browse/HDFS-16100 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16099: -- Labels: pull-request-available (was: ) > Make bpServiceToActive to be volatile >

[jira] [Work started] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-16099 started by Shuyan Zhang. --- > Make bpServiceToActive to be volatile > - >

[jira] [Resolved] (HDFS-16096) Delete useless method DirectoryWithQuotaFeature#setQuota

[ https://issues.apache.org/jira/browse/HDFS-16096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HDFS-16096. Resolution: Fixed Merged the PR. Thanks [~zhuxiangyi] and [~vjasani] for the review. >

[jira] [Work logged] (HDFS-16096) Delete useless method DirectoryWithQuotaFeature#setQuota

[ https://issues.apache.org/jira/browse/HDFS-16096?focusedWorklogId=616945=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616945 ] ASF GitHub Bot logged work on HDFS-16096: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=616950=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616950 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371915#comment-17371915 ] Jinglun commented on HDFS-16083: Hi [~lei w], thanks your patch, some comments. In EditLogTailer.java:

[jira] [Updated] (HDFS-16103) mvn test failed about hadoop@3.2.1

[ https://issues.apache.org/jira/browse/HDFS-16103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shixijun updated HDFS-16103: Affects Version/s: 3.2.1 Description: {panel:title=mvn test failed about hadoop@3.2.1} mvn test

[jira] [Updated] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

[ https://issues.apache.org/jira/browse/HDFS-16104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HDFS-16104: -- Labels: pull-request-available (was: ) > Remove unused parameter and fix java doc for

[jira] [Work logged] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

[ https://issues.apache.org/jira/browse/HDFS-16104?focusedWorklogId=616990=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616990 ] ASF GitHub Bot logged work on HDFS-16104: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16086) Add volume information to datanode log for tracing

[ https://issues.apache.org/jira/browse/HDFS-16086?focusedWorklogId=616994=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616994 ] ASF GitHub Bot logged work on HDFS-16086: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

[ https://issues.apache.org/jira/browse/HDFS-16104?focusedWorklogId=616992=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-616992 ] ASF GitHub Bot logged work on HDFS-16104: - Author: ASF GitHub Bot

[jira] [Created] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

lei w created HDFS-16101: Summary: Remove unuse variable and IoException in ProvidedStorageMap Key: HDFS-16101 URL: https://issues.apache.org/jira/browse/HDFS-16101 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

lei w created HDFS-16102: Summary: Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time Key: HDFS-16102 URL: https://issues.apache.org/jira/browse/HDFS-16102 Project: Hadoop

[jira] [Created] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

tomscut created HDFS-16104: -- Summary: Remove unused parameter and fix java doc for DiskBalancerCLI Key: HDFS-16104 URL: https://issues.apache.org/jira/browse/HDFS-16104 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-16083: --- Attachment: HDFS-16083.004.patch Status: Patch Available (was: Open) Re-submit v04. > Forbid

[jira] [Updated] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

[ https://issues.apache.org/jira/browse/HDFS-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16101: - Attachment: HDFS-16101.001.patch > Remove unuse variable and IoException in ProvidedStorageMap >

[jira] [Updated] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wudeyu updated HDFS-16100: -- Issue Type: Improvement (was: Wish) > HA: Improve performance of Standby node transition to Active >

[jira] [Updated] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wudeyu updated HDFS-16100: -- Attachment: HDFS-16100.patch Affects Version/s: 3.3.1 Status: Patch Available (was:

[jira] [Updated] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16102: - Description: The current logic in removeBlocksAssociatedTo(...) is as follows： {code:java} void

[jira] [Updated] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16102: - Attachment: HDFS-16102.001.patch > Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to

[jira] [Commented] (HDFS-16098) ERROR tools.DiskBalancerCLI: java.lang.IllegalArgumentException

[ https://issues.apache.org/jira/browse/HDFS-16098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371921#comment-17371921 ] Stephen O'Donnell commented on HDFS-16098: -- HDFS-13728 and HDFS-13727 may be relevant. > ERROR

[jira] [Created] (HDFS-16103) mvn test failed about hadoop@3.2.1

shixijun created HDFS-16103: --- Summary: mvn test failed about hadoop@3.2.1 Key: HDFS-16103 URL: https://issues.apache.org/jira/browse/HDFS-16103 Project: Hadoop HDFS Issue Type: Bug

[jira] [Work logged] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

[ https://issues.apache.org/jira/browse/HDFS-16095?focusedWorklogId=617027=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617027 ] ASF GitHub Bot logged work on HDFS-16095: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372039#comment-17372039 ] lei w commented on HDFS-16083: -- Thanks [~LiJinglun] reply. Take your suggestion and make some changes in v05

[jira] [Work logged] (HDFS-16099) Make bpServiceToActive to be volatile

[ https://issues.apache.org/jira/browse/HDFS-16099?focusedWorklogId=617119=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617119 ] ASF GitHub Bot logged work on HDFS-16099: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16104) Remove unused parameter and fix java doc for DiskBalancerCLI

[ https://issues.apache.org/jira/browse/HDFS-16104?focusedWorklogId=617134=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617134 ] ASF GitHub Bot logged work on HDFS-16104: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16100: -- Assignee: wudeyu > HA: Improve performance of Standby node transition to Active >

[jira] [Commented] (HDFS-16100) HA: Improve performance of Standby node transition to Active

[ https://issues.apache.org/jira/browse/HDFS-16100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372103#comment-17372103 ] Xiaoqiao He commented on HDFS-16100: Thanks [~g20141821] for your report. Add [~g20141821] to

[jira] [Commented] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372105#comment-17372105 ] Xiaoqiao He commented on HDFS-16097: Thanks [~lei w] for your report. It is good improvement! Do you

[jira] [Assigned] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He reassigned HDFS-16097: -- Assignee: lei w > Datanode receives ipc requests will throw NPE when datanode quickly restart

[jira] [Updated] (HDFS-16097) Datanode receives ipc requests will throw NPE when datanode quickly restart

[ https://issues.apache.org/jira/browse/HDFS-16097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoqiao He updated HDFS-16097: --- Status: Patch Available (was: Open) > Datanode receives ipc requests will throw NPE when datanode

[jira] [Updated] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

[ https://issues.apache.org/jira/browse/HDFS-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-16101: Assignee: lei w Status: Patch Available (was: Open) > Remove unuse variable and IoException

[jira] [Updated] (HDFS-16083) Forbid Observer NameNode trigger active namenode log roll

[ https://issues.apache.org/jira/browse/HDFS-16083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lei w updated HDFS-16083: - Attachment: HDFS-16083.005.patch > Forbid Observer NameNode trigger active namenode log roll >

[jira] [Commented] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

[ https://issues.apache.org/jira/browse/HDFS-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371998#comment-17371998 ] lei w commented on HDFS-16101: -- [~ayushsaxena] Could you give me some advice? > Remove unuse variable and

[jira] [Commented] (HDFS-16101) Remove unuse variable and IoException in ProvidedStorageMap

[ https://issues.apache.org/jira/browse/HDFS-16101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372009#comment-17372009 ] Ayush Saxena commented on HDFS-16101: - Makes sense to me.  The class is marked private and unstable,

[jira] [Work logged] (HDFS-16095) Add lsQuotaList command and getQuotaListing api for hdfs quota

[ https://issues.apache.org/jira/browse/HDFS-16095?focusedWorklogId=617158=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617158 ] ASF GitHub Bot logged work on HDFS-16095: - Author: ASF GitHub Bot

[jira] [Commented] (HDFS-16093) DataNodes under decommission will still be returned to the client via getLocatedBlocks, so the client may request decommissioning datanodes to read which will cause bad

[ https://issues.apache.org/jira/browse/HDFS-16093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372116#comment-17372116 ] Xiaoqiao He commented on HDFS-16093: -1 to remove DECOMMISSIONING state node from `LocatedBlocks`

[jira] [Commented] (HDFS-16102) Remove redundant iteration in BlockManager#removeBlocksAssociatedTo(...) to save time

[ https://issues.apache.org/jira/browse/HDFS-16102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372114#comment-17372114 ] Xiaoqiao He commented on HDFS-16102: Thanks [~lei w] for your report, It seems that your codebase is

[jira] [Commented] (HDFS-16088) Standby NameNode process getLiveDatanodeStorageReport request to reduce Active load

[ https://issues.apache.org/jira/browse/HDFS-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17372119#comment-17372119 ] Xiaoqiao He commented on HDFS-16088: Thanks [~tomscut] involve me here. It makes sense to me at first

[jira] [Work logged] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

[ https://issues.apache.org/jira/browse/HDFS-16090?focusedWorklogId=617246=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617246 ] ASF GitHub Bot logged work on HDFS-16090: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16090) Fine grained locking for datanodeNetworkCounts

[ https://issues.apache.org/jira/browse/HDFS-16090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Stack updated HDFS-16090: - Fix Version/s: 3.3.2 3.4.0 Hadoop Flags: Reviewed Resolution: