[jira] [Comment Edited] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-10 Thread Yongpan Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472529#comment-17472529 ] Yongpan Liu edited comment on HDFS-16043 at 1/11/22, 7:56 AM: -- There

[jira] [Commented] (HDFS-16043) Add markedDeleteBlockScrubberThread to delete blocks asynchronously

2022-01-10 Thread Yongpan Liu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472529#comment-17472529 ] Yongpan Liu commented on HDFS-16043: There was a problem today that may be related to this patch

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472419#comment-17472419 ] qinyuren commented on HDFS-16420: - Hi [~tasanuma] , we've merged these two PR into our code. It seems

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Takanobu Asanuma (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472404#comment-17472404 ] Takanobu Asanuma commented on HDFS-16420: - We recently fixed ec + balancer bugs by HDFS-16268 and

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472401#comment-17472401 ] qinyuren commented on HDFS-16420: - Hi [~ayushtkn] , we cherry-pick most of EC fixes which merged before

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Work logged] (HDFS-16400) Reconfig DataXceiver parameters for datanode

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16400?focusedWorklogId=706602=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-706602 ] ASF GitHub Bot logged work on HDFS-16400: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16400) Reconfig DataXceiver parameters for datanode

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16400?focusedWorklogId=706603=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-706603 ] ASF GitHub Bot logged work on HDFS-16400: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-10 Thread YulongZ (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YulongZ updated HDFS-16411: --- Component/s: rbf > RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false >

[jira] [Updated] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-10 Thread YulongZ (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YulongZ updated HDFS-16411: --- Affects Version/s: (was: 3.3.1) > RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

[jira] [Updated] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-10 Thread YulongZ (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YulongZ updated HDFS-16411: --- Affects Version/s: 3.3.1 > RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false >

[jira] [Updated] (HDFS-16411) RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false

2022-01-10 Thread YulongZ (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YulongZ updated HDFS-16411: --- Attachment: HDFS-16411.000.patch > RBF: RouterId is NULL when set dfs.federation.router.rpc.enable=false >

[jira] [Updated] (HDFS-16410) Insecure Xml parsing in OfflineEditsXmlLoader

2022-01-10 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HDFS-16410: - Fix Version/s: 2.10.2 3.2.3 Backported to branch-3.2, branch-3.2.3, and

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472091#comment-17472091 ] Ayush Saxena commented on HDFS-16420: - I just saw the description: {noformat}

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17472081#comment-17472081 ] Ayush Saxena commented on HDFS-16420: - Are there any duplicate blocks with same index for blk

[jira] [Comment Edited] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471966#comment-17471966 ] qinyuren edited comment on HDFS-16420 at 1/10/22, 12:49 PM: Hi [~sodonnell],

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471966#comment-17471966 ] qinyuren commented on HDFS-16420: - [~sodonnell] We cherry-pick most of EC fixes, especially those PR with

[jira] [Updated] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei updated HDFS-16417: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch Available) > RBF:

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread Stephen O'Donnell (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471862#comment-17471862 ] Stephen O'Donnell commented on HDFS-16420: -- Since release 3.1.0, I think there have been quite a

[jira] [Work logged] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?focusedWorklogId=705958=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-705958 ] ASF GitHub Bot logged work on HDFS-16417: - Author: ASF GitHub Bot

[jira] [Assigned] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16417: -- Assignee: Felix N (was: Hui Fei) > RBF: StaticRouterRpcFairnessPolicyController init fails with

[jira] [Assigned] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread Hui Fei (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hui Fei reassigned HDFS-16417: -- Assignee: Hui Fei > RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if >

[jira] [Work logged] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?focusedWorklogId=705956=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-705956 ] ASF GitHub Bot logged work on HDFS-16417: - Author: ASF GitHub Bot

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Work logged] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?focusedWorklogId=705954=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-705954 ] ASF GitHub Bot logged work on HDFS-16417: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?focusedWorklogId=705949=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-705949 ] ASF GitHub Bot logged work on HDFS-16417: - Author: ASF GitHub Bot

[jira] [Work logged] (HDFS-16417) RBF: StaticRouterRpcFairnessPolicyController init fails with division by 0 if concurrent ns handler count is configured

2022-01-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16417?focusedWorklogId=705948=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-705948 ] ASF GitHub Bot logged work on HDFS-16417: - Author: ASF GitHub Bot

[jira] [Comment Edited] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471822#comment-17471822 ] qinyuren edited comment on HDFS-16420 at 1/10/22, 10:01 AM: [~hexiaoqiao] ,

[jira] [Commented] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471822#comment-17471822 ] qinyuren commented on HDFS-16420: - [~hexiaoqiao] [~ayushtkn] Please take a look at this problem. > ec +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Updated] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
[ https://issues.apache.org/jira/browse/HDFS-16420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qinyuren updated HDFS-16420: Description: We have a similar problem as HDFS-16297 described.  In our cluster, we used ec(6+3) +

[jira] [Created] (HDFS-16420) ec + balancer may cause missing block

2022-01-10 Thread qinyuren (Jira)
qinyuren created HDFS-16420: --- Summary: ec + balancer may cause missing block Key: HDFS-16420 URL: https://issues.apache.org/jira/browse/HDFS-16420 Project: Hadoop HDFS Issue Type: Bug