[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated HDFS-14979: - Fix Version/s: (was: 2.11.0) > [Observer Node] Balancer should submit getBlocks to Observer Node when > possible > --- > > Key: HDFS-14979 > URL: https://issues.apache.org/jira/browse/HDFS-14979 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer mover, hdfs >Reporter: Erik Krogen >Assignee: Erik Krogen >Priority: Major > Fix For: 3.3.0, 3.1.4, 3.2.2, 2.10.1 > > Attachments: HDFS-14979.000.patch > > > In HDFS-14162, we made it so that the Balancer could function when > {{ObserverReadProxyProvider}} was in use. However, the Balancer would still > read from the active NameNode, because {{getBlocks}} wasn't annotated as > {{@ReadOnly}}. This task is to enable the Balancer to actually read from the > Observer Node to alleviate load from the active NameNode. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Resolution: Fixed Status: Resolved (was: Patch Available) > [Observer Node] Balancer should submit getBlocks to Observer Node when > possible > --- > > Key: HDFS-14979 > URL: https://issues.apache.org/jira/browse/HDFS-14979 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer mover, hdfs >Reporter: Erik Krogen >Assignee: Erik Krogen >Priority: Major > Fix For: 3.3.0, 3.1.4, 3.2.2, 2.10.1, 2.11.0 > > Attachments: HDFS-14979.000.patch > > > In HDFS-14162, we made it so that the Balancer could function when > {{ObserverReadProxyProvider}} was in use. However, the Balancer would still > read from the active NameNode, because {{getBlocks}} wasn't annotated as > {{@ReadOnly}}. This task is to enable the Balancer to actually read from the > Observer Node to alleviate load from the active NameNode. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Fix Version/s: 2.11.0 2.10.1 3.2.2 3.1.4 3.3.0 > [Observer Node] Balancer should submit getBlocks to Observer Node when > possible > --- > > Key: HDFS-14979 > URL: https://issues.apache.org/jira/browse/HDFS-14979 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer mover, hdfs >Reporter: Erik Krogen >Assignee: Erik Krogen >Priority: Major > Fix For: 3.3.0, 3.1.4, 3.2.2, 2.10.1, 2.11.0 > > Attachments: HDFS-14979.000.patch > > > In HDFS-14162, we made it so that the Balancer could function when > {{ObserverReadProxyProvider}} was in use. However, the Balancer would still > read from the active NameNode, because {{getBlocks}} wasn't annotated as > {{@ReadOnly}}. This task is to enable the Balancer to actually read from the > Observer Node to alleviate load from the active NameNode. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Status: Patch Available (was: Open) Attached v000 patch. The fix is simply to add the {{@ReadOnly}} annotation. I also enhanced the test to confirm that {{getBlocks}} calls go to the observer. > [Observer Node] Balancer should submit getBlocks to Observer Node when > possible > --- > > Key: HDFS-14979 > URL: https://issues.apache.org/jira/browse/HDFS-14979 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer mover, hdfs >Reporter: Erik Krogen >Assignee: Erik Krogen >Priority: Major > Attachments: HDFS-14979.000.patch > > > In HDFS-14162, we made it so that the Balancer could function when > {{ObserverReadProxyProvider}} was in use. However, the Balancer would still > read from the active NameNode, because {{getBlocks}} wasn't annotated as > {{@ReadOnly}}. This task is to enable the Balancer to actually read from the > Observer Node to alleviate load from the active NameNode. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[ https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Krogen updated HDFS-14979: --- Attachment: HDFS-14979.000.patch > [Observer Node] Balancer should submit getBlocks to Observer Node when > possible > --- > > Key: HDFS-14979 > URL: https://issues.apache.org/jira/browse/HDFS-14979 > Project: Hadoop HDFS > Issue Type: Improvement > Components: balancer mover, hdfs >Reporter: Erik Krogen >Assignee: Erik Krogen >Priority: Major > Attachments: HDFS-14979.000.patch > > > In HDFS-14162, we made it so that the Balancer could function when > {{ObserverReadProxyProvider}} was in use. However, the Balancer would still > read from the active NameNode, because {{getBlocks}} wasn't annotated as > {{@ReadOnly}}. This task is to enable the Balancer to actually read from the > Observer Node to alleviate load from the active NameNode. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org