[jira] [Comment Edited] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[
https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973656#comment-16973656
]
Erik Krogen edited comment on HDFS-14979 at 11/13/19 8:10 PM:
--
Committed this down to branch-2.10 (trunk, branch-3.2, branch-3.1, branch-2,
branch-2.10). Wasn't sure if I should do branch-2 given that I think we've
decided 2.10 is the last 2.x release, but figured it couldn't hurt. Thanks for
the review [~shv]!
was (Author: xkrogen):
Committed this down to branch-2.10 (trunk, branch-3.2, branch-3.1, branch-2,
branch-2.10). Wasn't sure if I should do branch-2 given that I think we've
decided 2.10 is the last 2.x release, but figured it couldn't hurt.
> [Observer Node] Balancer should submit getBlocks to Observer Node when
> possible
> ---
>
> Key: HDFS-14979
> URL: https://issues.apache.org/jira/browse/HDFS-14979
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer mover, hdfs
>Reporter: Erik Krogen
>Assignee: Erik Krogen
>Priority: Major
> Fix For: 3.3.0, 3.1.4, 3.2.2, 2.10.1, 2.11.0
>
> Attachments: HDFS-14979.000.patch
>
>
> In HDFS-14162, we made it so that the Balancer could function when
> {{ObserverReadProxyProvider}} was in use. However, the Balancer would still
> read from the active NameNode, because {{getBlocks}} wasn't annotated as
> {{@ReadOnly}}. This task is to enable the Balancer to actually read from the
> Observer Node to alleviate load from the active NameNode.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HDFS-14979) [Observer Node] Balancer should submit getBlocks to Observer Node when possible
[
https://issues.apache.org/jira/browse/HDFS-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971889#comment-16971889
]
Erik Krogen edited comment on HDFS-14979 at 11/11/19 10:47 PM:
---
Attached v000 patch. The fix is simply to add the {{@ReadOnly}} annotation. I
also enhanced the test to confirm that {{getBlocks}} calls go to the observer.
[~shv] or [~vagarychen], care to help review?
was (Author: xkrogen):
Attached v000 patch. The fix is simply to add the {{@ReadOnly}} annotation. I
also enhanced the test to confirm that {{getBlocks}} calls go to the observer.
> [Observer Node] Balancer should submit getBlocks to Observer Node when
> possible
> ---
>
> Key: HDFS-14979
> URL: https://issues.apache.org/jira/browse/HDFS-14979
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: balancer mover, hdfs
>Reporter: Erik Krogen
>Assignee: Erik Krogen
>Priority: Major
> Attachments: HDFS-14979.000.patch
>
>
> In HDFS-14162, we made it so that the Balancer could function when
> {{ObserverReadProxyProvider}} was in use. However, the Balancer would still
> read from the active NameNode, because {{getBlocks}} wasn't annotated as
> {{@ReadOnly}}. This task is to enable the Balancer to actually read from the
> Observer Node to alleviate load from the active NameNode.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
