[
https://issues.apache.org/jira/browse/HBASE-21706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16741442#comment-16741442
]
Lei Chen edited comment on HBASE-21706 at 1/13/19 2:18 AM:
-----------------------------------------------------------
I don't have a running apache hbase cluster right now, but I do see same code
in apache hbase 1.1.2
-
[HRegionServer.java|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L565]
-
[MasterFileSystem.java|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L121]
I believe apache master branch also has the same code.
After failover, the new active master finds the right fs ( "hdfs://DEV-CLUSTER"
), but the new standby (previous active) master will join the rest and have it
set to "hdfs://DEV-CLUSTER/hbase-root"
I would like to provide a patch if this is indeed an unexpected behavior, but
could anyone please help me identify some cases where `fs.defaultFS` from
standby masters might be used?
Thanks
was (Author: leochen4891):
I don't have a running apache hbase cluster right now, but I do see same code
in apache hbase 1.1.2
-
[HRegionServer.java|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L565]
-
[MasterFileSystem.java|https://github.com/apache/hbase/blob/rel/1.1.2/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L121]I
believe apache master branch also has the same code.
After failover, the new active master finds the right fs ( "hdfs://DEV-CLUSTER"
), but the new standby (previous active) master will join the rest and have it
set to "hdfs://DEV-CLUSTER/hbase-root"
I would like to provide a patch if this is indeed an unexpected behavior, but
could anyone please help me identify some cases where `fs.defaultFS` from
standby masters might be used?
Thanks
> Inconsistency of fs.defaultFS between active and standby masters
> ----------------------------------------------------------------
>
> Key: HBASE-21706
> URL: https://issues.apache.org/jira/browse/HBASE-21706
> Project: HBase
> Issue Type: Bug
> Components: conf, master
> Affects Versions: 1.1.2
> Reporter: Lei Chen
> Priority: Minor
>
> I'm using HDP-2.6.3.22-1 with HBase HA configured. I noticed that active and
> standby masters have different `fs.defaultFS` on their /conf pages.
> Given `fs.defaultFS` is set to <scheme>:<authority> and `hbase.rootdir` is
> set to <scheme>:<authority>/<root-dir> in core-site.xml on all the hosts, it
> looks like standby masters has `fs.defaultFS` programatically set to the same
> value as `hbase.rootdir`.
> For example, on a 3 heads cluster DEV-CLUSTER, my active master has the
> following line on the /conf page
> {code:java}
> <property><name>fs.defaultFS</name><value>hdfs://DEV-CLUSTER</value><source>programatically</source></property>
> {code}
> but standby masters has
> {code:java}
> <property><name>fs.defaultFS</name><value>hdfs://DEV-CLUSTER/hbase-root</value><source>programatically</source></property>{code}
> Please correct me if this is not a bug but a feature, however I find this
> behavior surprising plus I cannot locate any related document.
> From a quick look at the code, the cause seems to be that standby masters got
> the property set in
> [HRegionServer.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java#L649-L652],
> and active master got it set in a different way in
> [MasterFileSystem.java|https://github.com/hortonworks/hbase-release/blob/HDP-2.6.3.22-tag/hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java#L132-L137].
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
