[
https://issues.apache.org/jira/browse/HBASE-27304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17861131#comment-17861131
]
Y. SREENIVASULU REDDY edited comment on HBASE-27304 at 7/1/24 11:50 AM:
------------------------------------------------------------------------
Thanks [~heliangjun] for this nice feature, We want to use this feature for
our customer use case.
While verifying in IPV6 environment, HMaster is getting aborted with following
error
{noformat}
2024-07-01 18:55:43,931 | ERROR | master/<HOSTNAME>:16000:becomeActiveMaster |
***** ABORTING master <IPV6>,16000,1719831331236: Unhandled exception. Starting
shutdown. ***** |
org.slf4j.helpers.MarkerIgnoringBase.error(MarkerIgnoringBase.java:159)
java.lang.IllegalArgumentException: Pathname
/hbase/MasterData/WALs/<IPV6>,16000,1719831331236 from
hdfs://hacluster/hbase/MasterData/WALs/<IPV6>,16000,1719831331236 is not a
valid DFS filename.
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:272)
at
org.apache.hadoop.hdfs.DistributedFileSystem$31.doCall(DistributedFileSystem.java:1849)
at
org.apache.hadoop.hdfs.DistributedFileSystem$31.doCall(DistributedFileSystem.java:1846)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1861)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1811)
at
org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:192)
at
org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:263)
at
org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:344)
at
org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:892)
at
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2485)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:558)
at java.lang.Thread.run(Thread.java:750)
{noformat}
IPV6 address contains colon( : ) which is not a valid name in HDFS.
Have you met this problem or any workaround?
was (Author: sreenivasulureddy):
Thanks [~heliangjun] for this nice feature, We want to use this feature for
our customer use case.
While verifying in IPV6 environment, HMaster is getting aborted with following
error
{noformat}
2024-07-01 18:55:43,931 | ERROR | master/<HOSTNAME>:16000:becomeActiveMaster |
***** ABORTING master <IPV6>,16000,1719831331236: Unhandled exception. Starting
shutdown. ***** |
org.slf4j.helpers.MarkerIgnoringBase.error(MarkerIgnoringBase.java:159)
java.lang.IllegalArgumentException: Pathname
/hbase/MasterData/WALs/<IPV6>,16000,1719831331236 from
hdfs://hacluster/hbase/MasterData/WALs/<IPV6>,16000,1719831331236 is not a
valid DFS filename.
at
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:272)
at
org.apache.hadoop.hdfs.DistributedFileSystem$31.doCall(DistributedFileSystem.java:1849)
at
org.apache.hadoop.hdfs.DistributedFileSystem$31.doCall(DistributedFileSystem.java:1846)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1861)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1811)
at
org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:192)
at
org.apache.hadoop.hbase.master.region.MasterRegion.open(MasterRegion.java:263)
at
org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:344)
at
org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:892)
at
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2485)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:558)
at java.lang.Thread.run(Thread.java:750)
{noformat}
IPV6 address contains colon(:) which is not a valid name in HDFS.
Have you met this problem or any workaround?
> Support using IP to expose master/rs servers for some special scenarios
> -----------------------------------------------------------------------
>
> Key: HBASE-27304
> URL: https://issues.apache.org/jira/browse/HBASE-27304
> Project: HBase
> Issue Type: New Feature
> Components: master, regionserver
> Affects Versions: 3.0.0-alpha-4
> Reporter: Liangjun He
> Assignee: Liangjun He
> Priority: Minor
> Fix For: 2.6.0, 3.0.0-alpha-4
>
>
> In our environment, when accessing the HBase cluster from another cluster
> (such as the Flink cluster), you cannot use the hostname to access the HBase
> cluster, but you can use IP. Because it is possible that the hostname of the
> HBase cluster automatic expansion node is not maintained in the Flink
> cluster. So we should support using IP to expose master/rs servers for this
> special scenarios.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
