[
https://issues.apache.org/jira/browse/HADOOP-17668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17362970#comment-17362970
]
Viraj Jasani commented on HADOOP-17668:
---------------------------------------
Ah, we have a problem here. HBase 2 so far ships only HBase artifacts compiled
with default profile (Hadoop 2) and not the ones compiled with Hadoop 3
profile. Hence, in order to bump and use HBase 2 by Yarn timeline service,
HBase 2 should be manually built using Hadoop 3 profile and only then we should
build Hadoop. If we don't build HBase manually with Hadoop 3 profile, we will
face this known issue:
{code:java}
java.lang.IncompatibleClassChangeError: Found interface
org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but class was
expectedjava.lang.IncompatibleClassChangeError: Found interface
org.apache.hadoop.hdfs.protocol.HdfsFileStatus, but class was expected at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:536)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$400(FanOutOneBlockAsyncDFSOutputHelper.java:112)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:616)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$8.doCall(FanOutOneBlockAsyncDFSOutputHelper.java:611)
at
org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
at
org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.createOutput(FanOutOneBlockAsyncDFSOutputHelper.java:624)
at
org.apache.hadoop.hbase.io.asyncfs.AsyncFSOutputHelper.createOutput(AsyncFSOutputHelper.java:53)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncProtobufLogWriter.initOutput(AsyncProtobufLogWriter.java:180)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractProtobufLogWriter.init(AbstractProtobufLogWriter.java:166)
at
org.apache.hadoop.hbase.wal.AsyncFSWALProvider.createAsyncWriter(AsyncFSWALProvider.java:113)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:662)
at
org.apache.hadoop.hbase.regionserver.wal.AsyncFSWAL.createWriterInstance(AsyncFSWAL.java:130)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:848)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.rollWriter(AbstractFSWAL.java:551)
at
org.apache.hadoop.hbase.regionserver.wal.AbstractFSWAL.init(AbstractFSWAL.java:492)
at
org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:161)
at
org.apache.hadoop.hbase.wal.AbstractFSWALProvider.getWAL(AbstractFSWALProvider.java:63)
at org.apache.hadoop.hbase.wal.WALFactory.getWAL(WALFactory.java:296) at
org.apache.hadoop.hbase.master.region.MasterRegion.createWAL(MasterRegion.java:187)
at
org.apache.hadoop.hbase.master.region.MasterRegion.bootstrap(MasterRegion.java:207)
at
org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:307)
at
org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104)
at
org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:834)
at
org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2091)
at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:507)
{code}
> Use profile hbase-2.0 by default and update hbase version
> ---------------------------------------------------------
>
> Key: HADOOP-17668
> URL: https://issues.apache.org/jira/browse/HADOOP-17668
> Project: Hadoop Common
> Issue Type: Task
> Affects Versions: 3.4.0
> Reporter: Wei-Chiu Chuang
> Assignee: Viraj Jasani
> Priority: Major
>
> We currently use hbase1 profile by default (for those who aren't aware, the
> YARN timeline service uses HBase as the underlying storage). There isn't much
> development activity in HBase 1.x and 2.x is production ready. I think it's
> time to switch to hbase 2 by default.
>
> The HBase 2 version being used is 2.0.2. We should use the more recent
> versions. (e.g. 2.2/2.3/2.4) (And update hbase 1 version as well)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
