Ok. Found that the culprit jars (read only for root) have the same rights on the build machine in .m2/repository/... So 2 options. At the build time they need to be made a+r, or, at the deployment time they need to be made a+r...
JM 2014-08-20 16:56 GMT-04:00 Jean-Marc Spaggiari <[email protected]>: > Hi Cos, > > I think build is fine because I'm able to start HBase from the command > line directly. > > I found one thing. > > -rw-------. 1 root root 82123 Aug 18 17:25 metrics-core-2.2.0.jar > > Some jars don't have the correct rights. That's one of the issues I faced. > > I fixed the java.lang.NoClassDefFoundError: > org/apache/hadoop/http/HttpServer from the init.d script by exporting > HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` before calling it. > > Now I have another exception on the HBase side but I'm very confortable to > look at it: > org.apache.hadoop.hbase.TableExistsException: hbase:namespace > at > org.apache.hadoop.hbase.master.handler.CreateTableHandler.prepare(CreateTableHandler.java:120) > at > org.apache.hadoop.hbase.master.TableNamespaceManager.createNamespaceTable(TableNamespaceManager.java:232) > at > org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:86) > at > org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:1052) > at > org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:915) > at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:603) > at > org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCommandLine.java:263) > at java.lang.Thread.run(Thread.java:745) > > Did not have it when I run manually. > > I will continue and report when I found where it comes from.. > > Thanks, > > JM > > > 2014-08-20 16:41 GMT-04:00 Konstantin Boudnik <[email protected]>: > > Currently supported HBase if 0.98.2 (or 3???) and I was able personally to >> setup a cluster from bigtop bits and run it. Furthermore, I was able to >> do it >> with 0.99-SNAPSHOT version (e.g. before branch-1 spin-off) with master >> service >> caveat. >> >> One of the possible reasons for the problem you see is merge of region and >> master services. So, the master service is no longer relevant and needs >> to be >> removed (there's a ticket for it). Another one is the changes in the HBase >> build process which needs to be reflected in Bigtop. >> >> Hope it helps, >> Cos >> >> On Wed, Aug 20, 2014 at 03:31PM, Jean-Marc Spaggiari wrote: >> > Hi, >> > >> > I have no issues to build and start HBase from HBase code. >> > >> > But when I try from BigTop, at stratup I get a class not found error: >> > [root@hbr101 ~]# /etc/init.d/hbase-master start >> > starting master, logging to /var/log/hbase/hbase-hbase-master-hbr101.out >> > Exception in thread "main" java.lang.NoClassDefFoundError: >> > org/apache/hadoop/http/HttpServer >> > at java.lang.ClassLoader.defineClass1(Native Method) >> > at java.lang.ClassLoader.defineClass(Unknown Source) >> > at java.security.SecureClassLoader.defineClass(Unknown Source) >> > at java.net.URLClassLoader.defineClass(Unknown Source) >> > at java.net.URLClassLoader.access$100(Unknown Source) >> > at java.net.URLClassLoader$1.run(Unknown Source) >> > at java.net.URLClassLoader$1.run(Unknown Source) >> > at java.security.AccessController.doPrivileged(Native Method) >> > at java.net.URLClassLoader.findClass(Unknown Source) >> > Failed to start HBase master daemon. Return value: 1 [FAILED] >> > >> > If I export the Hadoop and HBase classpath, I'm able to pass this, but >> the >> > I face another ClassNotFound exception on the HBase side. >> > >> > export HBASE_CLASSPATH=`hbase classpath`:`hadoop classpath` >> > [root@10-0-1-208 output]# /etc/init.d/hbase-master start >> > starting master, logging to >> /var/log/hbase/hbase-hbase-master-10-0-1-208.out >> > Started HBase master daemon (hbase-master): [ OK ] >> > >> > 2014-08-20 19:29:37,788 INFO [main] impl.MetricsSystemImpl: HBase >> metrics >> > system started >> > 2014-08-20 19:29:37,841 ERROR [main] master.HMasterCommandLine: Master >> > exiting >> > java.lang.RuntimeException: Failed construction of Master: class >> > >> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMastercom.yammer.metrics.stats.Sample >> > at >> > >> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140) >> > at >> > >> org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:202) >> > at >> > >> org.apache.hadoop.hbase.LocalHBaseCluster.<init>(LocalHBaseCluster.java:152) >> > at >> > >> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:179) >> > at >> > >> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135) >> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70) >> > at >> > >> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126) >> > at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2794) >> > Caused by: java.lang.NoClassDefFoundError: >> com/yammer/metrics/stats/Sample >> > at >> > >> org.apache.hadoop.metrics2.lib.DynamicMetricsRegistry.newHistogram(DynamicMetricsRegistry.java:271) >> > at >> > >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceImpl.<init>(MetricsHBaseServerSourceImpl.java:65) >> > at >> > >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.getSource(MetricsHBaseServerSourceFactoryImpl.java:48) >> > at >> > >> org.apache.hadoop.hbase.ipc.MetricsHBaseServerSourceFactoryImpl.create(MetricsHBaseServerSourceFactoryImpl.java:38) >> > at >> > >> org.apache.hadoop.hbase.ipc.MetricsHBaseServer.<init>(MetricsHBaseServer.java:30) >> > at org.apache.hadoop.hbase.ipc.RpcServer.<init>(RpcServer.java:1878) >> > at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:438) >> > at >> > >> org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.<init>(HMasterCommandLine.java:258) >> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >> Method) >> > at >> > >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> > at >> > >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> > at >> > >> org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:137) >> > ... 7 more >> > >> > >> > I'm wondering, has anyone try to build HBase 0.98.4+ with BigTop trunk >> and >> > has been able to start it? I checked and class is on the metric jar, and >> > the jar in there on the CP. so I'm wondering where this is coming from >> and >> > still investigating. If I found anything, I will open a JIRA and provide >> > the details... >> > >> > Thanks, >> > >> > JM >> > >
