So I finally found the problem. I was using the hbase 0.98/0.99 version of kylin but I was actually running hbase 1.1.1. So I downloaded the hbase 1.1.1 compatible kylin and ran the sample_cube build and it ran perfectly. So it finalise:
Prerequisites: Hadoop -> 2.7.1 version used HBase -> 1.1.1 version used Zookeeper -> 3.4.6 version used Kylin -> 1.5.2.1 version used (HBase 1.x compatible) start HDFS -> YARN -> Zookeeper -> HBase -> Kylin On Wed, Jun 29, 2016 at 9:11 PM, Punit Naik <[email protected]> wrote: > Hi > > I changed updated my Hive version to 1.2.1 and I am still getting the same > error: > > java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at > org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) > at > org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.IllegalArgumentException: File not exist by > 'kylin_metadata@hbase': > /home/user/fcstack/apache-kylin-1.5.2.1-bin/kylin_metadata@hbase > at > org.apache.kylin.common.persistence.FileResourceStore.<init>(FileResourceStore.java:49) > ... 13 more > 2016-06-29 21:08:14,819 ERROR [main] persistence.ResourceStore: Create new > store instance failed > java.lang.reflect.InvocationTargetException > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) > at java.lang.reflect.Constructor.newInstance(Constructor.java:526) > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at > org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) > at > org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > Caused by: java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.client.HBaseAdmin.<init>(Lorg/apache/hadoop/hbase/client/HConnection;)V > at > org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:184) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:89) > at > org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:85) > ... 13 more > Exception in thread "main" java.lang.IllegalArgumentException: Failed to > find metadata store by url: kylin_metadata@hbase > at > org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) > at > org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) > at > org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) > at > org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:606) > at org.apache.hadoop.util.RunJar.main(RunJar.java:212) > 2016-06-29 21:08:14,824 INFO [Thread-2] > client.ConnectionManager$HConnectionImplementation: Closing zookeeper > sessionid=0x1559cce1b200007 > 2016-06-29 21:08:14,838 INFO [Thread-2] zookeeper.ZooKeeper: Session: > 0x1559cce1b200007 closed > 2016-06-29 21:08:14,839 INFO [main-EventThread] zookeeper.ClientCnxn: > EventThread shut down > > > Why is kylin trying to find that metadata file its its home folder? > > On Wed, Jun 29, 2016 at 5:24 PM, 王晓雨 <[email protected]> wrote: > >> Kylin1.3 and Kylin1.5 both has the HBase1.x version binary package >> If you are the first time to use Kylin and your env has Hadoop2.7.1 and >> HBase1.1.1, I suggest you to use Kylin1.5.2.1-HBase1.x version. >> This version is compile with Hadoop-2.7.1,HBase-1.1.1,Hive-1.2.1. >> So you can upgrade your hive to 1.2.1. it will work fine. >> >> 在 2016年6月29日，18:46，Punit Naik <[email protected]> 写道： >> >> I updated my hbase from 0.98.2 to 1.1.1 but it gave the following error >> when I tried to start kylin or run the sample.sh file: >> >> Caused by: java.lang.IllegalArgumentException: Failed to find metadata >> store by url: kylin_metadata@hbase >> at >> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) >> at >> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >> at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:880) >> at >> org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:814) >> at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:125) >> at org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:94) >> at >> org.apache.kylin.rest.service.CacheService.initCubeChangeListener(CacheService.java:79) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at >> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346) >> at >> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299) >> at >> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132) >> ... 53 more >> >> Can you help me on this? >> >> On Wed, Jun 29, 2016 at 3:41 PM, Punit Naik <[email protected]> >> wrote: >> >>> Hi >>> >>> I will try that and get back to you. >>> >>> On Wed, Jun 29, 2016 at 3:33 PM, 王晓雨 <[email protected]> wrote: >>> >>>> Hi >>>> HBase 0.98 is depends hadoop 2.2 >>>> If you can upgrade HBase version to 1.x can fix this exception. >>>> if can’t upgrade HBase >>>> set >>>> kylin.job.yarn.app.rest.check.status.url= >>>> http://YOUR_RM_AND_PORT/ws/v1/cluster/apps/${job_id}?anonymous=true >>>> <http://your_rm_and_port/ws/v1/cluster/apps/$%7Bjob_id%7D?anonymous=true> >>>> in $KYLIN_HOME/conf/kylin.properties >>>> ${job_id} will be auto replaced in kylin. >>>> >>>> 在 2016年6月29日，17:13，Punit Naik <[email protected]> 写道： >>>> >>>> Hello >>>> >>>> I even upgraded Hadoop from 2.4.0 to 2.7.1 but still I get the same >>>> error. I have checked the source code and the method >>>> 'YarnConfiguration.getServiceAddressConfKeys' is already there and the >>>> parameter and the return types are proper. Why do I still get this error? >>>> >>>> On Wed, Jun 29, 2016 at 12:28 PM, Punit Naik <[email protected]> >>>> wrote: >>>> >>>>> Hello >>>>> >>>>> I was building the sample_cube for kylin but it gave me the following >>>>> error at Step #2: >>>>> >>>>> java.lang.NoSuchMethodError: >>>>> org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List; >>>>> at >>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfKeyForRMInstance(HAUtil.java:239) >>>>> at >>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:250) >>>>> at >>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:262) >>>>> at >>>>> org.apache.kylin.job.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:198) >>>>> at >>>>> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:135) >>>>> at >>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>> at >>>>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51) >>>>> at >>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>> at >>>>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130) >>>>> at >>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>>>> at >>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>>>> at java.lang.Thread.run(Thread.java:745) >>>>> >>>>> >>>>> The Hadoop, HBase, Hive and Kylin versions that I am running are >>>>> 2.4.0, 0.98.2, 0.14 and 1.3.0 respectively. >>>>> >>>>> How do I fix this? >>>>> >>>>> -- >>>>> Thank Yo >>>>> >>>>> Regards >>>>> >>>>> Punit Naik >>>>> >>>> >>>> >>>> >>>> -- >>>> Thank You >>>> >>>> Regards >>>> >>>> Punit Naik >>>> >>>> >>>> >>> >>> >>> -- >>> Thank You >>> >>> Regards >>> >>> Punit Naik >>> >> >> >> >> -- >> Thank You >> >> Regards >> >> Punit Naik >> >> >> > > > -- > Thank You > > Regards > > Punit Naik > -- Thank You Regards Punit Naik
