Hi, Santosh
Thanks for reporting the issue, it looks to me that it is still the
problem of find-hive-dependecny.sh.
As a workaround, you can just manually add
/usr/hdp/current/hive-client/conf/ in this script.
On Thu Feb 19 2015 at 8:01:39 PM Santoshakhilesh <
[email protected]> wrote:
> Hi ,
> I analyzed the Kylin.log and found that find-hive-dependency.sh was
> not able to locate hive installation path correctly , so I modified the
> script to set the correct hive lib path.
> Now I dont get no classs found error so it means that class path is
> set right now to resolve hive dependencies.
>
> The next exception I get is following ,
> NoSuchObjectException(message:DEFAULT.books table not found)
>
> I could run following query on hive console;
> select * from default.books;
>
> So again problem seems to be some settings related to hive , can someone
> help me locate this issue ?
> Also I want to know do I need to include following lib; I dont have it
> currently in my path
> /usr/hdp/current/hive-client/conf/
>
> Exception:
> 2015-02-20 01:15:18,163 INFO [http-bio-7070-exec-10]
> DataNucleus.Datastore: The class
> "org.apache.hadoop.hive.metastore.model.MFieldSchema"
> is tagged as "embedded-only" so does not have its own datastore table.
> 2015-02-20 01:15:18,163 INFO [http-bio-7070-exec-10]
> DataNucleus.Datastore: The class
> "org.apache.hadoop.hive.metastore.model.MOrder"
> is tagged as "embedded-only" so does not have its own datastore table.
> 2015-02-20 01:15:18,532 INFO [http-bio-7070-exec-10]
> DataNucleus.Datastore: The class
> "org.apache.hadoop.hive.metastore.model.MFieldSchema"
> is tagged as "embedded-only" so does not have its own datastore table.
> 2015-02-20 01:15:18,532 INFO [http-bio-7070-exec-10]
> DataNucleus.Datastore: The class
> "org.apache.hadoop.hive.metastore.model.MOrder"
> is tagged as "embedded-only" so does not have its own datastore table.
> 2015-02-20 01:15:18,710 INFO [http-bio-7070-exec-10] DataNucleus.Query:
> Reading in results for query "org.datanucleus.store.rdbms.query.SQLQuery@0"
> since the connection used is closing
> 2015-02-20 01:15:18,713 INFO [http-bio-7070-exec-10]
> metastore.ObjectStore: Initialized ObjectStore
> 2015-02-20 01:15:19,002 INFO [http-bio-7070-exec-10]
> metastore.HiveMetaStore: Added admin role in metastore
> 2015-02-20 01:15:19,004 INFO [http-bio-7070-exec-10]
> metastore.HiveMetaStore: Added public role in metastore
> 2015-02-20 01:15:19,090 INFO [http-bio-7070-exec-10]
> metastore.HiveMetaStore: No user is added in admin role, since config is
> empty
> 2015-02-20 01:15:19,213 INFO [http-bio-7070-exec-10]
> metastore.HiveMetaStore: 0: get_table : db=DEFAULT tbl=books
> 2015-02-20 01:15:19,213 INFO [http-bio-7070-exec-10] HiveMetaStore.audit:
> ugi=root ip=unknown-ip-addr cmd=get_table : db=DEFAULT tbl=books
> NoSuchObjectException(message:DEFAULT.books table not found)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$
> HMSHandler.get_table_core(HiveMetaStore.java:1729)
> at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(
> HiveMetaStore.java:1699)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
> invoke(RetryingHMSHandler.java:102)
> at com.sun.proxy.$Proxy37.get_table(Unknown Source)
> at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> getTable(HiveMetaStoreClient.java:1091)
> at org.apache.kylin.common.util.HiveClient.getHiveTable(
> HiveClient.java:115)
> at org.apache.kylin.metadata.tool.HiveSourceTableLoader.
> extractHiveTables(HiveSourceTableLoader.java:86)
> at org.apache.kylin.metadata.tool.HiveSourceTableLoader.reloadHiveTables(
> HiveSourceTableLoader.java:70)
> at org.apache.kylin.rest.service.CubeService.reloadHiveTable(
> CubeService.java:537)
> at org.apache.kylin.rest.service.CubeService$$FastClassByCGLIB$
> $17a07c0e.invoke(<generated>)
>
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
> ------------------------------------------------------------
> -------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
>
> ________________________________________
> From: Santoshakhilesh [[email protected]]
> Sent: Thursday, February 19, 2015 3:37 PM
> To: [email protected]
> Subject: RE: Hive Table is not loaded in Kylin//RE: About building kylin
>
> Looks like this is the issue , I find one exception in
> localhost.2015-02-19.log
>
>
> Does this mean there is some issue in hive version I use , I am using
> 0.14.0?
>
>
> SEVERE: Servlet.service() for servlet [kylin] in context with path
> [/kylin] threw exception [Handler processing failed; nested exception is
> java.lang.NoClassDefFoundError:
> org/apache/hadoop/hive/ql/session/SessionState]
> with root cause
> java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.
> session.SessionState
> at org.apache.catalina.loader.WebappClassLoader.loadClass(
> WebappClassLoader.java:1720)
> at org.apache.catalina.loader.WebappClassLoader.loadClass(
> WebappClassLoader.java:1571)
> at org.apache.kylin.metadata.tool.HiveSourceTableLoader.
> extractHiveTables(HiveSourceTableLoader.java:83)
> at org.apache.kylin.metadata.tool.HiveSourceTableLoader.reloadHiveTables(
> HiveSourceTableLoader.java:70)
> at org.apache.kylin.rest.service.CubeService.reloadHiveTable(
> CubeService.java:537)
> at org.apache.kylin.rest.service.CubeService$$FastClassByCGLIB$
> $17a07c0e.invoke(<generated>)
> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
> ------------------------------------------------------------
> -------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
>
> ________________________________________
> From: Santoshakhilesh [[email protected]]
> Sent: Thursday, February 19, 2015 1:27 PM
> To: [email protected]
> Cc: Kulbhushan Rana
> Subject: Hive Table is not loaded in Kylin//RE: About building kylin
>
> Hi ,
>
> I have resolved this issue. I have hivesingle column table and I can
> access from Hive console and do queries on it sucecssfully using hive
> console.
>
> When I try to synch hive table using Kylin web specifiying the hive
> table name and synch.
>
> I get an error dialog "Oops Failed to take action" .
>
>
>
> Kylin.log
>
>
> [pool-3-thread-1]:[2015-02-19 21:09:54,152][INFO][org.
> apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
> - Job Fetcher: 0 running, 0 actual running, 0 ready, 0 others
> [http-bio-7070-exec-4]:[2015-02-19 21:09:59,556][INFO][org.
> apache.kylin.rest.controller.TableController.getHiveTables(TableController.java:74)]
> - Return all table metadata in 0 seconds
>
>
>
> localhost_access_log.2015-02-19.txt
>
>
>
> 10.19.36.67 - - [19/Feb/2015:21:21:58 +0800] "POST
> /kylin/api/tables/books/Sample HTTP/1.1" 500 1972
>
>
>
> Here books is my table (I have used default database) and sample is name
> of my project
>
>
>
> What could be reason of not loading the hive tables ? Someone whi is able
> to load the hive table successfully can help me to debug this issue ?
>
>
>
> Regards,
> Santosh Akhilesh
> Bangalore R&D
> HUAWEI TECHNOLOGIES CO.,LTD.
>
> www.huawei.com
> ------------------------------------------------------------
> -------------------------------------------------------------------------
> This e-mail and its attachments contain confidential information from
> HUAWEI, which
> is intended only for the person or entity whose address is listed above.
> Any use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender by
> phone or email immediately and delete it!
> ________________________________
> From: Santosh Akhilesh [[email protected]]
> Sent: Tuesday, February 17, 2015 8:13 PM
> To: [email protected]
> Subject: Re: About building kylin
>
> Hi,
> These days I spent time to learn Hive and create tables required for
> my test.
> Unfortunately when I am all set with Hive tables , Kylin can't start
> normally. Before this I could start and login to web ui. the logs are like
> below. What has gone wring any idea ?
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/home/santosh/work/
> frameworks/hbase-0.98.10-hadoop2/lib/slf4j-log4j12-1.6.
> 4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/home/santosh/work/
> frameworks/hadoop-1.2.1/lib/slf4j-log4j12-1.4.3.jar!/org/
> slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/home/santosh/work/
> frameworks/kylin/tomcat/webapps/kylin/WEB-INF/lib/
> slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> [localhost-startStop-1]:[2015-02-17 19:57:41,307][WARN][org.
> apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:527)]
> - KYLIN_CONF_HOME has not been set
> [localhost-startStop-1]:[2015-02-17 19:57:41,419][INFO][org.
> springframework.core.io.support.PropertiesLoaderSupport.loadProperties(
> PropertiesLoaderSupport.java:177)] - Loading properties file from
> resource loaded through InputStream
> [localhost-startStop-1]:[2015-02-17 19:57:41,815][WARN][org.
> apache.kylin.common.KylinConfig.getKylinProperties(KylinConfig.java:527)]
> - KYLIN_CONF_HOME has not been set
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/home/santosh/work/
> frameworks/hbase-0.98.10-hadoop2/lib/slf4j-log4j12-1.6.
> 4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/home/santosh/work/
> frameworks/hadoop-1.2.1/lib/slf4j-log4j12-1.4.3.jar!/org/
> slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> [localhost-startStop-1]:[2015-02-17 19:57:43,051][ERROR][org.
> springframework.web.context.ContextLoader.initWebApplicationContext(ContextLoader.java:307)]
> - Context initialization failed
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'com.ryantenney.metrics.spring.
> MetricsBeanPostProcessorFactory#0': BeanPostProcessor before
> instantiation of bean failed; nested exception is
> org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name
> 'org.springframework.cache.config.internalCacheAdvisor':
> Cannot resolve reference to bean 'org.springframework.cache.annotation.
> AnnotationCacheOperationSource#0' while setting bean property
> 'cacheOperationSource'; nested exception is
> org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name 'org.springframework.cache.annotation.
> AnnotationCacheOperationSource#0': BeanPostProcessor before instantiation
> of bean failed; nested exception is
> org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name 'org.springframework.security.
> methodSecurityMetadataSourceAdvisor': Cannot resolve reference to bean
> 'org.springframework.security.access.method.DelegatingMethodSecurityMetadataSource#0'
> while setting constructor argument; nested exception is
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'org.springframework.security.access.method.
> DelegatingMethodSecurityMetadataSource#0': Cannot create inner bean
> '(inner bean)' of type [org.springframework.security.access.prepost.
> PrePostAnnotationSecurityMetadataSource] while setting constructor
> argument with key [0]; nested exception is
> org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name '(inner bean)': Cannot create inner bean
> '(inner bean)' of type [org.springframework.security.
> access.expression.method.ExpressionBasedAnnotationAttributeFactory] while
> setting constructor argument; nested exception is
> org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name '(inner bean)': Cannot resolve reference to
> bean 'expressionHandler' while setting constructor argument; nested
> exception is org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name 'expressionHandler' defined in class path
> resource [kylinSecurity.xml]: Cannot resolve reference to bean
> 'permissionEvaluator' while setting bean property 'permissionEvaluator';
> nested exception is org.springframework.beans.factory.BeanCreationException:
> Error creating bean with name 'permissionEvaluator' defined in class path
> resource [kylinSecurity.xml]: Cannot resolve reference to bean 'aclService'
> while setting constructor argument; nested exception is
> org.springframework.beans.factory.BeanCreationException: Error creating
> bean with name 'aclService' defined in file [/home/santosh/work/
> frameworks/kylin/tomcat/webapps/kylin/WEB-INF/classes/
> org/apache/kylin/rest/service/AclService.class]: Instantiation of bean
> failed; nested exception is
> org.springframework.beans.BeanInstantiationException:
> Could not instantiate bean class [org.apache.kylin.rest.service.AclService]:
> Constructor threw exception; nested exception is
> org.apache.kylin.common.persistence.StorageException:
> Error when open connection hbase
> at org.springframework.beans.factory.support.
> AbstractAutowireCapableBeanFactory.createBean(
> AbstractAutowireCapableBeanFactory.java:452)
> at org.springframework.beans.factory.support.AbstractBeanFactory$1.
> getObject(AbstractBeanFactory.java:294)
> at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.
> getSingleton(DefaultSingletonBeanRegistry.java:225)
> at org.springframework.beans.factory.support.
> AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:291)
> at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(
> AbstractBeanFactory.java:197)
> at org.springframework.context.support.AbstractApplicationContext.
> registerBeanPostProcessors(AbstractApplicationContext.java:745)
> at org.springframework.context.support.AbstractApplicationContext.refresh(
> AbstractApplicationContext.java:454)
> at org.springframework.web.context.ContextLoader.
> configureAndRefreshWebApplicationContext(ContextLoader.java:383)
> at org.springframework.web.context.ContextLoader.
> initWebApplicationContext(ContextLoader.java:283)
> at org.springframework.web.context.ContextLoaderListener.
> contextInitialized(ContextLoaderListener.java:111)
> at org.apache.catalina.core.StandardContext.listenerStart(
> StandardContext.java:5016)
> at org.apache.catalina.core.StandardContext.startInternal(
> StandardContext.java:5524)
> at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150)
> at org.apache.catalina.core.ContainerBase.addChildInternal(
> ContainerBase.java:901)
> at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:877)
> at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:649)
> at org.apache.catalina.startup.HostConfig.deployWAR(HostConfig.java:1081)
> at org.apache.catalina.startup.HostConfig$DeployWar.run(
> HostConfig.java:1877)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.springframework.beans.factory.BeanCreationException: Error
> creating bean with name
> 'org.springframework.cache.config.internalCacheAdvisor':
> Cannot resolve reference to bean
>
> On Fri Feb 13 2015 at 8:32:48 PM Zhou, Qianhao <[email protected]<mailto:
> [email protected]>> wrote:
> You should create your own table in hive.
>
> 2015年2月13日 下午10:47于 Santosh Akhilesh <[email protected]<mailto:
> [email protected]>>写道：
> Oh thanks. You mean I should create my own table schema and insert data and
> then need to import?
> Does it mean I should create tables in hbase ? Any specific location ? I am
> quite new to hbase and hive so may be I have many silly questions.
> On Fri, 13 Feb 2015 at 8:05 pm, 周千昊 <[email protected]<mailto:z.
> [email protected]>> wrote:
>
> > Hi Santosh,
> > As you have setup a new hadoop environment, so there is no data in
> > hive. And we have not provided standalone data pack for this situation.
> > That means you have to manually import the data into hive table.
> >
> > On Fri Feb 13 2015 at 10:26:57 PM Santosh Akhilesh <
> > [email protected]<mailto:[email protected]>> wrote:
> >
> > > I have seen this link but my question is how to get EDW data source as
> > > mentioned in tutorial
> > > On Fri, 13 Feb 2015 at 7:41 pm, 周千昊 <[email protected]<mailto:z.
> [email protected]>> wrote:
> > >
> > > > Hi, Santosh
> > > > There is a tutorial about how to create a cube:
> > > > https://github.com/KylinOLAP/Kylin/wiki/Kylin-Cube-
> > > Creation-Tutorial
> > > >
> > > > On Fri Feb 13 2015 at 10:05:55 PM Santosh Akhilesh <
> > > > [email protected]<mailto:[email protected]>> wrote:
> > > >
> > > > > Hi Zhou,
> > > > > Yes I understand. I was wondering how do I use the create cube
> > > tutorial.
> > > > If
> > > > > there are some sample tables exist for me to try out the sample
> cube
> > > > > described in tutorial. I am quite new to these stuffs so if you can
> > > give
> > > > me
> > > > > pointers about how do I create sample hive tables and import it
> would
> > > be
> > > > > great. Thanks for your quick responses. I know in China you have
> > spring
> > > > > holidays but you guys still working :)
> > > > > Regards
> > > > > Santosh
> > > > > On Fri, 13 Feb 2015 at 7:13 pm, Zhou, Qianhao <[email protected]
> <mailto:[email protected]>>
> > > wrote:
> > > > >
> > > > > > Hi Santosh
> > > > > > Kylin is not responsible for source of the data, however you
> > can
> > > > > > import table from your hive table, there is a tab in the web ui
> > > called
> > > > > > table, you can import the table there
> > > > > >
> > > > > > 2015年2月13日 下午9:33于 Santoshakhilesh <[email protected]<
> mailto:[email protected]>>
> > 写道：
> > > > > > I saw the following link about creating the cube.
> > > > > >
> > > > > > https://github.com/KylinOLAP/Kylin/wiki/Kylin-Cube-
> > Creation-Tutorial
> > > > > >
> > > > > > In this there is already source table EDW exist , But in my
> > > environment
> > > > > > there is no such table.
> > > > > > How can I create this table manually or I need to export from
> > > > somewhere ?
> > > > > >
> > > > > > Also , how do I insert tables , data in table when I start
> creating
> > > my
> > > > > own
> > > > > > cubes and tables ?
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Santosh Akhilesh
> > > > > > Bangalore R&D
> > > > > > HUAWEI TECHNOLOGIES CO.,LTD.
> > > > > >
> > > > > > www.huawei.com<http://www.huawei.com><http://www.huawei.com>
> > > > > > ------------------------------------------------------------
> > > > > > ------------------------------------------------------------
> > > > > -------------
> > > > > > This e-mail and its attachments contain confidential information
> > from
> > > > > > HUAWEI, which
> > > > > > is intended only for the person or entity whose address is listed
> > > > above.
> > > > > > Any use of the
> > > > > > information contained herein in any way (including, but not
> limited
> > > to,
> > > > > > total or partial
> > > > > > disclosure, reproduction, or dissemination) by persons other than
> > the
> > > > > > intended
> > > > > > recipient(s) is prohibited. If you receive this e-mail in error,
> > > please
> > > > > > notify the sender by
> > > > > > phone or email immediately and delete it!
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Santoshakhilesh [[email protected]<mailto:
> [email protected]>]
> > > > > > Sent: Friday, February 13, 2015 5:40 PM
> > > > > > To: [email protected]<mailto:[email protected].
> apache.org>
> > > > > > Subject: RE: About building kylin
> > > > > >
> > > > > > Hi Zhou,
> > > > > > Thanks a million, it was hbase issue , now I am able to login
> to
> > > > main
> > > > > > interface page.
> > > > > > In the documents I see a section of building cubes. are there
> > any
> > > > > > sample cubles I can try with ?
> > > > > > Can you please tell me where can I get them and steps to
> import
> > > and
> > > > > > query them.
> > > > > >
> > > > > > Regards,
> > > > > > Santosh Akhilesh
> > > > > > Bangalore R&D
> > > > > > HUAWEI TECHNOLOGIES CO.,LTD.
> > > > > >
> > > > > > www.huawei.com<http://www.huawei.com><http://www.huawei.com>
> > > > > > ------------------------------------------------------------
> > > > > > ------------------------------------------------------------
> > > > > -------------
> > > > > > This e-mail and its attachments contain confidential information
> > from
> > > > > > HUAWEI, which
> > > > > > is intended only for the person or entity whose address is listed
> > > > above.
> > > > > > Any use of the
> > > > > > information contained herein in any way (including, but not
> limited
> > > to,
> > > > > > total or partial
> > > > > > disclosure, reproduction, or dissemination) by persons other than
> > the
> > > > > > intended
> > > > > > recipient(s) is prohibited. If you receive this e-mail in error,
> > > please
> > > > > > notify the sender by
> > > > > > phone or email immediately and delete it!
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Santoshakhilesh [[email protected]<mailto:
> [email protected]>]
> > > > > > Sent: Friday, February 13, 2015 2:38 PM
> > > > > > To: [email protected]<mailto:[email protected].
> apache.org>
> > > > > > Cc: Kulbhushan Rana
> > > > > > Subject: RE: About building kylin
> > > > > >
> > > > > > Hi Zhou,
> > > > > > The exceptions I see are below , So it seems Kylin instance
> is
> > > not
> > > > > > deployed correctly;
> > > > > >
> > > > > > WARNING: Failed to scan [file:/contrib/capacity-scheduler/*.jar]
> > > from
> > > > > > classloader hierarchy
> > > > > > java.io.FileNotFoundException: /contrib/capacity-scheduler/*.jar
> > (No
> > > > > such
> > > > > > file or directory)
> > > > > > at java.util.zip.ZipFile.open(Native Method)
> > > > > > at java.util.zip.ZipFile.<init>(ZipFile.java:215)
> > > > > > at java.util.zip.ZipFile.<init>(ZipFile.java:145)
> > > > > > at java.util.jar.JarFile.<init>(JarFile.java:154)
> > > > > > at java.util.jar.JarFile.<init>(JarFile.java:91)
> > > > > >
> > > > > > Feb 13, 2015 10:27:32 PM org.apache.catalina.startup.
> ContextConfig
> > > > > > processResourceJARs
> > > > > > SEVERE: Failed to processes JAR found at URL
> > > > [jar:file:/contrib/capacity-
> > > > > scheduler/*.jar!/]
> > > > > > for static resources to be included in context with name
> > > > > > [jar:file:/contrib/capacity-scheduler/*.jar!/]
> > > > > >
> > > > > > resource loaded through InputStream
> > > > > > [localhost-startStop-1]:[2015-02-13 22:27:34,475][WARN][org.
> > > > > > apache.kylin.common.KylinConfig.getKylinProperties(
> > > > > KylinConfig.java:527)]
> > > > > > - KYLIN_CONF_HOME has not been set
> > > > > > 2015-02-13 22:27:34,919 INFO [localhost-startStop-1] zookeeper.
> > > > > RecoverableZooKeeper:
> > > > > > Process identifier=hconnection-0x2b5a652e connecting to
> ZooKeeper
> > > > > > ensemble=localhost:2181
> > > > > >
> > > > > > 2015-02-13 22:27:34,958 INFO [localhost-startStop-1-
> > > > > SendThread(localhost:2181)]
> > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > > > > > localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate
> > > using
> > > > > > SASL (unknown error)
> > > > > > 2015-02-13 22:27:34,965 WARN [localhost-startStop-1-
> > > > > SendThread(localhost:2181)]
> > > > > > zookeeper.ClientCnxn: Session 0x0 for server null, unexpected
> > error,
> > > > > > closing socket connection and attempting reconnect
> > > > > > java.net.ConnectException: Connection refused
> > > > > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > > > at sun.nio.ch.SocketChannelImpl.finishConnect(
> > > > > SocketChannelImpl.java:739)
> > > > > > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
> > > > > > ClientCnxnSocketNIO.java:361)
> > > > > > at org.apache.zookeeper.ClientCnxn$SendThread.run(
> > > > ClientCnxn.java:1081)
> > > > > > 2015-02-13 22:27:35,070 INFO [localhost-startStop-1-
> > > > > SendThread(localhost:2181)]
> > > > > > zookeeper.ClientCnxn: Opening socket connection to server
> > localhost/
> > > > > > 127.0.0.1:2181<http://127.0.0.1:2181>. Will not attempt to
> authenticate using SASL
> > (unknown
> > > > > > error)
> > > > > >
> > > > > > 2015-02-13 22:27:51,920 WARN [localhost-startStop-1] zookeeper.
> > > > > RecoverableZooKeeper:
> > > > > > Possibly transient ZooKeeper, quorum=localhost:2181,
> > > > > exception=org.apache.
> > > > > > zookeeper.KeeperException$ConnectionLossException:
> > KeeperErrorCode =
> > > > > > ConnectionLoss for /hbase/hbaseid
> > > > > > 2015-02-13 22:27:51,921 ERROR [localhost-startStop-1] zookeeper.
> > > > > RecoverableZooKeeper:
> > > > > > ZooKeeper exists failed after 4 attempts
> > > > > > 2015-02-13 22:27:51,921 WARN [localhost-startStop-1]
> > > zookeeper.ZKUtil:
> > > > > > hconnection-0x2b5a652e, quorum=localhost:2181, baseZNode=/hbase
> > > Unable
> > > > to
> > > > > > set watcher on znode (/hbase/hbaseid)
> > > > > > org.apache.zookeeper.KeeperException$ConnectionLossException:
> > > > > > KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
> > > > > > at org.apache.zookeeper.KeeperException.create(
> > > > KeeperException.java:99)
> > > > > > at org.apache.zookeeper.KeeperException.create(
> > > > KeeperException.java:51)
> > > > > > at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
> > > > > > at org.apache.hadoop.hbase.zookeeper.
> RecoverableZooKeeper.exists(
> > > > > > RecoverableZooKeeper.java:222)
> > > > > > at org.apache.hadoop.hbase.zookeeper.ZKUtil.checkExists(
> > > > > ZKUtil.java:479)
> > > > > > at org.apache.hadoop.hbase.zookeeper.ZKClusterId.
> > > readClusterIdZNode(
> > > > > > ZKClusterId.java:65)
> > > > > > at org.apache.hadoop.hbase.client.ZooKeeperRegistry.
> getClusterId(
> > > > > > ZooKeeperRegistry.java:83)
> > > > > > at org.apache.hadoop.hbase.client.HConnectionManager$
> > > > > > HConnectionImplementation.retrieveClusterId(
> > > > HConnectionManager.java:897)
> > > > > > at org.apache.hadoop.hbase.client.HConnectionManager$
> > > > > > HConnectionImplementation.<init>(HConnectionManager.java:694)
> > > > > >
> > > > > >
> > > > > > Regards,
> > > > > > Santosh Akhilesh
> > > > > > Bangalore R&D
> > > > > > HUAWEI TECHNOLOGIES CO.,LTD.
> > > > > >
> > > > > > www.huawei.com<http://www.huawei.com><http://www.huawei.com>
> > > > > > ------------------------------------------------------------
> > > > > > ------------------------------------------------------------
> > > > > -------------
> > > > > > This e-mail and its attachments contain confidential information
> > from
> > > > > > HUAWEI, which
> > > > > > is intended only for the person or entity whose address is listed
> > > > above.
> > > > > > Any use of the
> > > > > > information contained herein in any way (including, but not
> limited
> > > to,
> > > > > > total or partial
> > > > > > disclosure, reproduction, or dissemination) by persons other than
> > the
> > > > > > intended
> > > > > > recipient(s) is prohibited. If you receive this e-mail in error,
> > > please
> > > > > > notify the sender by
> > > > > > phone or email immediately and delete it!
> > > > > >
> > > > > > ________________________________________
> > > > > > From: Zhou, Qianhao [[email protected]<mailto:[email protected]
> >]
> > > > > > Sent: Friday, February 13, 2015 2:07 PM
> > > > > > To: [email protected]<mailto:[email protected].
> apache.org>
> > > > > > Subject: Re: About building kylin
> > > > > >
> > > > > > Hi, Santosh
> > > > > > Please check tomcat/logs/kylin.log to see if there is any
> exception
> > > > > >
> > > > > > Best Regard
> > > > > > Zhou QianHao
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > >
> > > > > > On 2/13/15, 4:24 PM, "Santoshakhilesh" <
> > [email protected]<mailto:[email protected]>>
> > > > > > wrote:
> > > > > >
> > > > > > >Hi Zhou,
> > > > > > > I am able to access the http://127.0.0.17070/kylin using
> > > > firefox
> > > > > > > All I get is a blank page , its not 404 , it means I could
> > > > connect
> > > > > > >to web server successfully but there is some issue in
> rendering. I
> > > was
> > > > > > >noty asked for user name and password.
> > > > > > > When I run start kylin shell file , following prompt
> really
> > > > means
> > > > > > >everuthing went ok , or I should check some log files to know
> the
> > > real
> > > > > > >status ?
> > > > > > >A new Kylin instance is started by root, stop it using
> > > "stop-kylin.sh"
> > > > > > >Please visit http://<your_sandbox_ip>:7070/kylin to play with
> the
> > > > > cubes!
> > > > > > >
> > > > > > >Regards,
> > > > > > >Santosh Akhilesh
> > > > > > >Bangalore R&D
> > > > > > >HUAWEI TECHNOLOGIES CO.,LTD.
> > > > > > >
> > > > > > >www.huawei.com<http://www.huawei.com><http://www.huawei.com>
> > > > > > >-----------------------------------------------------------
> > > > > > ---------------
> > > > > > >-----------------------------------------------------------
> > > > > > >This e-mail and its attachments contain confidential information
> > > from
> > > > > > >HUAWEI, which
> > > > > > >is intended only for the person or entity whose address is
> listed
> > > > above.
> > > > > > >Any use of the
> > > > > > >information contained herein in any way (including, but not
> > limited
> > > > to,
> > > > > > >total or partial
> > > > > > >disclosure, reproduction, or dissemination) by persons other
> than
> > > the
> > > > > > >intended
> > > > > > >recipient(s) is prohibited. If you receive this e-mail in error,
> > > > please
> > > > > > >notify the sender by
> > > > > > >phone or email immediately and delete it!
> > > > > > >
> > > > > > >________________________________________
> > > > > > >From: Zhou, Qianhao [[email protected]<mailto:[email protected]
> >]
> > > > > > >Sent: Friday, February 13, 2015 1:04 PM
> > > > > > >To: [email protected]<mailto:[email protected].
> apache.org>
> > > > > > >Cc: Kulbhushan Rana
> > > > > > >Subject: Re: About building kylin
> > > > > > >
> > > > > > >Hi, Santosh
> > > > > > > You will see a kylin.war inside
> ${KYLIN_HOME}/tomcat/webapps.
> > > That
> > > > > is
> > > > > > >the server war package. The tomcat version is 7.0.59.
> > > > > > > If you want to bind 0.0.0.0:7070<http://0.0.0.0:7070>,
> please refer to the tomcat
> > > > > > document,
> > > > > > >there should be some configurations to let you do that.
> > > > > > >
> > > > > > >Best Regard
> > > > > > >Zhou QianHao
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >
> > > > > > >On 2/13/15, 1:46 PM, "Santoshakhilesh" <
> > [email protected]<mailto:[email protected]>
> > > >
> > > > > > >wrote:
> > > > > > >
> > > > > > >>Hi Zhou,
> > > > > > >> Due to some practical constarints , I have to setup
> clusster
> > > > > > >>manually.
> > > > > > >> I have downloaded all the dependency like hadoop , hbase ,
> > > hive
> > > > ,
> > > > > > >>tomcat and I have run the check-env.sh after it passes , I have
> > run
> > > > the
> > > > > > >>start-kylin.sh
> > > > > > >> Following is the log on console after running the
> > > > > ./start-kylin.sh.
> > > > > > >> Does this mean everything is ok or I should check some
> > other
> > > > > logs ?
> > > > > > >>Currently I am unable to login to http://
> <your_sandbox_ip>:7070/
> > > > kylin
> > > > > > >>from outside the machine.
> > > > > > >> Is it possible to bind it to 0.0.0.0 :7070 so that I can
> > > connect
> > > > > from
> > > > > > >>outside the lab network ? Where can I configure this ?
> > > > > > >>
> > > > > > >> ./start-kylin.sh
> > > > > > >>Checking KYLIN_HOME...
> > > > > > >>KYLIN_HOME is set to /opt/kylinb
> > > > > > >>Checking hbase...
> > > > > > >>hbase check passed
> > > > > > >>Checking hive...
> > > > > > >>hive check passed
> > > > > > >>Checking hadoop...
> > > > > > >>hadoop check passed
> > > > > > >>Logging initialized using configuration in
> > > > > > >>jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-
> > > > > > common-0.14.0.jar!/hiv
> > > > > > >>e
> > > > > > >>-log4j.properties
> > > > > > >>SLF4J: Class path contains multiple SLF4J bindings.
> > > > > > >>SLF4J: Found binding in
> > > > > > >>[jar:file:/opt/hadoop/hadoop-2.6.0/share/hadoop/
> > > > > > common/lib/slf4j-log4j12-
> > > > > > >>1
> > > > > > >>.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > > > >>SLF4J: Found binding in
> > > > > > >>[jar:file:/opt/hive/apache-hive-0.14.0-bin/lib/hive-jdbc-
> > > > > > 0.14.0-standalon
> > > > > > >>e
> > > > > > >>.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > > > >>SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings
> for
> > > an
> > > > > > >>explanation.
> > > > > > >>SLF4J: Actual binding is of type [org.slf4j.impl.
> > > Log4jLoggerFactory]
> > > > > > >>hive dependency:
> > > > > > >>/usr/hdp/current/hive-client/conf/:/hive/lib/*:/
> > > > > > hive-hcatalog/share/hcata
> > > > > > >>l
> > > > > > >>og/*
> > > > > > >>A new Kylin instance is started by root, stop it using
> > > > "stop-kylin.sh"
> > > > > > >>Please visit http://<your_sandbox_ip>:7070/kylin to play with
> > the
> > > > > cubes!
> > > > > > >>(Useranme: ADMIN, Password: KYLIN)
> > > > > > >>You can check the log at ./../tomcat/logs/kylin.log
> > > > > > >>
> > > > > > >>Regards,
> > > > > > >>Santosh Akhilesh
> > > > > > >>Bangalore R&D
> > > > > > >>HUAWEI TECHNOLOGIES CO.,LTD.
> > > > > > >>
> > > > > > >>www.huawei.com<http://www.huawei.com><http://www.huawei.com>
> > > > > > >>----------------------------------------------------------
> > > > > > ---------------
> > > > > > >>-
> > > > > > >>-----------------------------------------------------------
> > > > > > >>This e-mail and its attachments contain confidential
> information
> > > from
> > > > > > >>HUAWEI, which
> > > > > > >>is intended only for the person or entity whose address is
> listed
> > > > > above.
> > > > > > >>Any use of the
> > > > > > >>information contained herein in any way (including, but not
> > limited
> > > > to,
> > > > > > >>total or partial
> > > > > > >>disclosure, reproduction, or dissemination) by persons other
> than
> > > the
> > > > > > >>intended
> > > > > > >>recipient(s) is prohibited. If you receive this e-mail in
> error,
> > > > please
> > > > > > >>notify the sender by
> > > > > > >>phone or email immediately and delete it!
> > > > > > >>
> > > > > > >>________________________________________
> > > > > > >>From: Zhou, Qianhao [[email protected]<mailto:qian
> [email protected]>]
> > > > > > >>Sent: Thursday, February 12, 2015 2:59 PM
> > > > > > >>To: [email protected]<mailto:[email protected].
> apache.org>
> > > > > > >>Subject: Re: About building kylin
> > > > > > >>
> > > > > > >>Hi Santosh
> > > > > > >> Surely you can run kylin on single node.
> > > > > > >> Currently kylin is depend on
> > > > > > >> 1. Hive (where source data come from)
> > > > > > >> 2. HBase (where metadata and pre-computed data stored)
> > > > > > >> However once you have the hadoop environment ready, it does
> > not
> > > > > matter
> > > > > > >>how many vm running in the cluster.
> > > > > > >> As for your circumstances, a sandbox is strongly recommended
> > > which
> > > > > > >>will
> > > > > > >>save you a lot of time of setting up the environment.
> Hortonworks
> > > or
> > > > > > >>Cloudera will be good choice.
> > > > > > >>
> > > > > > >>Best Regard
> > > > > > >>Zhou QianHao
> > > > > >
> > > > >
> > > >
> > >
> >
