Your analysis is correct; When it failed to locate the proper hive-site.xml, it will use default values which is an embeded metadata store.
Please search more widely to see whether there is another hive-site.xml on the classpath. It may hide in hbase's folder or other place. 2016-09-12 14:25 GMT+08:00 udana pathirana <[email protected]>: > More infomation: > > I have a valid 'hive-site.xml" and the folder is added into the "hive > _dependency" by the "find-hive-dependency.sh" script. > "hive-site.xml" contains valid "hive.metastore.uris" : > thrift://hdp-hive01.hadoop.local:9083,thrift://hdp- > hive02.hadoop.local:9083 > > I can see all the databases/tables using hive/beeline client. > I found that HiveMetaStoreClient look for the hite-site.xml in the class > path and if its not found, it will fallback to default settings, which is > DerbDB . but it seems "find-hive-dependency.sh" add the correct folder to > the class path but still why it doesnt work ? > > > On Mon, Sep 12, 2016 at 11:58 AM, udana pathirana < > [email protected]> wrote: > >> After lots of trial-and-error I managed to start Kylin Web application >> without any exceptions. >> >> Here's the summary in short >> >> * We are running HDP 2.4.2 >> * HBase server 1.1.2 on Slider >> * Kylin installed on an edge node outside the cluster (Kerebros keytab >> files are configured on the edge node) >> - Kylin node have hbase-client-1.1.2.2.3.4.7-4.jar >> - from Kylin node ,I can access hive,hbase CLIs sucessfully >> >> >> I merged "1.5.x-HBase1.x" into "master" branch and built the binary >> package.Managed to solve previous errors related to Spring >> initialization/library mismatch..etc >> >> >> Now I can login to the Kylin UI.However,I cannot see the hive database >> list in the UI, When I give the table name manually , it throws the error >> "NoSuchObjectException" even though I can see this database/table using >> "hive" CLI. >> >> ---------------------- >> java.io.IOException: NoSuchObjectException(message:default.test01 table >> not found) >> at org.apache.kylin.source.hive.HiveSourceTableLoader.extractHi >> veTables(HiveSourceTableLoader.java:102) >> at org.apache.kylin.source.hive.HiveSourceTableLoader.reloadHiv >> eTables(HiveSourceTableLoader.java:74) >> at org.apache.kylin.rest.service.CubeService.reloadHiveTable(Cu >> beService.java:553) >> at org.apache.kylin.rest.service.CubeService$$FastClassBySpring >> CGLIB$$17a07c0e.invoke(<generated>) >> at org.springframework.cglib.proxy.MethodProxy.invoke(MethodPro >> xy.java:204) >> >> ------------------------------ >> I see following logs as well : >> 2016-09-12 02:37:30,263 INFO [http-bio-7070-exec-9] >> metastore.HiveMetaStore:756 : 2: get_table : db=default tbl=test01 >> 2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9] >> HiveMetaStore.audit:367 : ugi=udana/ins-kylin102.hadoop. >> [email protected] ip=unknown-ip-addr cmd=get_table : db=default >> tbl=test01 >> 2016-09-12 02:37:30,264 INFO [http-bio-7070-exec-9] >> metastore.HiveMetaStore:599 : 2: Opening raw store with implemenation >> class:org.apache.hadoop.hive.metastore.ObjectStore >> 2016-09-12 02:37:30,265 INFO [http-bio-7070-exec-9] >> metastore.ObjectStore:294 : ObjectStore, initialize called >> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] DataNucleus.Query:77 >> : Reading in results for query "org.datanucleus.store.rdbms.q >> uery.SQLQuery@0" since the connection used is closing >> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] >> metastore.MetaStoreDirectSql:140 : Using direct SQL, underlying DB is >> DERBY >> 2016-09-12 02:37:30,268 INFO [http-bio-7070-exec-9] >> metastore.ObjectStore:277 : Initialized ObjectStore >> >> >> >> 1) Why Kylin cannot retrieve Hive databases/tables? >> 2) Do I have to configure the Kerebros keytab file with Kylin? >> > > -- Best regards, Shaofeng Shi
