Hi Xiaoyu It worked manually.
On Thu, Jun 30, 2016 at 6:17 PM, Xiaoyu Wang <[email protected]> wrote: > The last step , Kylin use hive command line to execute: > > hive -e "USE default; > DROP TABLE IF EXISTS > default.kylin_intermediate_kylin_sales_cube_desc_20120101000000_20150408063000; > " > On your kylin job server , can you try the command manual. > > > > 在 2016年06月30日 20:40, Punit Naik 写道: > > Hi Xiaoyu > > I was able to connect to MySQL database as a metastore and I was also able > to create tables and stuff in it. But don't you think that this is a Kylin > issue? Because generally the derby metastore is initialised properly. Just > in the last step of the sample_cube it fails. > > On Thu, Jun 30, 2016 at 5:30 PM, Xiaoyu Wang <[email protected]> wrote: > >> Hi >> This error is hive create local derby metastore fail. >> You can check your hive work fine or not . The usual practice is to >> config a RDMS like mysql to store hive metadata. and start a hive >> metastore. >> >> >> 在 2016年06月30日 00:46, Punit Naik 写道: >> >> Hi >> >> Got this error at the last step of the sample_cube job: >> >> OS command error exit with 1 -- hive -e "USE default; >> DROP TABLE IF EXISTS >> default.kylin_intermediate_kylin_sales_cube_desc_20120101000000_20150408063000; >> " >> SLF4J: Class path contains multiple SLF4J bindings. >> SLF4J: Found binding in >> [jar:file:/home/formcept/fcstack/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: Found binding in >> [jar:file:/home/formcept/fcstack/spark-1.3.1-bin-2.2.0/lib/spark-assembly-1.3.1-hadoop2.2.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >> explanation. >> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >> SLF4J: Class path contains multiple SLF4J bindings. >> SLF4J: Found binding in >> [jar:file:/home/formcept/fcstack/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: Found binding in >> [jar:file:/home/formcept/fcstack/spark-1.3.1-bin-2.2.0/lib/spark-assembly-1.3.1-hadoop2.2.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] >> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >> explanation. >> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >> >> Logging initialized using configuration in >> jar:file:/home/formcept/fcstack/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties >> Exception in thread "main" java.lang.RuntimeException: >> java.lang.RuntimeException: Unable to instantiate >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient >> at >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >> Caused by: java.lang.RuntimeException: Unable to instantiate >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient >> at >> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >> at >> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >> at >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >> ... 8 more >> Caused by: java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >> ... 14 more >> Caused by: javax.jdo.JDOFatalDataStoreException: Unable to open a test >> connection to the given database. JDBC url = >> jdbc:derby:;databaseName=metastore_db;create=true, username = APP. >> Terminating connection pool (set lazyInit to true if you expect to start >> your database after your app). Original Exception: ------ >> java.sql.SQLException: Failed to start database 'metastore_db' with class >> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception for >> details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >> Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >> at java.sql.DriverManager.getConnection(DriverManager.java:571) >> at java.sql.DriverManager.getConnection(DriverManager.java:187) >> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >> at >> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >> at >> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >> at >> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >> at >> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >> at >> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >> at >> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >> at >> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >> at >> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >> at >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >> at >> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >> at >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >> exception for details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> ... 74 more >> Caused by: java.sql.SQLException: Another instance of Derby may have already >> booted the database /home/formcept/metastore_db. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >> Source) >> ... 71 more >> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >> the database /home/formcept/metastore_db. >> at org.apache.derby.iapi.error.StandardException.newException(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >> Source) >> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >> Source) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >> Source) >> ... 71 more >> ------ >> >> NestedThrowables: >> java.sql.SQLException: Unable to open a test connection to the given >> database. JDBC url = jdbc:derby:;databaseName=metastore_db;create=true, >> username = APP. Terminating connection pool (set lazyInit to true if you >> expect to start your database after your app). Original Exception: ------ >> java.sql.SQLException: Failed to start database 'metastore_db' with class >> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception for >> details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >> Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >> at java.sql.DriverManager.getConnection(DriverManager.java:571) >> at java.sql.DriverManager.getConnection(DriverManager.java:187) >> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >> at >> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >> at >> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >> at >> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >> at >> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >> at >> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >> at >> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >> at >> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >> at >> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >> at >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >> at >> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >> at >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >> exception for details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> ... 74 more >> Caused by: java.sql.SQLException: Another instance of Derby may have already >> booted the database /home/formcept/metastore_db. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >> Source) >> ... 71 more >> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >> the database /home/formcept/metastore_db. >> at org.apache.derby.iapi.error.StandardException.newException(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >> Source) >> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >> Source) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >> Source) >> ... 71 more >> ------ >> >> at >> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:436) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >> at >> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >> at >> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >> at >> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >> at >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >> ... 19 more >> Caused by: java.sql.SQLException: Unable to open a test connection to the >> given database. JDBC url = >> jdbc:derby:;databaseName=metastore_db;create=true, username = APP. >> Terminating connection pool (set lazyInit to true if you expect to start >> your database after your app). Original Exception: ------ >> java.sql.SQLException: Failed to start database 'metastore_db' with class >> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception for >> details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >> Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >> at java.sql.DriverManager.getConnection(DriverManager.java:571) >> at java.sql.DriverManager.getConnection(DriverManager.java:187) >> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >> at >> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >> at >> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >> at >> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >> at >> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >> at >> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >> at java.security.AccessController.doPrivileged(Native Method) >> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >> at >> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >> at >> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >> at >> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >> at >> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >> at >> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >> at >> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >> at >> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >> at >> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >> at >> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >> at >> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >> at >> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at >> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >> at >> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:606) >> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >> exception for details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> ... 74 more >> Caused by: java.sql.SQLException: Another instance of Derby may have already >> booted the database /home/formcept/metastore_db. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >> Source) >> ... 71 more >> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >> the database /home/formcept/metastore_db. >> at org.apache.derby.iapi.error.StandardException.newException(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >> Source) >> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >> Source) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >> Source) >> ... 71 more >> ------ >> >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at com.jolbox.bonecp.PoolUtil.generateSQLException(PoolUtil.java:192) >> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:422) >> at >> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >> at >> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >> at >> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >> at >> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >> at >> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >> at >> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >> at >> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >> at >> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >> at >> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >> ... 48 more >> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >> exception for details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >> Source) >> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >> at java.sql.DriverManager.getConnection(DriverManager.java:571) >> at java.sql.DriverManager.getConnection(DriverManager.java:187) >> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >> ... 60 more >> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >> exception for details. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> ... 74 more >> Caused by: java.sql.SQLException: Another instance of Derby may have already >> booted the database /home/formcept/metastore_db. >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >> Source) >> at >> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >> Source) >> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >> Source) >> ... 71 more >> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >> the database /home/formcept/metastore_db. >> at org.apache.derby.iapi.error.StandardException.newException(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >> Source) >> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >> Source) >> at java.security.AccessController.doPrivileged(Native Method) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >> Source) >> at >> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >> Source) >> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >> Source) >> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >> Source) >> at >> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >> Source) >> at >> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >> Source) >> ... 71 more >> >> Any idea guys? >> >> On Wed, Jun 29, 2016 at 9:30 PM, Punit Naik < <[email protected]> >> [email protected]> wrote: >> >>> So I finally found the problem. I was using the hbase 0.98/0.99 version >>> of kylin but I was actually running hbase 1.1.1. So I downloaded the hbase >>> 1.1.1 compatible kylin and ran the sample_cube build and it ran perfectly. >>> So it finalise: >>> >>> Prerequisites: >>> Hadoop -> 2.7.1 version used >>> HBase -> 1.1.1 version used >>> Zookeeper -> 3.4.6 version used >>> Kylin -> 1.5.2.1 version used (HBase 1.x compatible) >>> >>> start HDFS -> YARN -> Zookeeper -> HBase -> Kylin >>> >>> On Wed, Jun 29, 2016 at 9:11 PM, Punit Naik < <[email protected]> >>> [email protected]> wrote: >>> >>>> Hi >>>> >>>> I changed updated my Hive version to 1.2.1 and I am still getting the >>>> same error: >>>> >>>> java.lang.reflect.InvocationTargetException >>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>> Method) >>>> at >>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>>> at >>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> at >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>> at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>> Caused by: java.lang.IllegalArgumentException: File not exist by >>>> 'kylin_metadata@hbase': >>>> /home/user/fcstack/apache-kylin-1.5.2.1-bin/kylin_metadata@hbase >>>> at >>>> org.apache.kylin.common.persistence.FileResourceStore.<init>(FileResourceStore.java:49) >>>> ... 13 more >>>> 2016-06-29 21:08:14,819 ERROR [main] persistence.ResourceStore: Create >>>> new store instance failed >>>> java.lang.reflect.InvocationTargetException >>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>> Method) >>>> at >>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>>> at >>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> at >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>> at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>> Caused by: java.lang.NoSuchMethodError: >>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(Lorg/apache/hadoop/hbase/client/HConnection;)V >>>> at >>>> org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:184) >>>> at >>>> org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:89) >>>> at >>>> org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:85) >>>> ... 13 more >>>> Exception in thread "main" java.lang.IllegalArgumentException: Failed >>>> to find metadata store by url: kylin_metadata@hbase >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) >>>> at >>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>> at >>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>> at >>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>> at >>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>> 2016-06-29 21:08:14,824 INFO [Thread-2] >>>> client.ConnectionManager$HConnectionImplementation: Closing zookeeper >>>> sessionid=0x1559cce1b200007 >>>> 2016-06-29 21:08:14,838 INFO [Thread-2] zookeeper.ZooKeeper: Session: >>>> 0x1559cce1b200007 closed >>>> 2016-06-29 21:08:14,839 INFO [main-EventThread] zookeeper.ClientCnxn: >>>> EventThread shut down >>>> >>>> >>>> Why is kylin trying to find that metadata file its its home folder? >>>> >>>> On Wed, Jun 29, 2016 at 5:24 PM, 王晓雨 < <[email protected]> >>>> [email protected]> wrote: >>>> >>>>> Kylin1.3 and Kylin1.5 both has the HBase1.x version binary package >>>>> If you are the first time to use Kylin and your env has Hadoop2.7.1 >>>>> and HBase1.1.1, I suggest you to use Kylin1.5.2.1-HBase1.x version. >>>>> This version is compile with Hadoop-2.7.1,HBase-1.1.1,Hive-1.2.1. >>>>> So you can upgrade your hive to 1.2.1. it will work fine. >>>>> >>>>> 在 2016年6月29日,18:46,Punit Naik < <[email protected]> >>>>> [email protected]> 写道: >>>>> >>>>> I updated my hbase from 0.98.2 to 1.1.1 but it gave the following >>>>> error when I tried to start kylin or run the sample.sh file: >>>>> >>>>> Caused by: java.lang.IllegalArgumentException: Failed to find metadata >>>>> store by url: kylin_metadata@hbase >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>>> at org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:880) >>>>> at >>>>> org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:814) >>>>> at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:125) >>>>> at >>>>> org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:94) >>>>> at >>>>> org.apache.kylin.rest.service.CacheService.initCubeChangeListener(CacheService.java:79) >>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>> at >>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>> at >>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346) >>>>> at >>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299) >>>>> at >>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132) >>>>> ... 53 more >>>>> >>>>> Can you help me on this? >>>>> >>>>> On Wed, Jun 29, 2016 at 3:41 PM, Punit Naik < <[email protected]> >>>>> [email protected]> wrote: >>>>> >>>>>> Hi >>>>>> >>>>>> I will try that and get back to you. >>>>>> >>>>>> On Wed, Jun 29, 2016 at 3:33 PM, 王晓雨 < <[email protected]> >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi >>>>>>> HBase 0.98 is depends hadoop 2.2 >>>>>>> If you can upgrade HBase version to 1.x can fix this exception. >>>>>>> if can’t upgrade HBase >>>>>>> set >>>>>>> kylin.job.yarn.app.rest.check.status.url= >>>>>>> <http://your_rm_and_port/ws/v1/cluster/apps/$%7Bjob_id%7D?anonymous=true> >>>>>>> <http://YOUR_RM_AND_PORT/ws/v1/cluster/apps/$> >>>>>>> http://YOUR_RM_AND_PORT/ws/v1/cluster/apps/${job_id}?anonymous=true >>>>>>> in $KYLIN_HOME/conf/kylin.properties >>>>>>> ${job_id} will be auto replaced in kylin. >>>>>>> >>>>>>> 在 2016年6月29日,17:13,Punit Naik < <[email protected]> >>>>>>> [email protected]> 写道: >>>>>>> >>>>>>> Hello >>>>>>> >>>>>>> I even upgraded Hadoop from 2.4.0 to 2.7.1 but still I get the same >>>>>>> error. I have checked the source code and the method >>>>>>> 'YarnConfiguration.getServiceAddressConfKeys' is already there and the >>>>>>> parameter and the return types are proper. Why do I still get this >>>>>>> error? >>>>>>> >>>>>>> On Wed, Jun 29, 2016 at 12:28 PM, Punit Naik < >>>>>>> <[email protected]>[email protected]> wrote: >>>>>>> >>>>>>>> Hello >>>>>>>> >>>>>>>> I was building the sample_cube for kylin but it gave me the >>>>>>>> following error at Step #2: >>>>>>>> >>>>>>>> java.lang.NoSuchMethodError: >>>>>>>> org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List; >>>>>>>> at >>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfKeyForRMInstance(HAUtil.java:239) >>>>>>>> at >>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:250) >>>>>>>> at >>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:262) >>>>>>>> at >>>>>>>> org.apache.kylin.job.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:198) >>>>>>>> at >>>>>>>> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:135) >>>>>>>> at >>>>>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>>>>> at >>>>>>>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51) >>>>>>>> at >>>>>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>>>>> at >>>>>>>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130) >>>>>>>> at >>>>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>>>>>>> at >>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>>> >>>>>>>> >>>>>>>> The Hadoop, HBase, Hive and Kylin versions that I am running are >>>>>>>> 2.4.0, 0.98.2, 0.14 and 1.3.0 respectively. >>>>>>>> >>>>>>>> How do I fix this? >>>>>>>> >>>>>>>> -- >>>>>>>> Thank Yo >>>>>>>> >>>>>>>> Regards >>>>>>>> >>>>>>>> Punit Naik >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Thank You >>>>>>> >>>>>>> Regards >>>>>>> >>>>>>> Punit Naik >>>>>>> >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thank You >>>>>> >>>>>> Regards >>>>>> >>>>>> Punit Naik >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> Thank You >>>>> >>>>> Regards >>>>> >>>>> Punit Naik >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> Thank You >>>> >>>> Regards >>>> >>>> Punit Naik >>>> >>> >>> >>> >>> -- >>> Thank You >>> >>> Regards >>> >>> Punit Naik >>> >> >> >> >> -- >> Thank You >> >> Regards >> >> Punit Naik >> >> >> > > > -- > Thank You > > Regards > > Punit Naik > > > -- Thank You Regards Punit Naik
