Hi Xiaoyu After running the command manually which completed successfully, I resumed the build from the point where it failed and surprisingly it completed to 100%. So what was the error??
On Thu, Jun 30, 2016 at 6:20 PM, Punit Naik <[email protected]> wrote: > Hi Xiaoyu > > It worked manually. > > On Thu, Jun 30, 2016 at 6:17 PM, Xiaoyu Wang <[email protected]> wrote: > >> The last step , Kylin use hive command line to execute: >> >> hive -e "USE default; >> DROP TABLE IF EXISTS >> default.kylin_intermediate_kylin_sales_cube_desc_20120101000000_20150408063000; >> " >> On your kylin job server , can you try the command manual. >> >> >> >> 在 2016年06月30日 20:40, Punit Naik 写道: >> >> Hi Xiaoyu >> >> I was able to connect to MySQL database as a metastore and I was also >> able to create tables and stuff in it. But don't you think that this is a >> Kylin issue? Because generally the derby metastore is initialised properly. >> Just in the last step of the sample_cube it fails. >> >> On Thu, Jun 30, 2016 at 5:30 PM, Xiaoyu Wang <[email protected]> wrote: >> >>> Hi >>> This error is hive create local derby metastore fail. >>> You can check your hive work fine or not . The usual practice is to >>> config a RDMS like mysql to store hive metadata. and start a hive >>> metastore. >>> >>> >>> 在 2016年06月30日 00:46, Punit Naik 写道: >>> >>> Hi >>> >>> Got this error at the last step of the sample_cube job: >>> >>> OS command error exit with 1 -- hive -e "USE default; >>> DROP TABLE IF EXISTS >>> default.kylin_intermediate_kylin_sales_cube_desc_20120101000000_20150408063000; >>> " >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/home/formcept/fcstack/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/home/formcept/fcstack/spark-1.3.1-bin-2.2.0/lib/spark-assembly-1.3.1-hadoop2.2.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> SLF4J: Class path contains multiple SLF4J bindings. >>> SLF4J: Found binding in >>> [jar:file:/home/formcept/fcstack/hadoop-2.7.1/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: Found binding in >>> [jar:file:/home/formcept/fcstack/spark-1.3.1-bin-2.2.0/lib/spark-assembly-1.3.1-hadoop2.2.0.jar!/org/slf4j/impl/StaticLoggerBinder.class] >>> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an >>> explanation. >>> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] >>> >>> Logging initialized using configuration in >>> jar:file:/home/formcept/fcstack/apache-hive-1.2.1-bin/lib/hive-common-1.2.1.jar!/hive-log4j.properties >>> Exception in thread "main" java.lang.RuntimeException: >>> java.lang.RuntimeException: Unable to instantiate >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient >>> at >>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:522) >>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >>> Caused by: java.lang.RuntimeException: Unable to instantiate >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient >>> at >>> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1523) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >>> at >>> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >>> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >>> at >>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >>> ... 8 more >>> Caused by: java.lang.reflect.InvocationTargetException >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >>> ... 14 more >>> Caused by: javax.jdo.JDOFatalDataStoreException: Unable to open a test >>> connection to the given database. JDBC url = >>> jdbc:derby:;databaseName=metastore_db;create=true, username = APP. >>> Terminating connection pool (set lazyInit to true if you expect to start >>> your database after your app). Original Exception: ------ >>> java.sql.SQLException: Failed to start database 'metastore_db' with class >>> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception >>> for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >>> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >>> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >>> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >>> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >>> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >>> at java.sql.DriverManager.getConnection(DriverManager.java:571) >>> at java.sql.DriverManager.getConnection(DriverManager.java:187) >>> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >>> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >>> at >>> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >>> at >>> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >>> at >>> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >>> at >>> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >>> at >>> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >>> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >>> at >>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >>> at >>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >>> at >>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >>> at >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >>> at >>> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >>> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >>> at >>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >>> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >>> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >>> exception for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> ... 74 more >>> Caused by: java.sql.SQLException: Another instance of Derby may have >>> already booted the database /home/formcept/metastore_db. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >>> Source) >>> ... 71 more >>> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >>> the database /home/formcept/metastore_db. >>> at org.apache.derby.iapi.error.StandardException.newException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >>> Source) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >>> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >>> Source) >>> ... 71 more >>> ------ >>> >>> NestedThrowables: >>> java.sql.SQLException: Unable to open a test connection to the given >>> database. JDBC url = jdbc:derby:;databaseName=metastore_db;create=true, >>> username = APP. Terminating connection pool (set lazyInit to true if you >>> expect to start your database after your app). Original Exception: ------ >>> java.sql.SQLException: Failed to start database 'metastore_db' with class >>> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception >>> for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >>> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >>> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >>> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >>> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >>> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >>> at java.sql.DriverManager.getConnection(DriverManager.java:571) >>> at java.sql.DriverManager.getConnection(DriverManager.java:187) >>> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >>> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >>> at >>> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >>> at >>> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >>> at >>> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >>> at >>> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >>> at >>> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >>> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >>> at >>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >>> at >>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >>> at >>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >>> at >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >>> at >>> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >>> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >>> at >>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >>> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >>> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >>> exception for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> ... 74 more >>> Caused by: java.sql.SQLException: Another instance of Derby may have >>> already booted the database /home/formcept/metastore_db. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >>> Source) >>> ... 71 more >>> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >>> the database /home/formcept/metastore_db. >>> at org.apache.derby.iapi.error.StandardException.newException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >>> Source) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >>> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >>> Source) >>> ... 71 more >>> ------ >>> >>> at >>> org.datanucleus.api.jdo.NucleusJDOHelper.getJDOExceptionForNucleusException(NucleusJDOHelper.java:436) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:788) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >>> at >>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >>> at >>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >>> at >>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >>> at >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >>> ... 19 more >>> Caused by: java.sql.SQLException: Unable to open a test connection to the >>> given database. JDBC url = >>> jdbc:derby:;databaseName=metastore_db;create=true, username = APP. >>> Terminating connection pool (set lazyInit to true if you expect to start >>> your database after your app). Original Exception: ------ >>> java.sql.SQLException: Failed to start database 'metastore_db' with class >>> loader sun.misc.Launcher$AppClassLoader@3351e824, see the next exception >>> for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >>> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >>> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >>> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >>> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >>> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >>> at java.sql.DriverManager.getConnection(DriverManager.java:571) >>> at java.sql.DriverManager.getConnection(DriverManager.java:187) >>> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >>> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >>> at >>> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >>> at >>> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >>> at >>> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >>> at >>> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >>> at >>> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >>> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.createPersistenceManagerFactory(JDOPersistenceManagerFactory.java:333) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.getPersistenceManagerFactory(JDOPersistenceManagerFactory.java:202) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at javax.jdo.JDOHelper$16.run(JDOHelper.java:1965) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at javax.jdo.JDOHelper.invoke(JDOHelper.java:1960) >>> at >>> javax.jdo.JDOHelper.invokeGetPersistenceManagerFactoryOnImplementation(JDOHelper.java:1166) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:808) >>> at javax.jdo.JDOHelper.getPersistenceManagerFactory(JDOHelper.java:701) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPMF(ObjectStore.java:365) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.getPersistenceManager(ObjectStore.java:394) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.initialize(ObjectStore.java:291) >>> at >>> org.apache.hadoop.hive.metastore.ObjectStore.setConf(ObjectStore.java:258) >>> at >>> org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:76) >>> at >>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:136) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.<init>(RawStoreProxy.java:57) >>> at >>> org.apache.hadoop.hive.metastore.RawStoreProxy.getProxy(RawStoreProxy.java:66) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.newRawStore(HiveMetaStore.java:593) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.getMS(HiveMetaStore.java:571) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.createDefaultDB(HiveMetaStore.java:624) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.init(HiveMetaStore.java:461) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.<init>(RetryingHMSHandler.java:66) >>> at >>> org.apache.hadoop.hive.metastore.RetryingHMSHandler.getProxy(RetryingHMSHandler.java:72) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStore.newRetryingHMSHandler(HiveMetaStore.java:5762) >>> at >>> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.<init>(HiveMetaStoreClient.java:199) >>> at >>> org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient.<init>(SessionHiveMetaStoreClient.java:74) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1521) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.<init>(RetryingMetaStoreClient.java:86) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:132) >>> at >>> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:104) >>> at >>> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:3005) >>> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:3024) >>> at >>> org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:503) >>> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:677) >>> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:621) >>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>> at >>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>> at java.lang.reflect.Method.invoke(Method.java:606) >>> at org.apache.hadoop.util.RunJar.run(RunJar.java:221) >>> at org.apache.hadoop.util.RunJar.main(RunJar.java:136) >>> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >>> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >>> exception for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> ... 74 more >>> Caused by: java.sql.SQLException: Another instance of Derby may have >>> already booted the database /home/formcept/metastore_db. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >>> Source) >>> ... 71 more >>> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >>> the database /home/formcept/metastore_db. >>> at org.apache.derby.iapi.error.StandardException.newException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >>> Source) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >>> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >>> Source) >>> ... 71 more >>> ------ >>> >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at com.jolbox.bonecp.PoolUtil.generateSQLException(PoolUtil.java:192) >>> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:422) >>> at >>> com.jolbox.bonecp.BoneCPDataSource.getConnection(BoneCPDataSource.java:120) >>> at >>> org.datanucleus.store.rdbms.ConnectionFactoryImpl$ManagedConnectionImpl.getConnection(ConnectionFactoryImpl.java:501) >>> at >>> org.datanucleus.store.rdbms.RDBMSStoreManager.<init>(RDBMSStoreManager.java:298) >>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) >>> at >>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>> at >>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>> at >>> org.datanucleus.plugin.NonManagedPluginRegistry.createExecutableExtension(NonManagedPluginRegistry.java:631) >>> at >>> org.datanucleus.plugin.PluginManager.createExecutableExtension(PluginManager.java:301) >>> at >>> org.datanucleus.NucleusContext.createStoreManagerForProperties(NucleusContext.java:1187) >>> at org.datanucleus.NucleusContext.initialise(NucleusContext.java:356) >>> at >>> org.datanucleus.api.jdo.JDOPersistenceManagerFactory.freezeConfiguration(JDOPersistenceManagerFactory.java:775) >>> ... 48 more >>> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >>> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >>> exception for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source) >>> at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source) >>> at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source) >>> at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source) >>> at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source) >>> at org.apache.derby.jdbc.Driver20.connect(Unknown Source) >>> at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source) >>> at java.sql.DriverManager.getConnection(DriverManager.java:571) >>> at java.sql.DriverManager.getConnection(DriverManager.java:187) >>> at com.jolbox.bonecp.BoneCP.obtainRawInternalConnection(BoneCP.java:361) >>> at com.jolbox.bonecp.BoneCP.<init>(BoneCP.java:416) >>> ... 60 more >>> Caused by: java.sql.SQLException: Failed to start database 'metastore_db' >>> with class loader sun.misc.Launcher$AppClassLoader@3351e824, see the next >>> exception for details. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> ... 74 more >>> Caused by: java.sql.SQLException: Another instance of Derby may have >>> already booted the database /home/formcept/metastore_db. >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown >>> Source) >>> at >>> org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown >>> Source) >>> at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown >>> Source) >>> ... 71 more >>> Caused by: ERROR XSDB6: Another instance of Derby may have already booted >>> the database /home/formcept/metastore_db. >>> at org.apache.derby.iapi.error.StandardException.newException(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.privGetJBMSLockOnDB(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.data.BaseDataFileFactory.run(Unknown >>> Source) >>> at java.security.AccessController.doPrivileged(Native Method) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.getJBMSLockOnDB(Unknown >>> Source) >>> at >>> org.apache.derby.impl.store.raw.data.BaseDataFileFactory.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.raw.RawStore.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.store.access.RAMAccessManager.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startModule(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.bootServiceModule(Unknown >>> Source) >>> at org.apache.derby.impl.db.BasicDatabase.bootStore(Unknown Source) >>> at org.apache.derby.impl.db.BasicDatabase.boot(Unknown Source) >>> at org.apache.derby.impl.services.monitor.BaseMonitor.boot(Unknown >>> Source) >>> at org.apache.derby.impl.services.monitor.TopService.bootModule(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startProviderService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.findProviderAndStartService(Unknown >>> Source) >>> at >>> org.apache.derby.impl.services.monitor.BaseMonitor.startPersistentService(Unknown >>> Source) >>> at >>> org.apache.derby.iapi.services.monitor.Monitor.startPersistentService(Unknown >>> Source) >>> ... 71 more >>> >>> Any idea guys? >>> >>> On Wed, Jun 29, 2016 at 9:30 PM, Punit Naik < <[email protected]> >>> [email protected]> wrote: >>> >>>> So I finally found the problem. I was using the hbase 0.98/0.99 version >>>> of kylin but I was actually running hbase 1.1.1. So I downloaded the hbase >>>> 1.1.1 compatible kylin and ran the sample_cube build and it ran perfectly. >>>> So it finalise: >>>> >>>> Prerequisites: >>>> Hadoop -> 2.7.1 version used >>>> HBase -> 1.1.1 version used >>>> Zookeeper -> 3.4.6 version used >>>> Kylin -> 1.5.2.1 version used (HBase 1.x compatible) >>>> >>>> start HDFS -> YARN -> Zookeeper -> HBase -> Kylin >>>> >>>> On Wed, Jun 29, 2016 at 9:11 PM, Punit Naik < <[email protected]> >>>> [email protected]> wrote: >>>> >>>>> Hi >>>>> >>>>> I changed updated my Hive version to 1.2.1 and I am still getting the >>>>> same error: >>>>> >>>>> java.lang.reflect.InvocationTargetException >>>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>>> Method) >>>>> at >>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>> at >>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>>> Caused by: java.lang.IllegalArgumentException: File not exist by >>>>> 'kylin_metadata@hbase': >>>>> /home/user/fcstack/apache-kylin-1.5.2.1-bin/kylin_metadata@hbase >>>>> at >>>>> org.apache.kylin.common.persistence.FileResourceStore.<init>(FileResourceStore.java:49) >>>>> ... 13 more >>>>> 2016-06-29 21:08:14,819 ERROR [main] persistence.ResourceStore: Create >>>>> new store instance failed >>>>> java.lang.reflect.InvocationTargetException >>>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native >>>>> Method) >>>>> at >>>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) >>>>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:85) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>> at >>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>>> Caused by: java.lang.NoSuchMethodError: >>>>> org.apache.hadoop.hbase.client.HBaseAdmin.<init>(Lorg/apache/hadoop/hbase/client/HConnection;)V >>>>> at >>>>> org.apache.kylin.storage.hbase.HBaseConnection.createHTableIfNeeded(HBaseConnection.java:184) >>>>> at >>>>> org.apache.kylin.storage.hbase.HBaseResourceStore.createHTableIfNeeded(HBaseResourceStore.java:89) >>>>> at >>>>> org.apache.kylin.storage.hbase.HBaseResourceStore.<init>(HBaseResourceStore.java:85) >>>>> ... 13 more >>>>> Exception in thread "main" java.lang.IllegalArgumentException: Failed >>>>> to find metadata store by url: kylin_metadata@hbase >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.copy(ResourceTool.java:117) >>>>> at >>>>> org.apache.kylin.common.persistence.ResourceTool.main(ResourceTool.java:71) >>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>> at >>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>> at >>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>> at org.apache.hadoop.util.RunJar.main(RunJar.java:212) >>>>> 2016-06-29 21:08:14,824 INFO [Thread-2] >>>>> client.ConnectionManager$HConnectionImplementation: Closing zookeeper >>>>> sessionid=0x1559cce1b200007 >>>>> 2016-06-29 21:08:14,838 INFO [Thread-2] zookeeper.ZooKeeper: Session: >>>>> 0x1559cce1b200007 closed >>>>> 2016-06-29 21:08:14,839 INFO [main-EventThread] zookeeper.ClientCnxn: >>>>> EventThread shut down >>>>> >>>>> >>>>> Why is kylin trying to find that metadata file its its home folder? >>>>> >>>>> On Wed, Jun 29, 2016 at 5:24 PM, 王晓雨 < <[email protected]> >>>>> [email protected]> wrote: >>>>> >>>>>> Kylin1.3 and Kylin1.5 both has the HBase1.x version binary package >>>>>> If you are the first time to use Kylin and your env has Hadoop2.7.1 >>>>>> and HBase1.1.1, I suggest you to use Kylin1.5.2.1-HBase1.x version. >>>>>> This version is compile with Hadoop-2.7.1,HBase-1.1.1,Hive-1.2.1. >>>>>> So you can upgrade your hive to 1.2.1. it will work fine. >>>>>> >>>>>> 在 2016年6月29日，18:46，Punit Naik < <[email protected]> >>>>>> [email protected]> 写道： >>>>>> >>>>>> I updated my hbase from 0.98.2 to 1.1.1 but it gave the following >>>>>> error when I tried to start kylin or run the sample.sh file: >>>>>> >>>>>> Caused by: java.lang.IllegalArgumentException: Failed to find >>>>>> metadata store by url: kylin_metadata@hbase >>>>>> at >>>>>> org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:93) >>>>>> at >>>>>> org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:104) >>>>>> at >>>>>> org.apache.kylin.cube.CubeManager.getStore(CubeManager.java:880) >>>>>> at >>>>>> org.apache.kylin.cube.CubeManager.loadAllCubeInstance(CubeManager.java:814) >>>>>> at org.apache.kylin.cube.CubeManager.<init>(CubeManager.java:125) >>>>>> at >>>>>> org.apache.kylin.cube.CubeManager.getInstance(CubeManager.java:94) >>>>>> at >>>>>> org.apache.kylin.rest.service.CacheService.initCubeChangeListener(CacheService.java:79) >>>>>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >>>>>> at >>>>>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) >>>>>> at >>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>> at >>>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleElement.invoke(InitDestroyAnnotationBeanPostProcessor.java:346) >>>>>> at >>>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor$LifecycleMetadata.invokeInitMethods(InitDestroyAnnotationBeanPostProcessor.java:299) >>>>>> at >>>>>> org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:132) >>>>>> ... 53 more >>>>>> >>>>>> Can you help me on this? >>>>>> >>>>>> On Wed, Jun 29, 2016 at 3:41 PM, Punit Naik < >>>>>> <[email protected]>[email protected]> wrote: >>>>>> >>>>>>> Hi >>>>>>> >>>>>>> I will try that and get back to you. >>>>>>> >>>>>>> On Wed, Jun 29, 2016 at 3:33 PM, 王晓雨 < <[email protected]> >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Hi >>>>>>>> HBase 0.98 is depends hadoop 2.2 >>>>>>>> If you can upgrade HBase version to 1.x can fix this exception. >>>>>>>> if can’t upgrade HBase >>>>>>>> set >>>>>>>> kylin.job.yarn.app.rest.check.status.url= >>>>>>>> <http://your_rm_and_port/ws/v1/cluster/apps/$%7Bjob_id%7D?anonymous=true> >>>>>>>> <http://YOUR_RM_AND_PORT/ws/v1/cluster/apps/$> >>>>>>>> http://YOUR_RM_AND_PORT/ws/v1/cluster/apps/${job_id}?anonymous=true >>>>>>>> in $KYLIN_HOME/conf/kylin.properties >>>>>>>> ${job_id} will be auto replaced in kylin. >>>>>>>> >>>>>>>> 在 2016年6月29日，17:13，Punit Naik < <[email protected]> >>>>>>>> [email protected]> 写道： >>>>>>>> >>>>>>>> Hello >>>>>>>> >>>>>>>> I even upgraded Hadoop from 2.4.0 to 2.7.1 but still I get the same >>>>>>>> error. I have checked the source code and the method >>>>>>>> 'YarnConfiguration.getServiceAddressConfKeys' is already there and the >>>>>>>> parameter and the return types are proper. Why do I still get this >>>>>>>> error? >>>>>>>> >>>>>>>> On Wed, Jun 29, 2016 at 12:28 PM, Punit Naik < >>>>>>>> <[email protected]>[email protected]> wrote: >>>>>>>> >>>>>>>>> Hello >>>>>>>>> >>>>>>>>> I was building the sample_cube for kylin but it gave me the >>>>>>>>> following error at Step #2: >>>>>>>>> >>>>>>>>> java.lang.NoSuchMethodError: >>>>>>>>> org.apache.hadoop.yarn.conf.YarnConfiguration.getServiceAddressConfKeys(Lorg/apache/hadoop/conf/Configuration;)Ljava/util/List; >>>>>>>>> at >>>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfKeyForRMInstance(HAUtil.java:239) >>>>>>>>> at >>>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:250) >>>>>>>>> at >>>>>>>>> org.apache.hadoop.yarn.conf.HAUtil.getConfValueForRMInstance(HAUtil.java:262) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.common.MapReduceExecutable.getRestStatusCheckUrl(MapReduceExecutable.java:198) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:135) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107) >>>>>>>>> at >>>>>>>>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130) >>>>>>>>> at >>>>>>>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >>>>>>>>> at >>>>>>>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >>>>>>>>> at java.lang.Thread.run(Thread.java:745) >>>>>>>>> >>>>>>>>> >>>>>>>>> The Hadoop, HBase, Hive and Kylin versions that I am running are >>>>>>>>> 2.4.0, 0.98.2, 0.14 and 1.3.0 respectively. >>>>>>>>> >>>>>>>>> How do I fix this? >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Thank Yo >>>>>>>>> >>>>>>>>> Regards >>>>>>>>> >>>>>>>>> Punit Naik >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Thank You >>>>>>>> >>>>>>>> Regards >>>>>>>> >>>>>>>> Punit Naik >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Thank You >>>>>>> >>>>>>> Regards >>>>>>> >>>>>>> Punit Naik >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Thank You >>>>>> >>>>>> Regards >>>>>> >>>>>> Punit Naik >>>>>> >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> Thank You >>>>> >>>>> Regards >>>>> >>>>> Punit Naik >>>>> >>>> >>>> >>>> >>>> -- >>>> Thank You >>>> >>>> Regards >>>> >>>> Punit Naik >>>> >>> >>> >>> >>> -- >>> Thank You >>> >>> Regards >>> >>> Punit Naik >>> >>> >>> >> >> >> -- >> Thank You >> >> Regards >> >> Punit Naik >> >> >> > > > -- > Thank You > > Regards > > Punit Naik > -- Thank You Regards Punit Naik
