[ https://issues.apache.org/jira/browse/CLOUDSTACK-209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465553#comment-13465553 ]
Abhinav Roy commented on CLOUDSTACK-209: ---------------------------------------- I tried again as per the instructions given by Rohit. MS -------------- 1. upgraded the management server. 2. Tried to re-install the cloud-scripts package, but since that package is already installed , it couldn't be installed again. 3. Because of step 2, uninstalled (yum remove) cloud-scripts, with this the 2 other dependencies are uninstalled, cloud-client and cloud-client-ui. 4. Now installed cloud-scripts , cloud-client and cloud-client-ui again. (yum install ****) 5. After this i cloud see all the scripts present in /usr/lib64/cloud/agent/scripts/vm/systemvm folder. HOST -------------- 1. upgraded the agent. 2. Tried to re-install the cloud-scripts package, but since that package is already installed , it couldn't be installed again. 3. Because of step 2, uninstalled (yum remove) cloud-scripts, with this the 1 other dependency is uninstalled, cloud-agent. 4. Now installed cloud-scripts and cloud-agent again. ------------------------ started the agent started the management server. But again i get a exception, a different one this time 2012-09-28 16:46:23,219 INFO [utils.component.ComponentLocator] (main:null) Adding system integrity checker: DatabaseUpgradeChecker 2012-09-28 16:46:23,279 DEBUG [utils.crypt.EncryptionSecretKeyChecker] (main:null) Encryption Type: none 2012-09-28 16:46:23,398 INFO [cloud.upgrade.DatabaseIntegrityChecker] (main:null) Grabbing lock to check for database integrity. 2012-09-28 16:46:27,542 ERROR [db.Transaction.Transaction] (main:null) Unexpected exception: com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: Could not create connection to database server. Attempted reconnect 3 times. Giving up. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:532) at com.mysql.jdbc.Util.handleNewInstance(Util.java:409) at com.mysql.jdbc.Util.getInstance(Util.java:384) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1015) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:989) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:984) at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:929) at com.mysql.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:2412) at com.mysql.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:787) at com.mysql.jdbc.JDBC4Connection.<init>(JDBC4Connection.java:49) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:532) at com.mysql.jdbc.Util.handleNewInstance(Util.java:409) at com.mysql.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:357) at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:285) at java.sql.DriverManager.getConnection(DriverManager.java:620) at java.sql.DriverManager.getConnection(DriverManager.java:200) at org.apache.commons.dbcp.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:48) at org.apache.commons.dbcp.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:290) at org.apache.commons.pool.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:840) at org.apache.commons.dbcp.PoolingDataSource.getConnection(PoolingDataSource.java:95) at com.cloud.utils.db.Transaction.getStandaloneConnectionWithException(Transaction.java:200) at com.cloud.utils.db.Transaction.getStandaloneConnection(Transaction.java:209) at com.cloud.utils.db.DbUtil.getConnectionForGlobalLocks(DbUtil.java:58) at com.cloud.utils.db.DbUtil.getGlobalLock(DbUtil.java:203) at com.cloud.utils.db.GlobalLock.lock(GlobalLock.java:151) at com.cloud.upgrade.DatabaseIntegrityChecker.check(DatabaseIntegrityChecker.java:228) at com.cloud.utils.component.ComponentLocator.runCheckers(ComponentLocator.java:273) at com.cloud.utils.component.ComponentLocator.parse(ComponentLocator.java:245) at com.cloud.utils.component.ComponentLocator.getLocatorInternal(ComponentLocator.java:836) at com.cloud.utils.component.ComponentLocator.getLocator(ComponentLocator.java:874) at com.cloud.utils.component.ComponentLocator.getComponent(ComponentLocator.java:416) at com.cloud.utils.component.ComponentLocator.getComponent(ComponentLocator.java:409) at com.cloud.servlet.CloudStartupServlet.init(CloudStartupServlet.java:44) at javax.servlet.GenericServlet.init(GenericServlet.java:212) at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173) at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:993) at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4187) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4496) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1041) at org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964) at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502) at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at org.apache.catalina.core.StandardHost.start(StandardHost.java:722) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443) at org.apache.catalina.core.StandardService.start(StandardService.java:516) at org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at org.apache.catalina.startup.Catalina.start(Catalina.java:593) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) Caused by: java.sql.SQLException: Access denied for user 'root'@'localhost' (using password: NO) ... 65 more 2012-09-28 16:46:27,548 ERROR [utils.db.DbUtil] (main:null) Unable to acquire DB connection for global lock system 2012-09-28 16:46:27,549 ERROR [utils.component.ComponentLocator] (main:null) Problems with running checker:DatabaseIntegrityChecker com.cloud.utils.exception.CloudRuntimeException: Unable to acquire lock to check for database integrity. at com.cloud.upgrade.DatabaseIntegrityChecker.check(DatabaseIntegrityChecker.java:229) at com.cloud.utils.component.ComponentLocator.runCheckers(ComponentLocator.java:273) at com.cloud.utils.component.ComponentLocator.parse(ComponentLocator.java:245) at com.cloud.utils.component.ComponentLocator.getLocatorInternal(ComponentLocator.java:836) at com.cloud.utils.component.ComponentLocator.getLocator(ComponentLocator.java:874) at com.cloud.utils.component.ComponentLocator.getComponent(ComponentLocator.java:416) at com.cloud.utils.component.ComponentLocator.getComponent(ComponentLocator.java:409) at com.cloud.servlet.CloudStartupServlet.init(CloudStartupServlet.java:44) at javax.servlet.GenericServlet.init(GenericServlet.java:212) at org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173) at org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:993) at org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4187) at org.apache.catalina.core.StandardContext.start(StandardContext.java:4496) at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791) at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771) at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1041) at org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964) at org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502) at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) at org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321) at org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) at org.apache.catalina.core.StandardHost.start(StandardHost.java:722) at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) at org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443) at org.apache.catalina.core.StandardService.start(StandardService.java:516) at org.apache.catalina.core.StandardServer.start(StandardServer.java:710) at org.apache.catalina.startup.Catalina.start(Catalina.java:593) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:616) at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) > Upgrade from CS-3.0.2 to ASF 4.0 fails with > com.cloud.utils.exception.CloudRuntimeException: Unable to find key inject > script scripts/vm/systemvm/injectkeys.sh > --------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: CLOUDSTACK-209 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-209 > Project: CloudStack > Issue Type: Bug > Components: Install and Setup, Management Server > Affects Versions: pre-4.0.0 > Environment: MS : Rhel 6.2 > HOST : KVM ( Rhel 6.2) > BUILDS : > CS-3.0.2 - CloudStack-3.0.2-1-rhel6.2.tar.gz > ASF 4.0 - CloudStack-oss-4.0.0-187.tar.bz2 > Reporter: Abhinav Roy > Assignee: Rohit Yadav > Priority: Blocker > Fix For: pre-4.0.0 > > Attachments: agent.log, api-server.log, management-server.log, > SQL_09_26.dmp > > > Steps : > ============================== > 1. Deploy an advanced zone setup with CS-3.0.2 and KVM host (Rhel 6.2) > 2. Create a VM instance. > 3. Stop Management server. > 4. Upgrade to ASF 4.0 > 5. Stop agent services on the host. > 6. Upgrade to ASF 4.0 > 7. Start agent on the host. > 8. Start management server services. > Expected Behaviour : > ============================== > The upgrade should happen smoothly without any error. > Observed Behaviour : > ============================== > 1. After executing above steps, following exception is seen in the logs > 2012-09-26 17:44:41,571 DEBUG [utils.script.Script] (main:null) Looking > for scripts/vm/systemvm/injectkeys.sh in > /var/lib/cloud/management/./scripts/vm/systemvm/injectkeys.sh > 2012-09-26 17:44:41,571 DEBUG [utils.script.Script] (main:null) Looking for > scripts/vm/systemvm/injectkeys.sh in > /var/lib/cloud/management/./scripts/vm/systemvm/injectkeys.sh > 2012-09-26 17:44:41,571 WARN [utils.script.Script] (main:null) Unable to > find script scripts/vm/systemvm/injectkeys.sh > 2012-09-26 17:44:41,574 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in the classpath > 2012-09-26 17:44:41,574 DEBUG [utils.script.Script] (main:null) System > resource: null > 2012-09-26 17:44:41,575 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso > 2012-09-26 17:44:41,575 DEBUG [utils.script.Script] (main:null) Current > binaries reside at /usr/share/java > 2012-09-26 17:44:41,575 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/share/java/vms/systemvm.iso > 2012-09-26 17:44:41,575 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/share/java/vms/systemvm.iso > 2012-09-26 17:44:41,575 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/share/vms/systemvm.iso > 2012-09-26 17:44:41,576 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/vms/systemvm.iso > 2012-09-26 17:44:41,576 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /vms/systemvm.iso > 2012-09-26 17:44:41,576 DEBUG [utils.script.Script] (main:null) Searching in > environment.properties > 2012-09-26 17:44:41,576 DEBUG [utils.script.Script] (main:null) > environment.properties says scripts should be in /usr/lib64/cloud/common > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/lib64/cloud/common/vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/lib64/cloud/common/vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/lib64/cloud/vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/lib64/vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /usr/vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /vms/systemvm.iso > 2012-09-26 17:44:41,578 DEBUG [utils.script.Script] (main:null) Searching in > the current directory > 2012-09-26 17:44:41,579 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /var/lib/cloud/management/./vms/systemvm.iso > 2012-09-26 17:44:41,579 DEBUG [utils.script.Script] (main:null) Looking for > vms/systemvm.iso in /var/lib/cloud/management/./vms/systemvm.iso > 2012-09-26 17:44:41,579 WARN [utils.script.Script] (main:null) Unable to > find script vms/systemvm.iso > 2012-09-26 17:44:41,582 ERROR [cloud.servlet.CloudStartupServlet] (main:null) > Exception starting management server > com.cloud.utils.exception.CloudRuntimeException: Unable to find key inject > script scripts/vm/systemvm/injectkeys.sh > at > com.cloud.server.ConfigurationServerImpl.updateKeyPairs(ConfigurationServerImpl.java:675) > at > com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) > at > com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:265) > at > com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) > at > com.cloud.servlet.CloudStartupServlet.init(CloudStartupServlet.java:47) > at javax.servlet.GenericServlet.init(GenericServlet.java:212) > at > org.apache.catalina.core.StandardWrapper.loadServlet(StandardWrapper.java:1173) > at > org.apache.catalina.core.StandardWrapper.load(StandardWrapper.java:993) > at > org.apache.catalina.core.StandardContext.loadOnStartup(StandardContext.java:4187) > at > org.apache.catalina.core.StandardContext.start(StandardContext.java:4496) > at > org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:791) > at > org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:771) > at > org.apache.catalina.core.StandardHost.addChild(StandardHost.java:526) > at > org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1041) > at > org.apache.catalina.startup.HostConfig.deployDirectories(HostConfig.java:964) > at > org.apache.catalina.startup.HostConfig.deployApps(HostConfig.java:502) > at org.apache.catalina.startup.HostConfig.start(HostConfig.java:1277) > at > org.apache.catalina.startup.HostConfig.lifecycleEvent(HostConfig.java:321) > at > org.apache.catalina.util.LifecycleSupport.fireLifecycleEvent(LifecycleSupport.java:119) > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1053) > at org.apache.catalina.core.StandardHost.start(StandardHost.java:722) > at > org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045) > at > org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443) > at > org.apache.catalina.core.StandardService.start(StandardService.java:516) > at > org.apache.catalina.core.StandardServer.start(StandardServer.java:710) > at org.apache.catalina.startup.Catalina.start(Catalina.java:593) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > at > sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) > at java.lang.reflect.Method.invoke(Method.java:616) > at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289) > at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414) > 2. This exception I feel is because of the change in script paths recently > and is independent of the host hypervisor. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira