manasaveloori created CLOUDSTACK-6573:
-----------------------------------------
Summary: Multiple exceptions after upgrading from 4.3 to 4.4
Key: CLOUDSTACK-6573
URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6573
Project: CloudStack
Issue Type: Bug
Security Level: Public (Anyone can view this level - this is the default.)
Components: Upgrade
Affects Versions: 4.4.0
Environment: upgrade from 4.3 to 4.4
Reporter: manasaveloori
Priority: Blocker
Fix For: 4.4.0
1. Deploy CS 4.3 with 2 zones using xen 6.1 and KVM hypervisor.
2. Configured LB rules,firewall rules.
3. Registered the template for 4.4 (using the naming convention
systemvm-xenserver-4.4,systemvm-kvm-4.4)
4. Upgraded to 4.4
Start the management server:
Below are the observations:
Issue1:
2014-05-05 05:04:17,699 INFO [c.c.s.ConfigurationServerImpl] (main:null) SSL
keystore located at /etc/cloudstack/management/cloud.keystore
2014-05-05 05:04:17,712 DEBUG [c.c.u.s.Script] (main:null) Executing: sudo
keytool -genkey -keystore /etc/cloudstack/management/cloud.keystore -storepass
vmops.com -keypass vmops.com -keyalg RSA -validity 3650 -dname cn="Cloudstack
User",ou="RHEL63test",o="RHEL63test",c="Unknown"
2014-05-05 05:04:17,947 DEBUG [c.c.u.s.Script] (main:null) Exit value is 1
2014-05-05 05:04:17,948 DEBUG [c.c.u.s.Script] (main:null) sudo: no tty present
and no askpass program specified
2014-05-05 05:04:17,950 WARN [c.c.s.ConfigurationServerImpl] (main:null) Would
use fail-safe keystore to continue.
java.io.IOException: Fail to generate certificate!: sudo: no tty present and no
askpass program specified
at
com.cloud.server.ConfigurationServerImpl.generateDefaultKeystore(ConfigurationServerImpl.java:595)
at
com.cloud.server.ConfigurationServerImpl.updateSSLKeystore(ConfigurationServerImpl.java:623)
at
com.cloud.server.ConfigurationServerImpl.persistDefaultValues(ConfigurationServerImpl.java:299)
at
com.cloud.server.ConfigurationServerImpl.configure(ConfigurationServerImpl.java:164)
at
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle$3.with(CloudStackExtendedLifeCycle.java:114)
at
org.apache.cloudstack.spring.lifecycle.CloudStackExtendedLifeCycle.with(CloudStackExtendedLifeCycle.java:153)
Issue 2:
2014-05-05 05:05:13,567 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-e36f20e1) AutoScaling Monitor is running...
2014-05-05 05:05:13,577 ERROR [c.c.s.StatsCollector]
(StatsCollector-4:ctx-e36f20e1) Error trying to monitor autoscaling
com.cloud.utils.exception.CloudRuntimeException: DB Exception on:
com.mysql.jdbc.JDBC4PreparedStatement@5b140551: SELECT autoscale_vmgroups.id,
autoscale_vmgroups.uuid, autoscale_vmgroups.zone_id,
autoscale_vmgroups.domain_id, autoscale_vmgroups.account_id,
autoscale_vmgroups.load_balancer_id, autoscale_vmgroups.min_members,
autoscale_vmgroups.max_members, autoscale_vmgroups.member_port,
autoscale_vmgroups.interval, autoscale_vmgroups.last_interval,
autoscale_vmgroups.profile_id, autoscale_vmgroups.removed,
autoscale_vmgroups.created, autoscale_vmgroups.state,
autoscale_vmgroups.display FROM autoscale_vmgroups WHERE
autoscale_vmgroups.removed IS NULL
at
com.cloud.utils.db.GenericDaoBase.executeList(GenericDaoBase.java:1127)
at com.cloud.utils.db.GenericDaoBase.listAll(GenericDaoBase.java:1150)
at com.cloud.utils.db.GenericDaoBase.listAll(GenericDaoBase.java:1136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.utils.db.TransactionContextInterceptor.invoke(TransactionContextInterceptor.java:34)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy220.listAll(Unknown Source)
at
com.cloud.server.StatsCollector$AutoScaleMonitor.runInContext(StatsCollector.java:673)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: Unknown
column 'autoscale_vmgroups.last_interval' in 'field list'
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at com.mysql.jdbc.Util.handleNewInstance(Util.java:411)
at com.mysql.jdbc.Util.getInstance(Util.java:386)
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:1052)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3597)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3529)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1990)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2151)
at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2625)
at
com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:2119)
at
com.mysql.jdbc.PreparedStatement.executeQuery(PreparedStatement.java:2283)
at
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
at
org.apache.commons.dbcp.DelegatingPreparedStatement.executeQuery(DelegatingPreparedStatement.java:96)
at
com.cloud.utils.db.GenericDaoBase.executeList(GenericDaoBase.java:1121)
... 28 more
Issue3:
Login the UI
Found below exception:
2014-05-05 05:10:27,789 ERROR [c.c.a.ApiServer] (catalina-exec-19:ctx-738d7732
ctx-f31c0a20) unhandled exception executing api command:
[Ljava.lang.String;@4cc0a048
com.cloud.utils.exception.CloudRuntimeException: Failed to find any private
zone for Resource domain admin.
at
com.cloud.user.AccountManagerImpl.getZoneIdForAccount(AccountManagerImpl.java:599)
at
com.cloud.user.AccountManagerImpl.checkAccessAndSpecifyAuthority(AccountManagerImpl.java:581)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy100.checkAccessAndSpecifyAuthority(Unknown
Source)
at
com.cloud.server.ManagementServerImpl.searchForAlerts(ManagementServerImpl.java:2333)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy234.searchForAlerts(Unknown Source)
at
org.apache.cloudstack.api.command.admin.resource.ListAlertsCmd.execute(ListAlertsCmd.java:81)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:119)
at com.cloud.api.ApiServer.queueCommand(ApiServer.java:591)
at com.cloud.api.ApiServer.handleRequest(ApiServer.java:414)
at com.cloud.api.ApiServlet.processRequestInContext(ApiServlet.java:330)
at com.cloud.api.ApiServlet.access$000(ApiServlet.java:54)
at com.cloud.api.ApiServlet$1.run(ApiServlet.java:118)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at com.cloud.api.ApiServlet.processRequest(ApiServlet.java:115)
at com.cloud.api.ApiServlet.doGet(ApiServlet.java:77)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:617)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:555)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at
org.apache.coyote.http11.Http11NioProcessor.process(Http11NioProcessor.java:889)
at
org.apache.coyote.http11.Http11NioProtocol$Http11ConnectionHandler.process(Http11NioProtocol.java:721)
at
org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:2274)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
2014-05-05 05:10:27,793 DEBUG [c.c.u.AccountManagerImpl]
(catalina-exec-19:ctx-738d7732 ctx-f31c0a20) Root Access granted to
Acct[d4cd5700-d1bd-11e3-b35b-06fa660000c6-admin] by AffinityGroupAccessChecker
APIs are failing to list PODs,clusters..
Attaching the Ms logs:
--
This message was sent by Atlassian JIRA
(v6.2#6252)
