[
https://issues.apache.org/jira/browse/CLOUDSTACK-1269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13578730#comment-13578730
]
Marcus Sorensen commented on CLOUDSTACK-1269:
---------------------------------------------
Q: Marcus: which ASF 4.1 build have you been debugging with which does not
exhibit SSVM CPVM problem?
I don't know anything about ASF 4.1 builds, I just test/develop against HEAD on
the 4.1 branch, the latest.
Q: Does KVM host requires qemu-kvm rpm?
I think the cloudstack-agent rpm requires it, but otherwise as long as you have
the binary for it to call it should work. Do you see them starting via 'virsh
list', but they just are never accessible via network?
This is interesting: 2013-02-14 13:22:35,130 DEBUG
[kvm.discoverer.KvmServerDiscoverer] (catalina-exec-8:null) It's not a KVM
enabled machine
It looks like your KVM host does not have kvm kernel modules, either not loaded
or no hardware support for virtualization. I'm sorry, i thought you had a
running host you could deploy SSVM and CPVM to.
> Failed to start CPVM java.lang.NullPointerException Unable to start SSVM
> --------------------------------------------------------------------------
>
> Key: CLOUDSTACK-1269
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1269
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.1.0
> Environment: MS rhel6.3 10.223.195.114 build
> CloudStack-non-OSS-23-rhel6.3.tar.gz
> host rhel6.3 kvm 10.223.51.2 build
> CloudStack-non-OSS-23-rhel6.3.tar.gz
> 1. host installation:
> build CloudStack-non-OSS-23-rhel6.3.tar.gz contains old version
> qemu-img-0.12.1.2-3.209.el6.4.x86_64
> Due to 4.1 packaging, build does not have new qemu-img and qemu-kvm for
> testing kvm 6.3 snapshot
> manually replace qemu-img-0.12.1.2-3.209.el6.4.x86_64 with
> qemu-img-0.12.1.2-3.295.el6.4.x86_64
> manually install qemu-kvm-0.12.1.2-3.295.el6.4.x86_64
> as part of above , had to remove libvirt-0.9.10-21.el6.x86_64, download
> libvirt-0.9.10-21.el6.x86_64
> Here are some rpms that was reinstalled:
> 1975468 Feb 13 20:56 libvirt-0.9.10-21.el6.x86_64.rpm
> 1361029 Feb 13 20:32
> qemu-img-0.12.1.2-3.295.el6.10.x86_64.rpm
> 10878235 Feb 13 20:33
> qemu-kvm-0.12.1.2-3.295.el6.10.x86_64.rpm
> 375800 Feb 13 22:16 xnba-kvm-1.0.3-7.x86_64.rpm
> 2. create advance zone isolation mode.
> CPVM unable to start SSVM CPVM
> Reporter: angeline shen
> Assignee: Fang Wang
> Priority: Blocker
> Fix For: 4.1.0
>
> Attachments: management-server.log.gz, Screenshot-CloudStack -
> Mozilla Firefox.png
>
>
> 2013-02-13 17:10:25,656 DEBUG [agent.transport.Request]
> (AgentManager-Handler-12:null) Seq 1-1481768980: Processing: { Ans: ,
> MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110,
> [{"Answer":{"result":false,"details":"java.lang.Nul
> lPointerException\n\tat
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat
>
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(Libvirt
> ComputingResource.java:2983)\n\tat
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat
>
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtCompu
> tingResource.java:1163)\n\tat
> com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat
> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat java.util.concurrent.
> ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
>
> java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":false,"
> details":"Stopped by previous failure","wait":0}}] }
> 2013-02-13 17:10:25,657 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1481768980: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1,
> Flags: 110, { Answer, Answer } }
> 2013-02-13 17:10:25,657 DEBUG [agent.manager.AgentAttache]
> (AgentManager-Handler-12:null) Seq 1-1481768981: Sending now. is current
> sequence.
> 2013-02-13 17:10:25,662 ERROR [cloud.vm.VirtualMachineManagerImpl]
> (secstorage-1:null) Failed to start instance VM[SecondaryStorageVm|s-1-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is
> of class com.cloud.agent.api.StartAnswer
> at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
> at
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:777)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:466)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:459)
> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
> at
> com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:43)
> at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at
> org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
> at
> org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
> at
> org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
> at
> com.cloud.storage.secondary.SecondaryStorageManagerImpl.startSecStorageVm(SecondaryStorageManagerImpl.java:264)
> at
> com.cloud.storage.secondary.SecondaryStorageManagerImpl.allocCapacity(SecondaryStorageManagerImpl.java:689)
> at
> com.cloud.storage.secondary.SecondaryStorageManagerImpl.expandPool(SecondaryStorageManagerImpl.java:1300)
> at
> com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:121)
> at
> com.cloud.secstorage.PremiumSecondaryStorageManagerImpl.scanPool(PremiumSecondaryStorageManagerImpl.java:52)
> at
> com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:104)
> at
> com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33)
> at
> com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81)
> at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> 2013-02-13 17:10:25,667 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (secstorage-1:null) Cleaning up resources for the vm
> VM[SecondaryStorageVm|s-1-VM] in Starting state
> 2013-02-13 17:10:25,668 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1481768983: Waiting for Seq 1481768981 Scheduling: { Cmd , MgmtId:
> 6809771312912, via: 1, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,
> "vmName":"s-1-VM","wait":0}}] }
> 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null)
> ===START=== 10.216.133.70 -- POST
> command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D
> 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl]
> (catalina-exec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by
> DomainChecker
> 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl]
> (catalina-exec-10:null) Created security group
> 2013-02-13 17:10:35,133 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null)
> ===START=== 10.216.133.70 -- POST
> command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D
> 2013-02-13 17:10:35,154 DEBUG [cloud.user.AccountManagerImpl]
> (catalina-exec-10:null) Access granted to Acct[2-admin] to Domain:2/d1/ by
> DomainChecker
> 2013-02-13 17:10:35,161 DEBUG [network.security.SecurityGroupManagerImpl]
> (catalina-exec-10:null) Created security group
> com.cloud.network.security.SecurityGroupVO$$EnhancerByCGLIB$$53628a27@753f827a
> for account id=4
> 2013-02-13 17:10:35,163 DEBUG [cloud.user.AccountManagerImpl]
> (catalina-exec-10:null) Creating user: d1domain, accountId: 4
> timezone:America/Los_Angeles
> 2013-02-13 17:10:35,324 DEBUG [cloud.api.ApiServlet] (catalina-exec-10:null)
> ===END=== 10.216.133.70 -- POST
> command=createAccount&response=json&sessionkey=ZPNnO6ZVMdSYISIfi%2FUga%2FM9H9A%3D
> 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request]
> (AgentManager-Handler-13:null) Seq 1-1481768981: Processing: { Ans: ,
> MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110,
> [{"Answer":{"result":false,"details":"java.lang.NullPointerException\n\tat
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.cleanupVMNetworks(LibvirtComputingResource.java:4214)\n\tat
>
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.handleVmStartFailure(LibvirtComputingResource.java:2983)\n\tat
>
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.execute(LibvirtComputingResource.java:3107)\n\tat
>
> com.cloud.hypervisor.kvm.resource.LibvirtComputingResource.executeRequest(LibvirtComputingResource.java:1163)\n\tat
> com.cloud.agent.Agent.processRequest(Agent.java:525)\n\tat
> com.cloud.agent.Agent$AgentRequestHandler.doTask(Agent.java:852)\n\tat
> com.cloud.utils.nio.Task.run(Task.java:83)\n\tat
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\n\tat
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\n\tat
>
> java.lang.Thread.run(Thread.java:679)\n","wait":0}},{"Answer":{"result":false,"details":"Stopped
> by previous failure","wait":0}}] }
> 2013-02-13 17:10:36,326 DEBUG [agent.manager.AgentAttache]
> (AgentManager-Handler-13:null) Seq 1-1481768983: Sending now. is current
> sequence.
> 2013-02-13 17:10:36,326 DEBUG [agent.transport.Request] (consoleproxy-1:null)
> Seq 1-1481768981: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1,
> Flags: 110, { Answer, Answer } }
> 2013-02-13 17:10:36,339 ERROR [cloud.vm.VirtualMachineManagerImpl]
> (consoleproxy-1:null) Failed to start instance VM[ConsoleProxy|v-2-VM]
> com.cloud.utils.exception.CloudRuntimeException: Unable to get answer that is
> of class com.cloud.agent.api.StartAnswer
> at com.cloud.agent.manager.Commands.getAnswer(Commands.java:80)
> at
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:777)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:466)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:459)
> at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)
> at
> org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
> at
> org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:80)
> at
> com.cloud.utils.db.TransactionContextBuilder.AroundAnyMethod(TransactionContextBuilder.java:43)
> at sun.reflect.GeneratedMethodAccessor35.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:616)
> at
> org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:621)
> at
> org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:610)
> at
> org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:65)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)
> at
> org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
> at
> org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622)
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.startProxy(ConsoleProxyManagerImpl.java:630)
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.allocCapacity(ConsoleProxyManagerImpl.java:1164)
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:1960)
> at
> com.cloud.consoleproxy.ConsoleProxyManagerImpl.expandPool(ConsoleProxyManagerImpl.java:174)
> at
> com.cloud.vm.SystemVmLoadScanner.loadScan(SystemVmLoadScanner.java:111)
> at
> com.cloud.vm.SystemVmLoadScanner.access$100(SystemVmLoadScanner.java:33)
> at
> com.cloud.vm.SystemVmLoadScanner$1.reallyRun(SystemVmLoadScanner.java:81)
> at com.cloud.vm.SystemVmLoadScanner$1.run(SystemVmLoadScanner.java:72)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at
> java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:351)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:178)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:165)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:267)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> 2013-02-13 17:10:36,343 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (consoleproxy-1:null) Cleaning up resources for the vm
> VM[ConsoleProxy|v-2-VM] in Starting state
> 2013-02-13 17:10:36,344 DEBUG [agent.transport.Request] (consoleproxy-1:null)
> Seq 1-1481768984: Waiting for Seq 1481768983 Scheduling: { Cmd , MgmtId:
> 6809771312912, via: 1, Ver: v1, Flags: 100111,
> [{"StopCommand":{"isProxy":false,"vmName":"v-2-VM","wait":0}}] }
> 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request]
> (AgentManager-Handler-14:null) Seq 1-1481768983: Processing: { Ans: ,
> MgmtId: 6809771312912, via: 1, Ver: v1, Flags: 110,
> [{"StopAnswer":{"vncPort":0,"result":true,"wait":0}}] }
> 2013-02-13 17:10:36,395 DEBUG [agent.manager.AgentAttache]
> (AgentManager-Handler-14:null) Seq 1-1481768984: Sending now. is current
> sequence.
> 2013-02-13 17:10:36,395 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1481768983: Received: { Ans: , MgmtId: 6809771312912, via: 1, Ver: v1,
> Flags: 110, { StopAnswer } }
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
