[ https://issues.apache.org/jira/browse/CLOUDSTACK-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13568270#comment-13568270 ]
Sangeetha Hariharan commented on CLOUDSTACK-1108: ------------------------------------------------- As part of restartNetworks , i see the router being destroyed and is in "Expunging" state in DB. I am not able to get a router to be created from this network by either starting a new VM / by attmepting a restartNetwork gain. In both cases , I see the following exception : 2013-02-01 00:02:20,090 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-19:job-27) Determining why we're unable to update the st ate to Starting for VM[DomainRouter|r-7-VM]. Retry=0 2013-02-01 00:02:20,091 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-19:job-27) Unable to find work for VM: VM[DomainRouter|r -7-VM] and state: Expunging 2013-02-01 00:02:20,091 ERROR [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-19:job-27) Failed to start instance VM[User|afterRoyerDo wn] com.cloud.utils.exception.CloudRuntimeException: Unable to start a VM due to concurrent operation at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:477) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.start(VirtualNetworkApplianceManagerImpl.java:2463) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startVirtualRouter(VirtualNetworkApplianceManagerImpl.java:1693) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.startRouters(VirtualNetworkApplianceManagerImpl.java:1793) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1771) at com.cloud.network.element.VirtualRouterElement.prepare(VirtualRouterElement.java:206) at com.cloud.network.NetworkManagerImpl.prepareElement(NetworkManagerImpl.java:1603) at com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:1720) at com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:1661) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:755) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:475) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2876) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2544) at com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2532) at com.cloud.event.ActionEventCallback.intercept(ActionEventCallback.java:36) at com.cloud.api.commands.DeployVMCmd.execute(DeployVMCmd.java:330) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:168) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:433) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) at java.lang.Thread.run(Thread.java:679) Caused by: com.cloud.exception.ConcurrentOperationException: Unable to change the state of VM[DomainRouter|r-7-VM] at com.cloud.vm.VirtualMachineManagerImpl.changeToStartState(VirtualMachineManagerImpl.java:579) at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) at com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:615) at com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:475) ... 27 more 2013-02-01 00:02:20,102 DEBUG [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-19:job-27) Cleaning up resources for the vm VM[User|afterRoyerDown] in Starting state 2013-02-01 00:02:20,103 DEBUG [agent.transport.Request] (J > Ipv6 - Not able to restart Networks. > ------------------------------------ > > Key: CLOUDSTACK-1108 > URL: https://issues.apache.org/jira/browse/CLOUDSTACK-1108 > Project: CloudStack > Issue Type: Bug > Security Level: Public(Anyone can view this level - this is the > default.) > Components: Management Server > Affects Versions: 4.1.0 > Environment: Latest build from networkrefactor branch. > Reporter: Sangeetha Hariharan > Assignee: Sheng Yang > Fix For: 4.1.0 > > > Create a Ipv6 network. > Deploy few Vms in this network. > Restart this network with cleanup option. This fails. > 2013-01-31 23:52:55,341 INFO [cloud.api.ApiServer] (catalina-exec-13:null) > (userId=2 accountId=2 sessionId=15E1EE3BB246B890356119483E4443A3) > 10.217.252.59 -- GET > command=restartNetwork&id=8bf309d8-8772-4542-a45c-a81dc57050e7&cleanup=true&response=json&sessionkey=2lbI7S08%2BJ57eJfiehe%2FFSPSL6o%3D&_=1359676422758 > 200 { "restartnetworkresponse" : > {"jobid":"ad1e0ac5-a9bf-426d-b4c4-dd4cd3a221b8"} } > 2013-01-31 23:53:00,437 INFO [cloud.api.ApiServer] (catalina-exec-18:null) > (userId=2 accountId=2 sessionId=15E1EE3BB246B890356119483E4443A3) > 10.217.252.59 -- GET > command=queryAsyncJobResult&jobId=ad1e0ac5-a9bf-426d-b4c4-dd4cd3a221b8&response=json&sessionkey=2lbI7S08%2BJ57eJfiehe%2FFSPSL6o%3D&_=1359676427958 > 200 { "queryasyncjobresultresponse" : > {"accountid":"b0e2f19c-9829-4623-98e6-df32f0a8fc8e","userid":"9428ad84-9a9b-441c-b788-58ade8e73039","cmd":"com.cloud.api.commands.RestartNetworkCmd","jobstatus":2,"jobprocstatus":0,"jobresultcode":530,"jobresulttype":"object","jobresult":{"errorcode":530,"errortext":"Failed > to restart > network"},"created":"2013-01-31T23:52:55-0800","jobid":"ad1e0ac5-a9bf-426d-b4c4-dd4cd3a221b8"} > } > Following exception seen in management server logs: > 2013-01-31 23:53:00,132 WARN [cloud.network.NetworkManagerImpl] > (Job-Executor-18:job-26) Unable to complete shutdown of the network elements > due to element: VirtualRouter > java.lang.ClassCastException: java.lang.Long cannot be cast to > java.lang.String > at > com.cloud.utils.db.GenericDaoBase.prepareAttribute(GenericDaoBase.java:1397) > at com.cloud.utils.db.GenericDaoBase.expunge(GenericDaoBase.java:1104) > at > com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) > at com.cloud.utils.db.GenericDaoBase.remove(GenericDaoBase.java:1663) > at > com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) > at > com.cloud.network.guru.DirectNetworkGuru.deallocate(DirectNetworkGuru.java:235) > at > com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) > at > com.cloud.network.NetworkManagerImpl.removeNic(NetworkManagerImpl.java:1838) > at > com.cloud.network.NetworkManagerImpl.cleanupNics(NetworkManagerImpl.java:1822) > at > com.cloud.vm.VirtualMachineManagerImpl.advanceExpunge(VirtualMachineManagerImpl.java:402) > at > com.cloud.vm.VirtualMachineManagerImpl.expunge(VirtualMachineManagerImpl.java:356) > at > com.cloud.network.router.VirtualNetworkApplianceManagerImpl.destroyRouter(VirtualNetworkApplianceManagerImpl.java:387) > at > com.cloud.network.element.VirtualRouterElement.shutdown(VirtualRouterElement.java:625) > at > com.cloud.network.NetworkManagerImpl.shutdownNetworkElementsAndResources(NetworkManagerImpl.java:2206) > at > com.cloud.network.NetworkManagerImpl.restartNetwork(NetworkManagerImpl.java:2510) > at > com.cloud.network.NetworkServiceImpl.restartNetwork(NetworkServiceImpl.java:1418) > at > com.cloud.event.ActionEventCallback.intercept(ActionEventCallback.java:36) > at > com.cloud.api.commands.RestartNetworkCmd.execute(RestartNetworkCmd.java:93) > at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:168) > at > com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:433) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:679) > 2013-01-31 23:53:00,133 DEBUG [cloud.network.NetworkManagerImpl] > (Job-Executor-18:job-26) Failed to shutdown the network elements and > resources as a part of network restart: Setup -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira