HI ALL 碰到一个难题,系统路由器消失不见了,重启网络 提示fail to restart network ,导致 创建的虚拟机一直不能自动分配IP,求如何处理方法。。先谢谢了。
root@manager ~]# tailf /usr/share/cloud/management/logs/management-server.log |grep -v 192.168 |grep -v Asking 2014-03-06 18:25:32,872 WARN [cloud.api.ApiDispatcher] (Job-Executor-102:job-535) class com.cloud.api.ServerApiException : Failed to restart network 2014-03-06 18:25:32,872 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-102:job-535) Complete async job-535, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to restart network 2014-03-06 18:25:33,006 DEBUG [cloud.async.SyncQueueManagerImpl] (Job-Executor-102:job-535) Sync queue (1) is currently empty 2014-03-06 18:25:33,013 WARN [cloud.async.AsyncJobManagerImpl] (Job-Executor-102:job-535) Unable to unregister active job 535 from JMX monitoring 2014-03-06 18:25:37,530 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-11:null) Async job-535 completed 2014-03-06 18:25:42,172 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2014-03-06 18:25:42,259 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] (consoleproxy-1:null) Zone 1 is ready to launch console proxy 2014-03-06 18:25:42,932 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (RouterStatusMonitor-1:null) Found 0 routers. 2014-03-06 18:25:51,157 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-460:null) Ping from 56 2014-03-06 18:25:52,120 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-412:null) Seq 56-1534525442: Executing request 2014-03-06 18:25:52,602 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-412:null) Seq 56-1534525442: Response Received: 2014-03-06 18:25:52,603 DEBUG [agent.transport.Request] (DirectAgent-412:null) Seq 56-1534525442: Processing: { Ans: , MgmtId: 690716573693, via: 56, Ver: v1, Flags: 10, [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"r esult":true,"wait":0}}] } 2014-03-06 18:25:55,664 DEBUG [cloud.server.StatsCollector] (StatsCollector-2:null) VmStatsCollector is running... 2014-03-06 18:25:55,703 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-406:null) Seq 56-1534532114: Executing request 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 4.42 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 3.32 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 86.85499999999999 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 5.15 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 5.155 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 5.695 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 4.665 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 5.075 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 5.8500000000000005 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 4.825 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 4.62 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 86.80499999999999 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 2.875 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 0.02 2014-03-06 18:25:56,136 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-406:null) Vm cpu utilization 4.39 2014-03-06 18:25:56,137 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-406:null) Seq 56-1534532114: Response Received: 2014-03-06 18:25:56,137 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 56-1534532114: Received: { Ans: , MgmtId: 690716573693, via: 56, Ver: v1, Flags: 10, { GetVmStatsAnswer } } 2014-03-06 18:25:56,149 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-480:null) Seq 65-598478431: Executing request 2014-03-06 18:25:56,420 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-480:null) Vm cpu utilization 0.18999999999999997 2014-03-06 18:25:56,420 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-480:null) Vm cpu utilization 2.65 2014-03-06 18:25:56,420 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-480:null) Vm cpu utilization 3.575 2014-03-06 18:25:56,420 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-480:null) Vm cpu utilization 2.63 2014-03-06 18:25:56,420 DEBUG [xen.resource.CitrixResourceBase] (DirectAgent-480:null) Vm cpu utilization 2.63 2014-03-06 18:25:56,420 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-480:null) Seq 65-598478431: Response Received: 2014-03-06 18:25:56,420 DEBUG [agent.transport.Request] (StatsCollector-2:null) Seq 65-598478431: Received: { Ans: , MgmtId: 690716573693, via: 65, Ver: v1, Flags: 10, { GetVmStatsAnswer } } 2014-03-06 18:26:01,978 DEBUG [cloud.async.AsyncJobManagerImpl] (catalina-exec-2:null) submit async job-536, details: AsyncJobVO {id:536, userId: 2, accountId: 2, sessionKey: null, instanceType: None, instanceId: null, cmd: com.cloud.api.commands.RestartNetworkCmd, cmdOriginator: null, cmdInfo: {"response":"json","id":"618b7dd7-3d70-4fb1-93c0-e43c47e8f728","sessionkey": "PwnIrOgjRi1fdHp1B8lSzeYLMKU\u003d","cleanup":"false","ctxUserId":"2","_":"1 394101570651","ctxAccountId":"2","ctxStartEventId":"5358"}, cmdVersion: 0, callbackType: 0, callbackAddress: null, status: 0, processStatus: 0, resultCode: 0, result: null, initMsid: 690716573693, completeMsid: null, lastUpdated: null, lastPolled: null, created: null} 2014-03-06 18:26:01,981 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-103:job-536) Executing com.cloud.api.commands.RestartNetworkCmd for job-536 2014-03-06 18:26:01,985 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-103:job-536) Sync job-536 execution on object network.209 2014-03-06 18:26:02,037 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-103:job-536) job com.cloud.api.commands.RestartNetworkCmd for job-536 was queued, processing the queue. 2014-03-06 18:26:02,087 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-103:job-536) Executing sync queue item: SyncQueueItemVO {id:3, queueId: 1, contentType: AsyncJob, contentId: 536, lastProcessMsid: 690716573693, lastprocessNumber: 9, created: Thu Mar 06 18:26:01 CST 2014} 2014-03-06 18:26:02,088 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-103:job-536) Schedule queued job-536 2014-03-06 18:26:02,146 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-104:job-536) Executing com.cloud.api.commands.RestartNetworkCmd for job-536 2014-03-06 18:26:02,146 DEBUG [cloud.async.SyncQueueManagerImpl] (Job-Executor-103:job-536) There is a pending process in sync queue(id: 1) 2014-03-06 18:26:02,248 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Restarting network 209... 2014-03-06 18:26:02,249 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Skip the shutting down of network id=209 2014-03-06 18:26:02,249 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Implementing the network Ntwk[209|Guest|6] elements and resources as a part of network restart 2014-03-06 18:26:02,249 DEBUG [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Implementing the network Ntwk[209|Guest|6] elements and resources as a part of network restart 2014-03-06 18:26:02,255 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-104:job-536) Lock is acquired for network id 209 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id) )] : Dest[Zone(2)-Pod(null)-Cluster(null)-Host(null)-Storage()] 2014-03-06 18:26:02,255 DEBUG [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-104:job-536) Lock is released for network id 209 as a part of router startup in Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id) )] : Dest[Zone(2)-Pod(null)-Cluster(null)-Host(null)-Storage()] 2014-03-06 18:26:02,255 WARN [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Failed to implement network Ntwk[209|Guest|6] elements and resources as a part of network restart due to com.cloud.utils.exception.CloudRuntimeException: Pod id is expected in deployment destination at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.getDeploymentPla nAndRouters(VirtualNetworkApplianceManagerImpl.java:1596) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.findOrDeployVirt ualRouterInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1305) at com.cloud.utils.db.DatabaseCallback.intercept(DatabaseCallback.java:34) at com.cloud.network.router.VirtualNetworkApplianceManagerImpl.deployVirtualRou terInGuestNetwork(VirtualNetworkApplianceManagerImpl.java:1688) at com.cloud.network.element.VirtualRouterElement.implement(VirtualRouterElemen t.java:172) at com.cloud.network.NetworkManagerImpl.implementNetworkElementsAndResources(Ne tworkManagerImpl.java:2033) at com.cloud.network.NetworkManagerImpl.restartNetwork(NetworkManagerImpl.java: 3892) at com.cloud.network.NetworkManagerImpl.restartNetwork(NetworkManagerImpl.java: 3827) at com.cloud.event.ActionEventCallback.intercept(ActionEventCallback.java:36) at com.cloud.api.commands.RestartNetworkCmd.execute(RestartNetworkCmd.java:93) at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:138) at com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:432) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11 10) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6 03) at java.lang.Thread.run(Thread.java:679) 2014-03-06 18:26:02,256 WARN [cloud.network.NetworkManagerImpl] (Job-Executor-104:job-536) Network id=209 failed to restart. 2014-03-06 18:26:02,304 WARN [cloud.api.ApiDispatcher] (Job-Executor-104:job-536) class com.cloud.api.ServerApiException : Failed to restart network 2014-03-06 18:26:02,305 DEBUG [cloud.async.AsyncJobManagerImpl] (Job-Executor-104:job-536) Complete async job-536, jobStatus: 2, resultCode: 530, result: Error Code: 530 Error text: Failed to restart network 2014-03-06 18:26:02,405 DEBUG [cloud.async.SyncQueueManagerImpl] (Job-Executor-104:job-536) Sync queue (1) is currently empty 2014-03-06 18:26:02,406 WARN [cloud.async.AsyncJobManagerImpl] (Job-Executor-104:job-536) Unable to unregister active job 536 from JMX monitoring 2014-03-06 18:26:06,077 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) HostStatsCollector is running... 2014-03-06 18:26:06,086 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-127:null) Seq 56-1534532115: Executing request 2014-03-06 18:26:06,382 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-127:null) Seq 56-1534532115: Response Received: 2014-03-06 18:26:06,382 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 56-1534532115: Received: { Ans: , MgmtId: 690716573693, via: 56, Ver: v1, Flags: 10, { GetHostStatsAnswer } } 2014-03-06 18:26:06,389 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-37:null) Seq 65-598478432: Executing request 2014-03-06 18:26:06,607 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-37:null) Seq 65-598478432: Response Received: 2014-03-06 18:26:06,607 DEBUG [agent.transport.Request] (StatsCollector-3:null) Seq 65-598478432: Received: { Ans: , MgmtId: 690716573693, via: 65, Ver: v1, Flags: 10, { GetHostStatsAnswer } } 2014-03-06 18:26:06,811 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) StorageCollector is running... ^C