Hello,
I try to setup ACS 4.3 + XS 6.2 with all patches and using GRE network
for guest traffic.
I have two questions:
1.) Are GRE tunnels though ovs works well in ACS 4.3?
2.) Are live migration work with GRE network?
At this moment I created network offering for GRE network, but in ACS
4.3 are not such options like described in
http://docs.cloudstack.apache.org/en/4.3/networking/ovs-plugin.html
With this network offering VM's live migration fails for me:
catalina.out: http://pastebin.com/1LrqHdfs
grep job ID from management-server.lv: http://pastebin.com/MEkwsU2S
Thanks.
INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-15:ctx-e1474b1e) Add job-57
into job monitoring
INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-15:ctx-e1474b1e
ctx-f8375979) Migrating VM[User|demo] to
Dest[Zone(Id)-Pod(Id)-Cluster(Id)-Host(Id)-Storage(Volume(Id|Type-->Pool(Id))]
: Dest[Zone(1)-Pod(1)-Cluster(1)-Host(2)-Storage()]
WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-315:ctx-3d95ea73) Task
failed! Task record: uuid: 64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-315:ctx-3d95ea73) Unable to
migrate VM(i-2-7-VM) from host(2859a585-caeb-43de-904e-f11078f74469) due to
Task failed! Task record: uuid:
64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
Task failed! Task record: uuid:
64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.checkForSuccess(CitrixResourceBase.java:3764)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.migrateVM(CitrixResourceBase.java:3910)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:3468)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:509)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-315:ctx-3d95ea73) Catch
Exception com.cloud.utils.exception.CloudRuntimeException: Migration failed due
to com.cloud.utils.exception.CloudRuntimeException: Unable to migrate
VM(i-2-7-VM) from host(2859a585-caeb-43de-904e-f11078f74469) due to Task
failed! Task record: uuid: 64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
com.cloud.utils.exception.CloudRuntimeException: Unable to migrate VM(i-2-7-VM)
from host(2859a585-caeb-43de-904e-f11078f74469) due to Task failed! Task
record: uuid: 64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.migrateVM(CitrixResourceBase.java:3921)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:3468)
at
com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:509)
at
com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:59)
at
com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:106)
at
com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
INFO [c.c.v.VirtualMachineManagerImpl] (Job-Executor-15:ctx-e1474b1e
ctx-f8375979) Migration was unsuccessful. Cleaning up: VM[User|demo]
WARN [o.a.c.alerts] (Job-Executor-15:ctx-e1474b1e ctx-f8375979) alertType::
17 // dataCenterId:: 1 // podId:: 1 // clusterId:: null // message:: Unable to
migrate vm i-2-7-VM from host cloudstack-5 in zone Cloud-1 and pod Rack-1
ERROR [c.c.a.ApiAsyncJobDispatcher] (Job-Executor-15:ctx-e1474b1e) Unexpected
exception while executing
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd
com.cloud.utils.exception.CloudRuntimeException: Unable to migrate due to Catch
Exception com.cloud.utils.exception.CloudRuntimeException: Migration failed due
to com.cloud.utils.exception.CloudRuntimeException: Unable to migrate
VM(i-2-7-VM) from host(2859a585-caeb-43de-904e-f11078f74469) due to Task
failed! Task record: uuid: 64be6ce0-7da8-c99a-78e1-d78b16098420
nameLabel: Async.VM.pool_migrate
nameDescription:
allowedOperations: []
currentOperations: {}
created: Wed Sep 03 15:59:09 EEST 2014
finished: Wed Sep 03 15:59:09 EEST 2014
status: failure
residentOn: com.xensource.xenapi.Host@f7b41d33
progress: 1.0
type: <none/>
result:
errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]
otherConfig: {}
subtaskOf: com.xensource.xenapi.Task@aaf13f6f
subtasks: []
at
com.cloud.vm.VirtualMachineManagerImpl.migrate(VirtualMachineManagerImpl.java:1840)
at
com.cloud.vm.VirtualMachineManagerImpl.orchestrateMigrate(VirtualMachineManagerImpl.java:1748)
at
com.cloud.vm.VirtualMachineManagerImpl.migrate(VirtualMachineManagerImpl.java:1712)
at
com.cloud.vm.UserVmManagerImpl.migrateVirtualMachine(UserVmManagerImpl.java:4219)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at
org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:183)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150)
at
com.cloud.event.ActionEventInterceptor.invoke(ActionEventInterceptor.java:50)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:161)
at
org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:91)
at
org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172)
at
org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:204)
at com.sun.proxy.$Proxy169.migrateVirtualMachine(Unknown Source)
at
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd.execute(MigrateVMCmd.java:148)
at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:161)
at
com.cloud.api.ApiAsyncJobDispatcher.runJobInContext(ApiAsyncJobDispatcher.java:109)
at
com.cloud.api.ApiAsyncJobDispatcher$1.run(ApiAsyncJobDispatcher.java:66)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
com.cloud.api.ApiAsyncJobDispatcher.runJob(ApiAsyncJobDispatcher.java:63)
at
org.apache.cloudstack.framework.jobs.impl.AsyncJobManagerImpl$5.runInContext(AsyncJobManagerImpl.java:509)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103)
at
org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53)
at
org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:701)
INFO [o.a.c.f.j.i.AsyncJobMonitor] (Job-Executor-15:ctx-e1474b1e) Remove
job-57 from job monitoring
INFO [c.c.h.x.r.CitrixResourceBase] (DirectAgent-400:ctx-7fbf41f2) VM does not
exist on XenServerc299d66d-ee90-43ef-aee2-7dbcc0426f15
WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-315:ctx-a1c93bdd) Detecting a
new state but couldn't find a old state so adding it to the changes: i-2-7-VM2014-09-03 15:59:09,375 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(catalina-exec-16:ctx-1434ab3f ctx-f8375979) submit async job-57, details:
AsyncJobVO {id:57, userId: 3, accountId: 2, instanceType: None, instanceId:
null, cmd: org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd, cmdInfo:
{"response":"json","sessionkey":"M/9XyZOvjTjPxcZM9mSTIYXsedQ\u003d","virtualmachineid":"b92e1ae8-c36f-4f4f-88a3-12d7dcdc7c79","cmdEventType":"VM.MIGRATE","hostid":"75799ce0-a09f-4a51-b2dd-efb45862f727","ctxUserId":"3","httpmethod":"GET","_":"1409749149474","ctxAccountId":"2","ctxStartEventId":"195"},
cmdVersion: 0, status: IN_PROGRESS, processStatus: 0, resultCode: 0, result:
null, initMsid: 95136892860611, completeMsid: null, lastUpdated: null,
lastPolled: null, created: null}
2014-09-03 15:59:09,376 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-15:ctx-e1474b1e) Add job-57 into job monitoring
2014-09-03 15:59:10,905 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-15:ctx-e1474b1e) Complete async job-57, jobStatus: FAILED,
resultCode: 530, result:
org.apache.cloudstack.api.response.ExceptionResponse/null/{"uuidList":[],"errorcode":530,"errortext":"Unable
to migrate due to Catch Exception
com.cloud.utils.exception.CloudRuntimeException: Migration failed due to
com.cloud.utils.exception.CloudRuntimeException: Unable to migrate VM(i-2-7-VM)
from host(2859a585-caeb-43de-904e-f11078f74469) due to Task failed! Task
record: uuid: 64be6ce0-7da8-c99a-78e1-d78b16098420\n
nameLabel: Async.VM.pool_migrate\n nameDescription: \n allowedOperations:
[]\n currentOperations: {}\n created: Wed Sep 03 15:59:09 EEST
2014\n finished: Wed Sep 03 15:59:09 EEST 2014\n
status: failure\n residentOn: com.xensource.xenapi.Host@f7b41d33\n
progress: 1.0\n type: \u003cnone/\u003e\n
result: \n errorInfo: [VM_REQUIRES_NETWORK,
OpaqueRef:701aa362-35a9-905c-968c-84141dfd584b,
OpaqueRef:24bfcf36-4b09-0f91-92ba-89ef3fac621d]\n otherConfig: {}\n
subtaskOf: com.xensource.xenapi.Task@aaf13f6f\n subtasks:
[]\n"}
2014-09-03 15:59:10,910 DEBUG [o.a.c.f.j.i.AsyncJobManagerImpl]
(Job-Executor-15:ctx-e1474b1e) Done executing
org.apache.cloudstack.api.command.admin.vm.MigrateVMCmd for job-57
2014-09-03 15:59:10,914 INFO [o.a.c.f.j.i.AsyncJobMonitor]
(Job-Executor-15:ctx-e1474b1e) Remove job-57 from job monitoring
