Sanjeev N created CLOUDSTACK-6755: ------------------------------------- Summary: [OVS] Can't create more than 7 GRE tunnel networks in xen cluster Key: CLOUDSTACK-6755 URL: https://issues.apache.org/jira/browse/CLOUDSTACK-6755 Project: CloudStack Issue Type: Bug Security Level: Public (Anyone can view this level - this is the default.) Components: Management Server, Network Controller, XenServer Affects Versions: 4.4.0 Environment: Latest build from 4.4 with commit e6961fd21bb6d793302c234d0f409f66dc498072 Reporter: Sanjeev N Assignee: Murali Reddy Priority: Blocker Fix For: 4.4.0
[OVS] Can't create more than 7 GRE tunnel networks in xen cluster Steps to reproduce: ================== 1.Bring up CS in advanced zone with Xen cluster 2.Create physical network with GRE isolation 3.Create isolated network offering with virtual networking and OVS as the service provider 4.Create 8 guest networks with above offering and deploy vms in each network Result: ====== CS would create 7 networks successfully and deploying vm in 8th network would fail because Tunnel network creation would fail for 8th network Following is the log snippet from MS log: 2014-05-23 10:18:12,784 DEBUG [c.c.n.e.OvsElement] (Work-Job-Executor-89:job-253/job-254 ctx-800616c3) Checking if OvsElement can handle service Connectivity on network test1-ovs 2014-05-23 10:18:12,789 DEBUG [c.c.n.o.OvsTunnelManagerImpl] (Work-Job-Executor-89:job-253/job-254 ctx-800616c3) Creating tunnels with OVS tunnel manager 2014-05-23 10:18:12,800 DEBUG [c.c.n.o.OvsTunnelManagerImpl] (Work-Job-Executor-89:job-253/job-254 ctx-800616c3) Ask host 1 to configure bridge for network:227 2014-05-23 10:18:12,807 DEBUG [c.c.a.t.Request] (Work-Job-Executor-89:job-253/job-254 ctx-800616c3) Seq 1-6553863357730929719: Sending { Cmd , MgmtId: 7332683579487, via: 1(xen-host-13), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.OvsSetupBridgeCommand":{"name":"OVSTunnel991","hostId":1,"networkId":227,"wait":0}}] } 2014-05-23 10:18:12,808 DEBUG [c.c.a.t.Request] (Work-Job-Executor-89:job-253/job-254 ctx-800616c3) Seq 1-6553863357730929719: Executing: { Cmd , MgmtId: 7332683579487, via: 1(xen-host-13), Ver: v1, Flags: 100111, [{"com.cloud.agent.api.OvsSetupBridgeCommand":{"name":"OVSTunnel991","hostId":1,"networkId":227,"wait":0}}] } 2014-05-23 10:18:12,808 DEBUG [c.c.a.m.DirectAgentAttache] (DirectAgent-268:ctx-46e3abbc) Seq 1-6553863357730929719: Executing request 2014-05-23 10:18:12,991 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) Create a vif on dom0 for tunnel network for account OVSTunnel991 2014-05-23 10:18:13,056 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) createTunnelNetwork failed com.cloud.utils.exception.CloudRuntimeException: Could not find available VIF slot in VM with name: Control domain on host: xen-host-13 at com.cloud.hypervisor.xen.resource.CitrixResourceBase.getLowestAvailableVIFDeviceNum(CitrixResourceBase.java:3990) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.enableXenServerNetwork(CitrixResourceBase.java:928) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.findOrCreateTunnelNetwork(CitrixResourceBase.java:1003) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5268) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:528) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102) at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-05-23 10:18:13,175 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) Create a vif on dom0 for tunnel network for account OVSTunnel991 2014-05-23 10:18:13,239 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) createTunnelNetwork failed com.cloud.utils.exception.CloudRuntimeException: Could not find available VIF slot in VM with name: Control domain on host: xen-host-13 at com.cloud.hypervisor.xen.resource.CitrixResourceBase.getLowestAvailableVIFDeviceNum(CitrixResourceBase.java:3990) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.enableXenServerNetwork(CitrixResourceBase.java:928) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.findOrCreateTunnelNetwork(CitrixResourceBase.java:1007) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.configureTunnelNetwork(CitrixResourceBase.java:1022) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5269) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:528) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102) at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-05-23 10:18:13,242 WARN [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) createandConfigureTunnelNetwork failed java.lang.NullPointerException at com.cloud.hypervisor.xen.resource.CitrixResourceBase.configureTunnelNetwork(CitrixResourceBase.java:1025) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:5269) at com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:528) at com.cloud.hypervisor.xen.resource.XenServer56Resource.executeRequest(XenServer56Resource.java:61) at com.cloud.hypervisor.xen.resource.XenServer610Resource.executeRequest(XenServer610Resource.java:102) at com.cloud.hypervisor.xen.resource.XenServer620SP1Resource.executeRequest(XenServer620SP1Resource.java:65) at com.cloud.agent.manager.DirectAgentAttache$Task.runInContext(DirectAgentAttache.java:216) at org.apache.cloudstack.managed.context.ManagedContextRunnable$1.run(ManagedContextRunnable.java:49) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext$1.call(DefaultManagedContext.java:56) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.callWithContext(DefaultManagedContext.java:103) at org.apache.cloudstack.managed.context.impl.DefaultManagedContext.runWithContext(DefaultManagedContext.java:53) at org.apache.cloudstack.managed.context.ManagedContextRunnable.run(ManagedContextRunnable.java:46) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) 2014-05-23 10:18:13,246 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-268:ctx-46e3abbc) OVS Bridge configured Observations: =========== On xenserver dom0 vm we are creating vif for every GRE tunnel network. But dom0 has a limitation of 7 vifs. So creating 8th tunnel network is failing. -- This message was sent by Atlassian JIRA (v6.2#6252)