[
https://issues.apache.org/jira/browse/CLOUDSTACK-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sailaja Mada updated CLOUDSTACK-4127:
-------------------------------------
Description:
Setup : VMWARE ESXi 5.0 Update 2 hosts
Steps:
1. Enable DvSwitch global config to true
2. Cofigure Adv Networking zone with below Physical network configuration :
Physical Network1 -
a) Mgmt Traffic - vSwitch0 and VMWARE SVS type
b) Public Traffic - vSwitch0 and VMWARE SVS type
Physical Network2 -
a) Guest Traffic- dvSwitch207 and VMWARE DVS
3. Enable Zone
mysql> select * from physical_network;
+-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
| id | uuid | name |
data_center_id | vnet | speed | domain_id | broadcast_domain_range | state
| created | removed |
+-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
| 200 | b58694d8-aaa1-4b6e-9a0f-ecc234d80ef1 | Physical Network 2 |
1 | 790-795 | NULL | NULL | ZONE | Enabled |
2013-08-07 05:38:56 | NULL |
| 201 | 8db4cda4-5f52-413d-b01e-ccb597fbd1ee | Physical Network 1 |
1 | NULL | NULL | NULL | ZONE | Enabled |
2013-08-07 05:38:56 | NULL |
+-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
2 rows in set (0.00 sec)
mysql> select * from physical_network_traffic_types;
+----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
| id | uuid | physical_network_id |
traffic_type | xen_network_label | kvm_network_label | vmware_network_label |
simulator_network_label | ovm_network_label | vlan | lxc_network_label |
+----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
| 1 | 4ba6cd48-dacc-4e89-bb5a-2fa3bea06b1e | 200 | Guest
| NULL | NULL | dvSwitch207 | NULL
| NULL | NULL | cloudbr0 |
| 2 | 6827c31f-d0f6-48be-b514-4204b73d69c0 | 201 | Management
| NULL | NULL | vSwitch0 | NULL
| NULL | NULL | cloudbr0 |
| 3 | 936e1e8a-ab66-41f9-be42-d10c36067a8f | 201 | Public
| NULL | NULL | vSwitch0 | NULL
| NULL | NULL | cloudbr0 |
| 4 | 312f0955-d14e-4a17-9cd5-f13591748fda | 201 | Storage
| NULL | NULL | vSwitch0 | NULL
| NULL | NULL | cloudbr0 |
+----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
4 rows in set (0.00 sec)
Observation:
1. System VM's are failed to start when DVS is enabled at the zone level and
Public Traffic is configured with Standard vSwitch
2. While creating Public port group it is looking for dv Switch information
though it is configured to use Standard vSwitch.
3. It is able to create Mgmt port group with no issues on Standard vSwitch.
Issue with Public traffic only.
2013-08-07 11:15:11,670 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
P[vSwitch0:untagged] with name prefix: cloud.private
2013-08-07 11:15:11,670 WARN [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Unrecognized broadcast type in VmwareResource,
type: LinkLocal. Use vlan info from labeling: untagged
2013-08-07 11:15:11,740 INFO [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
ready on vSwitch vSwitch0
2013-08-07 11:15:11,740 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Preparing NIC device on network
cloud.private.untagged.0.1-vSwitch0
2013-08-07 11:15:11,741 DEBUG [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC at new device
{"operation":"ADD","device":{"addressType":"Manual","macAddress":"02:00:45:bf:00:05","key":-3,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":0}}
2013-08-07 11:15:11,741 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"}
2013-08-07 11:15:11,744 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
P[vSwitch0:untagged] with name prefix: cloud.private
2013-08-07 11:15:11,811 INFO [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
ready on vSwitch vSwitch0
2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Preparing NIC device on network
cloud.private.untagged.0.1-vSwitch0
2013-08-07 11:15:11,811 DEBUG [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC at new device
{"operation":"ADD","device":{"addressType":"Manual","macAddress":"06:3c:f6:00:00:06","key":-4,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":1}}
2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"}
2013-08-07 11:15:11,815 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaredvs
P[vSwitch0:untagged] with name prefix: cloud.public
2013-08-07 11:15:11,827 ERROR [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Unable to find distributed vSwitch null
2013-08-07 11:15:11,827 WARN [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) StartCommand failed due to Exception:
java.lang.Exception
Message: Unable to find distributed vSwitch null
java.lang.Exception: Unable to find distributed vSwitch null
at
com.cloud.hypervisor.vmware.mo.HypervisorHostHelper.prepareNetwork(HypervisorHostHelper.java:510)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.prepareNetworkFromNicInfo(VmwareResource.java:3240)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2851)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:518)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-48:null) Seq 1-1359085612: Cancelling because one of the answers
is false and it is stop on error.
2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-48:null) Seq 1-1359085612: Response Received:
2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (DirectAgent-48:null)
Seq 1-1359085612: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver:
v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":5,"name":"s-5-VM","bootloader":"HVM","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP type=secstorage
host=10.102.192.207 port=8250 name=s-5-VM zone=1 pod=1 guid=s-5-VM
resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
instance=SecStorage sslcopy=true role=templateProcessor mtu=1500
eth2ip=10.102.197.220 eth2mask=255.255.255.0 gateway=10.102.197.1
public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0
eth1ip=10.102.195.145 eth1mask=255.255.252.0 mgmtcidr=10.102.192.0/22
localgw=10.102.192.1 private.network.device=eth1 eth3ip=10.102.195.143
eth3mask=255.255.252.0 storageip=10.102.195.143 storagenetmask=255.255.252.0
storagegateway=10.102.192.1 internaldns1=10.103.128.15
dns1=10.103.128.15","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"a12116e9d07a38c9","params":{"nicAdapter":"E1000"},"uuid":"5a084cda-414c-42bd-ae9a-437f165b81d6","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"6b5d9993-4649-4f4a-893a-8931553bbf2a","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"a24ea7dc-cd9b-35bd-a7d4-9e8b4b8614c5","id":1,"poolType":"NetworkFilesystem","host":"10.102.192.100","path":"/cpg_vol/sailaja/finalps1","port":2049}},"name":"ROOT-5","size":0,"path":"ROOT-5","volumeId":18,"vmName":"s-5-VM","accountId":1,"format":"OVA","id":18,"hypervisorType":"VMware"}},"diskSeq":0,"type":"ROOT"}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"0b2aab25-27a0-4e83-b6f4-0d3be1db55a1","mac":"02:00:45:bf:00:05","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"7e795618-61d8-4382-aace-cb25b109ac9a","ip":"10.102.195.143","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:64:8c:00:00:04","broadcastType":"Native","type":"Storage","isSecurityGroupEnabled":false,"name":"vSwitch0"}]},"result":false,"details":"StartCommand
failed due to Exception: java.lang.Exception\nMessage: Unable to find
distributed vSwitch null\n","wait":0}}] }
2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085612: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1,
Flags: 10, { StartAnswer } }
2013-08-07 11:15:11,836 INFO [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Unable to start VM on Host[-1-Routing] due to StartCommand
failed due to Exception: java.lang.Exception
Message: Unable to find distributed vSwitch null
2013-08-07 11:15:11,877 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Cleaning up resources for the vm
VM[SecondaryStorageVm|s-5-VM] in Starting state
2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085613: Sending { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags:
100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
}
2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085613: Executing: { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1,
Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
}
was:
Setup : VMWARE ESXi 5.0 Update 2 hosts
Steps:
1. Enable DvSwitch global config to true
2. Cofigure Adv Networking zone with below Physical network configuration :
Physical Network1 -
a) Mgmt Traffic - vSwitch0 and VMWARE SVS type
b) Public Traffic - vSwitch0 and VMWARE SVS type
Physical Network2 -
a) Guest Traffic- dvSwitch207 and VMWARE DVS
3. Enable Zone
Observation:
1. System VM's are failed to start when DVS is enabled at the zone level and
Public Traffic is configured with Standard vSwitch
2. While creating Public port group it is looking for dv Switch information
though it is configured to use Standard vSwitch.
3. It is able to create Mgmt port group with no issues on Standard vSwitch.
Issue with Public traffic only.
2013-08-07 11:15:11,670 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
P[vSwitch0:untagged] with name prefix: cloud.private
2013-08-07 11:15:11,670 WARN [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Unrecognized broadcast type in VmwareResource,
type: LinkLocal. Use vlan info from labeling: untagged
2013-08-07 11:15:11,740 INFO [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
ready on vSwitch vSwitch0
2013-08-07 11:15:11,740 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Preparing NIC device on network
cloud.private.untagged.0.1-vSwitch0
2013-08-07 11:15:11,741 DEBUG [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC at new device
{"operation":"ADD","device":{"addressType":"Manual","macAddress":"02:00:45:bf:00:05","key":-3,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":0}}
2013-08-07 11:15:11,741 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"}
2013-08-07 11:15:11,744 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
P[vSwitch0:untagged] with name prefix: cloud.private
2013-08-07 11:15:11,811 INFO [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
ready on vSwitch vSwitch0
2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Preparing NIC device on network
cloud.private.untagged.0.1-vSwitch0
2013-08-07 11:15:11,811 DEBUG [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC at new device
{"operation":"ADD","device":{"addressType":"Manual","macAddress":"06:3c:f6:00:00:06","key":-4,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":1}}
2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"}
2013-08-07 11:15:11,815 INFO [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) Prepare network on vmwaredvs
P[vSwitch0:untagged] with name prefix: cloud.public
2013-08-07 11:15:11,827 ERROR [vmware.mo.HypervisorHostHelper]
(DirectAgent-48:10.102.192.23) Unable to find distributed vSwitch null
2013-08-07 11:15:11,827 WARN [vmware.resource.VmwareResource]
(DirectAgent-48:10.102.192.23) StartCommand failed due to Exception:
java.lang.Exception
Message: Unable to find distributed vSwitch null
java.lang.Exception: Unable to find distributed vSwitch null
at
com.cloud.hypervisor.vmware.mo.HypervisorHostHelper.prepareNetwork(HypervisorHostHelper.java:510)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.prepareNetworkFromNicInfo(VmwareResource.java:3240)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2851)
at
com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:518)
at
com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
at java.util.concurrent.FutureTask.run(FutureTask.java:166)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:679)
2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-48:null) Seq 1-1359085612: Cancelling because one of the answers
is false and it is stop on error.
2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
(DirectAgent-48:null) Seq 1-1359085612: Response Received:
2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (DirectAgent-48:null)
Seq 1-1359085612: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver:
v1, Flags: 10,
[{"com.cloud.agent.api.StartAnswer":{"vm":{"id":5,"name":"s-5-VM","bootloader":"HVM","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"i686","os":"Debian
GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP type=secstorage
host=10.102.192.207 port=8250 name=s-5-VM zone=1 pod=1 guid=s-5-VM
resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
instance=SecStorage sslcopy=true role=templateProcessor mtu=1500
eth2ip=10.102.197.220 eth2mask=255.255.255.0 gateway=10.102.197.1
public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0
eth1ip=10.102.195.145 eth1mask=255.255.252.0 mgmtcidr=10.102.192.0/22
localgw=10.102.192.1 private.network.device=eth1 eth3ip=10.102.195.143
eth3mask=255.255.252.0 storageip=10.102.195.143 storagenetmask=255.255.252.0
storagegateway=10.102.192.1 internaldns1=10.103.128.15
dns1=10.103.128.15","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"a12116e9d07a38c9","params":{"nicAdapter":"E1000"},"uuid":"5a084cda-414c-42bd-ae9a-437f165b81d6","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"6b5d9993-4649-4f4a-893a-8931553bbf2a","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"a24ea7dc-cd9b-35bd-a7d4-9e8b4b8614c5","id":1,"poolType":"NetworkFilesystem","host":"10.102.192.100","path":"/cpg_vol/sailaja/finalps1","port":2049}},"name":"ROOT-5","size":0,"path":"ROOT-5","volumeId":18,"vmName":"s-5-VM","accountId":1,"format":"OVA","id":18,"hypervisorType":"VMware"}},"diskSeq":0,"type":"ROOT"}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"0b2aab25-27a0-4e83-b6f4-0d3be1db55a1","mac":"02:00:45:bf:00:05","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"7e795618-61d8-4382-aace-cb25b109ac9a","ip":"10.102.195.143","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:64:8c:00:00:04","broadcastType":"Native","type":"Storage","isSecurityGroupEnabled":false,"name":"vSwitch0"}]},"result":false,"details":"StartCommand
failed due to Exception: java.lang.Exception\nMessage: Unable to find
distributed vSwitch null\n","wait":0}}] }
2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085612: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver: v1,
Flags: 10, { StartAnswer } }
2013-08-07 11:15:11,836 INFO [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Unable to start VM on Host[-1-Routing] due to StartCommand
failed due to Exception: java.lang.Exception
Message: Unable to find distributed vSwitch null
2013-08-07 11:15:11,877 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(secstorage-1:null) Cleaning up resources for the vm
VM[SecondaryStorageVm|s-5-VM] in Starting state
2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085613: Sending { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1, Flags:
100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
}
2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null) Seq
1-1359085613: Executing: { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1,
Flags: 100011,
[{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
}
> [VMWARE DVS] System VM's are failed to start when DVS is enabled at the zone
> level and Public Traffic is configured with Standard vSwitch
> -----------------------------------------------------------------------------------------------------------------------------------------
>
> Key: CLOUDSTACK-4127
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4127
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Network Controller, VMware
> Affects Versions: 4.2.0
> Reporter: Sailaja Mada
> Priority: Blocker
> Fix For: 4.2.0
>
>
> Setup : VMWARE ESXi 5.0 Update 2 hosts
> Steps:
> 1. Enable DvSwitch global config to true
> 2. Cofigure Adv Networking zone with below Physical network configuration :
> Physical Network1 -
> a) Mgmt Traffic - vSwitch0 and VMWARE SVS type
> b) Public Traffic - vSwitch0 and VMWARE SVS type
> Physical Network2 -
> a) Guest Traffic- dvSwitch207 and VMWARE DVS
> 3. Enable Zone
> mysql> select * from physical_network;
> +-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
> | id | uuid | name |
> data_center_id | vnet | speed | domain_id | broadcast_domain_range | state
> | created | removed |
> +-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
> | 200 | b58694d8-aaa1-4b6e-9a0f-ecc234d80ef1 | Physical Network 2 |
> 1 | 790-795 | NULL | NULL | ZONE | Enabled |
> 2013-08-07 05:38:56 | NULL |
> | 201 | 8db4cda4-5f52-413d-b01e-ccb597fbd1ee | Physical Network 1 |
> 1 | NULL | NULL | NULL | ZONE | Enabled |
> 2013-08-07 05:38:56 | NULL |
> +-----+--------------------------------------+--------------------+----------------+---------+-------+-----------+------------------------+---------+---------------------+---------+
> 2 rows in set (0.00 sec)
> mysql> select * from physical_network_traffic_types;
> +----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
> | id | uuid | physical_network_id |
> traffic_type | xen_network_label | kvm_network_label | vmware_network_label |
> simulator_network_label | ovm_network_label | vlan | lxc_network_label |
> +----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
> | 1 | 4ba6cd48-dacc-4e89-bb5a-2fa3bea06b1e | 200 | Guest
> | NULL | NULL | dvSwitch207 | NULL
> | NULL | NULL | cloudbr0 |
> | 2 | 6827c31f-d0f6-48be-b514-4204b73d69c0 | 201 |
> Management | NULL | NULL | vSwitch0 |
> NULL | NULL | NULL | cloudbr0 |
> | 3 | 936e1e8a-ab66-41f9-be42-d10c36067a8f | 201 | Public
> | NULL | NULL | vSwitch0 | NULL
> | NULL | NULL | cloudbr0 |
> | 4 | 312f0955-d14e-4a17-9cd5-f13591748fda | 201 | Storage
> | NULL | NULL | vSwitch0 | NULL
> | NULL | NULL | cloudbr0 |
> +----+--------------------------------------+---------------------+--------------+-------------------+-------------------+----------------------+-------------------------+-------------------+------+-------------------+
> 4 rows in set (0.00 sec)
> Observation:
> 1. System VM's are failed to start when DVS is enabled at the zone level and
> Public Traffic is configured with Standard vSwitch
> 2. While creating Public port group it is looking for dv Switch information
> though it is configured to use Standard vSwitch.
> 3. It is able to create Mgmt port group with no issues on Standard vSwitch.
> Issue with Public traffic only.
> 2013-08-07 11:15:11,670 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
> P[vSwitch0:untagged] with name prefix: cloud.private
> 2013-08-07 11:15:11,670 WARN [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Unrecognized broadcast type in VmwareResource,
> type: LinkLocal. Use vlan info from labeling: untagged
> 2013-08-07 11:15:11,740 INFO [vmware.mo.HypervisorHostHelper]
> (DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
> ready on vSwitch vSwitch0
> 2013-08-07 11:15:11,740 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Preparing NIC device on network
> cloud.private.untagged.0.1-vSwitch0
> 2013-08-07 11:15:11,741 DEBUG [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare NIC at new device
> {"operation":"ADD","device":{"addressType":"Manual","macAddress":"02:00:45:bf:00:05","key":-3,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":0}}
> 2013-08-07 11:15:11,741 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
> {"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"}
> 2013-08-07 11:15:11,744 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare network on vmwaresvs
> P[vSwitch0:untagged] with name prefix: cloud.private
> 2013-08-07 11:15:11,811 INFO [vmware.mo.HypervisorHostHelper]
> (DirectAgent-48:10.102.192.23) Network cloud.private.untagged.0.1-vSwitch0 is
> ready on vSwitch vSwitch0
> 2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Preparing NIC device on network
> cloud.private.untagged.0.1-vSwitch0
> 2013-08-07 11:15:11,811 DEBUG [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare NIC at new device
> {"operation":"ADD","device":{"addressType":"Manual","macAddress":"06:3c:f6:00:00:06","key":-4,"backing":{"network":{"value":"network-9509","type":"Network"},"deviceName":"cloud.private.untagged.0.1-vSwitch0"},"connectable":{"startConnected":true,"allowGuestControl":true,"connected":true},"unitNumber":1}}
> 2013-08-07 11:15:11,811 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare NIC device based on NicTO:
> {"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"}
> 2013-08-07 11:15:11,815 INFO [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) Prepare network on vmwaredvs
> P[vSwitch0:untagged] with name prefix: cloud.public
> 2013-08-07 11:15:11,827 ERROR [vmware.mo.HypervisorHostHelper]
> (DirectAgent-48:10.102.192.23) Unable to find distributed vSwitch null
> 2013-08-07 11:15:11,827 WARN [vmware.resource.VmwareResource]
> (DirectAgent-48:10.102.192.23) StartCommand failed due to Exception:
> java.lang.Exception
> Message: Unable to find distributed vSwitch null
> java.lang.Exception: Unable to find distributed vSwitch null
> at
> com.cloud.hypervisor.vmware.mo.HypervisorHostHelper.prepareNetwork(HypervisorHostHelper.java:510)
> at
> com.cloud.hypervisor.vmware.resource.VmwareResource.prepareNetworkFromNicInfo(VmwareResource.java:3240)
> at
> com.cloud.hypervisor.vmware.resource.VmwareResource.execute(VmwareResource.java:2851)
> at
> com.cloud.hypervisor.vmware.resource.VmwareResource.executeRequest(VmwareResource.java:518)
> at
> com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:186)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> 2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-48:null) Seq 1-1359085612: Cancelling because one of the answers
> is false and it is stop on error.
> 2013-08-07 11:15:11,829 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-48:null) Seq 1-1359085612: Response Received:
> 2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (DirectAgent-48:null)
> Seq 1-1359085612: Processing: { Ans: , MgmtId: 187767034175903, via: 1, Ver:
> v1, Flags: 10,
> [{"com.cloud.agent.api.StartAnswer":{"vm":{"id":5,"name":"s-5-VM","bootloader":"HVM","type":"SecondaryStorageVm","cpus":1,"minSpeed":500,"maxSpeed":500,"minRam":268435456,"maxRam":268435456,"arch":"i686","os":"Debian
> GNU/Linux 5.0 (32-bit)","bootArgs":" template=domP type=secstorage
> host=10.102.192.207 port=8250 name=s-5-VM zone=1 pod=1 guid=s-5-VM
> resource=com.cloud.storage.resource.PremiumSecondaryStorageResource
> instance=SecStorage sslcopy=true role=templateProcessor mtu=1500
> eth2ip=10.102.197.220 eth2mask=255.255.255.0 gateway=10.102.197.1
> public.network.device=eth2 eth0mask=0.0.0.0 eth0ip=0.0.0.0
> eth1ip=10.102.195.145 eth1mask=255.255.252.0 mgmtcidr=10.102.192.0/22
> localgw=10.102.192.1 private.network.device=eth1 eth3ip=10.102.195.143
> eth3mask=255.255.252.0 storageip=10.102.195.143 storagenetmask=255.255.252.0
> storagegateway=10.102.192.1 internaldns1=10.103.128.15
> dns1=10.103.128.15","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"enableDynamicallyScaleVm":false,"vncPassword":"a12116e9d07a38c9","params":{"nicAdapter":"E1000"},"uuid":"5a084cda-414c-42bd-ae9a-437f165b81d6","disks":[{"data":{"org.apache.cloudstack.storage.to.VolumeObjectTO":{"uuid":"6b5d9993-4649-4f4a-893a-8931553bbf2a","volumeType":"ROOT","dataStore":{"org.apache.cloudstack.storage.to.PrimaryDataStoreTO":{"uuid":"a24ea7dc-cd9b-35bd-a7d4-9e8b4b8614c5","id":1,"poolType":"NetworkFilesystem","host":"10.102.192.100","path":"/cpg_vol/sailaja/finalps1","port":2049}},"name":"ROOT-5","size":0,"path":"ROOT-5","volumeId":18,"vmName":"s-5-VM","accountId":1,"format":"OVA","id":18,"hypervisorType":"VMware"}},"diskSeq":0,"type":"ROOT"}],"nics":[{"deviceId":2,"networkRateMbps":-1,"defaultNic":true,"uuid":"525d419a-2447-4407-8cfc-6c0ae4819ddb","ip":"10.102.197.220","netmask":"255.255.255.0","gateway":"10.102.197.1","mac":"06:a6:96:00:00:07","dns1":"10.103.128.15","broadcastType":"Vlan","type":"Public","broadcastUri":"vlan://101","isolationUri":"vlan://101","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"0b2aab25-27a0-4e83-b6f4-0d3be1db55a1","mac":"02:00:45:bf:00:05","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"0a1a5585-8662-46d6-9dfd-442bf401e60c","ip":"10.102.195.145","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:3c:f6:00:00:06","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false,"name":"vSwitch0"},{"deviceId":3,"networkRateMbps":-1,"defaultNic":false,"uuid":"7e795618-61d8-4382-aace-cb25b109ac9a","ip":"10.102.195.143","netmask":"255.255.252.0","gateway":"10.102.192.1","mac":"06:64:8c:00:00:04","broadcastType":"Native","type":"Storage","isSecurityGroupEnabled":false,"name":"vSwitch0"}]},"result":false,"details":"StartCommand
> failed due to Exception: java.lang.Exception\nMessage: Unable to find
> distributed vSwitch null\n","wait":0}}] }
> 2013-08-07 11:15:11,830 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1359085612: Received: { Ans: , MgmtId: 187767034175903, via: 1, Ver:
> v1, Flags: 10, { StartAnswer } }
> 2013-08-07 11:15:11,836 INFO [cloud.vm.VirtualMachineManagerImpl]
> (secstorage-1:null) Unable to start VM on Host[-1-Routing] due to
> StartCommand failed due to Exception: java.lang.Exception
> Message: Unable to find distributed vSwitch null
> 2013-08-07 11:15:11,877 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (secstorage-1:null) Cleaning up resources for the vm
> VM[SecondaryStorageVm|s-5-VM] in Starting state
> 2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1359085613: Sending { Cmd , MgmtId: 187767034175903, via: 1, Ver: v1,
> Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
> }
> 2013-08-07 11:15:11,879 DEBUG [agent.transport.Request] (secstorage-1:null)
> Seq 1-1359085613: Executing: { Cmd , MgmtId: 187767034175903, via: 1, Ver:
> v1, Flags: 100011,
> [{"com.cloud.agent.api.StopCommand":{"isProxy":false,"executeInSequence":false,"vmName":"s-5-VM","wait":0}}]
> }
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
