[
https://issues.apache.org/jira/browse/CLOUDSTACK-4172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sheng Yang resolved CLOUDSTACK-4172.
------------------------------------
Resolution: Cannot Reproduce
I've tried deploying userdata for 30 vms, cannot reproduce this issue.
You can check if your userdata string is legal.
I am using "&userdata=dGVzdA=="
> Parallel deployment of vm fails when userdata is provided
> ----------------------------------------------------------
>
> Key: CLOUDSTACK-4172
> URL: https://issues.apache.org/jira/browse/CLOUDSTACK-4172
> Project: CloudStack
> Issue Type: Bug
> Security Level: Public(Anyone can view this level - this is the
> default.)
> Components: Management Server
> Affects Versions: 4.2.0
> Environment: xenserver advance zone
> Reporter: shweta agarwal
> Priority: Blocker
> Fix For: 4.2.0
>
> Attachments: cloud-backup.dmp, management-server.log.tar.gz
>
>
> Repro steps:
> Set up - Advanced zone with 1 host (We all all the Vms to get deployed in
> this host).
> 1. Create an account.
> 2. Create network for this account.
> 3. Deploy a Vm in this network , so that the router for this network is
> already is running.
> 4. Deploy 30 - 50 Vms in parallel in this network by passing userdata.
> called 30 vm deployment call with userdata and all vm deployment failed with
> following exception
> 2013-08-07 21:53:34,410 DEBUG
> [network.router.VirtualNetworkApplianceManagerImpl] (Job-Executor-87:job-836
> = [ 391486bb-e207-4e33-8eab-cc0993a9c49d ]) Applying userdata and password
> entry in network Ntwk[207|Guest|8]
> 2013-08-07 21:53:34,422 DEBUG [agent.transport.Request]
> (Job-Executor-87:job-836 = [ 391486bb-e207-4e33-8eab-cc0993a9c49d ]) Seq
> 1-122754475: Sending { Cmd , MgmtId: 7200344900649, via: 1, Ver: v1, Flags:
> 100011,
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress":"10.1.1.136","vmName":"331d768a-33e6-4a00-b063-4c451e2acfee","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.2.248","router.name":"r-219-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.136","vmName":"331d768a-33e6-4a00-b063-4c451e2acfee","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.2.248","router.name":"r-219-VM"},"wait":0}}]
> }
> 2013-08-07 21:53:34,422 DEBUG [agent.transport.Request]
> (Job-Executor-87:job-836 = [ 391486bb-e207-4e33-8eab-cc0993a9c49d ]) Seq
> 1-122754475: Executing: { Cmd , MgmtId: 7200344900649, via: 1, Ver: v1,
> Flags: 100011,
> [{"com.cloud.agent.api.routing.SavePasswordCommand":{"password":"fnirq_cnffjbeq","vmIpAddress":"10.1.1.136","vmName":"331d768a-33e6-4a00-b063-4c451e2acfee","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.2.248","router.name":"r-219-VM"},"wait":0}},{"com.cloud.agent.api.routing.VmDataCommand":{"vmIpAddress":"10.1.1.136","vmName":"331d768a-33e6-4a00-b063-4c451e2acfee","executeInSequence":false,"accessDetails":{"router.guest.ip":"10.1.1.1","zone.network.type":"Advanced","router.ip":"169.254.2.248","router.name":"r-219-VM"},"wait":0}}]
> }
> 2013-08-07 21:53:34,533 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-203:null) Seq 1-122754474: Executing request
> 2013-08-07 21:53:34,540 DEBUG [agent.manager.AgentManagerImpl]
> (AgentManager-Handler-10:null) Ping from 3
> 2013-08-07 21:53:34,537 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-296:null) Seq 1-122754475: Executing request
> 2013-08-07 21:53:34,582 DEBUG [cloud.network.NetworkModelImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Service
> SecurityGroup is not supported in the network id=207
> 2013-08-07 21:53:34,582 DEBUG [cloud.network.NetworkModelImpl]
> (ApiServer-7:null) Service SecurityGroup is not supported in the network
> id=207
> 2013-08-07 21:53:34,586 DEBUG [cloud.network.NetworkModelImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Service
> SecurityGroup is not supported in the network id=207
> 2013-08-07 21:53:34,951 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Deploy
> avoids pods: null, clusters: null, hosts: null
> 2013-08-07 21:53:34,956 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ])
> DeploymentPlanner allocation algorithm:
> com.cloud.deploy.FirstFitPlanner_EnhancerByCloudStack_392cf6b8@1c529aa0
> 2013-08-07 21:53:34,956 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Trying
> to allocate a host and storage pools from dc:1, pod:null,cluster:null,
> requested cpu: 128, requested ram: 134217728
> 2013-08-07 21:53:34,956 DEBUG [cloud.deploy.DeploymentPlanningManagerImpl]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Is ROOT
> volume READY (pool already allocated)?: No
> 2013-08-07 21:53:34,957 DEBUG [cloud.deploy.FirstFitPlanner]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ])
> Searching all possible resources under this Zone: 1
> 2013-08-07 21:53:34,957 DEBUG [cloud.deploy.FirstFitPlanner]
> (Job-Executor-118:job-839 = [ 8f1bcacd-91b6-4481-ba74-41664b43d283 ]) Listing
> clusters in order of aggregate capacity, that have (atleast one host with)
> enough CPU and RAM capacity under this Zone: 1
> 2013-08-07 21:53:35,403 DEBUG [cloud.vm.UserVmManagerImpl] (ApiServer-7:null)
> Allocating in the DB for vm
> 2013-08-07 21:53:35,681 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (ApiServer-7:null) Allocating entries for VM:
> VM[User|74cfaf6a-808e-4001-bbb7-a09a374b3733]
> 2013-08-07 21:53:35,682 DEBUG [cloud.vm.VirtualMachineManagerImpl]
> (ApiServer-7:null) Allocating nics for
> VM[User|74cfaf6a-808e-4001-bbb7-a09a374b3733]
> 2013-08-07 21:53:35,683 DEBUG [cloud.network.NetworkManagerImpl]
> (ApiServer-7:null) Allocating nic for vm
> VM[User|74cfaf6a-808e-4001-bbb7-a09a374b3733] in network Ntwk[207|Guest|8]
> with requested profile NicProfile[0-0-null-null-null
> 2013-08-07 21:53:36,050 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-203:null) Seq 1-122754474: Response Received:
> 2013-08-07 21:53:36,050 DEBUG [agent.transport.Request]
> (DirectAgent-203:null) Seq 1-122754474: Processing: { Ans: , MgmtId:
> 7200344900649, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"vm_data
> failed","wait":0}}] }
> 207|Guest|8] with requested profile NicProfile[0-0-null-null-null
> 2013-08-07 21:53:36,050 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-203:null) Seq 1-122754474: Response Received:
> 2013-08-07 21:53:36,050 DEBUG [agent.transport.Request]
> (DirectAgent-203:null) Seq 1-122754474: Processing: { Ans: , MgmtId:
> 7200344900649, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"vm_data
> failed","wait":0}}] }
> 2013-08-07 21:53:36,050 DEBUG [agent.transport.Request]
> (Job-Executor-79:job-837 = [ b63e274a-ebfd-4a5c-9d27-6432fc1492f2 ]) Seq
> 1-122754474: Received: { Ans: , MgmtId: 7200344900649, via: 1, Ver: v1,
> Flags: 10, { Answer, Answer } }
> 2013-08-07 21:53:36,194 DEBUG [agent.manager.DirectAgentAttache]
> (DirectAgent-296:null) Seq 1-122754475: Response Received:
> 2013-08-07 21:53:36,264 DEBUG [agent.transport.Request]
> (DirectAgent-296:null) Seq 1-122754475: Processing: { Ans: , MgmtId:
> 7200344900649, via: 1, Ver: v1, Flags: 10,
> [{"com.cloud.agent.api.Answer":{"result":true,"wait":0}},{"com.cloud.agent.api.Answer":{"result":false,"details":"vm_data
> failed","wait":0}}] }
> 2013-08-07 21:53:36,264 DEBUG [agent.transport.Request]
> (Job-Executor-87:job-836 = [ 391486bb-e207-4e33-8eab-cc0993a9c49d ]) Seq
> 1-122754475: Received: { Ans: , MgmtId: 7200344900649, via: 1, Ver: v1,
> Flags: 10, { Answer, Answer } }
> 2013-08-07 21:53:36,264 INFO [cloud.vm.VirtualMachineManagerImpl]
> (Job-Executor-87:job-836 = [ 391486bb-e207-4e33-8eab-cc0993a9c49d ]) Unable
> to contact resource.
> com.cloud.exception.ResourceUnavailableException: Resource [DataCenter:1] is
> unreachable: Unable to apply userdata and password entry on router
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyRules(VirtualNetworkApplianceManagerImpl.java:3808)
> at
> com.cloud.network.router.VirtualNetworkApplianceManagerImpl.applyUserData(VirtualNetworkApplianceManagerImpl.java:2993)
> at
> com.cloud.network.element.VirtualRouterElement.addPasswordAndUserdata(VirtualRouterElement.java:941)
> at
> com.cloud.network.NetworkManagerImpl.prepareElement(NetworkManagerImpl.java:2035)
> at
> com.cloud.network.NetworkManagerImpl.prepareNic(NetworkManagerImpl.java:2141)
> at
> com.cloud.network.NetworkManagerImpl.prepare(NetworkManagerImpl.java:2082)
> at
> com.cloud.vm.VirtualMachineManagerImpl.advanceStart(VirtualMachineManagerImpl.java:932)
> at
> com.cloud.vm.VirtualMachineManagerImpl.start(VirtualMachineManagerImpl.java:624)
> at
> org.apache.cloudstack.engine.cloud.entity.api.VMEntityManagerImpl.deployVirtualMachine(VMEntityManagerImpl.java:227)
> at
> org.apache.cloudstack.engine.cloud.entity.api.VirtualMachineEntityImpl.deploy(VirtualMachineEntityImpl.java:209)
> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:3408)
> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2968)
> at
> com.cloud.vm.UserVmManagerImpl.startVirtualMachine(UserVmManagerImpl.java:2954)
> at
> com.cloud.utils.component.ComponentInstantiationPostProcessor$InterceptorDispatcher.intercept(ComponentInstantiationPostProcessor.java:125)
> at
> org.apache.cloudstack.api.command.user.vm.DeployVMCmd.execute(DeployVMCmd.java:420)
> at com.cloud.api.ApiDispatcher.dispatch(ApiDispatcher.java:158)
> at
> com.cloud.async.AsyncJobManagerImpl$1.run(AsyncJobManagerImpl.java:531)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> at java.lang.Thread.run(Thread.java:679)
> Router VM of the account shows entries of all the VM who were in the process
> of creating
> /etc/dhcphost.txt file shows
> 02:00:59:14:00:01,set:10_1_1_198,10.1.1.198,67c342de-04b6-4db5-9101-375024882ae2,infinite
> 02:00:77:0e:00:04,set:10_1_1_41,10.1.1.41,adeac3c8-d5c4-42cd-9abc-aba472632bbb,infinite
> 02:00:4b:6b:00:03,set:10_1_1_136,10.1.1.136,331d768a-33e6-4a00-b063-4c451e2acfee,infinite
> 02:00:4e:55:00:05,set:10_1_1_168,10.1.1.168,5cb2e3e1-35ac-4f37-a139-2731c588a9e7,infinite
> 02:00:52:76:00:06,set:10_1_1_123,10.1.1.123,0b32d24e-b850-4b8d-9518-b9ff499999bf,infinite
> 02:00:6a:ca:00:07,set:10_1_1_74,10.1.1.74,74cfaf6a-808e-4001-bbb7-a09a374b3733,infinite
> 02:00:2d:81:00:08,set:10_1_1_231,10.1.1.231,cc018a24-9186-4e74-aca6-4b95141516e6,infinite
> 02:00:60:aa:00:09,set:10_1_1_229,10.1.1.229,4c39fc86-bfb3-47b7-8877-cc2c14894c60,infinite
> 02:00:6e:5b:00:0a,set:10_1_1_249,10.1.1.249,10cc463f-88a3-474c-ac93-ecab9ff01f9a,infinite
> 02:00:3f:96:00:0b,set:10_1_1_219,10.1.1.219,8850247e-a14f-449e-a4b1-3a1fa7c5aa8d,infinite
> 02:00:4d:4e:00:0c,set:10_1_1_242,10.1.1.242,a82c039e-902d-459d-b84d-bf1558f5c225,infinite
> 02:00:5b:53:00:0d,set:10_1_1_122,10.1.1.122,368678ce-6584-4659-8c5e-db01d3e13e6a,infinite
> 02:00:06:2c:00:0e,set:10_1_1_171,10.1.1.171,8ab4b60c-16cc-4d8a-ba9d-b12139719735,infinite
> 02:00:30:48:00:0f,set:10_1_1_61,10.1.1.61,42452f68-21da-4709-81ea-659121c3af9b,infinite
> 02:00:2d:6b:00:10,set:10_1_1_141,10.1.1.141,7ce0da5c-3c0b-49c2-aeaf-f66ac40fc65d,infinite
> 02:00:1a:da:00:11,set:10_1_1_11,10.1.1.11,4941572a-2444-4ba5-ac62-80af4cff697e,infinite
> 02:00:75:27:00:12,set:10_1_1_133,10.1.1.133,615238e3-9dc1-4b2f-b755-6d5cacd6230c,infinite
> 02:00:3c:37:00:13,set:10_1_1_250,10.1.1.250,cb224309-d557-441d-9267-e44a49fa2fee,infinite
> 02:00:0c:88:00:14,set:10_1_1_193,10.1.1.193,a082c2d2-67ea-4b2b-a9ca-5ea49792565d,infinite
> 02:00:70:34:00:15,set:10_1_1_233,10.1.1.233,22ba7f5f-08b8-4564-94b2-48580663cefe,infinite
> 02:00:37:ab:00:16,set:10_1_1_76,10.1.1.76,896d62b1-feb5-49aa-8461-187313b5547b,infinite
> 02:00:62:b8:00:17,set:10_1_1_78,10.1.1.78,01f8e0c8-7f42-4fb7-b854-a7764d617d35,infinite
> 02:00:3c:97:00:18,set:10_1_1_50,10.1.1.50,cf0b09c2-b889-49b8-a6c3-7ae5aa7cd06f,infinite
> 02:00:22:03:00:19,set:10_1_1_53,10.1.1.53,90f8f8cf-9716-45c7-beb4-460fa019bd8d,infinite
> 02:00:7d:42:00:1a,set:10_1_1_200,10.1.1.200,d4302450-36d2-44b4-8f9e-e55798a0a85f,infinite
> 02:00:65:58:00:1b,set:10_1_1_43,10.1.1.43,4e900104-938d-4988-a631-836d993fa199,infinite
> 02:00:56:ed:00:1c,set:10_1_1_196,10.1.1.196,79315f39-4aa9-4189-b133-be534d97f56a,infinite
> 02:00:05:70:00:1d,set:10_1_1_186,10.1.1.186,28b0682c-addc-4430-acee-099ca61ad426,infinite
> 02:00:79:c1:00:1e,set:10_1_1_69,10.1.1.69,c5ba4daa-fb4b-4a63-a8ad-2002015f9b04,infinite
> 02:00:69:b3:00:1f,set:10_1_1_121,10.1.1.121,437d973c-304f-4a93-bc8c-93cfacb75f72,infinite
> 02:00:00:9d:00:20,set:10_1_1_124,10.1.1.124,dea57169-50af-40df-ba44-aceb7789990e,infinite
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
