Unfortunately my woes are not over. The ssvm is up but I seem to have a problem with secondary storage.
I keep seeing these messages even though ssvm is up: 2013-03-07 19:10:10,635 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM Also in the templates I see the centos template but it says it is not ready so I cant start a VM in the logs I see (greping for [storage.): 2013-03-07 19:39:10,634 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2013-03-07 19:39:16,880 INFO [storage.secondary.SecondaryStorageListener] (AgentManager-Handler-14:null) Received a host startup notification com.cloud.agent.api.StartupSecondaryStorageCommand 2013-03-07 19:39:18,319 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (AgentManager-Handler-14:null) Successfully programmed secondary storage nfs://172.30.45.2/store/secondary in secondary storage VM s-1-VM 2013-03-07 19:39:18,405 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (AgentManager-Handler-14:null) Successfully programmed firewall rules into s-1-VM 2013-03-07 19:39:18,513 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (AgentManager-Handler-14:null) Successfully programmed http auth into s-1-VM 2013-03-07 19:39:18,722 INFO [storage.download.DownloadMonitorImpl] (AgentManager-Handler-14:null) Template Sync found routing-1 already in the template host table 2013-03-07 19:39:18,728 INFO [storage.download.DownloadMonitorImpl] (AgentManager-Handler-14:null) Template Sync did not find centos55-x86_64 ready on server 2, will request download to start/resume shortly 2013-03-07 19:39:18,729 INFO [storage.download.DownloadMonitorImpl] (AgentManager-Handler-14:null) Template Sync did not find centos56-x86_64-xen ready on server 2, will request download to start/resume shortly 2013-03-07 19:39:18,731 INFO [storage.download.DownloadMonitorImpl] (AgentManager-Handler-14:null) Template Sync did not find centos53-x64 ready on server 2, will request download to start/resume shortly 2013-03-07 19:39:18,741 DEBUG [storage.download.DownloadMonitorImpl] (AgentManager-Handler-14:null) Template CentOS 5.6(64-bit) no GUI (XenServer) needs to be downloaded to nfs://172.30.45.2/store/secondary 2013-03-07 19:39:40,636 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2013-03-07 19:39:48,751 WARN [storage.download.DownloadListener] (Timer-5:null) Entering download error state: timeout waiting for response from storage host, template=CentOS 5.6(64-bit) no GUI (XenServer) at host nfs://172.30.45.2/store/secondary 2013-03-07 19:40:10,635 DEBUG [storage.secondary.SecondaryStorageManagerImpl] (secstorage-1:null) Zone 1 is ready to launch secondary storage VM 2 When trying to register an iso I see connection refused error in the logs even though I don't see any entries in my web logs of attempting to download the file (wget from the management server and the host works fine): 2013-03-07 19:15:13,772 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===START=== 172.30.61.63 -- GET command=registerIso&name=Ubuntu%2012.04%20server%2064bit&displayText=Ubuntu%2012.04%20LTS&url=http%3A%2F%2F172.30.45.2%2Fisos%2Fubuntu-12.04.1-server-amd64.iso&zoneid=-1&isextractable=false&bootable=true&osTypeId=8609a566-0fa8-41a0-9d8f-3bf6d70faefa&ispublic=false&isfeatured=false&response=json&sessionkey=RuCxKbUIJNJYVENXDQ28A9oCIgE%3D&_=1362712512719 2013-03-07 19:15:13,831 DEBUG [agent.transport.Request] (catalina-exec-23:null) Seq 4-17236017: Sending { Cmd , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 100011, [{"storage.DownloadCommand":{"hvm":true,"description":"Ubuntu 12.04 LTS","maxDownloadSizeInBytes":53687091200,"id":201,"resourceType":"TEMPLATE","url":" http://172.30.45.2/isos/ubuntu-12.04.1-server-amd64.iso ","format":"ISO","accountId":2,"name":"201-2-597c145a-1f38-355e-9225-943a184a1f8d","secUrl":"nfs:// 172.30.45.2/store/secondary","wait":0}}] } 2013-03-07 19:15:13,867 DEBUG [cloud.api.ApiServlet] (catalina-exec-23:null) ===END=== 172.30.61.63 -- GET command=registerIso&name=Ubuntu%2012.04%20server%2064bit&displayText=Ubuntu%2012.04%20LTS&url=http%3A%2F%2F172.30.45.2%2Fisos%2Fubuntu-12.04.1-server-amd64.iso&zoneid=-1&isextractable=false&bootable=true&osTypeId=8609a566-0fa8-41a0-9d8f-3bf6d70faefa&ispublic=false&isfeatured=false&response=json&sessionkey=RuCxKbUIJNJYVENXDQ28A9oCIgE%3D&_=1362712512719 2013-03-07 19:15:16,118 DEBUG [agent.transport.Request] (Timer-3:null) Seq 4-17236018: Sending { Cmd , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 100011, [{"storage.DownloadProgressCommand":{"jobId":"c1749be1-5c30-4a59-8014-bfeec0dea76a","request":"GET_STATUS","hvm":false,"description":"CentOS 5.6(64-bit) no GUI (XenServer)","checksum":"905cec879afd9c9d22ecc8036131a180","maxDownloadSizeInBytes":53687091200,"id":5,"resourceType":"TEMPLATE","url":" http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 ","format":"VHD","accountId":1,"name":"centos56-x86_64-xen","secUrl":"nfs:// 172.30.45.2/store/secondary","wait":0}}] } 2013-03-07 19:15:16,124 DEBUG [agent.transport.Request] (AgentManager-Handler-14:null) Seq 4-17236018: Processing: { Ans: , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 10, [{"storage.DownloadAnswer":{"jobId":"c1749be1-5c30-4a59-8014-bfeec0dea76a","downloadPct":2,"errorString":" ","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/c536fc4b-e34d-34f5-8a5a-fc87ad852fd2/template/tmpl/1/5/dnld8635841906619140940tmp_","templateSize":0,"templatePhySicalSize":0,"checkSum":"905cec879afd9c9d22ecc8036131a180","result":false,"details":" ","wait":0}}] } 2013-03-07 19:15:16,925 DEBUG [agent.transport.Request] (AgentManager-Handler-15:null) Seq 4-17236017: Processing: { Ans: , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 10, [{"storage.DownloadAnswer":{"jobId":"0c9055a8-b23f-49c5-82dd-5c7c00de1629","downloadPct":0,"errorString":" ","downloadStatus":"NOT_DOWNLOADED","downloadPath":"/mnt/SecStorage/c536fc4b-e34d-34f5-8a5a-fc87ad852fd2/template/tmpl/2/201/dnld7244558075029424555tmp_","templateSize":0,"templatePhySicalSize":0,"result":false,"details":" ","wait":0}}] } 2013-03-07 19:15:18,460 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-98:null) Ping from 1 2013-03-07 19:15:19,170 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-138:null) Seq 1-81068034: Executing request 2013-03-07 19:15:19,496 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-138:null) Seq 1-81068034: Response Received: 2013-03-07 19:15:19,496 DEBUG [agent.transport.Request] (DirectAgent-138:null) Seq 1-81068034: Processing: { Ans: , MgmtId: 233845174730255, via: 1, Ver: v1, Flags: 10, [{"ClusterSyncAnswer":{"_clusterId":1,"_newStates":{},"_isExecuted":false,"result":true,"wait":0}}] } 2013-03-07 19:15:21,231 DEBUG [cloud.server.StatsCollector] (StatsCollector-1:null) StorageCollector is running... 2013-03-07 19:15:21,291 DEBUG [agent.transport.Request] (StatsCollector-1:null) Seq 4-17236019: Received: { Ans: , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2013-03-07 19:15:21,298 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-30:null) Seq 1-81068109: Executing request 2013-03-07 19:15:21,825 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-30:null) Seq 1-81068109: Response Received: 2013-03-07 19:15:21,826 DEBUG [agent.transport.Request] (StatsCollector-1:null) Seq 1-81068109: Received: { Ans: , MgmtId: 233845174730255, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2013-03-07 19:15:21,832 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-19:null) Seq 1-81068110: Executing request 2013-03-07 19:15:22,343 DEBUG [agent.manager.DirectAgentAttache] (DirectAgent-19:null) Seq 1-81068110: Response Received: 2013-03-07 19:15:22,343 DEBUG [agent.transport.Request] (StatsCollector-1:null) Seq 1-81068110: Received: { Ans: , MgmtId: 233845174730255, via: 1, Ver: v1, Flags: 10, { GetStorageStatsAnswer } } 2013-03-07 19:15:25,595 DEBUG [cloud.server.StatsCollector] (StatsCollector-3:null) VmStatsCollector is running... 2013-03-07 19:15:26,127 DEBUG [agent.transport.Request] (Timer-3:null) Seq 4-17236020: Sending { Cmd , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 100011, [{"storage.DownloadProgressCommand":{"jobId":"c1749be1-5c30-4a59-8014-bfeec0dea76a","request":"GET_STATUS","hvm":false,"description":"CentOS 5.6(64-bit) no GUI (XenServer)","checksum":"905cec879afd9c9d22ecc8036131a180","maxDownloadSizeInBytes":53687091200,"id":5,"resourceType":"TEMPLATE","url":" http://download.cloud.com/templates/builtin/centos56-x86_64.vhd.bz2 ","format":"VHD","accountId":1,"name":"centos56-x86_64-xen","secUrl":"nfs:// 172.30.45.2/store/secondary","wait":0}}] } 2013-03-07 19:15:26,169 DEBUG [agent.transport.Request] (AgentManager-Handler-4:null) Seq 4-17236020: Processing: { Ans: , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 10, [{"storage.DownloadAnswer":{"jobId":"c1749be1-5c30-4a59-8014-bfeec0dea76a","downloadPct":2,"errorString":" ","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/c536fc4b-e34d-34f5-8a5a-fc87ad852fd2/template/tmpl/1/5/dnld8635841906619140940tmp_","templateSize":0,"templatePhySicalSize":0,"checkSum":"905cec879afd9c9d22ecc8036131a180","result":false,"details":" ","wait":0}}] } 2013-03-07 19:15:26,933 DEBUG [agent.transport.Request] (Timer-4:null) Seq 4-17236021: Sending { Cmd , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 100011, [{"storage.DownloadProgressCommand":{"jobId":"0c9055a8-b23f-49c5-82dd-5c7c00de1629","request":"GET_STATUS","hvm":true,"description":"Ubuntu 12.04 LTS","maxDownloadSizeInBytes":53687091200,"id":201,"resourceType":"TEMPLATE","url":" http://172.30.45.2/isos/ubuntu-12.04.1-server-amd64.iso ","format":"ISO","accountId":2,"name":"201-2-597c145a-1f38-355e-9225-943a184a1f8d","secUrl":"nfs:// 172.30.45.2/store/secondary","wait":0}}] } 2013-03-07 19:15:26,978 DEBUG [agent.transport.Request] (AgentManager-Handler-5:null) Seq 4-17236021: Processing: { Ans: , MgmtId: 233845174730255, via: 4, Ver: v1, Flags: 10, [{"storage.DownloadAnswer":{"jobId":"0c9055a8-b23f-49c5-82dd-5c7c00de1629","downloadPct":0,"errorString":"Connection refused","downloadStatus":"DOWNLOAD_ERROR","downloadPath":"/mnt/SecStorage/c536fc4b-e34d-34f5-8a5a-fc87ad852fd2/template/tmpl/2/201/dnld7244558075029424555tmp_","templateSize":0,"templatePhySicalSize":0,"result":false,"details":"Connection refused","wait":0}}] } I am going to re-install the management server and the hosts as well as clean up the secondary and primary stores and try again, but if anyone has any ideas let me know. thanks, -Carlos On Thu, Mar 7, 2013 at 9:13 PM, Ahmad Emneina <aemne...@gmail.com> wrote: > yeehaw! :D awesome to hear! > > > On Thu, Mar 7, 2013 at 6:58 PM, Carlos Reategui <car...@reategui.com> > wrote: > > > woohoo success.... > > > > Thanks to Ahmad's email in the other thread regarding enabling local > > storage, I decided to see if that would make a difference in my setup > too. > > Now my system VMs are up in local storage. I have also added nfs > primary > > storage and will now see if I am able to get my own instances up and > > running there. > > > > > > On Wed, Mar 6, 2013 at 4:53 PM, Carlos Reategui <create...@gmail.com> > > wrote: > > > > > I have been able to add my host but the system VM's won't start. I > > > thought it had to do with the avoid state problem mentioned in another > > > thread (hence the CS-587) but once I looked further up in the logs, it > is > > > not. > > > > > > My setup: > > > Management Server: ubuntu 12.04, CS 4.0.1 + CLOUDSTACK-587 (from local > > apt > > > repo built from source), Basic networking > > > Hosts: ubuntu 12.04, default xen and xcp-xapi > > > Primary storage: NFS, presetup > > > > > > Excption claims it is unable to find local SR. This is from my host: > > > root@ubuntu:~# df -h > > > Filesystem Size Used Avail Use% Mounted on > > > /dev/mapper/vg00-lv_root 9.2G 1.8G 7.0G 21% / > > > udev 431M 4.0K 431M 1% /dev > > > tmpfs 181M 396K 181M 1% /run > > > none 5.0M 0 5.0M 0% /run/lock > > > none 452M 0 452M 0% /run/shm > > > /dev/sda1 223M 48M 163M 23% /boot > > > 172.30.19.1:/export/primary 5.0T 2.6G 5.0T 1% > > > /run/sr-mount/d558fc56-d287-523e-8a9f-0fe061cb36c5 > > > root@ubuntu:~# xe sr-list > > > uuid ( RO) : d558fc56-d287-523e-8a9f-0fe061cb36c5 > > > name-label ( RW): nfs > > > name-description ( RW): > > > host ( RO): ubuntu > > > type ( RO): nfs > > > content-type ( RO): > > > > > > > > > uuid ( RO) : 7648436c-2fdd-e8b4-d1e5-372ac9eeec0d > > > name-label ( RW): XenServer Tools > > > name-description ( RW): XenServer Tools ISOs > > > host ( RO): <shared> > > > type ( RO): iso > > > content-type ( RO): iso > > > > > > > > > Management Logs: > > > 2013-03-06 16:21:48,858 DEBUG [cloud.storage.StorageManagerImpl] > > > (secstorage-1:null) Checking if we need to prepare 1 volumes for > > > VM[SecondaryStorageVm|s-1-VM] > > > 2013-03-06 16:21:48,861 DEBUG [cloud.storage.StorageManagerImpl] > > > (secstorage-1:null) Creating volume: Vol[1|vm=1|ROOT] > > > 2013-03-06 16:21:48,861 DEBUG [cloud.storage.StorageManagerImpl] > > > (secstorage-1:null) Trying to create in Pool[201|PreSetup] > > > 2013-03-06 16:22:00,399 DEBUG [agent.manager.DirectAgentAttache] > > > (DirectAgent-17:null) Seq 1-1910374413: Response Received: > > > 2013-03-06 16:22:00,400 DEBUG [agent.transport.Request] > > > (DirectAgent-17:null) Seq 1-1910374413: Processing: { Ans: , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 110, > > > > > > [{"storage.PrimaryStorageDownloadAnswer":{"installPath":"75e4eaaf-fc67-408f-9208-e54352def313","templateSize":565240320,"result":true,"wait":0}}] > > > } > > > 2013-03-06 16:22:00,400 DEBUG [agent.manager.AgentAttache] > > > (DirectAgent-17:null) Seq 1-1910374413: No more commands found > > > 2013-03-06 16:22:00,401 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374413: Received: { Ans: , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 110, { > > > PrimaryStorageDownloadAnswer } } > > > 2013-03-06 16:22:00,405 DEBUG [cloud.template.TemplateManagerImpl] > > > (consoleproxy-1:null) Template 1 is downloaded via 1 > > > 2013-03-06 16:22:00,415 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374414: Sending { Cmd , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 100111, > > > > > > [{"storage.CreateCommand":{"volId":2,"pool":{"id":201,"uuid":"nfs","host":"localhost","path":"/nfs","port":0,"type":"PreSetup"},"diskCharacteristics":{"size":0,"tags":[],"type":"ROOT","name":"ROOT-2","useLocalStorage":false,"recreatable":true,"diskOfferingId":8,"volumeId":2,"hyperType":"XenServer"},"templateUrl":"75e4eaaf-fc67-408f-9208-e54352def313","wait":0}}] > > > } > > > 2013-03-06 16:22:00,417 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374414: Executing: { Cmd , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 100111, > > > > > > [{"storage.CreateCommand":{"volId":2,"pool":{"id":201,"uuid":"nfs","host":"localhost","path":"/nfs","port":0,"type":"PreSetup"},"diskCharacteristics":{"size":0,"tags":[],"type":"ROOT","name":"ROOT-2","useLocalStorage":false,"recreatable":true,"diskOfferingId":8,"volumeId":2,"hyperType":"XenServer"},"templateUrl":"75e4eaaf-fc67-408f-9208-e54352def313","wait":0}}] > > > } > > > 2013-03-06 16:22:00,417 DEBUG [agent.manager.DirectAgentAttache] > > > (DirectAgent-19:null) Seq 1-1910374414: Executing request > > > 2013-03-06 16:22:00,563 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-19:null) SR retrieved for 201 > > > 2013-03-06 16:22:00,576 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-19:null) Checking nfs or SR > > > d558fc56-d287-523e-8a9f-0fe061cb36c5 on > > > XS[7b697b0e-b3fa-6bce-6105-14aa4c399506-172.30.45.13] > > > 2013-03-06 16:22:01,407 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-19:null) Succesfully created VDI for > > > com.cloud.agent.api.storage.CreateCommand. Uuid = > > > 1f842f76-d328-48bc-b638-08be7433e88a > > > 2013-03-06 16:22:01,408 DEBUG [agent.manager.DirectAgentAttache] > > > (DirectAgent-19:null) Seq 1-1910374414: Response Received: > > > 2013-03-06 16:22:01,410 DEBUG [agent.transport.Request] > > > (DirectAgent-19:null) Seq 1-1910374414: Processing: { Ans: , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 110, > > > > > > [{"storage.CreateAnswer":{"volume":{"id":2,"name":"ROOT-2","mountPoint":"/nfs","path":"1f842f76-d328-48bc-b638-08be7433e88a","size":2147483648,"type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"nfs","deviceId":0},"requestTemplateReload":false,"result":true,"wait":0}}] > > > } > > > 2013-03-06 16:22:01,410 DEBUG [agent.manager.AgentAttache] > > > (DirectAgent-19:null) Seq 1-1910374414: No more commands found > > > 2013-03-06 16:22:01,410 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374414: Received: { Ans: , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 110, { CreateAnswer } } > > > 2013-03-06 16:22:01,416 DEBUG [cloud.storage.StorageManagerImpl] > > > (consoleproxy-1:null) Volume Vol[2|vm=2|ROOT] is created on > > > Pool[201|PreSetup] > > > 2013-03-06 16:22:01,435 DEBUG > > [cloud.consoleproxy.ConsoleProxyManagerImpl] > > > (consoleproxy-1:null) Boot Args for VM[ConsoleProxy|v-2-VM]: > > template=domP > > > type=consoleproxy host=172.30.45.2 port=8250 name=v-2-VM premium=true > > > zone=1 pod=1 guid=Proxy.2 proxy_vm=2 disable_rp_filter=true > > > eth2ip=172.30.45.169 eth2mask=255.255.255.0 gateway=172.30.45.1 > > > eth0ip=169.254.3.56 eth0mask=255.255.0.0 eth1ip=172.30.45.59 > > > eth1mask=255.255.255.0 mgmtcidr=172.30.45.0/24 localgw=172.30.45.1 > > > internaldns1=172.30.20.176 internaldns2=172.30.20.177 > dns1=172.30.20.176 > > > dns2=172.30.20.177 > > > 2013-03-06 16:22:01,483 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374415: Sending { Cmd , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 100111, > > > > > > [{"StartCommand":{"vm":{"id":2,"name":"v-2-VM","bootloader":"PyGrub","type":"ConsoleProxy","cpus":1,"speed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian > > > GNU/Linux 6(64-bit)","bootArgs":" template=domP type=consoleproxy > > > host=172.30.45.2 port=8250 name=v-2-VM premium=true zone=1 pod=1 > > > guid=Proxy.2 proxy_vm=2 disable_rp_filter=true eth2ip=172.30.45.169 > > > eth2mask=255.255.255.0 gateway=172.30.45.1 eth0ip=169.254.3.56 > > > eth0mask=255.255.0.0 eth1ip=172.30.45.59 eth1mask=255.255.255.0 > mgmtcidr= > > > 172.30.45.0/24 localgw=172.30.45.1 internaldns1=172.30.20.176 > > > internaldns2=172.30.20.177 dns1=172.30.20.176 > > > > > > dns2=172.30.20.177","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"3d2759124df2d5eb","params":{},"uuid":"b6c396f8-25c7-4103-9b86-3944e77686a3","disks":[{"id":2,"name":"ROOT-2","mountPoint":"/nfs","path":"1f842f76-d328-48bc-b638-08be7433e88a","size":2147483648,"type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"nfs","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"0b0846cf-a554-4c46-80d2-ca5275624d1d","ip":"172.30.45.169","netmask":"255.255.255.0","gateway":"172.30.45.1","mac":"06:54:66:00:00:60","dns1":"172.30.20.176","dns2":"172.30.20.177","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"7348c8a8-9815-4940-99a7-ed9c503d16fc","ip":"169.254.3.56","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:38","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"c6222ef4-2750-4d9a-bb2b-f0f0027fb1be","ip":"172.30.45.59","netmask":"255.255.255.0","gateway":"172.30.45.1","mac":"06:12:82:00:00:0a","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false}]},"wait":0}},{"check.CheckSshCommand":{"ip":"169.254.3.56","port":3922,"interval":6,"retries":100,"name":"v-2-VM","wait":0}}] > > > } > > > 2013-03-06 16:22:01,490 DEBUG [agent.transport.Request] > > > (consoleproxy-1:null) Seq 1-1910374415: Executing: { Cmd , MgmtId: > > > 233845174730255, via: 1, Ver: v1, Flags: 100111, > > > > > > [{"StartCommand":{"vm":{"id":2,"name":"v-2-VM","bootloader":"PyGrub","type":"ConsoleProxy","cpus":1,"speed":500,"minRam":1073741824,"maxRam":1073741824,"arch":"x86_64","os":"Debian > > > GNU/Linux 6(64-bit)","bootArgs":" template=domP type=consoleproxy > > > host=172.30.45.2 port=8250 name=v-2-VM premium=true zone=1 pod=1 > > > guid=Proxy.2 proxy_vm=2 disable_rp_filter=true eth2ip=172.30.45.169 > > > eth2mask=255.255.255.0 gateway=172.30.45.1 eth0ip=169.254.3.56 > > > eth0mask=255.255.0.0 eth1ip=172.30.45.59 eth1mask=255.255.255.0 > mgmtcidr= > > > 172.30.45.0/24 localgw=172.30.45.1 internaldns1=172.30.20.176 > > > internaldns2=172.30.20.177 dns1=172.30.20.176 > > > > > > dns2=172.30.20.177","rebootOnCrash":false,"enableHA":false,"limitCpuUse":false,"vncPassword":"3d2759124df2d5eb","params":{},"uuid":"b6c396f8-25c7-4103-9b86-3944e77686a3","disks":[{"id":2,"name":"ROOT-2","mountPoint":"/nfs","path":"1f842f76-d328-48bc-b638-08be7433e88a","size":2147483648,"type":"ROOT","storagePoolType":"PreSetup","storagePoolUuid":"nfs","deviceId":0}],"nics":[{"deviceId":2,"networkRateMbps":200,"defaultNic":true,"uuid":"0b0846cf-a554-4c46-80d2-ca5275624d1d","ip":"172.30.45.169","netmask":"255.255.255.0","gateway":"172.30.45.1","mac":"06:54:66:00:00:60","dns1":"172.30.20.176","dns2":"172.30.20.177","broadcastType":"Native","type":"Guest","broadcastUri":"vlan://untagged","isolationUri":"ec2://untagged","isSecurityGroupEnabled":false},{"deviceId":0,"networkRateMbps":-1,"defaultNic":false,"uuid":"7348c8a8-9815-4940-99a7-ed9c503d16fc","ip":"169.254.3.56","netmask":"255.255.0.0","gateway":"169.254.0.1","mac":"0e:00:a9:fe:03:38","broadcastType":"LinkLocal","type":"Control","isSecurityGroupEnabled":false},{"deviceId":1,"networkRateMbps":-1,"defaultNic":false,"uuid":"c6222ef4-2750-4d9a-bb2b-f0f0027fb1be","ip":"172.30.45.59","netmask":"255.255.255.0","gateway":"172.30.45.1","mac":"06:12:82:00:00:0a","broadcastType":"Native","type":"Management","isSecurityGroupEnabled":false}]},"wait":0}},{"check.CheckSshCommand":{"ip":"169.254.3.56","port":3922,"interval":6,"retries":100,"name":"v-2-VM","wait":0}}] > > > } > > > 2013-03-06 16:22:01,490 DEBUG [agent.manager.DirectAgentAttache] > > > (DirectAgent-25:null) Seq 1-1910374415: Executing request > > > 2013-03-06 16:22:01,636 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) 1. The VM v-2-VM is in Starting state. > > > 2013-03-06 16:22:01,734 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) Created VM d2b354d1-6c06-b6f7-805e-489da21af530 > for > > > v-2-VM > > > 2013-03-06 16:22:01,861 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) PV args are -- quiet > > > > > > console=hvc0%template=domP%type=consoleproxy%host=172.30.45.2%port=8250%name=v-2-VM%premium=true%zone=1%pod=1%guid=Proxy.2%proxy_vm=2%disable_rp_filter=true%eth2ip=172.30.45.169%eth2mask=255.255.255.0%gateway=172.30.45.1%eth0ip=169.254.3.56%eth0mask=255.255.0.0%eth1ip=172.30.45.59%eth1mask=255.255.255.0%mgmtcidr= > > > > > > 172.30.45.0/24%localgw=172.30.45.1%internaldns1=172.30.20.176%internaldns2=172.30.20.177%dns1=172.30.20.176%dns2=172.30.20.177 > > > 2013-03-06 16:22:01,918 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) VBD e879be32-9292-ca96-a273-34dd69112fb1 created > > for > > > Vol[2|ROOT|1f842f76-d328-48bc-b638-08be7433e88a|2147483648] > > > 2013-03-06 16:22:01,919 WARN [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) Catch Exception: class > > > com.cloud.utils.exception.CloudRuntimeException due to > > > com.cloud.utils.exception.CloudRuntimeException: can not find local sr > > > com.cloud.utils.exception.CloudRuntimeException: can not find local sr > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.createPatchVbd(XcpOssResource.java:109) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1285) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.execute(XcpOssResource.java:142) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:497) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.executeRequest(XcpOssResource.java:136) > > > at > > > > > > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) > > > at > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > > at > > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > > > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > at java.lang.Thread.run(Thread.java:679) > > > 2013-03-06 16:22:01,920 WARN [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) Unable to start v-2-VM due to > > > com.cloud.utils.exception.CloudRuntimeException: can not find local sr > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.createPatchVbd(XcpOssResource.java:109) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1285) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.execute(XcpOssResource.java:142) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:497) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.executeRequest(XcpOssResource.java:136) > > > at > > > > > > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) > > > at > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > > at > > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > > > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > at java.lang.Thread.run(Thread.java:679) > > > 2013-03-06 16:22:01,980 WARN [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) Unable to clean up VBD due to > > > You gave an invalid object reference. The object may have recently > been > > > deleted. The class parameter gives the type of reference given, and > the > > > handle parameter echoes the bad value given. > > > at com.xensource.xenapi.Types.checkResponse(Types.java:207) > > > at > com.xensource.xenapi.Connection.dispatch(Connection.java:368) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XenServerConnectionPool$XenServerConnection.dispatch(XenServerConnectionPool.java:909) > > > at com.xensource.xenapi.VBD.unplug(VBD.java:1054) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.handleVmStartFailure(CitrixResourceBase.java:1092) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.execute(CitrixResourceBase.java:1353) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.execute(XcpOssResource.java:142) > > > at > > > > > > com.cloud.hypervisor.xen.resource.CitrixResourceBase.executeRequest(CitrixResourceBase.java:497) > > > at > > > > > > com.cloud.hypervisor.xen.resource.XcpOssResource.executeRequest(XcpOssResource.java:136) > > > at > > > > > > com.cloud.agent.manager.DirectAgentAttache$Task.run(DirectAgentAttache.java:191) > > > at > > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) > > > at > > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > > > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:165) > > > at > > > > > > java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:266) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1146) > > > at > > > > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > at java.lang.Thread.run(Thread.java:679) > > > 2013-03-06 16:22:01,982 DEBUG [xen.resource.CitrixResourceBase] > > > (DirectAgent-25:null) The VM is in stopped state, detected problem > during > > > startup : v-2-VM > > > 2013-03-06 16:22:02,344 DEBUG [agent.manager.DirectAgentAttache] > > > (DirectAgent-25:null) Seq 1-1910374415: Cancelling because one of the > > > answers is false and it is stop on error. > > > > > > > > >