There was an issue with the secondary storage vm try to access the management server over the wrong interface. I fixed the route there and now I get a clean test when I check the secondary storage vm health and I can create virtual machine instances. Simply the console proxy vm does not recreate once you destroy the instance. I am going to start digging through the VMWare logs to see if there is anything useful there, thanks for the reply.
----- Original Message ----- From: "Kirk Jantzer" <kirk.jant...@gmail.com> To: "Cloudstack users mailing list" <users@cloudstack.apache.org> Sent: Friday, September 20, 2013 4:09:36 PM Subject: Re: Console Proxy VM Unable to Be Recreated Are you able to deploy your own instances? Is the secondary storage ok? Regards, Kirk Jantzer http://about.me/kirkjantzer On Fri, Sep 20, 2013 at 3:47 PM, Ryan Shafer <ryan.sha...@ecommerce.com>wrote: > Curious if this should go to the dev list as it is a little more specific > that most of the requests I am seeing here? Any advice is appreciated as I > am new here, thank you. > > Sincerly, > Ryan Shafer > > ----- Original Message ----- > From: "Ryan Shafer" <ryan.sha...@ecommerce.com> > To: users@cloudstack.apache.org > Sent: Friday, September 20, 2013 12:44:30 AM > Subject: Console Proxy VM Unable to Be Recreated > > I am currently using cloudstack 4.1.1 with Vmware 5.0 Hypervisor with 96gb > ram and primary iscsi storage of 11TB. Secondary storage is an NFS server > with 300gb allocated. None of these have over 50% of their resources > allocated.Many devs were having issues accessing the consoles of instances. > After troubleshooting the console proxy vm the logical next step was to > attempt to recreate the console proxy vm. After destroying the non-working > console proxy vm a new instance was created in cloudstack gui however the > new vm was never created on the VMWare host. The logs from the time > cloudstack figured out the console proxy was gone until the new console > proxy fails to start is provided below. Any help pointing me in the right > direction would be helpful, I need fresh eyes on this, thank you. > > > > 2013-09-20 00:12:18,793 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) No stopped console proxy is available, need to > allocate > a new console proxy > 2013-09-20 00:12:18,793 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Assign console proxy from a newly started instance > for r > equest from data center : 1 > 2013-09-20 00:12:18,843 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Found existing network configuration for offering > [Network Offerin > g [1-Public-System-Public-Network]: Ntwk[200|Public|1] > 2013-09-20 00:12:18,843 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Releasing lock for Acct[1-system] > 2013-09-20 00:12:18,846 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Found existing network configuration for offering > [Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3] > 2013-09-20 00:12:18,846 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Releasing lock for Acct[1-system] > 2013-09-20 00:12:18,850 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Found existing network configuration for offering > [Network Offering [2-Management-System-Management-Network]: > Ntwk[201|Management|2] > 2013-09-20 00:12:18,850 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Releasing lock for Acct[1-system] > 2013-09-20 00:12:18,854 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Allocating entries for VM: VM[ConsoleProxy|v-1963-VM] > 2013-09-20 00:12:18,857 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Allocating nics for VM[ConsoleProxy|v-1963-VM] > 2013-09-20 00:12:18,858 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in > network Ntwk[200|Public|1] with requested profile > NicProfile[0-0-null-null-null > 2013-09-20 00:12:18,869 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in > network Ntwk[202|Control|3] with requested profile null > 2013-09-20 00:12:18,877 DEBUG [agent.transport.Request] (Timer-68:null) > Seq 3-571413470: Sending { Cmd , MgmtId: 345049484006, via: 3, Ver: v1, > Flags: 100011, > [{"storage.DownloadProgressCommand":{"jobId":"84f2bded-54e8-4ea4-88d0-020a18c8a9f8","request":"GET_STATUS","hvm":true,"description":"Fedora > 18 > x86","checksum":"0e32be24b38cba98bd62260896963b43","maxDownloadSizeInBytes":53687091200,"id":483,"resourceType":"TEMPLATE","url":" > http://download.fedoraproject.org/pub/fedora/linux/releases/18/Live/x86_64/Fedora-18-x86_64-Live-Desktop.iso > ","format":"ISO","accountId":361,"name":"483-361-39559626-1509-3df7-8e8c-8b5a42dbd5d2","secUrl":"nfs:// > 10.199.0.91/storage/secondary","wait":0}}] } > 2013-09-20 00:12:18,882 DEBUG [cloud.network.NetworkManagerImpl] > (consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in > network Ntwk[201|Management|2] with requested profile null > 2013-09-20 00:12:18,888 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Allocaing disks for VM[ConsoleProxy|v-1963-VM] > 2013-09-20 00:12:18,892 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Allocation completed for VM: > VM[ConsoleProxy|v-1963-VM] > 2013-09-20 00:12:18,894 DEBUG [cloud.alert.ConsoleProxyAlertAdapter] > (consoleproxy-1:null) received console proxy alert > 2013-09-20 00:12:18,894 DEBUG [cloud.alert.ConsoleProxyAlertAdapter] > (consoleproxy-1:null) New console proxy created, zone: Advanced-IT, proxy: > v-1963-VM, public IP: null, private IP: null > 2013-09-20 00:12:18,901 DEBUG [cloud.capacity.CapacityManagerImpl] > (consoleproxy-1:null) VM state transitted from :Stopped to Starting with > event: StartRequestedvm's original host id: null new host id: null host id > before state transition: null > 2013-09-20 00:12:18,901 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Successfully transitioned to start state for > VM[ConsoleProxy|v-1963-VM] reservation id = > 73b5aebe-b72d-4f6a-9337-62c34566e9ff > 2013-09-20 00:12:18,903 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Trying to deploy VM, vm has dcId: 1 and podId: null > 2013-09-20 00:12:18,903 DEBUG [cloud.vm.VirtualMachineManagerImpl] > (consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null > 2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) DeploymentPlanner allocation algorithm: random > 2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Trying to allocate a host and storage pools from > dc:1, pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824 > 2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No > 2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Searching all possible resources under this Zone: 1 > 2013-09-20 00:12:18,907 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Listing clusters in order of aggregate capacity, that > have (atleast one host with) enough CPU and RAM capacity under this Zone: 1 > 2013-09-20 00:12:18,908 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0 > 2013-09-20 00:12:18,915 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Checking resources in Cluster: 2 under Pod: 1 > 2013-09-20 00:12:18,916 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1 > cluster:2 > 2013-09-20 00:12:18,916 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts having tag > specified on SvcOffering:NULL > 2013-09-20 00:12:18,918 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Hosts with tag 'NULL' are:[] > 2013-09-20 00:12:18,918 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 0 hosts to > check for all > ocation: [] > 2013-09-20 00:12:18,919 DEBUG [agent.transport.Request] > (AgentManager-Handler-15:null) Seq 3-571413470: Processing: { Ans: , > MgmtId: 345049484006, via: > 3, Ver: v1, Flags: 10, > [{"storage.DownloadAnswer":{"jobId":"84f2bded-54e8-4ea4-88d0-020a18c8a9f8","downloadPct":24,"errorString":"Downloaded > 226730437 by > tes (incomplete > download)","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/6ae60210-7f03-35ce-ace5-a9c2fdc37dc8/template/tmpl/361 > > /483/dnld1565521422208757890tmp_","templateSize":0,"templatePhySicalSize":0,"checkSum":"0e32be24b38cba98bd62260896963b43","result":false,"details":"Downl > oaded 226730437 bytes (incomplete download)","wait":0}}] } > 2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Found 0 hosts for allocation > after prioritizat > ion: [] > 2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024 > 2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator] > (consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 0 > suitable hosts > 2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) No suitable hosts found > 2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) No suitable hosts found under this Cluster: 2 > 2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner] > (consoleproxy-1:null) Could not find suitable Deployment Destination for > this VM under any c > lusters, returning. > 2013-09-20 00:12:18,924 DEBUG [cloud.capacity.CapacityManagerImpl] > (consoleproxy-1:null) VM state transitted from :Starting to Stopped with > event: Operat > ionFailedvm's original host id: null new host id: null host id before > state transition: null > 2013-09-20 00:12:18,927 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl] > (consoleproxy-1:null) Exception while trying to start console proxy > > > > > -- > Sincerely, > Ryan Shafer > > -- > Sincerely, > Ryan Shafer > System Engineer > Ecommerce Inc. > ryan.sha...@ecommerce.com > -- Sincerely, Ryan Shafer System Engineer Ecommerce Inc. ryan.sha...@ecommerce.com
