I am currently using cloudstack 4.1.1 with Vmware 5.0 Hypervisor with 96gb ram
and primary iscsi storage of 11TB. Secondary storage is an NFS server with
300gb allocated. None of these have over 50% of their resources allocated.Many
devs were having issues accessing the consoles of instances. After
troubleshooting the console proxy vm the logical next step was to attempt to
recreate the console proxy vm. After destroying the non-working console proxy
vm a new instance was created in cloudstack gui however the new vm was never
created on the VMWare host. The logs from the time cloudstack figured out the
console proxy was gone until the new console proxy fails to start is provided
below. Any help pointing me in the right direction would be helpful, I need
fresh eyes on this, thank you.
2013-09-20 00:12:18,793 INFO [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) No stopped console proxy is available, need to allocate
a new console proxy
2013-09-20 00:12:18,793 DEBUG [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) Assign console proxy from a newly started instance for r
equest from data center : 1
2013-09-20 00:12:18,843 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Found existing network configuration for offering
[Network Offerin
g [1-Public-System-Public-Network]: Ntwk[200|Public|1]
2013-09-20 00:12:18,843 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Releasing lock for Acct[1-system]
2013-09-20 00:12:18,846 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Found existing network configuration for offering
[Network Offering [3-Control-System-Control-Network]: Ntwk[202|Control|3]
2013-09-20 00:12:18,846 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Releasing lock for Acct[1-system]
2013-09-20 00:12:18,850 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Found existing network configuration for offering
[Network Offering [2-Management-System-Management-Network]:
Ntwk[201|Management|2]
2013-09-20 00:12:18,850 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Releasing lock for Acct[1-system]
2013-09-20 00:12:18,854 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Allocating entries for VM: VM[ConsoleProxy|v-1963-VM]
2013-09-20 00:12:18,857 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Allocating nics for VM[ConsoleProxy|v-1963-VM]
2013-09-20 00:12:18,858 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in
network Ntwk[200|Public|1] with requested profile NicProfile[0-0-null-null-null
2013-09-20 00:12:18,869 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in
network Ntwk[202|Control|3] with requested profile null
2013-09-20 00:12:18,877 DEBUG [agent.transport.Request] (Timer-68:null) Seq
3-571413470: Sending { Cmd , MgmtId: 345049484006, via: 3, Ver: v1, Flags:
100011,
[{"storage.DownloadProgressCommand":{"jobId":"84f2bded-54e8-4ea4-88d0-020a18c8a9f8","request":"GET_STATUS","hvm":true,"description":"Fedora
18
x86","checksum":"0e32be24b38cba98bd62260896963b43","maxDownloadSizeInBytes":53687091200,"id":483,"resourceType":"TEMPLATE","url":"http://download.fedoraproject.org/pub/fedora/linux/releases/18/Live/x86_64/Fedora-18-x86_64-Live-Desktop.iso","format":"ISO","accountId":361,"name":"483-361-39559626-1509-3df7-8e8c-8b5a42dbd5d2","secUrl":"nfs://10.199.0.91/storage/secondary","wait":0}}]
}
2013-09-20 00:12:18,882 DEBUG [cloud.network.NetworkManagerImpl]
(consoleproxy-1:null) Allocating nic for vm VM[ConsoleProxy|v-1963-VM] in
network Ntwk[201|Management|2] with requested profile null
2013-09-20 00:12:18,888 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Allocaing disks for VM[ConsoleProxy|v-1963-VM]
2013-09-20 00:12:18,892 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Allocation completed for VM: VM[ConsoleProxy|v-1963-VM]
2013-09-20 00:12:18,894 DEBUG [cloud.alert.ConsoleProxyAlertAdapter]
(consoleproxy-1:null) received console proxy alert
2013-09-20 00:12:18,894 DEBUG [cloud.alert.ConsoleProxyAlertAdapter]
(consoleproxy-1:null) New console proxy created, zone: Advanced-IT, proxy:
v-1963-VM, public IP: null, private IP: null
2013-09-20 00:12:18,901 DEBUG [cloud.capacity.CapacityManagerImpl]
(consoleproxy-1:null) VM state transitted from :Stopped to Starting with event:
StartRequestedvm's original host id: null new host id: null host id before
state transition: null
2013-09-20 00:12:18,901 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Successfully transitioned to start state for
VM[ConsoleProxy|v-1963-VM] reservation id = 73b5aebe-b72d-4f6a-9337-62c34566e9ff
2013-09-20 00:12:18,903 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Trying to deploy VM, vm has dcId: 1 and podId: null
2013-09-20 00:12:18,903 DEBUG [cloud.vm.VirtualMachineManagerImpl]
(consoleproxy-1:null) Deploy avoids pods: null, clusters: null, hosts: null
2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) DeploymentPlanner allocation algorithm: random
2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Trying to allocate a host and storage pools from dc:1,
pod:null,cluster:null, requested cpu: 500, requested ram: 1073741824
2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Is ROOT volume READY (pool already allocated)?: No
2013-09-20 00:12:18,905 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Searching all possible resources under this Zone: 1
2013-09-20 00:12:18,907 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Listing clusters in order of aggregate capacity, that
have (atleast one host with) enough CPU and RAM capacity under this Zone: 1
2013-09-20 00:12:18,908 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) CPUOverprovisioningFactor considered: 1.0
2013-09-20 00:12:18,915 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Checking resources in Cluster: 2 under Pod: 1
2013-09-20 00:12:18,916 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts in dc: 1 pod:1
cluster:2
2013-09-20 00:12:18,916 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Looking for hosts having tag
specified on SvcOffering:NULL
2013-09-20 00:12:18,918 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Hosts with tag 'NULL' are:[]
2013-09-20 00:12:18,918 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) FirstFitAllocator has 0 hosts to
check for all
ocation: []
2013-09-20 00:12:18,919 DEBUG [agent.transport.Request]
(AgentManager-Handler-15:null) Seq 3-571413470: Processing: { Ans: , MgmtId:
345049484006, via:
3, Ver: v1, Flags: 10,
[{"storage.DownloadAnswer":{"jobId":"84f2bded-54e8-4ea4-88d0-020a18c8a9f8","downloadPct":24,"errorString":"Downloaded
226730437 by
tes (incomplete
download)","downloadStatus":"DOWNLOAD_IN_PROGRESS","downloadPath":"/mnt/SecStorage/6ae60210-7f03-35ce-ace5-a9c2fdc37dc8/template/tmpl/361
/483/dnld1565521422208757890tmp_","templateSize":0,"templatePhySicalSize":0,"checkSum":"0e32be24b38cba98bd62260896963b43","result":false,"details":"Downl
oaded 226730437 bytes (incomplete download)","wait":0}}] }
2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Found 0 hosts for allocation after
prioritizat
ion: []
2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Looking for speed=500Mhz, Ram=1024
2013-09-20 00:12:18,920 DEBUG [allocator.impl.FirstFitAllocator]
(consoleproxy-1:FirstFitRoutingAllocator) Host Allocator returning 0 suitable
hosts
2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) No suitable hosts found
2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) No suitable hosts found under this Cluster: 2
2013-09-20 00:12:18,920 DEBUG [cloud.deploy.FirstFitPlanner]
(consoleproxy-1:null) Could not find suitable Deployment Destination for this
VM under any c
lusters, returning.
2013-09-20 00:12:18,924 DEBUG [cloud.capacity.CapacityManagerImpl]
(consoleproxy-1:null) VM state transitted from :Starting to Stopped with event:
Operat
ionFailedvm's original host id: null new host id: null host id before state
transition: null
2013-09-20 00:12:18,927 WARN [cloud.consoleproxy.ConsoleProxyManagerImpl]
(consoleproxy-1:null) Exception while trying to start console proxy
--
Sincerely,
Ryan Shafer
