Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Elliot Berg
I've already had to flatten and start again so I'd rather avoid it - but my suspicion is that all of this is related to the kvm host's networking somehow. I followed the instructions on the cloudstack install guide, and ended up with the below - does it look right to you guys? auto lo iface

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Jayapal Reddy Uradi
Hi Elliot, Can you please try 'ifup eth0' on the router. It seems there is delay in bringing up the eth0 interface. Thanks, Jayapal On 16-Jul-2014, at 12:40 PM, Elliot Berg elliot.b...@avcosystems.com wrote: I've already had to flatten and start again so I'd rather avoid it - but my

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Elliot Berg
Hi, So that fails with the error Error: an inet prefix is expected rather than 10.4.2.6/255.0.0.0.. Failed to bring up eth0. I went and looked at the router's /etc/network/interfaces file and spotted that the netmask has a . on the end, as below. Removing that and then running ifup eth0

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Jayapal Reddy Uradi
Hi, Check the /var/cache/cloud/cmdline for eth0ip=10.1.1.1 eth0mask=255.255.255.0 If it is correct, then interfaces file is written wrongly. The /etc/network/interfaces updated from the cloud-early-config on router boot. What you can do is put set -x in cloud-early-config and run

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Elliot Berg
Hi, I've got template=domP name=r-27-VM eth0ip=10.4.2.6 eth0mask=255.0.0.0. gateway=10.0.0.1 domain=cs1cloud.internal dhcprange=10.0.0.1 eth1ip=169.254.1.246 eth1mask=255.255.0.0 type=dhcpsrvr disable_rp_filter=true dns1=10.0.0.12 dns2= ip6dns1= ip6dns2= In that file, which includes the

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Jayapal Reddy Uradi
Hi Elliot, Reboot the router and see the management server for router startcommand. These values are passed in startcommand. If it has . at the end then check the database nics table for entry with guest ip. If nic table has entry with . then correct and restart the MS and restart VR. Thanks,

Re: InsufficientServerCapacityException - Unsure Why

2014-07-16 Thread Elliot Berg
That worked - it was set incorrectly in the nics table. The secondary storage VM and Console Proxy VM are suffering the same problem, so I've fixed them - but I'm guessing this means it's been entered incorrectly on the main network config. I didn't spot it in the networks table, do you know

Re: InsufficientServerCapacityException - Unsure Why

2014-07-14 Thread Elliot Berg
Hi, I did that earlier as part of the troubleshooting when it was stuck - so I've just looked at the logs instead of recreating it again as that was only just done. When you say the router logs, do you mean general logs on the virtual router machine? If so,

Re: InsufficientServerCapacityException - Unsure Why

2014-07-14 Thread Jayapal Reddy Uradi
Hi, Check the logs while the router is booting. Also check /var/log/cloud.log Thanks, Jayapal On 14-Jul-2014, at 2:39 PM, Elliot Berg elliot.b...@avcosystems.com wrote: Hi, I did that earlier as part of the troubleshooting when it was stuck - so I've just looked at the logs instead of

Re: InsufficientServerCapacityException - Unsure Why

2014-07-14 Thread Elliot Berg
Hi, Cloud.log contains the following just after the machine's rebooted; Mon Jul 14 16:01:06 UTC 2014 checking that eth0 has IP Mon Jul 14 16:01:07 UTC 2014 waiting for eth0 interface setup with ip timer=0 Mon Jul 14 16:01:08 UTC 2014 waiting for eth0 interface setup with ip timer=1 Mon Jul 14

Re: InsufficientServerCapacityException - Unsure Why

2014-07-11 Thread Elliot Berg
So, I'm wondering whether the guest not having the interfaces configured correctly (i.e. not having an IP) is just a symptom of more generally broken networking - my interfaces file for the KVM host is below, does anyone spot any issues? auto lo iface lo inet loopback auto eth0 iface eth0

Re: InsufficientServerCapacityException - Unsure Why

2014-07-11 Thread Jayapal Reddy Uradi
Hi Elliot, Try recreating router (destroy the router and deploy new vm, router get recreated). After recreation if the problem still exists, check the router logs to see why the interfaces are brought up. Thanks, jayapal On 11-Jul-2014, at 1:38 PM, Elliot Berg elliot.b...@avcosystems.com

Re: InsufficientServerCapacityException - Unsure Why

2014-07-09 Thread Harikrishna Patnala
From the logs 2014-07-08 12:08:56,218 DEBUG [agent.transport.Request] (AgentManager-Handler-1:null) Seq 1-277348416: Processing: { Ans: , MgmtId: 159320647860937, via: 1, Ver: v1, Flags: 110, [{com.cloud.agent.api.Answer:{result:false,details:grep: /var/lib/misc/dnsmasq.leases: No such file

Re: InsufficientServerCapacityException - Unsure Why

2014-07-09 Thread Elliot Berg
I don't know - I can't seem to ssh to the link local IP. It pings, but ssh times out. If I try and use the connect to console button in the gui, that too times out :( Elliot Harikrishna Patnala wrote: From the logs 2014-07-08 12:08:56,218 DEBUG [agent.transport.Request]

Re: InsufficientServerCapacityException - Unsure Why

2014-07-09 Thread Harikrishna Patnala
1) Log into your KVM host. 2) Use command “virsh list”. This gives the list of VMs on the host. 3) Use command “virsh console VirtualRouterId” to log into the VR. -Harikrishna On 09-Jul-2014, at 3:52 pm, Elliot Berg elliot.b...@avcosystems.com wrote: I don't know - I can't seem to ssh to the

Re: InsufficientServerCapacityException - Unsure Why

2014-07-09 Thread Elliot Berg
Doh! I did, but forgot about it being on a funny port. Now that I'm into the VM I can see that it's not running, and fails to start when it tries to bind to the address that it should have on the guest range. I notice that ifconfig -a shows two NICs, only one of which is up (the one with the

Re: InsufficientServerCapacityException - Unsure Why

2014-07-08 Thread Elliot Berg
Hi, It appears to be stuck in the starting state - so I don't get the option to reboot it or anything. If I change the state to stopped in the database directly will the management server attempt to start it again or do I need to do something more? Thanks! Elliot Harikrishna Patnala

Re: InsufficientServerCapacityException - Unsure Why

2014-07-08 Thread Harikrishna Patnala
Yes mark the VR to stopped, destroy VR, mark the VR entry in op_it_work to “Done” and try deploying VM. -Harikrishna On 08-Jul-2014, at 12:44 pm, Elliot Berg elliot.b...@avcosystems.com wrote: Hi, It appears to be stuck in the starting state - so I don't get the option to reboot it or

Re: InsufficientServerCapacityException - Unsure Why

2014-07-08 Thread Elliot Berg
Hi, I've done that, and now there's a new virtual router which says it's running, however a deployment still fails. My latest lot of logs are available at https://dl.dropboxusercontent.com/u/47728104/management-server.log.gz, and there's now one thing in the op_it_work table with a step !=

Re: InsufficientServerCapacityException - Unsure Why

2014-07-07 Thread Elliot Berg
I'm still not really spotting anything indicating why it's not using the host, but I suspect that's just because I don't really know what I'm looking for - so I've zipped the whole log for today and stuffed it on dropbox at https://dl.dropboxusercontent.com/u/47728104/management-server.log.gz.

Re: InsufficientServerCapacityException - Unsure Why

2014-07-07 Thread Harikrishna Patnala
Do you see any work item pending for Virtual Router r-4-VM in “op_it_work” table ? If there are any, remove those entries and try VM deployment again. I see in the logs that VR has a task pending 2014-07-07 10:28:15,934 WARN [cloud.vm.VirtualMachineManagerImpl] (Job-Executor-5:job-48 = [

Re: InsufficientServerCapacityException - Unsure Why

2014-07-07 Thread Elliot Berg
I can see two entries that have the step field set to something other than Done, one of them is ConsoleProxy | Starting and the other is DomainRouter | Prepare Am I safe to just delete the rows, or should I just update the field? Thanks, Elliot Harikrishna Patnala wrote: Do you see any

Re: InsufficientServerCapacityException - Unsure Why

2014-07-07 Thread Harikrishna Patnala
Is your Virtual Router up and running ? If is in running state you can mark it Done and deploy a VM. If it is in stopped state try restarting it. You can try updating the field as well. -Harikrishna On 07-Jul-2014, at 7:10 pm, Elliot Berg elliot.b...@avcosystems.com wrote: I can see two

Re: InsufficientServerCapacityException - Unsure Why

2014-07-03 Thread Elliot Berg
Ah, so when looking back a bit further before (I was kind of only looking for exceptions higher up before now), I've just spotted this... 2014-07-03 10:48:28,765 DEBUG [allocator.impl.FirstFitAllocator] (Job-Executor-3:job-46 = [ 92fb959d-edc5-4fe2-84a0-5 6001226e4ac ]

Re: InsufficientServerCapacityException - Unsure Why

2014-07-03 Thread Elliot Berg
I'm going back over everything and I've noticed something else - everywhere I've looked for how to use local storage says I should change two global settings; * system.vm.use.local.storage = true * use.local.storage = true However I'm looking at my global settings and only the first exists

Re: InsufficientServerCapacityException - Unsure Why

2014-07-02 Thread ilya musayev
Elliot, When you see such an error - there usually a predecessor message that says CloudStack checked for X, Y and Z and found no suitable resources based on your configuration. Put the logs on pastebin or some other site (strip out any private info you dont want to share). I would also