You might take a look at iptraf during a slow deployment to determine if the utilization on a particular interface is high.
-----Original Message----- From: Openstack [mailto:[email protected]] On Behalf Of Steve Heistand Sent: Wednesday, May 01, 2013 12:43 PM To: [email protected] Subject: Re: [Openstack] launching multiple VMs takes very long time -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 ok a followup to this. its not any sort of disk access issue. I created a new disk to hold the glance directory and running atop while launching shows all the activity on the original root drive nothing using glance. Normally at idle the root drive does get heavily used by something, mostly keystone and rabbit so atop show that partition as busy. When launching a VM it doesnt seem to get more busy though. (maybe an LVM / is a bad idea) Ive also tried launching tiny (ie cirros) images and they too take ages to boot into tiny flavors. The really really weird part is that I ran an experiment of only launching 1 vm at a time. the time this takes grows each time I launch one. 1st vm < 2 minutes 2nd 2.5m 3rd 4m 4th 8m 5th 10m 6th 12m ... there may be some network issues going on here, trying to shove some amount of data bigger then a few Gig seems to start slowing things down. s On 04/30/2013 11:42 AM, Steve Heistand wrote: > if I launch one vm at a time its doesnt very long to start up the > instance. maybe a minute. if I launch 4 instances (of the same > snapshot as before) it takes 30 minutes. > > they are all launching to different compute nodes, the controllers are > all multicore, I dont see any processes on the compute nodes taking > much cpu power, the controller has a keystone process mostly sucking > up 1 core, loads and loads of beam.smp from rabbitmq but none are really > taking any cpu time. > > the glance image storage is on the controller node, the snapshots are 2-3G in > size. > > where should I start looking to find out why things are so slow? > > thanks > > s > - -- ************************************************************************ Steve Heistand NASA Ames Research Center email: [email protected] Steve Heistand/Mail Stop 258-6 ph: (650) 604-4369 Bldg. 258, Rm. 232-5 Scientific & HPC Application P.O. Box 1 Development/Optimization Moffett Field, CA 94035-0001 ************************************************************************ "Any opinions expressed are those of our alien overlords, not my own." # For Remedy # #Action: Resolve # #Resolution: Resolved # #Reason: No Further Action Required # #Tier1: User Code # #Tier2: Other # #Tier3: Assistance # #Notification: None # -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (GNU/Linux) iEYEARECAAYFAlGBVD4ACgkQoBCTJSAkVrErjACfetTt4wDzuh9Pq8AuI+iGjXFB toMAmgKR96PJ89edpdHnRyjFyqN25g6k =/+lx -----END PGP SIGNATURE----- _______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : [email protected] Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp _______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : [email protected] Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp
