[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** No longer affects: nova/essex -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Test coverage log. ** Attachment added: 2012.1.3+stable-20130405-e52e6912-0ubuntu1.log https://bugs.launchpad.net/bugs/1062314/+attachment/3678011/+files/2012.1.3%2Bstable-20130405-e52e6912-0ubuntu1.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Test coverage log. ** Attachment added: 2012.1.3+stable-20130405-e52e6912-0ubuntu1.log https://bugs.launchpad.net/bugs/1062314/+attachment/3678027/+files/2012.1.3%2Bstable-20130405-e52e6912-0ubuntu1.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Tags removed: verification-needed ** Tags added: verification-done -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:ubuntu/precise-updates/nova -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:ubuntu/precise-proposed/nova -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova Milestone: grizzly-1 = 2013.1 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
This bug was fixed in the package nova - 2012.2.1+stable-20121212 -a99a802e-0ubuntu1 --- nova (2012.2.1+stable-20121212-a99a802e-0ubuntu1) quantal-proposed; urgency=low * Ubuntu updates: - debian/control: Ensure novaclient is upgraded with nova, require python-keystoneclient = 1:2.9.0. (LP: #1073289) - d/p/avoid_setuptools_git_dependency.patch: Refresh. * Dropped patches, applied upstream: - debian/patches/CVE-2012-5625.patch: [a99a802] * Resynchronize with stable/folsom (b55014ca) (LP: #1085255): - [a99a802] create_lvm_image allocates dirty blocks (LP: #1070539) - [670b388] RPC exchange name defaults to 'openstack' (LP: #1083944) - [3ede373] disassociate_floating_ip with multi_host=True fails (LP: #1074437) - [22d7c3b] libvirt imagecache should handle shared image storage (LP: #1075018) - [e787786] Detached and deleted RBD volumes remain associated with insance (LP: #1083818) - [9265eb0] live_migration missing migrate_data parameter in Hyper-V driver (LP: #1066513) - [3d99848] use_single_default_gateway does not function correctly (LP: #1075859) - [65a2d0a] resize does not migrate DHCP host information (LP: #1065440) - [102c76b] Nova backup image fails (LP: #1065053) - [48a3521] Fix config-file overrides for nova-dhcpbridge - [69663ee] Cloudpipe in Folsom: no such option: cnt_vpn_clients (LP: #1069573) - [6e47cc8] DisassociateAddress can cause Internal Server Error (LP: #1080406) - [22c3d7b] API calls to dis-associate an auto-assigned floating IP should return proper warning (LP: #1061499) - [bd11d15] libvirt: if exception raised during volume_detach, volume state is inconsistent (LP: #1057756) - [dcb59c3] admin can't describe all images in ec2 api (LP: #1070138) - [78de622] Incorrect Exception raised during Create server when metadata over 255 characters (LP: #1004007) - [c313de4] Fixed IP isn't released before updating DHCP host file (LP: #1078718) - [f4ab42d] Enabling Return Reservation ID with XML create server request returns no body (LP: #1061124) - [3db2a38] 'BackupCreate' should accept rotation parameter greater than or equal to zero (LP: #1071168) - [f7e5dde] libvirt reboot sometimes fails to reattach volumes (LP: #1073720) - [ff776d4] libvirt: detaching volume may fail while terminating other instances on the same host concurrently (LP: #1060836) - [85a8bc2] Used instance uuid rather than id in remove-fixed-ip - [42a85c0] Fix error on invalid delete_on_termination value - [6a17579] xenapi migrations fail w/ swap (LP: #1064083) - [97649b8] attach-time field for volumes is not updated for detach volume (LP: #1056122) - [8f6a718] libvirt: rebuild is not using kernel and ramdisk associated with the new image (LP: #1060925) - [fbe835f] live-migration and volume host assignement (LP: #1066887) - [c2a9150] typo prevents volume_tmp_dir flag from working (LP: #1071536) - [93efa21] Instances deleted during spawn leak network allocations (LP: #1068716) - [ebabd02] After restarting an instance volume is lost (LP: #1071069) - [a369303] xen volume auto device selection always picks xvdb (LP: #1061944) - [8d1095c] Calls to to_xml() to generate XML for a soft deleted flavor fail (LP: #1073736) - [1857821] nova-manage doesn't validate the key value supplied to update the quota (LP: #1064359) - [6ae32f0] Compute manager doesn't update 'host' field when it tries to run a VM (LP: #1073600) - [284f6ea] Host field set too early during builds (LP: #1060255) - [395511f] finish_resize failures result in NoneType exception (LP: #1071595) - [85ccf80] confirm_resize mgr call requires admin context (LP: #1071600) - [2dceffa] Only return the last N lines of the console log (LP: #1081436) - [9c7a711] console auth does not work with memcache, unicode error (LP: #1057279) - [b27f7ef] disk path not exists when using LXC with libvirt_images_type=lvm (LP: #1079113) - [1351c6b] nova-api now requires quantumclient (LP: #1070509) - [612f404] nova-api now requires quantumclient (LP: #1070509) - [7e8a166] nova-compute (folsom) fails to start, compute_driver is None (LP: #1081836) - [182ca80] Nova API does not work with QuantumV2 API subclasses (LP: #1070045) - [55d1412] 413 error code doesn't always provide Retry-After (LP: #1079387) - [1581505] Snapshotting LXC instance fails (LP: #1058273) - [197398f] Stop network.api import on network import - [b874d21] Scheduler Race Condition at high volume (LP: #1073956) - [3316e1f] Nic Ordering not guaranteed with Quantum API (LP: #1064524) - [ab7e37e] Stable oslo (aka common) update - [3f7788c] update nova to report quantum floating IPs (LP: #1023169) - [d3fd05b] metadata service throws 500
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Hello Michael, or anyone else affected, Accepted nova into quantal-proposed. The package will build now and be available at http://launchpad.net/ubuntu/+source/nova/2012.2.1+stable-20121212 -a99a802e-0ubuntu1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested, and change the tag from verification-needed to verification-done. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed. In either case, details of your testing will help us make a better decision. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: nova (Ubuntu Quantal) Status: Confirmed = Fix Committed ** Tags added: verification-needed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~yolanda.robla/openstack-ubuntu-testing/nova- precise-proposed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Also affects: nova (Ubuntu Quantal) Importance: Undecided Status: New ** Changed in: nova (Ubuntu Quantal) Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova/folsom Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~openstack-ubuntu-testing/nova/precise-folsom -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova Status: Fix Committed = Fix Released ** Changed in: nova Milestone: None = grizzly-1 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova/folsom Milestone: None = 2012.2.1 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~openstack-ubuntu-testing/nova/raring-grizzly -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Reviewed: https://review.openstack.org/14368 Committed: http://github.com/openstack/nova/commit/86a59376c6d4d2ec5a05c8b63a419d0374e9d9c9 Submitter: Jenkins Branch:stable/essex commit 86a59376c6d4d2ec5a05c8b63a419d0374e9d9c9 Author: Michael Still mi...@stillhq.com Date: Thu Oct 11 15:46:11 2012 +1100 Avoid RPC calls while holding iptables lock. This exhibitied itself as very slow instance starts on a Canonical test cluster. This was because do_referesh_security_group_rules() was making rpc calls while holding the iptables lock. This refactor avoids that while making no functional changes (I hope). Fixes bug: 1062314 Change-Id: I36f805bd72f7bd06082cfe96c58d637203bcffb7 Cherry-picked: ba585524e32965697c1a44c8fd743dea060bb1af Conflicts: nova/virt/firewall.py ** Changed in: nova/essex Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~openstack-ubuntu-testing/nova/precise-folsom- proposed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~openstack-ubuntu-testing/nova/quantal-folsom -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova Importance: Undecided = High ** Changed in: nova/essex Importance: Undecided = High ** Changed in: nova/essex Importance: High = Medium ** Changed in: nova/folsom Importance: Undecided = High -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
This bug was fixed in the package nova - 2012.2-0ubuntu5 --- nova (2012.2-0ubuntu5) quantal-proposed; urgency=low [ Adam Gandelman ] * Move management of /var/lib/nova/volumes from nova-common to nova-volume. Ensure it has proper permissions. (LP: #1065320) * debian/patches/avoid_setuptools_git_dependency.patch: Remove setuptools_git from tools/pip-requires to avoid it being automatically added to python-nova's runtime dependencies. (LP: #1059907) [ Chuck Short ] * debian/patches/rbd-security.patch: Support override of ceph rbd user and secret in nova-compute. (LP: #1065883) * debian/patches/ubuntu/fix-libvirt-firewall-slowdown.patch: Fix refreshing of security groups in libvirt not to block on RPC calls. (LP: #1062314) * debian/patches/ubuntu/fix-ec2-volume-id-mappings.patch: Read deleted snapshot and volume id mappings. (LP: #1065785) -- Chuck Short zul...@ubuntu.com Fri, 12 Oct 2012 12:35:01 -0500 ** Changed in: nova (Ubuntu) Status: In Progress = Fix Released -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova/essex Milestone: 2012.1.3 = None -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Changed in: nova (Ubuntu) Status: Confirmed = In Progress -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:~openstack-ubuntu-testing/nova/quantal-folsom- proposed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Reviewed: https://review.openstack.org/14367 Committed: http://github.com/openstack/nova/commit/eee4dbb07e88e19ca891275f5ba1d381bd98b4e5 Submitter: Jenkins Branch:stable/folsom commit eee4dbb07e88e19ca891275f5ba1d381bd98b4e5 Author: Michael Still mi...@stillhq.com Date: Thu Oct 11 15:46:11 2012 +1100 Avoid RPC calls while holding iptables lock. This exhibitied itself as very slow instance starts on a Canonical test cluster. This was because do_referesh_security_group_rules() was making rpc calls while holding the iptables lock. This refactor avoids that while making no functional changes (I hope). Fixes bug: 1062314 Change-Id: I36f805bd72f7bd06082cfe96c58d637203bcffb7 Cherry-picked: ba585524e32965697c1a44c8fd743dea060bb1af ** Changed in: nova/folsom Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Upstream has chosen not to backport this fix to essex. Can we please consider carrying this patch ourselves? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
To clarify, it's not in 2012.1.3 but will probably be added to the 2012.1.4 branch -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Branch linked: lp:ubuntu/quantal-proposed/nova -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Reviewed: https://review.openstack.org/14326 Committed: http://github.com/openstack/nova/commit/ba585524e32965697c1a44c8fd743dea060bb1af Submitter: Jenkins Branch:master commit ba585524e32965697c1a44c8fd743dea060bb1af Author: Michael Still mi...@stillhq.com Date: Thu Oct 11 15:46:11 2012 +1100 Avoid RPC calls while holding iptables lock. This exhibitied itself as very slow instance starts on a Canonical test cluster. This was because do_referesh_security_group_rules() was making rpc calls while holding the iptables lock. This refactor avoids that while making no functional changes (I hope). This should resolve bug 1062314. Change-Id: I36f805bd72f7bd06082cfe96c58d637203bcffb7 ** Changed in: nova Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Also affects: nova/essex Importance: Undecided Status: New ** Also affects: nova/folsom Importance: Undecided Status: New ** Changed in: nova/essex Milestone: None = 2012.1.3 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Fix proposed to branch: stable/folsom Review: https://review.openstack.org/14367 ** Changed in: nova/folsom Status: New = In Progress ** Changed in: nova/folsom Assignee: (unassigned) = Pádraig Brady (p-draigbrady) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Fix proposed to branch: stable/essex Review: https://review.openstack.org/14368 ** Changed in: nova/essex Status: New = In Progress ** Changed in: nova/essex Assignee: (unassigned) = Pádraig Brady (p-draigbrady) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
** Also affects: nova Importance: Undecided Status: New ** Changed in: nova Assignee: (unassigned) = Michael Still (mikalstill) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Fix proposed to branch: master Review: https://review.openstack.org/14326 ** Changed in: nova Status: New = In Progress -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: nova (Ubuntu) Status: New = Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1062314] Re: do_refresh_security_group_rules in nova.virt.firewall is very slow
I think the issue here is that nova.virt.firewall.py IptablesFirewallDriver.instance_rules() is calling get_instance_nw_info() which is causing rpcs to be fired off _while_still_holding_the_iptables_lock. I suspect that the rpcs need to happen outside the lock. From yet more instrumented code: A synchronous RPC call is being made while a lock is held. This is probably a bug. Please report it. Include lines following this that start with ** please. ** multicall ** call ** call ** call ** get_instance_nw_info ** instance_rules ** add_filters_for_instance ** do_refresh_security_group_rules ** inner_while_holding_lock ** refresh_security_group_members ** refresh_security_group_members ** refresh_security_group_members ** wrapped ** _process_data ** wrapped ** _spawn_n_impl ** end of stack trace -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to nova in Ubuntu. https://bugs.launchpad.net/bugs/1062314 Title: do_refresh_security_group_rules in nova.virt.firewall is very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1062314/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
