[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
[Expired for neutron because there has been no activity for 60 days.] ** Changed in: neutron Status: Incomplete => Expired -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
[Expired for neutron (Ubuntu) because there has been no activity for 60 days.] ** Changed in: neutron (Ubuntu) Status: Incomplete => Expired -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
This report has gone ~1 year without activity. Marking it as incomplete to start the 60 day clean up timer - if this issue is still valid, please update the defect ** Changed in: neutron Status: Confirmed => Incomplete ** Changed in: neutron (Ubuntu) Status: Confirmed => Incomplete -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
** Changed in: neutron Assignee: Sudhakar Gariganti (sudhakar-gariganti) => (unassigned) ** Changed in: neutron (Ubuntu) Assignee: Sudhakar Gariganti (sudhakar-gariganti) => (unassigned) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
This might be better in juno due to the use of ipset to management groups within iptables rulebases. We'll re-test on the next big-ish load test we do and see how things fare! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
This is a known issue in how neutron passes security group rules thru messaging queue. There are several spec proposals for Juno to solve the issue: https://review.openstack.org/#/c/104522/ https://review.openstack.org/#/c/100761/ -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
** Tags added: loadimpact ** Changed in: neutron Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: neutron (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled
Hello James, Have you had a chance to look at https://review.openstack.org/#/c/77549/ ?? Looks similar. ** Changed in: neutron (Ubuntu) Assignee: (unassigned) => Sudhakar (sudhakar-gariganti) ** Changed in: neutron Assignee: (unassigned) => Sudhakar (sudhakar-gariganti) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances
** Changed in: neutron (Ubuntu) Importance: Undecided => Medium ** Summary changed: - instance creation fails on compute nodes with > 175 instances + instance creation fails on compute nodes with > 175 instances with neutron security groups enabled -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances with neutron security groups enabled To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances
** Tags added: sm15k -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances
** Changed in: neutron Importance: Undecided => Medium -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances
Disabling neutron security groups in the openvswitch agent works around this with an obvious side effect. I can push the same compute nodes well pass 300 instances, some degradation in time to provision but seems to stablize. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1314189] Re: instance creation fails on compute nodes with > 175 instances
Excerpt from agent log: 2014-04-29 12:32:47.261 2503 INFO neutron.agent.securitygroups_rpc [req-9440b702-7bfb-4e55-ae19-c8213c6d9f35 None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:32:47.432 2503 INFO neutron.agent.securitygroups_rpc [req-b628d8d3-198c-4cfe-a685-977256aa302c None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:32:48.152 2503 INFO neutron.agent.securitygroups_rpc [-] Refresh firewall rules 2014-04-29 12:35:24.912 2503 INFO neutron.agent.securitygroups_rpc [req-bd4577ec-c360-44df-bdc1-2fa6a5b1904e None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.913 2503 INFO neutron.agent.securitygroups_rpc [req-5779bb3f-053e-4348-9658-6c2dd6fcb9c8 None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.915 2503 INFO neutron.agent.securitygroups_rpc [req-d5e828ba-e06f-4248-bb2c-fda3d335e690 None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.915 2503 INFO neutron.agent.securitygroups_rpc [req-4e0f44e2-db23-4411-9ba8-fcdfb7d2b91e None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.916 2503 INFO neutron.agent.securitygroups_rpc [req-d0e230f5-f8c3-47c7-be66-47be3741a719 None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.917 2503 INFO neutron.agent.securitygroups_rpc [req-5975fd3e-6984-454d-9272-ab3fa0389455 None] Security group member updated [u'92232d3d-170a-49e1-8f70-f83187ddf38f'] 2014-04-29 12:35:24.918 2503 INFO neutron.agent.securitygroups_rpc [req-d76365ad-19a2-40c3-8c33-4fe1fec9cfce None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.919 2503 INFO neutron.agent.securitygroups_rpc [req-d1fcd223-adb7-44b8-b693-55f0d6639604 None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.920 2503 INFO neutron.agent.securitygroups_rpc [req-ff06e8ab-10f2-4650-a077-016076aaee94 None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.921 2503 INFO neutron.agent.securitygroups_rpc [req-1420521e-17f4-4b48-8d4a-b5e21c4bead4 None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.922 2503 INFO neutron.agent.securitygroups_rpc [req-728af0ac-cbe9-4d8c-b777-126dadc03abc None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.922 2503 INFO neutron.agent.securitygroups_rpc [req-a6d4a096-f35c-4373-8275-572a6c46e27c None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.923 2503 INFO neutron.agent.securitygroups_rpc [req-a2de92e0-8223-4346-a052-e429ac3b1755 None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:24.924 2503 INFO neutron.agent.securitygroups_rpc [req-13199ed9-4115-40e4-9245-a6a8c3c5eb1a None] Security group member updated [u'bd7d68e6-6598-4a65-afd4-395f7fd7aff9'] 2014-04-29 12:35:30.378 2503 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'e4fed7d8-54a3-45fe-a0bf-4fba8a68cf2d', u'daf1ea3c-71db-4669-a342-9c6426940ed8', u'1d9c78b4-0b31-48a8-9ec6-a8fd5b80723a', u'11fadb5f-ff8e-442d-8fb9-f4bf97d789df', u'b9de0ccc-2661-41de-9994-6b71c52759c2']) 2014-04-29 12:38:16.720 2503 INFO neutron.agent.securitygroups_rpc [-] Refresh firewall rules -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to neutron in Ubuntu. https://bugs.launchpad.net/bugs/1314189 Title: instance creation fails on compute nodes with > 175 instances To manage notifications about this bug go to: https://bugs.launchpad.net/neutron/+bug/1314189/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs