[Openstack-operators] [neutron][connection tracking] OVS connection tracking for a DNS VNF

2018-02-11 Thread Ajay Kalambur (akalambu)
Hi Has anyone had any experience running a DNS VNF on Openstack. Typically for these VNFs there is a really huge volume of DNS lookups and this translates to entries for udp in the conntrack table Sometimes under load this can lead to nf_conntrack table being FULL The default max on most systems

Re: [Openstack-operators] [openstack][placement] Placement API service catalog

2017-06-10 Thread Ajay Kalambur (akalambu)
Hi Curtis Thanks for the help. You were spot on in pointing out the issue Copy pasted previous nova api haproxy config and forgot to update port Thanks again Ajay On 6/10/17, 1:52 PM, "Curtis" <serverasc...@gmail.com> wrote: >On Sat, Jun 10, 2017 at 11:56 AM, Ajay

[Openstack-operators] [openstack][placement] Placement API service catalog

2017-06-10 Thread Ajay Kalambur (akalambu)
Hi I made all the changes as documented in https://docs.openstack.org/ocata/install-guide-ubuntu/nova-controller-install.html https://docs.openstack.org/ocata/install-guide-ubuntu/nova-compute-install.html The issue im facing is when nova compute comes up and queries the placement API it seems

Re: [Openstack-operators] [oslo]nova compute reconnection Issue Kilo

2016-04-21 Thread Ajay Kalambur (akalambu)
al down how aggressive they are. One thing I should mention is that if you have a large number of RPC workers, enabling heartbeats will increase cpu consumption about 1-2% per worker (in our experience). Since its now doing something with rabbitmq every few seconds. This can also increase load on

Re: [Openstack-operators] [oslo]nova compute reconnection Issue Kilo

2016-04-21 Thread Ajay Kalambur (akalambu)
ection its using is no longer valid. Heartbeats by itself solved 90%+ of our issues with rabbitmq and nodes being disconnected and never reconnecting. ___ Kris Lindgren Senior Linux Systems Engineer GoDaddy From: "Ajay Kalambur (akalambu)" <akala...@cisco.com<ma

Re: [Openstack-operators] [oslo]nova compute reconnection Issue Kilo

2016-04-21 Thread Ajay Kalambur (akalambu)
__ Kris Lindgren Senior Linux Systems Engineer GoDaddy From: "Ajay Kalambur (akalambu)" <akala...@cisco.com<mailto:akala...@cisco.com>> Date: Thursday, April 21, 2016 at 1:04 PM To: "Kris G. Lindgren" <klindg...@godaddy.com<mailto:klindg...@god

Re: [Openstack-operators] [oslo]nova compute reconnection Issue Kilo

2016-04-21 Thread Ajay Kalambur (akalambu)
rabbitmq and nodes being disconnected and never reconnecting. ___ Kris Lindgren Senior Linux Systems Engineer GoDaddy From: "Ajay Kalambur (akalambu)" <akala...@cisco.com<mailto:akala...@cisco.com>> Date: Thursday, April 21, 2016 at 12:51 PM To: "Kris G. Lindgren" &l

[Openstack-operators] [oslo]nova compute reconnection Issue Kilo

2016-04-21 Thread Ajay Kalambur (akalambu)
Hi I am seeing on Kilo if I bring down one contoller node sometimes some computes report down forever. I need to restart the compute service on compute node to recover. Looks like oslo is not reconnecting in nova-compute Here is the Trace from nova-compute 2016-04-19 20:25:39.090 6 TRACE

[Openstack-operators] [openstack-operators] Fernet key rotation

2016-03-19 Thread Ajay Kalambur (akalambu)
Hi In a multi node HA deployment for production does key rotate need a keystone process reboot or should we just run the fernet rotate on one node and distribute it without restarting any process I presume keystone can handle the rotation without a restart? I also assume this key rotation can

[Openstack-operators] Keystone token HA

2015-12-17 Thread Ajay Kalambur (akalambu)
Hi If we deploy Keystone using memcached as token backend we see that bringing down 1 of 3 memcache servers results in some tokens getting invalidated. Does memcached not support replication of tokens So if we wanted HA w.r.t keystone tokens should we use SQL backend for tokens? Ajay

[Openstack-operators] Keystone audit logs with haproxy

2015-11-24 Thread Ajay Kalambur (akalambu)
Hi Have a deployment where keystone sits behind a ha proxy node. Now authentication requests are made to a vip. Problem is when there is an authentication failure we cannot track the remote ip that failed login as all authentication failures show the VIP ip since ha proxy fwds the request to a

[Openstack-operators] Rabbit HA queues

2015-09-01 Thread Ajay Kalambur (akalambu)
Hi How is the rabbit_ha_queues parameter used in configuration files like nova.conf, neutron.conf, cinder.conf etc What happens if on the rabbit node the ha queue is set to mirrored but the ha queues is set to False on client side [root@j10-controller-1 /]# rabbitmqctl list_policies Listing

[Openstack-operators] Control exchange configuration

2015-09-01 Thread Ajay Kalambur (akalambu)
Hi When we configure the control_exchange parameter in each of the openstack components it defaults to openstack Is there a recommendation to have separate exchanges per component or just use the openstack exchange for rabbit Is there any impact of using one vs the other Ajay