[openstack-dev] [neutron][ovs] OVS drop issue

2018-08-22 Thread Ajay Kalambur (akalambu)
Hi We are seeing a very weird issue with OVS 2.9 which is not seen in OVS 2.6. Basically the end symptom is from the neutron L3 agent router namespace we cant ping the gateway in this case 10.86.67.1 Now on performing tcpdump tests we see the gateway responding to ARP the reply comes into the

Re: [openstack-dev] [neutron] Neutron L3 agent/Keepalived

2017-11-29 Thread Ajay Kalambur (akalambu)
I noticed that this happens when the router HA interface shows status: Down what can cause the ha interface to do down Ajay From: Ajay Kalambur > Reply-To: "OpenStack Development Mailing List (not for usage questions)"

[openstack-dev] [neutron] Neutron L3 agent/Keepalived

2017-11-29 Thread Ajay Kalambur (akalambu)
Hi I have a case where after running the system for a while I see that floating ip association API gets accepted and no Errors in neutron l3 logs But when I go into the qrouter namespace and check the qg- interface the floating ip is not added Also the keepalived.conf is not updated and SIGUP of

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-28 Thread Ajay Kalambur (akalambu)
M To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Cc: "Ian Wells (iawells)" <iawe...@cisco.com<mailto:iawe...@cisco.com>> Subject: Re: [openstack-dev] [

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-27 Thread Ajay Kalambur (akalambu)
ack-dev@lists.openstack.org>> Date: Monday, September 11, 2017 at 1:12 PM To: "OpenStack Development Mailing List (not for usage questions)" <openstack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Cc: "Ian Wells (iawells)" <iawe...@cisco.co

Re: [openstack-dev] [neutron] MTU native ovs firewall driver

2017-09-20 Thread Ajay Kalambur (akalambu)
So I was forced to explicitly set the MTU on br-int ovs-vsctl set int br-int mtu_request=9000 Without this the tap device added to br-int would get MTU 1500 Would this be something the ovs l2 agent can handle since it creates the bridge? Ajay On 9/20/17, 7:28 AM, "Ajay Kalambur (aka

[openstack-dev] [neutron] MTU native ovs firewall driver

2017-09-20 Thread Ajay Kalambur (akalambu)
Hi i am using large mtu setting of 9000. with the hybrid firewall driver i see large mtu set on both tap devices and the linuxbridges While i switch from ovs hybrid firewall driver to native ovs firewall driver i now see the tap device gets the default 1500 mtu i have the right setting for mtu

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-12 Thread Ajay Kalambur (akalambu)
ack-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Cc: "Ian Wells (iawells)" <iawe...@cisco.com<mailto:iawe...@cisco.com>> Subject: Re: [openstack-dev] [neutron]OVS connection tracking cleanup Can you start a bug on launchpad and upload the conntra

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-12 Thread Ajay Kalambur (akalambu)
v@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>> Cc: "Ian Wells (iawells)" <iawe...@cisco.com<mailto:iawe...@cisco.com>> Subject: Re: [openstack-dev] [neutron]OVS connection tracking cleanup Can you start a bug on launchpad and upload the conntrack atta

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-11 Thread Ajay Kalambur (akalambu)
s Ajay On Sep 11, 2017, at 9:49 AM, Kevin Benton <ke...@benton.pub<mailto:ke...@benton.pub>> wrote: The biggest improvement will be switching to native netlink calls: https://review.openstack.org/#/c/470912/ How many VMs were on a single compute node? On Mon, Sep 11, 2017 at

Re: [openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-11 Thread Ajay Kalambur (akalambu)
on a single compute node? On Mon, Sep 11, 2017 at 9:15 AM, Ajay Kalambur (akalambu) <akala...@cisco.com<mailto:akala...@cisco.com>> wrote: Hi I am performing a scale test and I see that after creating 500 Vms with ping traffic between them it took almost 1 hr for the connection trac

[openstack-dev] [neutron]OVS connection tracking cleanup

2017-09-11 Thread Ajay Kalambur (akalambu)
Hi I am performing a scale test and I see that after creating 500 Vms with ping traffic between them it took almost 1 hr for the connection tracking To clean up and ovs agent was busy doing this and unable to service any new port bind requests on some computes for almost an hr It took that long

Re: [openstack-dev] [nova] Compute Node restart

2017-04-26 Thread Ajay Kalambur (akalambu)
k-dev@lists.openstack.org<mailto:openstack-dev@lists.openstack.org>>, Ajay Kalambur <akala...@cisco.com<mailto:akala...@cisco.com>> Subject: Re: [openstack-dev] [nova] Compute Node restart On Apr 25, 2017 2:45 AM, "Ajay Kalambur (akalambu)" <akala...@cisco.co

[openstack-dev] [nova] Compute Node restart

2017-04-25 Thread Ajay Kalambur (akalambu)
Hi I see that when a host is gracefully rebooted nova-compute receives a lifecycle event to shutdown the instance and it updates the database with the state set to SHUTOFF. Now when compute node reboot and libvirt brings the VM back up nova checks its database and issues stop api and hence

[openstack-dev] [nova] Unit tests for a review

2017-01-12 Thread Ajay Kalambur (akalambu)
Hi I am looking into writing unit tests for a review https://review.openstack.org/#/c/387687/ Basically it modifies the deallocate for instance function to only deallocate ports to which this instance is bound to So this is more like a scenario test where the port is unbound outside of nova.

Re: [openstack-dev] Upgrade skip release

2016-12-19 Thread Ajay Kalambur (akalambu)
Hi Chris Thanks for the response. What were the specific problem areas you saw when upgrading from Kilo to Mitaka which were introduced by skipping Liberty? Ajay On 12/19/16, 12:36 PM, "Chris Friesen" <chris.frie...@windriver.com> wrote: >On 12/19/2016 01:56 PM, Ajay

[openstack-dev] Upgrade skip release

2016-12-19 Thread Ajay Kalambur (akalambu)
Hi Does openstack support skipping releases if one is performing a maintanance upgrade. Would alembic migrations work for instance from Liberty to Newton I think we would have to stop all existing services since API backward compatiblity is only 1 release front and back right? Ajay

[openstack-dev] [oslo] rabbitmq timeout

2016-11-15 Thread Ajay Kalambur (akalambu)
Hi We see an issue where if we boot 10 instances on 1 compute node at a time we see that sometimes a few instances error out on compute node with following Traceback It looks like the RPC message call from compute saying set Instance to Active is timing out. It seems to help to set rpc

Re: [openstack-dev] [openstack][nova] Port unbound from active VM

2016-10-17 Thread Ajay Kalambur (akalambu)
ck.org<mailto:openstack-dev@lists.openstack.org>> Subject: Re: [openstack-dev] [openstack][nova] Port unbound from active VM I suggest filing a bug against nova for this. On Thu, Oct 13, 2016 at 9:44 AM, Ajay Kalambur (akalambu) <akala...@cisco.com<mailto:akala...@cisco.com>>

[openstack-dev] [oslo] Heartbeat timeout

2016-10-16 Thread Ajay Kalambur (akalambu)
Hi In our setup we see the following message every second or 2 This cant be normal right? This means 30 heartbeats were missed since interval is 2 seconds. So in 60 seconds no heartbeat was sent. Is that how I interpret this message. I don’t see any Errors or Tracebacks related to oslo

Re: [openstack-dev] [openstack][nova] Port unbound from active VM

2016-10-13 Thread Ajay Kalambur (akalambu)
Any comments/input on this? Ajay From: Ajay Kalambur > Date: Monday, October 10, 2016 at 6:31 PM To: "OpenStack Development Mailing List (not for usage questions)" >

[openstack-dev] [openstack][nova] Port unbound from active VM

2016-10-10 Thread Ajay Kalambur (akalambu)
Hi There seems to be a corner case bug in nova code. Steps to reproduce it are 1. Create a neutron port 2. Create a VM and launch instance with this port 3. Shutdown nova compute and network agent on compute node 4. Unbind port from VM and delete the VM (offline delete) 5. Now

Re: [openstack-dev] [nova] VIF plugin issue _get_neutron_events

2016-10-08 Thread Ajay Kalambur (akalambu)
Hi Dan Thanks for the response. This is with one of our custom neutron ML2 mechanism drivers and that code is not yet upstream Nothing has changed in nova code though. We just use the Liberty version If I provide the nova and neutron logs would it be possible to provide some insights. I can log

Re: [openstack-dev] [nova] VIF plugin issue _get_neutron_events

2016-10-08 Thread Ajay Kalambur (akalambu)
Basically the issue is seen in the following three lines of nova compute log. For that port even though it received the vif plugging event 2 mins before it waits for it and blocks and times out Is there a race condition in the code that basically gets the events to wait for and the one where it

[openstack-dev] [nova] VIF plugin issue _get_neutron_events

2016-10-04 Thread Ajay Kalambur (akalambu)
Hi When booting Vms with 3 interfaces and when port binding happens quick enough I sometimes see that the first VM booted on a compute node gets stuck waiting for VIF plugging event but looking at the neutron logs the notification is sent and also nova responded with a 200 OK. When looking at

[openstack-dev] [neutron] port delete allowed on VM

2015-09-08 Thread Ajay Kalambur (akalambu)
Hi Today when we create a VM on a port and delete that port I don’t get a message saying Port in Use Is there a plan to fix this or is this expected behavior in neutron Is there a plan to fix this and if so is there a bug tracking this? Ajay

[openstack-dev] [manuals] Training guide issue

2015-02-24 Thread Ajay Kalambur (akalambu)
Hi I am trying to just get started with openstack commits and wanted to start by fixing some documentation bugs. I assigned 3 bugs which seem to be in the same file/area https://bugs.launchpad.net/openstack-training-guides/+bug/1380153

Re: [openstack-dev] [rally] Rally scenario for network scale with VMs

2014-12-18 Thread Ajay Kalambur (akalambu)
networks to created VM (which is just few lines of code). So task is quite easy resolvable now. Best regards, Boris Pavlovic On Wed, Nov 26, 2014 at 9:54 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi Is there a Rally scenario under works where we create N

Re: [openstack-dev] [rally] Rally scenario for network scale with VMs

2014-12-18 Thread Ajay Kalambur (akalambu)
regards, Boris Pavlovic On Fri, Dec 19, 2014 at 4:06 AM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: I created a new scenario which scales on network and VM at same time. If you have no objection I would like to send out a review this week I actually have

[openstack-dev] [rally] Rally scenario for network scale with VMs

2014-11-26 Thread Ajay Kalambur (akalambu)
Hi Is there a Rally scenario under works where we create N networks and associate N Vms with each network. This would be a decent stress tests of neutron Is there any such scale scenario in works I see scenario for N networks, subnet creation and a separate one for N VM bootups I am looking for

Re: [openstack-dev] [Rally] Question on periodic task

2014-11-26 Thread Ajay Kalambur (akalambu)
in work on this direction? Best regards, Boris Pavlovic On Fri, Nov 21, 2014 at 8:22 AM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Ok the action I wanted to perform was for HA I.e execute a scenario like VM boot and in parallel in a separate process , ssh

[openstack-dev] [Rally] Question on periodic task

2014-11-20 Thread Ajay Kalambur (akalambu)
Hi I have a question on /rally/openstack/common/periodic_task.py It looks like if I have a method decorated with @periodic_task my method would get scheduled in separate process every N seconds Now let us say we have a scenario and this periodic_task how does it work when concurrency=2 for

Re: [openstack-dev] [Rally] Question on periodic task

2014-11-20 Thread Ajay Kalambur (akalambu)
.. It's not that task Best regards, Boris Pavlovic On Fri, Nov 21, 2014 at 3:36 AM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi I have a question on /rally/openstack/common/periodic_task.py It looks like if I have a method decorated with @periodic_task my

[openstack-dev] [rally]Rally created tenant and users

2014-11-19 Thread Ajay Kalambur (akalambu)
Hi Is there a way to specify that the Rally created tenants and users and created with admin privileges Currently its created using member role and hence some admin operations are not allowed I want to specify that the account created has admin access Ajay

[openstack-dev] [Rally] Rally scenario question

2014-11-19 Thread Ajay Kalambur (akalambu)
Hi In rally I have 2 questions. When you use a context like example users: 2, tenant:2 I want the users and tenants to not be cleaned up but accumulated and cleaned up at end. Example create 1 user 1 tenant run tests create second user tenant run test and finally clean up user and tenant

Re: [openstack-dev] [rally][users]

2014-09-24 Thread Ajay Kalambur (akalambu)
when I finish. Best regards, Boris Pavlovic On Thu, Sep 25, 2014 at 5:02 AM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi Our default mode of execution of rally is allowing Rally to create a new user and tenant. Is there a way to have rally use the existing

Re: [openstack-dev] [rally][iperf] Benchmarking network performance

2014-09-07 Thread Ajay Kalambur (akalambu)
Benchmark configuration: %(config)s On Fri, Sep 5, 2014 at 7:46 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi mason What is the task you want to perform run commands after vm boot or run performance Based on that I can help with correct pointer Ajay

Re: [openstack-dev] [rally][iperf] Benchmarking network performance

2014-09-07 Thread Ajay Kalambur (akalambu)
are using old rally code. On Sun, Sep 7, 2014 at 10:33 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: The following context worked for me. context: { neutron_network: { network_cidr: 10.%s.0.0/16

Re: [openstack-dev] [rally][iperf] Benchmarking network performance

2014-09-05 Thread Ajay Kalambur (akalambu)
masoom.a...@gmail.commailto:masoom.a...@gmail.com wrote: Thanks Ajay I corrected this earlier. But facing another problem. Will forward paste in a while. On Friday, September 5, 2014, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Sorry there was typo in the patch

[openstack-dev] [rally] Parallel scenarios

2014-09-05 Thread Ajay Kalambur (akalambu)
Hi In Rally is there a way to run parallel scenarios? I know the scenario can support concurrency but I am talking about running multiple such scenarios themselves in parallel Ajay ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org

Re: [openstack-dev] [rally][iperf] Benchmarking network performance

2014-09-04 Thread Ajay Kalambur (akalambu)
://paste.openstack.org/show/106196/ On Thu, Sep 4, 2014 at 8:58 PM, Rick Jones rick.jon...@hp.commailto:rick.jon...@hp.com wrote: On 09/03/2014 11:47 AM, Ajay Kalambur (akalambu) wrote: Hi Looking into the following blueprint which requires that network performance tests be done as part of a scenario I

Re: [openstack-dev] Rally scenario Issue

2014-09-03 Thread Ajay Kalambur (akalambu)
the same scenario that you are working one, but getting the follow error: http://paste.openstack.org/show/105029/ Could you be of any help here? Thanks On Wed, Sep 3, 2014 at 4:16 AM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi Guys For the throughput tests

[openstack-dev] [rally][iperf] Benchmarking network performance

2014-09-03 Thread Ajay Kalambur (akalambu)
Hi Looking into the following blueprint which requires that network performance tests be done as part of a scenario I plan to implement this using iperf and basically a scenario which includes a client/server VM pair The client than sends out TCP traffic using iperf to server and the VM

Re: [openstack-dev] [rally]Rally scenario Issue

2014-08-29 Thread Ajay Kalambur (akalambu)
. On Fri, Aug 29, 2014 at 11:42 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi I am trying to run the Rally scenario boot-runcommand-delete. This scenario has the following code def boot_runcommand_delete(self, image, flavor, script

Re: [openstack-dev] [rally]Rally scenario Issue

2014-08-29 Thread Ajay Kalambur (akalambu)
. Please, note, that you should add the following part to your task JSON to enable Neutron context: ... context: { ... neutron_network: { network_cidr: 10.%s.0.0/16, } } ... Hope this will help. On Fri, Aug 29, 2014 at 11:42 PM, Ajay Kalambur (akalambu) akala

Re: [openstack-dev] [rally]Rally scenario Issue

2014-08-29 Thread Ajay Kalambur (akalambu)
to enable Neutron context: ... context: { ... neutron_network: { network_cidr: 10.%s.0.0/16, } } ... Hope this will help. On Fri, Aug 29, 2014 at 11:42 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi I am trying to run the Rally scenario

Re: [openstack-dev] Rally scenario Issue

2014-08-29 Thread Ajay Kalambur (akalambu)
: { ... neutron_network: { network_cidr: 10.%s.0.0/16, } } ... Hope this will help. On Fri, Aug 29, 2014 at 11:42 PM, Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com wrote: Hi I am trying to run the Rally scenario boot-runcommand-delete. This scenario has

[openstack-dev] Neutron permission issue

2014-07-11 Thread Ajay Kalambur (akalambu)
Hi As a tenant when I try to create a router and associate a gateway with the router as a two step process in Horizon things work fine. Now when I want to do the same thing through a create router API call with request below I get permission denied to create router { router: { name:

Re: [openstack-dev] Neutron permission issue

2014-07-11 Thread Ajay Kalambur (akalambu)
. From: Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com Date: Friday, 11 July 2014 10:05 To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Cc: openstack-systems-group(mailer list

Re: [openstack-dev] Neutron permission issue

2014-07-11 Thread Ajay Kalambur (akalambu)
issue Check /etc/neutron/policy.json, but I agree that's weird... -- Ian. From: Ajay Kalambur (akalambu) akala...@cisco.commailto:akala...@cisco.com Date: Friday, 11 July 2014 10:05 To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev

[openstack-dev] Tempest ipv6 tests

2014-06-11 Thread Ajay Kalambur (akalambu)
Hi Are there any tests available for ipv6 in Tempest. Also whats the road map for addition of these tests. Ajay ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev