[vpp-dev] 17.10 Release Dates and Features

[Florin Coras]

Folks, 

It’s that time again! We are compiling the list of features we plan to release 
in 17.10 and a release schedule. For more details, see the wiki page here [1].

Please feel free to add any features you are/will be working on and intend to 
release for 17.10. As always, the list serves as an indication of intent to the 
wider community and does not come with an implicit commitment to deliver said 
features within the release’s time frame. 

Regards, 
Florin (with the release manager hat on)

[1] https://wiki.fd.io/view/Projects/vpp/Release_Plans/Release_Plan_17.10 
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] vpp v17.07 ping assert

[Steve Heckman]

Neale,

Got it.

You're all set.

Thanks,

Steve


On 08/08/2017 02:22 PM, Neale Ranns (nranns) wrote:


Hi Steve,

No worries.

We use gerrit for our git interactions. In the gerrit link for that patch:

https://gerrit.fd.io/r/#/c/7661/ 



you’ll see a button for cherry pick, select it and enter the branch 
stable/1707. That’s it JWhen the CI jobs finish I can merge.


Thanks,

neale

*From: *Steve Heckman 
*Date: *Tuesday, 8 August 2017 at 19:16
*To: *"Neale Ranns (nranns)" ,
"vpp-dev@lists.fd.io" 
*Subject: *Re: [vpp-dev] vpp v17.07 ping assert

Neale,

Sorry, I'm a bit new to this.

I'm working with git cli. What GUI are you referring to? Eclipse/EGit?

This is the change:

mage removed by sender.

Mohammed Hawari>
07/18/2017 09:25:01 AM +0200

Committed by:John Lo>
07/27/2017 10:10:26 PM +

ping: fixing wrong value when there are worker threads - the
echo_reply_node is now notifying the cli process on the main
thread/vlib_main - the timestamp for the icmp reply is now
acquired in the echo_reply_node and not in the cli process to
avoid an off by 10ms error (see 【vpp-dev】delay is error in ping
with multi worker thread) Change-Id:
I21d37002b0376b4f2ccab08d8f04c2f2944b9b39 Signed-off-by: Mohammed
Hawari

I've seen references to gerrit-cherry-pick. Should I use that?
Thanks, -Steve

On 08/08/2017 01:00 PM, Neale Ranns (nranns) wrote:

Hi Steve,

Could you please press the cherry pick button on those review[s] to get 
them into stable/1707.

Thanks,

neale

-Original Message-

From:   on behalf of 
"Heckman, Steve" 

Date: Tuesday, 8 August 2017 at 17:01

To:"vpp-dev@lists.fd.io"    


Subject: Re: [vpp-dev] vpp v17.07 ping assert

 FWIW...I back-merged the changes to ping.[ch] from master to 17.07 
locally and now it works.

 


 -Steve

 


 -Original Message-

 From:vpp-dev-boun...@lists.fd.io 
  [mailto:vpp-dev-boun...@lists.fd.io] On 
Behalf Of Steve Heckman

 Sent: Tuesday, August 8, 2017 10:56 AM

 To:vpp-dev@lists.fd.io 

 Subject: [vpp-dev] vpp v17.07 ping assert

 


 I've been running into issues on certain servers where I get an 
assert:

 


 Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Main process exited, 
code=killed, status=6/ABRT Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Unit 
entered failed state.

 Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Failed with result 
'signal'.

 


 here in ping.c

 


vlib_process_signal_event (vm, pr->cli_process_id, event_type, 
bi0_copy);

 


 which calls vec_elt, where the assert actually occurs.

 


 /** \brief Get vector value at index i checking that i is in 
bounds. */

 #define vec_elt_at_index(v,i)   \

 ({  \

ASSERT ((i) < vec_len (v));   \

(v) + (i);\

 })

 


 /** \brief Get vector value at index i */ #define vec_elt(v,i) 
(vec_elt_at_index(v,i))[0]

 


 pr->cli_process_id is set in run_ping_ip46_address() and always 
seems to

 be 344.

 


uword curr_proc = vlib_current_process (vm);

 


 :

 


pr->cli_process_id = curr_proc;

 


 vec_len(v) seems to be 32 (Does that make sense?).

 


 Everything else seems to work OK. I can do "show interface (addr)", 
"show ip arp".

 


 Any ideas?

 


 This is stock apt install on Ubuntu 16.04 LTS on HPG9 and SMC 
servers with Intel 82599 NICs.

 


 Thanks,

 


 Steve Heckman

 


 Principal Software Engineer

 


 Arris

 


 

Re: [vpp-dev] vpp v17.07 ping assert

[Neale Ranns (nranns)]

Hi Steve,

No worries.

We use gerrit for our git interactions. In the gerrit link for that patch:
  https://gerrit.fd.io/r/#/c/7661/

you’ll see a button for cherry pick, select it and enter the branch 
stable/1707. That’s it ☺ When the CI jobs finish I can merge.

Thanks,
neale



From: Steve Heckman 
Date: Tuesday, 8 August 2017 at 19:16
To: "Neale Ranns (nranns)" , "vpp-dev@lists.fd.io" 

Subject: Re: [vpp-dev] vpp v17.07 ping assert


Neale,

Sorry, I'm a bit new to this.

I'm working with git cli. What GUI are you referring to? Eclipse/EGit?

This is the change:

[mage removed by sender.]
Mohammed Hawari >
07/18/2017 09:25:01 AM +0200
Committed by: John Lo >
07/27/2017 10:10:26 PM +

ping: fixing wrong value when there are worker threads - the echo_reply_node is 
now notifying the cli process on the main thread/vlib_main - the timestamp for 
the icmp reply is now acquired in the echo_reply_node and not in the cli 
process to avoid an off by 10ms error (see 【vpp-dev】delay is error in ping with 
multi worker thread) Change-Id: I21d37002b0376b4f2ccab08d8f04c2f2944b9b39 
Signed-off-by: Mohammed Hawari

I've seen references to gerrit-cherry-pick. Should I use that?

Thanks,

-Steve
On 08/08/2017 01:00 PM, Neale Ranns (nranns) wrote:

Hi Steve,



Could you please press the cherry pick button on those review[s] to get them 
into stable/1707.



Thanks,

neale



-Original Message-

From:  on 
behalf of "Heckman, Steve" 


Date: Tuesday, 8 August 2017 at 17:01

To: "vpp-dev@lists.fd.io" 


Subject: Re: [vpp-dev] vpp v17.07 ping assert



FWIW...I back-merged the changes to ping.[ch] from master to 17.07 locally 
and now it works.



-Steve



-Original Message-

From: vpp-dev-boun...@lists.fd.io 
[mailto:vpp-dev-boun...@lists.fd.io] On Behalf Of Steve Heckman

Sent: Tuesday, August 8, 2017 10:56 AM

To: vpp-dev@lists.fd.io

Subject: [vpp-dev] vpp v17.07 ping assert



I've been running into issues on certain servers where I get an assert:



Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Main process exited, 
code=killed, status=6/ABRT Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Unit 
entered failed state.

Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Failed with result 'signal'.



here in ping.c



   vlib_process_signal_event (vm, pr->cli_process_id, event_type, bi0_copy);



which calls vec_elt, where the assert actually occurs.



/** \brief Get vector value at index i checking that i is in bounds. */

#define vec_elt_at_index(v,i)   \

({  \

   ASSERT ((i) < vec_len (v));   \

   (v) + (i);\

})



/** \brief Get vector value at index i */ #define vec_elt(v,i) 
(vec_elt_at_index(v,i))[0]



pr->cli_process_id is set in run_ping_ip46_address() and always seems to

be 344.



   uword curr_proc = vlib_current_process (vm);



:



   pr->cli_process_id = curr_proc;



vec_len(v) seems to be 32 (Does that make sense?).



Everything else seems to work OK. I can do "show interface (addr)", "show 
ip arp".



Any ideas?



This is stock apt install on Ubuntu 16.04 LTS on HPG9 and SMC servers with 
Intel 82599 NICs.



Thanks,



Steve Heckman



Principal Software Engineer



Arris



___

vpp-dev mailing list

vpp-dev@lists.fd.io


https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.fd.io%2Fmailman%2Flistinfo%2Fvpp-dev=01%7C01%7CSteve.Heckman%40arris.com%7C07ca668477d64175ab0308d4de6db8ee%7Cf27929ade5544d55837ac561519c3091%7C1=vc%2Flg81kKLNwVjxd6n33tzkL5%2B%2BObfEhpnCg7y16zRA%3D=0

___

vpp-dev mailing list

vpp-dev@lists.fd.io


https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.fd.io%2Fmailman%2Flistinfo%2Fvpp-dev=01%7C01%7CSteve.Heckman%40arris.com%7C003ce87b5bd647d251da08d4de7eecee%7Cf27929ade5544d55837ac561519c3091%7C1=5W8hRzZRZazYdt1RnrpYkxhQOH7Ho0ABq%2FEQsN%2BqofU%3D=0





___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] vpp v17.07 ping assert

[Steve Heckman]

Neale,

Sorry, I'm a bit new to this.

I'm working with git cli. What GUI are you referring to? Eclipse/EGit?

This is the change:

Mohammed Hawari>
07/18/2017 09:25:01 AM +0200
Committed by:John Lo>
07/27/2017 10:10:26 PM +

ping: fixing wrong value when there are worker threads - the 
echo_reply_node is now notifying the cli process on the main 
thread/vlib_main - the timestamp for the icmp reply is now acquired in 
the echo_reply_node and not in the cli process to avoid an off by 10ms 
error (see 【vpp-dev】delay is error in ping with multi worker thread) 
Change-Id: I21d37002b0376b4f2ccab08d8f04c2f2944b9b39 Signed-off-by: 
Mohammed Hawari



I've seen references to gerrit-cherry-pick. Should I use that?

Thanks,

-Steve

On 08/08/2017 01:00 PM, Neale Ranns (nranns) wrote:

Hi Steve,

Could you please press the cherry pick button on those review[s] to get them 
into stable/1707.

Thanks,
neale

-Original Message-
From:  on behalf of "Heckman, Steve" 

Date: Tuesday, 8 August 2017 at 17:01
To: "vpp-dev@lists.fd.io" 
Subject: Re: [vpp-dev] vpp v17.07 ping assert

 FWIW...I back-merged the changes to ping.[ch] from master to 17.07 locally 
and now it works.
 
 -Steve
 
 -Original Message-

 From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] On 
Behalf Of Steve Heckman
 Sent: Tuesday, August 8, 2017 10:56 AM
 To: vpp-dev@lists.fd.io
 Subject: [vpp-dev] vpp v17.07 ping assert
 
 I've been running into issues on certain servers where I get an assert:
 
 Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Main process exited, code=killed, status=6/ABRT Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Unit entered failed state.

 Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Failed with result 'signal'.
 
 here in ping.c
 
vlib_process_signal_event (vm, pr->cli_process_id, event_type, bi0_copy);
 
 which calls vec_elt, where the assert actually occurs.
 
 /** \brief Get vector value at index i checking that i is in bounds. */

 #define vec_elt_at_index(v,i)   \
 ({  \
ASSERT ((i) < vec_len (v));   \
(v) + (i);\
 })
 
 /** \brief Get vector value at index i */ #define vec_elt(v,i) (vec_elt_at_index(v,i))[0]
 
 pr->cli_process_id is set in run_ping_ip46_address() and always seems to

 be 344.
 
uword curr_proc = vlib_current_process (vm);
 
 :
 
pr->cli_process_id = curr_proc;
 
 vec_len(v) seems to be 32 (Does that make sense?).
 
 Everything else seems to work OK. I can do "show interface (addr)", "show ip arp".
 
 Any ideas?
 
 This is stock apt install on Ubuntu 16.04 LTS on HPG9 and SMC servers with Intel 82599 NICs.
 
 Thanks,
 
 Steve Heckman
 
 Principal Software Engineer
 
 Arris
 
 ___

 vpp-dev mailing list
 vpp-dev@lists.fd.io
 
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.fd.io%2Fmailman%2Flistinfo%2Fvpp-dev=01%7C01%7CSteve.Heckman%40arris.com%7C07ca668477d64175ab0308d4de6db8ee%7Cf27929ade5544d55837ac561519c3091%7C1=vc%2Flg81kKLNwVjxd6n33tzkL5%2B%2BObfEhpnCg7y16zRA%3D=0
 ___
 vpp-dev mailing list
 vpp-dev@lists.fd.io
 
https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.fd.io%2Fmailman%2Flistinfo%2Fvpp-dev=01%7C01%7CSteve.Heckman%40arris.com%7C003ce87b5bd647d251da08d4de7eecee%7Cf27929ade5544d55837ac561519c3091%7C1=5W8hRzZRZazYdt1RnrpYkxhQOH7Ho0ABq%2FEQsN%2BqofU%3D=0
 



___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] vpp v17.07 ping assert

[Neale Ranns (nranns)]

Hi Steve,

Could you please press the cherry pick button on those review[s] to get them 
into stable/1707.

Thanks,
neale

-Original Message-
From:  on behalf of "Heckman, Steve" 

Date: Tuesday, 8 August 2017 at 17:01
To: "vpp-dev@lists.fd.io" 
Subject: Re: [vpp-dev] vpp v17.07 ping assert

FWIW...I back-merged the changes to ping.[ch] from master to 17.07 locally 
and now it works.

-Steve

-Original Message-
From: vpp-dev-boun...@lists.fd.io [mailto:vpp-dev-boun...@lists.fd.io] On 
Behalf Of Steve Heckman
Sent: Tuesday, August 8, 2017 10:56 AM
To: vpp-dev@lists.fd.io
Subject: [vpp-dev] vpp v17.07 ping assert

I've been running into issues on certain servers where I get an assert:

Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Main process exited, 
code=killed, status=6/ABRT Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Unit 
entered failed state.
Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Failed with result 'signal'.

here in ping.c

   vlib_process_signal_event (vm, pr->cli_process_id, event_type, bi0_copy);

which calls vec_elt, where the assert actually occurs.

/** \brief Get vector value at index i checking that i is in bounds. */
#define vec_elt_at_index(v,i)   \
({  \
   ASSERT ((i) < vec_len (v));   \
   (v) + (i);\
})

/** \brief Get vector value at index i */ #define vec_elt(v,i) 
(vec_elt_at_index(v,i))[0]

pr->cli_process_id is set in run_ping_ip46_address() and always seems to
be 344.

   uword curr_proc = vlib_current_process (vm);

:

   pr->cli_process_id = curr_proc;

vec_len(v) seems to be 32 (Does that make sense?).

Everything else seems to work OK. I can do "show interface (addr)", "show 
ip arp".

Any ideas?

This is stock apt install on Ubuntu 16.04 LTS on HPG9 and SMC servers with 
Intel 82599 NICs.

Thanks,

Steve Heckman

Principal Software Engineer

Arris

___
vpp-dev mailing list
vpp-dev@lists.fd.io

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.fd.io%2Fmailman%2Flistinfo%2Fvpp-dev=01%7C01%7CSteve.Heckman%40arris.com%7C07ca668477d64175ab0308d4de6db8ee%7Cf27929ade5544d55837ac561519c3091%7C1=vc%2Flg81kKLNwVjxd6n33tzkL5%2B%2BObfEhpnCg7y16zRA%3D=0
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev


___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] [csit-dev] "vpp-make-test-docs-verify-master" job failure

[Luke, Chris]

I'm not making any request; I'm merely positing ways forward to avoid the below 
issue, assuming this is in fact what the issue is.

Chris.

> -Original Message-
> From: Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> [mailto:ksek...@cisco.com]
> Sent: Tuesday, August 08, 2017 11:47 AM
> To: Dave Barach (dbarach) ; Luke, Chris
> ; csit-...@lists.fd.io
> Cc: vpp-dev@lists.fd.io
> Subject: RE: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master" job
> failure
> 
> Are you suggesting we put all the dependent python packages as part of the
> vpp source code tree then?
> Or is this request aimed at the test box maintainers?
> 
> Thanks,
> Klement
> 
> Quoting Luke, Chris (2017-08-08 17:04:57)
> > Sure, I know what pip is.
> >
> > My contention is that virtualenv should not be going to the network; in the
> old days it would dip into the system packages for anything the base venv
> needed. It's a really poor and insecure assumption that unfettered internet
> access is universally available. In this case, I suspect wherever the job runs
> needs an HTTP proxy to fit that assumption.
> >
> > So either pre-stage the packages you need, and tell pip where to find
> > them, or provide a proxy. :)
> >
> > Chris.
> >
> >
> > > -Original Message-
> > > From: Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > > [mailto:ksek...@cisco.com]
> > > Sent: Tuesday, August 08, 2017 10:51 AM
> > > To: Dave Barach (dbarach) ; Luke, Chris
> > > ; csit-...@lists.fd.io
> > > Cc: vpp-dev@lists.fd.io
> > > Subject: RE: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master"
> > > job failure
> > >
> > > Think of pip (used by virtualenv) like apt-get.  Python maintainers
> > > are innocent in this case. When adding the virtualenv feature to
> > > test framework, it never occured to me that somebody might be doing
> > > vpp development on an offline machine. Laptop which was online and
> > > later went offline doesn't count, because virtualenv uses cached
> > > versions for subsequent installations afaik.
> > >
> > > If this is a requirement, we'll need to think of a way to ship the
> > > python packages which virtualenv requires - e.g. setuptools - ourselves.
> > > But if we do that, we also need to have all the other packages which
> > > the test framework uses (e.g. scapy) somewhere in-tree(?).
> > >
> > > The packages currently used by test framework (apart from the
> > > implicit
> > > requirements) are:
> > >
> > > scapy==2.3.3 pexpect subprocess32 cffi
> > > git+https://github.com/klement/py-lispnetworking@setup
> > >
> > > the last one is a fork of py-lispnetworking, which is used by some
> > > LISP tests. I forked it and added an installation script, which was
> > > missing in the original repo so that we can install it in the same way as
> other packages.
> > >
> > > I have a strong feeling that this isn't something which we want to do...
> > >
> > > Klement
> > >
> > > Quoting Luke, Chris (2017-08-08 16:31:31)
> > > > I've seen precisely this issue with Python's virtualenv whenever
> > > > the host
> > > doesn't have internet access while the venv is being created; I work
> > > around it using an HTTP proxy, though requiring internet access just
> > > to create a venv seems like a particularly braindead decision by the
> Python maintainers.
> > > >
> > > > Chris.
> > > >
> > > > > -Original Message-
> > > > > From: csit-dev-boun...@lists.fd.io
> > > > > [mailto:csit-dev-boun...@lists.fd.io] On Behalf Of Klement
> > > > > Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > > > > Sent: Tuesday, August 08, 2017 8:23 AM
> > > > > To: Dave Barach (dbarach) ;
> > > > > csit-...@lists.fd.io
> > > > > Cc: vpp-dev@lists.fd.io
> > > > > Subject: Re: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master"
> > > > > job failure
> > > > >
> > > > > Looks to me like a bug in the urllib3 python library while
> > > > > reporting some kind of connection failure.. never seen it before..
> > > > >
> > > > > Klement
> > > > >
> > > > > Quoting Dave Barach (dbarach) (2017-08-08 14:05:16)
> > > > > >Please see [1]https://gerrit.fd.io/r/#/c/7885,
> > > > > >[2]https://jenkins.fd.io/job/vpp-make-test-docs-verify-
> > > > > master/2814/console.
> > > > > >
> > > > > >
> > > > > >
> > > > > >Any idea what this is all about?
> > > > > >
> > > > > >
> > > > > >
> > > > > >Thanks… Dave
> > > > > >
> > > > > >
> > > > > >
> > > > > > References
> > > > > >
> > > > > >Visible links
> > > > > >1. https://gerrit.fd.io/r/#/c/7885
> > > > > >2.
> > > > > > https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/281
> > > > > > 4/co
> > > > > > nsol
> > > > > > e
> > > > > ___
> > > > > csit-dev mailing list
> > > > > csit-...@lists.fd.io
> > > > > https://lists.fd.io/mailman/listinfo/csit-dev

[vpp-dev] tap_injection + VLan

[Marcelo Siena]

Hi All,.

 

I used plugin router for tap_injetcion, its works verfy well, except for VLans 
(sub-interfaces).

 

The VLans interfaces don’t reflect to userspace, so it don’t work.

 

How can I do tap_injection work in conjuction with VLans?

 

Best regars,

 

Marcelo Siena

 

___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] [csit-dev] "vpp-make-test-docs-verify-master" job failure

[Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)]

Are you suggesting we put all the dependent python packages as part of
the vpp source code tree then?
Or is this request aimed at the test box maintainers?

Thanks,
Klement

Quoting Luke, Chris (2017-08-08 17:04:57)
> Sure, I know what pip is.
> 
> My contention is that virtualenv should not be going to the network; in the 
> old days it would dip into the system packages for anything the base venv 
> needed. It's a really poor and insecure assumption that unfettered internet 
> access is universally available. In this case, I suspect wherever the job 
> runs needs an HTTP proxy to fit that assumption.
> 
> So either pre-stage the packages you need, and tell pip where to find them, 
> or provide a proxy. :)
> 
> Chris.
> 
> 
> > -Original Message-
> > From: Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > [mailto:ksek...@cisco.com]
> > Sent: Tuesday, August 08, 2017 10:51 AM
> > To: Dave Barach (dbarach) ; Luke, Chris
> > ; csit-...@lists.fd.io
> > Cc: vpp-dev@lists.fd.io
> > Subject: RE: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master" job
> > failure
> > 
> > Think of pip (used by virtualenv) like apt-get.  Python maintainers are
> > innocent in this case. When adding the virtualenv feature to test framework,
> > it never occured to me that somebody might be doing vpp development on
> > an offline machine. Laptop which was online and later went offline doesn't
> > count, because virtualenv uses cached versions for subsequent installations
> > afaik.
> > 
> > If this is a requirement, we'll need to think of a way to ship the python
> > packages which virtualenv requires - e.g. setuptools - ourselves.
> > But if we do that, we also need to have all the other packages which the 
> > test
> > framework uses (e.g. scapy) somewhere in-tree(?).
> > 
> > The packages currently used by test framework (apart from the implicit
> > requirements) are:
> > 
> > scapy==2.3.3 pexpect subprocess32 cffi
> > git+https://github.com/klement/py-lispnetworking@setup
> > 
> > the last one is a fork of py-lispnetworking, which is used by some LISP 
> > tests. I
> > forked it and added an installation script, which was missing in the 
> > original
> > repo so that we can install it in the same way as other packages.
> > 
> > I have a strong feeling that this isn't something which we want to do...
> > 
> > Klement
> > 
> > Quoting Luke, Chris (2017-08-08 16:31:31)
> > > I've seen precisely this issue with Python's virtualenv whenever the host
> > doesn't have internet access while the venv is being created; I work around 
> > it
> > using an HTTP proxy, though requiring internet access just to create a venv
> > seems like a particularly braindead decision by the Python maintainers.
> > >
> > > Chris.
> > >
> > > > -Original Message-
> > > > From: csit-dev-boun...@lists.fd.io
> > > > [mailto:csit-dev-boun...@lists.fd.io] On Behalf Of Klement Sekera -X
> > > > (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > > > Sent: Tuesday, August 08, 2017 8:23 AM
> > > > To: Dave Barach (dbarach) ; csit-...@lists.fd.io
> > > > Cc: vpp-dev@lists.fd.io
> > > > Subject: Re: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master"
> > > > job failure
> > > >
> > > > Looks to me like a bug in the urllib3 python library while reporting
> > > > some kind of connection failure.. never seen it before..
> > > >
> > > > Klement
> > > >
> > > > Quoting Dave Barach (dbarach) (2017-08-08 14:05:16)
> > > > >Please see [1]https://gerrit.fd.io/r/#/c/7885,
> > > > >[2]https://jenkins.fd.io/job/vpp-make-test-docs-verify-
> > > > master/2814/console.
> > > > >
> > > > >
> > > > >
> > > > >Any idea what this is all about?
> > > > >
> > > > >
> > > > >
> > > > >Thanks… Dave
> > > > >
> > > > >
> > > > >
> > > > > References
> > > > >
> > > > >Visible links
> > > > >1. https://gerrit.fd.io/r/#/c/7885
> > > > >2.
> > > > > https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/2814/co
> > > > > nsol
> > > > > e
> > > > ___
> > > > csit-dev mailing list
> > > > csit-...@lists.fd.io
> > > > https://lists.fd.io/mailman/listinfo/csit-dev
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] https://gerrit.fd.io/r/#/c/7856/ Review gerrit please

[Neale Ranns (nranns)]

Merged.

Thanks,
neale

From:  on behalf of Thomas F Herbert 

Date: Tuesday, 8 August 2017 at 16:05
To: vpp-dev 
Subject: [vpp-dev] https://gerrit.fd.io/r/#/c/7856/ Review gerrit please


All:

Could someone please review this patch?

https://gerrit.fd.io/r/#/c/7856/

I have some additional dependent patches on this patch to submit.

--TFH

--
Thomas F Herbert
NFV and Fast Data Planes
Office of Technology
Red Hat
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

[vpp-dev] https://gerrit.fd.io/r/#/c/7856/ Review gerrit please

[Thomas F Herbert]

All:

Could someone please review this patch?

https://gerrit.fd.io/r/#/c/7856/

I have some additional dependent patches on this patch to submit.

--TFH


--
*Thomas F Herbert*
NFV and Fast Data Planes
Office of Technology
*Red Hat*
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] [csit-dev] "vpp-make-test-docs-verify-master" job failure

[Luke, Chris]

Sure, I know what pip is.

My contention is that virtualenv should not be going to the network; in the old 
days it would dip into the system packages for anything the base venv needed. 
It's a really poor and insecure assumption that unfettered internet access is 
universally available. In this case, I suspect wherever the job runs needs an 
HTTP proxy to fit that assumption.

So either pre-stage the packages you need, and tell pip where to find them, or 
provide a proxy. :)

Chris.


> -Original Message-
> From: Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> [mailto:ksek...@cisco.com]
> Sent: Tuesday, August 08, 2017 10:51 AM
> To: Dave Barach (dbarach) ; Luke, Chris
> ; csit-...@lists.fd.io
> Cc: vpp-dev@lists.fd.io
> Subject: RE: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master" job
> failure
> 
> Think of pip (used by virtualenv) like apt-get.  Python maintainers are
> innocent in this case. When adding the virtualenv feature to test framework,
> it never occured to me that somebody might be doing vpp development on
> an offline machine. Laptop which was online and later went offline doesn't
> count, because virtualenv uses cached versions for subsequent installations
> afaik.
> 
> If this is a requirement, we'll need to think of a way to ship the python
> packages which virtualenv requires - e.g. setuptools - ourselves.
> But if we do that, we also need to have all the other packages which the test
> framework uses (e.g. scapy) somewhere in-tree(?).
> 
> The packages currently used by test framework (apart from the implicit
> requirements) are:
> 
> scapy==2.3.3 pexpect subprocess32 cffi
> git+https://github.com/klement/py-lispnetworking@setup
> 
> the last one is a fork of py-lispnetworking, which is used by some LISP 
> tests. I
> forked it and added an installation script, which was missing in the original
> repo so that we can install it in the same way as other packages.
> 
> I have a strong feeling that this isn't something which we want to do...
> 
> Klement
> 
> Quoting Luke, Chris (2017-08-08 16:31:31)
> > I've seen precisely this issue with Python's virtualenv whenever the host
> doesn't have internet access while the venv is being created; I work around it
> using an HTTP proxy, though requiring internet access just to create a venv
> seems like a particularly braindead decision by the Python maintainers.
> >
> > Chris.
> >
> > > -Original Message-
> > > From: csit-dev-boun...@lists.fd.io
> > > [mailto:csit-dev-boun...@lists.fd.io] On Behalf Of Klement Sekera -X
> > > (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > > Sent: Tuesday, August 08, 2017 8:23 AM
> > > To: Dave Barach (dbarach) ; csit-...@lists.fd.io
> > > Cc: vpp-dev@lists.fd.io
> > > Subject: Re: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master"
> > > job failure
> > >
> > > Looks to me like a bug in the urllib3 python library while reporting
> > > some kind of connection failure.. never seen it before..
> > >
> > > Klement
> > >
> > > Quoting Dave Barach (dbarach) (2017-08-08 14:05:16)
> > > >Please see [1]https://gerrit.fd.io/r/#/c/7885,
> > > >[2]https://jenkins.fd.io/job/vpp-make-test-docs-verify-
> > > master/2814/console.
> > > >
> > > >
> > > >
> > > >Any idea what this is all about?
> > > >
> > > >
> > > >
> > > >Thanks… Dave
> > > >
> > > >
> > > >
> > > > References
> > > >
> > > >Visible links
> > > >1. https://gerrit.fd.io/r/#/c/7885
> > > >2.
> > > > https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/2814/co
> > > > nsol
> > > > e
> > > ___
> > > csit-dev mailing list
> > > csit-...@lists.fd.io
> > > https://lists.fd.io/mailman/listinfo/csit-dev
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

[vpp-dev] vpp v17.07 ping assert

[Steve Heckman]

I've been running into issues on certain servers where I get an assert:

Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Main process exited, 
code=killed, status=6/ABRT

Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Unit entered failed state.
Aug 08 09:51:52 p5s3 systemd[1]: vpp.service: Failed with result 'signal'.

here in ping.c

  vlib_process_signal_event (vm, pr->cli_process_id, event_type, 
bi0_copy);


which calls vec_elt, where the assert actually occurs.

/** \brief Get vector value at index i checking that i is in bounds. */
#define vec_elt_at_index(v,i)   \
({  \
  ASSERT ((i) < vec_len (v));   \
  (v) + (i);\
})

/** \brief Get vector value at index i */
#define vec_elt(v,i) (vec_elt_at_index(v,i))[0]

pr->cli_process_id is set in run_ping_ip46_address() and always seems to 
be 344.


  uword curr_proc = vlib_current_process (vm);

:

  pr->cli_process_id = curr_proc;

vec_len(v) seems to be 32 (Does that make sense?).

Everything else seems to work OK. I can do "show interface (addr)", 
"show ip arp".


Any ideas?

This is stock apt install on Ubuntu 16.04 LTS on HPG9 and SMC servers 
with Intel 82599 NICs.


Thanks,

Steve Heckman

Principal Software Engineer

Arris

___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] [csit-dev] "vpp-make-test-docs-verify-master" job failure

[Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)]

Think of pip (used by virtualenv) like apt-get.  Python maintainers
are innocent in this case. When adding the virtualenv feature to test
framework, it never occured to me that somebody might be doing vpp development
on an offline machine. Laptop which was online and later went offline doesn't
count, because virtualenv uses cached versions for subsequent installations
afaik.

If this is a requirement, we'll need to think of a way to ship the python
packages which virtualenv requires - e.g. setuptools - ourselves.
But if we do that, we also need to have all the other packages which the
test framework uses (e.g. scapy) somewhere in-tree(?).

The packages currently used by test framework (apart from the implicit
requirements) are:

scapy==2.3.3 pexpect subprocess32 cffi
git+https://github.com/klement/py-lispnetworking@setup

the last one is a fork of py-lispnetworking, which is used by some LISP
tests. I forked it and added an installation script, which was missing
in the original repo so that we can install it in the same way as other
packages.

I have a strong feeling that this isn't something which we want to do...

Klement

Quoting Luke, Chris (2017-08-08 16:31:31)
> I've seen precisely this issue with Python's virtualenv whenever the host 
> doesn't have internet access while the venv is being created; I work around 
> it using an HTTP proxy, though requiring internet access just to create a 
> venv seems like a particularly braindead decision by the Python maintainers.
> 
> Chris.
> 
> > -Original Message-
> > From: csit-dev-boun...@lists.fd.io [mailto:csit-dev-boun...@lists.fd.io] On
> > Behalf Of Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> > Sent: Tuesday, August 08, 2017 8:23 AM
> > To: Dave Barach (dbarach) ; csit-...@lists.fd.io
> > Cc: vpp-dev@lists.fd.io
> > Subject: Re: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master" job
> > failure
> > 
> > Looks to me like a bug in the urllib3 python library while reporting some 
> > kind
> > of connection failure.. never seen it before..
> > 
> > Klement
> > 
> > Quoting Dave Barach (dbarach) (2017-08-08 14:05:16)
> > >Please see [1]https://gerrit.fd.io/r/#/c/7885,
> > >[2]https://jenkins.fd.io/job/vpp-make-test-docs-verify-
> > master/2814/console.
> > >
> > >
> > >
> > >Any idea what this is all about?
> > >
> > >
> > >
> > >Thanks… Dave
> > >
> > >
> > >
> > > References
> > >
> > >Visible links
> > >1. https://gerrit.fd.io/r/#/c/7885
> > >2.
> > > https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/2814/consol
> > > e
> > ___
> > csit-dev mailing list
> > csit-...@lists.fd.io
> > https://lists.fd.io/mailman/listinfo/csit-dev
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] acl-plugin now uses its own memory heap (master & stable/1707)

[Andrew  Yourtchenko]

Hi Burt,

Makes sense. Quickly looking at the code it shouldn't be affecting,
but that file should be indeed with everything else.

So I rebuilt it from 48_8 one in the master, and the gerrit is here:
https://gerrit.fd.io/r/#/c/7937/

Hopefully Damjan can review and +2 it.

--a

On 8/8/17, Burt Silverman  wrote:
> Hi Andrew,
>
> As long as you mention issues in acl plugin, I found something strange in
> bihash_40_8.h: there is no definition of BIHASH_KVP_CACHE_SIZE. So when you
> get to bihash_template.h, that will be obtaining BIHASH_KVP_CACHE_SIZE from
> whatever bihash_x_y.h happens to be last in the included header files. I
> don't know the operational ramifications, but it is not pretty to look at!
> Can you confirm my observation? I am looking at master.
>
> Burt
>
> On Tue, Aug 8, 2017 at 6:49 AM, Andrew  Yourtchenko 
> wrote:
>
>> Hi all,
>>
>> Just a heads-up: I am currently working on a few issues in acl-plugin
>> that the system testing as part of the open stack setup has uncovered,
>> one of them was a memory corruption in the new hash-table based
>> matching code. Those are always a pain to debug also because they of
>> course can trip up a completely different part of code than what
>> caused it.
>>
>> So, as part of the of the fix (https://gerrit.fd.io/r/#/c/7928/ &
>> https://gerrit.fd.io/r/#/c/7817/) , I also moved the ACL plugin to use
>> its own heap (actually two: one for the new "hash-table match" stuff,
>> and one for all the rest (including the sessions). This is to improve
>> the isolation with the other parts of VPP and simplify triage - in
>> theory, now anything caused by acl-plugin should affect just the
>> ACL-plugin.
>>
>> It was a big-ish patch for a stable branch, but I decided the
>> serviceability win is very well worth it.
>>
>> I've added the "show acl-plugin memory" command which tells about the
>> state of affairs in those heaps.
>>
>> --a
>> ___
>> vpp-dev mailing list
>> vpp-dev@lists.fd.io
>> https://lists.fd.io/mailman/listinfo/vpp-dev
>>
>
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] [csit-dev] "vpp-make-test-docs-verify-master" job failure

[Luke, Chris]

I've seen precisely this issue with Python's virtualenv whenever the host 
doesn't have internet access while the venv is being created; I work around it 
using an HTTP proxy, though requiring internet access just to create a venv 
seems like a particularly braindead decision by the Python maintainers.

Chris.

> -Original Message-
> From: csit-dev-boun...@lists.fd.io [mailto:csit-dev-boun...@lists.fd.io] On
> Behalf Of Klement Sekera -X (ksekera - PANTHEON TECHNOLOGIES at Cisco)
> Sent: Tuesday, August 08, 2017 8:23 AM
> To: Dave Barach (dbarach) ; csit-...@lists.fd.io
> Cc: vpp-dev@lists.fd.io
> Subject: Re: [csit-dev] [vpp-dev] "vpp-make-test-docs-verify-master" job
> failure
> 
> Looks to me like a bug in the urllib3 python library while reporting some kind
> of connection failure.. never seen it before..
> 
> Klement
> 
> Quoting Dave Barach (dbarach) (2017-08-08 14:05:16)
> >Please see [1]https://gerrit.fd.io/r/#/c/7885,
> >[2]https://jenkins.fd.io/job/vpp-make-test-docs-verify-
> master/2814/console.
> >
> >
> >
> >Any idea what this is all about?
> >
> >
> >
> >Thanks… Dave
> >
> >
> >
> > References
> >
> >Visible links
> >1. https://gerrit.fd.io/r/#/c/7885
> >2.
> > https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/2814/consol
> > e
> ___
> csit-dev mailing list
> csit-...@lists.fd.io
> https://lists.fd.io/mailman/listinfo/csit-dev
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

Re: [vpp-dev] 回复: vpp cpu usage utility

[Raju-dev grishma]

dpdk-input   polling   13176087868
3432988412  0  1.11e3 .26

The above line says polling is going good for RX. Only 26% times it could
get the packets. So I think this is a clue that you still have CPU left. =>
Dave & team can confirm ...

 drops   36931507
 rx-miss 22942665

Regarding above errors, I am not sure how these errors strings are mapped
to Device errors. I tired to check the driver code ..but could not nail
down. Again Dave & team can throw some info on these.
rx-miss => I think this is hardware interrupts missed on the CPU core.


Regards


On Mon, Aug 7, 2017 at 4:57 PM, SAKTHIVEL ANAND S 
wrote:

> Hi Dave, Thanks for your inputs..
> I just experimenting based on your inputs.. when i push < 7Gbps i don't
> see any packet losses on dpdk side and the vector/call is still ~1.1. As
> you mentioned <2.0,means has lot of room left..
> then i just increased the traffic to achieve bit rate of about  8gbps to 9
> gbps and started seeing dpdk packet drops. ( "rx missed" in show hardware
> as well as "drops" in show interfaces.
>
> can you tel me, what i have missed here and why dpdk is dropping , even
> though system has lot of cpu space?
> Also pls guide me to understand why vectors/call is not increasing ?
>
> here is the full o/p
> *root@ubuntu:~# vppctl sh ha*
>   NameIdx   Link  Hardware
> TenGigabitEthernet3/0/05 up   TenGigabitEthernet3/0/0
>   Ethernet address 14:02:ec:73:ea:d0
>   Intel X710/XL710 Family
> carrier up full duplex speed 1 mtu 9216
>
> tx frames ok 159
> tx bytes ok 9540
> rx frames ok  3429247504
> rx bytes ok4501655515148
> rx missed   22942665
> rx multicast frames ok   193
> extended stats:
>   rx good packets 3429247703
>   tx good packets159
>   rx good bytes4501655766820
>   tx good bytes 9540
>   rx unicast packets  3452190013
>   rx multicast packets   193
>   rx broadcast packets 3
>   rx unknown protocol packets 3452190211
>   tx unicast packets 159
>   rx size 64 packets 161
>   rx size 128 to 255 packets 193
>   rx size 1024 to 1522 packets3452189888
>   tx size 64 packets 159
> TenGigabitEthernet3/0/16 up   TenGigabitEthernet3/0/1
>   Ethernet address 14:02:ec:73:ea:d8
>   Intel X710/XL710 Family
> carrier up full duplex speed 1 mtu 9216
>
> tx frames ok  3389859164
> tx bytes ok4298341418744
> rx frames ok 194
> rx bytes ok36344
> rx multicast frames ok   193
> extended stats:
>   rx good packets194
>   tx good packets 3389859164
>   rx good bytes36344
>   tx good bytes4298341418744
>   rx unicast packets   1
>   rx multicast packets   193
>   rx unknown protocol packets194
>   tx unicast packets  3389859163
>   tx broadcast packets 1
>   rx size 64 packets   1
>   rx size 128 to 255 packets 193
>   tx size 64 packets   1
>   tx size 1024 to 1522 packets3389859163
> local0 0down  local0
>   local
> pg/stream-01down  pg/stream-0
>   Packet generator
> pg/stream-12down  pg/stream-1
>   Packet generator
> pg/stream-23down  pg/stream-2
>   Packet generator
> pg/stream-34down  pg/stream-3
>   Packet generator
> root@ubuntu:~# vppctl sh int
>   Name   Idx   State  Counter
> Count
> TenGigabitEthernet3/0/0   5 up   rx
> packets3430406350
>  rx bytes
> 4473249467216
>  tx
> packets   159
>   

Re: [vpp-dev] vppctl bug?

[Billy McFall]

I am seeing this same issue on stable/1707 but can't reproduce on master. I
tried to back port a couple patches from master back to stable/1707 to see
if they fixed it but haven't been able to pinpoint the fix. Does anyone
know if this was purposely fixed on master?

Billy McFall

On Thu, Jul 13, 2017 at 2:34 PM, Yichen Wang (yicwang) 
wrote:

> [Resend]
>
>
>
> This is 100% reproducible, and kind of blocking our automation. Anyone
> knows the reason?
>
>
>
> Thanks very much!
>
>
>
> Regards,
>
> Yichen
>
>
>
> *From: *"Yichen Wang (yicwang)" 
> *Date: *Tuesday, July 11, 2017 at 14:51
> *To: *Denis Lotarev via vpp-dev 
> *Subject: *vppctl bug?
>
>
>
> Hi, VPP folks,
>
>
>
> Using a pretty new VPP 17.07-rc2 RPM:
>
> neutron_vpp_8422 [root@sjc04-pod6-compute-1 /]# vppctl show ver verbose
>
> Version:  v17.07-rc2~3-g0786710~b20
>
> Compiled by:  jenkins
>
> Compile host: centos7-basebuild-4c-4g-489
>
> Compile date: Thu Jul  6 18:21:54 UTC 2017
>
> Compile location: /w/workspace/vpp-merge-1707-centos7
>
> Compiler: GCC 4.8.5 20150623 (Red Hat 4.8.5-11)
>
> Current PID:  69
>
>
>
> When I use “telnet 0 5002” I can see all information are returned
> correctly, but with vppctl, the same CLI just like break in the middle.
> Looks like a bug in vppctl, 100% reproducible:
>
> [root@sjc04-pod6-compute-1 /]# vppctl show int rx-placement
>
> Thread 1 (vpp_wk_0
>
> [root@sjc04-pod6-compute-1 /]#
>
>
>
> Thanks very much!
>
>
>
> Regards,
>
> Yichen
>
> ___
> vpp-dev mailing list
> vpp-dev@lists.fd.io
> https://lists.fd.io/mailman/listinfo/vpp-dev
>



-- 
*Billy McFall*
SDN Group
Office of Technology
*Red Hat*
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

[vpp-dev] "vpp-make-test-docs-verify-master" job failure

[Dave Barach (dbarach)]

Please see https://gerrit.fd.io/r/#/c/7885, 
https://jenkins.fd.io/job/vpp-make-test-docs-verify-master/2814/console.

Any idea what this is all about?

Thanks... Dave

___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev

[vpp-dev] acl-plugin now uses its own memory heap (master & stable/1707)

[Andrew  Yourtchenko]

Hi all,

Just a heads-up: I am currently working on a few issues in acl-plugin
that the system testing as part of the open stack setup has uncovered,
one of them was a memory corruption in the new hash-table based
matching code. Those are always a pain to debug also because they of
course can trip up a completely different part of code than what
caused it.

So, as part of the of the fix (https://gerrit.fd.io/r/#/c/7928/ &
https://gerrit.fd.io/r/#/c/7817/) , I also moved the ACL plugin to use
its own heap (actually two: one for the new "hash-table match" stuff,
and one for all the rest (including the sessions). This is to improve
the isolation with the other parts of VPP and simplify triage - in
theory, now anything caused by acl-plugin should affect just the
ACL-plugin.

It was a big-ish patch for a stable branch, but I decided the
serviceability win is very well worth it.

I've added the "show acl-plugin memory" command which tells about the
state of affairs in those heaps.

--a
___
vpp-dev mailing list
vpp-dev@lists.fd.io
https://lists.fd.io/mailman/listinfo/vpp-dev