Hi all,
We recently worked on GTPU tunnel and our target is to create 2M tunnels. It is
not as easy as it looks like, and it took us quite some time to figure it out.
The biggest problem we found is about mheap, which as you know is the low layer
memory management function of vPP. We believe it
s quite some time to figure it out. In the
end, we manage to add 2M tunnels & 2M routes in 250s.
Hope it helps.
Regard,
Kingwel
From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of Neale Ranns
Sent: Wednesday, April 18, 2018 4:33 PM
To: xyxue ; Kingwel Xie
Cc: vpp-dev@lists.f
Hi Damjan,
We will do it asap. Actually we are quite new to vPP and even don’t know how to
make bug report and code contribution or so.
Regards,
Kingwel
From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of Damjan
Marion
Sent: Wednesday, April 18, 2018 11:30 PM
To: Kingwel Xie
Thanks for the comments. Please see mine in line.
From: Neale Ranns (nranns) [mailto:nra...@cisco.com]
Sent: Wednesday, April 18, 2018 9:18 PM
To: Kingwel Xie ; xyxue
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] questions in configuring tunnel
Hi Kingwei,
Thank you for your analysis. Some
Get it. Will look into it. It will take a few days…
I’ll ask someone in the team to commit the code, then ask for your review.
From: Neale Ranns (nranns) [mailto:nra...@cisco.com]
Sent: Thursday, April 19, 2018 4:30 PM
To: Kingwel Xie ; Damjan Marion (damarion)
Cc: vpp-dev@lists.fd.io
Subject
align_offset);
if (r != MHEAP_GROUNDED) return r;
}));
/* *INDENT-ON* */
}
return MHEAP_GROUNDED;
}
From: vpp-dev@lists.fd.io [mailto:vpp-dev@lists.fd.io] On Behalf Of xyxue
Sent: Thursday, April 19, 2018 4:02 PM
To: Kingwel Xie ; nranns
Cc: vpp-dev
Subject: Re: [vpp-dev] question
size. However, I wouldn’t recommend you to do so, because you just
need 100K.
Hope it helps, instead of confusing you.
Regards,
Kingwel
From: 薛欣颖 [mailto:xy...@fiberhome.com]
Sent: Thursday, April 19, 2018 7:43 PM
To: Kingwel Xie ; nranns
Cc: vpp-dev
Subject: Re: Re: [vpp-dev] questions in
-
From: Neale Ranns (nranns) [mailto:nra...@cisco.com]
Sent: Thursday, April 19, 2018 9:06 PM
To: Kingwel Xie ; xyxue
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] questions in configuring tunnel
Hi Kingwei,
[nr] if you skip this then the tunnels are not part of the FIB graph and hence
any
.
Regards,
Kingwel
From: Kingwel Xie
Sent: Thursday, April 19, 2018 9:20 AM
To: Damjan Marion
Cc: vpp-dev@lists.fd.io
Subject: RE: [vpp-dev] mheap performance issue and fixup
Hi Damjan,
We will do it asap. Actually we are quite new to vPP and even don’t know how to
make bug report and code
23, 2018 3:25 PM
To: Kingwel Xie ; Damjan Marion ;
nranns
Cc: vpp-dev
Subject: Re: Re: [vpp-dev] mheap performance issue and fixup
Hi Kingwel,
After I merged the three patch ,there is a SIGSEGV when I startup vpp (not
every time). And the error didn't appear before .
Is there anything I c
Hi Damjan and all,
We are currently thinking of how to utilize the handoff mechanism to serve our
application logic – to run a packet re-ordering and re-transmit queue in the
same worker context to avoid any lock between threads. We come across with a
question when looking into the implementati
, April 23, 2018 6:25 PM
To: Ole Troan ; Kingwel Xie
Cc: vpp-dev ; Lollita Liu
Subject: Re: [vpp-dev] Question of worker thread handoff
Yes, there are 2 options when handoff queue is full, drop or wait.
Wait gives you nice back-pressure mechanism as it will slow down input worker,
but it will
ollita thought there might be some improvement we can do to
the handoff queue. Please Lollita share what you found.
Regards,
Kingwel
From: Damjan Marion (damarion) [mailto:damar...@cisco.com]
Sent: Monday, April 23, 2018 8:32 PM
To: Kingwel Xie
Cc: Ole Troan ; vpp-dev ; Lollita
Liu
Subject: Re: [v
Hi,
We managed to link with openssl 1.1 successfully. The OS is ubuntu 16.04.
Basically we downloaded v1.1, and built it. Then make some changes to vpp
makefile pointing to the correct header and lib files.
V1.0.2 is still there for the other apps, but vpp is working with v1.1.
Regards,
Kingwe
Hi,
You should increase heap size. In startup.conf, heapsize 1g or something like
that.
When running in multi-core environment, vpp definitely need more memory,
because some global variables have to be expanded to have multiple copies - per
worker thread. F.g., Interface Counters, Error counte
Hi all,
We are working on improving gtpu plugin, to make it better comply with 3GPP
standard.
Here is the brief of what we have done:
1. Path management – gtpu-process was added
2. Error indication
3. Bi-direction TEID
4. Some bug fixes
I’m thinking of pushing up-stream the improv
Well, it would take a dew days. Just realized we have to pass the review
process in Ericsson…
Will get it done asap.
From: Ni, Hongjun
Sent: Friday, June 08, 2018 5:54 PM
To: Edward Warnicke ; Kingwel Xie
; vpp-dev@lists.fd.io
Cc: Yao, Chengqiang
Subject: RE: [vpp-dev] GTPu
Thanks Kingwei
Hi all,
I'm wondering if it can be accepted by the community.
Every time when vPP crashes for some reason, core dump file can be used for
further analysis. However, core file is usually big and even unfortunately
isn't generated. A trick we used before is to generate a crash dump file to
indic
o: Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Integration with libbacktrace
What is the difference between libunwind and libbacktrace?
I can see that libunwind is available as package on ubuntu, and libbacktrace is
not...
> On 11 Jun 2018, at 11:41, Kingwel Xie wrote
vpp/build-data/../src/vppinfra/longjmp.S:110
#13 0x7fffb7234920 in ?? ()
#14 0x778db978 in vlib_process_startup (vm=0x28, p=0x1, f=0x0) at
/home/vppshare/kingwel/vpp/build-data/../src/vlib/main.c:1253
-Original Message-
From: vpp-dev@lists.fd.io On Behalf Of Kingwel Xie
Sent: Mo
0x113
#13 0x7f87222bd5a0 format + 0xb8
#14 0x7f872259614a shm_name_from_svm_map_region_args + 0x32d
Aborted (core dumped)
Makefile:446: recipe for target 'run' failed
From: Damjan Marion
Sent: Thursday, June 14, 2018 8:31 PM
To: Dave Barach ; Kingwel Xie
Cc: vpp-dev
Subjec
Hi,
My colleague Liu Anhua has done the patch:
https://gerrit.fd.io/r/#/c/13134/
Couldn’t add Chengqiang as reviewer, gerrit says he/she can not be identified.
Regards,
Kingwel
From: Ni, Hongjun
Sent: Friday, June 08, 2018 5:54 PM
To: Edward Warnicke ; Kingwel Xie
; vpp-dev@lists.fd.io
Cc
Hi all,
I'm proposing some improvements to CLI commands 'show interface' and 'show
error'.
As you might have known, these two commands show the cumulative counters of
interfaces and errors. Unfortunately there are no rate statistics for these
counters, which makes it hard to know how fast vPP
Well, I’ll check it further to see how to make use of the new infra.
From: Ole Troan
Sent: Wednesday, June 27, 2018 5:15 PM
To: Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Packet rate & throughput satistics for SW interfaces &
Error Counters
Hi Kingwei,
Did you see
: Damjan Marion ; Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: RE: [vpp-dev] mheap performance issue and fixup
+1.
It would be super-helpful if you were to add test cases to
.../src/vppinfra/test_mheap.c, and push a draft patch so we can reproduce / fix
the problem(s).
Thanks... Dave
From: vpp-dev
ingwel
From: Dave Barach (dbarach)
Sent: Thursday, June 28, 2018 9:06 PM
To: Kingwel Xie ; Damjan Marion
Cc: vpp-dev@lists.fd.io
Subject: RE: [vpp-dev] mheap performance issue and fixup
Allocating a large number of 16 byte objects @ 64 byte alignment will never
work very well. If you pad the
Hi Vamsi, Damjan,
I’d like to contribute my two cents about IPSEC. We have been working on the
improvement for quite some time.
1. Great that vPP supports IPSEC, but the code is mainly for PoC. It lacks
of many features: buffer chain, AES-GCM/AES-CTR, UDP encap (seems already there
in mast
all of them.
Regards,
Kingwel
From: vpp-dev@lists.fd.io On Behalf Of Damjan Marion
Sent: Monday, July 02, 2018 7:43 PM
To: Kingwel Xie
Cc: Vamsi Krishna ; Jim Thompson ; Dave
Barach ; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Is VPP IPSec implementation thread safe?
--
Damjan
On 2 Jul 2018
Tuesday, July 03, 2018 5:14 PM
To: Kingwel Xie
Cc: Vamsi Krishna ; Jim Thompson ; Dave
Barach ; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Is VPP IPSec implementation thread safe?
On 3 Jul 2018, at 02:36, Kingwel Xie
mailto:kingwel@ericsson.com>> wrote:
Hi Damjan,
Thanks for the
: Damjan Marion
Sent: Friday, July 06, 2018 6:14 PM
To: Kingwel Xie
Cc: Vamsi Krishna ; Jim Thompson ; Dave
Barach ; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Is VPP IPSec implementation thread safe?
We don't use recycle anymore (except at one place), mainly due ot the issue how
dpdk
Hi Damijan,
Thanks for the great job done. It is now much faster.
We noticed a difference between using cmake and automake in the latest code:
Vppinfra/qsort.c is included in vppinfra/CMakefile.txt but not in vppinfra.am,
which creates a situation that cmake image would be linked to the qsort.c
Marion via Lists.Fd.Io
mailto:dmarion=me@lists.fd.io>> wrote:
Dear Kingwei,
That should be easy to fix. Can you just remove it and submit patch, so i can
merge it?
Thanks,
--
Damjan
On 7 Sep 2018, at 02:39, Kingwel Xie
mailto:kingwel@ericsson.com>> wrote:
Hi Damijan,
Well, you should really look for the discussion about IKE/IPSec this mailing
list had before.
I can put it this way:
1. vPP IKEv2/IPSEC is PoC quality, meaning it is far from a carrier grade
product
2. No SNMP support, you got to do it by yourself
3. Performance is good though, but st
Hi,
I worked on testing IP reassembly recently, the hit a crash when testing IP
reassembly with IPSec. It took me some time to figure out why.
The crash only happens when there are >1 feature node enabled under ip-unicast
and ip reassembly is working, like below.
ip4-unicast:
ip4-reassembly-
Ok. I'll find some time tomorrow to push a patch fixing both v4 and v6.
-Original Message-
From: Klement Sekera
Sent: Tuesday, September 25, 2018 6:02 PM
To: Kingwel Xie ; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] A bug in IP reassembly?
Hi Kingwel,
thanks for finding this bug.
Hi vPPers,
I’m looking at the latest changes in IPSEC, and I notice ip4 and ip6 nodes are
separated. So there are a lot of code in the node function like this:
if (is_ip6)
vlib_node_increment_counter (vm, esp6_decrypt_node.index,
ing node counters
来自: "Dave Barach (dbarach)"
发至: 2018年11月2日 下午7:00
抄送: Kingwel Xie ,vpp-dev@lists.fd.io
Yes, you missed something. This pattern is used in inline functions called with
compile-time constant values for is_ip6:
always_inline uword
ah_encrypt_inline (vli
Thanks for the education. will look into the assembly code.
原始邮件
主题: Re: [vpp-dev] Incrementing node counters
来自: "Dave Barach via Lists.Fd.Io"
发至: 2018年11月3日 下午7:55
抄送: Kingwel Xie ,vpp-dev@lists.fd.io
You’ll have to look at the instruction stream in gdb or else “g
Hi dear Damjan,
I'm looking at the DPDK IPSec code, and occasionally I got a strange behavior
of the memory pools created by dpdk_pool_create.
After some time hard debugging, I think there might be a potential overrun
issue in clib_pmalloc_create_shared_arena.
This is the modified code:
return
Hi Damjan and vPPers,
I got a question about the physical mem management in vPP.
As I understand, we specify socket-mem in startup.conf for DPDK to allocate mem
for itself, but we are using vPP phymem allocator for mbuf and crypto PMDs if
vdev is specified. The latter consist of crypto op , ses
thanks. then those pools can be moved to dpdk socket-mem, I guess.
I'll submit a patch soon.
原始邮件
主题: Re: [vpp-dev] dpdk socket-mem and dpdk_pool_create
来自: Damjan Marion
发至: 2018年11月25日 下午8:06
抄送: Kingwel Xie
> On 25 Nov 2018, at 05:23, Kingwel Xie wrote:
>
Hi Dave,
I’m looking at the perfmon plugin. It is a fantastic tool tuning node
performance, extremely helpful. Thanks for the great contribution.
Here I got a question about ‘cpu-cycles’ event. It shows very different results
if comparing with clocks of ‘show run’. Around 20% slower. I checked
of our colleagues from Intel can explain the difference.
D.
From: vpp-dev@lists.fd.io<mailto:vpp-dev@lists.fd.io>
mailto:vpp-dev@lists.fd.io>> On Behalf Of Kingwel Xie
Sent: Tuesday, December 11, 2018 5:18 AM
To: Dave Barach (dbarach) mailto:dbar...@cisco.com>>;
vpp-dev mailto:vpp-d
Hi Avinash,
I happened to look at the patch recently. To my understanding, it is valuable,
cool stuff, as it allows offloading crypto to other cpu cores. Therefore, more
throughput can be archieved. A question, you patched the dpdk ring to mp and
mc, why not mp and sc?
Hi Damjan,
I guess the
itself always
introduces massive data cache misses, even worse than compare-swap. However,
handoff is always worthwhile in some case even there is penalty.
Appreciate you can share your opinion.
Regards,
Kingwel
From: Damjan Marion
Sent: Tuesday, December 18, 2018 1:03 AM
To: Kingwel Xie
Cc
bigger and more flexible ring size.
Sorry I changed the subject, it doesn’t strictly follow the original one any
more.
Regards,
Kingwel
From: vpp-dev@lists.fd.io On Behalf Of Damjan Marion via
Lists.Fd.Io
Sent: Tuesday, December 18, 2018 3:12 PM
To: Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: Re
Hi Avinash,
My question about the MP/MC ring flag that you made a patch to DPDK, any
comments?
I’d like them to be MP/SC, as we always have only one consumer.
Regards,
Kingwel
From: vpp-dev@lists.fd.io On Behalf Of Gonsalves, Avinash
(Nokia - IN/Bangalore)
Sent: Tuesday, December 18, 2018 3:
0 1.19e1 256.00
ppf-sdap-encap active 4105410509824
0 2.64e1 256.00
From: Damjan Marion
Sent: Tuesday, December 18, 2018 5:18 PM
To: Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: Re: vPP handoff discussion
Possibly,
Hi Matthew,
The patch (https://gerrit.fd.io/r/#/c/16287/) was intended to allocate crypto
mem pool from DPDK, instead of from vPP. I guess you are using 2MB huge page,
so you are experiencing out of memory with new patch created by Damjan. Please
switch to 1GB, to see if it still happens.
Hi D
how much you need with
socket-mem option.
Hi Damjan,
Thanks for the heads-up.
Regards,
Kingwel
From: vpp-dev@lists.fd.io On Behalf Of Kingwel Xie
Sent: Friday, December 21, 2018 11:04 AM
To: dmar...@me.com; Matthew Smith
Cc: vpp-dev@lists.fd.io
Subject: Non-compliant mail - action required
multiple vPP processes.
I think it is not an expected behavior.
Regards,
Kingwel
原始邮件
主题: Re: [vpp-dev] dpdk: switch to in-memory mode, deprecate use of socket-mem
来自: "Dave Barach via Lists.Fd.Io"
发至: 2018年12月23日 上午12:37
抄送: Kingwel Xie ,dmar...@me.com,Matthew Smith
Hi Damjan,
I noticed you removed the quick path from dpdk-input to ip-input/mpls-input,
after you merged the patch of ethernet-input optimization. Therefore, all
packets now have to go through ethernet-input. It would take a few more cpu
clocks than before.
Please elaborate why making this cha
vlan tagging, would you like to consider using the HW rx and tx offload to
optimize the vlan sub-interface?
Reagrds,
Kingwel
原始邮件
主题: Re: [vpp-dev] ethernet-input on master branch
来自: "Damjan Marion via Lists.Fd.Io"
发至: 2019年1月7日 下午5:23
抄送: Kingwel Xie
On 5 Jan 2019
Many thanks for the sharing. Yes, as you pointed out, it might not worthwhile
to do offload for vlan.
Regards,
Kingwel
From: Damjan Marion
Sent: Monday, January 07, 2019 9:18 PM
To: Kingwel Xie
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] ethernet-input on master branch
On 7 Jan 2019
Just like the regular interface you are using:
create sub-interfaces eth0 181
set interface state eth0.181 up
set interface ip address eth0.181 18.1.0.141/24
ip route add 0.0.0.0/0 via 18.1.0.1 eth0.181
Note there is some performance penalty using vlan sub-intf. As I can see on my
setup, > 10% o
Simply because most CLI commands and API handlers are marked as not is_mp_safe,
hence they are actually protected by vlib_worker_thread_barrier_sync.
So to speak, node functions are temporally stopped and waiting when CLI/API is
being executed.
You should take a look at: vlib_worker_thread_barr
Hi Dave and all,
I'm looking at a buffer trace issue with DPDK IPSEC. It turns out the flag
VLIB_FRAME_TRACE is broken in vlib_next_frame_change_ownership().
The node path in my setup is: pg-input -> ip-input -> ip-lookup -> ... ->
dkdp-esp-encrypt -> cryptodev -> crypto-input -> ip-lookup ->
rship
来自: "Dave Barach (dbarach)"
发至: 2019年1月23日 下午8:49
抄送: Kingwel Xie ,vpp-dev
As you've probably noticed, the buffer manager has been under active
development. That may or may not have anything to do with the issue.
Please follow the bug reporting process:
https://wiki.fd.io
, type ethernet/IP4, address size 6/4
de:ad:00:00:00:00/18.1.0.71 -> 00:00:00:00:00:00/18.1.0.241
00:00:53:961126: error-drop
arp-input: IP4 source address matches local interface
From: Dave Barach (dbarach)
Sent: Wednesday, January 23, 2019 11:33 PM
To: Kingwel Xie ; vpp-de
nce. Please confirm if this is
expected behavior of frame ownership.
Regards,
Kingwel
From: vpp-dev@lists.fd.io On Behalf Of Dave Barach via
Lists.Fd.Io
Sent: Friday, January 25, 2019 4:52 AM
To: Kingwel Xie ; vpp-dev
Cc: vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] Question ab
First, performance. Second, still performance, you can use QAT with dpdk IPSEC.
Also note that dpdk ipsec doesn’t support AH. And, dpdk ipsec support GCM, but
native one doesn’t.
There is the 3rd one, ipsecmb ipsec, which provides even better performance if
using SW ciphering/hashing only. It c
Thanks, Dave. Crystally clear! It is a deliberate design, indeed.
Regards,
Kingwel
原始邮件
主题: RE: [vpp-dev] Question about vlib_next_frame_change_ownership
来自: "Dave Barach (dbarach)"
发至: 2019年1月25日 下午9:03
抄送: Kingwel Xie ,vpp-dev
Dear Kingwei,
On a per-thread basis
Thanks, for the optimizations. Will try verifying it on my setup.
From: vpp-dev@lists.fd.io On Behalf Of Damjan Marion via
Lists.Fd.Io
Sent: Saturday, January 26, 2019 1:09 AM
To: vpp-dev
Cc: vpp-dev@lists.fd.io
Subject: [vpp-dev] RFC: buffer manager rework
I am very close to the finish line
input nodes produce very different
numbers of packets, e.g. 99 and 1. Anyhow, the code doesn’t work that way and
isn’t going to work that way, so I digress...
Thanks... Dave
From: Kingwel Xie mailto:kingwel@ericsson.com>>
Sent: Friday, January 25, 2019 5:13 AM
To: Dave Barach (dba
Has anyone noticed that dpdk ipsec doesn't work on the master code?
A quick debug session shows it might be a problem of dpdk1902 API changes.
Will come back with a patch later. Probably need a week. Holiday...
原始邮件
主题: Re: [vpp-dev] VPP register node change upper limit
来自: "D
Hi vpp-dev,
I’m looking at the ip-rewrite node, and I think it might be a bug at:
vnet_rewrite_one_header (adj0[0], ip0, sizeof (ethernet_header_t));
The adj-> rewrite_header.data_bytes might be 0 when it comes to tunnel
interface, f.g., gtpu, ipsec. Thus, at least 8 bytes garbage are written t
Thanks. Look forward to the fix…
From: Dave Barach (dbarach)
Sent: Tuesday, March 05, 2019 8:25 PM
To: Kingwel Xie ; vpp-dev@lists.fd.io
Subject: RE: ip-rewrite bug?
Let’s try to fix the underlying code in vnet_rewrite_one_header, and friends.
The code already checks for the magic rewrite
Thanks. Very helpful.
-Original Message-
From: vpp-dev@lists.fd.io On Behalf Of Maciek
Konstantynowicz (mkonstan) via Lists.Fd.Io
Sent: 2019年3月12日 23:55
To: csit-dev ; vpp-dev ;
disc...@lists.fd.io
Cc: vpp-dev@lists.fd.io
Subject: [vpp-dev] Published: Tech paper - "Benchmarking SW Data
Well, I can not open the xz file. It is always 32B…
Anyway, patch 17889 should be always included if you want to use IPSec
cryptodev.
From: vpp-dev@lists.fd.io On Behalf Of Jan Gelety via
Lists.Fd.Io
Sent: 2019年3月19日 0:25
To: Dave Barach (dbarach) ; Kingwel Xie
; yuwei1.zh...@intel.com
Cc
Looks like your are running an old vPP…
You can check phymem allocation by running CLI:
vpp# show physmem
vpp# show dpdk physmem
The master code is managing phymem by itself, in other words, allocating
buffers from huge pages hold by vPP instead of DPDK. Typically, it will use 2
huge pages unl
70 matches
Mail list logo