Re: [EXTERNAL] Re: [vpp-dev] Issue with cloning repo on VM

2021-02-21 Thread Chris Luke via lists.fd.io 
Rajesh,

It looks like a local system issue, nothing to do with git or gerrit per se.

Your system is tell you it’s not letting you create that file. You should 
investigate that. I believe it’s out of scope for this list I’m afraid.

Chris.

From: vpp-dev@lists.fd.io  On Behalf Of Rajesh Dawadi via 
lists.fd.io
Sent: Sunday, February 21, 2021 09:19
To: vpp-dev@lists.fd.io; vpp-dev-inter...@cisco.com
Subject: [EXTERNAL] Re: [vpp-dev] Issue with cloning repo on VM

Hi, Has anyone faced similar issues when trying to clone on an Ubuntu VM? All 
the options suggested on google search didnt work, both https and ssh clone 
didnt work even after adding a new ssh public key.
Thanks,
Rajesh

On Sunday, February 14, 2021, 2:54:15 p.m. EST, Rajesh Dawadi 
mailto:dwdraj...@yahoo.com>> wrote:


Hi,
I am trying to setup the VPP repo on a Ubuntu VM running on MAC host and was 
trying to follow the steps mentioned here for "Pulling code via authenticated 
https": 
https://wiki.fd.io/view/VPP/Pulling,_Building,_Running,_Hacking_and_Pushing_VPP_Code

 However, I face 2 issues with both authenticated and the anonymous cloning 
with git.
1. git clone fails with error " git clone 
https://gerrit.fd.io/r/vpp
Cloning into 'vpp'...
remote: Counting objects: 93, done
fatal: Unable to create temporary file 
'/home/rajesh/vpp_ubuntu/repo/vpp/.git/objects/pack/tmp_pack_XX': Operation 
not permitted
fatal: index-pack failed" .
I tried to add chmod on the .git directory but it didn't help.

2. With authenticated https, it fails at the authentication step itself, even 
though the same username/password credential works for the Linux Foundation 
account at:
git clone 
https://dwdraj...@gerrit.fd.io/r/a/vpp
Cloning into 'vpp'...
Password for 'https://dwdraj...@gerrit.fd.io': 

remote: Unauthorized
fatal: Authentication failed for 
'https://gerrit.fd.io/r/a/vpp/'"

Any one faced similar issue with Ubuntu VM on MAC ?
Thanks a lot ,
Rajesh
"

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#18777): https://lists.fd.io/g/vpp-dev/message/18777
Mute This Topic: https://lists.fd.io/mt/80803544/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] Issue with cloning repo on VM

2021-02-21 Thread Rajesh Dawadi via lists.fd.io 
 Hi, Has anyone faced similar issues when trying to clone on an Ubuntu VM? All 
the options suggested on google search didnt work, both https and ssh clone 
didnt work even after adding a new ssh public key.
Thanks,
Rajesh

On Sunday, February 14, 2021, 2:54:15 p.m. EST, Rajesh Dawadi 
 wrote:  
 
 Hi,I am trying to setup the VPP repo on a Ubuntu VM running on MAC host and 
was trying to follow the steps mentioned here for "Pulling code via 
authenticated https": 
https://wiki.fd.io/view/VPP/Pulling,_Building,_Running,_Hacking_and_Pushing_VPP_Code
 However, I face 2 issues with both authenticated and the anonymous cloning 
with git.1. git clone fails with error " git clone 
https://gerrit.fd.io/r/vppCloning into 'vpp'...remote: Counting objects: 93, 
donefatal: Unable to create temporary file 
'/home/rajesh/vpp_ubuntu/repo/vpp/.git/objects/pack/tmp_pack_XX': Operation 
not permittedfatal: index-pack failed" .I tried to add chmod on the .git 
directory but it didn't help.
2. With authenticated https, it fails at the authentication step itself, even 
though the same username/password credential works for the Linux Foundation 
account at: git clone https://dwdraj...@gerrit.fd.io/r/a/vppCloning into 
'vpp'...Password for 'https://dwdraj...@gerrit.fd.io': remote: 
Unauthorizedfatal: Authentication failed for 'https://gerrit.fd.io/r/a/vpp/'"
Any one faced similar issue with Ubuntu VM on MAC ? 
Thanks a lot ,Rajesh"  

-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#18776): https://lists.fd.io/g/vpp-dev/message/18776
Mute This Topic: https://lists.fd.io/mt/80638501/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-

Re: [vpp-dev] VPP 20.09 os_out_of_memory() in clib_bihash_add_del_16_8 in IPv4 Shallow Virtual reassembly code

2021-02-21 Thread Dave Barach 
That's right. In 20.09, bihash did its own os-level memory allocation. You 
could (probably) pick up and port src/vppinfra/bihash*.[ch] to 20.09, or you 
could add some config knobs to the reassembly code. 

If switching to 21.01 is an option, that seems like the path of least 
resistance.

HTH... Dave

-Original Message-
From: vpp-dev@lists.fd.io  On Behalf Of Elias Rudberg
Sent: Friday, February 19, 2021 12:10 PM
To: v...@barachs.net; vpp-dev@lists.fd.io
Subject: Re: [vpp-dev] VPP 20.09 os_out_of_memory() in clib_bihash_add_del_16_8 
in IPv4 Shallow Virtual reassembly code

Thanks Dave, however it looks like BIHASH_USE_HEAP does not exist in VPP 20.09 
but was introduced later. Looks like it appeared with the commit 2454de2d4 
"vppinfra: use heap to store bihash data" which was after 20.09 was released.

I guess this means that bihash data is not stored on the heap in VPP 20.09. 
Maybe switching to VPP 21.01 would help with this issue then, or at least with 
21.01 all of our main heap space would need to be consumed before we get 
another os_out_of_memory() SIGABRT crash?

/ Elias


On Fri, 2021-02-19 at 09:56 -0500, v...@barachs.net wrote:
> See ../src/vppinfra/bihash_16_8.h:
> 
> #define BIHASH_USE_HEAP 1
> 
> The the sv reassembly bihash table configuration appears to be 
> hardwired, and complex enough to satisfy the cash customers. If the 
> number of buckets is way too low for your use-case, bihash is capable 
> of wasting a considerable amount of memory.
> 
> Suggest that you ping Klement Sekera, it's his code...
> 
> D.
> 
> -Original Message-
> From: vpp-dev@lists.fd.io  On Behalf Of Elias 
> Rudberg
> Sent: Friday, February 19, 2021 7:41 AM
> To: vpp-dev@lists.fd.io
> Subject: [vpp-dev] VPP 20.09 os_out_of_memory() in
> clib_bihash_add_del_16_8 in IPv4 Shallow Virtual reassembly code
> 
> Hello VPP experts,
> 
> We have a problem with VPP 20.09 crashing with SIGABRT, this happened 
> several times lately but we do not have an exact way of reproducing 
> it. Here is a backtrace from gdb:
> 
> Thread 10 "vpp_wk_7" received signal SIGABRT, Aborted.
> [Switching to Thread 0x7feac47f8700 (LWP 6263)] __GI_raise (
> sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
> #0  __GI_raise (sig=sig@entry=6) at
> ../sysdeps/unix/sysv/linux/raise.c:51
> #1  0x74044921 in __GI_abort () at abort.c:79
> #2  0xc640 in os_panic () at src/vpp/vnet/main.c:368
> #3  0x77719229 in alloc_aligned_16_8 (h=0x77b79990 
> , nbytes=) at
> src/vppinfra/bihash_template.c:34
> #4  0x7771b650 in value_alloc_16_8 (h=0x77b79990 
> , log2_pages=4) at
> src/vppinfra/bihash_template.c:356
> #5  0x7771b43a in split_and_rehash_16_8 (h=0x77b79990 
> , old_values=0x7ff87c7b0d40, old_log2_pages=3,
> new_log2_pages=4) at src/vppinfra/bihash_template.c:453
> #6  0x77710f84 in clib_bihash_add_del_inline_with_hash_16_8
> (h=0x77b79990 , add_v=0x7ffbf2088c60, 
> hash=, is_add=, is_stale_cb=0x0,
> arg=0x0) at src/vppinfra/bihash_template.c:765
> #7  clib_bihash_add_del_inline_16_8 (h=0x77b79990 
> , add_v=0x7ffbf2088c60, is_add=, 
> is_stale_cb=0x0, arg=0x0) at src/vppinfra/bihash_template.c:857
> #8  clib_bihash_add_del_16_8 (h=0x77b79990 , 
> add_v=0x7ffbf2088c60, is_add=) at
> src/vppinfra/bihash_template.c:864
> #9  0x766795ec in ip4_sv_reass_find_or_create (vm= out>, rm=, rt=, kv=,
> do_handoff=) at src/vnet/ip/reass/ip4_sv_reass.c:364
> #10 ip4_sv_reass_inline (vm=, node=, 
> frame=, is_feature=255, is_output_feature=false,
> is_custom=false) at src/vnet/ip/reass/ip4_sv_reass.c:726
> #11 ip4_sv_reass_node_feature_fn_skx (vm=, 
> node=, frame=) at
> src/vnet/ip/reass/ip4_sv_reass.c:919
> #12 0x75ac806e in dispatch_node (vm=0x7ffbf1e74400, 
> node=0x7ffbf2553fc0, type=VLIB_NODE_TYPE_INTERNAL, 
> dispatch_state=VLIB_NODE_STATE_POLLING, frame=, 
> last_time_stamp=) at src/vlib/main.c:1194
> #13 dispatch_pending_node (vm=0x7ffbf1e74400, 
> pending_frame_index=, last_time_stamp=) 
> at src/vlib/main.c:1353
> #14 vlib_main_or_worker_loop (vm=0x7ffbf1e74400, is_main=0) at
> src/vlib/main.c:1846
> #15 vlib_worker_loop (vm=0x7ffbf1e74400) at src/vlib/main.c:1980
> 
> The line at bihash_template.c:34 is "os_out_of_memory ()".
> 
> If VPP calls "os_out_of_memory()" at that point in the code, what does 
> that mean, is there some way we could configure VPP to allow it to use 
> more memory for this kind of allocations?
> 
> We have plenty of physical memory available and the main heap 
> ("heapsize" in startup.conf) has already been set to a large value but 
> maybe this part of the code is using some other kind of memory 
> allocation, not using the main heap? How do we know if this particular 
> allocation is using the main heap or not?
> 
> Best regards,
> Elias
> 


-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#18775): https://lists.fd.io/g/vpp-dev/message/18775
Mute This Topic: