Re: [Users] openvz 7> centos 8 container

2020-06-10 Thread mailinglist
Yes im shure every mount point is duplicated.
If i look at /proc/1009/mounts 
I see all entrys of /etc/fstab
And after that again the entrys

In /etc/fstab and /proc/mount the entrys are not duplicated

umount /var/www/clients/client449/web1440/log
then the entry is gone
cat /proc/1009/mounts | grep web1440

and if i do:
mount /var/www/clients/client449/web1440/log
the lines are back
cat /proc/1009/mounts | grep web1440
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0

So it looks like that the mount command runs twice... but how


If i look on the node
cat /proc/self/mountinfo  | grep ploop
178 51 182:518529 / /vz/root/1 rw,relatime shared:154 - ext4
/dev/ploop32408p1 rw,data=ordered,balloon_ino=12
55 51 182:347185 / /vz/root/2 rw,relatime shared:34 - ext4 /dev/ploop21699p1
rw,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,grpjquota=a
quota.group


And on the vps.. 578 lines all unique

Very very strange

-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: woensdag 10 juni 2020 16:22
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

Hi Steffan,

On 06/10/2020 03:51 PM, mailingl...@tikklik.nl wrote:
> Just noticed your script is not completely correct Total number of 
> mounts: 28169 is not counting as it should be.

Yes, i've already written it in my previous mail, there is a mistake in the
script.
=
 > On 06/09/2020 01:32 PM, Konstantin Khorenko wrote:
 > > Total number of mounts: 28169
 >
 > He-he, there is a mistake in the script - "Total number of mounts" prints
sum of pids.
 > But ok, the real sum of mounts is 1+.
=

> But  when looking at the mounts there is something  strange
>
> Every pidhas all mountpoint twice
>
> cat /proc/1009/mounts | grep web1440
> /dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4 
> rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.u
> ser,gr
> pjquota=aquota.group 0 0
> /dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4 
> rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.u
> ser,gr
> pjquota=aquota.group 0 0

Are you sure really *every* mount entry is duplicated?
If really *all* mounts are duplicated, then it's strange.
But i guess not all of them are duplicated.

 > /dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4 ...
This is a bindmount, so i think someone just did 2 bindmounts to the same
place, that's it.

May be you've started the software 2 times and first time it was not
gracefully shutdowned and did not unmount "old" mounts, i've no idea
honestly.

Or may be someone did on CT start something like "mount -o bind / /", and
after that every mount in a CT will be shown twice due to propagation.

Example:
[root@localhost ~]# mount -o bind / /

[root@localhost ~]# cat /proc/self/mountinfo  | grep ploop
153 62 182:503793 / / rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12
264 153 182:503793 / / rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12

[root@localhost ~]# mount -o bind /var/log /mnt

[root@localhost ~]# cat /proc/self/mountinfo  | grep ploop
153 62 182:503793 / / rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12
264 153 182:503793 / / rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12
269 153 182:503793 /var/log /mnt rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12
270 264 182:503793 /var/log /mnt rw,relatime shared:41 master:38 - ext4
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12

Currently i do not see any sign the issue is virtualization related, most
probably if you make same setup on a Hardware Node, you'll get the same.

(If you think it's virtualization related and we have some bug which does
not trigger on vz6 but triggers on vz7 - just migrate old Containers from
vz6 to vz7 and see the number of mounts.)

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team
>
> Steffan
>
>
> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: dinsdag 9 juni 2020 12:32
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/09/2020 12:19 PM, mailingl...@tikklik.nl wrote:
>> Hello Konstantin,
>>
>>
>> 1: this is a centos 6 container
>> lsns is not there
>
> i don't expect n

Re: [Users] openvz 7> centos 8 container

2020-06-10 Thread Konstantin Khorenko

Hi Steffan,

On 06/10/2020 03:51 PM, mailingl...@tikklik.nl wrote:

Just noticed your script is not completely correct
Total number of mounts: 28169 is not counting as it should be.


Yes, i've already written it in my previous mail, there is a mistake in the 
script.
=
> On 06/09/2020 01:32 PM, Konstantin Khorenko wrote:
> > Total number of mounts: 28169
>
> He-he, there is a mistake in the script - "Total number of mounts" prints sum 
of pids.
> But ok, the real sum of mounts is 1+.
=


But  when looking at the mounts there is something  strange

Every pidhas all mountpoint twice

cat /proc/1009/mounts | grep web1440
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0


Are you sure really *every* mount entry is duplicated?
If really *all* mounts are duplicated, then it's strange.
But i guess not all of them are duplicated.

> /dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4 ...
This is a bindmount, so i think someone just did 2 bindmounts to the same 
place, that's it.

May be you've started the software 2 times and first time it was not gracefully 
shutdowned
and did not unmount "old" mounts, i've no idea honestly.

Or may be someone did on CT start something like "mount -o bind / /",
and after that every mount in a CT will be shown twice due to propagation.

Example:
[root@localhost ~]# mount -o bind / /

[root@localhost ~]# cat /proc/self/mountinfo  | grep ploop
153 62 182:503793 / / rw,relatime shared:41 master:38 - ext4 /dev/ploop31487p1 
rw,data=ordered,balloon_ino=12
264 153 182:503793 / / rw,relatime shared:41 master:38 - ext4 /dev/ploop31487p1 
rw,data=ordered,balloon_ino=12

[root@localhost ~]# mount -o bind /var/log /mnt

[root@localhost ~]# cat /proc/self/mountinfo  | grep ploop
153 62 182:503793 / / rw,relatime shared:41 master:38 - ext4 /dev/ploop31487p1 
rw,data=ordered,balloon_ino=12
264 153 182:503793 / / rw,relatime shared:41 master:38 - ext4 /dev/ploop31487p1 
rw,data=ordered,balloon_ino=12
269 153 182:503793 /var/log /mnt rw,relatime shared:41 master:38 - ext4 
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12
270 264 182:503793 /var/log /mnt rw,relatime shared:41 master:38 - ext4 
/dev/ploop31487p1 rw,data=ordered,balloon_ino=12

Currently i do not see any sign the issue is virtualization related,
most probably if you make same setup on a Hardware Node, you'll get the same.

(If you think it's virtualization related and we have some bug which does not 
trigger on vz6 but triggers on vz7 -
just migrate old Containers from vz6 to vz7 and see the number of mounts.)

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team


Steffan


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: dinsdag 9 juni 2020 12:32
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 12:19 PM, mailingl...@tikklik.nl wrote:

Hello Konstantin,


1: this is a centos 6 container
lsns is not there


i don't expect namespaces in centos 6 Containers, i think there is only one,
but you can verify it:
# for i in /proc/[0-9]*/ns/mnt; do readlink $i; done | uniq

Just check the number of lines in output.

And how many mounts in CentOS 6 Container?
(Assuming only 1 mount namespace, just cat /proc/mounts | wc -l)



2:
PID: 1, # of mounts: 600,   cmdline: init-z
PID: 707,   # of mounts: 1199,  cmdline:
/usr/lib/systemd/systemd-udevd
PID: 724,   # of mounts: 1205,  cmdline:
/usr/sbin/NetworkManager--no-daemon
PID: 11063, # of mounts: 1201,  cmdline:

/usr/sbin/httpd-DFOREGROUND

PID: 10410, # of mounts: 1203,  cmdline:
/usr/libexec/postfix/master-w
PID: 1118,  # of mounts: 1201,  cmdline:
/usr/libexec/mysqld--basedir=/usr
PID: 1029,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php73/php-fpm.conf)
PID: 1037,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php71/php-fpm.conf)
PID: 1039,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php56/php-fpm.conf)
PID: 1041,  # of mounts: 1202,  cmdline: php-fpm: master process
(/etc/php-fpm.conf)




Total number of mounts: 28169


He-he, there is a mistake in the script - "Total number of mounts" prints
sum of pids. :) But ok, the real sum of mounts is 1+.

--
Konstantin


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens
Konstantin Khorenko
Verzonden: dinsdag 9 juni 2020 10:53
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 09:42 

Re: [Users] openvz 7> centos 8 container

2020-06-10 Thread mailinglist
Hello Konstantin,

Just noticed your script is not completely correct
Total number of mounts: 28169 is not counting as it should be.
But  when looking at the mounts there is something  strange

Every pidhas all mountpoint twice

cat /proc/1009/mounts | grep web1440
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0
/dev/ploop21699p1 /var/www/clients/client449/web1440/log ext4
rw,relatime,data=ordered,balloon_ino=12,jqfmt=vfsv1,usrjquota=aquota.user,gr
pjquota=aquota.group 0 0

ISPCONFIG (the controlpanel im using) says
" It might be an issue related to the virtualization environment that you
are using, I noticed it's a loop, so must be OpenVZ or Virtuozzo."

Any idees?

Steffan


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: dinsdag 9 juni 2020 12:32
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 12:19 PM, mailingl...@tikklik.nl wrote:
> Hello Konstantin,
>
>
> 1: this is a centos 6 container
> lsns is not there

i don't expect namespaces in centos 6 Containers, i think there is only one,
but you can verify it:
# for i in /proc/[0-9]*/ns/mnt; do readlink $i; done | uniq

Just check the number of lines in output.

And how many mounts in CentOS 6 Container?
(Assuming only 1 mount namespace, just cat /proc/mounts | wc -l)


> 2:
> PID: 1, # of mounts: 600,   cmdline: init-z
> PID: 707,   # of mounts: 1199,  cmdline:
> /usr/lib/systemd/systemd-udevd
> PID: 724,   # of mounts: 1205,  cmdline:
> /usr/sbin/NetworkManager--no-daemon
> PID: 11063, # of mounts: 1201,  cmdline:
/usr/sbin/httpd-DFOREGROUND
> PID: 10410, # of mounts: 1203,  cmdline:
> /usr/libexec/postfix/master-w
> PID: 1118,  # of mounts: 1201,  cmdline:
> /usr/libexec/mysqld--basedir=/usr
> PID: 1029,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php73/php-fpm.conf)
> PID: 1037,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php71/php-fpm.conf)
> PID: 1039,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php56/php-fpm.conf)
> PID: 1041,  # of mounts: 1202,  cmdline: php-fpm: master process
> (/etc/php-fpm.conf)


> Total number of mounts: 28169

He-he, there is a mistake in the script - "Total number of mounts" prints
sum of pids. :) But ok, the real sum of mounts is 1+.

--
Konstantin

> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: dinsdag 9 juni 2020 10:53
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/09/2020 09:42 AM, mailingl...@tikklik.nl wrote:
>> Is this on a openvz6 a different setting.
>
> That's strange, the mount limit presents in vz6 as well.
>
> At some point we faced the situation when some Container stop took 
> enormous amount of time, we found out that there was a software inside
which "leaked"
> mounts, but this does not matter, it means any "bad guy" can create a 
> lot of mounts and start/stop Containers affecting other Containers on 
> the same node (global locks taken - namespace_sem, vfsmount_lock).
>
> Thus we've implemented the precaution limit for mounts.
>
> Can you check the total number of mounts on
> 1) vz6 ("old" server running in centos7 Container?) and
> 2) vz7 ("new" server running in centos8 Container?)
>
> # export total=0; for i in `lsns | grep mnt | awk -e '{print $4;}'`; 
> do echo -en "PID: $i,\t# of mounts: "; echo -n `cat /proc/$i/mounts | 
> wc -l`; echo -en ",\tcmdline: "; cat /proc/$i/cmdline; echo ""; 
> total=$((total + $i)); done; echo "Total number of mounts: $total"
>
> Thank you.
>
> --
> Konstantin
>
>> The old server is now running on a centos 7 vps
>>
>>
>> -Oorspronkelijk bericht-
>> Van: users-boun...@openvz.org  Namens 
>> Konstantin Khorenko
>> Verzonden: maandag 8 juni 2020 23:07
>> Aan: OpenVZ users 
>> Onderwerp: Re: [Users] openvz 7> centos 8 container
>>
>> On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:
>>> If 4096 is the default
>>> Then i dont get it why this error is there
>>>
>>> Its 'only' 597
>>>
>>> mount | wc -l
>>> 597
>>
>> Most probably you have mount namespaces with more mounts inside.
>>
>>>
>>>
>>> Best regards,
>>>
>>> Steffan
>>> -Oorspronkelijk bericht-
>>> Van: users-boun...@openvz.org  Namens 

Re: [Users] openvz 7> centos 8 container Fatal Python error: PyEval_SaveThread: NULL tstate

2020-06-10 Thread mailinglist
Oke the problem is in python, when i remove python from apache it is
working.
No costumers is using it so it is no big deal.



-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens
mailingl...@tikklik.nl
Verzonden: woensdag 10 juni 2020 08:50
Aan: 'OpenVZ users' 
Onderwerp: [Users] openvz 7> centos 8 container Fatal Python error:
PyEval_SaveThread: NULL tstate

I have a strange problem, not realy related to openvz (i think) but hoep
that someone has a tip where to debug...

Im running multiple a centos8 VPS on multiple Openvz 7 On one vps i have a
problem and i cant find the answer online. (server is not inproduction)

On every
 systemctl reload httpd.service

apache is hanging:
CODE: SELECT ALL

Redirecting to /bin/systemctl status httpd.service ● httpd.service - The
Apache HTTP Server
   Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor
preset: disabled)
  Drop-In: /usr/lib/systemd/system/httpd.service.d
   └─php-fpm.conf, php56-php-fpm.conf, php71-php-fpm.conf,
php73-php-fpm.conf
   Active: reloading (reload) (Result: core-dump) since Tue 2020-06-09
16:28:07 CEST; 8min ago
 Docs: man:httpd.service(8)
  Process: 19045 ExecReload=/usr/sbin/httpd $OPTIONS -k graceful
(code=exited, status=0/SUCCESS)
  Process: 27977 ExecStart=/usr/sbin/httpd $OPTIONS -DFOREGROUND
(code=dumped, signal=ABRT)  Main PID: 27977 (code=dumped, signal=ABRT)
   Status: "Reading configuration..."
Tasks: 3 (limit: 26213)
   CGroup: /system.slice/httpd.service
   ├─19150 vlogger (access log)
   ├─19160 /usr/sbin/httpd -DFOREGROUND
   └─19167 /usr/sbin/httpd -DFOREGROUND

Jun 09 16:28:05 xxx systemd[1]: Starting The Apache HTTP Server...
Jun 09 16:28:07 xxx systemd[1]: Started The Apache HTTP Server.
Jun 09 16:28:09 xxx httpd[27977]: Server configured, listening on: port
8000, port 8081, port 443, port 80 Jun 09 16:36:17 xxx systemd[1]: Reloading
The Apache HTTP Server.
Jun 09 16:36:18 xxx systemd[1]: Reloaded The Apache HTTP Server.
Jun 09 16:36:21 xxx systemd[1]: httpd.service: Main process exited,
code=dumped, status=6/ABRT


If i look in the errorlog i see
[Tue Jun 09 16:38:22.998164 2020] [mpm_event:notice] [pid 20777:tid
139711662569728] AH00493: SIGUSR1 received.  Doing graceful restart [Tue Jun
09 16:38:26.337080 2020] [ssl:warn] [pid 20777:tid 139711662569728]
AH01909: :8000:0 server certificate does NOT include an ID which matches
the server name [Tue Jun 09 16:38:26.338171 2020]
[lbmethod_heartbeat:notice] [pid 20777:tid 139711662569728] AH02282: No
slotmem from mod_heartmonitor [Tue Jun 09 16:38:26.583950 2020] [:notice]
[pid 20777:tid 139711662569728]
mod_python: Creating 8 session mutexes based on 4 max processes and 25 max
threads.
[Tue Jun 09 16:38:26.583978 2020] [:notice] [pid 20777:tid 139711662569728]
mod_python: using mutex_directory /tmp
Fatal Python error: PyEval_SaveThread: NULL tstate

Current thread 0x7f112804b900 (most recent call first):


after doing a restart i see in the log

[Tue Jun 09 16:38:53.987408 2020] [suexec:notice] [pid 26684:tid
140297755269376] AH01232: suEXEC mechanism enabled (wrapper:
/usr/sbin/suexec)
[Tue Jun 09 16:38:54.230237 2020] [ssl:warn] [pid 26684:tid 140297755269376]
AH01909::8000:0 server certificate does NOT include an ID which matches
the server name [Tue Jun 09 16:38:55.613760 2020] [ssl:warn] [pid 26684:tid
140297755269376]
AH01909:x3:8000:0 server certificate does NOT include an ID which
matches the server name [Tue Jun 09 16:38:55.614883 2020]
[lbmethod_heartbeat:notice] [pid 26684:tid 140297755269376] AH02282: No
slotmem from mod_heartmonitor [Tue Jun 09 16:38:55.844846 2020] [:notice]
[pid 26684:tid 140297755269376]
mod_python: Creating 8 session mutexes based on 16 max processes and 25 max
threads.
[Tue Jun 09 16:38:55.844871 2020] [:notice] [pid 26684:tid 140297755269376]
mod_python: using mutex_directory /tmp
[Tue Jun 09 16:38:55.885371 2020] [core:warn] [pid 26684:tid
140297755269376] AH00098: pid file /etc/httpd/run/httpd.pid overwritten --
Unclean shutdown of previous Apache run?
[Tue Jun 09 16:38:56.224821 2020] [mpm_event:notice] [pid 26684:tid
140297755269376] AH00489: Apache/2.4.37 (centos) OpenSSL/1.1.1c mod_fcgid/2.
3.9 mod_python/3.5.0- Python/3.6.8 configured -- resuming normal operations
[Tue Jun 09 16:38:56.224871 2020] [core:notice] [pid 26684:tid
140297755269376] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'


Loaded Modules:
 core_module (static)
 so_module (static)
 http_module (static)
 access_compat_module (shared)
 actions_module (shared)
 alias_module (shared)
 allowmethods_module (shared)
 auth_basic_module (shared)
 auth_digest_module (shared)
 authn_anon_module (shared)
 authn_core_module (shared)
 authn_dbd_module (shared)
 authn_dbm_module (shared)
 authn_file_module (shared)
 authn_socache_module (shared)
 authz_core_module (shared)
 authz_dbd_module (shared)
 authz_dbm_module (shared)
 authz_groupfile_module (shared)
 

Re: [Users] openvz 7> centos 8 container Fatal Python error: PyEval_SaveThread: NULL tstate

2020-06-10 Thread mailinglist
Hm i missed that one.
But that didnt do the job.

Still getting the python error on a systemctl reload httpd.service
not on a restart or start / stop

[Wed Jun 10 10:37:11.343415 2020] [mpm_event:notice] [pid 2022:tid
140095417166080] AH00493: SIGUSR1 received.  Doing graceful restart
[Wed Jun 10 10:37:12.755064 2020] [lbmethod_heartbeat:notice] [pid 2022:tid
140095417166080] AH02282: No slotmem from mod_heartmonitor
[Wed Jun 10 10:37:12.960995 2020] [:notice] [pid 2022:tid 140095417166080]
mod_python: Creating 8 session mutexes based on 3 max processes and 25 max
threads.
[Wed Jun 10 10:37:12.961027 2020] [:notice] [pid 2022:tid 140095417166080]
mod_python: using mutex_directory /tmp
Fatal Python error: PyEval_SaveThread: NULL tstate

Current thread 0x7f6a81932900 (most recent call first):

-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: woensdag 10 juni 2020 10:10
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container Fatal Python error:
PyEval_SaveThread: NULL tstate

On 06/10/2020 09:50 AM, mailingl...@tikklik.nl wrote:
> AH01909: :8000:0 server certificate does NOT include an ID which 
> matches the server name

May be this is the root cause:

https://unix.stackexchange.com/questions/358089/apache-ssl-server-cert-does-
not-include-id-which-matches-server-name


--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team
___
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users

___
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users


Re: [Users] openvz 7> centos 8 container Fatal Python error: PyEval_SaveThread: NULL tstate

2020-06-10 Thread Konstantin Khorenko

On 06/10/2020 09:50 AM, mailingl...@tikklik.nl wrote:

AH01909: :8000:0 server certificate does NOT include an ID which matches
the server name


May be this is the root cause:

https://unix.stackexchange.com/questions/358089/apache-ssl-server-cert-does-not-include-id-which-matches-server-name


--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team
___
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users


Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread mailinglist
Thanxs for helping me out...

for i in /proc/[0-9]*/ns/mnt; do readlink $i; done | uniq
mnt:[4026531840]

cat /proc/mounts | wc -l
593

Oke soy the problem here was that centos8 is using namesapces and centos 6
not.

I will contact the vendor to see if i can reduse the total of mounts
This mounts are all website log directory, but i dont offer SSH access so
dont need them.
An dit is only slowing down the restarts if needed.

Thanxs

Steffan

-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: dinsdag 9 juni 2020 12:32
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 12:19 PM, mailingl...@tikklik.nl wrote:
> Hello Konstantin,
>
>
> 1: this is a centos 6 container
> lsns is not there

i don't expect namespaces in centos 6 Containers, i think there is only one,
but you can verify it:
# for i in /proc/[0-9]*/ns/mnt; do readlink $i; done | uniq

Just check the number of lines in output.

And how many mounts in CentOS 6 Container?
(Assuming only 1 mount namespace, just cat /proc/mounts | wc -l)


> 2:
> PID: 1, # of mounts: 600,   cmdline: init-z
> PID: 707,   # of mounts: 1199,  cmdline:
> /usr/lib/systemd/systemd-udevd
> PID: 724,   # of mounts: 1205,  cmdline:
> /usr/sbin/NetworkManager--no-daemon
> PID: 11063, # of mounts: 1201,  cmdline:
/usr/sbin/httpd-DFOREGROUND
> PID: 10410, # of mounts: 1203,  cmdline:
> /usr/libexec/postfix/master-w
> PID: 1118,  # of mounts: 1201,  cmdline:
> /usr/libexec/mysqld--basedir=/usr
> PID: 1029,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php73/php-fpm.conf)
> PID: 1037,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php71/php-fpm.conf)
> PID: 1039,  # of mounts: 1201,  cmdline: php-fpm: master process
> (/etc/opt/remi/php56/php-fpm.conf)
> PID: 1041,  # of mounts: 1202,  cmdline: php-fpm: master process
> (/etc/php-fpm.conf)


> Total number of mounts: 28169

He-he, there is a mistake in the script - "Total number of mounts" prints
sum of pids. :) But ok, the real sum of mounts is 1+.

--
Konstantin

> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: dinsdag 9 juni 2020 10:53
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/09/2020 09:42 AM, mailingl...@tikklik.nl wrote:
>> Is this on a openvz6 a different setting.
>
> That's strange, the mount limit presents in vz6 as well.
>
> At some point we faced the situation when some Container stop took 
> enormous amount of time, we found out that there was a software inside
which "leaked"
> mounts, but this does not matter, it means any "bad guy" can create a 
> lot of mounts and start/stop Containers affecting other Containers on 
> the same node (global locks taken - namespace_sem, vfsmount_lock).
>
> Thus we've implemented the precaution limit for mounts.
>
> Can you check the total number of mounts on
> 1) vz6 ("old" server running in centos7 Container?) and
> 2) vz7 ("new" server running in centos8 Container?)
>
> # export total=0; for i in `lsns | grep mnt | awk -e '{print $4;}'`; 
> do echo -en "PID: $i,\t# of mounts: "; echo -n `cat /proc/$i/mounts | 
> wc -l`; echo -en ",\tcmdline: "; cat /proc/$i/cmdline; echo ""; 
> total=$((total + $i)); done; echo "Total number of mounts: $total"
>
> Thank you.
>
> --
> Konstantin
>
>> The old server is now running on a centos 7 vps
>>
>>
>> -Oorspronkelijk bericht-
>> Van: users-boun...@openvz.org  Namens 
>> Konstantin Khorenko
>> Verzonden: maandag 8 juni 2020 23:07
>> Aan: OpenVZ users 
>> Onderwerp: Re: [Users] openvz 7> centos 8 container
>>
>> On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:
>>> If 4096 is the default
>>> Then i dont get it why this error is there
>>>
>>> Its 'only' 597
>>>
>>> mount | wc -l
>>> 597
>>
>> Most probably you have mount namespaces with more mounts inside.
>>
>>>
>>>
>>> Best regards,
>>>
>>> Steffan
>>> -Oorspronkelijk bericht-
>>> Van: users-boun...@openvz.org  Namens 
>>> Konstantin Khorenko
>>> Verzonden: maandag 8 juni 2020 17:45
>>> Aan: OpenVZ users 
>>> Onderwerp: Re: [Users] openvz 7> centos 8 container
>>>
>>> On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:
>>>> I now see on my node:
>>>>
>>>> kernel: CT#402 re

Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread Konstantin Khorenko

On 06/09/2020 12:19 PM, mailingl...@tikklik.nl wrote:

Hello Konstantin,


1: this is a centos 6 container
lsns is not there


i don't expect namespaces in centos 6 Containers, i think
there is only one, but you can verify it:
# for i in /proc/[0-9]*/ns/mnt; do readlink $i; done | uniq

Just check the number of lines in output.

And how many mounts in CentOS 6 Container?
(Assuming only 1 mount namespace, just cat /proc/mounts | wc -l)



2:
PID: 1, # of mounts: 600,   cmdline: init-z
PID: 707,   # of mounts: 1199,  cmdline:
/usr/lib/systemd/systemd-udevd
PID: 724,   # of mounts: 1205,  cmdline:
/usr/sbin/NetworkManager--no-daemon
PID: 11063, # of mounts: 1201,  cmdline: /usr/sbin/httpd-DFOREGROUND
PID: 10410, # of mounts: 1203,  cmdline:
/usr/libexec/postfix/master-w
PID: 1118,  # of mounts: 1201,  cmdline:
/usr/libexec/mysqld--basedir=/usr
PID: 1029,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php73/php-fpm.conf)
PID: 1037,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php71/php-fpm.conf)
PID: 1039,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php56/php-fpm.conf)
PID: 1041,  # of mounts: 1202,  cmdline: php-fpm: master process
(/etc/php-fpm.conf)




Total number of mounts: 28169


He-he, there is a mistake in the script - "Total number of mounts" prints sum 
of pids. :)
But ok, the real sum of mounts is 1+.

--
Konstantin


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: dinsdag 9 juni 2020 10:53
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 09:42 AM, mailingl...@tikklik.nl wrote:

Is this on a openvz6 a different setting.


That's strange, the mount limit presents in vz6 as well.

At some point we faced the situation when some Container stop took enormous
amount of time, we found out that there was a software inside which "leaked"
mounts, but this does not matter, it means any "bad guy" can create a lot of
mounts and start/stop Containers affecting other Containers on the same node
(global locks taken - namespace_sem, vfsmount_lock).

Thus we've implemented the precaution limit for mounts.

Can you check the total number of mounts on
1) vz6 ("old" server running in centos7 Container?) and
2) vz7 ("new" server running in centos8 Container?)

# export total=0; for i in `lsns | grep mnt | awk -e '{print $4;}'`; do echo
-en "PID: $i,\t# of mounts: "; echo -n `cat /proc/$i/mounts | wc -l`; echo
-en ",\tcmdline: "; cat /proc/$i/cmdline; echo ""; total=$((total + $i));
done; echo "Total number of mounts: $total"

Thank you.

--
Konstantin


The old server is now running on a centos 7 vps


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens
Konstantin Khorenko
Verzonden: maandag 8 juni 2020 23:07
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:

If 4096 is the default
Then i dont get it why this error is there

Its 'only' 597

mount | wc -l
597


Most probably you have mount namespaces with more mounts inside.




Best regards,

Steffan
-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens
Konstantin Khorenko
Verzonden: maandag 8 juni 2020 17:45
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:

I now see on my node:

kernel: CT#402 reached the limit on mounts.


You can increase the limit of mounts inside a Container via sysctl
"fs.ve-mount-nr" (4096 by default).

Warning: stopping of a Container with many mounts inside can take
quite a long time.
Say, if you have 20 of mounts in a Container, Container stop may
take
~10 minutes.

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team


So think that is the problem.

I see a old toppic onlin

https://forum.openvz.org/index.php?t=rview=12902=52002


Any idee if that is the solution that is needed today?







*Van:* users-boun...@openvz.org  *Namens

*mailingl...@tikklik.nl

*Verzonden:* maandag 8 juni 2020 14:17
*Aan:* 'OpenVZ users' 
*Onderwerp:* [Users] openvz 7> centos 8 container



Hello,



If installed a centos 8 op-envz container

It was working, but after migration my data from an older
container im

keep getting errors like this:






php71-php-fpm.service: Failed to set up mount namespacing:
Cannot

allocate memory


php71-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory




php73-php-fpm.service: Failed to set up mount namespacing:
Cannot

allocate memory


php73-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory






httpd.se

Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread mailinglist
Hello Konstantin,


1: this is a centos 6 container
lsns is not there

2:
PID: 1, # of mounts: 600,   cmdline: init-z
PID: 707,   # of mounts: 1199,  cmdline:
/usr/lib/systemd/systemd-udevd
PID: 724,   # of mounts: 1205,  cmdline:
/usr/sbin/NetworkManager--no-daemon
PID: 11063, # of mounts: 1201,  cmdline: /usr/sbin/httpd-DFOREGROUND
PID: 10410, # of mounts: 1203,  cmdline:
/usr/libexec/postfix/master-w
PID: 1118,  # of mounts: 1201,  cmdline:
/usr/libexec/mysqld--basedir=/usr
PID: 1029,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php73/php-fpm.conf)
PID: 1037,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php71/php-fpm.conf)
PID: 1039,  # of mounts: 1201,  cmdline: php-fpm: master process
(/etc/opt/remi/php56/php-fpm.conf)
PID: 1041,  # of mounts: 1202,  cmdline: php-fpm: master process
(/etc/php-fpm.conf)
Total number of mounts: 28169

-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: dinsdag 9 juni 2020 10:53
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/09/2020 09:42 AM, mailingl...@tikklik.nl wrote:
> Is this on a openvz6 a different setting.

That's strange, the mount limit presents in vz6 as well.

At some point we faced the situation when some Container stop took enormous
amount of time, we found out that there was a software inside which "leaked"
mounts, but this does not matter, it means any "bad guy" can create a lot of
mounts and start/stop Containers affecting other Containers on the same node
(global locks taken - namespace_sem, vfsmount_lock).

Thus we've implemented the precaution limit for mounts.

Can you check the total number of mounts on
1) vz6 ("old" server running in centos7 Container?) and
2) vz7 ("new" server running in centos8 Container?)

# export total=0; for i in `lsns | grep mnt | awk -e '{print $4;}'`; do echo
-en "PID: $i,\t# of mounts: "; echo -n `cat /proc/$i/mounts | wc -l`; echo
-en ",\tcmdline: "; cat /proc/$i/cmdline; echo ""; total=$((total + $i));
done; echo "Total number of mounts: $total"

Thank you.

--
Konstantin

> The old server is now running on a centos 7 vps
>
>
> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: maandag 8 juni 2020 23:07
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:
>> If 4096 is the default
>> Then i dont get it why this error is there
>>
>> Its 'only' 597
>>
>> mount | wc -l
>> 597
>
> Most probably you have mount namespaces with more mounts inside.
>
>>
>>
>> Best regards,
>>
>> Steffan
>> -Oorspronkelijk bericht-
>> Van: users-boun...@openvz.org  Namens 
>> Konstantin Khorenko
>> Verzonden: maandag 8 juni 2020 17:45
>> Aan: OpenVZ users 
>> Onderwerp: Re: [Users] openvz 7> centos 8 container
>>
>> On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:
>>> I now see on my node:
>>>
>>> kernel: CT#402 reached the limit on mounts.
>>
>> You can increase the limit of mounts inside a Container via sysctl 
>> "fs.ve-mount-nr" (4096 by default).
>>
>> Warning: stopping of a Container with many mounts inside can take 
>> quite a long time.
>> Say, if you have 20 of mounts in a Container, Container stop may 
>> take
>> ~10 minutes.
>>
>> --
>> Best regards,
>>
>> Konstantin Khorenko,
>> Virtuozzo Linux Kernel Team
>>
>>> So think that is the problem.
>>>
>>> I see a old toppic onlin
>> https://forum.openvz.org/index.php?t=rview=12902=52002
>>>
>>> Any idee if that is the solution that is needed today?
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *Van:* users-boun...@openvz.org  *Namens
>> *mailingl...@tikklik.nl
>>> *Verzonden:* maandag 8 juni 2020 14:17
>>> *Aan:* 'OpenVZ users' 
>>> *Onderwerp:* [Users] openvz 7> centos 8 container
>>>
>>>
>>>
>>> Hello,
>>>
>>>
>>>
>>> If installed a centos 8 op-envz container
>>>
>>> It was working, but after migration my data from an older 
>>> container im
>> keep getting errors like this:
>>>
>>>
>>>
>>>
>>>
>>> php71-php-fpm.service: Failed to set up mount namespacing: 
>>> Cannot
>> allocate memory
>>>
>>> 

Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread Konstantin Khorenko

On 06/09/2020 09:42 AM, mailingl...@tikklik.nl wrote:

Is this on a openvz6 a different setting.


That's strange, the mount limit presents in vz6 as well.

At some point we faced the situation when some Container stop took enormous
amount of time, we found out that there was a software inside which "leaked"
mounts, but this does not matter, it means any "bad guy" can create a lot of
mounts and start/stop Containers affecting other Containers on the same node
(global locks taken - namespace_sem, vfsmount_lock).

Thus we've implemented the precaution limit for mounts.

Can you check the total number of mounts on
1) vz6 ("old" server running in centos7 Container?)
and
2) vz7 ("new" server running in centos8 Container?)

# export total=0; for i in `lsns | grep mnt | awk -e '{print $4;}'`; do echo -en "PID: $i,\t# of mounts: "; echo -n `cat /proc/$i/mounts | wc -l`; echo -en ",\tcmdline: "; cat 
/proc/$i/cmdline; echo ""; total=$((total + $i)); done; echo "Total number of mounts: $total"


Thank you.

--
Konstantin


The old server is now running on a centos 7 vps


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: maandag 8 juni 2020 23:07
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:

If 4096 is the default
Then i dont get it why this error is there

Its 'only' 597

mount | wc -l
597


Most probably you have mount namespaces with more mounts inside.




Best regards,

Steffan
-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens
Konstantin Khorenko
Verzonden: maandag 8 juni 2020 17:45
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:

I now see on my node:

kernel: CT#402 reached the limit on mounts.


You can increase the limit of mounts inside a Container via sysctl
"fs.ve-mount-nr" (4096 by default).

Warning: stopping of a Container with many mounts inside can take
quite a long time.
Say, if you have 20 of mounts in a Container, Container stop may
take
~10 minutes.

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team


So think that is the problem.

I see a old toppic onlin

https://forum.openvz.org/index.php?t=rview=12902=52002


Any idee if that is the solution that is needed today?







*Van:* users-boun...@openvz.org  *Namens

*mailingl...@tikklik.nl

*Verzonden:* maandag 8 juni 2020 14:17
*Aan:* 'OpenVZ users' 
*Onderwerp:* [Users] openvz 7> centos 8 container



Hello,



If installed a centos 8 op-envz container

It was working, but after migration my data from an older
container im

keep getting errors like this:






php71-php-fpm.service: Failed to set up mount namespacing: Cannot

allocate memory


php71-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory




php73-php-fpm.service: Failed to set up mount namespacing: Cannot

allocate memory


php73-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory






httpd.service: Failed to set up mount namespacing: Cannot
allocate

memory


httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd:

Cannot allocate memory






cat /proc/user_beancounters

Version: 2.5

resource held  maxheld

barrierlimit  failcnt


kmemsize 92078080121937920

9223372036854775807  92233720368547758070


lockedpages 00

9223372036854775807  92233720368547758070


privvmpages 5215575857

9223372036854775807  92233720368547758070


shmpages  659 2636

9223372036854775807  92233720368547758070


dummy   00

9223372036854775807  92233720368547758070


numproc39   39

4194304  41943040


physpages   97697   111964

9223372036854775807  92233720368547758070


vmguarpages 00

9223372036854775807  92233720368547758070


oomguarpages97697   111964

000


numtcpsock  00

9223372036854775807  92233720368547758070


numflock25

9223372036854775807  92233720368547758070


numpty  0  

Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread mailinglist
Oke that worked.
but
fs.ve-mount-nr =1
was even to low.
To bad the software is using so much mountpoints...


Thanxs

Steffan

-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: maandag 8 juni 2020 23:07
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:
> If 4096 is the default
> Then i dont get it why this error is there
>
> Its 'only' 597
>
> mount | wc -l
> 597

Most probably you have mount namespaces with more mounts inside.

>
>
> Best regards,
>
> Steffan
> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: maandag 8 juni 2020 17:45
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:
>> I now see on my node:
>>
>> kernel: CT#402 reached the limit on mounts.
>
> You can increase the limit of mounts inside a Container via sysctl 
> "fs.ve-mount-nr" (4096 by default).
>
> Warning: stopping of a Container with many mounts inside can take 
> quite a long time.
> Say, if you have 20 of mounts in a Container, Container stop may 
> take
> ~10 minutes.
>
> --
> Best regards,
>
> Konstantin Khorenko,
> Virtuozzo Linux Kernel Team
>
>> So think that is the problem.
>>
>> I see a old toppic onlin
> https://forum.openvz.org/index.php?t=rview=12902=52002
>>
>> Any idee if that is the solution that is needed today?
>>
>>
>>
>>
>>
>>
>>
>> *Van:* users-boun...@openvz.org  *Namens
> *mailingl...@tikklik.nl
>> *Verzonden:* maandag 8 juni 2020 14:17
>> *Aan:* 'OpenVZ users' 
>> *Onderwerp:* [Users] openvz 7> centos 8 container
>>
>>
>>
>> Hello,
>>
>>
>>
>> If installed a centos 8 op-envz container
>>
>> It was working, but after migration my data from an older 
>> container im
> keep getting errors like this:
>>
>>
>>
>>
>>
>> php71-php-fpm.service: Failed to set up mount namespacing: Cannot
> allocate memory
>>
>> php71-php-fpm.service: Failed at step NAMESPACE spawning
> /opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory
>>
>>
>>
>> php73-php-fpm.service: Failed to set up mount namespacing: Cannot
> allocate memory
>>
>> php73-php-fpm.service: Failed at step NAMESPACE spawning
> /opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory
>>
>>
>>
>>
>>
>> httpd.service: Failed to set up mount namespacing: Cannot 
>> allocate
> memory
>>
>> httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd:
> Cannot allocate memory
>>
>>
>>
>>
>>
>> cat /proc/user_beancounters
>>
>> Version: 2.5
>>
>> resource held  maxheld
> barrierlimit  failcnt
>>
>> kmemsize 92078080121937920
> 9223372036854775807  92233720368547758070
>>
>> lockedpages 00
> 9223372036854775807  92233720368547758070
>>
>> privvmpages 5215575857
> 9223372036854775807  92233720368547758070
>>
>> shmpages  659 2636
> 9223372036854775807  92233720368547758070
>>
>> dummy   00
> 9223372036854775807  92233720368547758070
>>
>> numproc39   39
> 4194304  41943040
>>
>> physpages   97697   111964
> 9223372036854775807  92233720368547758070
>>
>> vmguarpages 00
> 9223372036854775807  92233720368547758070
>>
>> oomguarpages97697   111964
> 000
>>
>> numtcpsock  00
> 9223372036854775807  92233720368547758070
>>
>> numflock25
> 9223372036854775807  92233720368547758070
>>
>> numpty  01
> 9223372036854775807  92233720368547

Re: [Users] openvz 7> centos 8 container

2020-06-09 Thread mailinglist
Is this on a openvz6 a different setting.
The old server is now running on a centos 7 vps


-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: maandag 8 juni 2020 23:07
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:
> If 4096 is the default
> Then i dont get it why this error is there
>
> Its 'only' 597
>
> mount | wc -l
> 597

Most probably you have mount namespaces with more mounts inside.

>
>
> Best regards,
>
> Steffan
> -Oorspronkelijk bericht-
> Van: users-boun...@openvz.org  Namens 
> Konstantin Khorenko
> Verzonden: maandag 8 juni 2020 17:45
> Aan: OpenVZ users 
> Onderwerp: Re: [Users] openvz 7> centos 8 container
>
> On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:
>> I now see on my node:
>>
>> kernel: CT#402 reached the limit on mounts.
>
> You can increase the limit of mounts inside a Container via sysctl 
> "fs.ve-mount-nr" (4096 by default).
>
> Warning: stopping of a Container with many mounts inside can take 
> quite a long time.
> Say, if you have 20 of mounts in a Container, Container stop may 
> take
> ~10 minutes.
>
> --
> Best regards,
>
> Konstantin Khorenko,
> Virtuozzo Linux Kernel Team
>
>> So think that is the problem.
>>
>> I see a old toppic onlin
> https://forum.openvz.org/index.php?t=rview=12902=52002
>>
>> Any idee if that is the solution that is needed today?
>>
>>
>>
>>
>>
>>
>>
>> *Van:* users-boun...@openvz.org  *Namens
> *mailingl...@tikklik.nl
>> *Verzonden:* maandag 8 juni 2020 14:17
>> *Aan:* 'OpenVZ users' 
>> *Onderwerp:* [Users] openvz 7> centos 8 container
>>
>>
>>
>> Hello,
>>
>>
>>
>> If installed a centos 8 op-envz container
>>
>> It was working, but after migration my data from an older 
>> container im
> keep getting errors like this:
>>
>>
>>
>>
>>
>> php71-php-fpm.service: Failed to set up mount namespacing: Cannot
> allocate memory
>>
>> php71-php-fpm.service: Failed at step NAMESPACE spawning
> /opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory
>>
>>
>>
>> php73-php-fpm.service: Failed to set up mount namespacing: Cannot
> allocate memory
>>
>> php73-php-fpm.service: Failed at step NAMESPACE spawning
> /opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory
>>
>>
>>
>>
>>
>> httpd.service: Failed to set up mount namespacing: Cannot 
>> allocate
> memory
>>
>> httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd:
> Cannot allocate memory
>>
>>
>>
>>
>>
>> cat /proc/user_beancounters
>>
>> Version: 2.5
>>
>> resource held  maxheld
> barrierlimit  failcnt
>>
>> kmemsize 92078080121937920
> 9223372036854775807  92233720368547758070
>>
>> lockedpages 00
> 9223372036854775807  92233720368547758070
>>
>> privvmpages 5215575857
> 9223372036854775807  92233720368547758070
>>
>> shmpages  659 2636
> 9223372036854775807  92233720368547758070
>>
>> dummy   00
> 9223372036854775807  92233720368547758070
>>
>> numproc39   39
> 4194304  41943040
>>
>> physpages   97697   111964
> 9223372036854775807  92233720368547758070
>>
>> vmguarpages 00
> 9223372036854775807  92233720368547758070
>>
>> oomguarpages97697   111964
> 000
>>
>> numtcpsock  00
> 9223372036854775807  92233720368547758070
>>
>> numflock25
> 9223372036854775807  92233720368547758070
>>
>> numpty  01
> 9223372036854775807  92233720368547758070
>>
>>

Re: [Users] openvz 7> centos 8 container

2020-06-08 Thread Konstantin Khorenko

On 06/08/2020 09:15 PM, mailingl...@tikklik.nl wrote:

If 4096 is the default
Then i dont get it why this error is there

Its 'only' 597

mount | wc -l
597


Most probably you have mount namespaces with more mounts inside.




Best regards,

Steffan
-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: maandag 8 juni 2020 17:45
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:

I now see on my node:

kernel: CT#402 reached the limit on mounts.


You can increase the limit of mounts inside a Container via sysctl
"fs.ve-mount-nr" (4096 by default).

Warning: stopping of a Container with many mounts inside can take quite a
long time.
Say, if you have 20 of mounts in a Container, Container stop may take
~10 minutes.

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team


So think that is the problem.

I see a old toppic onlin

https://forum.openvz.org/index.php?t=rview=12902=52002


Any idee if that is the solution that is needed today?







*Van:* users-boun...@openvz.org  *Namens

*mailingl...@tikklik.nl

*Verzonden:* maandag 8 juni 2020 14:17
*Aan:* 'OpenVZ users' 
*Onderwerp:* [Users] openvz 7> centos 8 container



Hello,



If installed a centos 8 op-envz container

It was working, but after migration my data from an older container im

keep getting errors like this:






php71-php-fpm.service: Failed to set up mount namespacing: Cannot

allocate memory


php71-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory




php73-php-fpm.service: Failed to set up mount namespacing: Cannot

allocate memory


php73-php-fpm.service: Failed at step NAMESPACE spawning

/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory






httpd.service: Failed to set up mount namespacing: Cannot allocate

memory


httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd:

Cannot allocate memory






cat /proc/user_beancounters

Version: 2.5

resource held  maxheld

barrierlimit  failcnt


kmemsize 92078080121937920

9223372036854775807  92233720368547758070


lockedpages 00

9223372036854775807  92233720368547758070


privvmpages 5215575857

9223372036854775807  92233720368547758070


shmpages  659 2636

9223372036854775807  92233720368547758070


dummy   00

9223372036854775807  92233720368547758070


numproc39   39

4194304  41943040


physpages   97697   111964

9223372036854775807  92233720368547758070


vmguarpages 00

9223372036854775807  92233720368547758070


oomguarpages97697   111964

000


numtcpsock  00

9223372036854775807  92233720368547758070


numflock25

9223372036854775807  92233720368547758070


numpty  01

9223372036854775807  92233720368547758070


numsiginfo  0   57

9223372036854775807  92233720368547758070


tcpsndbuf   00

9223372036854775807  92233720368547758070


tcprcvbuf   00

9223372036854775807  92233720368547758070


othersockbuf00

9223372036854775807  92233720368547758070


dgramrcvbuf 00

9223372036854775807  92233720368547758070


numothersock00

9223372036854775807  92233720368547758070


dcachesize   51408896 72798208

9223372036854775807  92233720368547758070


numfile   711  995

9223372036854775807  92233720368547758070


dummy   00

9223372036854775807  92233720368547758070


dummy   00

9223372036854775807  92233720368547758070


dummy   0 

Re: [Users] openvz 7> centos 8 container

2020-06-08 Thread mailinglist
If 4096 is the default
Then i dont get it why this error is there

Its 'only' 597

mount | wc -l
597


Best regards,

Steffan
-Oorspronkelijk bericht-
Van: users-boun...@openvz.org  Namens Konstantin
Khorenko
Verzonden: maandag 8 juni 2020 17:45
Aan: OpenVZ users 
Onderwerp: Re: [Users] openvz 7> centos 8 container

On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:
> I now see on my node:
>
> kernel: CT#402 reached the limit on mounts.

You can increase the limit of mounts inside a Container via sysctl
"fs.ve-mount-nr" (4096 by default).

Warning: stopping of a Container with many mounts inside can take quite a
long time.
Say, if you have 20 of mounts in a Container, Container stop may take
~10 minutes.

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team

> So think that is the problem.
>
> I see a old toppic onlin
https://forum.openvz.org/index.php?t=rview=12902=52002
>
> Any idee if that is the solution that is needed today?
>
>
>
>
>
>
>
> *Van:* users-boun...@openvz.org  *Namens
*mailingl...@tikklik.nl
> *Verzonden:* maandag 8 juni 2020 14:17
> *Aan:* 'OpenVZ users' 
> *Onderwerp:* [Users] openvz 7> centos 8 container
>
>
>
> Hello,
>
>
>
> If installed a centos 8 op-envz container
>
> It was working, but after migration my data from an older container im
keep getting errors like this:
>
>
>
>
>
> php71-php-fpm.service: Failed to set up mount namespacing: Cannot
allocate memory
>
> php71-php-fpm.service: Failed at step NAMESPACE spawning
/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory
>
>
>
> php73-php-fpm.service: Failed to set up mount namespacing: Cannot
allocate memory
>
> php73-php-fpm.service: Failed at step NAMESPACE spawning
/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory
>
>
>
>
>
> httpd.service: Failed to set up mount namespacing: Cannot allocate
memory
>
> httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd:
Cannot allocate memory
>
>
>
>
>
> cat /proc/user_beancounters
>
> Version: 2.5
>
> resource held  maxheld
barrierlimit  failcnt
>
> kmemsize 92078080121937920
9223372036854775807  92233720368547758070
>
> lockedpages 00
9223372036854775807  92233720368547758070
>
> privvmpages 5215575857
9223372036854775807  92233720368547758070
>
> shmpages  659 2636
9223372036854775807  92233720368547758070
>
> dummy   00
9223372036854775807  92233720368547758070
>
> numproc39   39
4194304  41943040
>
> physpages   97697   111964
9223372036854775807  92233720368547758070
>
> vmguarpages 00
9223372036854775807  92233720368547758070
>
> oomguarpages97697   111964
000
>
> numtcpsock  00
9223372036854775807  92233720368547758070
>
> numflock25
9223372036854775807  92233720368547758070
>
> numpty  01
9223372036854775807  92233720368547758070
>
> numsiginfo  0   57
9223372036854775807  92233720368547758070
>
> tcpsndbuf   00
9223372036854775807  92233720368547758070
>
> tcprcvbuf   00
9223372036854775807  92233720368547758070
>
> othersockbuf00
9223372036854775807  92233720368547758070
>
> dgramrcvbuf 00
9223372036854775807  92233720368547758070
>
> numothersock00
9223372036854775807  92233720368547758070
>
> dcachesize   51408896 72798208
9223372036854775807  92233720368547758070
>
> numfile   711  995
9223372036854775807  92233720368547758070
>
> dummy   

Re: [Users] openvz 7> centos 8 container

2020-06-08 Thread Konstantin Khorenko

On 06/08/2020 03:31 PM, mailingl...@tikklik.nl wrote:

I now see on my node:

kernel: CT#402 reached the limit on mounts.


You can increase the limit of mounts inside a Container via sysctl 
"fs.ve-mount-nr" (4096 by default).

Warning: stopping of a Container with many mounts inside can take quite a long 
time.
Say, if you have 20 of mounts in a Container, Container stop may take ~10 
minutes.

--
Best regards,

Konstantin Khorenko,
Virtuozzo Linux Kernel Team


So think that is the problem.

I see a old toppic onlin 
https://forum.openvz.org/index.php?t=rview=12902=52002

Any idee if that is the solution that is needed today?







*Van:* users-boun...@openvz.org  *Namens 
*mailingl...@tikklik.nl
*Verzonden:* maandag 8 juni 2020 14:17
*Aan:* 'OpenVZ users' 
*Onderwerp:* [Users] openvz 7> centos 8 container



Hello,



If installed a centos 8 op-envz container

It was working, but after migration my data from an older container im keep 
getting errors like this:





php71-php-fpm.service: Failed to set up mount namespacing: Cannot allocate 
memory

php71-php-fpm.service: Failed at step NAMESPACE spawning 
/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory



php73-php-fpm.service: Failed to set up mount namespacing: Cannot allocate 
memory

php73-php-fpm.service: Failed at step NAMESPACE spawning 
/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory





httpd.service: Failed to set up mount namespacing: Cannot allocate memory

httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd: Cannot 
allocate memory





cat /proc/user_beancounters

Version: 2.5

resource held  maxheld  barrier 
   limit  failcnt

kmemsize 92078080121937920  9223372036854775807 
 92233720368547758070

lockedpages 00  9223372036854775807 
 92233720368547758070

privvmpages 5215575857  9223372036854775807 
 92233720368547758070

shmpages  659 2636  9223372036854775807 
 92233720368547758070

dummy   00  9223372036854775807 
 92233720368547758070

numproc39   39  4194304 
 41943040

physpages   97697   111964  9223372036854775807 
 92233720368547758070

vmguarpages 00  9223372036854775807 
 92233720368547758070

oomguarpages97697   1119640 
   00

numtcpsock  00  9223372036854775807 
 92233720368547758070

numflock25  9223372036854775807 
 92233720368547758070

numpty  01  9223372036854775807 
 92233720368547758070

numsiginfo  0   57  9223372036854775807 
 92233720368547758070

tcpsndbuf   00  9223372036854775807 
 92233720368547758070

tcprcvbuf   00  9223372036854775807 
 92233720368547758070

othersockbuf00  9223372036854775807 
 92233720368547758070

dgramrcvbuf 00  9223372036854775807 
 92233720368547758070

numothersock00  9223372036854775807 
 92233720368547758070

dcachesize   51408896 72798208  9223372036854775807 
 92233720368547758070

numfile   711  995  9223372036854775807 
 92233720368547758070

dummy   00  9223372036854775807 
 92233720368547758070

dummy   00  9223372036854775807 
 92233720368547758070

dummy   00  9223372036854775807 
 92233720368547758070

numiptent   8   16  
9223372036854775807  92233720368547758070





uname -r  3.10.0-1062.12.1.vz7.131.10



any idees what went wrong and how to repair?



Thanxs


Steffan





___
Users mailing list
Users@openvz.org

Re: [Users] openvz 7> centos 8 container

2020-06-08 Thread mailinglist
I now see on my node:

kernel: CT#402 reached the limit on mounts.

 

So think that is the problem.

I see a old toppic onlin https://forum.openvz.org/index.php?t=rview 
 
=12902=52002

Any idee if that is the solution that is needed today?

 

 

 

Van: users-boun...@openvz.org  Namens 
mailingl...@tikklik.nl
Verzonden: maandag 8 juni 2020 14:17
Aan: 'OpenVZ users' 
Onderwerp: [Users] openvz 7> centos 8 container

 

Hello,

 

If installed a centos 8 op-envz container

It was working, but after migration my data from an older container im keep 
getting errors like this:

 

 

php71-php-fpm.service: Failed to set up mount namespacing: Cannot allocate 
memory

php71-php-fpm.service: Failed at step NAMESPACE spawning 
/opt/remi/php71/root/usr/sbin/php-fpm: Cannot allocate memory

 

php73-php-fpm.service: Failed to set up mount namespacing: Cannot allocate 
memory

php73-php-fpm.service: Failed at step NAMESPACE spawning 
/opt/remi/php73/root/usr/sbin/php-fpm: Cannot allocate memory

 

 

httpd.service: Failed to set up mount namespacing: Cannot allocate memory

httpd.service: Failed at step NAMESPACE spawning /usr/sbin/httpd: Cannot 
allocate memory

 

 

cat /proc/user_beancounters

Version: 2.5

resource held  maxheld  barrier 
   limit  failcnt

kmemsize 92078080121937920  9223372036854775807  
92233720368547758070

lockedpages 00  9223372036854775807  
92233720368547758070

privvmpages 5215575857  9223372036854775807  
92233720368547758070

shmpages  659 2636  9223372036854775807  
92233720368547758070

dummy   00  9223372036854775807  
92233720368547758070

numproc39   39  4194304 
 41943040

physpages   97697   111964  9223372036854775807  
92233720368547758070

vmguarpages 00  9223372036854775807  
92233720368547758070

oomguarpages97697   1119640 
   00

numtcpsock  00  9223372036854775807  
92233720368547758070

numflock25  9223372036854775807  
92233720368547758070

numpty  01  9223372036854775807  
92233720368547758070

numsiginfo  0   57  9223372036854775807  
92233720368547758070

tcpsndbuf   00  9223372036854775807  
92233720368547758070

tcprcvbuf   00  9223372036854775807  
92233720368547758070

othersockbuf00  9223372036854775807  
92233720368547758070

dgramrcvbuf 00  9223372036854775807  
92233720368547758070

numothersock00  9223372036854775807  
92233720368547758070

dcachesize   51408896 72798208  9223372036854775807  
92233720368547758070

numfile   711  995  9223372036854775807  
92233720368547758070

dummy   00  9223372036854775807  
92233720368547758070

dummy   00  9223372036854775807  
92233720368547758070

dummy   00  9223372036854775807  
92233720368547758070

numiptent   8   16  9223372036854775807 
 92233720368547758070

 

 

uname -r  3.10.0-1062.12.1.vz7.131.10

 

any idees what went wrong and how to repair?

 

Thanxs


Steffan

 

___
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users