I think there is no need to increase ulimit inside the CT since most operations
are performed from the node side.
I've added ulimit tweak to the tool itself, will build it soon.
________________________________
From: users-boun...@openvz.org <users-boun...@openvz.org> on behalf of Jehan
PROCACCIA <jehan.procac...@tem-tsp.eu>
Sent: Saturday, April 24, 2021 12:32 PM
To: OpenVZ users <users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
ok I increased to 10240 and it completed successfully now , thanks :
on the Hyoervisor:
# grep NUMFILE /etc/vz/conf/7ed1de35-75bc-4137-977a-b4055067fb0a.conf
NUMFILE="10240"
# ulimit -n 10240
this second command may not be needed, I wondered if the 10240 numfile ulimit
needs to be set inside the container or on the hypervisor ?
# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt idp4mt
...
rdma-core x86_64 32.0-3.vl8
zstd x86_64 1.4.4-1.vl8
7ed1de35-75bc-4137-977a-b4055067fb0a: Warning!
The following packages were added compared to CentOS 8:['nss.x86_64',
'nspr.x86_64', 'binutils.x86_64', 'nss-softokn-freebl.x86_64',
'nss-sysinit.x86_64', 'nss-util.x86_64', 'nss-softokn.x86_64']
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 11:19:29.385333
inside the CT
# cat /etc/redhat-release
Virtuozzo Linux release 8
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "jehan procaccia" <jehan.procac...@imtbs-tsp.eu>
Cc: "OpenVZ users" <users@openvz.org>
Envoyé: Samedi 24 Avril 2021 07:16:00
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Yes. 'ulimit -n 10240' before the conversion could help.
________________________________
From: Jehan PROCACCIA <jehan.procac...@imtbs-tsp.eu>
Sent: Friday, April 23, 2021 10:37 PM
To: Denis Silakov <dsila...@virtuozzo.com>
Cc: OpenVZ users <users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
OK, I revert to a previous snapshot, not sure I took the correct one though
(anyway, tah CT is a test, I don't care to loose it ..)
# prlctl snapshot-list idp4mt
PARENT_SNAPSHOT_ID SNAPSHOT_ID
{6a5c1dcf-776e-4011-a935-06b186c38541}
{6a5c1dcf-776e-4011-a935-06b186c38541} *{6703557b-e46c-4437-877a-ca3d8f917d79}
# prlctl snapshot-list idpmt4
PARENT_SNAPSHOT_ID SNAPSHOT_ID
[root@olympos ~]# prlctl snapshot-switch idp4mt --id
6a5c1dcf-776e-4011-a935-06b186c38541
so I set NUMFILE in CT this way :
# grep NUMFILE /etc/vz/conf/7ed1de35-75bc-4137-977a-b4055067fb0a.conf
NUMFILE="4096"
# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {e4d44103-1aa8-4040-bc1b-4161e234e0c4} has been
successfully created.
Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 21:33:22.250234
...
Transaction Summary
================================================================================
Install 31 Packages
Upgrade 582 Packages
Total size: 381 M
Downloading Packages:
[SKIPPED] libmodulemd1-1.8.16-0.2.9.4.2.x86_64.rpm: Already downloaded
[SKIPPED] annobin-9.35-1.vl8.x86_64.rpm: Already downloaded
..
Running scriptlet: filesystem-3.8-3.vl8.x86_64 1/1
Preparing : 1/1
Running scriptlet: libgcc-8.4.1-1.vl8.x86_64
1/1Error: Cannot open file
/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/python3-six-1.15.0-8.vl8.2.noarch.rpm:
[Errno 24] Too many open files:
'/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/python3-six-1.15.0-8.vl8.2.noarch.rpm'
FATAL ERROR: python callback ??? failed, aborting!
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 21:33:41.692332
Did I miss to increase ulimit ?
thanks .
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "jehan procaccia" <jehan.procac...@imtbs-tsp.eu>
Cc: "OpenVZ users" <users@openvz.org>
Envoyé: Vendredi 23 Avril 2021 21:09:47
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Agrh, "Too many open files" is the reason, you should increase your ulimit
values. We have already discussed this in the list and likely we should change
ulimits directly from script for the time of its work.
And yes, I would recommend to revert container to pre-convert state. vzconvert
automatically creates snapshot every time it is launch, you can simply use
"prlctl snapshot-switch" (and btw, if you performed several conversion
attempts, you can already have multiple snapshots)
________________________________
From: Jehan PROCACCIA <jehan.procac...@imtbs-tsp.eu>
Sent: Friday, April 23, 2021 10:03 PM
To: Denis Silakov <dsila...@virtuozzo.com>
Cc: OpenVZ users <users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
OK, indeed there was
OSTEMPLATE=".vzlinux-8-x86_64"
TECHNOLOGIES="x86_64 nptl "
DISTRIBUTION="centos"
OSRELEASE="4.18.0"
I changed OSTEMPLATE back to :
OSTEMPLATE=".centos-8-x86_64"
now it goes on :
# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {6703557b-e46c-4437-877a-ca3d8f917d79} has been
successfully created.
Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 20:31:03.188883
base0 3.0 kB/s | 4.6 kB 00:01
base0 30 MB/s | 13 MB 00:00
base1 20 kB/s | 2.9 kB 00:00
Dependencies resolved.
================================================================================
Package Arch Version Repository
Size
================================================================================
Installing:
vzlinux-logos-httpd noarch 80.5.1-2.vl8 base0 24 k
replacing centos-logos-httpd.noarch 80.5-2.el8
vzlinux-release x86_64 3:8.3-11.vl8 base0 35 k
replacing centos-linux-release.noarch 8.3-1.2011.el8
replacing centos-linux-repos.noarch 8-2.el8
Upgrading:
abattis-cantarell-fonts noarch 0.0.25-6.vl8.1 base0 155 k
acl x86_64 2.2.53-1.vl8.1 base0 80 k
...
(613/614): zip-3.0-23.vl8.x86_64.rpm 458 kB/s | 270 kB 00:00
(614/614): zlib-1.2.11-17.vl8.x86_64.rpm 160 kB/s | 102 kB 00:00
--------------------------------------------------------------------------------
Total 376 kB/s | 381 MB 17:17
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Running scriptlet: filesystem-3.8-3.vl8.x86_64 1/1
but fails here:
Preparing : 1/1
Running scriptlet: libgcc-8.4.1-1.vl8.x86_64
1/1Error: Cannot open file
/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/libgcc-8.4.1-1.vl8.x86_64.rpm:
[Errno 24] Too many open files:
'/vz/template/vzlinux/8/x86_64/pm/base0-b1ad5fe4dfeb5b55/packages/libgcc-8.4.1-1.vl8.x86_64.rpm'
FATAL ERROR: python callback ??? failed, aborting!
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 20:48:44.232772
the CT seems still beeing a centos8 !?
[root@idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011
is it broken now ? I did before a backup of the root.hds , I can revert it to
it's original centos 8 packages states, maybe I should set back that root.HDD
and allow more open files to reply the process
Kevin Drysdale said on that thread :
Yes, it was just the stock ulimit default value of 1024 for open files before I
changed it. I increased that by a factor of 10 to 10240, and that did the
trick.
But where/how can I change the ulimit of open files ?
thanks .
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procac...@tem-tsp.eu>
Cc: "OpenVZ users" <users@openvz.org>
Envoyé: Vendredi 23 Avril 2021 20:04:58
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Yes, need to look into CT config
(/vz/private/7ed1de35-75bc-4137-977a-b4055067fb0a/ve.conf) and turn back
'centos' as template.
________________________________
From: Jehan PROCACCIA <jehan.procac...@tem-tsp.eu>
Sent: Friday, April 23, 2021 8:19 PM
To: Denis Silakov <dsila...@virtuozzo.com>
Cc: OpenVZ users <users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
well, it looks like I'am in the middle of the process, now it doesn't want to
convert anymore
# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion aborted: Container's OS
template is not supported
althought the CT seems to be keept in centos 8 :
[root@idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011
maybe I need to revert/remove something that the conversion has started ?
thanks .
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procac...@tem-tsp.eu>
Cc: "OpenVZ users" <users@openvz.org>
Envoyé: Vendredi 23 Avril 2021 16:28:45
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Probably the issue with gcc is caused by gcc update in VzLinux 8 which is
happening right now.
Could you check again, the repos are refreshed now?
And the script considered the problem to be serious enough not to proceed with
conversion.
________________________________
From: Jehan PROCACCIA <jehan.procac...@tem-tsp.eu>
Sent: Friday, April 23, 2021 5:01 PM
To: Denis Silakov <dsila...@virtuozzo.com>
Cc: OpenVZ users <users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
yes it's better with --log option , but still no convertion and errors/warnings
!? :
# vzconvert8 convert --log /tmp/idp4mt-convovz8.logidp4mt idp4mt
7ed1de35-75bc-4137-977a-b4055067fb0a: Creating the snapshot...
The snapshot with id {6a5c1dcf-776e-4011-a935-06b186c38541} has been
successfully created.
Starting conversion: 7ed1de35-75bc-4137-977a-b4055067fb0a at 15:58:13.564369
Cache was expired
0 files removed
base0 23 MB/s | 11 MB 00:00
base1 1.7 kB/s | 257 B 00:00
Metadata cache created.
Last metadata expiration check: 0:00:01 ago on Fri Apr 23 13:58:18 2021.
base0 31 kB/s | 4.2 kB 00:00
base1 38 kB/s | 2.9 kB 00:00
Error:
Problem: package annobin-9.35-1.vl8.x86_64 requires gcc >= 8, but none of the
providers can be installed
- package gcc-8.3.1-5.vl8.x86_64 requires libgomp = 8.3.1-5.vl8, but none of
the providers can be installed
- package redhat-rpm-config-125-1.vl8.noarch requires annobin, but none of the
providers can be installed
- cannot install both libgomp-8.3.1-5.vl8.x86_64 and
libgomp-8.3.1-5.1.el8.x86_64
- cannot install the best update candidate for package
redhat-rpm-config-123-1.el8.noarch
- problem with installed package libgomp-8.3.1-5.1.el8.x86_64
(try to add '--allowerasing' to command line to replace conflicting packages or
'--skip-broken' to skip uninstallable packages or '--nobest' to use not only
best candidate packages)
Error: /usr/share/vzyum/bin/yum failed, exitcode=1
7ed1de35-75bc-4137-977a-b4055067fb0a: Conversion successful at 15:58:21.015511
back on the CT I am still on centos 8 :
[root@idp4mt ~]# cat /etc/redhat-release
CentOS Linux release 8.3.2011
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procac...@tem-tsp.eu>, "OpenVZ users"
<users@openvz.org>
Envoyé: Vendredi 23 Avril 2021 15:48:57
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Looks like we broke launch without --log option while improving logging.
Will be fixed soon, as a workaround you can use --log option.
________________________________
From: jehan Procaccia tem-tsp <jehan.procac...@tem-tsp.eu>
Sent: Friday, April 23, 2021 4:41 PM
To: OpenVZ users <users@openvz.org>; Denis Silakov <dsila...@virtuozzo.com>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
I tested vzconvert8 from fresly installed vzdeploy8
(vzdeploy8-1.0.30-1.vl7.x86_64)
it failed :
# vzconvert8 convert tomcatsrv9
712c1ecb-29e8-46e9-b81b-7856fb4ab3c9: Creating the snapshot...
The snapshot with id {369834dc-cee0-4d87-807e-77f18b2f4c70} has been
successfully created.
Starting conversion: 712c1ecb-29e8-46e9-b81b-7856fb4ab3c9 at 15:36:46.492202
Traceback (most recent call last):
File "/usr/bin/vzconvert8", line 362, in <module>
args.func()
File "/usr/bin/vzconvert8", line 198, in process_cts
results = pool.map(process_single_ct, args.CT)
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 266, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 44, in mapstar
return list(map(*args))
File "/usr/bin/vzconvert8", line 300, in process_single_ct
log_info(l.strip(), ct_log)
UnboundLocalError: local variable 'ct_log' referenced before assignment
did I missed something ?
thanks .
Le 22/03/2021 à 08:09, Denis Silakov a écrit :
Looks a bit strange indeed, vzdeploy was intended to just leave httpd from
centos in such cases.
But now we have one more way for converting containers which will probably be
more reliable. It utilizes vzpkg tool and should be launched from the server
side:
# yum install vzdeploy8
# vzconvert8 convert <CTID>
________________________________
From: users-boun...@openvz.org<mailto:users-boun...@openvz.org>
<users-boun...@openvz.org><mailto:users-boun...@openvz.org> on behalf of Ian
<openvz_l...@fishnet.co.uk><mailto:openvz_l...@fishnet.co.uk>
Sent: Thursday, March 11, 2021 6:48 PM
To: OpenVZ users <users@openvz.org><mailto:users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
On 03/03/2021 10:46, Denis Silakov wrote:
> Meanwhile, issue with kernel-headers should be fixed in the latest script.
> ------------------------------------------------------------------------
Hi,
On a brand new centos8 container I get the following error from yum
after running the vzdeloy8 script (with the ignore kernel env set) :
-----
Modular dependency problems:
Problem 1: conflicting requests
- nothing provides module(platform:el8) needed by module
httpd:2.4:8030020201104025655:30b713e6-0.x86_64
Problem 2: conflicting requests
- nothing provides module(platform:el8) needed by module
python36:3.6:8030020201104034153:24f1489c-0.x86_64
Dependencies resolved.
Nothing to do.
------
I tried removing and reinstalling httpd* but that didn't resolve the error.
Any ideas ?
I feel this is very close now !
Thanks for all your hard work.
Regards
Ian
_______________________________________________
Users mailing list
Users@openvz.org<mailto:Users@openvz.org>
https://lists.openvz.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@openvz.org<mailto:Users@openvz.org>
https://lists.openvz.org/mailman/listinfo/users
________________________________
De: "Denis Silakov" <dsila...@virtuozzo.com>
À: "Jehan PROCACCIA" <jehan.procac...@tem-tsp.eu>, "OpenVZ users"
<users@openvz.org>
Envoyé: Vendredi 23 Avril 2021 15:48:57
Objet: Re: [Users] virtuozzo base OS and new centos 8 orientations
Looks like we broke launch without --log option while improving logging.
Will be fixed soon, as a workaround you can use --log option.
________________________________
From: jehan Procaccia tem-tsp <jehan.procac...@tem-tsp.eu>
Sent: Friday, April 23, 2021 4:41 PM
To: OpenVZ users <users@openvz.org>; Denis Silakov <dsila...@virtuozzo.com>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
I tested vzconvert8 from fresly installed vzdeploy8
(vzdeploy8-1.0.30-1.vl7.x86_64)
it failed :
# vzconvert8 convert tomcatsrv9
712c1ecb-29e8-46e9-b81b-7856fb4ab3c9: Creating the snapshot...
The snapshot with id {369834dc-cee0-4d87-807e-77f18b2f4c70} has been
successfully created.
Starting conversion: 712c1ecb-29e8-46e9-b81b-7856fb4ab3c9 at 15:36:46.492202
Traceback (most recent call last):
File "/usr/bin/vzconvert8", line 362, in <module>
args.func()
File "/usr/bin/vzconvert8", line 198, in process_cts
results = pool.map(process_single_ct, args.CT)
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 266, in map
return self._map_async(func, iterable, mapstar, chunksize).get()
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 644, in get
raise self._value
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 119, in worker
result = (True, func(*args, **kwds))
File "/usr/lib64/python3.6/multiprocessing/pool.py", line 44, in mapstar
return list(map(*args))
File "/usr/bin/vzconvert8", line 300, in process_single_ct
log_info(l.strip(), ct_log)
UnboundLocalError: local variable 'ct_log' referenced before assignment
did I missed something ?
thanks .
Le 22/03/2021 à 08:09, Denis Silakov a écrit :
Looks a bit strange indeed, vzdeploy was intended to just leave httpd from
centos in such cases.
But now we have one more way for converting containers which will probably be
more reliable. It utilizes vzpkg tool and should be launched from the server
side:
# yum install vzdeploy8
# vzconvert8 convert <CTID>
________________________________
From: users-boun...@openvz.org<mailto:users-boun...@openvz.org>
<users-boun...@openvz.org><mailto:users-boun...@openvz.org> on behalf of Ian
<openvz_l...@fishnet.co.uk><mailto:openvz_l...@fishnet.co.uk>
Sent: Thursday, March 11, 2021 6:48 PM
To: OpenVZ users <users@openvz.org><mailto:users@openvz.org>
Subject: Re: [Users] virtuozzo base OS and new centos 8 orientations
On 03/03/2021 10:46, Denis Silakov wrote:
> Meanwhile, issue with kernel-headers should be fixed in the latest script.
> ------------------------------------------------------------------------
Hi,
On a brand new centos8 container I get the following error from yum
after running the vzdeloy8 script (with the ignore kernel env set) :
-----
Modular dependency problems:
Problem 1: conflicting requests
- nothing provides module(platform:el8) needed by module
httpd:2.4:8030020201104025655:30b713e6-0.x86_64
Problem 2: conflicting requests
- nothing provides module(platform:el8) needed by module
python36:3.6:8030020201104034153:24f1489c-0.x86_64
Dependencies resolved.
Nothing to do.
------
I tried removing and reinstalling httpd* but that didn't resolve the error.
Any ideas ?
I feel this is very close now !
Thanks for all your hard work.
Regards
Ian
_______________________________________________
Users mailing list
Users@openvz.org<mailto:Users@openvz.org>
https://lists.openvz.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@openvz.org<mailto:Users@openvz.org>
https://lists.openvz.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@openvz.org
https://lists.openvz.org/mailman/listinfo/users
