Re: [pve-devel] [PATCH manager] ceph: extend pveceph purge

2020-05-04 Thread Thomas Lamprecht
On 5/3/20 5:53 PM, Alwin Antreich wrote: > to clean service directories as well as disable and stop Ceph services. > Addtionally provide the option to remove crash and log information. > > This patch is in addtion to #2607, as the current cleanup doesn't allow > to re-configure Ceph, without

[pve-devel] applied: [PATCH v2 common] print_text_table: handle undefined values in comparision

2020-05-04 Thread Thomas Lamprecht
On 4/28/20 12:00 PM, Oğuz Bektaş wrote: >> Fabian Ebner hat am 28. April 2020 10:18 geschrieben: >> >> >> by introducing a safe_compare helper. Fixes warnings, e.g. >> pvesh get /nodes//network >> would print "use of uninitialized"-warnings if there are inactive >> network interfaces, because

[pve-devel] applied: [PATCH widget-toolkit] window/LanguageEdit: make window non-resizable

2020-05-04 Thread Thomas Lamprecht
On 4/27/20 4:40 PM, Dominik Csapak wrote: > Signed-off-by: Dominik Csapak > --- > window/LanguageEdit.js | 1 + > 1 file changed, 1 insertion(+) > > diff --git a/window/LanguageEdit.js b/window/LanguageEdit.js > index dd7393c..9176cfd 100644 > --- a/window/LanguageEdit.js > +++

[pve-devel] applied: [PATCH common] fix #2696: avoid 'undefined value' warning in 'pvesh help'

2020-05-04 Thread Thomas Lamprecht
On 5/4/20 2:02 PM, Stefan Reiter wrote: > Signed-off-by: Stefan Reiter > --- > src/PVE/CLIHandler.pm | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/src/PVE/CLIHandler.pm b/src/PVE/CLIHandler.pm > index 763cd60..9955d77 100644 > --- a/src/PVE/CLIHandler.pm > +++

Re: [pve-devel] [PATCH guest-common 1/2] Avoid duplication by using lock_config_mode

2020-05-04 Thread Thomas Lamprecht
On 4/23/20 1:51 PM, Fabian Ebner wrote: > No functional change is intended. > > Signed-off-by: Fabian Ebner > --- > PVE/AbstractConfig.pm | 8 +--- > 1 file changed, 1 insertion(+), 7 deletions(-) > > diff --git a/PVE/AbstractConfig.pm b/PVE/AbstractConfig.pm > index beb10c7..f1b395c

[pve-devel] applied: [PATCH qemu-server 2/3] api/destroy: repeat early checks after lock

2020-05-04 Thread Thomas Lamprecht
On 4/27/20 10:24 AM, Fabian Grünbichler wrote: > to protect against concurrent changes > > Signed-off-by: Fabian Grünbichler > --- > best viewed with --patience -w > > PVE/API2/Qemu.pm | 40 +++- > 1 file changed, 23 insertions(+), 17 deletions(-) >

[pve-devel] applied: [PATCH qemu-server 1/3] QemuServer: drop unused imported locking functions

2020-05-04 Thread Thomas Lamprecht
On 4/27/20 10:24 AM, Fabian Grünbichler wrote: > lock_file is used by PVE::QemuServer::Memory, but it does properly 'use > PVE::Tools ...' itself so we can drop them in the main module. > > Signed-off-by: Fabian Grünbichler > --- > PVE/QemuServer.pm | 4 ++-- > 1 file changed, 2 insertions(+),

[pve-devel] applied: [PATCH manager] NodeConfig: ensure locked context has current view

2020-05-04 Thread Thomas Lamprecht
On 4/30/20 10:37 AM, Fabian Grünbichler wrote: > similar to the recent changes for pve-guest-common - we start each API > call with a cfs_update, but while we were waiting for the flock another > R-M-W cycle might have happened, so we need to refresh after obtaining > the lock. > > Signed-off-by:

[pve-devel] applied: [PATCH qemu-server] Revert "resize_vm: request new size from storage after resizing"

2020-05-04 Thread Thomas Lamprecht
On 3/4/20 10:51 AM, Fabian Ebner wrote: > This reverts commit b5490d8a98e5e7328eb4cebb0ae0b60e6d406c38. > > When resizing a volume of a running VM, a qmp block_resize command > is issued. This is non-blocking, so the size on the storage immediately > after issuing the command might still be the

[pve-devel] applied: [PATCH qemu-server] migrate: don't accidentally take NBD code paths

2020-05-04 Thread Thomas Lamprecht
On 4/30/20 9:35 AM, Fabian Grünbichler wrote: > by avoiding auto-vivification of $self->{online_local_volumes} via > iteration. most code paths don't care whether it's undef or a reference > to an empty list, but this caused the (already) fixed bug of calling > nbd_stop without having started an

[pve-devel] applied: [PATCH qemu-server] migrate: skip rescan for efidisk and shared volumes

2020-05-04 Thread Thomas Lamprecht
On 4/30/20 12:44 PM, Dominik Csapak wrote: > we really only want to rescan the disk size of the disks we actually > need, and that are only the local disks (for which we have to allocate > the correct size on the target) > > also we want to always skip the efidisk, since we get the wanted > size

[pve-devel] [PATCH v2 manager 1/2] vzdump: make guest include logic testable

2020-05-04 Thread Aaron Lauterer
As a first step to make the whole guest include logic more testable the part from the API endpoint has been moved to its own method with as little changes as possible. Everything concerning `all` and `exclude` logic is still in the PVE::VZDump->exec_backup() method. Signed-off-by: Aaron Lauterer

[pve-devel] [PATCH v2 manager 2/2] vzdump: test: add first tests to the guest include logic

2020-05-04 Thread Aaron Lauterer
Signed-off-by: Aaron Lauterer --- v1 -> v2: adapt handling of return values, closer to what is used in production code. test/Makefile | 5 +- test/vzdump_guest_included_test.pl | 191 + 2 files changed, 195 insertions(+), 1 deletion(-) create

[pve-devel] applied-series: [PATCH v2 qemu 1/2] experimentally move savevm-async back into a coroutine

2020-05-04 Thread Thomas Lamprecht
On 5/4/20 2:35 PM, Wolfgang Bumiller wrote: > Move qemu_savevm_state_{header,setup} into the main loop and > the rest of the iteration into a coroutine. The former need > to lock the iothread (and we can't unlock it in the > coroutine), and the latter can't deal with being in a > separate thread,

[pve-devel] [PATCH docs] remove SLAAC reference from cloudinit docs

2020-05-04 Thread Mira Limbeck
As we don't currently support SLAAC in the nocloud network format code, remove the reference from the docs. Signed-off-by: Mira Limbeck --- We have removed SLAAC from the GUI a while ago because cloud-init did not support it back then but missed the reference in the docs.

[pve-devel] [PATCH docs v3] add documenation for ldap syncing

2020-05-04 Thread Dominik Csapak
explaining the main Requirements and limitations, as well as the most important sync options Signed-off-by: Dominik Csapak --- changes from v2: * incorporated suggestions from aaron @aaron, regarding linking to character limitations, sadly no, this is a sub based format, so even if we would have

[pve-devel] applied: [PATCH acme] plugin id: limit to 'pve-configid' format

2020-05-04 Thread Thomas Lamprecht
Else one can pass almost arbitrary data as ID and break editing or deletion of a plugin. Signed-off-by: Thomas Lamprecht --- src/PVE/ACME/Challenge.pm | 1 + 1 file changed, 1 insertion(+) diff --git a/src/PVE/ACME/Challenge.pm b/src/PVE/ACME/Challenge.pm index 0af77a3..0c679fc 100644 ---

[pve-devel] [PATCH v2 qemu 2/2] add optional buffer size to QEMUFile

2020-05-04 Thread Wolfgang Bumiller
and use 4M for our savevm-async buffer size Signed-off-by: Wolfgang Bumiller --- Changes to v1: add missing call to free() in qemu_fclose. ...add-optional-buffer-size-to-QEMUFile.patch | 183 ++ debian/patches/series | 1 + 2 files changed, 184

[pve-devel] [PATCH v2 qemu 1/2] experimentally move savevm-async back into a coroutine

2020-05-04 Thread Wolfgang Bumiller
Move qemu_savevm_state_{header,setup} into the main loop and the rest of the iteration into a coroutine. The former need to lock the iothread (and we can't unlock it in the coroutine), and the latter can't deal with being in a separate thread, so a coroutine it must be. Signed-off-by: Wolfgang

[pve-devel] applied-series: [PATCH storage v5 00/17] Fix: #2124 zstd

2020-05-04 Thread Fabian Grünbichler
with an additional commit adding '--rsyncable'. thanks! On April 28, 2020 3:58 pm, Alwin Antreich wrote: > Zstandard (zstd) [0] is a data compression algorithm, in addition to > gzip, lzo for our backup/restore. It can utilize multiple core CPUs. But > by default it has one compression and one

[pve-devel] applied: [PATCH firewall 2/3] fix wrong icmpv6 types

2020-05-04 Thread Thomas Lamprecht
On 4/29/20 3:45 PM, Mira Limbeck wrote: > This removes icmpv6-type 'any' as it is not supported by ip6tables. Also > introduced new icmpv6 types 'beyond-scope', 'failed-policy' and > 'reject-route'. These values were taken from 'ip6tables -p icmpv6 -h'. > > Signed-off-by: Mira Limbeck > --- >

[pve-devel] applied: [PATCH firewall 4/4] add dport: factor out ICMP-type validity checking

2020-05-04 Thread Thomas Lamprecht
Signed-off-by: Thomas Lamprecht --- src/PVE/Firewall.pm | 26 ++ 1 file changed, 14 insertions(+), 12 deletions(-) diff --git a/src/PVE/Firewall.pm b/src/PVE/Firewall.pm index a6157e3..eadfc6b 100644 --- a/src/PVE/Firewall.pm +++ b/src/PVE/Firewall.pm @@ -812,6 +812,17

[pve-devel] applied: [PATCH firewall 2/4] fix typo: s/ICPM/ICMP/

2020-05-04 Thread Thomas Lamprecht
Signed-off-by: Thomas Lamprecht --- src/PVE/Firewall.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/PVE/Firewall.pm b/src/PVE/Firewall.pm index 5d1a584..28dbb19 100644 --- a/src/PVE/Firewall.pm +++ b/src/PVE/Firewall.pm @@ -1082,7 +1082,7 @@ sub

[pve-devel] applied: [PATCH firewall 3/4] icmp: allow to specify the echo-reply (0) type as integer

2020-05-04 Thread Thomas Lamprecht
Signed-off-by: Thomas Lamprecht --- src/PVE/Firewall.pm | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/src/PVE/Firewall.pm b/src/PVE/Firewall.pm index 28dbb19..a6157e3 100644 --- a/src/PVE/Firewall.pm +++ b/src/PVE/Firewall.pm @@ -2039,7 +2039,7 @@ sub ipt_rule_to_cmds {

[pve-devel] applied: [PATCH firewall 1/4] test/simulator: add very basic ICMP type functionallity

2020-05-04 Thread Thomas Lamprecht
For now without integer to full-name, and vice versa, mapping of ICMP types. Signed-off-by: Thomas Lamprecht --- src/PVE/FirewallSimulator.pm | 9 +++-- test/test-basic1/100.fw | 2 ++ test/test-basic1/tests | 4 3 files changed, 13 insertions(+), 2 deletions(-) diff --git

[pve-devel] applied: [PATCH firewall 1/3] fix iptables-restore failing if icmp-type value > 255

2020-05-04 Thread Thomas Lamprecht
On 4/29/20 3:45 PM, Mira Limbeck wrote: > This has to be done in both icmp and icmpv6 cases. Currently if > 'ipv6-icmp' is set via the GUI ('icmpv6' is not available there) there > is no icmp-type handling. As this is meant to fix the iptables-restore > failure if an icmp-type > 255 is specified,

Re: [pve-devel] [PATCH qemu 1/2] experimentally move savevm-async back into a coroutine

2020-05-04 Thread Wolfgang Bumiller
> On May 4, 2020 12:43 PM Stefan Reiter wrote: > > > Fixes the SIGSEGV issues on Ceph with snapshot and rollback for me, so: > > Tested-by: Stefan Reiter > > Just for reference, I also bisected the bug this fixes to upstream > commit 8c6b0356b53 ("util/async: make bh_aio_poll() O(1)"),

[pve-devel] [PATCH common] fix #2696: avoid 'undefined value' warning in 'pvesh help'

2020-05-04 Thread Stefan Reiter
Signed-off-by: Stefan Reiter --- src/PVE/CLIHandler.pm | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/PVE/CLIHandler.pm b/src/PVE/CLIHandler.pm index 763cd60..9955d77 100644 --- a/src/PVE/CLIHandler.pm +++ b/src/PVE/CLIHandler.pm @@ -235,8 +235,8 @@ sub

[pve-devel] [PATCH v2 manager 5/6] ui: CPUModelSelector: use API call for store

2020-05-04 Thread Stefan Reiter
CPU models are retrieved from the new /nodes/X/cpu call and ordered by vendor to approximate the previous sort order (less change for accustomed users). With this, custom CPU models are now selectable via the GUI. Signed-off-by: Stefan Reiter --- v2: * Put vendor map and order map into

[pve-devel] [PATCH v2 qemu-server 1/6] api: check Sys.Audit permissions when setting a custom CPU model

2020-05-04 Thread Stefan Reiter
Explicitly allows changing other properties than the cputype, even if the currently set cputype is not accessible by the user. This way, an administrator can assign a custom CPU type to a VM for a less privileged user without breaking edit functionality for them. Signed-off-by: Stefan Reiter ---

[pve-devel] [PATCH v2 0/6] Custom CPU models API/GUI basics

2020-05-04 Thread Stefan Reiter
Permission handling, the beginnings of the API and getting the GUI to play nice with custom models (no editor yet, but it'll behave as expected if a determined user creates a custom model by editing the config). First 3 patches are API stuff, 4 is an independent UI fix/cleanup, rest are new GUI

[pve-devel] [PATCH v2 qemu-server 2/6] api: allow listing custom and default CPU models

2020-05-04 Thread Stefan Reiter
More API calls will follow for this path, for now add the 'index' call to list all custom and default CPU models. Any user can list the default CPU models, as these are public anyway, but custom models are restricted to users with Sys.Audit on /nodes. Signed-off-by: Stefan Reiter ---

[pve-devel] [PATCH v2 manager 6/6] ui: ProcessorEdit: allow modifications with inaccessible CPU model

2020-05-04 Thread Stefan Reiter
An administrator can set a custom CPU model for a VM where the general user does not have permission to use this particular model. Prior to this change the ProcessorEdit component would be broken by this, since the store of the CPU type selector did not contain the configured CPU model. Add it in

[pve-devel] [PATCH v2 manager 3/6] api: register /nodes/X/cpu call for CPU models

2020-05-04 Thread Stefan Reiter
Signed-off-by: Stefan Reiter --- Depends on updated qemu-server. PVE/API2/Nodes.pm | 7 +++ 1 file changed, 7 insertions(+) diff --git a/PVE/API2/Nodes.pm b/PVE/API2/Nodes.pm index 58497b2b..2ac838ea 100644 --- a/PVE/API2/Nodes.pm +++ b/PVE/API2/Nodes.pm @@ -34,6 +34,7 @@ use

[pve-devel] [PATCH v2 manager 4/6] ui: ProcessorEdit: fix total core calculation and use view model

2020-05-04 Thread Stefan Reiter
Clean up the code in ProcessorEdit with a view model and fix a bug while at it - previously, pressing the 'Reset' button on the form would always set the value of the total core count field to 1, so mark 'totalcores' with 'isFormField: false' to avoid reset. Signed-off-by: Stefan Reiter --- v2:

Re: [pve-devel] [PATCH qemu 2/2] add optional buffer size to QEMUFile

2020-05-04 Thread Stefan Reiter
On 5/4/20 12:02 PM, Wolfgang Bumiller wrote: and use 4M for our savevm-async buffer size Signed-off-by: Wolfgang Bumiller --- ...add-optional-buffer-size-to-QEMUFile.patch | 173 ++ debian/patches/series | 1 + 2 files changed, 174 insertions(+)

Re: [pve-devel] [PATCH qemu 1/2] experimentally move savevm-async back into a coroutine

2020-05-04 Thread Stefan Reiter
Fixes the SIGSEGV issues on Ceph with snapshot and rollback for me, so: Tested-by: Stefan Reiter Just for reference, I also bisected the bug this fixes to upstream commit 8c6b0356b53 ("util/async: make bh_aio_poll() O(1)"), i.e. it only breaks after this commit. Might be an upstream bug too

[pve-devel] [PATCH qemu 2/2] add optional buffer size to QEMUFile

2020-05-04 Thread Wolfgang Bumiller
and use 4M for our savevm-async buffer size Signed-off-by: Wolfgang Bumiller --- ...add-optional-buffer-size-to-QEMUFile.patch | 173 ++ debian/patches/series | 1 + 2 files changed, 174 insertions(+) create mode 100644

Re: [pve-devel] [PATCH manager 2/3] Allow setting targetstorage for offline migration

2020-05-04 Thread Fabian Grünbichler
On May 4, 2020 11:20 am, Tim Marx wrote: > >> Fabian Ebner hat am 4. Mai 2020 09:26 geschrieben: >> >> >> On 5/2/20 11:40 AM, Alexandre DERUMIER wrote: >> >>> The problem is that offline migration with target storage might not >> >>> always work depending on supported export/import formats.

Re: [pve-devel] [PATCH manager 2/3] Allow setting targetstorage for offline migration

2020-05-04 Thread Tim Marx
> Fabian Ebner hat am 4. Mai 2020 09:26 geschrieben: > > > On 5/2/20 11:40 AM, Alexandre DERUMIER wrote: > >>> The problem is that offline migration with target storage might not > >>> always work depending on supported export/import formats. Then users > >>> might start an offline migration,

[pve-devel] [PATCH v2 manager 2/2] Allow setting no target storage and make it default

2020-05-04 Thread Fabian Ebner
so the current disk locations can be preserved even if there are multiple local disks. And users don't have to manually select the current storage if there is only one local disk. Signed-off-by: Fabian Ebner --- www/manager6/window/Migrate.js | 8 ++-- 1 file changed, 6 insertions(+), 2

[pve-devel] [PATCH v2 manager 1/2] Don't show empty parentheses when size is not known

2020-05-04 Thread Fabian Ebner
The size of VM state files and the size of unused disks not referenced by any snapshot is not saved in the VM configuration, so it's not available here either. Signed-off-by: Fabian Ebner --- Changes from v1: * use variable for size text and use format string * drop patch exposing

Re: [pve-devel] [PATCH manager 2/3] Allow setting targetstorage for offline migration

2020-05-04 Thread Fabian Ebner
On 5/2/20 11:40 AM, Alexandre DERUMIER wrote: The problem is that offline migration with target storage might not always work depending on supported export/import formats. Then users might start an offline migration, which then fails after a few disks have already been copied. Hi,