[PULL 06/17] tests/qtest: Allow qtest_qemu_binary to use a custom environment variable

2023-10-20 Thread Juan Quintela
use QTEST_QEMU_BINARY as a fallback. Reviewed-by: Juan Quintela Reviewed-by: Thomas Huth Signed-off-by: Fabiano Rosas Signed-off-by: Juan Quintela Message-ID: <20231018192741.25885-2-faro...@suse.de> --- tests/qtest/libqtest.c | 13 ++--- 1 file changed, 10 insertions(+), 3 del

[PULL 00/17] Migration 20231020 patches

2023-10-20 Thread Juan Quintela
The following changes since commit 0d239e513e0117e66fa739fb71a43b9383a108ff: Merge tag 'pull-lu-20231018' of https://gitlab.com/rth7680/qemu into staging (2023-10-19 10:20:57 -0700) are available in the Git repository at: https://gitlab.com/juan.quintela/qemu.git

[PATCH 12/13] migration: Use vmstate_register_any() for eeprom93xx

2023-10-19 Thread Juan Quintela
We can have more than one eeprom93xx. For instance: e100_nic_realize() -> eeprom93xx_new() Signed-off-by: Juan Quintela --- hw/nvram/eeprom93xx.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hw/nvram/eeprom93xx.c b/hw/nvram/eeprom93xx.c index 1081e2cc0d..57d6363

[PATCH 13/13] migration: Use vmstate_register_any() for vmware_vga

2023-10-19 Thread Juan Quintela
I have no idea if we can have more than one vmware_vga device, so play it safe. Signed-off-by: Juan Quintela --- hw/display/vmware_vga.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hw/display/vmware_vga.c b/hw/display/vmware_vga.c index 09591fbd39..7490d43881 100644

[PATCH 05/13] migration: Use VMSTATE_INSTANCE_ID_ANY for slirp

2023-10-19 Thread Juan Quintela
/qtest/libqtest.c:195: kill_qemu() tried to terminate QEMU process but encountered exit status 1 (expected 0) Aborted (core dumped) Signed-off-by: Juan Quintela --- net/slirp.c | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/net/slirp.c b/net/slirp.c index c33b3e02e7

[PATCH 11/13] migration: Use vmstate_register_any() for audio

2023-10-19 Thread Juan Quintela
We can have more than one audio card. void audio_init_audiodevs(void) { AudiodevListEntry *e; QSIMPLEQ_FOREACH(e, , next) { audio_init(e->dev, _fatal); } } Signed-off-by: Juan Quintela --- audio/audio.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --

[PATCH 04/13] migration: Use vmstate_register_any() for ipmi-bt*

2023-10-19 Thread Juan Quintela
Otherwise device-introspection-test fails. $ ./tests/qtest/device-introspect-test ... Broken pipe ../../../../../mnt/code/qemu/full/tests/qtest/libqtest.c:195: kill_qemu() tried to terminate QEMU process but encountered exit status 1 (expected 0) Aborted (core dumped) Signed-off-by: Juan

[PATCH 08/13] migration: vmstate_register() check that instance_id is valid

2023-10-19 Thread Juan Quintela
Signed-off-by: Juan Quintela --- include/migration/vmstate.h | 6 ++ 1 file changed, 6 insertions(+) diff --git a/include/migration/vmstate.h b/include/migration/vmstate.h index 9ca7e9cc48..d1282a78ef 100644 --- a/include/migration/vmstate.h +++ b/include/migration/vmstate.h @@ -28,6 +28,7

[PATCH 06/13] migration: Use VMSTATE_INSTANCE_ID_ANY for s390 devices

2023-10-19 Thread Juan Quintela
(expected 0) Aborted (core dumped) Signed-off-by: Juan Quintela --- hw/s390x/s390-skeys.c| 3 ++- hw/s390x/s390-stattrib.c | 3 ++- 2 files changed, 4 insertions(+), 2 deletions(-) diff --git a/hw/s390x/s390-skeys.c b/hw/s390x/s390-skeys.c index 5024faf411..ef089e1967 100644 --- a/hw/s390x/s390

[PATCH 07/13] RFC migration: icp/server is a mess

2023-10-19 Thread Juan Quintela
his machine is already complex enough, I need help from PPC maintainers to fix this. Volunteers? CC: Cedric Le Goater CC: Daniel Henrique Barboza CC: David Gibson CC: Greg Kurz Signed-off-by: Juan Quintela --- hw/ppc/spapr.c | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff -

[PATCH 10/13] migration: Improve example and documentation of vmstate_register()

2023-10-19 Thread Juan Quintela
Signed-off-by: Juan Quintela --- docs/devel/migration.rst | 12 1 file changed, 8 insertions(+), 4 deletions(-) diff --git a/docs/devel/migration.rst b/docs/devel/migration.rst index c3e1400c0c..a9fde75862 100644 --- a/docs/devel/migration.rst +++ b/docs/devel/migration.rst

[PATCH 09/13] migration: Check in savevm_state_handler_insert for dups

2023-10-19 Thread Juan Quintela
Signed-off-by: Peter Xu Reviewed-by: Juan Quintela Reviewed-by: Dr. David Alan Gilbert Signed-off-by: Juan Quintela --- migration/savevm.c | 14 ++ 1 file changed, 14 insertions(+) diff --git a/migration/savevm.c b/migration/savevm.c index 8622f229e5..e26833eaae 100644 --- a/migratio

[PATCH 02/13] migration: Use vmstate_register_any()

2023-10-19 Thread Juan Quintela
This are the easiest cases, where we were already using VMSTATE_INSTANCE_ID_ANY. Signed-off-by: Juan Quintela --- backends/dbus-vmstate.c | 3 +-- backends/tpm/tpm_emulator.c | 3 +-- hw/i2c/core.c | 2 +- hw/input/adb.c | 2 +- hw/input/ads7846.c | 2

[PATCH 01/13] migration: Create vmstate_register_any()

2023-10-19 Thread Juan Quintela
-by: Juan Quintela --- include/migration/vmstate.h | 17 + 1 file changed, 17 insertions(+) diff --git a/include/migration/vmstate.h b/include/migration/vmstate.h index 1a31fb7293..9ca7e9cc48 100644 --- a/include/migration/vmstate.h +++ b/include/migration/vmstate.h @@ -1230,6

[PATCH 03/13] migration: Use vmstate_register_any() for isa-ide

2023-10-19 Thread Juan Quintela
exit status 1 (expected 0) Aborted (core dumped) $ Signed-off-by: Juan Quintela --- hw/ide/isa.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/hw/ide/isa.c b/hw/ide/isa.c index 95053e026f..ea60c08116 100644 --- a/hw/ide/isa.c +++ b/hw/ide/isa.c @@ -73,7 +73,7 @@ static void

[PATCH 00/13] migration: Check for duplicates on vmstate_register()

2023-10-19 Thread Juan Quintela
ust happens that is value is < VMSTATE_INSTANCE_ID_ANY. Please, review. Juan Quintela (12): migration: Create vmstate_register_any() migration: Use vmstate_register_any() migration: Use vmstate_register_any() for isa-ide migration: Use vmstate_register_any() for ipmi-bt* migration: Use VMSTATE_INSTANCE

Re: [PULL 13/38] migration: Non multifd migration don't care about multifd flushes

2023-10-19 Thread Juan Quintela
Michael Tokarev wrote: > 17.10.2023 11:29, Juan Quintela: >> RDMA was having trouble because >> migrate_multifd_flush_after_each_section() can only be true or false, >> but we don't want to send any flush when we are not in multifd >> migration. >> CC: Fab

[PATCH v8 4/5] migration: Deprecate block migration

2023-10-18 Thread Juan Quintela
It is obsolete. It is better to use driver-mirror with NBD instead. CC: Kevin Wolf CC: Eric Blake CC: Stefan Hajnoczi CC: Hanna Czenczek Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 10 ++ qapi

[PATCH v8 5/5] migration: Deprecate old compression method

2023-10-18 Thread Juan Quintela
Acked-by: Stefan Hajnoczi Acked-by: Peter Xu Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 8 + qapi/migration.json | 63 ++- migration/options.c | 13 3 files changed, 64 insertions

[PATCH v8 2/5] migration: migrate 'inc' command option is deprecated.

2023-10-18 Thread Juan Quintela
Use blockdev-mirror with NBD instead. Reviewed-by: Thomas Huth Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 8 qapi/migration.json| 8 +++- migration/migration-hmp-cmds.c | 5

[PATCH v8 3/5] migration: migrate 'blk' command option is deprecated.

2023-10-18 Thread Juan Quintela
Use blocked-mirror with NBD instead. Acked-by: Stefan Hajnoczi Reviewed-by: Thomas Huth Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 9 + qapi/migration.json| 7 --- migration/migration-hmp-cmds.c | 5

[PATCH v8 1/5] qemu-iotests: Filter warnings about block migration being deprecated

2023-10-18 Thread Juan Quintela
Create a new filter that removes the two warnings for test 183. Signed-off-by: Juan Quintela --- tests/qemu-iotests/183 | 2 +- tests/qemu-iotests/common.filter | 7 +++ 2 files changed, 8 insertions(+), 1 deletion(-) diff --git a/tests/qemu-iotests/183 b/tests/qemu-iotests/183

[PATCH v8 0/5] Migration deprecated parts

2023-10-18 Thread Juan Quintela
n if we remove it is not so big. So we can leave it until 9.0 or whatever we think fit. What do you think? Later, Juan. Juan Quintela (5): qemu-iotests: Filter warnings about block migration being deprecated migration: migrate 'inc' command option is deprecated. migration: migrate 'blk

Re: [PATCH v7 0/4] Migration deprecated parts

2023-10-18 Thread Juan Quintela
Daniel P. Berrangé wrote: > On Wed, Oct 18, 2023 at 12:38:10PM +0200, Juan Quintela wrote: >> Juan Quintela wrote: >> > Based on: Message-ID: <20231018100651.32674-1-quint...@redhat.com> >> > [PULL 00/11] Migration 20231018 patches >> > >

Re: [PATCH v7 0/4] Migration deprecated parts

2023-10-18 Thread Juan Quintela
Juan Quintela wrote: > Based on: Message-ID: <20231018100651.32674-1-quint...@redhat.com> > [PULL 00/11] Migration 20231018 patches > > And here we are, at v7: > - drop black line at the end of deprecated.rst > - change qemu-iotest output due to warnings for d

[PATCH v7 1/4] migration: migrate 'inc' command option is deprecated.

2023-10-18 Thread Juan Quintela
Use blockdev-mirror with NBD instead. Reviewed-by: Thomas Huth Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 8 qapi/migration.json| 8 +++- migration/migration-hmp-cmds.c | 5

[PATCH v7 2/4] migration: migrate 'blk' command option is deprecated.

2023-10-18 Thread Juan Quintela
Use blocked-mirror with NBD instead. Acked-by: Stefan Hajnoczi Reviewed-by: Thomas Huth Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 9 + qapi/migration.json| 7 --- migration/migration-hmp-cmds.c | 5

[PATCH v7 4/4] migration: Deprecate old compression method

2023-10-18 Thread Juan Quintela
Acked-by: Stefan Hajnoczi Acked-by: Peter Xu Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 8 + qapi/migration.json | 63 ++- migration/options.c | 13 3 files changed, 64 insertions

[PATCH v7 0/4] Migration deprecated parts

2023-10-18 Thread Juan Quintela
ecause management apps have a working option that are already using "defer", and the code simplifacation if we remove it is not so big. So we can leave it until 9.0 or whatever we think fit. What do you think? Later, Juan. Juan Quintela (4): migration: migrate 'inc' command opti

[PATCH v7 3/4] migration: Deprecate block migration

2023-10-18 Thread Juan Quintela
It is obsolete. It is better to use driver-mirror with NBD instead. CC: Kevin Wolf CC: Eric Blake CC: Stefan Hajnoczi CC: Hanna Czenczek Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 10 ++ qapi

Re: [PATCH v6 2/5] migration: migrate 'inc' command option is deprecated.

2023-10-18 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> Use blockdev-mirror with NBD instead. >> >> Reviewed-by: Thomas Huth >> Acked-by: Stefan Hajnoczi >> Reviewed-by: Markus Armbruster >> Signed-off-by: Juan Quintela >> --- >>

Re: [PATCH v6 3/5] migration: migrate 'blk' command option is deprecated.

2023-10-17 Thread Juan Quintela
Juan Quintela wrote: > Use blocked-mirror with NBD instead. > > Signed-off-by: Juan Quintela > Acked-by: Stefan Hajnoczi > Reviewed-by: Thomas Huth > Reviewed-by: Markus Armbruster Hi Kevin and Stefan Can we change the iotest output to fix this? https://gitlab.com/juan.qu

[PATCH v6 4/5] migration: Deprecate block migration

2023-10-17 Thread Juan Quintela
It is obsolete. It is better to use driver-mirror with NBD instead. CC: Kevin Wolf CC: Eric Blake CC: Stefan Hajnoczi CC: Hanna Czenczek Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster --- docs/about/deprecated.rst | 10 ++ qapi

[PATCH v6 2/5] migration: migrate 'inc' command option is deprecated.

2023-10-17 Thread Juan Quintela
Use blockdev-mirror with NBD instead. Reviewed-by: Thomas Huth Acked-by: Stefan Hajnoczi Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela --- docs/about/deprecated.rst | 9 + qapi/migration.json| 8 +++- migration/migration-hmp-cmds.c | 5

[PATCH v6 1/5] migration: Print block status when needed

2023-10-17 Thread Juan Quintela
The new line was only printed when command options were used. When we used migration parameters and capabilities, it wasn't. Signed-off-by: Juan Quintela Reviewed-by: Fabiano Rosas --- migration/migration-hmp-cmds.c | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git

[PATCH v6 3/5] migration: migrate 'blk' command option is deprecated.

2023-10-17 Thread Juan Quintela
Use blocked-mirror with NBD instead. Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi Reviewed-by: Thomas Huth Reviewed-by: Markus Armbruster --- docs/about/deprecated.rst | 9 + qapi/migration.json| 7 --- migration/migration-hmp-cmds.c | 5

[PATCH v6 5/5] migration: Deprecate old compression method

2023-10-17 Thread Juan Quintela
Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi Acked-by: Peter Xu Reviewed-by: Markus Armbruster --- docs/about/deprecated.rst | 8 + qapi/migration.json | 63 ++- migration/options.c | 13 3 files changed, 64 insertions

[PATCH v6 0/5] Migration deprecated parts

2023-10-17 Thread Juan Quintela
option that are already using "defer", and the code simplifacation if we remove it is not so big. So we can leave it until 9.0 or whatever we think fit. What do you think? Later, Juan. Juan Quintela (5): migration: Print block status when needed migration: migrate 'inc

Re: [PATCH v5 5/7] migration: Deprecate old compression method

2023-10-17 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> Signed-off-by: Juan Quintela >> Acked-by: Stefan Hajnoczi >> Acked-by: Peter Xu >> # @deprecated: Member @disk is deprecated because block migration is. >> +# Member @compression is

Re: [PATCH v5 4/7] migration: Deprecate block migration

2023-10-17 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> # >> +# @deprecated: Member @block-incremental is deprecated. Use > > Two spaces between sentences for consistency, please. Done. At least here I did the copy and paste right. >> diff --git a/migration/block.

Re: [PATCH v5 3/7] migration: migrate 'blk' command option is deprecated.

2023-10-17 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> Use blocked-mirror with NBD instead. >> >> Signed-off-by: Juan Quintela >> Acked-by: Stefan Hajnoczi >> Reviewed-by: Thomas Huth >> >> --- >> >> Improve documentation and s

Re: [PATCH v5 2/7] migration: migrate 'inc' command option is deprecated.

2023-10-17 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> Use blockdev-mirror with NBD instead. >> >> Reviewed-by: Thomas Huth >> Acked-by: Stefan Hajnoczi >> Signed-off-by: Juan Quintela >> >> --- >> >> Improve documentation and style (

Re: [PULL 11/38] tests/qtest: migration-test: Add tests for file-based migration

2023-10-17 Thread Juan Quintela
Fabiano Rosas wrote: > Juan Quintela writes: > [..] >>>> I am resubmitting with this change. >>>> >>>> But I think we need to change this: >>>> >>>>>> +g_autofree char *path = g_strdup_printf("%s/%s", tmpfs

Re: [PATCH 2/2] virtio: Drop out of coroutine context in virtio_load()

2023-10-17 Thread Juan Quintela
Michael Tokarev wrote: > 05.09.2023 17:50, Kevin Wolf wrote: >> virtio_load() as a whole should run in coroutine context because it >> reads from the migration stream and we don't want this to block. >> However, it calls virtio_set_features_nocheck() and devices don't >> expect their

Re: [PULL 11/38] tests/qtest: migration-test: Add tests for file-based migration

2023-10-17 Thread Juan Quintela
Fabiano Rosas wrote: > Juan Quintela writes: > >> Fabiano Rosas wrote: >> D> Juan Quintela writes: >>> >>>> From: Fabiano Rosas >>>> >>>> Add basic tests for file-based migration. >>>> >>>> Note that we

[PATCH v5 3/7] migration: migrate 'blk' command option is deprecated.

2023-10-17 Thread Juan Quintela
Use blocked-mirror with NBD instead. Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi Reviewed-by: Thomas Huth --- Improve documentation and style (markus) --- docs/about/deprecated.rst | 10 ++ qapi/migration.json| 6 -- migration/migration-hmp-cmds.c

[PATCH v5 1/7] migration: Print block status when needed

2023-10-17 Thread Juan Quintela
The new line was only printed when command options were used. When we used migration parameters and capabilities, it wasn't. Signed-off-by: Juan Quintela --- migration/migration-hmp-cmds.c | 5 ++--- 1 file changed, 2 insertions(+), 3 deletions(-) diff --git a/migration/migration-hmp-cmds.c b

[PATCH v5 0/7] Migration deprecated parts

2023-10-17 Thread Juan Quintela
t so big. So we can leave it until 9.0 or whatever we think fit. What do you think? Later, Juan. Juan Quintela (7): migration: Print block status when needed migration: migrate 'inc' command option is deprecated. migration: migrate 'blk' command option is deprecated. migration:

[PATCH v5 2/7] migration: migrate 'inc' command option is deprecated.

2023-10-17 Thread Juan Quintela
Use blockdev-mirror with NBD instead. Reviewed-by: Thomas Huth Acked-by: Stefan Hajnoczi Signed-off-by: Juan Quintela --- Improve documentation and style (thanks Markus) --- docs/about/deprecated.rst | 8 qapi/migration.json| 8 +++- migration/migration-hmp

[PATCH v5 6/7] [RFC] migration: Make -i/-b an error for hmp and qmp

2023-10-17 Thread Juan Quintela
[DON'T MERGE] Block migration is obsolete, users should use blockdev-mirror instead. Make it one error to set them. Signed-off-by: Juan Quintela --- migration/migration-hmp-cmds.c | 13 +++-- migration/migration.c | 33 ++--- 2 files changed, 13

[PATCH v5 4/7] migration: Deprecate block migration

2023-10-17 Thread Juan Quintela
It is obsolete. It is better to use driver-mirror with NBD instead. CC: Kevin Wolf CC: Eric Blake CC: Stefan Hajnoczi CC: Hanna Czenczek Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi --- docs/about/deprecated.rst | 10 ++ qapi/migration.json | 29

[PATCH v5 7/7] [RFC] migration: Remove helpers needed for -i/-b migrate options

2023-10-17 Thread Juan Quintela
[DON'T MERGE] We were abusing capabilities and parameters to implement -i/-b. Previous patch convert that options into one error. Remove all the helpers needed to implement them. Signed-off-by: Juan Quintela --- migration/migration.h | 4 migration/options.h | 6 -- migration

[PATCH v5 5/7] migration: Deprecate old compression method

2023-10-17 Thread Juan Quintela
Signed-off-by: Juan Quintela Acked-by: Stefan Hajnoczi Acked-by: Peter Xu --- docs/about/deprecated.rst | 8 qapi/migration.json | 79 +-- migration/options.c | 13 +++ 3 files changed, 72 insertions(+), 28 deletions(-) diff --git

[PULL 16/38] migration/rdma: Unfold ram_control_after_iterate()

2023-10-17 Thread Juan Quintela
Once there: - Remove unused data parameter - unfold it in its callers - change all callers to call qemu_rdma_registration_stop() - We need to call QIO_CHANNEL_RDMA() after we check for migrate_rdma() Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-4-qu

[PULL 30/38] multifd: reset next_packet_len after sending pages

2023-10-17 Thread Juan Quintela
Reviewed-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184358.97349-5-elena.ufimts...@oracle.com> --- migration/multifd.c | 1 + 1 file changed, 1 insertion(+) diff --git a/migration/multifd.c b/migration/multifd.c index e6e0013c16..c45f5015f8

[PULL 32/38] migration/ram: Remove RAMState from xbzrle_cache_zero_page

2023-10-17 Thread Juan Quintela
From: Fabiano Rosas 'rs' is not used in that function. It's a leftover from commit 9360447d34 ("ram: Use MigrationStats for statistics"). Reviewed-by: Peter Xu Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184604

[PULL 23/38] migration/rdma: Check sooner if we are in postcopy for save_page()

2023-10-17 Thread Juan Quintela
Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-11-quint...@redhat.com> --- migration/rdma.c | 6 +- 1 file changed, 1 insertion(+), 5 deletions(-) diff --git a/migration/rdma.c b/migration/rdma.c index c147c94b08..e973

[PULL 20/38] qemu-file: Remove QEMUFileHooks

2023-10-17 Thread Juan Quintela
The only user was rdma, and its use is gone. Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-8-quint...@redhat.com> --- migration/qemu-file.h | 4 migration/qemu-file.c | 6 -- migration/rdma.c | 9 - 3

[PULL 26/38] migration/rdma: Remove all "ret" variables that are used only once

2023-10-17 Thread Juan Quintela
Change code that is: int ret; ... ret = foo(); if (ret[ < 0]?) { to: if (foo()[ < 0]) { Reviewed-by: Fabiano Rosas Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-14-quint...@redhat.com> --- migration/rdma.c | 29 -

[PULL 31/38] migration/ram: Refactor precopy ram loading code

2023-10-17 Thread Juan Quintela
Reviewed-by: Peter Xu Reviewed-by: Juan Quintela Signed-off-by: Fabiano Rosas Signed-off-by: Juan Quintela Message-ID: <20231011184604.32364-3-faro...@suse.de> --- migration/ram.c | 146 +++- 1 file changed, 82 insertions(+), 64 deletions(-)

[PULL 25/38] migration/rdma: Declare for index variables local

2023-10-17 Thread Juan Quintela
Declare all variables that are only used inside a for loop inside the for statement. This makes clear that they are not used outside of the for loop. Reviewed-by: Fabiano Rosas Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-13-quint...@redhat.

[PULL 34/38] migration/ram: Move xbzrle zero page handling into save_zero_page

2023-10-17 Thread Juan Quintela
-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184604.32364-6-faro...@suse.de> --- migration/ram.c | 35 --- 1 file changed, 20 insertions(+), 15 deletions(-) diff --git a/migration/ram.c b/migration/ram.c index 2ec28c4507..229cad5c74

[PULL 28/38] migration: check for rate_limit_max for RATE_LIMIT_DISABLED

2023-10-17 Thread Juan Quintela
there. Signed-off-by: Elena Ufimtseva Reviewed-by: Fabiano Rosas Reviewed-by: Peter Xu Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184358.97349-2-elena.ufimts...@oracle.com> --- migration/migration-stats.c | 9 + 1 file changed, 5 insertions(+), 4 del

[PULL 36/38] migration/multifd: Remove direct "socket" references

2023-10-17 Thread Juan Quintela
From: Fabiano Rosas We're about to enable support for other transports in multifd, so remove direct references to sockets. Signed-off-by: Fabiano Rosas Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231012134343.23757-2-f

[PULL 24/38] migration/rdma: Use i as for index instead of idx

2023-10-17 Thread Juan Quintela
Once there, all the uses are local to the for, so declare the variable inside the for statement. Reviewed-by: Fabiano Rosas Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-12-quint...@redhat.com> --- migration/rdma.

[PULL 13/38] migration: Non multifd migration don't care about multifd flushes

2023-10-17 Thread Juan Quintela
RDMA was having trouble because migrate_multifd_flush_after_each_section() can only be true or false, but we don't want to send any flush when we are not in multifd migration. CC: Fabiano Rosas Reviewed-by: Li Zhijian Reviewed-by: Peter Xu Signed-off-by: Juan Quintela Message-ID

[PULL 10/38] tests/qtest/migration: Add a test for the analyze-migration script

2023-10-17 Thread Juan Quintela
is the most likely to know right away what the problem is. Signed-off-by: Fabiano Rosas Acked-by: Thomas Huth Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-7-faro...@suse.de> --- tests/qtest/migration-test.

[PULL 02/38] migration: Use g_autofree to simplify ram_dirty_bitmap_reload()

2023-10-17 Thread Juan Quintela
From: Philippe Mathieu-Daudé Signed-off-by: Philippe Mathieu-Daudé Reviewed-by: Markus Armbruster Reviewed-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011023627.86691-1-phi...@linaro.org> --- migration/ram.c | 17 ++---

[PULL 06/38] migration: Fix analyze-migration.py 'configuration' parsing

2023-10-17 Thread Juan Quintela
"./scripts/analyze-migration.py", line 571, in read raise Exception("Unknown section type: %d" % section_type) Exception: Unknown section type: 5 Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-3-faro

[PULL 21/38] migration/rdma: Move rdma constants from qemu-file.h to rdma.h

2023-10-17 Thread Juan Quintela
Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-9-quint...@redhat.com> --- migration/qemu-file.h | 17 - migration/rdma.h | 16 migration/ram.c | 2 +- 3 files changed, 17 insertions(

[PULL 29/38] multifd: fix counters in multifd_send_thread

2023-10-17 Thread Juan Quintela
PAGE_SIZE) that is being sent as iov[0]. The packet_len part should be added to account for the size of MultiFDPacket and the array of the offsets. Signed-off-by: Elena Ufimtseva Reviewed-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184358.97349-4

[PULL 27/38] migration: Improve json and formatting

2023-10-17 Thread Juan Quintela
Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela Message-ID: <20231013104736.31722-2-quint...@redhat.com> --- qapi/migration.json | 7 +++ 1 file changed, 3 insertions(+), 4 deletions(-) diff --git a/qapi/migration.json b/qapi/migration.json index 360e609f66..db3df12d6c

[PULL 09/38] migration: Fix analyze-migration read operation signedness

2023-10-17 Thread Juan Quintela
ection_key] KeyError: ('spapr_iommu', -2147483648) Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-6-faro...@suse.de> --- scripts/analyze-migration.py | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) di

[PULL 05/38] migration: Add the configuration vmstate to the json writer

2023-10-17 Thread Juan Quintela
Borisov Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-2-faro...@suse.de> --- migration/migration.c | 1 + migration/savevm.c| 20 2 files changed, 17 insertions(+), 4 deletions(-) diff

[PULL 17/38] migration/rdma: Remove all uses of RAM_CONTROL_HOOK

2023-10-17 Thread Juan Quintela
Instead of going through ram_control_load_hook(), call qemu_rdma_registration_handle() directly. Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-5-quint...@redhat.com> --- migration/qemu-file.h | 1 - migration/rdma.h | 3 +++ migration

[PULL 01/38] migration: refactor migration_completion

2023-10-17 Thread Juan Quintela
Wang Reviewed-by: Peter Xu Reviewed-by: Isaku Yamahata Reviewed-by: Juan Quintela Message-ID: <20230804093053.5037-1-wei.w.w...@intel.com> Signed-off-by: Juan Quintela --- migration/migration.c | 167 -- 1 file changed, 94 insertions(+), 73 del

[PULL 38/38] migration/multifd: Clarify Error usage in multifd_channel_connect

2023-10-17 Thread Juan Quintela
passing the error into the function. Cc: Markus Armbruster Signed-off-by: Fabiano Rosas Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231012134343.23757-4-faro...@suse.de> --- migration/multifd.c

[PULL 19/38] migration/rdma: Create rdma_control_save_page()

2023-10-17 Thread Juan Quintela
The only user of ram_control_save_page() and save_page() hook was rdma. Just move the function to rdma.c, rename it to rdma_control_save_page(). Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-7-quint...@redhat.com> --- mig

[PULL 33/38] migration/ram: Stop passing QEMUFile around in save_zero_page

2023-10-17 Thread Juan Quintela
From: Fabiano Rosas We don't need the QEMUFile when we're already passing the PageSearchStatus. Reviewed-by: Peter Xu Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184604.32364-5-faro...@suse.de> --- migration/ram.

[PULL 14/38] migration: Create migrate_rdma()

2023-10-17 Thread Juan Quintela
Helper to say if we are doing a migration over rdma. Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-2-quint...@redhat.com> --- migration/migration.h | 2 ++ migration/options.h | 1 + migration/migration.c | 1 + mig

[PULL 35/38] migration/ram: Merge save_zero_page functions

2023-10-17 Thread Juan Quintela
From: Fabiano Rosas We don't need to do this in two pieces. One single function makes it easier to grasp, specially since it removes the indirection on the return value handling. Reviewed-by: Peter Xu Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela

[PULL 12/38] migration: hold the BQL during setup

2023-10-17 Thread Juan Quintela
semaphore. The comment in ram_init_bitmaps() was introduced by 4987783400 ("migration: fix incorrect memory_global_dirty_log_start outside BQL") and is removed, because it referred to the qemu_mutex_lock_iothread() call. Signed-off-by: Fiona Ebner Reviewed-by: Fabiano Rosas Review

[PULL 22/38] migration/rdma: Remove qemu_ prefix from exported functions

2023-10-17 Thread Juan Quintela
Functions are long enough even without this. Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-10-quint...@redhat.com> --- migration/rdma.h | 12 ++-- migration/ram.c| 14 +++--- migration/

[PULL 37/38] migration/multifd: Unify multifd_send_thread error paths

2023-10-17 Thread Juan Quintela
Quintela Signed-off-by: Juan Quintela Message-ID: <20231012134343.23757-3-faro...@suse.de> --- migration/multifd.c | 12 +++- 1 file changed, 3 insertions(+), 9 deletions(-) diff --git a/migration/multifd.c b/migration/multifd.c index 8e9a5ee394..c92955de41 100644 --- a/migration/mul

[PULL 11/38] tests/qtest: migration-test: Add tests for file-based migration

2023-10-17 Thread Juan Quintela
the migration data to the file before the destination can start reading. Add a new migration function specifically to handle the file migration. Reviewed-by: Peter Xu Reviewed-by: Juan Quintela Signed-off-by: Fabiano Rosas Signed-off-by: Juan Quintela Message-ID: <20230712190742.22294-7-faro...@suse

[PULL 07/38] migration: Add capability parsing to analyze-migration.py

2023-10-17 Thread Juan Quintela
From: Fabiano Rosas The script is broken when the configuration/capabilities section is present. Add support for parsing the capabilities so we can fix it in the next patch. Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15

[PULL 15/38] migration/rdma: Unfold ram_control_before_iterate()

2023-10-17 Thread Juan Quintela
Once there: - Remove unused data parameter - unfold it in its callers. - change all callers to call qemu_rdma_registration_start() - We need to call QIO_CHANNEL_RDMA() after we check for migrate_rdma() Reviewed-by: Li Zhijian Reviewed-by: Fabiano Rosas Signed-off-by: Juan Quintela Message-ID

[PULL 18/38] migration/rdma: Unfold hook_ram_load()

2023-10-17 Thread Juan Quintela
There is only one flag called with: RAM_CONTROL_BLOCK_REG. Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-6-quint...@redhat.com> --- migration/qemu-file.h | 11 --- migration/rdma.h | 3 +++ migration/qemu-file.c | 10 -- mig

[PULL 08/38] migration: Fix analyze-migration.py when ignore-shared is used

2023-10-17 Thread Juan Quintela
hat's added when x-ignore-shared is used to fix the script. Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-5-faro...@suse.de> --- scripts/analyze-migration.py | 5 + 1 file changed, 5 insertions(+) diff --git a/

[PULL 03/38] migration: Allow user to specify available switchover bandwidth

2023-10-17 Thread Juan Quintela
Reported-by: Zhiyi Guo Reviewed-by: Joao Martins Reviewed-by: Juan Quintela Signed-off-by: Peter Xu Signed-off-by: Juan Quintela Message-ID: <20231010221922.40638-1-pet...@redhat.com> --- qapi/migration.json| 34 +- migration/migration

[PULL 00/38] Migration 20231017 patches

2023-10-17 Thread Juan Quintela
references migration/multifd: Unify multifd_send_thread error paths migration/multifd: Clarify Error usage in multifd_channel_connect Fiona Ebner (1): migration: hold the BQL during setup Juan Quintela (15): migration: Non multifd migration don't care about multifd flushes migration: Create mi

[PULL 04/38] migration: fix RAMBlock add NULL check

2023-10-17 Thread Juan Quintela
Xu Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231010104851.802947-1-fro...@swemel.ru> --- migration/ram.c | 5 + 1 file changed, 5 insertions(+) diff --git a/migration/ram.c b/migration/ram.c index 24d91de8b3..e8df4dc862 100644 --- a/migration/ram.c

Re: [PULL 00/38] Migration 20231016 patches

2023-10-17 Thread Juan Quintela
Stefan Hajnoczi wrote: > On Mon, 16 Oct 2023 at 06:11, Juan Quintela wrote: >> >> The following changes since commit 63011373ad22c794a013da69663c03f1297a5c56: >> >> Merge tag 'pull-riscv-to-apply-20231012-1' of >> https://github.com/alistair23/qemu into s

Re: [PULL 11/38] tests/qtest: migration-test: Add tests for file-based migration

2023-10-17 Thread Juan Quintela
Fabiano Rosas wrote: D> Juan Quintela writes: > >> From: Fabiano Rosas >> >> Add basic tests for file-based migration. >> >> Note that we cannot use test_precopy_common because that routine >> expects it to be possible to run the migration live. W

Re: [PATCH v4 03/10] migration: migrate 'inc' command option is deprecated.

2023-10-16 Thread Juan Quintela
Markus Armbruster wrote: > Juan Quintela writes: > >> Markus Armbruster wrote: >>> Juan Quintela writes: >> So what I want, I want to remove -i/-b in the next version (9.0?). For >> the other, I want to remove it, but I don't care if the code is around >

[PULL 37/38] migration/multifd: Unify multifd_send_thread error paths

2023-10-16 Thread Juan Quintela
Quintela Signed-off-by: Juan Quintela Message-ID: <20231012134343.23757-3-faro...@suse.de> --- migration/multifd.c | 12 +++- 1 file changed, 3 insertions(+), 9 deletions(-) diff --git a/migration/multifd.c b/migration/multifd.c index 8e9a5ee394..c92955de41 100644 --- a/migration/mul

[PULL 32/38] migration/ram: Remove RAMState from xbzrle_cache_zero_page

2023-10-16 Thread Juan Quintela
From: Fabiano Rosas 'rs' is not used in that function. It's a leftover from commit 9360447d34 ("ram: Use MigrationStats for statistics"). Reviewed-by: Peter Xu Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231011184604

[PULL 06/38] migration: Fix analyze-migration.py 'configuration' parsing

2023-10-16 Thread Juan Quintela
"./scripts/analyze-migration.py", line 571, in read raise Exception("Unknown section type: %d" % section_type) Exception: Unknown section type: 5 Signed-off-by: Fabiano Rosas Reviewed-by: Juan Quintela Signed-off-by: Juan Quintela Message-ID: <20231009184326.15777-3-faro

[PULL 14/38] migration: Create migrate_rdma()

2023-10-16 Thread Juan Quintela
Helper to say if we are doing a migration over rdma. Reviewed-by: Peter Xu Reviewed-by: Li Zhijian Signed-off-by: Juan Quintela Message-ID: <20231011203527.9061-2-quint...@redhat.com> --- migration/migration.h | 2 ++ migration/options.h | 1 + migration/migration.c | 1 + mig

[PULL 27/38] migration: Improve json and formatting

2023-10-16 Thread Juan Quintela
Reviewed-by: Markus Armbruster Signed-off-by: Juan Quintela Message-ID: <20231013104736.31722-2-quint...@redhat.com> --- qapi/migration.json | 7 +++ 1 file changed, 3 insertions(+), 4 deletions(-) diff --git a/qapi/migration.json b/qapi/migration.json index 360e609f66..db3df12d6c

<    1   2   3   4   5   6   7   8   9   10   >