[PATCH v2 3/4] iotests/mirror-top-perms: switch to AQMP

2022-03-21 Thread John Snow
We don't have to maintain compatibility with both QMP libraries anymore, so we can just remove the old exception. While we're here, take advantage of the extra fields present in the VMLaunchFailure exception that machine.py now raises. (Note: I'm leaving the logging suppression here unchanged. I

[PATCH v2 0/4] iotests: finalize switch to async QMP

2022-03-21 Thread John Snow
GitLab: https://gitlab.com/jsnow/qemu/-/commits/python-qmp-legacy-switch-pt1b CI: https://gitlab.com/jsnow/qemu/-/pipelines/495951187 This series isolates the iotests-centric changes required to switch to the new QMP library. It doesn't do a whole lot! This is a re-send just being sent for the

[PATCH 07/10] python: remove the old QMP package

2022-03-21 Thread John Snow
Thank you for your service! Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Beraldo Leal --- python/PACKAGE.rst | 4 +- python/README.rst | 2 +- python/qemu/qmp/README.rst | 9 - python/qemu/qmp/__init__.py | 396

Re: [PATCH v3 3/5] softmmu/cpus: Free cpu->halt_cond in generic_destroy_vcpu_thread()

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 15:14, Mark Kanda wrote: vCPU hotunplug related leak reported by Valgrind: ==102631== 56 bytes in 1 blocks are definitely lost in loss record 5,089 of 8,555 ==102631==at 0x4C3ADBB: calloc (vg_replace_malloc.c:1117) ==102631==by 0x69EE4CD: g_malloc0 (in

Re: [PATCH v3 5/5] i386/cpu: Free env->xsave_buf in KVM and HVF destory_vcpu_thread routines

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 23:04, Philippe Mathieu-Daudé wrote: On 21/3/22 15:14, Mark Kanda wrote: Create KVM and HVF specific destory_vcpu_thread() routines to free Typo "destroy" env->xsave_buf. vCPU hotunplug related leak reported by Valgrind: ==132362== 4,096 bytes in 1 blocks are definitely lost in

[PATCH v4 03/11] target/s390x: vxeh2: vector string search

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson --- target/s390x/helper.h| 6 ++ target/s390x/tcg/insn-data.def | 2 + target/s390x/tcg/translate.c | 3 +- target/s390x/tcg/translate_vx.c.inc | 25 +++ target/s390x/tcg/vec_string_helper.c | 99

[PATCH v4 08/11] target/s390x: vxeh2: vector {load, store} byte reversed element

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson Reviewed-by: David Hildenbrand --- target/s390x/tcg/insn-data.def | 12 target/s390x/tcg/translate_vx.c.inc | 85 + 2 files changed, 97 insertions(+) diff --git a/target/s390x/tcg/insn-data.def

[PATCH v4 09/11] target/s390x: add S390_FEAT_VECTOR_ENH2 to qemu CPU model

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson --- target/s390x/gen-features.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/target/s390x/gen-features.c b/target/s390x/gen-features.c index 22846121c4..499a3b10a8 100644 --- a/target/s390x/gen-features.c +++

Re: [PATCH v2] MAINTAINERS: change Vladimir's email address

2022-03-21 Thread Vladimir Sementsov-Ogievskiy
21.03.2022 23:12, Eric Blake wrote: On Thu, Mar 17, 2022 at 11:24:28AM +0300, Vladimir Sementsov-Ogievskiy wrote: 17.03.2022 00:36, Eric Blake wrote: On Wed, Mar 16, 2022 at 12:27:02PM +0300, Vladimir Sementsov-Ogievskiy wrote: Old vsement...@virtuozzo.com is not accessible anymore.

[PATCH v5 07/18] iotests: use qemu_img_json() when applicable

2022-03-21 Thread John Snow
qemu_img_json() gives better diagnostic information on failure. Signed-off-by: John Snow Reviewed-by: Hanna Reitz --- tests/qemu-iotests/iotests.py | 8 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/tests/qemu-iotests/iotests.py b/tests/qemu-iotests/iotests.py index

[PATCH v5 17/18] iotests: remove qemu_img_pipe_and_status()

2022-03-21 Thread John Snow
With the exceptional 'create' calls removed in the prior commit, change qemu_img_log() and img_info_log() to call qemu_img() directly instead. For now, allow these calls to qemu-img to return non-zero on the basis that any unusual output will be logged anyway. The very next commit begins to

[PATCH v5 15/18] iotests: use qemu_img() in has_working_luks()

2022-03-21 Thread John Snow
Admittedly a mostly lateral move, but qemu_img() is essentially the replacement for qemu_img_pipe_and_status(). It will give slightly better diagnostics on crash. Signed-off-by: John Snow Reviewed-by: Hanna Reitz --- tests/qemu-iotests/iotests.py | 18 +- 1 file changed, 9

[PATCH v2 2/4] scripts/bench-block-job: switch to AQMP

2022-03-21 Thread John Snow
For this commit, we only need to remove accommodations for the synchronous QMP library. Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Beraldo Leal Acked-by: Hanna Reitz --- scripts/simplebench/bench_block_job.py | 3 +-- 1 file changed, 1 insertion(+), 2

Re: [EXT] Re: QEMU+KVM on RISC-V + Hypervisor Extension

2022-03-21 Thread Palmer Dabbelt
On Sun, 20 Mar 2022 22:43:07 PDT (-0700), alistai...@gmail.com wrote: On Thu, Mar 17, 2022 at 7:46 PM Peter Maydell wrote: On Wed, 16 Mar 2022 at 22:23, Alistair Francis wrote: > Hmm... This seems like a bug. We shouldn't allow the user to specify a > `-bios` option if using KVM. Would you

[PATCH 02/10] python/aqmp: relicense as GPLv2+

2022-03-21 Thread John Snow
I am the sole author of all of the async QMP code (python/qemu/aqmp) with the following exceptions: python/qemu/aqmp/qmp_shell.py and python/qemu/aqmp/legacy.py were written by Luiz Capitulino (et al) and are already licensed separately as GPLv2 (only). aqmp_tui.py was written by Niteesh Babu G

Re: [PATCH v3 2/2] ui/cocoa: Create menus in iothread

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 05:10, Akihiko Odaki wrote: Commit 0439c5a4623d674efa0c72abd62ca6e98bb7cf87 introduced an assertion that blk_all_next is called in the main thread. The function is called in the following chain: - blk_all_next - qmp_query_block - addRemovableDevicesMenuItems - main This change moves

Re: [PATCH v1 08/13] libvhost-user: expose vu_request_to_string

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 16:30, Alex Bennée wrote: This is useful for more human readable debug messages in vhost-user programs. Signed-off-by: Alex Bennée --- subprojects/libvhost-user/libvhost-user.h | 9 + subprojects/libvhost-user/libvhost-user.c | 2 +- 2 files changed, 10 insertions(+), 1

Re: [PATCH v1 11/13] contrib/vhost-user-blk: fix 32 bit build and enable

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 16:30, Alex Bennée wrote: We were not building the vhost-user-blk server due to 32 bit compilation problems. The problem was due to format string types so fix that and then enable the build. Tweak the rule to follow the same rules as other vhost-user daemons. Signed-off-by: Alex

[PATCH v4 07/11] target/s390x: vxeh2: vector {load, store} byte reversed elements

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson --- target/s390x/tcg/insn-data.def | 4 + target/s390x/tcg/translate_vx.c.inc | 115 2 files changed, 119 insertions(+) diff --git a/target/s390x/tcg/insn-data.def b/target/s390x/tcg/insn-data.def

[PATCH v4 10/11] tests/tcg/s390x: Tests for Vector Enhancements Facility 2

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson --- tests/tcg/s390x/Makefile.target | 8 ++ tests/tcg/s390x/vxeh2_vcvt.c| 97 + tests/tcg/s390x/vxeh2_vlstr.c | 146 tests/tcg/s390x/vxeh2_vs.c | 91

[PATCH v5 11/18] iotests: change supports_quorum to use qemu_img

2022-03-21 Thread John Snow
Similar to other recent changes: use the qemu_img() invocation that supports throwing loud, nasty exceptions when it fails for surprising reasons. (Why would "--help" ever fail? I don't know, but eliminating *all* calls to qemu-img that do not go through qemu_img() is my goal, so qemu_img_pipe()

[PATCH v5 13/18] iotests/149: Remove qemu_img_pipe() call

2022-03-21 Thread John Snow
qemu_img_pipe calls blank their output when the command being run is a 'create' call and the command succeeds. Thus, the normative output for this command in iotest 149 is to print a blank line. We can remove the logging from this invocation and use a checked invocation, but we still need to

[PATCH v5 18/18] iotests: make qemu_img_log and img_info_log raise on error

2022-03-21 Thread John Snow
Add a `check: bool = True` parameter to both functions and make their qemu_img() invocations raise on error by default. users of img_info_log: 206, 207, 210, 211, 212, 213, 237, 242, 266, 274, 302 users of qemu_img_log: 044, 209, 274, 302, 304 iotests 242 and 266 need to use check=False for

[PATCH v2 4/4] iotests: switch to AQMP

2022-03-21 Thread John Snow
iotests is already using async QMP, but to finalize the switchover we only need to update any remaining import paths to rely solely on the new library instead. Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Beraldo Leal Acked-by: Hanna Reitz ---

[PATCH 08/10] python: re-enable pylint duplicate-code warnings

2022-03-21 Thread John Snow
With the old library gone, there's nothing duplicated in the tree, so the warning suppression can be removed. Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Beraldo Leal --- python/setup.cfg | 1 - 1 file changed, 1 deletion(-) diff --git a/python/setup.cfg

[PATCH 06/10] python/aqmp: copy qmp docstrings to qemu.aqmp.legacy

2022-03-21 Thread John Snow
Copy the docstrings out of qemu.qmp, adjusting them as necessary to more accurately reflect the current state of this class. (Licensing: This is copying and modifying GPLv2-only licensed docstrings into a GPLv2-only file.) Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy

[PATCH 10/10] python: rename 'aqmp-tui' to 'qmp-tui'

2022-03-21 Thread John Snow
This is the last vestige of the "aqmp" moniker surviving in the tree; remove it. Signed-off-by: John Snow Reviewed-by: Beraldo Leal --- python/qemu/qmp/{aqmp_tui.py => qmp_tui.py} | 12 ++-- python/setup.cfg| 6 +++--- 2 files changed, 9 insertions(+), 9

[PATCH 05/10] python/aqmp: fully separate from qmp.QEMUMonitorProtocol

2022-03-21 Thread John Snow
After this patch, qemu.aqmp.legacy.QEMUMonitorProtocol no longer inherits from qemu.qmp.QEMUMonitorProtocol. To do this, several inherited methods need to be explicitly re-defined. (Licensing: This is copying and modifying GPLv2-only code into a GPLv2-only file.) Signed-off-by: John Snow

Re: [PATCH v2 0/4] iotests: finalize switch to async QMP

2022-03-21 Thread John Snow
On Mon, Mar 21, 2022 at 4:33 PM John Snow wrote: > > GitLab: https://gitlab.com/jsnow/qemu/-/commits/python-qmp-legacy-switch-pt1b > CI: https://gitlab.com/jsnow/qemu/-/pipelines/495951187 > > This series isolates the iotests-centric changes required to switch to > the new QMP library. It doesn't

[PULL 1/3] MAINTAINERS: change Vladimir's email address

2022-03-21 Thread Eric Blake
From: Vladimir Sementsov-Ogievskiy Old vsement...@virtuozzo.com is not accessible anymore. Signed-off-by: Vladimir Sementsov-Ogievskiy Message-Id: <20220316092702.426629-1-v.sementsov...@mail.ru> Signed-off-by: Eric Blake --- MAINTAINERS | 12 ++-- 1 file changed, 6 insertions(+), 6

[PULL 3/3] block/nbd.c: Fixed IO request coroutine not being wakeup when kill NBD server

2022-03-21 Thread Eric Blake
From: Rao Lei During the IO stress test, the IO request coroutine has a probability that is can't be awakened when the NBD server is killed. The GDB stack is as follows: (gdb) bt 0 0x7f2ff990cbf6 in __ppoll (fds=0x55575de85000, nfds=1, timeout=, sigmask=0x0) at

Re: [PATCH v1 7/8] semihosting: clean up handling of expanded argv

2022-03-21 Thread Philippe Mathieu-Daudé
On 15/3/22 15:15, Daniel P. Berrangé wrote: On Tue, Mar 15, 2022 at 01:59:59PM +, Alex Bennée wrote: Philippe Mathieu-Daudé writes: On 15/3/22 13:12, Alex Bennée wrote: Another cleanup patch tripped over the fact we weren't being careful in our casting. Fix the casts, allow for a

Re: [RFC PATCH v3 17/36] pflash_cfi01/tdx: Introduce ram_mode of pflash for TDVF

2022-03-21 Thread Isaku Yamahata
On Mon, Mar 21, 2022 at 04:54:51PM +0800, Xiaoyao Li wrote: > On 3/18/2022 10:07 PM, Philippe Mathieu-Daudé wrote: > > Hi, > > > > On 17/3/22 14:58, Xiaoyao Li wrote: > > > TDX VM needs to boot with Trust Domain Virtual Firmware (TDVF). Unlike > > > that OVMF is mapped as rom device, TDVF needs

Re: [PATCH v1 03/13] hw/virtio: add vhost_user_[read|write] trace points

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 16:30, Alex Bennée wrote: These are useful when trying to debug the initial vhost-user negotiation, especially when it hard to get logging from the low level library on the other side. Signed-off-by: Alex Bennée --- v2 - fixed arguments --- hw/virtio/vhost-user.c | 4

[PATCH v4 04/11] target/s390x: vxeh2: Update for changes to vector shifts

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson --- target/s390x/helper.h | 3 ++ target/s390x/tcg/insn-data.def | 12 ++--- target/s390x/tcg/translate_vx.c.inc | 75 - target/s390x/tcg/vec_int_helper.c | 55 + 4

[PATCH v4 06/11] target/s390x: vxeh2: vector {load, store} elements reversed

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson Reviewed-by: David Hildenbrand --- target/s390x/tcg/insn-data.def | 4 ++ target/s390x/tcg/translate_vx.c.inc | 84 + 2 files changed, 88 insertions(+) diff --git a/target/s390x/tcg/insn-data.def

Re: [PATCH v2] MAINTAINERS: change Vladimir's email address

2022-03-21 Thread Eric Blake
On Mon, Mar 21, 2022 at 11:31:18PM +0300, Vladimir Sementsov-Ogievskiy wrote: > 21.03.2022 23:12, Eric Blake wrote: > > On Thu, Mar 17, 2022 at 11:24:28AM +0300, Vladimir Sementsov-Ogievskiy > > wrote: > > > 17.03.2022 00:36, Eric Blake wrote: > > > > On Wed, Mar 16, 2022 at 12:27:02PM +0300,

[PATCH 00/10] Python: Remove synchronous QMP library

2022-03-21 Thread John Snow
Based-On: <20220321203315.909411-1-js...@redhat.com> GitLab: https://gitlab.com/jsnow/qemu/-/tree/python-qmp-legacy-switch-pt1c CI: https://gitlab.com/jsnow/qemu/-/pipelines/497561638 This series finalizes swapping out the old QMP library for the new one. It's been through about two release

[PATCH 04/10] python/aqmp: take QMPBadPortError and parse_address from qemu.qmp

2022-03-21 Thread John Snow
Shift these definitions over from the qmp package to the async qmp package. (Licensing: this is a lateral move, from GPLv2 (only) to GPLv2 (only)) Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Beraldo Leal --- python/qemu/aqmp/aqmp_tui.py | 3 +--

[PATCH 03/10] python: temporarily silence pylint duplicate-code warnings

2022-03-21 Thread John Snow
The next several commits copy some code from qemu.qmp to qemu.aqmp, then delete qemu.qmp. In the interim, to prevent test failures, the duplicate code detection needs to be silenced to prevent bisect problems with CI testing. Signed-off-by: John Snow Reviewed-by: Vladimir Sementsov-Ogievskiy

[PATCH 01/10] python/aqmp: add explicit GPLv2 license to legacy.py

2022-03-21 Thread John Snow
The legacy.py module is heavily based on the QMP module by Luiz Capitulino (et al) which is licensed as explicit GPLv2-only. The async QMP package is currently licensed similarly, but I intend to relicense the async package to the more flexible GPLv2+. In preparation for that change, make the

[PATCH 09/10] python: rename qemu.aqmp to qemu.qmp

2022-03-21 Thread John Snow
Now that we are fully switched over to the new QMP library, move it back over the old namespace. This is being done primarily so that we may upload this package simply as "qemu.qmp" without introducing confusion over whether or not "aqmp" is a new protocol or not. The trade-off is increased

Re: Memory leak in via_isa_realize()

2022-03-21 Thread BALATON Zoltan
On Mon, 21 Mar 2022, Cédric Le Goater wrote: On 3/21/22 13:11, BALATON Zoltan wrote: On Mon, 21 Mar 2022, Peter Maydell wrote: On Mon, 21 Mar 2022 at 10:31, Thomas Huth wrote: FYI, I'm seeing a memory leak in via_isa_realize() when building QEMU with sanitizers enabled or when running QEMU

Re: [PATCH v5 18/18] iotests: make qemu_img_log and img_info_log raise on error

2022-03-21 Thread Eric Blake
On Mon, Mar 21, 2022 at 04:16:18PM -0400, John Snow wrote: > Add a `check: bool = True` parameter to both functions and make their > qemu_img() invocations raise on error by default. > > users of img_info_log: > 206, 207, 210, 211, 212, 213, 237, 242, 266, 274, 302 > > users of qemu_img_log: >

[PULL 2/3] docs: Consistent typography for options of qemu-nbd

2022-03-21 Thread Eric Blake
Prefer the :option:`--name` form when cross-referencing other options from the qemu-nbd documentation. Signed-off-by: Eric Blake Message-Id: <20220314203818.3681277-2-ebl...@redhat.com> Reviewed-by: Daniel P. Berrangé --- docs/tools/qemu-nbd.rst | 12 ++-- 1 file changed, 6

[PULL 0/3] NBD patches for -rc1

2022-03-21 Thread Eric Blake
The following changes since commit 2028ab513bf0232841a909e1368309858919dbcc: Merge tag 'block-pull-request' of https://gitlab.com/stefanha/qemu into staging (2022-03-21 15:27:13 +) are available in the Git repository at: https://repo.or.cz/qemu/ericb.git tags/pull-nbd-2022-03-21 for

Re: [PATCH] memory: Make memory_region_readd_subregion() properly handle mapped aliases

2022-03-21 Thread Niek Linnenbank
Hi Paolo, Peter, With the 7.0 release approaching, just a friendly reminder that the patch in this thread is not yet in master (2058fdbe81e2985c226a026851dd26b146d3395c). It's currently preventing the orangepi-pc board to boot SD card images from U-Boot, terminating with an assert:

Re: [PATCH v3 1/2] ui/cocoa: Move create_initial_menus

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 05:10, Akihiko Odaki wrote: The following change would make it use add_console_menu_entries and addRemovableDevicesMenuItems so it should come after them. Signed-off-by: Akihiko Odaki --- ui/cocoa.m | 178 ++--- 1 file changed, 89

Re: [PATCH v3 5/5] i386/cpu: Free env->xsave_buf in KVM and HVF destory_vcpu_thread routines

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 15:14, Mark Kanda wrote: Create KVM and HVF specific destory_vcpu_thread() routines to free Typo "destroy" env->xsave_buf. vCPU hotunplug related leak reported by Valgrind: ==132362== 4,096 bytes in 1 blocks are definitely lost in loss record 8,440 of 8,549 ==132362==at

Re: [PATCH v1 04/13] docs: vhost-user: clean up request/reply description

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 16:30, Alex Bennée wrote: From: Paolo Bonzini It is not necessary to mention which side is sending/receiving each payload; it is more interesting to say which is the request and which is the reply. This also matches what vhost-user-gpu.rst already does. While at it, ensure that

[PATCH v4 02/11] target/s390x: vxeh2: vector convert short/32b

2022-03-21 Thread David Miller
Signed-off-by: David Miller Signed-off-by: Richard Henderson Reviewed-by: David Hildenbrand --- target/s390x/helper.h | 4 +++ target/s390x/tcg/translate_vx.c.inc | 44 ++--- target/s390x/tcg/vec_fpu_helper.c | 31 3 files changed,

[PATCH v4 11/11] target/s390x: Fix writeback to v1 in helper_vstl

2022-03-21 Thread David Miller
From: Richard Henderson Signed-off-by: Richard Henderson Reviewed-by: David Miller Reviewed-by: David Hildenbrand --- target/s390x/tcg/vec_helper.c | 2 -- 1 file changed, 2 deletions(-) diff --git a/target/s390x/tcg/vec_helper.c b/target/s390x/tcg/vec_helper.c index ededf13cf0..48d86722b2

[PATCH 1/3] qapi-schema: support alternates with array type

2022-03-21 Thread Paolo Bonzini
Detect array types as alternate branches, and turn the JSON list into a QAPISchemaArrayType. Array types in an alternate are represented with QTYPE_QLIST in the type field. Signed-off-by: Paolo Bonzini --- scripts/qapi/expr.py | 2 +- scripts/qapi/schema.py |

[PATCH 0/3] qapi-schema: support alternates with array type

2022-03-21 Thread Paolo Bonzini
As suggested in the review of the statistics subsystem. Paolo Bonzini (3): qapi-schema: support alternates with array type qapi-schema: test: add a qapi-schema-test for array alternates qapi-schema: test: add a unit test for parsing array alternates scripts/qapi/expr.py

[PATCH] Define MAP_SYNC and MAP_SHARED_VALIDATE on needed linux systems

2022-03-21 Thread Khem Raj
linux only wires MAP_SYNC and MAP_SHARED_VALIDATE for architectures which include asm-generic/mman.h and mips/powerpc are not including this file in linux/mman.h, therefore these should be defined for such architectures on Linux as well. This fixes build on mips/musl/linux Signed-off-by: Khem Raj

Re: [PATCH 13/15] iotests: remove qemu_io_pipe_and_status()

2022-03-21 Thread Eric Blake
On Fri, Mar 18, 2022 at 04:36:53PM -0400, John Snow wrote: > I know we just added it, sorry. This is done in favor of qemu_io() which > *also* returns the console output and status, but with more robust error > handling on failure. > > Signed-off-by: John Snow > --- >

Re: [PATCH 15/15] iotests: make qemu_io_log() check return codes by default

2022-03-21 Thread Eric Blake
On Fri, Mar 18, 2022 at 04:36:55PM -0400, John Snow wrote: > Just like qemu_img_log(), upgrade qemu_io_log() to enforce a return code > of zero by default. > > Affected tests: 242 245 255 274 303 307 nbd-reconnect-on-open > > Signed-off-by: John Snow > --- > tests/qemu-iotests/iotests.py

Re: Memory leak in via_isa_realize()

2022-03-21 Thread Cédric Le Goater
On 3/21/22 14:04, Philippe Mathieu-Daudé wrote: Cc'ing Bernhard who did a similar cleanup recently. On 21/3/22 11:31, Thomas Huth wrote:   Hi! FYI, I'm seeing a memory leak in via_isa_realize() when building QEMU with sanitizers enabled or when running QEMU through valgrind: $ valgrind

Re: [PATCH v2] gitlab: disable accelerated zlib for s390x

2022-03-21 Thread Cornelia Huck
On Mon, Mar 21 2022, Alex Bennée wrote: > There appears to be a bug in the s390 hardware-accelerated version of > zlib distributed with Ubuntu 20.04, which makes our test > /i386/migration/multifd/tcp/zlib hit an assertion perhaps one time in > 10. Fortunately zlib provides an escape hatch where

Re: [PATCH for 7.0 v1 0/8] misc testing, i386, docs, gitdm, gitlab

2022-03-21 Thread Alex Bennée
Alex Bennée writes: > Hi, > > As per usual here are the collection of random fixes and tweaks as we > go through the release process. Most of these patches have been posted > individually before although the semihosting and gitlab patches are > new. > > The following need review: > > -

[PULL 1/8] softmmu/physmem: Simplify flatview_write and address_space_access_valid

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Remove unuseful local 'result' variables. Reviewed-by: Peter Xu Reviewed-by: David Hildenbrand Reviewed-by: Alexander Bulekov Reviewed-by: Stefan Hajnoczi Signed-off-by: Philippe Mathieu-Daudé Message-Id: <20211215182421.418374-3-phi...@redhat.com>

[PULL 6/8] hw/sd/sdhci: Honor failed DMA transactions

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé DMA transactions might fail. The DMA API returns a MemTxResult, indicating such failures. Do not ignore it. On failure, raise the ADMA error flag and eventually triggering an IRQ (see spec chapter 1.13.5: "ADMA2 States"). Signed-off-by: Philippe Mathieu-Daudé

[PULL 8/8] tests/qtest/fuzz-sdcard-test: Add reproducer for OSS-Fuzz (Issue 29225)

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Include the qtest reproducer provided by Alexander Bulekov in https://gitlab.com/qemu-project/qemu/-/issues/451. Without the previous commit, we get: $ make check-qtest-i386 ... Running test qtest-i386/fuzz-sdcard-test ==447470==ERROR: AddressSanitizer:

[PULL 4/8] hw/audio/intel-hda: Restrict DMA engine to memories (not MMIO devices)

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Issue #542 reports a reentrancy problem when the DMA engine accesses the HDA controller I/O registers. Fix by restricting the DMA engine to memories regions (forbidding MMIO devices such the HDA controller). Reported-by: OSS-Fuzz (Issue 28435) Reported-by: Alexander

Re: [PATCH 14/15] iotests: remove qemu_io_silent() and qemu_io_silent_check().

2022-03-21 Thread Eric Blake
On Fri, Mar 18, 2022 at 04:36:54PM -0400, John Snow wrote: > Like qemu-img, qemu-io returning 0 should be the norm and not the > exception. Remove all calls to qemu_io_silent that just assert the > return code is zero (That's every last call, as it turns out), and > replace them with a normal

RE: [PATCH v8 07/12] target/hexagon: prepare input for the idef-parser

2022-03-21 Thread Taylor Simpson
> -Original Message- > From: Anton Johansson > Sent: Wednesday, February 9, 2022 11:03 AM > To: qemu-devel@nongnu.org > Cc: a...@rev.ng; Taylor Simpson ; Brian Cain > ; Michael Lambert ; > bab...@rev.ng; ni...@rev.ng; richard.hender...@linaro.org > Subject: [PATCH v8 07/12]

Re: [PATCH 14/15] iotests: remove qemu_io_silent() and qemu_io_silent_check().

2022-03-21 Thread John Snow
On Mon, Mar 21, 2022 at 2:16 PM Eric Blake wrote: > > On Fri, Mar 18, 2022 at 04:36:54PM -0400, John Snow wrote: > > Like qemu-img, qemu-io returning 0 should be the norm and not the > > exception. Remove all calls to qemu_io_silent that just assert the > > return code is zero (That's every last

Re: [PATCH v2] MAINTAINERS: change Vladimir's email address

2022-03-21 Thread Eric Blake
On Thu, Mar 17, 2022 at 11:24:28AM +0300, Vladimir Sementsov-Ogievskiy wrote: > 17.03.2022 00:36, Eric Blake wrote: > > On Wed, Mar 16, 2022 at 12:27:02PM +0300, Vladimir Sementsov-Ogievskiy > > wrote: > > > Old vsement...@virtuozzo.com is not accessible anymore. > > > > > > Signed-off-by:

[PATCH v5 01/18] python/utils: add add_visual_margin() text decoration utility

2022-03-21 Thread John Snow
>>> print(add_visual_margin(msg, width=72, name="Commit Message")) ┏━ Commit Message ━━ ┃ add_visual_margin() takes a chunk of text and wraps it in a visual ┃ container that force-wraps to a specified width. An optional title ┃ label may be

[PATCH v5 12/18] iotests: replace unchecked calls to qemu_img_pipe()

2022-03-21 Thread John Snow
qemu_img_pipe() discards the return code from qemu-img in favor of returning just its output. Some tests using this function don't save, log, or check the output either, though, which is unsafe. Replace all of these calls with a checked version. Tests affected are 194, 202, 203, 234, 262, and

[PATCH v5 09/18] iotests/remove-bitmap-from-backing: use qemu_img_info()

2022-03-21 Thread John Snow
This removes two more usages of qemu_img_pipe() and replaces them with calls to qemu_img(), which provides better diagnostic information on failure. Signed-off-by: John Snow Reviewed-by: Hanna Reitz --- tests/qemu-iotests/tests/remove-bitmap-from-backing | 6 +++--- 1 file changed, 3

Re: [PATCH v4] tests: Do not treat the iotests as separate meson test target anymore

2022-03-21 Thread Thomas Huth
On 21/03/2022 14.11, Hanna Reitz wrote: On 21.03.22 10:17, Thomas Huth wrote: On 21/03/2022 10.06, Hanna Reitz wrote: On 18.03.22 18:36, Thomas Huth wrote: On 18/03/2022 18.04, Hanna Reitz wrote: On 10.03.22 08:50, Thomas Huth wrote: If there is a failing iotest, the output is currently not

Re: [PATCH] tests/qemu-iotests/testrunner: Supply a test plan in TAP mode

2022-03-21 Thread Hanna Reitz
On 23.02.22 10:58, Thomas Huth wrote: Quoting the TAP specification: "The plan tells how many tests will be run [...]. It’s a check that the test file hasn’t stopped prematurely." That's a good idea of course, so let's support that in the iotest testrunner, too. Signed-off-by: Thomas Huth ---

[PULL 2/2] hw/i386/amd_iommu: Fix maybe-uninitialized error with GCC 12

2022-03-21 Thread Paolo Bonzini
Be more explicit that the loop must roll at least once. Avoids the following warning: FAILED: libqemu-x86_64-softmmu.fa.p/hw_i386_amd_iommu.c.o In function 'pte_get_page_mask', inlined from 'amdvi_page_walk' at hw/i386/amd_iommu.c:945:25, inlined from 'amdvi_do_translate' at

[PULL 0/8] Fix CVE-2021-3611 and heap overflow in sdhci code

2022-03-21 Thread Thomas Huth
The following changes since commit 2058fdbe81e2985c226a026851dd26b146d3395c: Merge tag 'fixes-20220318-pull-request' of git://git.kraxel.org/qemu into staging (2022-03-19 11:28:54 +) are available in the Git repository at: https://gitlab.com/thuth/qemu.git tags/pull-request-2022-03-21

[PULL 3/8] hw/audio/intel-hda: Do not ignore DMA overrun errors

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Per the "High Definition Audio Specification" manual (rev. 1.0a), section "3.3.30 Offset 5Dh: RIRBSTS - RIRB Status": Response Overrun Interrupt Status (RIRBOIS): Hardware sets this bit to a 1 when an overrun occurs in the RIRB. An interrupt may be generated

[PULL 5/8] tests/qtest/intel-hda-test: Add reproducer for issue #542

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Include the qtest reproducer provided by Alexander Bulekov in https://gitlab.com/qemu-project/qemu/-/issues/542. Without the previous commit, we get: $ make check-qtest-i386 ... Running test tests/qtest/intel-hda-test AddressSanitizer:DEADLYSIGNAL

Re: [PATCH v3 0/4] Improve integration of iotests in the meson test harness

2022-03-21 Thread Thomas Huth
On 21/03/2022 17.14, Hanna Reitz wrote: On 23.02.22 10:38, Thomas Huth wrote: Though "make check-block" is currently already run via the meson test runner, it still looks like an oddball in the output of "make check". It would be nicer if the iotests would show up like the other tests suites.

Re: [PULL for-7.0 0/2] Block patches

2022-03-21 Thread Peter Maydell
On Mon, 21 Mar 2022 at 14:44, Stefan Hajnoczi wrote: > > On Thu, Mar 17, 2022 at 06:36:36PM +, Peter Maydell wrote: > > On Thu, 17 Mar 2022 at 16:57, Stefan Hajnoczi wrote: > > > > > > The following changes since commit > > > 1d60bb4b14601e38ed17384277aa4c30c57925d3: > > > > > > Merge tag

RE: [PATCH v8 09/12] target/hexagon: import lexer for idef-parser

2022-03-21 Thread Taylor Simpson
> -Original Message- > From: Anton Johansson > Sent: Wednesday, February 9, 2022 11:03 AM > To: qemu-devel@nongnu.org > Cc: a...@rev.ng; Taylor Simpson ; Brian Cain > ; Michael Lambert ; > bab...@rev.ng; ni...@rev.ng; richard.hender...@linaro.org > Subject: [PATCH v8 09/12]

Re: [PATCH 15/15] iotests: make qemu_io_log() check return codes by default

2022-03-21 Thread John Snow
On Mon, Mar 21, 2022 at 2:22 PM Eric Blake wrote: > > On Fri, Mar 18, 2022 at 04:36:55PM -0400, John Snow wrote: > > Just like qemu_img_log(), upgrade qemu_io_log() to enforce a return code > > of zero by default. > > > > Affected tests: 242 245 255 274 303 307 nbd-reconnect-on-open > > > >

[PATCH v5 00/18] iotests: add enhanced debugging info to qemu-img failures

2022-03-21 Thread John Snow
V5 hotfix: - Quote the subprocess.CompletedProcess[str] type annotations, Python 3.6 chokes on them at runtime :( - Reduce line length in the text decoration fn, even though check-patch still doesn't like it. - Reflow docstring for qemu_img.* V5 CI:

[PATCH v5 02/18] python/utils: add VerboseProcessError

2022-03-21 Thread John Snow
This adds an Exception that extends the Python stdlib subprocess.CalledProcessError. The difference is that the str() method of this exception also adds the stdout/stderr logs. In effect, if this exception goes unhandled, Python will print the output in a visually distinct wrapper to the terminal

[PATCH v5 05/18] iotests: fortify compare_images() against crashes

2022-03-21 Thread John Snow
Fortify compare_images() to be more discerning about the status codes it receives. If qemu_img() returns an exit code that implies it didn't actually perform the comparison, treat that as an exceptional circumstance and force the caller to be aware of the peril. If a negative test is desired

[PATCH v5 03/18] iotests: Remove explicit checks for qemu_img() == 0

2022-03-21 Thread John Snow
qemu_img() returning zero ought to be the rule, not the exception. Remove all explicit checks against the condition in preparation for making non-zero returns an Exception. Signed-off-by: John Snow Reviewed-by: Eric Blake Reviewed-by: Hanna Reitz --- tests/qemu-iotests/163

[PATCH v5 10/18] iotests: add qemu_img_map() function

2022-03-21 Thread John Snow
Add a qemu_img_map() function by analogy with qemu_img_measure(), qemu_img_check(), and qemu_img_info() that all return JSON information. Replace calls to qemu_img_pipe('map', '--output=json', ...) with this new function, which provides better diagnostic information on failure. Note: The output

Re: comparison of coroutine backends

2022-03-21 Thread Daniel P . Berrangé
On Fri, Mar 18, 2022 at 09:48:37AM +0100, Paolo Bonzini wrote: > Hi all, > > based on the previous discussions here is a comparison of the various > possibilities for implementing coroutine backends in QEMU and the > respective advantages and disadvantages. > > I'm adding a third possibility for

Re: [PATCH 06/15] iotests: rebase qemu_io() on top of qemu_tool()

2022-03-21 Thread John Snow
On Mon, Mar 21, 2022, 11:29 AM Eric Blake wrote: > On Fri, Mar 18, 2022 at 04:36:46PM -0400, John Snow wrote: > > Rework qemu_io() to be analogous to qemu_img(); a function that requires > > a return code of zero by default unless disabled explicitly. > > > > Tests that use qemu_io(): > > 030

Re: [PATCH v1 2/8] tests/avocado: update aarch64_virt test to exercise -cpu max

2022-03-21 Thread Thomas Huth
On 15/03/2022 13.12, Alex Bennée wrote: The Fedora 29 kernel is quite old and importantly fails when running in LPA2 scenarios. As it's not really exercising much of the CPU space replace it with a custom 5.16.12 kernel with all the architecture options turned on. There is a minimal buildroot

Re: [PATCH 12/15] iotests/migration-permissions: use assertRaises() for qemu_io() negative test

2022-03-21 Thread Eric Blake
On Fri, Mar 18, 2022 at 04:36:52PM -0400, John Snow wrote: > Modify this test to use assertRaises for its negative testing of > qemu_io. If the exception raised does not match the one we tell it to > expect, we get *that* exception unhandled. If we get no exception, we > get a unittest assertion

Re: Memory leak in via_isa_realize()

2022-03-21 Thread Philippe Mathieu-Daudé
On 21/3/22 19:55, Cédric Le Goater wrote: On 3/21/22 14:04, Philippe Mathieu-Daudé wrote: Cc'ing Bernhard who did a similar cleanup recently. Same problem happens with qemu-system-ppc64 and the pegasos2 machine. No clue how to properly fix this... is it safe to free the pointer at the end

[PATCH 2/3] qapi-schema: test: add a qapi-schema-test for array alternates

2022-03-21 Thread Paolo Bonzini
Check that conflicts among array alternates are detected correctly. Signed-off-by: Paolo Bonzini --- tests/qapi-schema/alternate-conflict-lists.err | 2 ++ tests/qapi-schema/alternate-conflict-lists.json | 6 + tests/qapi-schema/alternate-conflict-lists.out | 0

[PULL 2/8] softmmu/physmem: Introduce MemTxAttrs::memory field and MEMTX_ACCESS_ERROR

2022-03-21 Thread Thomas Huth
From: Philippe Mathieu-Daudé Add the 'memory' bit to the memory attributes to restrict bus controller accesses to memories. Introduce flatview_access_allowed() to check bus permission before running any bus transaction. Have read/write accessors return MEMTX_ACCESS_ERROR if an access is

Re: [PATCH v1 1/1] test/avocado/machine_aspeed.py: Add ast1030 test case

2022-03-21 Thread Thomas Huth
On 21/03/2022 10.16, Jamin Lin wrote: Add test case to test "ast1030-evb" machine with zephyr os Signed-off-by: Jamin Lin --- tests/avocado/machine_aspeed.py | 36 + 1 file changed, 36 insertions(+) create mode 100644 tests/avocado/machine_aspeed.py diff

RE: [PATCH v8 05/12] target/hexagon: introduce new helper functions

2022-03-21 Thread Taylor Simpson
> -Original Message- > From: Anton Johansson > Sent: Wednesday, February 9, 2022 11:03 AM > To: qemu-devel@nongnu.org > Cc: a...@rev.ng; Taylor Simpson ; Brian Cain > ; Michael Lambert ; > bab...@rev.ng; ni...@rev.ng; richard.hender...@linaro.org > Subject: [PATCH v8 05/12]

Re: Memory leak in via_isa_realize()

2022-03-21 Thread BALATON Zoltan
On Mon, 21 Mar 2022, Peter Maydell wrote: On Mon, 21 Mar 2022 at 10:31, Thomas Huth wrote: FYI, I'm seeing a memory leak in via_isa_realize() when building QEMU with sanitizers enabled or when running QEMU through valgrind: Same problem happens with qemu-system-ppc64 and the pegasos2 machine.

Re: Memory leak in via_isa_realize()

2022-03-21 Thread Cédric Le Goater
On 3/21/22 13:11, BALATON Zoltan wrote: On Mon, 21 Mar 2022, Peter Maydell wrote: On Mon, 21 Mar 2022 at 10:31, Thomas Huth wrote: FYI, I'm seeing a memory leak in via_isa_realize() when building QEMU with sanitizers enabled or when running QEMU through valgrind: Same problem happens with

[PATCH v5 06/18] iotests: add qemu_img_json()

2022-03-21 Thread John Snow
qemu_img_json() is a new helper built on top of qemu_img() that tries to pull a valid JSON document out of the stdout stream. In the event that the return code is negative (the program crashed), or the code is greater than zero and did not produce valid JSON output, the VerboseProcessError raised

[PATCH v5 08/18] iotests: add qemu_img_info()

2022-03-21 Thread John Snow
Add qemu_img_info() by analogy with qemu_img_measure() and qemu_img_check(). Modify image_size() to use this function instead to take advantage of the better diagnostic information on failure provided (ultimately) by qemu_img(). Signed-off-by: John Snow Reviewed-by: Hanna Reitz ---

Re: [PATCH v2] gitlab: disable accelerated zlib for s390x

2022-03-21 Thread Daniel P . Berrangé
On Mon, Mar 21, 2022 at 04:11:51PM +, Alex Bennée wrote: > There appears to be a bug in the s390 hardware-accelerated version of > zlib distributed with Ubuntu 20.04, which makes our test > /i386/migration/multifd/tcp/zlib hit an assertion perhaps one time in > 10. Fortunately zlib provides an

<    1   2   3   >