Re: [PATCH v6 36/42] nvme: add support for scatter gather lists

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:58, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > For now, support the Data Block, Segment and Last Segment descriptor > > types. > > > > See NVM Express 1.3d, Section 4.4 ("Scatter Gather List (SGL)"). > > > >

Re: [PATCH v6 38/42] nvme: support multiple namespaces

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:59, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > This adds support for multiple namespaces by introducing a new 'nvme-ns' > > device model. The nvme device creates a bus named from the device name > > ('id'). The

Re: [PATCH v6 35/42] nvme: handle dma errors

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:58, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Handling DMA errors gracefully is required for the device to pass the > > block/011 test ("disable PCI device while doing I/O") in the blktests > > suite. > > > > With

Re: [PATCH v6 14/42] nvme: add missing mandatory features

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:41, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Add support for returning a resonable response to Get/Set Features of > > mandatory features. > > > > Signed-off-by: Klaus Jensen > > Acked-by: Keith Busch > > --- >

Re: [PATCH v6 10/42] nvme: refactor device realization

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:40, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > This patch splits up nvme_realize into multiple individual functions, > > each initializing a different subset of the device. > > > > Signed-off-by: Klaus Jensen > >

Re: [PATCH v6 12/42] nvme: add support for the get log page command

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:40, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Add support for the Get Log Page command and basic implementations of > > the mandatory Error Information, SMART / Health Information and Firmware > > Slot Information

Re: [PATCH v6 09/42] nvme: add max_ioqpairs device parameter

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:39, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > The num_queues device paramater has a slightly confusing meaning because > > it accounts for the admin queue pair which is not really optional. > > Secondly, it is

Re: [PATCH v6 19/42] nvme: enforce valid queue creation sequence

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:43, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Support returning Command Sequence Error if Set Features on Number of > > Queues is called after queues have been created. > > > > Signed-off-by: Klaus Jensen > > ---

Re: [PATCH v6 11/42] nvme: add temperature threshold feature

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:40, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > It might seem wierd to implement this feature for an emulated device, > > but it is mandatory to support and the feature is useful for testing > > asynchronous event

[PATCH v10 05/14] iotests: add pylintrc file

2020-03-30 Thread John Snow
This allows others to get repeatable results with pylint. If you run `pylint iotests.py`, you should see a 100% pass. Signed-off-by: John Snow Reviewed-by: Max Reitz --- tests/qemu-iotests/pylintrc | 22 ++ 1 file changed, 22 insertions(+) create mode 100644

Re: [PATCH v6 23/42] nvme: add mapping helpers

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:45, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Add nvme_map_addr, nvme_map_addr_cmb and nvme_addr_to_cmb helpers and > > use them in nvme_map_prp. > > > > This fixes a bug where in the case of a CMB transfer, the

Re: [PATCH v6 31/42] nvme: add check for prinfo

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:57, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Check the validity of the PRINFO field. > > > > Signed-off-by: Klaus Jensen > > --- > > hw/block/nvme.c | 50 --- > >

Re: [PATCH v6 24/42] nvme: remove redundant has_sg member

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:45, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Remove the has_sg member from NvmeRequest since it's redundant. > > To be honest this patch also replaces the dma_acct_start with block_acct_start > which looks right

Re: [PATCH v6 29/42] nvme: refactor request bounds checking

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:56, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Signed-off-by: Klaus Jensen > > --- > > hw/block/nvme.c | 28 ++-- > > 1 file changed, 22 insertions(+), 6 deletions(-) > > > > diff --git

[PATCH v10 00/14] iotests: use python logging

2020-03-30 Thread John Snow
This series uses python logging to enable output conditionally on iotests.log(). We unify an initialization call (which also enables debugging output for those tests with -d) and then make the switch inside of iotests. It will help alleviate the need to create logged/unlogged versions of all the

[PATCH v10 03/14] iotests: ignore import warnings from pylint

2020-03-30 Thread John Snow
The right way to solve this is to come up with a virtual environment infrastructure that sets all the paths correctly, and/or to create installable python modules that can be imported normally. That's hard, so just silence this error for now. Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Max

[PATCH v10 01/14] iotests: do a light delinting

2020-03-30 Thread John Snow
This doesn't fix everything in here, but it does help clean up the pylint report considerably. This should be 100% style changes only; the intent is to make pylint more useful by working on establishing a baseline for iotests that we can gate against in the future. Signed-off-by: John Snow

[PATCH v10 14/14] iotests: use python logging for iotests.log()

2020-03-30 Thread John Snow
We can turn logging on/off globally instead of per-function. Remove use_log from run_job, and use python logging to turn on diffable output when we run through a script entry point. iotest 245 changes output order due to buffering reasons. An extended note on python logging: A NullHandler is

[PATCH v10 06/14] iotests: alphabetize standard imports

2020-03-30 Thread John Snow
I had to fix a merge conflict, so do this tiny harmless thing while I'm here. Signed-off-by: John Snow Reviewed-by: Max Reitz --- tests/qemu-iotests/iotests.py | 18 +- 1 file changed, 9 insertions(+), 9 deletions(-) diff --git a/tests/qemu-iotests/iotests.py

[PATCH v10 07/14] iotests: drop pre-Python 3.4 compatibility code

2020-03-30 Thread John Snow
We no longer need to accommodate <3.4, drop this code. (The lines were > 79 chars and it stood out.) Signed-off-by: John Snow Reviewed-by: Max Reitz --- tests/qemu-iotests/iotests.py | 5 + 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/tests/qemu-iotests/iotests.py

Re: [PATCH v6 04/42] nvme: bump spec data structures to v1.3

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:37, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Add missing fields in the Identify Controller and Identify Namespace > > data structures to bring them in line with NVMe v1.3. > > > > This also adds data structures

Re: [PATCH v6 01/42] nvme: rename trace events to nvme_dev

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:36, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Change the prefix of all nvme device related trace events to 'nvme_dev' > > to not clash with trace events from the nvme block driver. > > > > Signed-off-by: Klaus

[PATCH v10 08/14] iotests: touch up log function signature

2020-03-30 Thread John Snow
Representing nested, recursive data structures in mypy is notoriously difficult; the best we can reliably do right now is denote the leaf types as "Any" while describing the general shape of the data. Regardless, this fully annotates the log() function. Typing notes: TypeVar is a Type variable

[PATCH v10 10/14] iotests: add hmp helper with logging

2020-03-30 Thread John Snow
Minor cleanup for HMP functions; helps with line length and consolidates HMP helpers through one implementation function. Although we are adding a universal toggle to turn QMP logging on or off, many existing callers to hmp functions don't expect that output to be logged, which causes quite a few

[PATCH v10 12/14] iotest 258: use script_main

2020-03-30 Thread John Snow
Since this one is nicely factored to use a single entry point, use script_main to run the tests. Signed-off-by: John Snow Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Max Reitz --- tests/qemu-iotests/258 | 11 --- 1 file changed, 4 insertions(+), 7 deletions(-) diff --git

[PATCH v10 09/14] iotests: limit line length to 79 chars

2020-03-30 Thread John Snow
79 is the PEP8 recommendation. This recommendation works well for reading patch diffs in TUI email clients. Signed-off-by: John Snow Reviewed-by: Max Reitz --- tests/qemu-iotests/iotests.py | 64 +++ tests/qemu-iotests/pylintrc | 6 +++- 2 files changed, 47

Re: [PATCH v6 32/42] nvme: allow multiple aios per command

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:57, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:29 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > This refactors how the device issues asynchronous block backend > > requests. The NvmeRequest now holds a queue of NvmeAIOs that are > > associated with the command.

Re: [PATCH v6 05/42] nvme: use constant for identify data size

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:37, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Signed-off-by: Klaus Jensen > > --- > > hw/block/nvme.c | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/hw/block/nvme.c

Re: [PATCH v6 06/42] nvme: add identify cns values in header

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:37, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Signed-off-by: Klaus Jensen > > --- > > hw/block/nvme.c | 6 +++--- > > 1 file changed, 3 insertions(+), 3 deletions(-) > > > > diff --git a/hw/block/nvme.c

Re: [PATCH v6 07/42] nvme: refactor nvme_addr_read

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 25 12:38, Maxim Levitsky wrote: > On Mon, 2020-03-16 at 07:28 -0700, Klaus Jensen wrote: > > From: Klaus Jensen > > > > Pull the controller memory buffer check to its own function. The check > > will be used on its own in later patches. > > > > Signed-off-by: Klaus Jensen > > Acked-by:

[PATCH v10 04/14] iotests: replace mutable list default args

2020-03-30 Thread John Snow
It's bad hygiene: if we modify this list, it will be modified across all invocations. (Remaining bad usages are fixed in a subsequent patch which changes the function signature anyway.) Signed-off-by: John Snow Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Max Reitz ---

[PATCH v10 02/14] iotests: don't use 'format' for drive_add

2020-03-30 Thread John Snow
It shadows (with a different type) the built-in format. Use something else. Signed-off-by: John Snow Reviewed-by: Philippe Mathieu-Daudé Reviewed-by: Max Reitz --- tests/qemu-iotests/055| 3 ++- tests/qemu-iotests/iotests.py | 6 +++--- 2 files changed, 5 insertions(+), 4 deletions(-)

[PATCH v10 11/14] iotests: add script_initialize

2020-03-30 Thread John Snow
Like script_main, but doesn't require a single point of entry. Replace all existing initialization sections with this drop-in replacement. This brings debug support to all existing script-style iotests. Signed-off-by: John Snow Reviewed-by: Max Reitz --- tests/qemu-iotests/149| 3 +-

[PATCH v10 13/14] iotests: Mark verify functions as private

2020-03-30 Thread John Snow
Mark the verify functions as "private" with a leading underscore, to discourage their use. Update type signatures while we're here. (Also, make pending patches not yet using the new entry points fail in a very obvious way.) Signed-off-by: John Snow --- tests/qemu-iotests/iotests.py | 23

Re: AIO_WAIT_WHILE questions

2020-03-30 Thread Stefan Hajnoczi
On Mon, Mar 30, 2020 at 10:09:45AM +0200, Markus Armbruster wrote: > Cc'ing people based on output of "scripts/get_maintainer.pl -f > include/block/aio-wait.h". > > Dietmar Maurer writes: > > > Hi all, > > > > I have a question about AIO_WAIT_WHILE. The docs inside the code say: > > > > * The

[PATCH v11 1/4] qcow2: introduce compression type feature

2020-03-30 Thread Denis Plotnikov
The patch adds some preparation parts for incompatible compression type feature to qcow2 allowing the use different compression methods for image clusters (de)compressing. It is implied that the compression type is set on the image creation and can be changed only later by image conversion, thus

[PATCH v11 0/4] qcow2: Implement zstd cluster compression method

2020-03-30 Thread Denis Plotnikov
v11: * 03: the loops don't need "do{}while" form anymore and the they were buggy (missed "do" in the beginning) replace them with usual "while(){}" loops [Vladimir] v10: * 03: fix zstd (de)compressed loops for multi-frame cases [Vladimir] v9: * 01: fix error

[PATCH v10 2/4] qcow2: rework the cluster compression routine

2020-03-30 Thread Denis Plotnikov
The patch enables processing the image compression type defined for the image and chooses an appropriate method for image clusters (de)compression. Signed-off-by: Denis Plotnikov Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Alberto Garcia --- block/qcow2-threads.c | 71

[PATCH v10 1/4] qcow2: introduce compression type feature

2020-03-30 Thread Denis Plotnikov
The patch adds some preparation parts for incompatible compression type feature to qcow2 allowing the use different compression methods for image clusters (de)compressing. It is implied that the compression type is set on the image creation and can be changed only later by image conversion, thus

[PATCH v10 0/4] qcow2: Implement zstd cluster compression method

2020-03-30 Thread Denis Plotnikov
v10: * 03: fix zstd (de)compressed loops for multi-frame cases [Vladimir] v9: * 01: fix error checking and reporting in qcow2_amend compression type part [Vladimir] * 03: replace asserts with -EIO in qcow2_zstd_decompression [Vladimir, Alberto] * 03: reword/amend/add

[PATCH v11 2/4] qcow2: rework the cluster compression routine

2020-03-30 Thread Denis Plotnikov
The patch enables processing the image compression type defined for the image and chooses an appropriate method for image clusters (de)compression. Signed-off-by: Denis Plotnikov Reviewed-by: Vladimir Sementsov-Ogievskiy Reviewed-by: Alberto Garcia --- block/qcow2-threads.c | 71

Re: [PATCH v4] qcow2: Forbid discard in qcow2 v2 images with backing files

2020-03-30 Thread Max Reitz
On 27.03.20 19:59, Alberto Garcia wrote: > A discard request deallocates the selected clusters so they read back > as zeroes. This is done by clearing the cluster offset field and > setting QCOW_OFLAG_ZERO in the L2 entry. > > This flag is however only supported when qcow_version >= 3. In older >

[PATCH v10 4/4] iotests: 287: add qcow2 compression type test

2020-03-30 Thread Denis Plotnikov
The test checks fulfilling qcow2 requiriements for the compression type feature and zstd compression type operability. Signed-off-by: Denis Plotnikov Reviewed-by: Vladimir Sementsov-Ogievskiy --- tests/qemu-iotests/287 | 128 + tests/qemu-iotests/287.out

Re: AIO_WAIT_WHILE questions

2020-03-30 Thread Markus Armbruster
Cc'ing people based on output of "scripts/get_maintainer.pl -f include/block/aio-wait.h". Dietmar Maurer writes: > Hi all, > > I have a question about AIO_WAIT_WHILE. The docs inside the code say: > > * The caller's thread must be the IOThread that owns @ctx or the main loop > * thread (with

Re: [PATCH v4 1/2] virtio-blk: delete vqs on the error path in realize()

2020-03-30 Thread Stefan Hajnoczi
On Sat, Mar 28, 2020 at 08:57:04AM +0800, Pan Nengyuan wrote: > virtio_vqs forgot to free on the error path in realize(). Fix that. > > The asan stack: > Direct leak of 14336 byte(s) in 1 object(s) allocated from: > #0 0x7f58b93fd970 in __interceptor_calloc (/lib64/libasan.so.5+0xef970) >

[PATCH v11 4/4] iotests: 287: add qcow2 compression type test

2020-03-30 Thread Denis Plotnikov
The test checks fulfilling qcow2 requiriements for the compression type feature and zstd compression type operability. Signed-off-by: Denis Plotnikov Reviewed-by: Vladimir Sementsov-Ogievskiy --- tests/qemu-iotests/287 | 128 + tests/qemu-iotests/287.out

[PATCH v11 3/4] qcow2: add zstd cluster compression

2020-03-30 Thread Denis Plotnikov
zstd significantly reduces cluster compression time. It provides better compression performance maintaining the same level of the compression ratio in comparison with zlib, which, at the moment, is the only compression method available. The performance test results: Test compresses and

[PATCH v10 3/4] qcow2: add zstd cluster compression

2020-03-30 Thread Denis Plotnikov
zstd significantly reduces cluster compression time. It provides better compression performance maintaining the same level of the compression ratio in comparison with zlib, which, at the moment, is the only compression method available. The performance test results: Test compresses and

Re: [PATCH v9 08/14] iotests: touch up log function signature

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > Representing nested, recursive data structures in mypy is notoriously > difficult; the best we can reliably do right now is denote the atom > types as "Any" while describing the general shape of the data. > > Regardless, this fully annotates the log()

Re: [PATCH v9 09/14] iotests: limit line length to 79 chars

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > 79 is the PEP8 recommendation. This recommendation works well for > reading patch diffs in TUI email clients. > > Signed-off-by: John Snow > --- > tests/qemu-iotests/iotests.py | 64 +++ > tests/qemu-iotests/pylintrc | 6

Re: [PATCH v9 00/14] iotests: use python logging

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > This series uses python logging to enable output conditionally on > iotests.log(). We unify an initialization call (which also enables > debugging output for those tests with -d) and then make the switch > inside of iotests. > > It will help alleviate the

Re: [PATCH v11 3/4] qcow2: add zstd cluster compression

2020-03-30 Thread Vladimir Sementsov-Ogievskiy
30.03.2020 12:54, Denis Plotnikov wrote: zstd significantly reduces cluster compression time. It provides better compression performance maintaining the same level of the compression ratio in comparison with zlib, which, at the moment, is the only compression method available. The performance

Re: [PATCH v5 3/4] qmp: Move dispatcher to a coroutine

2020-03-30 Thread Markus Armbruster
Kevin Wolf writes: > Am 18.03.2020 um 16:36 hat Markus Armbruster geschrieben: >> Kevin Wolf writes: >> >> > This moves the QMP dispatcher to a coroutine and runs all QMP command >> > handlers that declare 'coroutine': true in coroutine context so they >> > can avoid blocking the main loop

[RFC 0/3] 64bit block-layer part I

2020-03-30 Thread Vladimir Sementsov-Ogievskiy
Hi all! There is an idea to make NBD protocol extension to support 64bit write-zero/discard/block-status commands (commands, which doesn't transfer user data). It's needed to increase performance of zeroing large ranges (up to the whole image). Zeroing of the whole image is used as first step of

[PATCH 1/3] block: use int64_t as bytes type in tracked requests

2020-03-30 Thread Vladimir Sementsov-Ogievskiy
We are generally moving to int64_t for both offset and bytes paramaters on all io paths. Convert tracked requests now. Signed-off-by: Vladimir Sementsov-Ogievskiy --- include/block/block_int.h | 4 ++-- block/io.c| 11 ++- 2 files changed, 8 insertions(+), 7

Re: [PATCH RESEND v3 0/4] virtio-pci: enable blk and scsi multi-queue by default

2020-03-30 Thread Pankaj Gupta
For best case its really a good idea to configure default number of queues to the number of CPU's. For the series: Reviewed-by: Pankaj Gupta

Re: [PATCH v9 01/14] iotests: do a light delinting

2020-03-30 Thread Markus Armbruster
John Snow writes: > This doesn't fix everything in here, but it does help clean up the > pylint report considerably. > > This should be 100% style changes only; the intent is to make pylint > more useful by working on establishing a baseline for iotests that we > can gate against in the future.

Re: [PATCH v9 1/4] qcow2: introduce compression type feature

2020-03-30 Thread Markus Armbruster
Denis Plotnikov writes: > The patch adds some preparation parts for incompatible compression type > feature to qcow2 allowing the use different compression methods for > image clusters (de)compressing. > > It is implied that the compression type is set on the image creation and > can be changed

[PATCH 3/3] block: use int64_t instead of uint64_t in driver handlers

2020-03-30 Thread Vladimir Sementsov-Ogievskiy
We are generally moving to int64_t for both offset and bytes parameters on all io paths. Convert driver handlers parameters which are already 64bit to signed type. Signed-off-by: Vladimir Sementsov-Ogievskiy --- include/block/block_int.h | 28 ++-- block/backup-top.c

[PATCH 2/3] block/io: convert generic io path to use int64_t parameters

2020-03-30 Thread Vladimir Sementsov-Ogievskiy
We are generally moving to int64_t for both offset and bytes paramaters on all io paths. Convert generic io path now. Signed-off-by: Vladimir Sementsov-Ogievskiy --- include/block/block.h | 8 ++-- include/block/block_int.h | 20 - block/blkverify.c | 2 +- block/io.c

Re: [PATCH v9 05/14] iotests: add pylintrc file

2020-03-30 Thread Markus Armbruster
John Snow writes: > This allows others to get repeatable results with pylint. If you run > `pylint iotests.py`, you should see a 100% pass. Nice. > > Signed-off-by: John Snow > Reviewed-by: Max Reitz > --- > tests/qemu-iotests/pylintrc | 22 ++ > 1 file changed, 22

Re: [PATCH v11 3/4] qcow2: add zstd cluster compression

2020-03-30 Thread Denis Plotnikov
On 30.03.2020 16:14, Vladimir Sementsov-Ogievskiy wrote: 30.03.2020 12:54, Denis Plotnikov wrote: zstd significantly reduces cluster compression time. It provides better compression performance maintaining the same level of the compression ratio in comparison with zlib, which, at the moment,

Re: [PATCH v9 01/14] iotests: do a light delinting

2020-03-30 Thread Kevin Wolf
Am 25.03.2020 um 00:20 hat John Snow geschrieben: > This doesn't fix everything in here, but it does help clean up the > pylint report considerably. > > This should be 100% style changes only; the intent is to make pylint > more useful by working on establishing a baseline for iotests that we >

Re: [PATCH v9 05/14] iotests: add pylintrc file

2020-03-30 Thread Kevin Wolf
Am 25.03.2020 um 00:20 hat John Snow geschrieben: > This allows others to get repeatable results with pylint. If you run > `pylint iotests.py`, you should see a 100% pass. > > Signed-off-by: John Snow > Reviewed-by: Max Reitz I see you said "should" and not "will", but I still get two

Re: [PATCH v9 08/14] iotests: touch up log function signature

2020-03-30 Thread Kevin Wolf
Am 25.03.2020 um 00:20 hat John Snow geschrieben: > Representing nested, recursive data structures in mypy is notoriously > difficult; the best we can reliably do right now is denote the atom > types as "Any" while describing the general shape of the data. > > Regardless, this fully annotates the

Re: [PATCH v9 10/14] iotests: add hmp helper with logging

2020-03-30 Thread Kevin Wolf
Am 25.03.2020 um 00:20 hat John Snow geschrieben: > Just a mild cleanup while I was here. > > Although we now have universal qmp logging on or off, many existing > callers to hmp functions don't expect that output to be logged, which > causes quite a few changes in the test output. > > For now,

Re: [PATCH v9 1/4] qcow2: introduce compression type feature

2020-03-30 Thread Denis Plotnikov
On 30.03.2020 18:06, Markus Armbruster wrote: Denis Plotnikov writes: The patch adds some preparation parts for incompatible compression type feature to qcow2 allowing the use different compression methods for image clusters (de)compressing. It is implied that the compression type is set

[PATCH RESEND v4] nvme: introduce PMR support from NVMe 1.4 spec

2020-03-30 Thread Andrzej Jakowski
This patch introduces support for PMR that has been defined as part of NVMe 1.4 spec. User can now specify a pmrdev option that should point to HostMemoryBackend. pmrdev memory region will subsequently be exposed as PCI BAR 2 in emulated NVMe device. Guest OS can perform mmio read and writes to

Re: [PATCH 3/6] dump/win_dump: fix use after free of err

2020-03-30 Thread Markus Armbruster
Vladimir Sementsov-Ogievskiy writes: > It's possible that we'll try to set err twice (or more). It's bad, it > will crash. True. > Instead, use warn_report(). Improvement even without the potential crash enabled by the loop. > Signed-off-by: Vladimir Sementsov-Ogievskiy > --- >

Re: [PATCH v9 13/14] iotests: Mark verify functions as private

2020-03-30 Thread Kevin Wolf
Am 25.03.2020 um 00:21 hat John Snow geschrieben: > Mark the verify functions as "private" with a leading underscore, to > discourage their use. > > (Also, make pending patches not yet using the new entry points fail in a > very obvious way.) > > Signed-off-by: John Snow > Reviewed-by: Max

Re: [PATCH RESEND v4] nvme: introduce PMR support from NVMe 1.4 spec

2020-03-30 Thread Keith Busch
On Mon, Mar 30, 2020 at 09:46:56AM -0700, Andrzej Jakowski wrote: > This patch introduces support for PMR that has been defined as part of NVMe > 1.4 > spec. User can now specify a pmrdev option that should point to > HostMemoryBackend. > pmrdev memory region will subsequently be exposed as PCI

Re: [PATCH v9 05/14] iotests: add pylintrc file

2020-03-30 Thread John Snow
On 3/30/20 10:45 AM, Markus Armbruster wrote: > John Snow writes: > >> This allows others to get repeatable results with pylint. If you run >> `pylint iotests.py`, you should see a 100% pass. > > Nice. > >> >> Signed-off-by: John Snow >> Reviewed-by: Max Reitz >> --- >>

Re: [PATCH v9 00/14] iotests: use python logging

2020-03-30 Thread John Snow
On 3/24/20 7:20 PM, John Snow wrote: > This series uses python logging to enable output conditionally on > iotests.log(). We unify an initialization call (which also enables > debugging output for those tests with -d) and then make the switch > inside of iotests. > > It will help alleviate the

Re: [RFC 0/3] 64bit block-layer part I

2020-03-30 Thread no-reply
Patchew URL: https://patchew.org/QEMU/20200330141818.31294-1-vsement...@virtuozzo.com/ Hi, This series failed the asan build test. Please find the testing commands and their output below. If you have Docker installed, you can probably reproduce it locally. === TEST SCRIPT BEGIN ===

Re: [PATCH v9 08/14] iotests: touch up log function signature

2020-03-30 Thread John Snow
On 3/30/20 8:28 AM, Max Reitz wrote: > On 25.03.20 00:20, John Snow wrote: >> Representing nested, recursive data structures in mypy is notoriously >> difficult; the best we can reliably do right now is denote the atom >> types as "Any" while describing the general shape of the data. >> >>

Re: [PATCH v9 05/14] iotests: add pylintrc file

2020-03-30 Thread John Snow
On 3/30/20 11:49 AM, Kevin Wolf wrote: > Am 25.03.2020 um 00:20 hat John Snow geschrieben: >> This allows others to get repeatable results with pylint. If you run >> `pylint iotests.py`, you should see a 100% pass. >> >> Signed-off-by: John Snow >> Reviewed-by: Max Reitz > > I see you said

Re: [PATCH v9 09/14] iotests: limit line length to 79 chars

2020-03-30 Thread John Snow
On 3/30/20 8:34 AM, Max Reitz wrote: > On 30.03.20 14:31, Max Reitz wrote: >> On 25.03.20 00:20, John Snow wrote: >>> 79 is the PEP8 recommendation. This recommendation works well for >>> reading patch diffs in TUI email clients. >>> >>> Signed-off-by: John Snow >>> --- >>>

Re: [PATCH RESEND v4] nvme: introduce PMR support from NVMe 1.4 spec

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 31 03:13, Keith Busch wrote: > On Mon, Mar 30, 2020 at 08:07:32PM +0200, Klaus Birkelund Jensen wrote: > > On Mar 31 01:55, Keith Busch wrote: > > > On Mon, Mar 30, 2020 at 09:46:56AM -0700, Andrzej Jakowski wrote: > > > > This patch introduces support for PMR that has been defined as part

Re: [PATCH RESEND v4] nvme: introduce PMR support from NVMe 1.4 spec

2020-03-30 Thread Keith Busch
On Mon, Mar 30, 2020 at 08:07:32PM +0200, Klaus Birkelund Jensen wrote: > On Mar 31 01:55, Keith Busch wrote: > > On Mon, Mar 30, 2020 at 09:46:56AM -0700, Andrzej Jakowski wrote: > > > This patch introduces support for PMR that has been defined as part of > > > NVMe 1.4 > > > spec. User can now

Re: [PATCH v9 08/14] iotests: touch up log function signature

2020-03-30 Thread John Snow
On 3/30/20 12:19 PM, Kevin Wolf wrote: > Am 25.03.2020 um 00:20 hat John Snow geschrieben: >> Representing nested, recursive data structures in mypy is notoriously >> difficult; the best we can reliably do right now is denote the atom >> types as "Any" while describing the general shape of the

Re: [PATCH v9 01/14] iotests: do a light delinting

2020-03-30 Thread John Snow
On 3/30/20 11:41 AM, Kevin Wolf wrote: > Am 25.03.2020 um 00:20 hat John Snow geschrieben: >> This doesn't fix everything in here, but it does help clean up the >> pylint report considerably. >> >> This should be 100% style changes only; the intent is to make pylint >> more useful by working on

Re: [PATCH v9 01/14] iotests: do a light delinting

2020-03-30 Thread John Snow
On 3/30/20 10:39 AM, Markus Armbruster wrote: > John Snow writes: > >> This doesn't fix everything in here, but it does help clean up the >> pylint report considerably. >> >> This should be 100% style changes only; the intent is to make pylint >> more useful by working on establishing a

Re: [RFC 0/3] 64bit block-layer part I

2020-03-30 Thread no-reply
Patchew URL: https://patchew.org/QEMU/20200330141818.31294-1-vsement...@virtuozzo.com/ Hi, This series failed the docker-quick@centos7 build test. Please find the testing commands and their output below. If you have Docker installed, you can probably reproduce it locally. === TEST SCRIPT

Re: [RFC 0/3] 64bit block-layer part I

2020-03-30 Thread no-reply
Patchew URL: https://patchew.org/QEMU/20200330141818.31294-1-vsement...@virtuozzo.com/ Hi, This series failed the docker-mingw@fedora build test. Please find the testing commands and their output below. If you have Docker installed, you can probably reproduce it locally. === TEST SCRIPT

Re: [PATCH RESEND v4] nvme: introduce PMR support from NVMe 1.4 spec

2020-03-30 Thread Klaus Birkelund Jensen
On Mar 31 01:55, Keith Busch wrote: > On Mon, Mar 30, 2020 at 09:46:56AM -0700, Andrzej Jakowski wrote: > > This patch introduces support for PMR that has been defined as part of NVMe > > 1.4 > > spec. User can now specify a pmrdev option that should point to > > HostMemoryBackend. > > pmrdev

Re: [PATCH v9 10/14] iotests: add hmp helper with logging

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > Just a mild cleanup while I was here. > > Although we now have universal qmp logging on or off, many existing > callers to hmp functions don't expect that output to be logged, which > causes quite a few changes in the test output. > > For now, just offer a

Re: [PATCH v9 07/14] iotests: drop pre-Python 3.4 compatibility code

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > We no longer need to accommodate 3.4, drop this code. > (The lines were > 79 chars and it stood out.) > > Signed-off-by: John Snow > --- > tests/qemu-iotests/iotests.py | 5 + > 1 file changed, 1 insertion(+), 4 deletions(-) I did say I wouldn’t

Re: [PATCH v9 09/14] iotests: limit line length to 79 chars

2020-03-30 Thread Max Reitz
On 30.03.20 14:31, Max Reitz wrote: > On 25.03.20 00:20, John Snow wrote: >> 79 is the PEP8 recommendation. This recommendation works well for >> reading patch diffs in TUI email clients. >> >> Signed-off-by: John Snow >> --- >> tests/qemu-iotests/iotests.py | 64

Re: [PATCH v5 3/4] qmp: Move dispatcher to a coroutine

2020-03-30 Thread Markus Armbruster
Marc-André Lureau writes: > Hi > > On Mon, Mar 23, 2020 at 6:41 PM Kevin Wolf wrote: >> >> Am 18.03.2020 um 16:36 hat Markus Armbruster geschrieben: >> > Kevin Wolf writes: >> > >> > > This moves the QMP dispatcher to a coroutine and runs all QMP command >> > > handlers that declare

Re: [PATCH v9 06/14] iotests: alphabetize standard imports

2020-03-30 Thread Max Reitz
On 25.03.20 00:20, John Snow wrote: > I had to fix a merge conflict, so do this tiny harmless thing while I'm > here. > > Signed-off-by: John Snow > --- > tests/qemu-iotests/iotests.py | 18 +- > 1 file changed, 9 insertions(+), 9 deletions(-) Reviewed-by: Max Reitz

Re: [PATCH v4 1/2] virtio-blk: delete vqs on the error path in realize()

2020-03-30 Thread Pankaj Gupta
Reviewed-by: Pankaj Gupta

Re: [PATCH v9 00/14] iotests: use python logging

2020-03-30 Thread John Snow
On 3/30/20 9:00 AM, Max Reitz wrote: > On 25.03.20 00:20, John Snow wrote: >> This series uses python logging to enable output conditionally on >> iotests.log(). We unify an initialization call (which also enables >> debugging output for those tests with -d) and then make the switch >> inside