[Qemu-devel] [PATCH for 2.7 0/2] block: fixes for deadlock in flush code

2016-08-17 Thread Denis V. Lunev
ession testing faces it ~1 time a week or less. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com>

Re: [Qemu-devel] [PATCH v7 00/16] backup compression

2016-08-08 Thread Denis V. Lunev
On 08/08/2016 04:02 PM, Stefan Hajnoczi wrote: On Fri, Jul 22, 2016 at 11:17:39AM +0300, Denis V. Lunev wrote: The idea is simple - backup is "written-once" data. It is written block by block and it is large enough. It would be nice to save storage space and compress it. These p

Re: [Qemu-devel] [PATCH 1/1] ehci: faster frame index calculation for skipped frames

2016-08-01 Thread Denis V. Lunev
On 07/27/2016 06:55 PM, Denis V. Lunev wrote: From: Evgeny Yakovlev <eyakov...@virtuozzo.com> ehci_update_frindex takes time linearly proportional to a number of uframes to calculate new frame index and raise FLR interrupts, which is a problem for large amounts of uframes. If we expe

[Qemu-devel] [PATCH 1/1] migration: mmap error check fix

2016-07-29 Thread Denis V. Lunev
ge is definitely wrong and should be fixed. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Juan Quintela <quint...@redhat.com> CC: Amit Shah <amit.s...@redhat.com> --- migration/postcopy-ram.c | 2 +- 1 file chan

Re: [Qemu-devel] [PATCH 1/1] block/parallels: check new image size

2016-07-27 Thread Denis V. Lunev
On 07/27/2016 07:01 PM, Denis V. Lunev wrote: From: Klim Kireev <spr...@linux.com> Before this patch incorrect image could be created via qemu-img (Example: qemu-img create -f parallels -o size=4096T hack.img), incorrect images cannot be used due to overflow in main image structure. This

[Qemu-devel] [PATCH v2 1/1] block/parallels: check new image size

2016-07-27 Thread Denis V. Lunev
eation. After reading size it compare it with UINT32_MAX * cluster_size. Signed-off-by: Klim Kireev <pro...@virtuozzo.mipt.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> --- changes from v1: - fixed from: to be virtuozzo.mipt

[Qemu-devel] [PATCH 1/1] block/parallels: check new image size

2016-07-27 Thread Denis V. Lunev
After reading size it compare it with UINT32_MAX * cluster_size. Signed-off-by: Klim Kireev <pro...@virtuozzo.mipt.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> --- block/parallels.c | 5 + 1 file changed, 5 insertions(+) diff -

[Qemu-devel] [PATCH 1/1] ehci: faster frame index calculation for skipped frames

2016-07-27 Thread Denis V. Lunev
while guest is unresponsive. This misbehavior could happen for a while and QEMU does not get out from this state automatically without the patch. This change makes ehci_update_frindex execute in constant time. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis

[Qemu-devel] [PATCH v7 16/16] qemu-iotests: add vmdk for test backup compression in 055

2016-07-22 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> The vmdk format has support for compression, it would be fine to add it for the test backup compression Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v7 12/16] block: simplify blockdev-backup

2016-07-22 Thread Denis V. Lunev
d-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <st

[Qemu-devel] [PATCH v7 13/16] drive-backup: added support for data compression

2016-07-22 Thread Denis V. Lunev
er and the error will be reported if we are doing something wrong. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster

[Qemu-devel] [PATCH v7 15/16] qemu-iotests: test backup compression in 055

2016-07-22 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Added cases to check the backup compression out of qcow2, raw in qcow2 on drive-backup and blockdev-backup. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v7 02/16] block: Convert bdrv_pwrite_compressed() to BdrvChild

2016-07-22 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Eric Blake <ebl...@redhat.com> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm..

[Qemu-devel] [PATCH v7 06/16] vmdk: add vmdk_co_pwritev_compressed

2016-07-22 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC

[Qemu-devel] [PATCH v7 03/16] block/io: reuse bdrv_co_pwritev() for write compressed

2016-07-22 Thread Denis V. Lunev
iented function for write compressed by using bdrv_co_pwritev/blk_co_pwritev with BDRV_REQ_WRITE_COMPRESSED flag. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <j

[Qemu-devel] [PATCH v7 05/16] qcow2: cleanup qcow2_co_pwritev_compressed to avoid the recursion

2016-07-22 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Now that the function uses a vector instead of a buffer, there is no need to use recursive code. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v7 04/16] qcow2: add qcow2_co_pwritev_compressed

2016-07-22 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v7 01/16] block: switch blk_write_compressed() to byte-based interface

2016-07-22 Thread Denis V. Lunev
lt;pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Reviewed-by: Eric Blake <ebl...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@re

[Qemu-devel] [PATCH v7 14/16] blockdev-backup: added support for data compression

2016-07-22 Thread Denis V. Lunev
ed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajno

[Qemu-devel] [PATCH v7 09/16] block: remove BlockDriver.bdrv_write_compressed

2016-07-22 Thread Denis V. Lunev
lt;pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.

[Qemu-devel] [PATCH v7 10/16] block/io: turn on dirty_bitmaps for the compressed writes

2016-07-22 Thread Denis V. Lunev
ressed write is always in coroutine and setting the bits is done after the write, so that we can return the dirty_bitmaps for the compressed writes. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev &l

[Qemu-devel] [PATCH v7 07/16] qcow: add qcow_co_pwritev_compressed

2016-07-22 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v7 11/16] block: simplify drive-backup

2016-07-22 Thread Denis V. Lunev
d-by: Stefan Hajnoczi <stefa...@redhat.com> Reviewed-by: Eric Blake <ebl...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Sn

[Qemu-devel] [PATCH v7 08/16] qcow: cleanup qcow_co_pwritev_compressed to avoid the recursion

2016-07-22 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Now that the function uses a vector instead of a buffer, there is no need to use recursive code. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v7 00/16] backup compression

2016-07-22 Thread Denis V. Lunev
in <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com&g

[Qemu-devel] [PATCH v6 07/16] qcow: add qcow_co_pwritev_compressed

2016-07-21 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v6 13/16] drive-backup: added support for data compression

2016-07-21 Thread Denis V. Lunev
er and the error will be reported if we are doing something wrong. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster

[Qemu-devel] [PATCH v6 00/16] backup compression

2016-07-21 Thread Denis V. Lunev
mmands (10, 11) - reworded drive/blockdev-backup documentation about compression (12, 13) - fix s/bakup/backup/ (14) Changes form v5: - rebased on master - fix grammar (5, 8) Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org

[Qemu-devel] [PATCH v6 11/16] block: simplify drive-backup

2016-07-21 Thread Denis V. Lunev
d-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <st

[Qemu-devel] [PATCH v6 15/16] qemu-iotests: test backup compression in 055

2016-07-21 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Added cases to check the backup compression out of qcow2, raw in qcow2 on drive-backup and blockdev-backup. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v6 14/16] blockdev-backup: added support for data compression

2016-07-21 Thread Denis V. Lunev
ed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajno

[Qemu-devel] [PATCH v6 16/16] qemu-iotests: add vmdk for test backup compression in 055

2016-07-21 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> The vmdk format has support for compression, it would be fine to add it for the test backup compression Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v6 02/16] block: Convert bdrv_pwrite_compressed() to BdrvChild

2016-07-21 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com>

[Qemu-devel] [PATCH v6 12/16] block: simplify blockdev-backup

2016-07-21 Thread Denis V. Lunev
d-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <st

[Qemu-devel] [PATCH v6 06/16] vmdk: add vmdk_co_pwritev_compressed

2016-07-21 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC

[Qemu-devel] [PATCH v6 01/16] block: switch blk_write_compressed() to byte-based interface

2016-07-21 Thread Denis V. Lunev
uozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan H

[Qemu-devel] [PATCH v6 09/16] block: remove BlockDriver.bdrv_write_compressed

2016-07-21 Thread Denis V. Lunev
lt;pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.

[Qemu-devel] [PATCH v6 08/16] qcow: cleanup qcow_co_pwritev_compressed to avoid the recursion

2016-07-21 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Now that the function uses a vector instead of a buffer, there is no need to use recursive code. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v6 05/16] qcow2: cleanup qcow2_co_pwritev_compressed to avoid the recursion

2016-07-21 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Now that the function uses a vector instead of a buffer, there is no need to use recursive code. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v6 03/16] block/io: reuse bdrv_co_pwritev() for write compressed

2016-07-21 Thread Denis V. Lunev
iented function for write compressed by using bdrv_co_pwritev/blk_co_pwritev with BDRV_REQ_WRITE_COMPRESSED flag. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <j

[Qemu-devel] [PATCH v6 04/16] qcow2: add qcow2_co_pwritev_compressed

2016-07-21 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v6 10/16] block/io: turn on dirty_bitmaps for the compressed writes

2016-07-21 Thread Denis V. Lunev
ressed write is always in coroutine and setting the bits is done after the write, so that we can return the dirty_bitmaps for the compressed writes. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev &l

Re: [Qemu-devel] [PATCH v2] mirror: double performance of the bulk stage if the disc is full

2016-07-20 Thread Denis V. Lunev
On 07/20/2016 10:08 PM, Paolo Bonzini wrote: - Original Message - From: "Denis V. Lunev" <d...@openvz.org> To: "Vladimir Sementsov-Ogievskiy" <vsement...@virtuozzo.com>, qemu-bl...@nongnu.org, qemu-devel@nongnu.org Cc: stefa...@redhat.com, f...@r

Re: [Qemu-devel] [PATCH v2] mirror: double performance of the bulk stage if the disc is full

2016-07-20 Thread Denis V. Lunev
off-by: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Jeff Cody

[Qemu-devel] [PATCH v8 4/4] block: ignore flush requests when storage is clean

2016-07-18 Thread Denis V. Lunev
mirror and active block-commit commands now arrives faster, before QMP send successfully returns to caller (tests 141 144). Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.co

[Qemu-devel] [PATCH v8 1/4] ide: refactor retry_unit set and clear into separate function

2016-07-18 Thread Denis V. Lunev
From: Evgeny Yakovlev <eyakov...@virtuozzo.com> Code to set and clear state associated with retry in moved into ide_set_retry and ide_clear_retry to make adding retry setups easier. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openv

[Qemu-devel] [PATCH v8 2/4] ide: set retry_unit for PIO and FLUSH requests

2016-07-18 Thread Denis V. Lunev
s->unit. But s->retry_unit is still -1 after previous DMA completion and flush does not use anything related to retry. This patch restricts retry unit assertion only to ops that actually use retry logic. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev

[Qemu-devel] [PATCH v8 3/4] tests: in IDE and AHCI tests perform DMA write before flushing

2016-07-18 Thread Denis V. Lunev
nds so that bdrv_flush actually generates flush_to_disk event. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redha

[Qemu-devel] [PATCH v8 0/4] block: ignore flush requests when storage is clean

2016-07-18 Thread Denis V. Lunev
Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: John Snow <js...@redhat.com

Re: [Qemu-devel] [PATCH v7 4/4] block: ignore flush requests when storage is clean

2016-07-18 Thread Denis V. Lunev
On 07/18/2016 10:10 PM, John Snow wrote: On 07/15/2016 09:47 AM, Denis V. Lunev wrote: From: Evgeny Yakovlev <eyakov...@virtuozzo.com> Some guests (win2008 server for example) do a lot of unnecessary flushing when underlying media has not changed. This adds additional overhead on hos

Re: [Qemu-devel] [PATCH v3 0/8] drive-mirror improvements

2016-07-18 Thread Denis V. Lunev
On 07/14/2016 04:33 PM, Denis V. Lunev wrote: This patchset contains patches dealing with known-to-be-zero areas in drive mirror from [PATCH 0/9] major rework of drive-mirror patchset. Changes from v2: - added mirror_throttle helper (patch 3) to address Eric' comment about last_time_ns

Re: [Qemu-devel] [PATCH v2] mirror: double performance of the bulk stage if the disc is full

2016-07-18 Thread Denis V. Lunev
off-by: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Jeff Cody

[Qemu-devel] [PATCH v7 3/4] tests: in IDE and AHCI tests perform DMA write before flushing

2016-07-15 Thread Denis V. Lunev
nds so that bdrv_flush actually generates flush_to_disk event. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redha

[Qemu-devel] [PATCH v7 2/4] ide: set retry_unit for PIO and FLUSH requests

2016-07-15 Thread Denis V. Lunev
s->unit. But s->retry_unit is still -1 after previous DMA completion and flush does not use anything related to retry. This patch restricts retry unit assertion only to ops that actually use retry logic. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev

[Qemu-devel] [PATCH v7 1/4] ide: refactor retry_unit set and clear into separate function

2016-07-15 Thread Denis V. Lunev
From: Evgeny Yakovlev <eyakov...@virtuozzo.com> Code to set and clear state associated with retry in moved into ide_set_retry and ide_clear_retry to make adding retry setups easier. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openv

[Qemu-devel] [PATCH v7 0/4] block: ignore flush requests when storage is clean

2016-07-15 Thread Denis V. Lunev
be skipped will now wait for completion of any previous requests already in flight - Fixed IDE and AHCI tests to dirty media for new flush behaviour - Fixed a problem in IDE CMD_FLUSH_CACHE failure handling Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lu

[Qemu-devel] [PATCH v7 4/4] block: ignore flush requests when storage is clean

2016-07-15 Thread Denis V. Lunev
mirror and active block-commit commands now arrives faster, before QMP send successfully returns to caller (tests 141 144). Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.co

Re: [Qemu-devel] [PATCH v3 4/8] mirror: create mirror_dirty_init helper for mirror_run

2016-07-14 Thread Denis V. Lunev
On 07/14/2016 07:19 PM, Eric Blake wrote: On 07/14/2016 07:33 AM, Denis V. Lunev wrote: The code inside the helper will be extended in the next patch. mirror_run itself is overbloated at the moment. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogi

[Qemu-devel] [PATCH v3 3/8] mirror: create mirror_throttle helper

2016-07-14 Thread Denis V. Lunev
The patch also places last_pause_ns from stack in mirror_run into MirrorBlockJob structure. This helper will be useful in next patches. Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> CC: Eric Blake <ebl...@redhat.

[Qemu-devel] [PATCH v3 8/8] mirror: improve performance of mirroring of empty disk

2016-07-14 Thread Denis V. Lunev
We should not take into account zero blocks for delay calculations. They are not read and thus IO throttling is not required. In the other case VM migration with 16 Tb QCOW2 disk with 4 Gb of data takes days. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sem

[Qemu-devel] [PATCH v3 7/8] mirror: efficiently zero out target

2016-07-14 Thread Denis V. Lunev
-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogievskiy<vsement...@virtuozzo.com> Reviewed-by: Fam Zheng <f...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: J

[Qemu-devel] [PATCH v3 6/8] mirror: optimize dirty bitmap filling in mirror_run a bit

2016-07-14 Thread Denis V. Lunev
There is no need to scan allocation tables if we have mark_all_dirty flag set. Just mark it all dirty. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogievskiy<vsement...@virtuozzo.com> Reviewed-by: Eric Blake <ebl...@redhat.com> Reviewed

[Qemu-devel] [PATCH v3 0/8] drive-mirror improvements

2016-07-14 Thread Denis V. Lunev
- direct checking of .bdrv_co_write_zeroes is replaced with bdrv_can_write_zeroes_with_unmap - added fixes for bdrv_can_write_zeroes_with_unmap Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: Kevin Wolf

[Qemu-devel] [PATCH v3 2/8] mirror: make sectors_in_flight int64_t

2016-07-14 Thread Denis V. Lunev
We keep here the sum of int fields. Thus this could easily overflow, especially when we will start sending big requests in next patches. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> Reviewed-by: Eric Blake <eb

[Qemu-devel] [PATCH v3 4/8] mirror: create mirror_dirty_init helper for mirror_run

2016-07-14 Thread Denis V. Lunev
The code inside the helper will be extended in the next patch. mirror_run itself is overbloated at the moment. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogievskiy<vsement...@virtuozzo.com> Reviewed-by: Eric Blake <ebl...@redhat.com> Reviewe

[Qemu-devel] [PATCH v3 1/8] dirty-bitmap: operate with int64_t amount

2016-07-14 Thread Denis V. Lunev
Underlying HBitmap operates even with uint64_t. Thus this change is safe. This would be useful f.e. to mark entire bitmap dirty in one call. Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> Reviewed-by: Eri

[Qemu-devel] [PATCH v3 5/8] block: remove extra condition in bdrv_can_write_zeroes_with_unmap

2016-07-14 Thread Denis V. Lunev
All .bdrv_co_write_zeroes callbacks nowadays work perfectly even with backing store attached. If future new callbacks would be unable to do that - they have a chance to block this in bdrv_get_info(). Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Eric Blake <ebl...@r

[Qemu-devel] [PATCH v6 2/6] ide: set retry_unit for PIO and FLUSH requests

2016-07-14 Thread Denis V. Lunev
s->unit. But s->retry_unit is still -1 after previous DMA completion and flush does not use anything related to retry. This patch restricts retry unit assertion only to ops that actually use retry logic. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev

[Qemu-devel] [PATCH v6 3/6] tests: in IDE and AHCI tests perform DMA write before flushing

2016-07-14 Thread Denis V. Lunev
nds so that bdrv_flush actually generates flush_to_disk event. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redha

[Qemu-devel] [PATCH v6 5/6] tests: removed skipped flushes from block test traces

2016-07-14 Thread Denis V. Lunev
pected flush error logs from block tests 026 071 089 Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v6 4/6] block: ignore flush requests when storage is clean

2016-07-14 Thread Denis V. Lunev
. Each loop creates 10^3 directories with 10 files in each. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> Reviewed-by: Paolo Bonzini <pbonz...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redha

[Qemu-devel] [PATCH v6 0/6] block: ignore flush requests when storage is clean

2016-07-14 Thread Denis V. Lunev
behaviour - Fixed a problem in IDE CMD_FLUSH_CACHE failure handling Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@r

[Qemu-devel] [PATCH v6 6/6] tests: changed block job ready event generation order

2016-07-14 Thread Denis V. Lunev
re QMP send successfully returns in block tests 141 144 Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com>

[Qemu-devel] [PATCH v6 1/6] ide: refactor retry_unit set and clear into separate function

2016-07-14 Thread Denis V. Lunev
From: Evgeny Yakovlev <eyakov...@virtuozzo.com> Code to set and clear state associated with retry in moved into ide_set_retry and ide_clear_retry to make adding retry setups easier. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openv

[Qemu-devel] [PATCH 1/1] mirror: double performance of the bulk stage if the disc is full

2016-07-12 Thread Denis V. Lunev
igned-off-by: Vladimir Sementsov-Ogievskiy <vsement...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC

Re: [Qemu-devel] [PATCH v5 00/15] backup compression

2016-07-08 Thread Denis V. Lunev
On 07/04/2016 03:28 PM, Denis V. Lunev wrote: The idea is simple - backup is "written-once" data. It is written block by block and it is large enough. It would be nice to save storage space and compress it. These patches add the ability to compress data during backup. This fun

Re: [Qemu-devel] [PATCH] fixup! cpu: report hyperv feature words through qom

2016-07-07 Thread Denis V. Lunev
On 07/07/2016 07:49 PM, Eduardo Habkost wrote: On Thu, Jul 07, 2016 at 01:44:48PM -0300, Eduardo Habkost wrote: Hi, Sorry for taking so long to review it. The patch in general looks good, except for: On Fri, Jun 24, 2016 at 01:49:36PM +0300, Denis V. Lunev wrote

Re: [Qemu-devel] [PATCH 4/9] mirror: efficiently zero out target

2016-07-06 Thread Denis V. Lunev
On 06/15/2016 03:34 PM, Eric Blake wrote: On 06/15/2016 02:46 AM, Denis V. Lunev wrote: On 06/15/2016 06:00 AM, Eric Blake wrote: On 06/14/2016 09:25 AM, Denis V. Lunev wrote: With a bdrv_co_write_zeroes method on a target BDS zeroes will not be placed into the wire. Thus the target could

Re: [Qemu-devel] [PATCH v3 1/1] cpu: report hyperv feature words through qom

2016-07-05 Thread Denis V. Lunev
On 06/24/2016 01:49 PM, Denis V. Lunev wrote: From: Evgeny Yakovlev <eyakov...@virtuozzo.com> This change adds hyperv feature words report through qom rpc. When VM is configured with hyperv features enabled libvirt will check that required feature words are set in cpuid leaf 4003 t

[Qemu-devel] [PATCH v5 3/4] tests: in IDE and AHCI tests perform DMA write before flushing

2016-07-04 Thread Denis V. Lunev
nds so that bdrv_flush actually generates flush_to_disk event. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com>

[Qemu-devel] [PATCH v5 1/4] ide: refactor retry_unit set and clear into separate function

2016-07-04 Thread Denis V. Lunev
From: Evgeny Yakovlev <eyakov...@virtuozzo.com> Code to set and clear state associated with retry in moved into ide_set_retry and ide_clear_retry to make adding retry setups easier. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz

[Qemu-devel] [PATCH v5 2/4] ide: set retry_unit for PIO and FLUSH requests

2016-07-04 Thread Denis V. Lunev
s->unit. But s->retry_unit is still -1 after previous DMA completion and flush does not use anything related to retry. This patch restricts retry unit assertion only to ops that actually use retry logic. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d

[Qemu-devel] [PATCH v5 0/4] block: ignore flush requests when storage is clean

2016-07-04 Thread Denis V. Lunev
ed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Fam Zheng <f...@redhat.com> CC: John Snow <js...@redhat.com> Evgeny Yakovlev (4): ide: refactor retry_unit

[Qemu-devel] [PATCH v5 4/4] block: ignore flush requests when storage is clean

2016-07-04 Thread Denis V. Lunev
. Each loop creates 10^3 directories with 10 files in each. Signed-off-by: Evgeny Yakovlev <eyakov...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Kevin Wolf <kw...@redhat.com> CC: Max Reitz <mre...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com>

[Qemu-devel] [PATCH 1/1] qemu-img: fix failed autotests

2016-07-04 Thread Denis V. Lunev
There are 9 iotests failed on Ubuntu 15.10 at the moment. The problem is that options parsing in qemu-img is broken by the following commit: commit 10985131e337a0c52c5bd1e191fd7867a6ff8d02 Author: Denis V. Lunev <d...@openvz.org> Date: Fri Jun 17 17:44:13 2016 +0300 qe

[Qemu-devel] [PATCH v5 13/15] blockdev-backup: added support for data compression

2016-07-04 Thread Denis V. Lunev
ed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajno

[Qemu-devel] [PATCH v5 14/15] qemu-iotests: test backup compression in 055

2016-07-04 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Added cases to check the backup compression out of qcow2, raw in qcow2 on drive-backup and blockdev-backup. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <

[Qemu-devel] [PATCH v5 05/15] vmdk: add vmdk_co_pwritev_compressed

2016-07-04 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC

[Qemu-devel] [PATCH v5 11/15] block: simplify blockdev-backup

2016-07-04 Thread Denis V. Lunev
ff-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC: Kevin Wolf &

[Qemu-devel] [PATCH v5 03/15] qcow2: add qcow2_co_pwritev_compressed

2016-07-04 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC:

[Qemu-devel] [PATCH v5 10/15] block: simplify drive-backup

2016-07-04 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Now that we can support boxed commands, use it to greatly reduce the number of parameters (and likelihood of getting out of sync) when adjusting drive-backup parameters. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off

[Qemu-devel] [PATCH v5 12/15] drive-backup: added support for data compression

2016-07-04 Thread Denis V. Lunev
er and the error will be reported if we are doing something wrong. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster

[Qemu-devel] [PATCH v5 08/15] block: remove BlockDriver.bdrv_write_compressed

2016-07-04 Thread Denis V. Lunev
lt;pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC

[Qemu-devel] [PATCH v5 00/15] backup compression

2016-07-04 Thread Denis V. Lunev
l Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redha

[Qemu-devel] [PATCH v5 07/15] qcow: cleanup qcow_co_pwritev_compressed to avoid the recursion

2016-07-04 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> Since the function became use a vector instead of a buffer there is no sense to use a recursive code. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@r

[Qemu-devel] [PATCH v5 06/15] qcow: add qcow_co_pwritev_compressed

2016-07-04 Thread Denis V. Lunev
noczi <stefa...@redhat.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redhat.com> CC: Eric Blake <ebl...@redhat.com> CC: John Snow <js...@redhat.com> CC: Stefan Hajnoczi <stefa...@redhat.com> CC

[Qemu-devel] [PATCH v5 01/15] block: switch blk_write_compressed() to byte-based interface

2016-07-04 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> This is a preparatory patch, which continues the general trend of the transition to the byte-based interfaces. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-

[Qemu-devel] [PATCH v5 15/15] qemu-iotests: add vmdk for test backup compression in 055

2016-07-04 Thread Denis V. Lunev
From: Pavel Butsykin <pbutsy...@virtuozzo.com> The vmdk format has support for compression, it would be fine to add it for the test backup compression. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Reviewed-by: Stefan Hajnoczi <stefa...@redhat.com> Signed-off-by:

[Qemu-devel] [PATCH v5 09/15] block/io: turn on dirty_bitmaps for the compressed writes

2016-07-04 Thread Denis V. Lunev
ressed write is always in coroutine and setting the bits is done after the write, so that we can return the dirty_bitmaps for the compressed writes. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com&

[Qemu-devel] [PATCH v5 02/15] block/io: reuse bdrv_co_pwritev() for write compressed

2016-07-04 Thread Denis V. Lunev
iented function for write compressed by using bdrv_co_pwritev/blk_co_pwritev with BDRV_REQ_WRITE_COMPRESSED flag. Signed-off-by: Pavel Butsykin <pbutsy...@virtuozzo.com> Signed-off-by: Denis V. Lunev <d...@openvz.org> CC: Jeff Cody <jc...@redhat.com> CC: Markus Armbruster <arm...@redh

<    4   5   6   7   8   9   10   11   12   13   >