Re: [Qemu-devel] [PULL 00/10] migration queue

[Peter Maydell]

On 15 June 2018 at 16:15, Dr. David Alan Gilbert (git)
 wrote:
> From: "Dr. David Alan Gilbert" 
>
> The following changes since commit 2702c2d3eb74e3908c0c5dbf3a71c8987595a86e:
>
>   Merge remote-tracking branch 
> 'remotes/stsquad/tags/pull-travis-updates-140618-1' into staging (2018-06-15 
> 12:49:36 +0100)
>
> are available in the Git repository at:
>
>   git://github.com/dagrh/qemu.git tags/pull-migration-20180615a
>
> for you to fetch changes up to 650af8907bd567db914b7ce3a7e9df4c323f4619:
>
>   migration: calculate expected_downtime with ram_bytes_remaining() 
> (2018-06-15 14:40:56 +0100)
>
> 
> Migration pull 2018-06-15
>
> 

Applied, thanks.

-- PMM

[Qemu-devel] [PULL 00/10] migration queue

[Dr. David Alan Gilbert (git)]

From: "Dr. David Alan Gilbert" 

The following changes since commit 2702c2d3eb74e3908c0c5dbf3a71c8987595a86e:

  Merge remote-tracking branch 
'remotes/stsquad/tags/pull-travis-updates-140618-1' into staging (2018-06-15 
12:49:36 +0100)

are available in the Git repository at:

  git://github.com/dagrh/qemu.git tags/pull-migration-20180615a

for you to fetch changes up to 650af8907bd567db914b7ce3a7e9df4c323f4619:

  migration: calculate expected_downtime with ram_bytes_remaining() (2018-06-15 
14:40:56 +0100)


Migration pull 2018-06-15


Balamuruhan S (1):
  migration: calculate expected_downtime with ram_bytes_remaining()

Dr. David Alan Gilbert (5):
  migration: Fixes for non-migratable RAMBlocks
  migration: Poison ramblock loops in migration
  migration/postcopy: Add max-postcopy-bandwidth parameter
  migration: Wake rate limiting for urgent requests
  migration/postcopy: Wake rate limit sleep on postcopy request

Greg Kurz (1):
  typedefs: add QJSON

Vladimir Sementsov-Ogievskiy (1):
  migration/block-dirty-bitmap: fix dirty_bitmap_load

Xiao Guangrong (2):
  migration: fix counting xbzrle cache_miss_rate
  migration: introduce migration_update_rates

 hmp.c  |  7 
 include/exec/ramlist.h |  4 ++-
 include/migration/vmstate.h|  2 --
 include/qemu/typedefs.h|  1 +
 migration/block-dirty-bitmap.c |  3 ++
 migration/migration.c  | 73 ++
 migration/migration.h  | 11 +++
 migration/qjson.h  |  2 --
 migration/ram.c| 53 --
 migration/rdma.c   |  2 +-
 migration/trace-events |  2 ++
 qapi/migration.json| 19 +--
 12 files changed, 146 insertions(+), 33 deletions(-)

Re: [Qemu-devel] [PULL 00/10] migration queue

[Peter Maydell]

On 14 February 2018 at 15:39, Dr. David Alan Gilbert (git)
 wrote:
> From: "Dr. David Alan Gilbert" 
>
> The following changes since commit bec9c64ef7be8063f1192608b83877bc5c9ea217:
>
>   Merge remote-tracking branch 'remotes/bonzini/tags/for-upstream' into 
> staging (2018-02-13 18:24:08 +)
>
> are available in the Git repository at:
>
>   git://github.com/dagrh/qemu.git tags/pull-migration-20180214a
>
> for you to fetch changes up to 3e0c8050ebba3f55dc2d92b3790a3cfb80786d07:
>
>   migration: pass MigrationState to migrate_init() (2018-02-14 10:37:09 +)
>
> 
> Migration pull 20180214
>
> Note that the 'Add test for migration to bad destination' displays
> a 'Connection refused' during running, but still gives the correct exit
> code and OK (It's checking that the source doesn't fail when
> it can't connect, so that's the right error).
> If it's particularly disliked that patch can be skipped individually.
>
> 


Applied, thanks.

-- PMM

Re: [Qemu-devel] [PULL 00/10] migration queue

[Thomas Huth]

On 15.02.2018 21:19, Dr. David Alan Gilbert wrote:
> * Peter Maydell (peter.mayd...@linaro.org) wrote:
>> On 14 February 2018 at 15:39, Dr. David Alan Gilbert (git)
>>  wrote:
>>> From: "Dr. David Alan Gilbert" 
>>>
>>> The following changes since commit bec9c64ef7be8063f1192608b83877bc5c9ea217:
>>>
>>>   Merge remote-tracking branch 'remotes/bonzini/tags/for-upstream' into 
>>> staging (2018-02-13 18:24:08 +)
>>>
>>> are available in the Git repository at:
>>>
>>>   git://github.com/dagrh/qemu.git tags/pull-migration-20180214a
>>>
>>> for you to fetch changes up to 3e0c8050ebba3f55dc2d92b3790a3cfb80786d07:
>>>
>>>   migration: pass MigrationState to migrate_init() (2018-02-14 10:37:09 
>>> +)
>>>
>>> 
>>> Migration pull 20180214
>>>
>>> Note that the 'Add test for migration to bad destination' displays
>>> a 'Connection refused' during running, but still gives the correct exit
>>> code and OK (It's checking that the source doesn't fail when
>>> it can't connect, so that's the right error).
>>> If it's particularly disliked that patch can be skipped individually.
>>>
>>> 
>>
>> Hi. This fails 'make check' on aarch64 host:
>> QTEST_QEMU_BINARY=hppa-softmmu/qemu-system-hppa
>> QTEST_QEMU_IMG=qemu-img MALLOC_PERTURB_=${MALLOC_PERTURB_:-$((
>> ${RANDOM
>> :-0} % 255 + 1))} gtester -k --verbose -m=quick tests/boot-serial-test
>> tests/qmp-test tests/device-introspect-test test
>> s/qom-test tests/test-hmp
>> TEST: tests/boot-serial-test... (pid=2306)
>>   /hppa/boot-serial/hppa:  **
>> ERROR:/home/pm215/qemu/tests/boot-serial-test.c:137:check_guest_output:
>> assertion failed: (output_ok)
>> FAIL
>> GTester: last random seed: R02S43359b02a322915508b897be44a0e9c6
>> (pid=7220)
>> FAIL: tests/boot-serial-test
> 
> I can't obviously see a reason why it should in any way affect that
> test; however I'll try and grab an aarch64 box tomorrow.

For the records: It's a bug in the boot-serial tester. I've just sent a
mail with a fix: "tests/boot-serial-test: Fix problem with timeout due
to dropped characters".

 Thomas

Re: [Qemu-devel] [PULL 00/10] migration queue

[Dr. David Alan Gilbert]

* Peter Maydell (peter.mayd...@linaro.org) wrote:
> On 14 February 2018 at 15:39, Dr. David Alan Gilbert (git)
>  wrote:
> > From: "Dr. David Alan Gilbert" 
> >
> > The following changes since commit bec9c64ef7be8063f1192608b83877bc5c9ea217:
> >
> >   Merge remote-tracking branch 'remotes/bonzini/tags/for-upstream' into 
> > staging (2018-02-13 18:24:08 +)
> >
> > are available in the Git repository at:
> >
> >   git://github.com/dagrh/qemu.git tags/pull-migration-20180214a
> >
> > for you to fetch changes up to 3e0c8050ebba3f55dc2d92b3790a3cfb80786d07:
> >
> >   migration: pass MigrationState to migrate_init() (2018-02-14 10:37:09 
> > +)
> >
> > 
> > Migration pull 20180214
> >
> > Note that the 'Add test for migration to bad destination' displays
> > a 'Connection refused' during running, but still gives the correct exit
> > code and OK (It's checking that the source doesn't fail when
> > it can't connect, so that's the right error).
> > If it's particularly disliked that patch can be skipped individually.
> >
> > 
> 
> Hi. This fails 'make check' on aarch64 host:
> QTEST_QEMU_BINARY=hppa-softmmu/qemu-system-hppa
> QTEST_QEMU_IMG=qemu-img MALLOC_PERTURB_=${MALLOC_PERTURB_:-$((
> ${RANDOM
> :-0} % 255 + 1))} gtester -k --verbose -m=quick tests/boot-serial-test
> tests/qmp-test tests/device-introspect-test test
> s/qom-test tests/test-hmp
> TEST: tests/boot-serial-test... (pid=2306)
>   /hppa/boot-serial/hppa:  **
> ERROR:/home/pm215/qemu/tests/boot-serial-test.c:137:check_guest_output:
> assertion failed: (output_ok)
> FAIL
> GTester: last random seed: R02S43359b02a322915508b897be44a0e9c6
> (pid=7220)
> FAIL: tests/boot-serial-test

I can't obviously see a reason why it should in any way affect that
test; however I'll try and grab an aarch64 box tomorrow.

Dave

> 
> 
> thanks
> -- PMM
--
Dr. David Alan Gilbert / dgilb...@redhat.com / Manchester, UK

Re: [Qemu-devel] [PULL 00/10] migration queue

[Peter Maydell]

On 14 February 2018 at 15:39, Dr. David Alan Gilbert (git)
 wrote:
> From: "Dr. David Alan Gilbert" 
>
> The following changes since commit bec9c64ef7be8063f1192608b83877bc5c9ea217:
>
>   Merge remote-tracking branch 'remotes/bonzini/tags/for-upstream' into 
> staging (2018-02-13 18:24:08 +)
>
> are available in the Git repository at:
>
>   git://github.com/dagrh/qemu.git tags/pull-migration-20180214a
>
> for you to fetch changes up to 3e0c8050ebba3f55dc2d92b3790a3cfb80786d07:
>
>   migration: pass MigrationState to migrate_init() (2018-02-14 10:37:09 +)
>
> 
> Migration pull 20180214
>
> Note that the 'Add test for migration to bad destination' displays
> a 'Connection refused' during running, but still gives the correct exit
> code and OK (It's checking that the source doesn't fail when
> it can't connect, so that's the right error).
> If it's particularly disliked that patch can be skipped individually.
>
> 

Hi. This fails 'make check' on aarch64 host:
QTEST_QEMU_BINARY=hppa-softmmu/qemu-system-hppa
QTEST_QEMU_IMG=qemu-img MALLOC_PERTURB_=${MALLOC_PERTURB_:-$((
${RANDOM
:-0} % 255 + 1))} gtester -k --verbose -m=quick tests/boot-serial-test
tests/qmp-test tests/device-introspect-test test
s/qom-test tests/test-hmp
TEST: tests/boot-serial-test... (pid=2306)
  /hppa/boot-serial/hppa:  **
ERROR:/home/pm215/qemu/tests/boot-serial-test.c:137:check_guest_output:
assertion failed: (output_ok)
FAIL
GTester: last random seed: R02S43359b02a322915508b897be44a0e9c6
(pid=7220)
FAIL: tests/boot-serial-test


thanks
-- PMM

[Qemu-devel] [PULL 00/10] migration queue

[Dr. David Alan Gilbert (git)]

From: "Dr. David Alan Gilbert" 

The following changes since commit bec9c64ef7be8063f1192608b83877bc5c9ea217:

  Merge remote-tracking branch 'remotes/bonzini/tags/for-upstream' into staging 
(2018-02-13 18:24:08 +)

are available in the Git repository at:

  git://github.com/dagrh/qemu.git tags/pull-migration-20180214a

for you to fetch changes up to 3e0c8050ebba3f55dc2d92b3790a3cfb80786d07:

  migration: pass MigrationState to migrate_init() (2018-02-14 10:37:09 +)


Migration pull 20180214

Note that the 'Add test for migration to bad destination' displays
a 'Connection refused' during running, but still gives the correct exit
code and OK (It's checking that the source doesn't fail when
it can't connect, so that's the right error).
If it's particularly disliked that patch can be skipped individually.


Dr. David Alan Gilbert (3):
  tests/migration: Add source to PC boot block
  migration: Fix early failure cleanup
  tests/migration: Add test for migration to bad destination

Greg Kurz (1):
  migration: improve documentation of postcopy-ram

Peter Xu (5):
  migration: better error handling with QEMUFile
  migration: reuse mis->userfault_quit_fd
  migration: provide postcopy_fault_thread_notify()
  migration: allow send_rq to fail
  migration: pass MigrationState to migrate_init()

Ross Lagerwall (1):
  migration/xen: Check return value of qemu_fclose

 docs/devel/migration.rst |   4 +-
 hmp-commands.hx  |   3 +-
 migration/migration.c|  47 +
 migration/migration.h|  10 +--
 migration/postcopy-ram.c |  60 ++--
 migration/postcopy-ram.h |   2 +
 migration/ram.c  |  33 ++---
 migration/savevm.c   |  48 +++--
 qapi/migration.json  |  10 +--
 tests/migration-test.c   | 117 ++-
 tests/migration/rebuild-x86-bootblock.sh |  33 +
 tests/migration/x86-a-b-bootblock.h  |  51 ++
 tests/migration/x86-a-b-bootblock.s  |  92 
 13 files changed, 388 insertions(+), 122 deletions(-)
 create mode 100755 tests/migration/rebuild-x86-bootblock.sh
 create mode 100644 tests/migration/x86-a-b-bootblock.h
 create mode 100644 tests/migration/x86-a-b-bootblock.s

Re: [Qemu-devel] [PULL 00/10] Migration queue

[Peter Maydell]

On 5 February 2015 at 16:24, Juan Quintela quint...@redhat.com wrote:
 Hi

 This is the migration queue.  Thanks to Amit for doing almost all the work.
 There were a Makefile missing dependency to make test-vmstate compile with 
 the json changes,
 Alex agreed with the changes.

 List of things:
 - vmstate checker fix (amit)
 - better tracing and errors (dgilbert)
 - json description for migration stream (alex)
 - mc146818rtc fix for subsection (Zhang).

 Please apply

 Thanks, Juan.

 The following changes since commit cd07b19307bd185dccfd39052ac66d2730b32857:

   Merge remote-tracking branch 
 'remotes/pmaydell/tags/pull-target-arm-20150205' into staging (2015-02-05 
 14:22:51 +)

 are available in the git repository at:

   git://github.com/juanquintela/qemu.git tags/migration/20150205

 for you to fetch changes up to bb426311901776b95b021cece831b69dce4ef5ee:

   fix mc146818rtc wrong subsection name to avoid vmstate_subsection_load() 
 fail (2015-02-05 17:16:14 +0100)

 
 migration/next for 20150205

 

Applied, thanks.

-- PMM

[Qemu-devel] [PULL 00/10] Migration queue

[Juan Quintela]

Hi

This is the migration queue.  Thanks to Amit for doing almost all the work.
There were a Makefile missing dependency to make test-vmstate compile with the 
json changes,
Alex agreed with the changes.

List of things:
- vmstate checker fix (amit)
- better tracing and errors (dgilbert)
- json description for migration stream (alex)
- mc146818rtc fix for subsection (Zhang).

Please apply

Thanks, Juan.

The following changes since commit cd07b19307bd185dccfd39052ac66d2730b32857:

  Merge remote-tracking branch 'remotes/pmaydell/tags/pull-target-arm-20150205' 
into staging (2015-02-05 14:22:51 +)

are available in the git repository at:

  git://github.com/juanquintela/qemu.git tags/migration/20150205

for you to fetch changes up to bb426311901776b95b021cece831b69dce4ef5ee:

  fix mc146818rtc wrong subsection name to avoid vmstate_subsection_load() fail 
(2015-02-05 17:16:14 +0100)


migration/next for 20150205


Alexander Graf (4):
  QJSON: Add JSON writer
  qemu-file: Add fast ftell code path
  migration: Append JSON description of migration stream
  Add migration stream analyzation script

Amit Shah (1):
  vmstate-static-checker: update whitelist

Dr. David Alan Gilbert (4):
  savevm: Convert fprintf to error_report
  Migration: Add lots of trace events
  Print errors in some of the early migration failure cases.
  Tracify migration/rdma.c

Zhang Haoyu (1):
  fix mc146818rtc wrong subsection name to avoid vmstate_subsection_load() 
fail

 Makefile.objs |   1 +
 hw/pci/pci.c  |   2 +-
 hw/scsi/spapr_vscsi.c |   2 +-
 hw/timer/mc146818rtc.c|   2 +-
 hw/virtio/virtio.c|   2 +-
 include/migration/migration.h |   1 +
 include/migration/qemu-file.h |   1 +
 include/migration/vmstate.h   |   3 +-
 include/qjson.h   |  29 ++
 migration/qemu-file.c |  16 ++
 migration/rdma.c  | 333 ++---
 migration/vmstate.c   | 217 +-
 qjson.c   | 129 +
 savevm.c  |  92 --
 scripts/analyze-migration.py  | 592 ++
 scripts/vmstate-static-checker.py |   2 +
 tests/Makefile|   3 +-
 tests/test-vmstate.c  |   6 +-
 trace-events  |  73 -
 19 files changed, 1274 insertions(+), 232 deletions(-)
 create mode 100644 include/qjson.h
 create mode 100644 qjson.c
 create mode 100755 scripts/analyze-migration.py