[ovirt-users] Re: Incremental VM backups

2020-08-23 Thread Hector Gonnzalez
phthon scripts is a easy way to backup ovirt vms, but as you say, you cannot do 
incremental backup with it. you may check Vinchin, it can do incremental backup 
and differential backup, and you can set time schedule for incremental backup, 
kind of automated. 
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/DGBI5O7UVHQT4PO7YWJZNPEMBMRPTXL2/


[ovirt-users] Re: Incremental VM backups

2020-08-21 Thread Kevin Doyle
I have tried protect and found it slow, thanks anyway
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/LBZ4XWRMGVVHDRWM524VKA2XCR4CHOEF/


[ovirt-users] Re: Incremental VM backups

2020-08-21 Thread Kevin Doyle
Many thanks I will try this out

Kevin
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/ESN4S7JCMCY2UFYS4HVQCXOTC6OV7SUR/


[ovirt-users] Re: Incremental VM backups

2020-08-21 Thread Paweł Mączka
Kevin,

Feel free to play with vProtect. Incremental works for 4 different strategies 

And yes - 10vms are for free.

Details you can found in below doc.

https://storware.gitbook.io/storware-vprotect/deployment/protected-platforms/virtual-machines/ovirt

Best Regards/Pozdrawiam
Paweł Mączka

On 20 Aug 2020, at 00:07, Jayme  wrote:


Vprotect can do some form of incremental backup of ovirt vms. At least on 4.3 
I’m not sure where they’re at for 4.4 support. Worth checking out, free for 10 
vms

On Wed, Aug 19, 2020 at 7:03 AM Kevin Doyle 
mailto:kevin.do...@manchester.ac.uk>> wrote:
Hi

I am looking at ways to backup VM's, ideally that support incremental backups. 
I have found a couple of python scripts that snapshot a VM and back it up but 
not incremental. The question is what do you use to backup the VM's ? (both 
linux and windows)



Thanks

Kevin

___

Users mailing list -- users@ovirt.org

To unsubscribe send an email to 
users-le...@ovirt.org

Privacy Statement: https://www.ovirt.org/privacy-policy.html

oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/

List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/KU2FI6KCAQGTLE46YEXFPJY7KQTTAQYN/

___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/GK3NKES3ISMHSNN3QHW65IZ2I3ZIE6LD/
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/GVRMMXZWKO3NC4DDTOR3TE3RYYVRZQ6I/


[ovirt-users] Re: Incremental VM backups

2020-08-19 Thread Jayme
Vprotect can do some form of incremental backup of ovirt vms. At least on
4.3 I’m not sure where they’re at for 4.4 support. Worth checking out, free
for 10 vms

On Wed, Aug 19, 2020 at 7:03 AM Kevin Doyle 
wrote:

> Hi
>
> I am looking at ways to backup VM's, ideally that support incremental
> backups. I have found a couple of python scripts that snapshot a VM and
> back it up but not incremental. The question is what do you use to backup
> the VM's ? (both linux and windows)
>
>
>
> Thanks
>
> Kevin
>
> ___
>
> Users mailing list -- users@ovirt.org
>
> To unsubscribe send an email to users-le...@ovirt.org
>
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
>
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
>
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/KU2FI6KCAQGTLE46YEXFPJY7KQTTAQYN/
>
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/GK3NKES3ISMHSNN3QHW65IZ2I3ZIE6LD/


[ovirt-users] Re: Incremental VM backups

2020-08-19 Thread Nir Soffer
On Wed, Aug 19, 2020 at 1:04 PM Kevin Doyle
 wrote:
>
> Hi
> I am looking at ways to backup VM's, ideally that support incremental 
> backups. I have found a couple of python scripts that snapshot a VM and back 
> it up but not incremental. The question is what do you use to backup the VM's 
> ? (both linux and windows)

Full backup is supported for a while and can be used now. Incremental backup
can be used now with on CentOS 8.2, but there are many rough edges that may
break your incremental backup, like creating and deleting snapshots or moving
disks.

Restoring backups requires manual work, since we don't really have a backup
solution but a backup API. The example backup scripts only do the minimal
work to show how to use the API, and require some scripting to build a simple
solution.

What you run on the VM does not matter, since the backup is in the disk
level, not in the guest filesystem level. However, to get consistent backups,
you must run qemu-guest-agent in the guest.

With these notes, here is an example backup for a vm.

The VM has  2 disks:
- 6g qcow2 - os disk
- 100g qcow2 - data disk (empty file system)

qcow2 is important, incremental backup is possible only for qcow2
disks. To enable
incremental backup when creating a disk, you need to check this:

[ ] Enable incremental backup

This will use qcow2 format for the disk, regardless of the allocation policy
(thin or preallocated).

I'm running this on RHEL AV 8.3 nightly build, but this used to work
on RHEL AV 8.2
few weeks ago, so CentOS 8.2 should work. If not you will have to wait
for the next
CentOS updated since we don't test CentOS.

Install packages on the host running the backup script:

dnf install python3-ovirt-engine-sdk4 ovirt-imageio-client

If you run this on a oVirt host, the packages are already installed,
and the backup
will be faster.

Creating a full backup:

$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/backup_vm.py full \
--engine-url https://engine3 \
--username admin@internal \
--password-file password \
--cafile engine3.pem \
--backup-dir /var/tmp/backups \
ed2e2c59-36d3-41e2-ac7e-f4d33eb69ad4
[   0.0 ] Starting full backup for VM ed2e2c59-36d3-41e2-ac7e-f4d33eb69ad4
[   0.2 ] Waiting until backup e0de71d6-146a-40f6-80f6-7c6b2969aa3f is ready
[   1.2 ] Created checkpoint 'c13420d7-ab33-4545-acad-4fe1417cc61f'
(to use in --from-checkpoint-uuid for the next incremental backup)
[   1.2 ] Creating image transfer for disk 419b83e7-a6b5-4445-9324-a85e27b134d2
[   2.3 ] Image transfer 6fc1944c-ce4c-40e7-8119-61208f6489fe is ready
Formatting 
'/var/tmp/backups/419b83e7-a6b5-4445-9324-a85e27b134d2.202008192037.full.qcow2',
fmt=qcow2 cluster_size=65536 compression_type=zlib size=107374182400
lazy_refcounts=off refcount_bits=16
[ 100.00% ] 100.00 GiB, 0.79 seconds, 126.17 GiB/s
[   3.1 ] Finalizing image transfer
[   5.2 ] Creating image transfer for disk 58daea80-1229-4c6b-b33c-1a4e568c8ad7
[   6.2 ] Image transfer 63e1f899-7add-46a8-8d68-4ef3e6a1385b is ready
Formatting 
'/var/tmp/backups/58daea80-1229-4c6b-b33c-1a4e568c8ad7.202008192037.full.qcow2',
fmt=qcow2 cluster_size=65536 compression_type=zlib size=6442450944
lazy_refcounts=off refcount_bits=16
[ 100.00% ] 6.00 GiB, 8.39 seconds, 731.93 MiB/s
[  14.6 ] Finalizing image transfer
[  19.8 ] Full backup completed successfully

The backup created these files:

$ qemu-img info
/var/tmp/backups/419b83e7-a6b5-4445-9324-a85e27b134d2.202008192037.full.qcow2
image: 
/var/tmp/backups/419b83e7-a6b5-4445-9324-a85e27b134d2.202008192037.full.qcow2
file format: qcow2
virtual size: 100 GiB (107374182400 bytes)
disk size: 51 MiB
...

$ qemu-img info
/var/tmp/backups/58daea80-1229-4c6b-b33c-1a4e568c8ad7.202008192037.full.qcow2
image: 
/var/tmp/backups/58daea80-1229-4c6b-b33c-1a4e568c8ad7.202008192037.full.qcow2
file format: qcow2
virtual size: 6 GiB (6442450944 bytes)
disk size: 2.2 GiB
...

Now lets create an incremental backup - we need to use the checkpoint id created
during the previous backup:

[   1.2 ] Created checkpoint
'c13420d7-ab33-4545-acad-4fe1417cc61f' (to use in
--from-checkpoint-uuid for the next incremental backup)

And the "incremental" sub command:

$ python3 /usr/share/doc/python3-ovirt-engine-sdk4/examples/backup_vm.py
incremental \
--engine-url https://engine3 \
--username admin@internal \
--password-file password \
--cafile engine3.pem \
--backup-dir /var/tmp/backups \
--from-checkpoint-uuid c13420d7-ab33-4545-acad-4fe1417cc61f \
ed2e2c59-36d3-41e2-ac7e-f4d33eb69ad4
[   0.0 ] Starting incremental backup for VM
ed2e2c59-36d3-41e2-ac7e-f4d33eb69ad4
[   0.2 ] Waiting until backup 76fbea79-b92a-4970-a1bf-f60904dabc6a is ready
[   1.2 ] Created checkpoint '68936483-6c5c-41e8-9f0c-b00ff963edfc'
(to use in --from-checkpoint-uuid for the next incremental backup)
[   1.2 ] Creating image transfer for disk 419b83e7-a6b5-4445-9324-a85e27b134d2
[   2.3 ] Image transfer