[ovirt-users] Re: oVirt Open Source Backup solution?

[Jorick Astrego]

On 5/16/19 4:12 PM, Derek Atkins wrote:
> Jorick Astrego  writes:
>
>> Maybe split it in 2 disks? One OS and one APP/DATA? You can then backup 
>> only one. 
>>  
>> I prefer to do this anyway as I then can just redeploy the OS and attach 
>> the second disk to get things back up and running. 
> Are you suggesting that /etc and /var should go onto their own disks?
> There is lots of configuration in /etc (which is usually in the root
> disk) that needs to be backed up.
>
> Also, different apps store configuration and data in different places,
> so saying "just put it on a second disk" can be hard.
>
> Sure, it works fine for /home -- but mysql?  imapd?  ...
>
> -derek

/etc for us is mostly generated by deployment and provisioning, in
production at least so that is not a problem. All changes have to go
through puppet/ansible.

The /var I have been putting on a seperate disk for a long time. And a
lot of VM's have separate disks for /data or /home.

So this combination works for us but it depends on your layout and
whether you have any provisioning/config management tools an procedures
running.

Regards,

Jorick Astrego





Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts 



Tel: 053 20 30 270  i...@netbulae.euStaalsteden 4-3A
KvK 08198180
Fax: 053 20 30 271  www.netbulae.eu 7547 TA Enschede
BTW NL821234584B01



___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/YEUDZEG6VDQMESWGQ4UJOKS77ACVB6ZW/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Martin]

Hi,

there are some :

https://github.com/zipurman/oVIRT_Simple_Backup 

https://github.com/wefixit-AT/oVirtBackup 

https://github.com/vacosta94/VirtBKP 

Just my 2 cents :).

BR!

> On 9 May 2019, at 00:09, mich...@wanderingmad.com wrote:
> 
> Is there a good low to no-cost solution to backup oVirt and the virtual 
> machines?  I've been unabel to find something that will do a direct VM backup 
> instead of a backup agent installed on VM
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct: 
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives: 
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/6LHUU3EQVDYLP6I5NYO42SGKR2746ORN/

___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/4ACW2U7XNFBVCSACNSSYCTEDNPINPUGO/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

Jorick Astrego  writes:

> Maybe split it in 2 disks? One OS and one APP/DATA? You can then backup 
> only one. 
>  
> I prefer to do this anyway as I then can just redeploy the OS and attach 
> the second disk to get things back up and running. 

Are you suggesting that /etc and /var should go onto their own disks?
There is lots of configuration in /etc (which is usually in the root
disk) that needs to be backed up.

Also, different apps store configuration and data in different places,
so saying "just put it on a second disk" can be hard.

Sure, it works fine for /home -- but mysql?  imapd?  ...

-derek
-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/WCKEURYZBKGWW5HFECF7OMLBCONFXRKZ/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Jorick Astrego]

On 5/14/19 2:43 PM, Derek Atkins wrote:
> Strahil Nikolov  writes:
>
>> In such case ,
>> you use the same approach for the VM in whole - lock + snapshot on oVirt +
>> unlock.
>> This way you keep OS + app backup in one place , which has it's own Pluses 
>> and
>> Minuses.
> Sure  But the minus being it requires SIGNIFICANTLY more space.
> I've got over a dozen VMs, all running the same (pretty much) OS.
> If I based up the VM Snaphot there would be 12x space usage for OS
> files that I don't need to backup because I can recreate those from the
> initial repositories.  Of course, this is at the expense of more time to
> restore from the backup.
>
> YMMV.

Maybe split it in 2 disks? One OS and one APP/DATA? You can then backup
only one.

I prefer to do this anyway as I then can just redeploy the OS and attach
the second disk to get things back up and running.

Regards, Jorick Astrego



>> Best Regards,
>> Strahil Nikolov
> -derek




Met vriendelijke groet, With kind regards,

Jorick Astrego

Netbulae Virtualization Experts 



Tel: 053 20 30 270  i...@netbulae.euStaalsteden 4-3A
KvK 08198180
Fax: 053 20 30 271  www.netbulae.eu 7547 TA Enschede
BTW NL821234584B01



___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/M2KBXD2LWZZYAX3RSNXEMZZLU5JNXEUS/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

Strahil Nikolov  writes:

> In such case ,
> you use the same approach for the VM in whole - lock + snapshot on oVirt +
> unlock.
> This way you keep OS + app backup in one place , which has it's own Pluses and
> Minuses.

Sure  But the minus being it requires SIGNIFICANTLY more space.
I've got over a dozen VMs, all running the same (pretty much) OS.
If I based up the VM Snaphot there would be 12x space usage for OS
files that I don't need to backup because I can recreate those from the
initial repositories.  Of course, this is at the expense of more time to
restore from the backup.

YMMV.

> Best Regards,
> Strahil Nikolov

-derek
-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/X3VEPWIQVOM5PCFPL56PZN4RRKBNYXBV/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Strahil Nikolov]

 In such case ,you use the same approach for the VM in whole - lock + snapshot 
on oVirt + unlock.This way you keep OS + app backup in one place , which has 
it's own Pluses and Minuses.
Best Regards,Strahil Nikolov

В вторник, 14 май 2019 г., 6:40:56 ч. Гринуич-4, Derek Atkins 
 написа:  
 
 Hi,

I am sorry I was unclear.  Of course the long operation happens with the
DB unlocked.

Once the LVM snapshot is created (from within the locked environment), the
lock is of course released and the backup proceeds from a db-unlocked
environment.

I apologize for my lack of clarity with "and then I backup off the
snapshot" not making that clear.

-derek

On Tue, May 14, 2019 6:20 am, Strahil wrote:
> Derek,
>
> That's risky.
> Just read lock the DB, create the lvm snapshot and release the lock.
> Otherwise you risk a transaction to be  interrupted.
>
> Best Regards,
> Strahil NikolovOn May 13, 2019 16:47, Derek Atkins 
> wrote:
>>
>> Strahil  writes:
>>
>> > Another option is to create a snapshot, backup the snapahot and merge
>> > the disks (delete the snapshot actually).
>> > Sadly that option doesn't work with Databases, as you might inyerrupt
>> > a transaction and leave the DB in inconsistent state.
>>
>> Yet another reason to do it from inside the VM.
>>
>> What I do (on systems that have a running database) is to run a "flush"
>> operation to sync the database to disk, and then from within the flush
>> operation I create an LVM snapshot, and then I backup off the snapshot.
>> If I'm not running a database, then I just create the snapshot directly.
>>
>> > Best Regards,
>> > Strahil Nikolov
>>
>> -derek
>> --
>>    Derek Atkins 617-623-3745
>>    de...@ihtfp.com www.ihtfp.com
>>    Computer and Internet Security Consultant
>> ___
>> Users mailing list -- users@ovirt.org
>> To unsubscribe send an email to users-le...@ovirt.org
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/JS6YVB3S33VYLPEQTUE3UJVZOBBO5W7H/
>


-- 
      Derek Atkins                617-623-3745
      de...@ihtfp.com            www.ihtfp.com
      Computer and Internet Security Consultant

  ___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/MXK2PNDKTGGK4F55VACFRHRB2UADIQVP/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

Hi,

I am sorry I was unclear.  Of course the long operation happens with the
DB unlocked.

Once the LVM snapshot is created (from within the locked environment), the
lock is of course released and the backup proceeds from a db-unlocked
environment.

I apologize for my lack of clarity with "and then I backup off the
snapshot" not making that clear.

-derek

On Tue, May 14, 2019 6:20 am, Strahil wrote:
> Derek,
>
> That's risky.
> Just read lock the DB, create the lvm snapshot and release the lock.
> Otherwise you risk a transaction to be  interrupted.
>
> Best Regards,
> Strahil NikolovOn May 13, 2019 16:47, Derek Atkins 
> wrote:
>>
>> Strahil  writes:
>>
>> > Another option is to create a snapshot, backup the snapahot and merge
>> > the disks (delete the snapshot actually).
>> > Sadly that option doesn't work with Databases, as you might inyerrupt
>> > a transaction and leave the DB in inconsistent state.
>>
>> Yet another reason to do it from inside the VM.
>>
>> What I do (on systems that have a running database) is to run a "flush"
>> operation to sync the database to disk, and then from within the flush
>> operation I create an LVM snapshot, and then I backup off the snapshot.
>> If I'm not running a database, then I just create the snapshot directly.
>>
>> > Best Regards,
>> > Strahil Nikolov
>>
>> -derek
>> --
>>    Derek Atkins 617-623-3745
>>    de...@ihtfp.com www.ihtfp.com
>>    Computer and Internet Security Consultant
>> ___
>> Users mailing list -- users@ovirt.org
>> To unsubscribe send an email to users-le...@ovirt.org
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/JS6YVB3S33VYLPEQTUE3UJVZOBBO5W7H/
>


-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/3LQMSRLUHRBXNLGUHAIHZNEES7WWDHMJ/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Strahil]

Derek,

That's risky.
Just read lock the DB, create the lvm snapshot and release the lock.
Otherwise you risk a transaction to be  interrupted.

Best Regards,
Strahil NikolovOn May 13, 2019 16:47, Derek Atkins  wrote:
>
> Strahil  writes: 
>
> > Another option is to create a snapshot, backup the snapahot and merge 
> > the disks (delete the snapshot actually). 
> > Sadly that option doesn't work with Databases, as you might inyerrupt 
> > a transaction and leave the DB in inconsistent state. 
>
> Yet another reason to do it from inside the VM. 
>
> What I do (on systems that have a running database) is to run a "flush" 
> operation to sync the database to disk, and then from within the flush 
> operation I create an LVM snapshot, and then I backup off the snapshot. 
> If I'm not running a database, then I just create the snapshot directly. 
>
> > Best Regards, 
> > Strahil Nikolov 
>
> -derek 
> -- 
>    Derek Atkins 617-623-3745 
>    de...@ihtfp.com www.ihtfp.com 
>    Computer and Internet Security Consultant
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct: 
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives: 
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/JS6YVB3S33VYLPEQTUE3UJVZOBBO5W7H/
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/CLQVBZOTZJGRNB72TUVOHP3MVBKPJHD3/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Yedidyah Bar David]

On Tue, May 14, 2019 at 1:19 AM Jayme  wrote:
>
> Works for smaller vms but that process is pretty inefficient imo. It had to 
> clone the vm then export it, takes a lot of space and time. I like the way 
> vprotect does it, snapshot then streams the image via the API. There’s no 
> cloning to another vm step and also handles incremental backups of vms as 
> well so incremental backups take a fraction of time.

I am not following this closely, but it seems like CBT is intended to
be included in a later 4.3 release, see e.g.:

https://ovirt.org/develop/release-management/features/storage/incremental-backup.html
https://bugzilla.redhat.com/show_bug.cgi?id=1217820

>
> On Mon, May 13, 2019 at 3:04 PM Wood Peter  wrote:
>>
>> I've been using oVirtBackup in the past few years and also I've done more 
>> restores from this backup than I'd have liked. All restores were successful. 
>> I'm pretty happy with this script:
>>
>> https://github.com/wefixit-AT/oVirtBackup
>>
>> Well documented, easy to install and configure.
>>
>> In summary the script uses the API to take a snapshot, convert it to a VM, 
>> export the VM, remove the snapshot. It also removes old backups, checks for 
>> free storage space, and so on.
>>
>> It's basically set and forget.
>>
>> I just wrote my own little bash wrapper that will grab the output of the 
>> script and email it to me.
>>
>> Hope this helps,
>>
>> -- Peter
>>
>>
>>
>> On Mon, May 13, 2019 at 8:12 AM Jayme  wrote:
>>>
>>> I know that a robust API is provided for performing VM backup functions, 
>>> but it seems crazy to me that oVirt has not implemented a simple method to 
>>> backup VM to a storage domain such as an NFS export domain.

oVirt does provide an _example_ python sdk script to do that, in case
you want to hack something of your own around it:

https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/vm_backup.py

>>>  Is this functionality being left out for a reason (perhaps not wanting to 
>>> step on toes of 3rd party software vendors providing backup solutions for 
>>> oVirt/RHEV)?

I do not think oVirt should do _everything_, do you? It should allow
easy integration with other tools. And it does, IMO.

>>>
>>> On Mon, May 13, 2019 at 11:21 AM Gianluca Cecchi 
>>>  wrote:

 On Mon, May 13, 2019 at 3:47 PM Derek Atkins  wrote:
>
> Strahil  writes:
>
> > Another option is to create a snapshot, backup the snapahot and merge
> > the disks (delete the snapshot actually).
> > Sadly that option doesn't work with Databases, as you might inyerrupt
> > a transaction and leave the DB in inconsistent state.
>
> Yet another reason to do it from inside the VM.


 Actually doable, depending on DB architecture and if some 
 "logging/archiviing" supported/enabled on database.
 See here related threads where I was involved:
 https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJFQOLIWU224R2KE35VGHYXZFL6GZK4R/
 and here:
 https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65N7E2PY3KWUCZE2OGFVCKKWXKFDSRI/

 When you install qemu-guest-agent (in my case version 
 0.12.1.2-2.506.el6_10.1) you also get an example for MySQL in
 /usr/share/qemu-kvm/qemu-ga/fsfreeze-hook.d/mysql-flush.sh.sample
 and eventually updated code (actually I see it is dated 2013...) here:
 https://github.com/guillon/qemu-plugins/blob/master/scripts/qemu-guest-agent/fsfreeze-hook.d/mysql-flush.sh.sample

 In case of PostgreSQL you would need to have WAL enabled and do an 
 Exclusive Low Level Backup, because the pre-snapshot and post-snapshot 
 could not be inside the same RDBMS session connection:
 https://www.postgresql.org/docs/10/continuous-archiving.html#BACKUP-BASE-BACKUP

 so the freeze option of your freeze-hook script would contain a call to a 
 connection that runs
 SELECT pg_start_backup('label', true);
 to minimize time to do checkpoint

 and the thaw option would contain
 SELECT pg_stop_backup();

 This needs also that archives during the elapsed of backup (and the last 
 generaed when stopping backup) are copied in some way externally in 
 respect of the VM OS for complete recoverability, if you don't already 
 have it for your standard archiving policy.

 And thoroughly test the whole workflow, both backups and restores, 
 especially when upgrading your software layers, oVirt, VM OS, 
 PostgreSQL

 HIH,
 Gianluca
 ___
 Users mailing list -- users@ovirt.org
 To unsubscribe send an email to users-le...@ovirt.org
 Privacy Statement: https://www.ovirt.org/site/privacy-policy/
 oVirt Code of Conduct: 
 https://www.ovirt.org/community/about/community-guidelines/
 List Archives: 
 https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RAVXSCEPPCWLSQI4DAU6D6A2G2QBZBB/
>>>
>>> 

[ovirt-users] Re: oVirt Open Source Backup solution?

[Jayme]

Works for smaller vms but that process is pretty inefficient imo. It had to
clone the vm then export it, takes a lot of space and time. I like the way
vprotect does it, snapshot then streams the image via the API. There’s no
cloning to another vm step and also handles incremental backups of vms as
well so incremental backups take a fraction of time.

On Mon, May 13, 2019 at 3:04 PM Wood Peter  wrote:

> I've been using oVirtBackup in the past few years and also I've done more
> restores from this backup than I'd have liked. All restores were
> successful. I'm pretty happy with this script:
>
> https://github.com/wefixit-AT/oVirtBackup
>
> Well documented, easy to install and configure.
>
> In summary the script uses the API to take a snapshot, convert it to a VM,
> export the VM, remove the snapshot. It also removes old backups, checks for
> free storage space, and so on.
>
> It's basically set and forget.
>
> I just wrote my own little bash wrapper that will grab the output of the
> script and email it to me.
>
> Hope this helps,
>
> -- Peter
>
>
>
> On Mon, May 13, 2019 at 8:12 AM Jayme  wrote:
>
>> I know that a robust API is provided for performing VM backup functions,
>> but it seems crazy to me that oVirt has not implemented a simple method to
>> backup VM to a storage domain such as an NFS export domain.  Is this
>> functionality being left out for a reason (perhaps not wanting to step on
>> toes of 3rd party software vendors providing backup solutions for
>> oVirt/RHEV)?
>>
>> On Mon, May 13, 2019 at 11:21 AM Gianluca Cecchi <
>> gianluca.cec...@gmail.com> wrote:
>>
>>> On Mon, May 13, 2019 at 3:47 PM Derek Atkins  wrote:
>>>
 Strahil  writes:

 > Another option is to create a snapshot, backup the snapahot and merge
 > the disks (delete the snapshot actually).
 > Sadly that option doesn't work with Databases, as you might inyerrupt
 > a transaction and leave the DB in inconsistent state.

 Yet another reason to do it from inside the VM.

>>>
>>> Actually doable, depending on DB architecture and if some
>>> "logging/archiviing" supported/enabled on database.
>>> See here related threads where I was involved:
>>>
>>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJFQOLIWU224R2KE35VGHYXZFL6GZK4R/
>>> and here:
>>>
>>> https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65N7E2PY3KWUCZE2OGFVCKKWXKFDSRI/
>>>
>>> When you install qemu-guest-agent (in my case
>>> version 0.12.1.2-2.506.el6_10.1) you also get an example for MySQL in
>>> /usr/share/qemu-kvm/qemu-ga/fsfreeze-hook.d/mysql-flush.sh.sample
>>> and eventually updated code (actually I see it is dated 2013...) here:
>>>
>>> https://github.com/guillon/qemu-plugins/blob/master/scripts/qemu-guest-agent/fsfreeze-hook.d/mysql-flush.sh.sample
>>>
>>> In case of PostgreSQL you would need to have WAL enabled and do an
>>> Exclusive Low Level Backup, because the pre-snapshot and post-snapshot
>>> could not be inside the same RDBMS session connection:
>>>
>>> https://www.postgresql.org/docs/10/continuous-archiving.html#BACKUP-BASE-BACKUP
>>>
>>> so the freeze option of your freeze-hook script would contain a call to
>>> a connection that runs
>>> SELECT pg_start_backup('label', true);
>>> to minimize time to do checkpoint
>>>
>>> and the thaw option would contain
>>> SELECT pg_stop_backup();
>>>
>>> This needs also that archives during the elapsed of backup (and the last
>>> generaed when stopping backup) are copied in some way externally in respect
>>> of the VM OS for complete recoverability, if you don't already have it for
>>> your standard archiving policy.
>>>
>>> And thoroughly test the whole workflow, both backups and restores,
>>> especially when upgrading your software layers, oVirt, VM OS, PostgreSQL
>>>
>>> HIH,
>>> Gianluca
>>> ___
>>> Users mailing list -- users@ovirt.org
>>> To unsubscribe send an email to users-le...@ovirt.org
>>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>>> oVirt Code of Conduct:
>>> https://www.ovirt.org/community/about/community-guidelines/
>>> List Archives:
>>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RAVXSCEPPCWLSQI4DAU6D6A2G2QBZBB/
>>>
>> ___
>> Users mailing list -- users@ovirt.org
>> To unsubscribe send an email to users-le...@ovirt.org
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>>
> List Archives:
>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/7DVSYQLZ6DGVPGOCE4LHTSAAH333MGFY/
>>
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 

[ovirt-users] Re: oVirt Open Source Backup solution?

[Wood Peter]

I've been using oVirtBackup in the past few years and also I've done more
restores from this backup than I'd have liked. All restores were
successful. I'm pretty happy with this script:

https://github.com/wefixit-AT/oVirtBackup

Well documented, easy to install and configure.

In summary the script uses the API to take a snapshot, convert it to a VM,
export the VM, remove the snapshot. It also removes old backups, checks for
free storage space, and so on.

It's basically set and forget.

I just wrote my own little bash wrapper that will grab the output of the
script and email it to me.

Hope this helps,

-- Peter



On Mon, May 13, 2019 at 8:12 AM Jayme  wrote:

> I know that a robust API is provided for performing VM backup functions,
> but it seems crazy to me that oVirt has not implemented a simple method to
> backup VM to a storage domain such as an NFS export domain.  Is this
> functionality being left out for a reason (perhaps not wanting to step on
> toes of 3rd party software vendors providing backup solutions for
> oVirt/RHEV)?
>
> On Mon, May 13, 2019 at 11:21 AM Gianluca Cecchi <
> gianluca.cec...@gmail.com> wrote:
>
>> On Mon, May 13, 2019 at 3:47 PM Derek Atkins  wrote:
>>
>>> Strahil  writes:
>>>
>>> > Another option is to create a snapshot, backup the snapahot and merge
>>> > the disks (delete the snapshot actually).
>>> > Sadly that option doesn't work with Databases, as you might inyerrupt
>>> > a transaction and leave the DB in inconsistent state.
>>>
>>> Yet another reason to do it from inside the VM.
>>>
>>
>> Actually doable, depending on DB architecture and if some
>> "logging/archiviing" supported/enabled on database.
>> See here related threads where I was involved:
>>
>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJFQOLIWU224R2KE35VGHYXZFL6GZK4R/
>> and here:
>>
>> https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65N7E2PY3KWUCZE2OGFVCKKWXKFDSRI/
>>
>> When you install qemu-guest-agent (in my case
>> version 0.12.1.2-2.506.el6_10.1) you also get an example for MySQL in
>> /usr/share/qemu-kvm/qemu-ga/fsfreeze-hook.d/mysql-flush.sh.sample
>> and eventually updated code (actually I see it is dated 2013...) here:
>>
>> https://github.com/guillon/qemu-plugins/blob/master/scripts/qemu-guest-agent/fsfreeze-hook.d/mysql-flush.sh.sample
>>
>> In case of PostgreSQL you would need to have WAL enabled and do an
>> Exclusive Low Level Backup, because the pre-snapshot and post-snapshot
>> could not be inside the same RDBMS session connection:
>>
>> https://www.postgresql.org/docs/10/continuous-archiving.html#BACKUP-BASE-BACKUP
>>
>> so the freeze option of your freeze-hook script would contain a call to a
>> connection that runs
>> SELECT pg_start_backup('label', true);
>> to minimize time to do checkpoint
>>
>> and the thaw option would contain
>> SELECT pg_stop_backup();
>>
>> This needs also that archives during the elapsed of backup (and the last
>> generaed when stopping backup) are copied in some way externally in respect
>> of the VM OS for complete recoverability, if you don't already have it for
>> your standard archiving policy.
>>
>> And thoroughly test the whole workflow, both backups and restores,
>> especially when upgrading your software layers, oVirt, VM OS, PostgreSQL
>>
>> HIH,
>> Gianluca
>> ___
>> Users mailing list -- users@ovirt.org
>> To unsubscribe send an email to users-le...@ovirt.org
>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
>> oVirt Code of Conduct:
>> https://www.ovirt.org/community/about/community-guidelines/
>> List Archives:
>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RAVXSCEPPCWLSQI4DAU6D6A2G2QBZBB/
>>
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/7DVSYQLZ6DGVPGOCE4LHTSAAH333MGFY/
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/DPL2EMTA457APOJEYIU4EY3RQKTQBGU4/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Jayme]

I know that a robust API is provided for performing VM backup functions,
but it seems crazy to me that oVirt has not implemented a simple method to
backup VM to a storage domain such as an NFS export domain.  Is this
functionality being left out for a reason (perhaps not wanting to step on
toes of 3rd party software vendors providing backup solutions for
oVirt/RHEV)?

On Mon, May 13, 2019 at 11:21 AM Gianluca Cecchi 
wrote:

> On Mon, May 13, 2019 at 3:47 PM Derek Atkins  wrote:
>
>> Strahil  writes:
>>
>> > Another option is to create a snapshot, backup the snapahot and merge
>> > the disks (delete the snapshot actually).
>> > Sadly that option doesn't work with Databases, as you might inyerrupt
>> > a transaction and leave the DB in inconsistent state.
>>
>> Yet another reason to do it from inside the VM.
>>
>
> Actually doable, depending on DB architecture and if some
> "logging/archiviing" supported/enabled on database.
> See here related threads where I was involved:
>
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJFQOLIWU224R2KE35VGHYXZFL6GZK4R/
> and here:
>
> https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65N7E2PY3KWUCZE2OGFVCKKWXKFDSRI/
>
> When you install qemu-guest-agent (in my case
> version 0.12.1.2-2.506.el6_10.1) you also get an example for MySQL in
> /usr/share/qemu-kvm/qemu-ga/fsfreeze-hook.d/mysql-flush.sh.sample
> and eventually updated code (actually I see it is dated 2013...) here:
>
> https://github.com/guillon/qemu-plugins/blob/master/scripts/qemu-guest-agent/fsfreeze-hook.d/mysql-flush.sh.sample
>
> In case of PostgreSQL you would need to have WAL enabled and do an
> Exclusive Low Level Backup, because the pre-snapshot and post-snapshot
> could not be inside the same RDBMS session connection:
>
> https://www.postgresql.org/docs/10/continuous-archiving.html#BACKUP-BASE-BACKUP
>
> so the freeze option of your freeze-hook script would contain a call to a
> connection that runs
> SELECT pg_start_backup('label', true);
> to minimize time to do checkpoint
>
> and the thaw option would contain
> SELECT pg_stop_backup();
>
> This needs also that archives during the elapsed of backup (and the last
> generaed when stopping backup) are copied in some way externally in respect
> of the VM OS for complete recoverability, if you don't already have it for
> your standard archiving policy.
>
> And thoroughly test the whole workflow, both backups and restores,
> especially when upgrading your software layers, oVirt, VM OS, PostgreSQL
>
> HIH,
> Gianluca
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RAVXSCEPPCWLSQI4DAU6D6A2G2QBZBB/
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/7DVSYQLZ6DGVPGOCE4LHTSAAH333MGFY/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Gianluca Cecchi]

On Mon, May 13, 2019 at 3:47 PM Derek Atkins  wrote:

> Strahil  writes:
>
> > Another option is to create a snapshot, backup the snapahot and merge
> > the disks (delete the snapshot actually).
> > Sadly that option doesn't work with Databases, as you might inyerrupt
> > a transaction and leave the DB in inconsistent state.
>
> Yet another reason to do it from inside the VM.
>

Actually doable, depending on DB architecture and if some
"logging/archiviing" supported/enabled on database.
See here related threads where I was involved:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJFQOLIWU224R2KE35VGHYXZFL6GZK4R/
and here:
https://lists.ovirt.org/archives/list/users@ovirt.org/thread/J65N7E2PY3KWUCZE2OGFVCKKWXKFDSRI/

When you install qemu-guest-agent (in my case
version 0.12.1.2-2.506.el6_10.1) you also get an example for MySQL in
/usr/share/qemu-kvm/qemu-ga/fsfreeze-hook.d/mysql-flush.sh.sample
and eventually updated code (actually I see it is dated 2013...) here:
https://github.com/guillon/qemu-plugins/blob/master/scripts/qemu-guest-agent/fsfreeze-hook.d/mysql-flush.sh.sample

In case of PostgreSQL you would need to have WAL enabled and do an
Exclusive Low Level Backup, because the pre-snapshot and post-snapshot
could not be inside the same RDBMS session connection:
https://www.postgresql.org/docs/10/continuous-archiving.html#BACKUP-BASE-BACKUP

so the freeze option of your freeze-hook script would contain a call to a
connection that runs
SELECT pg_start_backup('label', true);
to minimize time to do checkpoint

and the thaw option would contain
SELECT pg_stop_backup();

This needs also that archives during the elapsed of backup (and the last
generaed when stopping backup) are copied in some way externally in respect
of the VM OS for complete recoverability, if you don't already have it for
your standard archiving policy.

And thoroughly test the whole workflow, both backups and restores,
especially when upgrading your software layers, oVirt, VM OS, PostgreSQL

HIH,
Gianluca
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RAVXSCEPPCWLSQI4DAU6D6A2G2QBZBB/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

Strahil  writes:

> Another option is to create a snapshot, backup the snapahot and merge
> the disks (delete the snapshot actually).
> Sadly that option doesn't work with Databases, as you might inyerrupt
> a transaction and leave the DB in inconsistent state.

Yet another reason to do it from inside the VM.

What I do (on systems that have a running database) is to run a "flush"
operation to sync the database to disk, and then from within the flush
operation I create an LVM snapshot, and then I backup off the snapshot.
If I'm not running a database, then I just create the snapshot directly.

> Best Regards,
> Strahil Nikolov

-derek
-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/JS6YVB3S33VYLPEQTUE3UJVZOBBO5W7H/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Strahil]

Another option is to create a snapshot, backup the snapahot and merge the disks 
(delete the snapshot actually).
Sadly that option doesn't work with Databases, as you might inyerrupt a 
transaction and leave the DB in inconsistent state.

Best Regards,
Strahil Nikolov
On May 10, 2019 15:37, Derek Atkins  wrote:
>
> Hi, 
>
> Michael Blanchard  writes: 
>
> > If you haven't seen my other posts, I'm not a very experienced Linux admin, 
> > so 
> > I'm trying to make it as easy as possible to run and maintain.  It's hard 
> > enough for me to not break ovirt in crazy ways 
>
> This has nothing to do with ovirt. 
>
> You could use rdiff-backup on any running machine, be it virtual or bare 
> metal.  It's just a way to use a combination of diff and rsync to backup 
> machines.  Indeed, I was using it with my vmware-based systems and, when 
> I migrated them to ovirt, the backups just continued working. 
>
> > Get Outlook for Android 
>
> -derek 
> -- 
>    Derek Atkins 617-623-3745 
>    de...@ihtfp.com www.ihtfp.com 
>    Computer and Internet Security Consultant
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct: 
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives: 
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/CBMHSCOBQ3MQHK2CFK6KYGBD2TSSOYAA/
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/CHR7SHZID6J4JHU4MOIDNPJZBYWCG6XY/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

Hi,

Michael Blanchard  writes:

> If you haven't seen my other posts, I'm not a very experienced Linux admin, so
> I'm trying to make it as easy as possible to run and maintain.  It's hard
> enough for me to not break ovirt in crazy ways

This has nothing to do with ovirt.

You could use rdiff-backup on any running machine, be it virtual or bare
metal.  It's just a way to use a combination of diff and rsync to backup
machines.  Indeed, I was using it with my vmware-based systems and, when
I migrated them to ovirt, the backups just continued working.

> Get Outlook for Android

-derek
-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/CBMHSCOBQ3MQHK2CFK6KYGBD2TSSOYAA/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Michael Blanchard]

If you haven't seen my other posts, I'm not a very experienced Linux admin, so 
I'm trying to make it as easy as possible to run and maintain.  It's hard 
enough for me to not break ovirt in crazy ways

Get Outlook for Android


From: Derek Atkins 
Sent: Thursday, May 9, 2019 9:49:13 AM
To: Michael Blanchard
Cc: users@ovirt.org
Subject: Re: [ovirt-users] oVirt Open Source Backup solution?

mich...@wanderingmad.com writes:

> Is there a good low to no-cost solution to backup oVirt and the
> virtual machines?  I've been unabel to find something that will do a
> direct VM backup instead of a backup agent installed on VM

I just use rdiff-backup inside my VMs.

-derek
--
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant

This email and any files transmitted with it are confidential and intended 
solely for the use of the individual or entity to whom they are addressed. If 
you have received this email in error please notify the system manager. This 
message contains confidential information and is intended only for the 
individual named. If you are not the named addressee you should not 
disseminate, distribute or copy this e-mail. Please notify the sender 
immediately by e-mail if you have received this e-mail by mistake and delete 
this e-mail from your system. If you are not the intended recipient you are 
notified that disclosing, copying, distributing or taking any action in 
reliance on the contents of this information is strictly prohibited.
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/CRXHVXK6WLQVJ7ZWC6NWXA6ZTIQAOF2F/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Derek Atkins]

mich...@wanderingmad.com writes:

> Is there a good low to no-cost solution to backup oVirt and the
> virtual machines?  I've been unabel to find something that will do a
> direct VM backup instead of a backup agent installed on VM

I just use rdiff-backup inside my VMs.

-derek
-- 
   Derek Atkins 617-623-3745
   de...@ihtfp.com www.ihtfp.com
   Computer and Internet Security Consultant
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z52SMCGN2SYDB2I2QLBYM5TZZL6HYPX7/

[ovirt-users] Re: oVirt Open Source Backup solution?

[femi adegoke]

Check out: http://zipur.ca/ovirt-backup/

On May 8 2019, at 6:09 pm, mich...@wanderingmad.com wrote:
> I've seen that, but i'm in that horrible pro-sumer category where it's really 
> just me, but i've got 20-40 VMs / containers running, plus terabytes of data 
> and 5 hosts (2 hyper-v, 3 ovirt)
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct: 
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives: 
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/QGJWDWLCG3RBH2NKMEIIHMNA7LWWF77K/
>

___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/K3VSTURYRDJ2UICDJQLTFVYBAQ37ZP6W/

[ovirt-users] Re: oVirt Open Source Backup solution?

[michael]

I've seen that, but i'm in that horrible pro-sumer category where it's really 
just me, but i've got 20-40 VMs / containers running, plus terabytes of data 
and 5 hosts (2 hyper-v, 3 ovirt)
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/QGJWDWLCG3RBH2NKMEIIHMNA7LWWF77K/

[ovirt-users] Re: oVirt Open Source Backup solution?

[Jayme]

vProtect is not open source but if you have 10 VMs or less the license is
free.  It's an enterprise grade backup solution that can backup oVirt/RHEV
VMs (including incremental backups), also handles restores (can mount on
the backup machine or restore to a new VM directly to oVirt), snapshot
management and a bunch of other things.  I've been demoing it for the past
several months to backup my oVirt 4.3 VMs and it has been working great.


On Wed, May 8, 2019 at 7:10 PM  wrote:

> Is there a good low to no-cost solution to backup oVirt and the virtual
> machines?  I've been unabel to find something that will do a direct VM
> backup instead of a backup agent installed on VM
> ___
> Users mailing list -- users@ovirt.org
> To unsubscribe send an email to users-le...@ovirt.org
> Privacy Statement: https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
> https://lists.ovirt.org/archives/list/users@ovirt.org/message/6LHUU3EQVDYLP6I5NYO42SGKR2746ORN/
>
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/CUOOGN6Q6MUWJKF23HNGR6LI4HHLMVXR/