Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
On 11 November 2015 at 01:02, Liam Curtiswrote: > Thanks for this info! Would be great if the temporary storage could > ultimately be made to be persistent Having persistent data on local storage will make your life very hard when the time comes around to secure and back up that important data. I think you can enjoy both worlds by using temporary local storage for I/O-intensive calculation, and then store the important final results to a central storage you can easily secure and back up. If what you want to do is pool together your local storage to get something that looks like a cheap central storage, then you are in the realm of ceph/gluster/hyper-converge. There is a performance and complexity overhead to using those technologies. (And not everything is supported by oVirt yet) -- Barak Korren bkor...@redhat.com RHEV-CI Team ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
Great..thanks all very much for insight and advice. Keep up the great work. This is a very vibrant and supportive community. On Wed, Nov 11, 2015 at 4:51 AM, Barak Korrenwrote: > On 11 November 2015 at 01:02, Liam Curtis wrote: > > Thanks for this info! Would be great if the temporary storage could > > ultimately be made to be persistent > > Having persistent data on local storage will make your life very hard > when the time comes around to secure and back up that important data. > I think you can enjoy both worlds by using temporary local storage for > I/O-intensive calculation, and then store the important final results > to a central storage you can easily secure and back up. > If what you want to do is pool together your local storage to get > something that looks like a cheap central storage, then you are in the > realm of ceph/gluster/hyper-converge. There is a performance and > complexity overhead to using those technologies. (And not everything > is supported by oVirt yet) > > -- > Barak Korren > bkor...@redhat.com > RHEV-CI Team > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
Thanks for this info! Would be great if the temporary storage could ultimately be made to be persistent ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
On 9 November 2015 at 09:18, Sandro Bonazzola <sbona...@redhat.com> wrote: > > > On Sun, Nov 8, 2015 at 9:22 AM, Barak Korren <bkor...@redhat.com> wrote: > >> >> >> On 3 November 2015 at 07:48, Liam Curtis <lcur...@datto.com> wrote: >> >>> Any chance this will change? It is a severe limitation to not be able to >>> use local storage available to a host as that is often very fast storage. >>> >>> >> It is not completely impossible to mix shared and local storage. There is >> a VDSM hook that allows you to attach some local storage to a VM, stored on >> a shared storage, for temporary use. >> We actually plan to try and use it in the oVirt CI infrastructure to >> speed up builds and other random-I/O-intensive operations. >> Anton Marchukov from the oVirt infra team could give you more details >> about that. >> >> > > Please document this somewhere in the wiki as well. > There is this: http://www.ovirt.org/VDSM-Hooks/scratchpad > > > >> >> >>> On Sun, Nov 1, 2015 at 10:22 AM, Aharon Canan <aca...@redhat.com> wrote: >>> >>>> No... >>>> >>>> when creating DC you choose shared/local (where gluster is shared) >>>> >>>> You can mix shared (gluster/iscsi/nfs etc) but not local. >>>> >>>> >>>> >>>> >>>> Regards, >>>> __ >>>> Aharon Canan >>>> >>>> -- >>>> >>>> *From: *"Liam Curtis" <lcur...@datto.com> >>>> *To: *Users@ovirt.org >>>> *Sent: *Sunday, November 1, 2015 5:17:58 PM >>>> *Subject: *[ovirt-users] Wishlist - Mix gluster and local storage in >>>> same datacenter >>>> >>>> Hello all... >>>> >>>> Would like to be able to use both local storage and gluster within same >>>> host / data center. >>>> >>>> Wondering if this is something being worked on? >>>> >>>> ___ >>>> Users mailing list >>>> Users@ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>> >>>> >>>> >>> >>> >>> -- >>> >>> *Liam Curtis* >>> Manager of Systems EngineeringDatto, Inc.(203) 529-4949 x228 >>> www.datto.com >>> >>> <http://datto.com/datto-signature/> >>> Join the conversation! [image: Facebook] >>> <http://www.facebook.com/dattoinc> [image: Twitter] >>> <https://twitter.com/datto> [image: LinkedIn] >>> <https://www.linkedin.com/company/datto-inc.> [image: Blog RSS] >>> <http://blog.datto.com/blog> [image: YouTube] >>> <http://www.youtube.com/user/DattoInc/featured> [image: Google Plus >>> Page] <https://plus.google.com/u/0/108292366419623632143/posts> >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >>> >> >> >> -- >> *Barak Korren* >> bkor...@redhat.com >> RHEV-CI Team >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com > -- *Barak Korren* bkor...@redhat.com RHEV-CI Team ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
Messed up the quote. removed it for clarity: One thing that would render this whole issue moot is being able to use local fast storage on the hypervisor hosts, ie SSD or 3D-Xpoint drives in LVM-Cache to accelerate IOPS on shared storage. The underlying stuff is already there, and it works. I've been using LVM cache for while in Centos 7. Geting this to work in oVirt would be a killer feature. Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. This email is not intended to, nor should it be taken to, constitute advice. The information provided is correct to our knowledge & belief and must not be used as a substitute for obtaining tax, regulatory, investment, legal or any other appropriate advice. "Transact" is operated by Integrated Financial Arrangements Ltd. 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300. (Registered office: as above; Registered in England and Wales under number: 3727592). Authorised and regulated by the Financial Conduct Authority (entered on the Financial Services Register; no. 190856). ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. This email is not intended to, nor should it be taken to, constitute advice. The information provided is correct to our knowledge & belief and must not be used as a substitute for obtaining tax, regulatory, investment, legal or any other appropriate advice. "Transact" is operated by Integrated Financial Arrangements Ltd. 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300. (Registered office: as above; Registered in England and Wales under number: 3727592). Authorised and regulated by the Financial Conduct Authority (entered on the Financial Services Register; no. 190856). -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. This email is not intended to, nor should it be taken to, constitute advice. The information provided is correct to our knowledge & belief and must not be used as a substitute for obtaining tax, regulatory, investment, legal or any other appropriate advice. "Transact" is operated by Integrated Financial Arrangements Ltd. 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300. (Registered office: as above; Registered in England and Wales under number: 3727592). Authorised and regulated by the Financial Conduct Authority (entered on the Financial Services Register; no. 190856). ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
There are many things that tie a VM to a host, like USB device passthrough, but that's not reason to remove all such support from oVirt, is it? In my case, I'd like to mix iSCSI and local storage, because I have a couple of systems that need higher disk I/O that I'd like to put on my shared storage. The two systems are redundant to each other, so that is taken care of at a different layer. The two systems don't however consume all the resources of the host machines (lots of CPU and RAM available). I'd like to make them nodes in my oVirt cluster, so those resources can be used for other VMs (that are on shared storage for that level of HA), but I can't do that (at least as far as I know, with oVirt 3.5). I thought that had been mentioned as a feature for 3.6, but I don't see it anywhere in the features or release notes, so I assume that functionality is still not available. One thing that would render this whole issue moot is being able to use local fast storage on the hypervisor hosts, ie SSD or 3D-Xpoint drives in LVM-Cache to accelerate IOPS on shared storage. The underlying stuff is already there, and it works. I've been using LVM cache for while in Centos 7. Geting this to work in oVirt would be a killer feature. Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. This email is not intended to, nor should it be taken to, constitute advice. The information provided is correct to our knowledge & belief and must not be used as a substitute for obtaining tax, regulatory, investment, legal or any other appropriate advice. "Transact" is operated by Integrated Financial Arrangements Ltd. 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 5300. (Registered office: as above; Registered in England and Wales under number: 3727592). Authorised and regulated by the Financial Conduct Authority (entered on the Financial Services Register; no. 190856). ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
On Sun, Nov 8, 2015 at 9:22 AM, Barak Korren <bkor...@redhat.com> wrote: > > > On 3 November 2015 at 07:48, Liam Curtis <lcur...@datto.com> wrote: > >> Any chance this will change? It is a severe limitation to not be able to >> use local storage available to a host as that is often very fast storage. >> >> > It is not completely impossible to mix shared and local storage. There is > a VDSM hook that allows you to attach some local storage to a VM, stored on > a shared storage, for temporary use. > We actually plan to try and use it in the oVirt CI infrastructure to speed > up builds and other random-I/O-intensive operations. > Anton Marchukov from the oVirt infra team could give you more details > about that. > > Please document this somewhere in the wiki as well. > > >> On Sun, Nov 1, 2015 at 10:22 AM, Aharon Canan <aca...@redhat.com> wrote: >> >>> No... >>> >>> when creating DC you choose shared/local (where gluster is shared) >>> >>> You can mix shared (gluster/iscsi/nfs etc) but not local. >>> >>> >>> >>> >>> Regards, >>> __ >>> Aharon Canan >>> >>> ------ >>> >>> *From: *"Liam Curtis" <lcur...@datto.com> >>> *To: *Users@ovirt.org >>> *Sent: *Sunday, November 1, 2015 5:17:58 PM >>> *Subject: *[ovirt-users] Wishlist - Mix gluster and local storage in >>> same datacenter >>> >>> Hello all... >>> >>> Would like to be able to use both local storage and gluster within same >>> host / data center. >>> >>> Wondering if this is something being worked on? >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >>> >>> >> >> >> -- >> >> *Liam Curtis* >> Manager of Systems EngineeringDatto, Inc.(203) 529-4949 x228 >> www.datto.com >> >> <http://datto.com/datto-signature/> >> Join the conversation! [image: Facebook] >> <http://www.facebook.com/dattoinc> [image: Twitter] >> <https://twitter.com/datto> [image: LinkedIn] >> <https://www.linkedin.com/company/datto-inc.> [image: Blog RSS] >> <http://blog.datto.com/blog> [image: YouTube] >> <http://www.youtube.com/user/DattoInc/featured> [image: Google Plus Page] >> <https://plus.google.com/u/0/108292366419623632143/posts> >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > > -- > *Barak Korren* > bkor...@redhat.com > RHEV-CI Team > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
On 3 November 2015 at 07:48, Liam Curtis <lcur...@datto.com> wrote: > Any chance this will change? It is a severe limitation to not be able to > use local storage available to a host as that is often very fast storage. > > It is not completely impossible to mix shared and local storage. There is a VDSM hook that allows you to attach some local storage to a VM, stored on a shared storage, for temporary use. We actually plan to try and use it in the oVirt CI infrastructure to speed up builds and other random-I/O-intensive operations. Anton Marchukov from the oVirt infra team could give you more details about that. > On Sun, Nov 1, 2015 at 10:22 AM, Aharon Canan <aca...@redhat.com> wrote: > >> No... >> >> when creating DC you choose shared/local (where gluster is shared) >> >> You can mix shared (gluster/iscsi/nfs etc) but not local. >> >> >> >> >> Regards, >> __ >> Aharon Canan >> >> -- >> >> *From: *"Liam Curtis" <lcur...@datto.com> >> *To: *Users@ovirt.org >> *Sent: *Sunday, November 1, 2015 5:17:58 PM >> *Subject: *[ovirt-users] Wishlist - Mix gluster and local storage in >> same datacenter >> >> Hello all... >> >> Would like to be able to use both local storage and gluster within same >> host / data center. >> >> Wondering if this is something being worked on? >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> >> > > > -- > > *Liam Curtis* > Manager of Systems EngineeringDatto, Inc.(203) 529-4949 x228 > www.datto.com > > <http://datto.com/datto-signature/> > Join the conversation! [image: Facebook] > <http://www.facebook.com/dattoinc> [image: Twitter] > <https://twitter.com/datto> [image: LinkedIn] > <https://www.linkedin.com/company/datto-inc.> [image: Blog RSS] > <http://blog.datto.com/blog> [image: YouTube] > <http://www.youtube.com/user/DattoInc/featured> [image: Google Plus Page] > <https://plus.google.com/u/0/108292366419623632143/posts> > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- *Barak Korren* bkor...@redhat.com RHEV-CI Team ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
On Tue, Nov 3, 2015 at 7:48 AM, Liam Curtis <lcur...@datto.com> wrote: > > Any chance this will change? It is a severe limitation to not be able to use > local storage available to a host as that is often very fast storage. This will couple the vm to this host, so you cannot run it to another host. If this host is down, you cannot run the vm on any other host, since your storage is gone. Don't you think this is a severe limitation as well? The current system is focused on high availability; all hosts must be able to access all storage domains in the data center, so you can run any vm on all hosts on the data center. If you don't need to migrate vms or manage shared storage, you can use virt-manager to run vms on specific hosts. Nir > > > On Sun, Nov 1, 2015 at 10:22 AM, Aharon Canan <aca...@redhat.com> wrote: >> >> No... >> >> when creating DC you choose shared/local (where gluster is shared) >> >> You can mix shared (gluster/iscsi/nfs etc) but not local. >> >> >> >> >> Regards, >> __ >> Aharon Canan >> >> >> >> From: "Liam Curtis" <lcur...@datto.com> >> To: Users@ovirt.org >> Sent: Sunday, November 1, 2015 5:17:58 PM >> Subject: [ovirt-users] Wishlist - Mix gluster and local storage in same data >>center >> >> Hello all... >> >> Would like to be able to use both local storage and gluster within same host >> / data center. >> >> Wondering if this is something being worked on? >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > > > -- > > Liam Curtis > Manager of Systems Engineering > Datto, Inc. > (203) 529-4949 x228 > www.datto.com > > > Join the conversation! > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
Once upon a time, Nir Soffersaid: > On Tue, Nov 3, 2015 at 7:48 AM, Liam Curtis wrote: > > > > Any chance this will change? It is a severe limitation to not be able to > > use local storage available to a host as that is often very fast storage. > > This will couple the vm to this host, so you cannot run it to another > host. If this host > is down, you cannot run the vm on any other host, since your storage is gone. > > Don't you think this is a severe limitation as well? There are many things that tie a VM to a host, like USB device passthrough, but that's not reason to remove all such support from oVirt, is it? In my case, I'd like to mix iSCSI and local storage, because I have a couple of systems that need higher disk I/O that I'd like to put on my shared storage. The two systems are redundant to each other, so that is taken care of at a different layer. The two systems don't however consume all the resources of the host machines (lots of CPU and RAM available). I'd like to make them nodes in my oVirt cluster, so those resources can be used for other VMs (that are on shared storage for that level of HA), but I can't do that (at least as far as I know, with oVirt 3.5). I thought that had been mentioned as a feature for 3.6, but I don't see it anywhere in the features or release notes, so I assume that functionality is still not available. -- Chris Adams ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
Any chance this will change? It is a severe limitation to not be able to use local storage available to a host as that is often very fast storage. On Sun, Nov 1, 2015 at 10:22 AM, Aharon Canan <aca...@redhat.com> wrote: > No... > > when creating DC you choose shared/local (where gluster is shared) > > You can mix shared (gluster/iscsi/nfs etc) but not local. > > > > > Regards, > __ > Aharon Canan > > -- > > *From: *"Liam Curtis" <lcur...@datto.com> > *To: *Users@ovirt.org > *Sent: *Sunday, November 1, 2015 5:17:58 PM > *Subject: *[ovirt-users] Wishlist - Mix gluster and local storage in same > datacenter > > Hello all... > > Would like to be able to use both local storage and gluster within same > host / data center. > > Wondering if this is something being worked on? > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > -- *Liam Curtis* Manager of Systems EngineeringDatto, Inc.(203) 529-4949 x228 www.datto.com <http://datto.com/datto-signature/> Join the conversation! [image: Facebook] <http://www.facebook.com/dattoinc> [image: Twitter] <https://twitter.com/datto> [image: LinkedIn] <https://www.linkedin.com/company/datto-inc.> [image: Blog RSS] <http://blog.datto.com/blog> [image: YouTube] <http://www.youtube.com/user/DattoInc/featured> [image: Google Plus Page] <https://plus.google.com/u/0/108292366419623632143/posts> ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Wishlist - Mix gluster and local storage in same data center
Hello all... Would like to be able to use both local storage and gluster within same host / data center. Wondering if this is something being worked on? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Wishlist - Mix gluster and local storage in same data center
No... when creating DC you choose shared/local (where gluster is shared) You can mix shared (gluster/iscsi/nfs etc) but not local. Regards, __ Aharon Canan - Original Message - > From: "Liam Curtis" <lcur...@datto.com> > To: Users@ovirt.org > Sent: Sunday, November 1, 2015 5:17:58 PM > Subject: [ovirt-users] Wishlist - Mix gluster and local storage in same data > center > Hello all... > Would like to be able to use both local storage and gluster within same host > / data center. > Wondering if this is something being worked on? > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users