Re: [ceph-users] Does anyone know why cephfs do not support EC pool?

2016-10-18 Thread Erick Perez - Quadrian Enterprises 
On Tue, Oct 18, 2016 at 3:46 AM, Lars Marowsky-Bree  wrote:

> On 2016-10-18T00:06:57, Erick Perez - Quadrian Enterprises <
> epe...@quadrianweb.com> wrote:
>
> > Is EC in the roadmap for CEPH? Cant seem to find it. My question is
> because
> > "all others" (Nutanix, Hypergrid) do EC storage for VMs as the default
> way
> > of storage. It seems EC in ceph (as of Sept 2016) is considered by many
> > "experimental" unless is used for cold data.
>
> Right now (Jewel) you have to "cheat" and put a cache tier in front of
> an EC pool if you want to use it for block or direct data access (like
> CephFS). That actually works quite well, and you can then also use
> much faster storage media in front of your dense EC pool.
>
> The downside is you have to understand how to set some of the cache
> tiering tunables and be able to size it appropriately, and understand
> the impact of cache tiering on your cluster performance (e.g., the
> overhead of the additional traffic between the tiers). Yet, it works
> well.
>
> Partial overwrites for EC pools directly is on the roadmap for
> Kraken/Luminous, probably leveraging some of BlueStore's new features.
> If I understood Sage correctly, he considers that a release criteria for
> Luminous.
>
> That'd allow us to directly access EC pools w/o the need for cache
> tiering.
>
>
>
> Regards,
> Lars
>
> --
> SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB
> 21284 (AG Nürnberg)
> "Experience is the name everyone gives to their mistakes." -- Oscar Wilde
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


Thanks Lars, I was reading about bluestore last night. I will wait for a
Kraken release to test as much EC functionality as possible at least from a
non-programmer point of use. Point and click tunables for EC is something
that will for sure be needed at least for some of us that do not run a
gazillion VMs and Petas of object storage.

Hopefully if i develop more know-how in EC I can help with testing
predefined tunables that can be available for smaller installations to use,
like the ones i use (always in Hewlett packard hardware)  at least in my
country we do not run white-box hardware outside a lab.
I guess my first goal will be to learn how to obtain proper meaningful
metrics when testing VM loads and object loads.


Thanks to all for the comments,

-- 

-
Erick Perez
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Does anyone know why cephfs do not support EC pool?

2016-10-18 Thread Lars Marowsky-Bree 
On 2016-10-18T00:06:57, Erick Perez - Quadrian Enterprises 
 wrote:

> Is EC in the roadmap for CEPH? Cant seem to find it. My question is because
> "all others" (Nutanix, Hypergrid) do EC storage for VMs as the default way
> of storage. It seems EC in ceph (as of Sept 2016) is considered by many
> "experimental" unless is used for cold data.

Right now (Jewel) you have to "cheat" and put a cache tier in front of
an EC pool if you want to use it for block or direct data access (like
CephFS). That actually works quite well, and you can then also use
much faster storage media in front of your dense EC pool.

The downside is you have to understand how to set some of the cache
tiering tunables and be able to size it appropriately, and understand
the impact of cache tiering on your cluster performance (e.g., the
overhead of the additional traffic between the tiers). Yet, it works
well.

Partial overwrites for EC pools directly is on the roadmap for
Kraken/Luminous, probably leveraging some of BlueStore's new features.
If I understood Sage correctly, he considers that a release criteria for
Luminous.

That'd allow us to directly access EC pools w/o the need for cache
tiering.



Regards,
Lars

-- 
SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 
(AG Nürnberg)
"Experience is the name everyone gives to their mistakes." -- Oscar Wilde

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Does anyone know why cephfs do not support EC pool?

2016-10-17 Thread huang jun 
you can look into this:
https://github.com/ceph/ceph/pull/10334
https://github.com/ceph/ceph/compare/master...athanatos:wip-ec-cache
the community have do a lot works related to ec for rbd and fs interface.

2016-10-18 13:06 GMT+08:00 Erick Perez - Quadrian Enterprises <
epe...@quadrianweb.com>:

> On Mon, Oct 17, 2016 at 9:23 PM, huang jun  wrote:
>
>> ec only support writefull and append operations, but not partial write,
>> your can try it by doing random writes, see if the osd crash or not.
>>
>> 2016-10-18 10:10 GMT+08:00 Liuxuan :
>> > Hello:
>> >
>> >
>> >
>> >   I have create cephfs which data pool type is EC and metadata is
>> replica,
>> > The cluster reported errors from MDSMonitor::_check_pool function.
>> >
>> >  But when I ignore to check the pool type, the cephfs can write and read
>> > datas. Does anyone know why cephfs do not support EC pool?
>> >
>> >
>> >
>> > 
>> >
>> > liuxuan
>> >
>> >
>> >
>> > 
>> -
>> > 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
>> > 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
>> > 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
>> > 邮件！
>> > This e-mail and its attachments contain confidential information from
>> H3C,
>> > which is
>> > intended only for the person or entity whose address is listed above.
>> Any
>> > use of the
>> > information contained herein in any way (including, but not limited to,
>> > total or partial
>> > disclosure, reproduction, or dissemination) by persons other than the
>> > intended
>> > recipient(s) is prohibited. If you receive this e-mail in error, please
>> > notify the sender
>> > by phone or email immediately and delete it!
>> >
>> > ___
>> > ceph-users mailing list
>> > ceph-users@lists.ceph.com
>> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>> >
>>
>>
>>
>> --
>> Thank you!
>> HuangJun
>> ___
>> ceph-users mailing list
>> ceph-users@lists.ceph.com
>> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>>
>
>
> Is EC in the roadmap for CEPH? Cant seem to find it. My question is
> because "all others" (Nutanix, Hypergrid) do EC storage for VMs as the
> default way of storage. It seems EC in ceph (as of Sept 2016) is considered
> by many "experimental" unless is used for cold data.
> --
>
> -
> Erick Perez
> Soluciones Tacticas Pasivas/Activas de Inteligencia y Analitica de Datos
> para Gobiernos
> Quadrian Enterprises S.A. - Panama, Republica de Panama
> Skype chat: eaperezh
> WhatsApp IM: +507-6675-5083
> POBOX 0819-12679, Panama
> Tel. (507) 391.8174 / (507) 391.8175
>



-- 
Thank you!
HuangJun
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Does anyone know why cephfs do not support EC pool?

2016-10-17 Thread Erick Perez - Quadrian Enterprises 
On Mon, Oct 17, 2016 at 9:23 PM, huang jun  wrote:

> ec only support writefull and append operations, but not partial write,
> your can try it by doing random writes, see if the osd crash or not.
>
> 2016-10-18 10:10 GMT+08:00 Liuxuan :
> > Hello:
> >
> >
> >
> >   I have create cephfs which data pool type is EC and metadata is
> replica,
> > The cluster reported errors from MDSMonitor::_check_pool function.
> >
> >  But when I ignore to check the pool type, the cephfs can write and read
> > datas. Does anyone know why cephfs do not support EC pool?
> >
> >
> >
> > 
> >
> > liuxuan
> >
> >
> >
> > 
> -
> > 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
> > 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
> > 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
> > 邮件！
> > This e-mail and its attachments contain confidential information from
> H3C,
> > which is
> > intended only for the person or entity whose address is listed above. Any
> > use of the
> > information contained herein in any way (including, but not limited to,
> > total or partial
> > disclosure, reproduction, or dissemination) by persons other than the
> > intended
> > recipient(s) is prohibited. If you receive this e-mail in error, please
> > notify the sender
> > by phone or email immediately and delete it!
> >
> > ___
> > ceph-users mailing list
> > ceph-users@lists.ceph.com
> > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
> >
>
>
>
> --
> Thank you!
> HuangJun
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>


Is EC in the roadmap for CEPH? Cant seem to find it. My question is because
"all others" (Nutanix, Hypergrid) do EC storage for VMs as the default way
of storage. It seems EC in ceph (as of Sept 2016) is considered by many
"experimental" unless is used for cold data.
-- 

-
Erick Perez
Soluciones Tacticas Pasivas/Activas de Inteligencia y Analitica de Datos
para Gobiernos
Quadrian Enterprises S.A. - Panama, Republica de Panama
Skype chat: eaperezh
WhatsApp IM: +507-6675-5083
POBOX 0819-12679, Panama
Tel. (507) 391.8174 / (507) 391.8175
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Does anyone know why cephfs do not support EC pool?

2016-10-17 Thread huang jun 
ec only support writefull and append operations, but not partial write,
your can try it by doing random writes, see if the osd crash or not.

2016-10-18 10:10 GMT+08:00 Liuxuan :
> Hello:
>
>
>
>   I have create cephfs which data pool type is EC and metadata is replica,
> The cluster reported errors from MDSMonitor::_check_pool function.
>
>  But when I ignore to check the pool type, the cephfs can write and read
> datas. Does anyone know why cephfs do not support EC pool?
>
>
>
> 
>
> liuxuan
>
>
>
> -
> 本邮件及其附件含有杭州华三通信技术有限公司的保密信息，仅限于发送给上面地址中列出
> 的个人或群组。禁止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、
> 或散发）本邮件中的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本
> 邮件！
> This e-mail and its attachments contain confidential information from H3C,
> which is
> intended only for the person or entity whose address is listed above. Any
> use of the
> information contained herein in any way (including, but not limited to,
> total or partial
> disclosure, reproduction, or dissemination) by persons other than the
> intended
> recipient(s) is prohibited. If you receive this e-mail in error, please
> notify the sender
> by phone or email immediately and delete it!
>
> ___
> ceph-users mailing list
> ceph-users@lists.ceph.com
> http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
>



-- 
Thank you!
HuangJun
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com