Re: [ceph-users] best Linux distro for Ceph

2015-06-18 Thread Chris Jones
Hi Shane,

We (Bloomberg) have many large clusters and we currently use Ubuntu. We
have just recently upgraded to Trusty (14.04). Our new super object store
that we're building out is using Trusty but we may switch to RHEL because
of other departments joining in - final decision has not been made.
However, our OpenStack clusters will stay Ubuntu.

Thanks,
Chris

On Wed, Jun 17, 2015 at 2:06 PM, Shane Gibson shane_gib...@symantec.com
wrote:


 Ok - I know this post has the potential to spread to unsavory corners of
 discussion about the best linux distro ... blah blah blah ... please,
 don't let it go there ... !

 I'm seeking some input from people that have been running larger Ceph
 clusters ... on the order of 100s of physical servers with thousands of
 OSDs in them.  Our primary use case is Object via Swift API integration and
 adding Block store capability for both OpenStack/KVM backing VMs, as well
 as general use for various block store scenarios.

 We'd *like* to look at CephFS, and I'm heartened to see a kernel module
 (over the FUSE based), and a growing use base around it, and hoping
 production ready will soon be stamped on CephFS ...

 We currently deploy Ubuntu (primarily Trusty - 14.04), and CentOS 7.1.
 Currently we've been testing our Ceph clusters on both, but our preference
 as an organization is CentOS 7.1.1503 (currently).

 However - I see a lot of noise in the list about needing to track the more
 modern kernel versions as opposed to the already dated 3.10.x that CentOS
 7.1 deploys.  Yes, I know RH and community backport a lot of the newer
 kernel features to their kernel version ... but ... not everything gets
 backported.

 Can someone out there with real world, larger scale Ceph cluster
 operational experience provide a guideline on the Linux Distro they
 deploy/use, and works well with Ceph, and is more inline with keeping up
 with modern kernel versions ... without crossing the line in to the
 bleeding and painful edge versions ... ?

 Thank you ...

 ~~shane



 ___
 ceph-users mailing list
 ceph-users@lists.ceph.com
 http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com




-- 
Best Regards,
Chris Jones

http://www.cloudm2.com

cjo...@cloudm2.com
(p) 770.655.0770

This message is intended exclusively for the individual or entity to which
it is addressed.  This communication may contain information that is
proprietary, privileged or confidential or otherwise legally exempt from
disclosure.  If you are not the named addressee, you are not authorized to
read, print, retain, copy or disseminate this message or any part of it.
If you have received this message in error, please notify the sender
immediately by e-mail and delete all copies of the message.
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com


[ceph-users] best Linux distro for Ceph

2015-06-17 Thread Shane Gibson

Ok - I know this post has the potential to spread to unsavory corners of 
discussion about the best linux distro ... blah blah blah ... please, don't 
let it go there ... !

I'm seeking some input from people that have been running larger Ceph clusters 
... on the order of 100s of physical servers with thousands of OSDs in them.  
Our primary use case is Object via Swift API integration and adding Block store 
capability for both OpenStack/KVM backing VMs, as well as general use for 
various block store scenarios.

We'd *like* to look at CephFS, and I'm heartened to see a kernel module (over 
the FUSE based), and a growing use base around it, and hoping production 
ready will soon be stamped on CephFS ...

We currently deploy Ubuntu (primarily Trusty - 14.04), and CentOS 7.1.   
Currently we've been testing our Ceph clusters on both, but our preference as 
an organization is CentOS 7.1.1503 (currently).

However - I see a lot of noise in the list about needing to track the more 
modern kernel versions as opposed to the already dated 3.10.x that CentOS 7.1 
deploys.  Yes, I know RH and community backport a lot of the newer kernel 
features to their kernel version ... but ... not everything gets backported.

Can someone out there with real world, larger scale Ceph cluster operational 
experience provide a guideline on the Linux Distro they deploy/use, and works 
well with Ceph, and is more inline with keeping up with modern kernel 
versions ... without crossing the line in to the bleeding and painful edge 
versions ... ?

Thank you ...

~~shane


___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com