On Thu, Sep 24, 2015 at 2:06 AM, Ilya Dryomov <[email protected]> wrote: > On Thu, Sep 24, 2015 at 7:05 AM, Robert LeBlanc <[email protected]> wrote: >> -----BEGIN PGP SIGNED MESSAGE----- >> Hash: SHA256 >> >> If you use RADOS gateway, RBD or CephFS, then you don't need to worry >> about striping. If you write your own application that uses librados, >> then you have to worry about it. I understand that there is a >> radosstriper library that should help with that. There is also a limit >> to the size of an object that can be stored. I think I've seen the >> number of 100GB thrown around. > > Just for the sake of archives, it's 90M by default.
Yeah, despite being *able* to create objects larger than this, you definitely don't want to create a 100GB object on any storage devices existing today. I've no idea what the (arbitrary) actual limit is (if we have one), but you want to have a lot of objects of each size and you want them to not be an appreciable fraction of a single storage device. The Hadoop bindings default to 64MB and that seems to be fine but I wouldn't go past 256MB or something, and then only if you have a really good reason... -Greg _______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
