Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-14 Thread Gregory Farnum
On Mon, Jan 12, 2015 at 8:25 AM, Dan Van Der Ster daniel.vanders...@cern.ch wrote: On 12 Jan 2015, at 17:08, Sage Weil s...@newdream.net wrote: On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Moving forward, I think it would be good for Ceph to a least document this behaviour, but better would

Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-14 Thread Sage Weil
On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Sure, I?ll try to prepare a patch which warns but isn?t too annoying. MongoDB already solved the heuristic: https://github.com/mongodb/mongo/blob/master/src/mongo/db/startup_warnings_mongod.cpp It?s licensed as AGPLv3 -- do you already know if

Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-14 Thread Loic Dachary
On 13/01/2015 01:10, Gregory Farnum wrote: On Mon, Jan 12, 2015 at 8:25 AM, Dan Van Der Ster daniel.vanders...@cern.ch wrote: On 12 Jan 2015, at 17:08, Sage Weil s...@newdream.net wrote: On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Moving forward, I think it would be good for Ceph to a

Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-14 Thread Loic Dachary
Hi Dan, On 12/01/2015 17:25, Dan Van Der Ster wrote: On 12 Jan 2015, at 17:08, Sage Weil s...@newdream.net mailto:s...@newdream.net wrote: On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Moving forward, I think it would be good for Ceph to a least document this behaviour, but better would

[ceph-users] NUMA zone_reclaim_mode

2015-01-12 Thread Dan Van Der Ster
(apologies if you receive this more than once... apparently I cannot reply to a 1 year old message on the list). Dear all, I'd like to +10 this old proposal of Kyle's. Let me explain why... A couple months ago we started testing a new use-case with radosgw -- this new user is writing millions

Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-12 Thread Sage Weil
On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Moving forward, I think it would be good for Ceph to a least document this behaviour, but better would be to also detect when zone_reclaim_mode != 0 and warn the admin (like MongoDB does). This line from the commit which disables it in the kernel is

Re: [ceph-users] NUMA zone_reclaim_mode

2015-01-12 Thread Dan Van Der Ster
On 12 Jan 2015, at 17:08, Sage Weil s...@newdream.netmailto:s...@newdream.net wrote: On Mon, 12 Jan 2015, Dan Van Der Ster wrote: Moving forward, I think it would be good for Ceph to a least document this behaviour, but better would be to also detect when zone_reclaim_mode != 0 and warn the