If you watch `ceph -w` while stopping the OSD, do you see 2014-12-02 11:45:17.715629 mon.0 [INF] osd.X marked itself down
? On Tue, Dec 2, 2014 at 11:06 AM, Christoph Adomeit < [email protected]> wrote: > Thanks Craig, > > but this is what I am doing. > > After setting "ceph osd set noout" I do a "service ceph stop osd.51" > and as soon as I do this I get growing numbers (200) of slow requests, > although there is not a big load on my cluster. > > Christoph > > On Tue, Dec 02, 2014 at 10:40:13AM -0800, Craig Lewis wrote: > > I've found that it helps to shut down the osds before shutting down the > > host. Especially if the node is also a monitor. It seems that some OSD > > shutdown messages get lost while monitors are holding elections. > > > > On Tue, Dec 2, 2014 at 10:10 AM, Christoph Adomeit < > > [email protected]> wrote: > > > > > Hi there, > > > > > > I have a giant cluster with 60 OSDs on 6 OSD Hosts. > > > > > > Now I want to do maintenance on one of the OSD Hosts. > > > > > > The documented Procedure is to "ceph osd set noout" and then shutdown > > > the OSD Node for maintenance. > > > > > > However, as soon as I even shut down 1 OSD I get around 200 slow > requests > > > and the number of slow requests is growing for minutes. > > > > > > The test was done at night with low IOPS and I was expecting the > cluster > > > to handle this condition much better. > > > > > > Is there some way of a more graceful shutdown of OSDs so that I can > prevent > > > those slow requests ? I suppose it takes some time until monitor gets > > > notified that an OSD was shutdown. > > > > > > Thanks > > > Christoph > > > > > > > > > > > > _______________________________________________ > > > ceph-users mailing list > > > [email protected] > > > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com > > > > >
_______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
