Re: [ceph-users] HEALTH_WARN 1 MDSs report slow metadata IOs

2019-07-17 Thread Dietmar Rieder
Hi, thanks for the hint!! This did it. I indeed found stuck requests using "ceph daemon mds.xxx objecter_requests". I then restarted the osds involved in those requests one by one and now the problems are gone and the status is back to HEALTH_OK. Thanks again Dietmar On 7/17/19 9:08 AM,

Re: [ceph-users] HEALTH_WARN 1 MDSs report slow metadata IOs

2019-07-17 Thread Yan, Zheng
Check if there is any hang request in 'ceph daemon mds.xxx objecter_requests' On Tue, Jul 16, 2019 at 11:51 PM Dietmar Rieder wrote: > > On 7/16/19 4:11 PM, Dietmar Rieder wrote: > > Hi, > > > > We are running ceph version 14.1.2 with cephfs only. > > > > I just noticed that one of our pgs had

Re: [ceph-users] HEALTH_WARN 1 MDSs report slow metadata IOs

2019-07-17 Thread Dietmar Rieder
On 7/16/19 5:34 PM, Dietmar Rieder wrote: > On 7/16/19 4:11 PM, Dietmar Rieder wrote: >> Hi, >> >> We are running ceph version 14.1.2 with cephfs only. >> >> I just noticed that one of our pgs had scrub errors which I could repair >> >> # ceph health detail >> HEALTH_ERR 1 MDSs report slow

Re: [ceph-users] HEALTH_WARN 1 MDSs report slow metadata IOs

2019-07-16 Thread Dietmar Rieder
On 7/16/19 4:11 PM, Dietmar Rieder wrote: > Hi, > > We are running ceph version 14.1.2 with cephfs only. > > I just noticed that one of our pgs had scrub errors which I could repair > > # ceph health detail > HEALTH_ERR 1 MDSs report slow metadata IOs; 1 MDSs report slow requests; > 1 scrub

[ceph-users] HEALTH_WARN 1 MDSs report slow metadata IOs

2019-07-16 Thread Dietmar Rieder
Hi, We are running ceph version 14.1.2 with cephfs only. I just noticed that one of our pgs had scrub errors which I could repair # ceph health detail HEALTH_ERR 1 MDSs report slow metadata IOs; 1 MDSs report slow requests; 1 scrub errors; Possible data damage: 1 pg inconsistent