omputing
Naval Postgraduate School
Monterey, California
voice: 831-656-6238
From: Lincoln Bryant [mailto:linco...@uchicago.edu]
Sent: Thursday, April 28, 2016 12:56 PM
To: Andrus, Brian Contractor
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] Troubleshoot blocked OSDs
...@uchicago.edu]
Sent: Thursday, April 28, 2016 12:56 PM
To: Andrus, Brian Contractor
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] Troubleshoot blocked OSDs
OK, a few more questions.
What does the load look like on the OSDs with ‘iostat’ during the rsync?
What version of Ceph? Are you
ril 28, 2016 12:31 PM
> To: Andrus, Brian Contractor
> Cc: ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
> Subject: Re: [ceph-users] Troubleshoot blocked OSDs
>
> Hi Brian,
>
> The first thing you can do is “ceph health detail”, which should give you
&g
Computing
Naval Postgraduate School
Monterey, California
voice: 831-656-6238
From: Lincoln Bryant [mailto:linco...@uchicago.edu]
Sent: Thursday, April 28, 2016 12:31 PM
To: Andrus, Brian Contractor
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] Troubleshoot blocked OSDs
Hi Brian
Hi Brian,
The first thing you can do is “ceph health detail”, which should give you some
more information about which OSD(s) have blocked requests.
If it’s isolated to one OSD in particular, perhaps use iostat to check
utilization and/or smartctl to check health.
—Lincoln
> On Apr 28, 2016,
All,
I have a small ceph cluster with 4 OSDs and 3 MONs on 4 systems.
I was rsyncing about 50TB of files and things get very slow. To the point I
stopped the rsync, but even with everything stopped, I see:
health HEALTH_WARN
80 requests are blocked > 32 sec
The number was as high
