Re: [ceph-users] OSDs going down/up at random

2018-01-10 Thread Brad Hubbard
On Wed, Jan 10, 2018 at 8:32 PM, Mike O'Connor wrote: > On 10/01/2018 4:48 PM, Mike O'Connor wrote: >> On 10/01/2018 4:24 PM, Sam Huracan wrote: >>> Hi Mike, >>> >>> Could you show system log at moment osd down and up? > So now I know its a crash, what my next step. As soon as I

Re: [ceph-users] OSDs going down/up at random

2018-01-10 Thread Mike O'Connor
On 10/01/2018 4:48 PM, Mike O'Connor wrote: > On 10/01/2018 4:24 PM, Sam Huracan wrote: >> Hi Mike, >> >> Could you show system log at moment osd down and up? So now I know its a crash, what my next step. As soon as I put the system under write load, OSDs start crashing. Mike

Re: [ceph-users] OSDs going down/up at random

2018-01-09 Thread Mike O'Connor
On 10/01/2018 4:24 PM, Sam Huracan wrote: > Hi Mike, > > Could you show system log at moment osd down and up? Ok so I have no idea how I missed this each time I looked but the syslog does show a problem. I've created the dump file mentioned in the log its 29M compressed so any one who wants it

Re: [ceph-users] OSDs going down/up at random

2018-01-09 Thread Sam Huracan
Hi Mike, Could you show system log at moment osd down and up? On Jan 10, 2018 12:52, "Mike O'Connor" wrote: > On 10/01/2018 3:52 PM, Linh Vu wrote: > > > > Have you checked your firewall? > > > There are no ip tables rules at this time but connection tracking is > enable. I

Re: [ceph-users] OSDs going down/up at random

2018-01-09 Thread Mike O'Connor
On 10/01/2018 3:52 PM, Linh Vu wrote: > > Have you checked your firewall? > There are no ip tables rules at this time but connection tracking is enable. I would expect errors about running out of table space if that was an issue. Thanks Mike ___

Re: [ceph-users] OSDs going down/up at random

2018-01-09 Thread Linh Vu
Have you checked your firewall? From: ceph-users <ceph-users-boun...@lists.ceph.com> on behalf of Mike O'Connor <m...@oeg.com.au> Sent: Wednesday, 10 January 2018 3:40:30 PM To: ceph-users@lists.ceph.com Subject: [ceph-users] OSDs going down/up at ra

[ceph-users] OSDs going down/up at random

2018-01-09 Thread Mike O'Connor
Hi All I have a ceph host (12.2.2) which has 14 OSDs which seem to go down the up, what should I look at to try to identify the issue ? The system has three LSI SAS9201-8i cards which is then connected 14 drives at this time. (option of 24 drives) I have three of these chassis but only one is