Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-10 Thread Philippe Van Hecke
Weil wrote: > On Mon, 4 Feb 2019, Philippe Van Hecke wrote: > > Hi Sage, First of all tanks for your help > > > > Please find here > > https://filesender.belnet.be/?s=download=dea0edda-5b6a-4284-9ea1-c1fdf88b65e9 Something caused the version number on this PG to rese

[ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
Hello, I'am working for BELNET the Belgian Natioanal Research Network We currently a manage a luminous ceph cluster on ubuntu 16.04 with 144 hdd osd spread across two data centers with 6 osd nodes on each datacenter. Osd(s) are 4 TB sata disk. Last week we had a network incident and the link

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
From: Sage Weil Sent: 03 February 2019 18:25 To: Philippe Van Hecke Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Luminous cluster in very bad state need some assistance. On Sun, 3 Feb 2019, Philippe Van Hecke wrote: > Hello, > I'am w

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
ere https://filesender.belnet.be/?s=download=e2b1fdbc-0739-423f-9d97-0bd258843a33 file ceph-objectstore-tool-export-remove.txt Kr Philippe. From: Sage Weil Sent: 04 February 2019 06:59 To: Philippe Van Hecke Cc: ceph-users@lists.ceph.com; Belnet Servi

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
to forget that it inform me about it immediately :-) Kr Philippe. On Mon, 4 Feb 2019, Sage Weil wrote: > On Mon, 4 Feb 2019, Philippe Van Hecke wrote: > > Hi Sage, First of all tanks for your help > > > > Please find here > > https://filesender.belnet.be/?s=download

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
-01 12:48:41.343144 66131'19810044 2019-01-30 11:44:36.006505 cp done. So i can make ceph-objecstore-tool --op remove command ? From: Sage Weil Sent: 04 February 2019 07:26 To: Philippe Van Hecke Cc: ceph-users@lists.ceph.com; Belnet Services Subject

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
pgs 11.182_head removing 11.182 Remove successful So now i suppose i restart the osd and see From: Sage Weil Sent: 04 February 2019 07:37 To: Philippe Van Hecke Cc: ceph-users@lists.ceph.com; Belnet Services Subject: Re: [ceph-users] Luminous cluster in very

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-03 Thread Philippe Van Hecke
. From: Philippe Van Hecke Sent: 04 February 2019 07:42 To: Sage Weil Cc: ceph-users@lists.ceph.com; Belnet Services Subject: Re: [ceph-users] Luminous cluster in very bad state need some assistance. oot@ls-node-5-lcl:~# ceph-objectstore-tool --data-path /var/lib/ceph

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-04 Thread Philippe Van Hecke
Hi, Seem that the recovery process stop and get back to the same situation as before. I hope that the log can provide more info. Any way thanks already for your assistance. Kr Philippe. From: Philippe Van Hecke Sent: 04 February 2019 07:53 To: Sage

Re: [ceph-users] Luminous cluster in very bad state need some assistance.

2019-02-04 Thread Philippe Van Hecke
"osd": "51", "status": "osd is down" }, { "osd": "63", "status": "osd is down" }, {