Re: [ceph-users] MDSs report damaged metadata - "return_code": -116
Hi Paul, thanks for the hint. I did a recursive scrub from "/". The log says there where some inodes with bad backtraces repaired. But the error remains. May this have something to do with a deleted file? Or a file within a snapshot? The path told by # ceph tell mds.mds3 damage ls 2019-08-19 13:43:04.608 7f563f7f6700 0 client.894552 ms_handle_reset on v2:192.168.16.23:6800/176704036 2019-08-19 13:43:04.624 7f56407f8700 0 client.894558 ms_handle_reset on v2:192.168.16.23:6800/176704036 [ { "damage_type": "backtrace", "id": 3760765989, "ino": 1099518115802, "path": "~mds0/stray7/15161f7/dovecot.index.backup" } ] starts a bit strange to me. Are the snapshots also repaired with a recursive repair operation? Thanks Lars Mon, 19 Aug 2019 13:30:53 +0200 Paul Emmerich ==> Lars Täuber : > Hi, > > that error just says that the path is wrong. I unfortunately don't > know the correct way to instruct it to scrub a stray path off the top > of my head; you can always run a recursive scrub on / to go over > everything, though > > > Paul > -- Informationstechnologie Berlin-Brandenburgische Akademie der Wissenschaften Jägerstraße 22-23 10117 Berlin Tel.: +49 30 20370-352 http://www.bbaw.de ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] MDSs report damaged metadata - "return_code": -116
Hi, that error just says that the path is wrong. I unfortunately don't know the correct way to instruct it to scrub a stray path off the top of my head; you can always run a recursive scrub on / to go over everything, though Paul -- Paul Emmerich Looking for help with your Ceph cluster? Contact us at https://croit.io croit GmbH Freseniusstr. 31h 81247 München www.croit.io Tel: +49 89 1896585 90 On Mon, Aug 19, 2019 at 12:55 PM Lars Täuber wrote: > > Hi all! > > Where can I look up what the error number means? > Or did I something wrong in my command line? > > Thanks in advance, > Lars > > Fri, 16 Aug 2019 13:31:38 +0200 > Lars Täuber ==> Paul Emmerich : > > Hi Paul, > > > > thank you for your help. But I get the following error: > > > > # ceph tell mds.mds3 scrub start > > "~mds0/stray7/15161f7/dovecot.index.backup" repair > > 2019-08-16 13:29:40.208 7f7e927fc700 0 client.881878 ms_handle_reset on > > v2:192.168.16.23:6800/176704036 > > 2019-08-16 13:29:40.240 7f7e937fe700 0 client.867786 ms_handle_reset on > > v2:192.168.16.23:6800/176704036 > > { > > "return_code": -116 > > } > > > > > > > > Lars > > > > > > Fri, 16 Aug 2019 13:17:08 +0200 > > Paul Emmerich ==> Lars Täuber : > > > Hi, > > > > > > damage_type backtrace is rather harmless and can indeed be repaired > > > with the repair command, but it's called scrub_path. > > > Also you need to pass the name and not the rank of the MDS as id, it > > > should be > > > > > > # (on the server where the MDS is actually running) > > > ceph daemon mds.mds3 scrub_path ... > > > > > > But you should also be able to use ceph tell since nautilus which is a > > > little bit easier because it can be run from any node: > > > > > > ceph tell mds.mds3 scrub start 'PATH' repair > > > > > > > > > Paul > > > > ___ > ceph-users mailing list > ceph-users@lists.ceph.com > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] MDSs report damaged metadata - "return_code": -116
Hi all! Where can I look up what the error number means? Or did I something wrong in my command line? Thanks in advance, Lars Fri, 16 Aug 2019 13:31:38 +0200 Lars Täuber ==> Paul Emmerich : > Hi Paul, > > thank you for your help. But I get the following error: > > # ceph tell mds.mds3 scrub start > "~mds0/stray7/15161f7/dovecot.index.backup" repair > 2019-08-16 13:29:40.208 7f7e927fc700 0 client.881878 ms_handle_reset on > v2:192.168.16.23:6800/176704036 > 2019-08-16 13:29:40.240 7f7e937fe700 0 client.867786 ms_handle_reset on > v2:192.168.16.23:6800/176704036 > { > "return_code": -116 > } > > > > Lars > > > Fri, 16 Aug 2019 13:17:08 +0200 > Paul Emmerich ==> Lars Täuber : > > Hi, > > > > damage_type backtrace is rather harmless and can indeed be repaired > > with the repair command, but it's called scrub_path. > > Also you need to pass the name and not the rank of the MDS as id, it should > > be > > > > # (on the server where the MDS is actually running) > > ceph daemon mds.mds3 scrub_path ... > > > > But you should also be able to use ceph tell since nautilus which is a > > little bit easier because it can be run from any node: > > > > ceph tell mds.mds3 scrub start 'PATH' repair > > > > > > Paul > > ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com