On Thu, Jun 21, 2018 at 5:43 PM Hennen, Christian <[email protected]> wrote: > > Dear Community, > > > > here at ZIMK at the University of Trier we operate a Ceph Luminous Cluster as > filer for a HPC environment via CephFS (Bluestore backend). During setup last > year we made the mistake of not configuring the RAID as JBOD, so initially > the 3 nodes only housed 1 OSD each. Currently, we are in the process of > remediating this. After a loss of metadata due to resetting the journal > (journal entries were not being flushed fast enough), we managed to bring the > cluster back up and started adding 2 additional nodes. The hardware is a > little bit older than the first 3 nodes. We configured the drives on these > individually (RAID-0 on each disk since there is no pass-through mode on the > controller) and after some rebalancing and re-weight, the first of the > original nodes is now empty and ready to be re-installed. > > > > However, due to the aforementioned metadata loss, we are currently getting > warnings about metadata damage. > > damage ls shows, that only one folder is affected. As we don’t need this > folder, we’d like to delete it and the associated metadata and other > informations if possible. Taking the cluster offline for a data-scan right > now would be a little bit difficult, so any other suggestions would be > appreciated. > > > > Cluster health details are available here: > https://gitlab.uni-trier.de/snippets/65 > >
Try following commands mkdir /damaged_dirs setfattr -n ceph.dir.pin -v 0 /damamged_dirs mv /clients/installserver/repos/ubuntu/mirror/mirror.uni-trier.de/ubuntu/pool/universe/g/gerritlib /damaged_dirs mv /clients/installserver/repos/ubuntu/mirror/mirror.uni-trier.de/ubuntu/pool/universe/g/gst-fluendo-mp3 /damaged_dirs ceph daemon mds.<rank 0> journal flush ceph daemon mds.<rank 1> journal flush ceph daemon mds.<rank 0> scrub_path /damaged_dirs force recursive repair Now you should be able to rmdir directories in /dmamged_dirs/ Regards Yan, Zheng > > Regards > > Christian Hennen > > > > Project Manager Infrastructural Services > > Zentrum für Informations-, Medien- > > und Kommunikationstechnologie (ZIMK) > > Universität Trier > > 54286 Trier > > > > Tel.: +49 651 201 3488 > > Fax: +49 651 201 3921 > > E-Mail: [email protected] > > Web: http://zimk.uni-trier.de > > _______________________________________________ > ceph-users mailing list > [email protected] > http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com _______________________________________________ ceph-users mailing list [email protected] http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
