All other OSDs that I converted (#60-69) look basically identical while the Filestore OSDs (/var/lib/ceph/osd/ceph-70 etc.) look different obviously. When I run "df" it does NOT list those converted osds (only the Filestore ones). In other words, /dev/sdh1 where osd.60 should be is not listed. (Should it be?) Neither does mount lists that drive. ("df | grep sdh" and "mount | grep sdh" both return nothing)
On Tue, Nov 6, 2018 at 10:42 AM, Hector Martin <hec...@marcansoft.com> wrote: > > > On 11/7/18 12:30 AM, Hayashida, Mami wrote: > > So, currently this is what /var/lib/ceph/osd/ceph-60 shows. Is it not > > correct? I don't know what I should expect to see. > > > > root@osd1:~# ls -l /var/lib/ceph/osd/ceph-60 > > total 86252 > > -rw-r--r-- 1 ceph ceph 384 Nov 2 16:20 activate.monmap > > -rw-r--r-- 1 ceph ceph 10737418240 Nov 5 16:32 block > > lrwxrwxrwx 1 ceph ceph 14 Nov 2 16:20 block.db -> > /dev/ssd0/db60 > > -rw-r--r-- 1 ceph ceph 2 Nov 2 16:20 bluefs > > -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 ceph_fsid > > -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 fsid > > -rw------- 1 ceph ceph 57 Nov 2 16:20 keyring > > -rw-r--r-- 1 ceph ceph 8 Nov 2 16:20 kv_backend > > -rw-r--r-- 1 ceph ceph 21 Nov 2 16:20 magic > > -rw-r--r-- 1 ceph ceph 4 Nov 2 16:20 mkfs_done > > -rw-r--r-- 1 ceph ceph 41 Nov 2 16:20 osd_key > > -rw-r--r-- 1 ceph ceph 6 Nov 2 16:20 ready > > -rw-r--r-- 1 ceph ceph 10 Nov 2 16:20 type > > -rw-r--r-- 1 ceph ceph 3 Nov 2 16:20 whoami > > Are all the other OSDs like this? What is mounted on those directories > (i.e. what do "df" and "mount" show)? > > All those files are dated Nov 2, yet it should be a tmpfs and you > rebooted after that date, so I think something's wrong here. > > > The disk I am using for this osd (osd.60) is a 3.7TB hdd. > > > > lsblk shows > > > > sdh 8:112 0 3.7T 0 disk > > └─hdd60-data60 252:1 0 3.7T 0 lvm > > > > and "ceph osd tree" shows > > 60 hdd 3.63689 osd.60 up 1.00000 1.00000 > > That looks correct as far as the weight goes, but I'm really confused as > to why you have a 10GB "block" file. That should be a symlink to the > hdd60/data60 device as far as I know. > > -- > Hector Martin (hec...@marcansoft.com) > Public Key: https://mrcn.st/pub > -- *Mami Hayashida* *Research Computing Associate* Research Computing Infrastructure University of Kentucky Information Technology Services 301 Rose Street | 102 James F. Hardymon Building Lexington, KY 40506-0495 mami.hayash...@uky.edu (859)323-7521
_______________________________________________ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com