All other OSDs that I converted (#60-69) look basically identical while the
Filestore OSDs (/var/lib/ceph/osd/ceph-70 etc.) look different obviously.
When I run "df" it does NOT list those converted osds (only the Filestore
ones). In other words, /dev/sdh1 where osd.60 should be is not listed.
(Should it be?) Neither does mount lists that drive. ("df | grep sdh"
and "mount | grep sdh" both return nothing)
On Tue, Nov 6, 2018 at 10:42 AM, Hector Martin <[email protected]>
wrote:
>
>
> On 11/7/18 12:30 AM, Hayashida, Mami wrote:
> > So, currently this is what /var/lib/ceph/osd/ceph-60 shows. Is it not
> > correct? I don't know what I should expect to see.
> >
> > root@osd1:~# ls -l /var/lib/ceph/osd/ceph-60
> > total 86252
> > -rw-r--r-- 1 ceph ceph 384 Nov 2 16:20 activate.monmap
> > -rw-r--r-- 1 ceph ceph 10737418240 Nov 5 16:32 block
> > lrwxrwxrwx 1 ceph ceph 14 Nov 2 16:20 block.db ->
> /dev/ssd0/db60
> > -rw-r--r-- 1 ceph ceph 2 Nov 2 16:20 bluefs
> > -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 ceph_fsid
> > -rw-r--r-- 1 ceph ceph 37 Nov 2 16:20 fsid
> > -rw------- 1 ceph ceph 57 Nov 2 16:20 keyring
> > -rw-r--r-- 1 ceph ceph 8 Nov 2 16:20 kv_backend
> > -rw-r--r-- 1 ceph ceph 21 Nov 2 16:20 magic
> > -rw-r--r-- 1 ceph ceph 4 Nov 2 16:20 mkfs_done
> > -rw-r--r-- 1 ceph ceph 41 Nov 2 16:20 osd_key
> > -rw-r--r-- 1 ceph ceph 6 Nov 2 16:20 ready
> > -rw-r--r-- 1 ceph ceph 10 Nov 2 16:20 type
> > -rw-r--r-- 1 ceph ceph 3 Nov 2 16:20 whoami
>
> Are all the other OSDs like this? What is mounted on those directories
> (i.e. what do "df" and "mount" show)?
>
> All those files are dated Nov 2, yet it should be a tmpfs and you
> rebooted after that date, so I think something's wrong here.
>
> > The disk I am using for this osd (osd.60) is a 3.7TB hdd.
> >
> > lsblk shows
> >
> > sdh 8:112 0 3.7T 0 disk
> > └─hdd60-data60 252:1 0 3.7T 0 lvm
> >
> > and "ceph osd tree" shows
> > 60 hdd 3.63689 osd.60 up 1.00000 1.00000
>
> That looks correct as far as the weight goes, but I'm really confused as
> to why you have a 10GB "block" file. That should be a symlink to the
> hdd60/data60 device as far as I know.
>
> --
> Hector Martin ([email protected])
> Public Key: https://mrcn.st/pub
>
--
*Mami Hayashida*
*Research Computing Associate*
Research Computing Infrastructure
University of Kentucky Information Technology Services
301 Rose Street | 102 James F. Hardymon Building
Lexington, KY 40506-0495
[email protected]
(859)323-7521
_______________________________________________
ceph-users mailing list
[email protected]
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
