[ceph-users] what are these files for mon?

2014-08-05 Thread Jimmy Lu
Hello, I’ve been testing cephfs with 1 monitor. My /var partition keeps on filling up so that the mon process just die because of insufficient space. I drilled down on /var partition that below mon path is taking most of the space with *.sst files. I just curious what these files are and can

Re: [ceph-users] OSD keyrings shifted and down

2014-06-09 Thread Jimmy Lu
More detail to this. I recently upgraded my Ceph cluster from Emperor to Firefly. After the upgrade had been done, I noticed 1 of the OSD not coming back to life. While in the process of troubleshooting, rebooted the osd server and the keyring shifted. My $ENV. 4x OSD servers (each has 12, 1

Re: [ceph-users] OSD keyrings shifted and down

2014-06-06 Thread Jimmy Lu
Has anyone run into this issue and would like to provide any troubleshooting tip? Thanks, Jimmy From: J L j...@yahoo-inc.commailto:j...@yahoo-inc.com Date: Thursday, June 5, 2014 at 4:20 PM To: ceph-users@lists.ceph.commailto:ceph-users@lists.ceph.com

[ceph-users] OSD keyrings shifted and down

2014-06-05 Thread Jimmy Lu
Hello Ceph Guru, I rebooted osd server to fix “osd.33”. When the server came back online, I noticed all the osd are down, while I am troubleshooting and restarting the osd, I got below error for authentication. I also noticed the “keyring” for each osd had shifted. For example, for osd.33

Re: [ceph-users] How to find the disk partitions attached to a OSD

2014-05-21 Thread Jimmy Lu
This would give you pretty good understanding where the mounts and /dev/sd* are. [jlu@gfsnode1 osd]$ ceph-disk list; pwd; ls -lai /dev/sda : /dev/sda1 other, mounted on /boot /dev/sda2 other /dev/sdb other, unknown, mounted on /ceph/osd120 /dev/sdc other, unknown, mounted on /ceph/osd121

[ceph-users] ceph mom help

2014-05-02 Thread Jimmy Lu
Hello All, I am using “ceph-deploy” to setup my ceph cluster with 3 nodes. I am getting an error when running “sudo ceph-deploy mon create gfsnode5”. Would you someone please give me a pointer what the problem is? Thanks in advance! -Jimmy [cuser@gfsnode5 my-cluster]$ sudo ceph-deploy mon

Re: [ceph-users] ceph mom help

2014-05-02 Thread Jimmy Lu
This is a possible bug which was resolved. It was due to leveldb version. My node is already running on version 1.12. [root@gfsnode5 my-cluster]# rpm -qa | grep -i leveldb leveldb-1.12.0-3.el6.x86_64 [root@gfsnode5 my-cluster]# Thanks, Jimmy From: J L

Re: [ceph-users] ceph mom help

2014-05-02 Thread Jimmy Lu
I was able to dig up an archive of an IRC chat from Sage. The suggestion from the chat was to downgrade leveldb from 1.12 to 1.7.0. After the downgrade, I was able to run sudo ceph-deploy mon create gfsnode5. -Jimmy From: J L j...@yahoo-inc.commailto:j...@yahoo-inc.com Date: Friday, May 2,