Re: [ceph-users] OSD up takes 15 minutes after machine restarts
No, bluestore_fsck_on_mount_deep is applied when bluestore_fsck_on_mount
is set to true only.
Hence there is no fsck on mount in your case.
Thanks,
Igor
On 1/20/2020 10:25 AM, huxia...@horebdata.cn wrote:
HI, Igor,
does this could cause the problem?
huxia...@horebdata.cn
*From:* Igor Fedotov <mailto:ifedo...@suse.de>
*Date:* 2020-01-19 11:41
*To:* huxia...@horebdata.cn <mailto:huxia...@horebdata.cn>;
ceph-users <mailto:ceph-users@lists.ceph.com>
*Subject:* Re: [ceph-users] OSD up takes 15 minutes after machine
restarts
Hi Samuel,
wondering if you have bluestore_fsck_on_mount option set to true?
Can you see high read load over OSD device(s) during the startup?
If so it might be fsck running which takes that long.
Thanks,
Igor
On 1/19/2020 11:53 AM, huxia...@horebdata.cn wrote:
Dear folks,
I had a strange situation with 3-node Ceph cluster on Luminous
12.2.12 with bluestore. Each machine has 5 OSDs on HDD, and each
OSD uses a 30GB DB/WAL partition on SSD. At the beginning without
much data, OSDs can quickly up if one node restarts.
Then I ran 4-day long stress tests with vdbench, and then I
restarts one node, and to my surprise, OSDs on that node takes ca
15 minutes to turn into up state. How can i speed up the OSD UP
process ?
thanks,
Samuel
huxia...@horebdata.cn
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] OSD up takes 15 minutes after machine restarts
HI, Igor, does this could cause the problem? huxia...@horebdata.cn From: Igor Fedotov Date: 2020-01-19 11:41 To: huxia...@horebdata.cn; ceph-users Subject: Re: [ceph-users] OSD up takes 15 minutes after machine restarts Hi Samuel, wondering if you have bluestore_fsck_on_mount option set to true? Can you see high read load over OSD device(s) during the startup? If so it might be fsck running which takes that long. Thanks, Igor On 1/19/2020 11:53 AM, huxia...@horebdata.cn wrote: Dear folks, I had a strange situation with 3-node Ceph cluster on Luminous 12.2.12 with bluestore. Each machine has 5 OSDs on HDD, and each OSD uses a 30GB DB/WAL partition on SSD. At the beginning without much data, OSDs can quickly up if one node restarts. Then I ran 4-day long stress tests with vdbench, and then I restarts one node, and to my surprise, OSDs on that node takes ca 15 minutes to turn into up state. How can i speed up the OSD UP process ? thanks, Samuel huxia...@horebdata.cn ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Re: [ceph-users] OSD up takes 15 minutes after machine restarts
Hi Samuel, wondering if you have bluestore_fsck_on_mount option set to true? Can you see high read load over OSD device(s) during the startup? If so it might be fsck running which takes that long. Thanks, Igor On 1/19/2020 11:53 AM, huxia...@horebdata.cn wrote: Dear folks, I had a strange situation with 3-node Ceph cluster on Luminous 12.2.12 with bluestore. Each machine has 5 OSDs on HDD, and each OSD uses a 30GB DB/WAL partition on SSD. At the beginning without much data, OSDs can quickly up if one node restarts. Then I ran 4-day long stress tests with vdbench, and then I restarts one node, and to my surprise, OSDs on that node takes ca 15 minutes to turn into up state. How can i speed up the OSD UP process ? thanks, Samuel huxia...@horebdata.cn ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com ___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
