[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-09-29 Thread Corey Bryant
I think CEPH_VOLUME_SYSTEMD_TRIES can be set in /etc/default/ceph and then systemd units can pick the setting up from there. A charm change is being tracked at LP: #189. I think we can move the discussion to that bug unless there are thoughts that the upstream or package defaults should be

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-09-29 Thread Drew Freiberger
The bionic-ussuri package has the retries set for 1. My start time to vault unseal time was about 18 hours. We should have this set to heal for up to 5 days after machine start. I'm almost wondering if vaultlocker-decrypt also needs the retries increased as well. Here's a workaround I've

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-09-29 Thread Drew Freiberger
This is still an issue with bionic-ussuri ceph 15.2.3-0ubuntu0.20.04.2~cloud0 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD units requires reboot if they boot before vault

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-16 Thread James Page
** Changed in: cloud-archive/queens Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD units requires reboot if they boot before

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-15 Thread Launchpad Bug Tracker
This bug was fixed in the package ceph - 12.2.13-0ubuntu0.18.04.2 --- ceph (12.2.13-0ubuntu0.18.04.2) bionic; urgency=medium * d/p/bug1871820.patch: Revert change in default concurrency for rocksdb background compactions to avoid potential data loss (LP: #1871820). ceph

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-15 Thread dongdong tao
Just to clarify a bit to avoid confusion. In above comment, at step 5, I meant Wait for about 1.5 hour and unseal the vault. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-14 Thread dongdong tao
I have verified the fix in bionic-proposed and confirm it can fix this issue. The test steps I've performed: 1. deployed a ceph cluster with vault 2. upgrade some of the osds to 12.2.13 3. Add "Environment=CEPH_VOLUME_SYSTEMD_TRIES=2000" at /lib/systemd/system/ceph-volume@.service for all osds

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-10 Thread James Page
This fix need re-verification in bionic-proposed as a further change was added so the binaries have been rebuilt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD units requires

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-08 Thread Edward Hope-Morley
** Tags removed: verification-needed-bionic verification-rocky-needed verification-stein-needed ** Tags added: verification-done-bionic verification-rocky-done verification-stein-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-06-04 Thread dongdong tao
Hi All, I can confirm this release fixed the bug, I used below steps to test 1. Deployed a ceph cluster with vault 2. Upgrade all the ceph packages to 12.2.13 at bionic-proposed 3. Add "Environment=CEPH_VOLUME_SYSTEMD_TRIES=2000" at /lib/systemd/system/ceph-volume@.service for some osd node 4.

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-04-20 Thread Edward Hope-Morley
Bionic/Queens is currently blocked on a potential regression in bug 1871820 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD units requires reboot if they boot before vault

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-04-20 Thread James Page
** Changed in: ceph (Ubuntu Eoan) Status: Fix Committed => Fix Released ** Changed in: cloud-archive/train Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-04-14 Thread Corey Bryant
This bug was fixed in the package ceph - 13.2.8-0ubuntu0.18.10.1~cloud0 --- ceph (13.2.8-0ubuntu0.18.10.1~cloud0) bionic; urgency=medium . * New upstream release for the Ubuntu Cloud Archive (LP: #1864514). * d/p/bug1804261.patch: Cherry pick fix to ensure that ceph-volume

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-04-14 Thread Corey Bryant
This bug was fixed in the package ceph - 13.2.8-0ubuntu0.19.04.1~cloud1 --- ceph (13.2.8-0ubuntu0.19.04.1~cloud1) bionic; urgency=medium . * d/p/bug1804261.patch: Cherry pick fix to ensure that ceph-volume tries and interval environment variables are converted to int

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-04-01 Thread James Page
@sil2100 - yes this bug was present in the eoan version of ceph - the fix is included in the update to 14.2.8 covered under bug 1861789 so I elected not to cover it specifically under this bug. ** Changed in: ceph (Ubuntu Eoan) Status: New => Fix Committed -- You received this bug

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-03-30 Thread Łukasz Zemczak
Is this bug also present in eoan? If yes, it would be good to have a fix scheduled there too. ** Changed in: ceph (Ubuntu Bionic) Status: New => Fix Committed ** Tags added: verification-needed verification-needed-bionic -- You received this bug notification because you are a member of

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-03-18 Thread James Page
** Description changed: - In a scenario where Ceph is encrypted and using Vault as the keymanager, - in a scenario where vault and ceph are both stopped, any OSDs on the - unit(s) affected will require a further reboot if they try to start - before vault is unsealed. + [Impact] + Various

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-03-09 Thread Łukasz Zemczak
What is the test case for verification of this bug as part of the SRU? Since this bug is called out as being fixed by the new upload, please include the basic SRU information such as Test Case and Regression Potential. Thank you! -- You received this bug notification because you are a member of

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2020-02-13 Thread James Page
** Changed in: ceph (Ubuntu Focal) Status: New => Fix Released ** Changed in: cloud-archive/ussuri Status: New => Fix Released ** Changed in: ceph (Ubuntu Disco) Status: New => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2019-12-11 Thread Edward Hope-Morley
** Also affects: ceph (Ubuntu Focal) Importance: High Assignee: dongdong tao (taodd) Status: New ** Also affects: ceph (Ubuntu Disco) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Bionic) Importance: Undecided Status: New ** Also affects:

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2019-12-11 Thread Edward Hope-Morley
Side note, I was initially unable to manually recover because I was restarting the wrong ceph-volume service: root@cephtest:~# systemctl -a| grep ceph-volume ceph-volume@bbfc0235-f8fd-458b-9c3d-21803b72f4bc.service loadedactivating start start Ceph Volume activation:

[Bug 1804261] Re: Ceph OSD units requires reboot if they boot before vault (and if not unsealed with 150s)

2019-12-10 Thread Edward Hope-Morley
** Also affects: ceph (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1804261 Title: Ceph OSD units requires reboot if they boot before vault (and