[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-19 Thread Corey Bryant
This bug was fixed in the package ceph - 12.2.13-0ubuntu0.18.04.6~cloud0 --- ceph (12.2.13-0ubuntu0.18.04.6~cloud0) xenial-queens; urgency=medium . * New update for the Ubuntu Cloud Archive. . ceph (12.2.13-0ubuntu0.18.04.6) bionic; urgency=medium . * d/p/bug1906496.patch:

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-19 Thread Corey Bryant
This bug was fixed in the package ceph - 13.2.9-0ubuntu0.19.04.1~cloud3 --- ceph (13.2.9-0ubuntu0.19.04.1~cloud3) bionic-stein; urgency=medium . * d/p/bug1906496.patch: disable network stats in dump_osd_stats (LP: #1906496) -- You received this bug notification because you

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-18 Thread Launchpad Bug Tracker
This bug was fixed in the package ceph - 12.2.13-0ubuntu0.18.04.6 --- ceph (12.2.13-0ubuntu0.18.04.6) bionic; urgency=medium * d/p/bug1906496.patch: disable network stats in dump_osd_stats (LP: #1906496) -- Ponnuvel Palaniyappan Mon, 07 Dec 2020 18:15:24 + ** Changed

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-16 Thread Mathew Hodson
** Tags removed: verification-needed-done ** Tags added: verification-bionic-done ** Tags removed: verification-bionic-done ** Tags added: verification-done-bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-08 Thread Ponnuvel Palaniyappan
Queens verification of 12.2.13-0ubuntu0.18.04.6~cloud0 Ran same tests on Queens - ceph mgr was functional and responsive under cluster load. ** Attachment added: "queens.sru" https://bugs.launchpad.net/ubuntu/bionic/+source/ceph/+bug/1906496/+attachment/5450803/+files/queens.sru ** Tags

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] Ceph upstream implemented a new feature [1] that will check/report those long network ping times between OSDs, but it introduced an issue that ceph-mgr might be very slow because it needs to dump all the new OSD network ping stats [2] for some tasks, this

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu Bionic) Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) ** Changed in: cloud-archive/stein Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) ** Changed in: cloud-archive/queens Assignee: (unassigned) => Ponnuvel Palaniyappan

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
Bionic 12.2.13-0ubuntu0.18.04.6 ** Attachment added: "bionic.sru" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5450097/+files/bionic.sru ** Tags removed: verification-needed-bionic verification-stein-needed ** Tags added: verification-needed-done

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
Stein UCA 13.2.9-0ubuntu0.19.04.1~cloud3 ** Attachment added: "stein.sru" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5450096/+files/stein.sru -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
SRU tests: Deployed a cluster with many OSDs with the new packages; I/O was driven from a VM (both reads & writes). Enabled a number mgr modules, too. And under load, the cluster was functioning and mgr was still responding. Attaching some relevant info on the tests here. -- You received

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-06 Thread Robie Basak
Hello dongdong, or anyone else affected, Accepted ceph into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/ceph/12.2.13-0ubuntu0.18.04.6 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-14 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] - Ceph upstream implemented a new feature [1] that will check/report those long network ping times between osds, but it introduced an issue that ceph-mgr might be very slow because it needs to dump all the new osd network ping stats [2] for some tasks, this

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-13 Thread Ponnuvel Palaniyappan
@Corey, yes, I am happy to do the SRU verification when the packages are available. I've updated the [Test case] section to note a simplified, functional test. ** Description changed: - [Impact] + [Impact] Ceph upstream implemented a new feature [1] that will check/report those long network

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-11 Thread Corey Bryant
Thanks for the patches Ponnuvel. New versions of ceph with the sponsored changes to fix this bug have been uploaded to stein-staging and the bionic unapproved queue. @Ponnuvel, would you mind helping to test this once it is available in proposed? I think the [Test Case] section above needs

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-11 Thread Corey Bryant
** Also affects: ceph (Ubuntu Groovy) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Hirsute) Importance: High Assignee: Ponnuvel Palaniyappan (pponnuvel) Status: Fix Released ** Also affects: ceph (Ubuntu Focal) Importance: Undecided Status:

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-10 Thread Mathew Hodson
** Also affects: ceph (Ubuntu Bionic) Importance: Undecided Status: New ** Changed in: ceph (Ubuntu) Importance: Undecided => High ** Changed in: ceph (Ubuntu Bionic) Importance: Undecided => Medium ** Also affects: cloud-archive Importance: Undecided Status: New **

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-10 Thread Ponnuvel Palaniyappan
** Summary changed: - mgr can be very slow in a large ceph cluster + [SRU] mgr can be very slow in a large ceph cluster ** Description changed: - upstream implemented a new feature [1] that will check/report those long - network ping times between osds, but it introduced an issue that ceph- -