[Bug 1894453] [NEW] Building Ceph packages with RelWithDebInfo

2020-09-06 Thread Ponnuvel Palaniyappan
Public bug reported: This is to consider/discuss the possibility of whether the Ceph packages (UCA) should be built with RelWithDebInfo build option (CMAKE_BUILD_TYPE [0]) which can be supplied to the build script do_cmake.sh [1]. Currently, Upstream as well as UCA builds default to 'Debug' [0]

[Bug 1891567] Re: [SRU] ceph_osd crash in _committed_osd_maps when failed to encode first inc map

2020-09-10 Thread Ponnuvel Palaniyappan
Tests for Focal: $ for osd in {0..2}; do juju ssh ceph-osd/$osd 'sudo dpkg -l | grep ceph'; done ii ceph 15.2.3-0ubuntu0.20.04.2 amd64distributed storage and file system ii ceph-base15.2.3-0ubuntu0.20.04.2

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-15 Thread Ponnuvel Palaniyappan
@Corey, Yes, I am happy to test this for Groovy. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph packages with RelWithDebInfo To manage notifications about this bug go

[Bug 1891567] Re: [SRU] ceph_osd crash in _committed_osd_maps when failed to encode first inc map

2020-09-15 Thread Ponnuvel Palaniyappan
@Brian, I have repeated the steps for focal and attached the text file with relevant logs/output. Can you please check again? ** Attachment added: "Package upgrade and test case execution steps & logs"

[Bug 1891567] Re: [SRU] ceph_osd crash in _committed_osd_maps when failed to encode first inc map

2020-09-15 Thread Ponnuvel Palaniyappan
** Tags removed: verification-needed verification-needed-focal ** Tags added: verification-done verification-done-focal -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1891567 Title: [SRU] ceph_osd

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-14 Thread Ponnuvel Palaniyappan
Looking some of the recent build logs, most of the Ceph packages are in fact compiled with -O2 and -g as Trent alluded to. Only rocksdb is compiled without them as Tyler noted. However, the upstream rocksdbhas been changed to honour CMAKE_BUILD_TYPE recently [2]. So it's only the rocksdb in UCA

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-14 Thread Ponnuvel Palaniyappan
@Corey Bryant, I think Ceph simply specifies rocksdb version to be used in the submodule information. 1. I checked out the tag v15.2.3 (upstream): git checkout tags/v15.2.3 -b 15.2.3 (which src/rocksdb is an empty directory) 2. Initialize submodule indexes: git submodule update --init 3. The

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-14 Thread Ponnuvel Palaniyappan
@Tyler, Canonical's Ceph builds don't deal with build options as such (like -DNDEBUG) but uses the upstream provided CMakeLists.txt files. So if we build with RelWithDebInfo, it should automatically use -DNDEBUG, too. The question was whether our build uses RelWithDebInfo -- which turns out to

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-07 Thread Ponnuvel Palaniyappan
Attaching relevant chat transcript with a Ceph dev on RelWithDebInfo. ** Attachment added: "upstream chat(kefu).txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5408399/+files/upstream%20chat%28kefu%29.txt -- You received this bug notification because you are a

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-07 Thread Ponnuvel Palaniyappan
** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph packages with RelWithDebInfo To manage notifications about this bug go to:

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-07 Thread Ponnuvel Palaniyappan
Another thing to note is that the size of binaries will be slightly bigger and also the build/compilation will be longer. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-10-07 Thread Ponnuvel Palaniyappan
@Corey, Had a discussion with Daniel Hill in SEG, and we think the risk is low. So, yes, we'd like to backport this to all releases. I am happy to do SRU (and/or tests) once this is ready. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1891567] Re: [SRU] ceph_osd crash in _committed_osd_maps when failed to encode first inc map

2020-08-28 Thread Ponnuvel Palaniyappan
Also tested the same with Octopus: # ceph versions { "mon": { "ceph version 15.2.3 (d289bbdec69ed7c1f516e0a093594580a76b78d0) octopus (stable)": 1 }, "mgr": { "ceph version 15.2.3 (d289bbdec69ed7c1f516e0a093594580a76b78d0) octopus (stable)": 1 }, "osd": {

[Bug 1891567] Re: [SRU] ceph_osd crash in _committed_osd_maps when failed to encode first inc map

2020-08-27 Thread Ponnuvel Palaniyappan
I have tested this ussuri-proposed packages and it fixes the issue. Setup a Nautilus cluster with the following versions: # ceph versions { "mon": { "ceph version

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-29 Thread Ponnuvel Palaniyappan
@Tyler, Indeed it does. My cluster tests were done in a "cloud-on-cloud" environment, so I didn't want to stress too much on the actual numbers (whereas rocksdb tests were done locally in a tightly controlled environment). As a whole, we can definitely say that RelWithDebInfo is the way to go for

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-24 Thread Ponnuvel Palaniyappan
@Corey > The individual building of rocksdb files doesn't give off much information in the package builds to see compiler flags set. VERBOSE flag would show full flags - however, that'd need changing rules & rebuilding again. That we can RelWithDebInfo is sufficient to confirm that it does pass

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-21 Thread Ponnuvel Palaniyappan
An update: I have built rocksdb with & without RelWithDebInfo. Some differences are: - the exact set of additional flags used with RelWithDebInfo are: -O2 -NDEBUG -fno-omit-frame-pointer -momit-leaf-frame-pointer. - the size of rocksdb shared library (librocksdb.so): default-build = 156M,

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-28 Thread Ponnuvel Palaniyappan
Hi @Corey, (Ignore my comments as I've managed to setup a cluster without needing ceph-deploy). I have installed the packages and setup a cluster. The cluster was functional and found no issues with the Groovy packages in my tests. I have done some of the Ceph's benchmarks [0] using the Ceph

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-28 Thread Ponnuvel Palaniyappan
** Attachment added: "Ceph tests on Octopus - rocksdb optimized.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5415022/+files/Ceph%20tests%20on%20Octopus%20-%20rocksdb%20optimized.txt -- You received this bug notification because you are a member of Ubuntu Bugs,

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-09-28 Thread Ponnuvel Palaniyappan
** Attachment added: "Ceph tests on Octopus - rocksdb UNoptimized.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5415021/+files/Ceph%20tests%20on%20Octopus%20-%20rocksdb%20UNoptimized.txt -- You received this bug notification because you are a member of Ubuntu

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-10-27 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] This is to consider/discuss the possibility of whether the Ceph packages (UCA) should be built with RelWithDebInfo build option (CMAKE_BUILD_TYPE [0]) which can be supplied to the build script do_cmake.sh [1]. Currently, Upstream as well as UCA builds

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-10-28 Thread Ponnuvel Palaniyappan
Hi Brian, I have updated the description. Does it help? On Tue, Oct 27, 2020 at 10:01 PM Brian Murray <1894...@bugs.launchpad.net> wrote: > >From the bug description its not clear to me why this change should be > SRU'ed to Focal or what the benefit to end users is. Could someone > please

[Bug 1852441] Re: In bionic, one of the ceph packages installed causes chrony to auto-install even on lxd

2020-06-30 Thread Ponnuvel Palaniyappan
Notes: 1. `--no-install-recommends` also excludes `ceph-common` package from getting installed which is needed (it could possibly exclude more packages, too). 2. `ntp` isn't getting installed - it's not an issues/related any more. So simply removing `chrony` is probably enough. ** Changed in:

[Bug 1852441] Re: In bionic, one of the ceph packages installed causes chrony to auto-install even on lxd

2020-06-29 Thread Ponnuvel Palaniyappan
** Changed in: charm-ceph-mon Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1852441 Title: In bionic, one of the ceph packa

[Bug 1760849] Re: Login screen appears on only one monitor and it's not the one I want

2020-07-17 Thread Ponnuvel Palaniyappan
This still happens on Ubuntu 20.04 (Focal), too. In my case, I have one external monitor which is mirrored. But the login screen appears only on the laptop's screen but not on the external monitor's display. -- You received this bug notification because you are a member of Ubuntu Bugs, which is

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
Bionic 12.2.13-0ubuntu0.18.04.6 ** Attachment added: "bionic.sru" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5450097/+files/bionic.sru ** Tags removed: verification-needed-bionic verification-stein-needed ** Tags added: verification-needed-done

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
SRU tests: Deployed a cluster with many OSDs with the new packages; I/O was driven from a VM (both reads & writes). Enabled a number mgr modules, too. And under load, the cluster was functioning and mgr was still responding. Attaching some relevant info on the tests here. -- You received

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
Stein UCA 13.2.9-0ubuntu0.19.04.1~cloud3 ** Attachment added: "stein.sru" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5450096/+files/stein.sru -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1910264] Re: [plugin][ceph] include time-sync-status for ceph mon

2021-01-07 Thread Ponnuvel Palaniyappan
Hi Eric, Attached debdiff's for bionic, focal, and groovy. Please let me know if they're OK. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1910264 Title: [plugin][ceph] include time-sync-status

[Bug 1910264] Re: [plugin][ceph] include time-sync-status for ceph mon

2021-01-07 Thread Ponnuvel Palaniyappan
focal debdiff ** Patch added: "focal.debdiff" https://bugs.launchpad.net/ubuntu/focal/+source/sosreport/+bug/1910264/+attachment/5450256/+files/focal.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1910264] Re: [plugin][ceph] include time-sync-status for ceph mon

2021-01-07 Thread Ponnuvel Palaniyappan
groovy debdiff ** Patch added: "groovy.debdiff" https://bugs.launchpad.net/ubuntu/focal/+source/sosreport/+bug/1910264/+attachment/5450257/+files/groovy.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1910264] Re: [plugin][ceph] include time-sync-status for ceph mon

2021-01-07 Thread Ponnuvel Palaniyappan
bionic debdiff ** Changed in: sosreport (Ubuntu Bionic) Status: New => In Progress ** Changed in: sosreport (Ubuntu Focal) Status: New => In Progress ** Changed in: sosreport (Ubuntu Groovy) Status: New => Incomplete ** Changed in: sosreport (Ubuntu Groovy) Status:

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu Bionic) Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) ** Changed in: cloud-archive/stein Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) ** Changed in: cloud-archive/queens Assignee: (unassigned) => Ponnuvel Pal

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-07 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] Ceph upstream implemented a new feature [1] that will check/report those long network ping times between OSDs, but it introduced an issue that ceph-mgr might be very slow because it needs to dump all the new OSD network ping stats [2] for some tasks, this

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-05 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu) Status: New => Incomplete ** Changed in: ceph (Ubuntu) Status: Incomplete => New ** Changed in: ceph (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-07 Thread Ponnuvel Palaniyappan
Attaching diff for Bionic (Ceph 12.2.13) - same as before but easier to read. ** Attachment added: "bug1906496.patch-bionic-12.2.13" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5441740/+files/bug1906496.patch-bionic-12.2.13 -- You received this bug notification

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-07 Thread Ponnuvel Palaniyappan
Attaching debdiff for Bionic (Ceph 12.2.13). ** Attachment added: "Bionic-Ceph-12.2.13-debdiff" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5441739/+files/debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-08 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu) Status: Confirmed => Won't Fix ** Changed in: ceph (Ubuntu) Status: Won't Fix => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1906496 Title:

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-09 Thread Ponnuvel Palaniyappan
debdiff for 13.2.9 ** Attachment added: "debdiff-ceph-13.2.9" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5442308/+files/debdiff-ceph-13.2.9 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-09 Thread Ponnuvel Palaniyappan
Patch file for 13.2.9 ** Attachment added: "bug1906496.patch-13.2.9" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1906496/+attachment/5442309/+files/bug1906496.patch-13.2.9 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-12-04 Thread Ponnuvel Palaniyappan
** Attachment added: "queens_out.after" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5440914/+files/queens_out.after ** Tags removed: verification-queens-needed ** Tags added: verification-queens-done -- You received this bug notification because you are a member

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-12-04 Thread Ponnuvel Palaniyappan
Tested queens-proposed following the same steps noted in #34. Like others results previously, this shows better results as well. Attached the test notes. ** Changed in: cloud-archive/queens Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) ** Changed in: ceph (Ubuntu Bio

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-12-04 Thread Ponnuvel Palaniyappan
Tested queens-proposed following the same steps noted in #34. Like others results previously, this shows better results as well. Attached the test notes. ** Attachment added: "queens_out.beore"

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-03 Thread Ponnuvel Palaniyappan
** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1906496 Title: mgr can be very slow in a large ceph cluster To manage notifications about this bug go to:

[Bug 1906496] Re: mgr can be very slow in a large ceph cluster

2020-12-02 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu) Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1906496 Title: mgr can be very slow in a large c

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-14 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] - Ceph upstream implemented a new feature [1] that will check/report those long network ping times between osds, but it introduced an issue that ceph-mgr might be very slow because it needs to dump all the new osd network ping stats [2] for some tasks, this

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-10 Thread Ponnuvel Palaniyappan
** Summary changed: - mgr can be very slow in a large ceph cluster + [SRU] mgr can be very slow in a large ceph cluster ** Description changed: - upstream implemented a new feature [1] that will check/report those long - network ping times between osds, but it introduced an issue that ceph- -

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2020-12-13 Thread Ponnuvel Palaniyappan
@Corey, yes, I am happy to do the SRU verification when the packages are available. I've updated the [Test case] section to note a simplified, functional test. ** Description changed: - [Impact] + [Impact] Ceph upstream implemented a new feature [1] that will check/report those long network

[Bug 1899180] Re: autopkgtest almost always fails in Bionic on amd64

2020-11-10 Thread Ponnuvel Palaniyappan
I've encountered this failure, too: https://objectstorage.prodstack4-5.canonical.com/v1/AUTH_77e2ada1e7a84929a74ba3b87153c0ac /autopkgtest- bionic/bionic/amd64/libv/libvirt/20201109_214647_148b5@/log.gz -- You received this bug notification because you are a member of Ubuntu Bugs, which is

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-10 Thread Ponnuvel Palaniyappan
The smoke-lxc test failure (reported in comment #37) could be due to https://bugs.launchpad.net/ubuntu/+source/libvirt/+bug/1899180. LP#1899180 suggests this could be treated as flaky. If it's easy, coud try re-running the regression tests for 12.2.13-0ubuntu0.18.04.5 to see if it's indeed a

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-11 Thread Ponnuvel Palaniyappan
** Changed in: cloud-archive/stein Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph packa

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-16 Thread Ponnuvel Palaniyappan
Performed same as for Ussuri (comment #34) and attached results here. ** Attachment added: "Stein_verification.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5434835/+files/Stein_verification.txt -- You received this bug notification because you are a member of

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-16 Thread Ponnuvel Palaniyappan
^^ The above is for Stein verification. ** Tags removed: verification-stein-needed ** Tags added: verification-stein-done -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-16 Thread Ponnuvel Palaniyappan
Test results for Train. ** Attachment added: "train_verification.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5434889/+files/train_verification.txt ** Tags removed: verification-train-needed ** Tags added: verification-train-done -- You received this bug

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-17 Thread Ponnuvel Palaniyappan
Re-run of the regression tests is OK for 12.2.13-0ubuntu0.18.04.5 [0]. Test results for 12.2.13-0ubuntu0.18.04.5 is good. Attached before & after test results. [0] https://people.canonical.com/~ubuntu-archive/proposed- migration/bionic/update_excuses.html#ceph ** Attachment added:

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-17 Thread Ponnuvel Palaniyappan
James Page has done focal-proposed verification already (comment #43) - with that, all tests are done and verified. Please let me know if you have any questions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-16 Thread Ponnuvel Palaniyappan
** Changed in: cloud-archive/train Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph packa

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-09 Thread Ponnuvel Palaniyappan
** Attachment added: "out__ussuri_before.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5432708/+files/out__ussuri_before.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-09 Thread Ponnuvel Palaniyappan
SRU tests are oood for ussuri (observed perf numbers are better). Did a short rados benchmark and attached the results (before and after upgrade). The steps taken are: - Upgrade the packages on monitor, and OSDs in order. - Restart monitor, manager and OSDs in order. - Repeat the same benchmark

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-09 Thread Ponnuvel Palaniyappan
** Attachment added: "out__ussuri_after.txt" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1894453/+attachment/5432709/+files/out__ussuri_after.txt ** Tags removed: verification-ussuri-needed ** Tags added: verification-ussuri-done -- You received this bug notification because you are

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-11-09 Thread Ponnuvel Palaniyappan
** Changed in: cloud-archive/ussuri Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1894453 Title: Building Ceph packa

[Bug 1894453] Re: Building Ceph packages with RelWithDebInfo

2020-10-30 Thread Ponnuvel Palaniyappan
** Description changed: [Impact] - This is to consider/discuss the possibility of whether the Ceph packages (UCA) should be built with RelWithDebInfo build option (CMAKE_BUILD_TYPE [0]) which can be supplied to the build script do_cmake.sh [1]. + This is to build the Ceph packages (UCA) with

[Bug 1906496] Re: [SRU] mgr can be very slow in a large ceph cluster

2021-01-08 Thread Ponnuvel Palaniyappan
Queens verification of 12.2.13-0ubuntu0.18.04.6~cloud0 Ran same tests on Queens - ceph mgr was functional and responsive under cluster load. ** Attachment added: "queens.sru" https://bugs.launchpad.net/ubuntu/bionic/+source/ceph/+bug/1906496/+attachment/5450803/+files/queens.sru ** Tags

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-01-25 Thread Ponnuvel Palaniyappan
** No longer affects: ceph (Ubuntu Hirsute) ** No longer affects: ceph (Ubuntu Groovy) ** No longer affects: ceph (Ubuntu Focal) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1911900 Title: [SRU]

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-01-25 Thread Ponnuvel Palaniyappan
** Also affects: cloud-archive/ussuri Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1911900 Title: [SRU] Active scrub blocks upmap balancer To manage

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-01-25 Thread Ponnuvel Palaniyappan
** Also affects: ceph (Ubuntu) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Focal) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Groovy) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Hirsute) Importance:

[Bug 1840043] Re: bcache: Performance degradation when querying priority_stats

2021-01-25 Thread Ponnuvel Palaniyappan
A question: Does stat(2) calls (lstat, fstat and the like) on priority_stats cause the same issue? Context: https://github.com/sosreport/sos/pull/2384#discussion_r563975063 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
** Changed in: sosreport (Ubuntu Bionic) Status: New => In Progress ** Changed in: sosreport (Ubuntu Focal) Status: New => In Progress ** Changed in: sosreport (Ubuntu Groovy) Status: New => In Progress ** Changed in: sosreport (Ubuntu Bionic) Importance: Undecided =>

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
Please ignore the patch in #5 - I had the wrong patch number there and fixed it here. Focal debdiff ** Patch added: "focal.debdiff" https://bugs.launchpad.net/ubuntu/+source/sosreport/+bug/1913284/+attachment/5458139/+files/focal.debdiff -- You received this bug notification because you

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
Groovy debdiff ** Patch added: "groovy.debdiff" https://bugs.launchpad.net/ubuntu/+source/sosreport/+bug/1913284/+attachment/5458147/+files/groovy.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
Focal debdiff ** Patch added: "focal.debdiff" https://bugs.launchpad.net/ubuntu/+source/sosreport/+bug/1913284/+attachment/5458138/+files/focal.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
Bionic debdiff ** Patch added: "bionic.debdiff" https://bugs.launchpad.net/ubuntu/+source/sosreport/+bug/1913284/+attachment/5458137/+files/bionic.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-02-01 Thread Ponnuvel Palaniyappan
Attaching debdiff for Focal/Octopus. ** Changed in: ceph (Ubuntu Bionic) Status: New => In Progress ** Patch added: "focal-octopus.debdiff" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1911900/+attachment/5458789/+files/focal-octopus.debdiff -- You received this bug

[Bug 1913284] [NEW] [plugin] [bcache] add a new bcache plugin

2021-01-26 Thread Ponnuvel Palaniyappan
Public bug reported: A new plugin for bcache stats are proposed upstream [0] and there's a PR currently under review [1]. [0] https://github.com/sosreport/sos/issues/2378 [1] https://github.com/sosreport/sos/pull/2384 ** Affects: sosreport (Ubuntu) Importance: Undecided Status:

[Bug 1840043] Re: bcache: Performance degradation when querying priority_stats

2021-01-27 Thread Ponnuvel Palaniyappan
Thanks for the clarification, Heitor! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1840043 Title: bcache: Performance degradation when querying priority_stats To manage notifications about this

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-01-26 Thread Ponnuvel Palaniyappan
** Also affects: ceph (Ubuntu Focal) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Hirsute) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Groovy) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Bionic)

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-06-17 Thread Ponnuvel Palaniyappan
** Changed in: cloud-archive/queens Status: Triaged => Won't Fix ** Changed in: cloud-archive/rocky Status: Triaged => Won't Fix ** Changed in: cloud-archive/stein Status: Triaged => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs,

[Bug 1914911] Re: [SRU] bluefs doesn't compact log file

2021-05-28 Thread Ponnuvel Palaniyappan
Verified that log compactions occur in bluefs with read/write I/O. Attaching test notes. ** Attachment added: "queens_sru_1914911" https://bugs.launchpad.net/ubuntu/+source/ceph/+bug/1914911/+attachment/5500895/+files/queens_sru_1914911 ** Tags removed: verification-queens-needed ** Tags

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-29 Thread Ponnuvel Palaniyappan
** Tags removed: verification-ussuri-needed ** Tags added: verification-ussuri-failed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914584 Title: [SRU] radosgw-admin user create error message

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-27 Thread Ponnuvel Palaniyappan
With SRU verification test, it doesn't quite work as intended. I believe the problem is with the upstream patch [0]. I've asked for clarification/confirmation [1]. I'll then have to mark the verifications failed, I am afraid. This obviously affects 15.2.11 release as well. I'll try to get this

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-30 Thread Ponnuvel Palaniyappan
This (incorrect) patch is in upstream master and backported to Nautilus, Octopus, and Pacific. This isn't critical and doesn't break functionality - except for an incorrect error message if user attributes modification fails. However, the reported problem still exists. So I've marked all

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-28 Thread Ponnuvel Palaniyappan
Submitted patch upstream: https://github.com/ceph/ceph/pull/41065 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914584 Title: [SRU] radosgw-admin user create error message confusing if user with

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-28 Thread Ponnuvel Palaniyappan
Confirmed that the patch needs re-work. So marking all verification failed. I've opened an issue in upstream tracker [0]. Submitted the patch upstream [1]. Once that gets approved, backports to Nautilus, Octopus, and Pacific to follow. I am not sure how 15.2.11 release can be worked around

[Bug 1914584] Re: [SRU] radosgw-admin user create error message confusing if user with email already exists

2021-04-28 Thread Ponnuvel Palaniyappan
** Tags removed: verification-needed verification-needed-focal verification-needed-groovy ** Tags added: verification-failed verification-failed-focal verification-failed-groovy -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-08 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu) Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914911 Title: bluefs doesn't compact log file To man

[Bug 1914584] Re: radosgw-admin user create error message confusing if user with email already exists

2021-02-05 Thread Ponnuvel Palaniyappan
** Also affects: ceph (Ubuntu Focal) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Hirsute) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Groovy) Importance: Undecided Status: New ** Also affects: ceph (Ubuntu Bionic)

[Bug 1914584] Re: radosgw-admin user create error message confusing if user with email already exists

2021-02-05 Thread Ponnuvel Palaniyappan
** Also affects: cloud-archive/ussuri Importance: Undecided Status: New ** Also affects: cloud-archive/stein Importance: Undecided Status: New ** Also affects: cloud-archive/queens Importance: Undecided Status: New ** Also affects: cloud-archive/train

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-10 Thread Ponnuvel Palaniyappan
** Also affects: cloud-archive Importance: Undecided Status: New ** Also affects: cloud-archive/queens Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-10 Thread Ponnuvel Palaniyappan
** Also affects: ceph (Ubuntu Bionic) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914911 Title: bluefs doesn't compact log file To manage

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-10 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu Bionic) Status: New => In Progress -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914911 Title: bluefs doesn't compact log file To manage notifications about

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-10 Thread Ponnuvel Palaniyappan
** Changed in: ceph (Ubuntu Bionic) Assignee: (unassigned) => Ponnuvel Palaniyappan (pponnuvel) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914911 Title: bluefs doesn't compact log f

[Bug 1914911] Re: bluefs doesn't compact log file

2021-02-11 Thread Ponnuvel Palaniyappan
Attached debdiff for Bionic. ** Patch added: "bionic.debdiff" https://bugs.launchpad.net/cloud-archive/+bug/1914911/+attachment/5462589/+files/bionic.debdiff ** Tags added: sts-sru-needed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1914911] Re: [SRU] bluefs doesn't compact log file

2021-02-11 Thread Ponnuvel Palaniyappan
** Summary changed: - bluefs doesn't compact log file + [SRU] bluefs doesn't compact log file -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1914911 Title: [SRU] bluefs doesn't compact log file To

[Bug 1914911] Re: [SRU] bluefs doesn't compact log file

2021-02-11 Thread Ponnuvel Palaniyappan
** Description changed: - For a certain type of workload, the bluefs might never compact the log file, - which would cause the bluefs log file slowly grows to a huge size + [Impact] + + For a certain type of workload, the bluefs might never compact the log + file, which would cause the bluefs

[Bug 1914911] Re: [SRU] bluefs doesn't compact log file

2021-02-11 Thread Ponnuvel Palaniyappan
Attaching a gitdiff based off branch: applied/12.2.13-0ubuntu0.18.04.6 ** Attachment added: "ceph12.2.13-lp1914911.gitdiff" https://bugs.launchpad.net/cloud-archive/+bug/1914911/+attachment/5462713/+files/ceph12.2.13-lp1914911.gitdiff -- You received this bug notification because you are a

[Bug 1913284] Re: [plugin] [bcache] add a new bcache plugin

2021-01-29 Thread Ponnuvel Palaniyappan
Thanks, Eric. It hasn't been merged at upstream yet. It's ready to go - tested & reviewed, just waiting for someone to hit the merge button. I'll for that to happen just in case. Once that's done, I'll submit the debdiff's here. -- You received this bug notification because you are a member

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-01-29 Thread Ponnuvel Palaniyappan
** Changed in: cloud-archive Importance: Undecided => Medium ** Changed in: cloud-archive/ussuri Importance: Undecided => Medium ** Changed in: ceph (Ubuntu Bionic) Importance: Undecided => Medium ** Changed in: ceph (Ubuntu Focal) Importance: Undecided => Medium ** Changed in:

[Bug 1911900] Re: [SRU] Active scrub blocks upmap balancer

2021-02-01 Thread Ponnuvel Palaniyappan
Thanks, Corey, for catching the unintended change in the previous debdiff. I've corrected it and attached a new debdiff here. ** Patch added: "new-focal-octopus.debdiff" https://bugs.launchpad.net/cloud-archive/+bug/1911900/+attachment/5458823/+files/new-focal-octopus.debdiff -- You

[Bug 1852441] Re: In bionic, one of the ceph packages installed causes chrony to auto-install even on lxd

2021-03-24 Thread Ponnuvel Palaniyappan
** Changed in: ntp-charm Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1852441 Title: In bionic, one of the ceph packages installed causes chrony to auto- install

[Bug 1914911] Re: [SRU] bluefs doesn't compact log file

2021-03-25 Thread Ponnuvel Palaniyappan
Hi James, I manually edited the debdiff because it produced a lot of cruft when doing debdiff which aren't relevant to the patch (that probably cause the issue). Perhaps that's not an issue after all? I created the patch again and attached here (that does contain the cruft I noted) and also

  1   2   >