[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
This bug was fixed in the package designate - 1:6.0.1-0ubuntu1.2~cloud0 --- designate (1:6.0.1-0ubuntu1.2~cloud0) xenial-queens; urgency=medium . * New update for the Ubuntu Cloud Archive. . designate (1:6.0.1-0ubuntu1.2) bionic; urgency=medium . [ Edward Hope-Morley ] * d/p/add-unique-constraint-to-service_statuses.patch: Remove use of tests.fixtures.StandardLogging since it is not supported in stable/queens. . designate (1:6.0.1-0ubuntu1.1) bionic; urgency=medium . * Add patch to create service_statuses uniq constraint (LP: #1768824) d/p/add-unique-constraint-to-service_statuses.patch ** Changed in: cloud-archive/queens Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Xenial Queens verifie using [Test Case]
Test Output:
root@juju-c01a91-lp1768824-sru-1:~# mysql -h$host -u${service} -p$passwd
${service} -e'select count(*) from service_statuses where
service_name="pool_manager";'
+--+
| count(*) |
+--+
|1 |
+--+
root@juju-c01a91-lp1768824-sru-1:~# ts=`date '+%Y-%m-%d %H:%M:%S'`
root@juju-c01a91-lp1768824-sru-1:~# svc_host=`mysql -B -h$host -u${service}
-p$passwd ${service} -e 'select hostname from service_statuses where
service_name="pool_manager";'| tail -n 1`
root@juju-c01a91-lp1768824-sru-1:~# mysql -h$host -u${service} -p$passwd
${service} -e "insert into service_statuses values ('1234', '$ts', '$ts',
'pool_manager', '$svc_host', '$ts', 'UP', '{}', '{}');"
ERROR 1062 (23000) at line 1: Duplicate entry
'pool_manager-juju-c01a91-lp1768824-sru-1' for key 'unique_service_status'
root@juju-c01a91-lp1768824-sru-1:~# mysql -h$host -u${service} -p$passwd
${service} -e "select * from INFORMATION_SCHEMA.TABLE_CONSTRAINTS where
CONSTRAINT_TYPE='UNIQUE';"| grep service_statuses
def designate unique_service_status designate
service_statusesUNIQUE
** Description changed:
[Impact]
This patch is required to prevent pool-manager from creating unbounded
amounts of status logs in the service_statuses table triggered by having > 1
log in there.
[Test Case]
* deploy openstack queens with designate
* mysql> select count(*) from service_statuses where
service_name="pool_manager"; should return 1
* try to add an extra entry:
- ts=date '+%Y-%m-%d %H:%M:%S'
+ ts=`date '+%Y-%m-%d %H:%M:%S'`
svc_host=`mysql -B -h$host -u${service} -p$passwd ${service} -e 'select
hostname from service_statuses where service_name="pool_manager";'| tail -n 1`
mysql -h$host -u${service} -p$passwd ${service} -e "insert into
service_statuses values ('1234', '$ts', '$ts', 'pool_manager', '$svc_host',
'$ts', 'UP', '{}', '{}');"
* this should fail since the hostname/servicename columns should now be a
unique contraint
* can also check this with:
mysql -h$host -u${service} -p$passwd ${service} -e "select * from
INFORMATION_SCHEMA.TABLE_CONSTRAINTS where CONSTRAINT_TYPE='UNIQUE';"|
grep service_statuses
- [Regression Potential]
+ [Regression Potential]
if the table already has multiple records for pool_manager in the
service_statuses table, it will be necessary to (manually) delete all but one
record in order for the upgrade to succeed.
Hi,
The service_statuses table in Designate database is running full of
records in our deployment:
MariaDB [designate]> select count(*) from service_statuses;
+--+
| count(*) |
+--+
| 24474342 |
+--+
1 row in set (7 min 19.09 sec)
We got millions of rows in just couple of month. The problem is that the same
services running on the same hosts create new record (instead of updating
existing) during status report to Designate.
This is how it looks in DB:
MariaDB [designate]> select * from service_statuses;
+--+-+-+--++-++---+--+
| id | created_at | updated_at
| service_name | hostname | heartbeated_at |
status | stats | capabilities |
+--+-+-+--++-++---+--+
| 0dde2b5f228549d5995cb0338841bd50 | 2018-05-02 12:06:03 | NULL
| producer | designate-producer-855855776-cr8d9 | 2018-05-02 12:06:03 | UP
| {}| {} |
| 0e311d3000d8403d97066eba619490a3 | 2018-05-02 12:05:14 | NULL
| api | designate-api-2042646259-6090v | 2018-05-02 12:05:13 | UP
| {}| {} |
| 168448cd97cd428ea19318243570482c | 2018-05-02 12:05:48 | NULL
| producer | designate-producer-855855776-cr8d9 | 2018-05-02 12:05:48 | UP
| {}| {} |
| 1685d7f80d8c4f75b052680e5e2f40ae | 2018-05-02 12:05:59 | NULL
| api | designate-api-2042646259-6090v | 2018-05-02 12:05:58 | UP
| {}| {} |
| 192275eb33854b4091b981b0c32d04f7 | 2018-05-02 12:05:41 | NULL
| worker | designate-worker-3446544-7fzqx | 2018-05-02 12:05:35 | UP
| {}| {} |
| 1e465011f21f47f096b54005675e8011 | 2018-05-02 12:05:25 | NULL
| mdns | designate-mdns-4198843580-lw6s2| 2018-05-02 12:05:25 | UP
| {}| {} |
| 22e0ab87b3cd4228bc191e49923d13ba | 2018-05-02 12:05:58 | NULL
| producer | designate-producer-855855776-cr8d9 |
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
This bug was fixed in the package designate - 1:6.0.1-0ubuntu1.2 --- designate (1:6.0.1-0ubuntu1.2) bionic; urgency=medium [ Edward Hope-Morley ] * d/p/add-unique-constraint-to-service_statuses.patch: Remove use of tests.fixtures.StandardLogging since it is not supported in stable/queens. designate (1:6.0.1-0ubuntu1.1) bionic; urgency=medium * Add patch to create service_statuses uniq constraint (LP: #1768824) d/p/add-unique-constraint-to-service_statuses.patch -- Corey Bryant Fri, 12 Jul 2019 08:53:10 -0400 ** Changed in: designate (Ubuntu Bionic) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Bionic Queen verified using [Test Case]
Test Output:
root@juju-01d5ff-lp1768824-sru-5:~# dpkg -l| grep designate
ii designate-agent 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - agent
ii designate-api 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - API server
ii designate-central 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - central daemon
ii designate-common1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - common files
ii designate-mdns 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - mdns
ii designate-pool-manager 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - pool manager
ii designate-sink 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - sink
ii designate-zone-manager 1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - zone manager
ii python-designate1:6.0.1-0ubuntu1.2
all OpenStack DNS as a Service - Python libs
ii python-designateclient 2.9.0-0ubuntu1
all client library for the OpenStack Designate API - Python 2.7
root@juju-01d5ff-lp1768824-sru-5:~# mysql -h$host -u${service} -p$passwd
${service} -e'select count(*) from service_statuses where
service_name="pool_manager"'
mysql: [Warning] Using a password on the command line interface can be insecure.
+--+
| count(*) |
+--+
|1 |
+--+
root@juju-01d5ff-lp1768824-sru-5:~# ts=`date '+%Y-%m-%d %H:%M:%S'`
root@juju-01d5ff-lp1768824-sru-5:~# svc_host=`mysql -B -h$host -u${service}
-p$passwd ${service} -e 'select hostname from service_statuses where
service_name="pool_manager";'| tail -n 1`
mysql: [Warning] Using a password on the command line interface can be insecure.
root@juju-01d5ff-lp1768824-sru-5:~# mysql -h$host -u${service} -p$passwd
${service} -e "insert into service_statuses values ('1234', '$ts', '$ts',
'pool_manager', '$svc_host', '$ts', 'UP', '{}', '{}');"
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1062 (23000) at line 1: Duplicate entry
'pool_manager-juju-01d5ff-lp1768824-sru-5' for key 'unique_service_status'
root@juju-01d5ff-lp1768824-sru-5:~# mysql -h$host -u${service} -p$passwd
${service} -e "select * from INFORMATION_SCHEMA.TABLE_CONSTRAINTS where
CONSTRAINT_TYPE='UNIQUE';"| grep service_statuses
mysql: [Warning] Using a password on the command line interface can be insecure.
def designate unique_service_status designate
service_statusesUNIQUE
** Tags removed: verification-needed-bionic
** Tags added: verification-done-bionic
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1768824
Title:
[SRU] service_statuses table running full in Designate database
To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Hello Dmitry, or anyone else affected, Accepted designate into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/designate/1:6.0.1-0ubuntu1.2 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping! N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days. ** Tags removed: verification-failed verification-failed-bionic ** Tags added: verification-needed verification-needed-bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
** Patch added: "lp1768824-bionic.debdiff" https://bugs.launchpad.net/cloud-archive/+bug/1768824/+attachment/5276673/+files/lp1768824-bionic.debdiff ** Tags removed: verification-needed verification-needed-bionic ** Tags added: verification-failed verification-failed-bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Bionic proposed package failed to build because I forgot to remove a dependency from the unit tests in that patch prior to attaching the debdiff. Apologies for that. I have tested a new patch with this dependency removed and will attach it now. Please go ahead and replace the current bionic-proposed build with this one. Thanks. ** Patch removed: "lp1768824-bionic-queens.debdiff" https://bugs.launchpad.net/cloud-archive/+bug/1768824/+attachment/5268554/+files/lp1768824-bionic-queens.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Hello Dmitry, or anyone else affected, Accepted designate into bionic-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/designate/1:6.0.1-0ubuntu1.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed. Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-bionic to verification-done-bionic. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-bionic. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance for helping! N.B. The updated package will be released to -updates after the bug(s) fixed by this package have been verified and the package has been in -proposed for a minimum of 7 days. ** Changed in: designate (Ubuntu Bionic) Status: Triaged => Fix Committed ** Tags added: verification-needed verification-needed-bionic -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Thanks Edward. This has been uploaded to the bionic unapproved queue: https://launchpad.net/ubuntu/bionic/+queue?queue_state=1_text=designate -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
** Changed in: cloud-archive/queens Status: New => Triaged ** Changed in: cloud-archive/queens Importance: Undecided => High ** Changed in: designate (Ubuntu Bionic) Status: New => Triaged ** Changed in: designate (Ubuntu Bionic) Importance: Undecided => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
** Tags added: sts sts-sru-needed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Thanks Ed. Just waiting on the rocky fix to land upstream so that we can upload the rocky changes for designate-status before we upload queens. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
** Patch removed: "lp1606741-queens.debdiff" https://bugs.launchpad.net/designate/+bug/1768824/+attachment/5268542/+files/lp1606741-rocky.debdiff ** Patch added: "lp1768824-bionic-queens.debdiff" https://bugs.launchpad.net/designate/+bug/1768824/+attachment/5268554/+files/lp1768824-bionic-queens.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
** Patch added: "lp1606741-rocky.debdiff" https://bugs.launchpad.net/cloud-archive/+bug/1768824/+attachment/5268542/+files/lp1606741-rocky.debdiff ** Also affects: designate (Ubuntu) Importance: Undecided Status: New ** Changed in: designate (Ubuntu) Status: New => Fix Released ** Also affects: designate (Ubuntu Bionic) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1768824] Re: [SRU] service_statuses table running full in Designate database
Above desbdiff is for the "Add unique constraint to service_statuses". We also want to SRU the designate-manage patch (same package) but that needs to be backported to rocky first (it landed in Stein upstream). -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1768824 Title: [SRU] service_statuses table running full in Designate database To manage notifications about this bug go to: https://bugs.launchpad.net/cloud-archive/+bug/1768824/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
