[VERIFICATION XENIAL] * == corosync upgrade (with pacemaker installed) ==
# lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 16.04.4 LTS Release: 16.04 Codename: xenial # dpkg -l ii corosync 2.3.5-3ubuntu2 amd64 cluster engine daemon and utilities ii pacemaker 1.1.14-2ubuntu1.3 amd64 cluster resource manager # systemctl status corosync | egrep "Active:|PID:" Active: active (running) since Tue 2018-02-27 13:38:49 UTC; 1min 19s ago Main PID: 3214 (corosync) # systemctl status pacemaker | egrep "Active:|PID:" Active: active (running) since Tue 2018-02-27 13:38:50 UTC; 1min 23s ago Main PID: 3307 (pacemakerd) # apt-get install corosync -y Reading package lists... Done Building dependency tree Reading state information... Done The following package was automatically installed and is no longer required: libfreetype6 Use 'apt autoremove' to remove it. The following additional packages will be installed: pacemaker Suggested packages: fence-agents The following packages will be upgraded: corosync pacemaker 2 upgraded, 0 newly installed, 0 to remove and 44 not upgraded. Need to get 502 kB of archives. After this operation, 2048 B of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 pacemaker amd64 1.1.14-2ubuntu1.4 [334 kB] Get:2 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 corosync amd64 2.3.5-3ubuntu2.1 [168 kB] Fetched 502 kB in 1s (373 kB/s) (Reading database ... 28101 files and directories currently installed.) Preparing to unpack .../pacemaker_1.1.14-2ubuntu1.4_amd64.deb ... Unpacking pacemaker (1.1.14-2ubuntu1.4) over (1.1.14-2ubuntu1.3) ... Preparing to unpack .../corosync_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking corosync (2.3.5-3ubuntu2.1) over (2.3.5-3ubuntu2) ... Processing triggers for systemd (229-4ubuntu21.1) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for man-db (2.7.5-1) ... Setting up corosync (2.3.5-3ubuntu2.1) ... Setting up pacemaker (1.1.14-2ubuntu1.4) ... # dpkg ii corosync 2.3.5-3ubuntu2.1 amd64 cluster engine daemon and utilities ii pacemaker 1.1.14-2ubuntu1.4 amd64 cluster resource manager # systemctl status corosync | egrep "Active:|PID:" Active: active (running) since Tue 2018-02-27 13:42:54 UTC; 23s ago Main PID: 6562 (corosync) # systemctl status pacemaker | egrep "Active:|PID:" Active: active (running) since Tue 2018-02-27 13:42:54 UTC; 25s ago Main PID: 6652 (pacemakerd) * == corosync upgrade (with pacemaker not installed) == # systemctl status corosync Active: active (running) since Tue 2018-02-27 14:02:51 UTC; 17s ago Main PID: 1488 (corosync) # apt-get install corosync -y Reading package lists... Done Building dependency tree Reading state information... Done The following package was automatically installed and is no longer required: libfreetype6 Use 'apt autoremove' to remove it. The following packages will be upgraded: corosync 1 upgraded, 0 newly installed, 0 to remove and 36 not upgraded. Need to get 168 kB of archives. After this operation, 1024 B of additional disk space will be used. Get:1 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 corosync amd64 2.3.5-3ubuntu2.1 [168 kB] Fetched 168 kB in 0s (260 kB/s) (Reading database ... 25722 files and directories currently installed.) Preparing to unpack .../corosync_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking corosync (2.3.5-3ubuntu2.1) over (2.3.5-3ubuntu2) ... Processing triggers for systemd (229-4ubuntu21.1) ... Processing triggers for ureadahead (0.100.0-19) ... Processing triggers for man-db (2.7.5-1) ... Setting up corosync (2.3.5-3ubuntu2.1) ... # systemctl status corosync Loaded: loaded (/lib/systemd/system/corosync.service; enabled; vendor preset: enabled) Active: active (running) since Tue 2018-02-27 14:03:18 UTC; 3s ago * == corosync installation == # apt-get install corosync Reading package lists... Done Building dependency tree Reading state information... Done The following package was automatically installed and is no longer required: libfreetype6 Use 'apt autoremove' to remove it. The following additional packages will be installed: libcfg6 libcmap4 libcorosync-common4 libcpg4 libibverbs1 libnspr4 libnss3 libnss3-nssdb libqb0 libquorum5 librdmacm1 libstatgrab10 libtotem-pg5 libvotequorum7 libxslt1.1 xsltproc The following NEW packages will be installed: corosync libcfg6 libcmap4 libcorosync-common4 libcpg4 libibverbs1 libnspr4 libnss3 libnss3-nssdb libqb0 libquorum5 librdmacm1 libstatgrab10 libtotem-pg5 libvotequorum7 libxslt1.1 xsltproc 0 upgraded, 17 newly installed, 0 to remove and 29 not upgraded. Need to get 1879 kB of archives. After this operation, 7816 kB of additional disk space will be used. Do you want to continue? [Y/n] y Get:1 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libcorosync-common4 amd64 2.3.5-3ubuntu2.1 [9508 B] Get:2 http://archive.ubuntu.com/ubuntu xenial/main amd64 libqb0 amd64 0.17.2.real-6ubuntu1 [57.0 kB] Get:3 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libcfg6 amd64 2.3.5-3ubuntu2.1 [7476 B] Get:4 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libcmap4 amd64 2.3.5-3ubuntu2.1 [9368 B] Get:5 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libcpg4 amd64 2.3.5-3ubuntu2.1 [10.5 kB] Get:6 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libquorum5 amd64 2.3.5-3ubuntu2.1 [6398 B] Get:7 http://archive.ubuntu.com/ubuntu xenial/main amd64 libstatgrab10 amd64 0.91-1 [33.7 kB] Get:8 http://archive.ubuntu.com/ubuntu xenial/main amd64 libibverbs1 amd64 1.1.8-1.1ubuntu2 [25.0 kB] Get:9 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnspr4 amd64 2:4.13.1-0ubuntu0.16.04.1 [112 kB] Get:10 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3-nssdb all 2:3.28.4-0ubuntu0.16.04.3 [10.6 kB] Get:11 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libnss3 amd64 2:3.28.4-0ubuntu0.16.04.3 [1148 kB] Get:12 http://archive.ubuntu.com/ubuntu xenial/main amd64 librdmacm1 amd64 1.0.21-1 [49.1 kB] Get:13 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libtotem-pg5 amd64 2.3.5-3ubuntu2.1 [65.7 kB] Get:14 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 libvotequorum7 amd64 2.3.5-3ubuntu2.1 [7484 B] Get:15 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 libxslt1.1 amd64 1.1.28-2.1ubuntu0.1 [145 kB] Get:16 http://archive.ubuntu.com/ubuntu xenial-updates/main amd64 xsltproc amd64 1.1.28-2.1ubuntu0.1 [13.4 kB] Get:17 http://archive.ubuntu.com/ubuntu xenial-proposed/main amd64 corosync amd64 2.3.5-3ubuntu2.1 [168 kB] Fetched 1879 kB in 2s (642 kB/s) Selecting previously unselected package libcorosync-common4:amd64. (Reading database ... 25549 files and directories currently installed.) Preparing to unpack .../libcorosync-common4_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libcorosync-common4:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libqb0:amd64. Preparing to unpack .../libqb0_0.17.2.real-6ubuntu1_amd64.deb ... Unpacking libqb0:amd64 (0.17.2.real-6ubuntu1) ... Selecting previously unselected package libcfg6:amd64. Preparing to unpack .../libcfg6_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libcfg6:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libcmap4:amd64. Preparing to unpack .../libcmap4_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libcmap4:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libcpg4:amd64. Preparing to unpack .../libcpg4_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libcpg4:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libquorum5:amd64. Preparing to unpack .../libquorum5_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libquorum5:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libstatgrab10. Preparing to unpack .../libstatgrab10_0.91-1_amd64.deb ... Unpacking libstatgrab10 (0.91-1) ... Selecting previously unselected package libibverbs1. Preparing to unpack .../libibverbs1_1.1.8-1.1ubuntu2_amd64.deb ... Unpacking libibverbs1 (1.1.8-1.1ubuntu2) ... Selecting previously unselected package libnspr4:amd64. Preparing to unpack .../libnspr4_2%3a4.13.1-0ubuntu0.16.04.1_amd64.deb ... Unpacking libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ... Selecting previously unselected package libnss3-nssdb. Preparing to unpack .../libnss3-nssdb_2%3a3.28.4-0ubuntu0.16.04.3_all.deb ... Unpacking libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ... Selecting previously unselected package libnss3:amd64. Preparing to unpack .../libnss3_2%3a3.28.4-0ubuntu0.16.04.3_amd64.deb ... Unpacking libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ... Selecting previously unselected package librdmacm1. Preparing to unpack .../librdmacm1_1.0.21-1_amd64.deb ... Unpacking librdmacm1 (1.0.21-1) ... Selecting previously unselected package libtotem-pg5:amd64. Preparing to unpack .../libtotem-pg5_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libtotem-pg5:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libvotequorum7:amd64. Preparing to unpack .../libvotequorum7_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking libvotequorum7:amd64 (2.3.5-3ubuntu2.1) ... Selecting previously unselected package libxslt1.1:amd64. Preparing to unpack .../libxslt1.1_1.1.28-2.1ubuntu0.1_amd64.deb ... Unpacking libxslt1.1:amd64 (1.1.28-2.1ubuntu0.1) ... Selecting previously unselected package xsltproc. Preparing to unpack .../xsltproc_1.1.28-2.1ubuntu0.1_amd64.deb ... Unpacking xsltproc (1.1.28-2.1ubuntu0.1) ... Selecting previously unselected package corosync. Preparing to unpack .../corosync_2.3.5-3ubuntu2.1_amd64.deb ... Unpacking corosync (2.3.5-3ubuntu2.1) ... Processing triggers for libc-bin (2.23-0ubuntu10) ... Processing triggers for man-db (2.7.5-1) ... Processing triggers for systemd (229-4ubuntu21.1) ... Processing triggers for ureadahead (0.100.0-19) ... Setting up libcorosync-common4:amd64 (2.3.5-3ubuntu2.1) ... Setting up libqb0:amd64 (0.17.2.real-6ubuntu1) ... Setting up libcfg6:amd64 (2.3.5-3ubuntu2.1) ... Setting up libcmap4:amd64 (2.3.5-3ubuntu2.1) ... Setting up libcpg4:amd64 (2.3.5-3ubuntu2.1) ... Setting up libquorum5:amd64 (2.3.5-3ubuntu2.1) ... Setting up libstatgrab10 (0.91-1) ... Setting up libibverbs1 (1.1.8-1.1ubuntu2) ... Setting up libnspr4:amd64 (2:4.13.1-0ubuntu0.16.04.1) ... Setting up librdmacm1 (1.0.21-1) ... Setting up libvotequorum7:amd64 (2.3.5-3ubuntu2.1) ... Setting up libxslt1.1:amd64 (1.1.28-2.1ubuntu0.1) ... Setting up xsltproc (1.1.28-2.1ubuntu0.1) ... Setting up libnss3-nssdb (2:3.28.4-0ubuntu0.16.04.3) ... Setting up libnss3:amd64 (2:3.28.4-0ubuntu0.16.04.3) ... Setting up libtotem-pg5:amd64 (2.3.5-3ubuntu2.1) ... Setting up corosync (2.3.5-3ubuntu2.1) ... Processing triggers for libc-bin (2.23-0ubuntu10) ... Processing triggers for systemd (229-4ubuntu21.1) ... Processing triggers for ureadahead (0.100.0-19) ... -- You received this bug notification because you are a member of STS Sponsors, which is subscribed to the bug report. https://bugs.launchpad.net/bugs/1740892 Title: corosync upgrade on 2018-01-02 caused pacemaker to fail Status in OpenStack hacluster charm: Invalid Status in corosync package in Ubuntu: Fix Released Status in pacemaker package in Ubuntu: Fix Released Status in corosync source package in Trusty: Won't Fix Status in pacemaker source package in Trusty: Won't Fix Status in corosync source package in Xenial: Fix Committed Status in pacemaker source package in Xenial: Fix Committed Status in corosync source package in Artful: Fix Committed Status in pacemaker source package in Artful: Fix Committed Status in corosync source package in Bionic: Fix Released Status in corosync package in Debian: New Bug description: [Impact] When corosync and pacemaker are both installed, a corosync upgrade caused pacemaker to fail. pacemaker will need to be restarted manually to work again, it won't recover by itself. [Test Case] 1) Have corosync (< 2.3.5-3ubuntu2) and pacemaker (< 1.1.14-2ubuntu1.3) installed 2) Make sure corosync & pacemaker are running via systemctl status cmd. 3) Upgrade corosync 4) Look corosync and pacemaker via systemctl status cmd again. You will notice pacemaker is dead (inactive) and doesn't recover, unless a systemctl start pacemaker is done manually. [Regression Potential] Regression potential is low, it doesn't change corosync/pacemaker core functionality. This patch make sure thing goes smoother at the packaging level during a corosync upgrade where pacemaker is installed/involved. This can also be useful in particular in situation where the system has "unattended-upgrades" enable (software upgrades without supervision), and no sysadmin available to start pacemaker manually because this isn't a schedule maintenance. For the symbol tag change in Artful to (optional), please refer yourself to comment #60 from slangasek. For the asctime change in Artful, please refer yourself to comment #51 & comment #52. Note that both Artful changes in pacemaker above are only necessary for the package to build (even as-is without this patch). They aren't a requirement for the patch the work, but for the src pkg to build. [Other Info] XENIAL Merge-proposal: https://code.launchpad.net/~nacc/ubuntu/+source/corosync/+git/corosync/+merge/336338 https://code.launchpad.net/~nacc/ubuntu/+source/pacemaker/+git/pacemaker/+merge/336339 [Original Description] During upgrades on 2018-01-02, corosync and it's libs were upgraded: (from a trusty/mitaka cloud) Upgrade: libcmap4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), corosync:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcfg6:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcpg4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libquorum5:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libcorosync-common4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libsam4:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libvotequorum6:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4), libtotem-pg5:amd64 (2.3.3-1ubuntu3, 2.3.3-1ubuntu4) During this process, it appears that pacemaker service is restarted and it errors: syslog:Jan 2 16:09:33 juju-machine-0-lxc-4 pacemakerd[1994]: notice: crm_update_peer_state: pcmk_quorum_notification: Node juju-machine-1-lxc-3[1001] - state is now lost (was member) syslog:Jan 2 16:09:34 juju-machine-0-lxc-4 pacemakerd[1994]: notice: crm_update_peer_state: pcmk_quorum_notification: Node juju-machine-1-lxc-3[1001] - state is now member (was lost) syslog:Jan 2 16:14:32 juju-machine-0-lxc-4 pacemakerd[1994]: error: cfg_connection_destroy: Connection destroyed syslog:Jan 2 16:14:32 juju-machine-0-lxc-4 pacemakerd[1994]: notice: pcmk_shutdown_worker: Shuting down Pacemaker syslog:Jan 2 16:14:32 juju-machine-0-lxc-4 pacemakerd[1994]: notice: stop_child: Stopping crmd: Sent -15 to process 2050 syslog:Jan 2 16:14:32 juju-machine-0-lxc-4 pacemakerd[1994]: error: pcmk_cpg_dispatch: Connection to the CPG API failed: Library error (2) syslog:Jan 2 16:14:32 juju-machine-0-lxc-4 pacemakerd[1994]: error: mcp_cpg_destroy: Connection destroyed Also affected xenial/ocata To manage notifications about this bug go to: https://bugs.launchpad.net/charm-hacluster/+bug/1740892/+subscriptions -- Mailing list: https://launchpad.net/~sts-sponsors Post to : sts-sponsors@lists.launchpad.net Unsubscribe : https://launchpad.net/~sts-sponsors More help : https://help.launchpad.net/ListHelp