[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Stefan, thanks for the reply. It seems my information was not that
clear. Here some more so it is more clear what my problem was.
The problem is with the pacemaker drbd agent:
/usr/lib/ocf/resource.d/linbit/drbd
Here a snippet of this agent:
-
drbd_start() {
local rc
local status
local first_try=true
rc=$OCF_ERR_GENERIC
if ! is_drbd_enabled; then
do_cmd modprobe -s drbd `$DRBDADM sh-mod-parms` || {
ocf_log err Cannot load the drbd module.;
return $OCF_ERR_INSTALLED
}
drbd_validate_all
ocf_log debug $DRBD_RESOURCE start: Module loaded.
fi
--
The line with drbd_validate_all is the one I added. Without this line, drbd
will not work after reboot.
I hope this clearify a bit more.
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to drbd8 in Ubuntu.
https://bugs.launchpad.net/bugs/1185756
Title:
drbd8-utils not compatible with linux-lts-raring kernel in 12.04
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Ah yes, that helps a lot. So somehow (not sure this is because I am using the Linux Cluster Management Console for setting up my test environment or because timing is just in my favour) I seem to avoid this because the drbd init script already loads the module. So by the time the pacemaker agent runs it does not have to. But I can see how it might happen. In order to get this into a Stable Release Update this should go into a new bug report, though. I believe ubuntu-bug drbd8 should be the simplest way to do this. The description should point out why the module does not get loaded before in your case (if you know). Subscribe me to the new report, then I can spot it more easily. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Stefan, thanks for the reply. It seems my information was not that
clear. Here some more so it is more clear what my problem was.
The problem is with the pacemaker drbd agent:
/usr/lib/ocf/resource.d/linbit/drbd
Here a snippet of this agent:
-
drbd_start() {
local rc
local status
local first_try=true
rc=$OCF_ERR_GENERIC
if ! is_drbd_enabled; then
do_cmd modprobe -s drbd `$DRBDADM sh-mod-parms` || {
ocf_log err Cannot load the drbd module.;
return $OCF_ERR_INSTALLED
}
drbd_validate_all
ocf_log debug $DRBD_RESOURCE start: Module loaded.
fi
--
The line with drbd_validate_all is the one I added. Without this line, drbd
will not work after reboot.
I hope this clearify a bit more.
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1185756
Title:
drbd8-utils not compatible with linux-lts-raring kernel in 12.04
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Ah yes, that helps a lot. So somehow (not sure this is because I am using the Linux Cluster Management Console for setting up my test environment or because timing is just in my favour) I seem to avoid this because the drbd init script already loads the module. So by the time the pacemaker agent runs it does not have to. But I can see how it might happen. In order to get this into a Stable Release Update this should go into a new bug report, though. I believe ubuntu-bug drbd8 should be the simplest way to do this. The description should point out why the module does not get loaded before in your case (if you know). Subscribe me to the new report, then I can spot it more easily. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Jacob, sorry for the long delay. I tried to confirm your report but could not see any problem (drbd8 version 2:8.4.3-0ubuntu0.12.04.2). Not sure whether you refer to eval $(drbdadm --version ...) in /etc/init.d/drbd. That could indeed be wrong on start. Though the values are actually only evaluated for stop. Probably should be moved there for being more obvious. If you still see the issue (there were a lot of compat mode issues fixed between 12.04.1 and .2) it would be best to open a new bug report to find out what the cause is. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Jacob, sorry for the long delay. I tried to confirm your report but could not see any problem (drbd8 version 2:8.4.3-0ubuntu0.12.04.2). Not sure whether you refer to eval $(drbdadm --version ...) in /etc/init.d/drbd. That could indeed be wrong on start. Though the values are actually only evaluated for stop. Probably should be moved there for being more obvious. If you still see the issue (there were a lot of compat mode issues fixed between 12.04.1 and .2) it would be best to open a new bug report to find out what the cause is. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I had the same problem and found out that there is a different behaviour of the drbd agent between just stop and start the drbd resource or rebooting the system. When you stop drbd, the drbd module stay loaded so when you start drbd again, the validity check of the agent correctly detects an 8.3 module. However when you reboot, no module is loaded yet so the validity check thinks we have an 8.4 module. Then the agent loads the module but does not check the validity any more. So it uses the 8.4 tools to create the drbd devices. This fails! Adding a call to the validity check function just after the module is loaded fixes this problem. So no need to revert. I just found this by trial and error so it could have side effects. Maybe Stefan can confirm that this is really fixing something. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I had the same problem and found out that there is a different behaviour of the drbd agent between just stop and start the drbd resource or rebooting the system. When you stop drbd, the drbd module stay loaded so when you start drbd again, the validity check of the agent correctly detects an 8.3 module. However when you reboot, no module is loaded yet so the validity check thinks we have an 8.4 module. Then the agent loads the module but does not check the validity any more. So it uses the 8.4 tools to create the drbd devices. This fails! Adding a call to the validity check function just after the module is loaded fixes this problem. So no need to revert. I just found this by trial and error so it could have side effects. Maybe Stefan can confirm that this is really fixing something. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hi, I had same problem during a regular update. The package from http://people.canonical.com/~smb/lp1185756/ works for me in individual DRBD config and Pacemaker/Heartbeat env. Thank you! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hi, I had same problem during a regular update. The package from http://people.canonical.com/~smb/lp1185756/ works for me in individual DRBD config and Pacemaker/Heartbeat env. Thank you! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I can confirm that solution in #97 (i.e. #71) worked for me as well (also Pacemaker/Heartbeat). # uname -a Linux server 3.5.0-49-generic #74~precise1-Ubuntu SMP Fri May 2 21:32:31 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # drbdadm --version : identical # echo drbd8-utils hold | dpkg --set-selections To make sure the package won't get upgraded without my noticing. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I can confirm that solution in #97 (i.e. #71) worked for me as well (also Pacemaker/Heartbeat). # uname -a Linux server 3.5.0-49-generic #74~precise1-Ubuntu SMP Fri May 2 21:32:31 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # drbdadm --version : identical # echo drbd8-utils hold | dpkg --set-selections To make sure the package won't get upgraded without my noticing. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I was able to fix this by downgrading drbd8-utils as explained in #71, Pacemaker/heartbeat. CRM is again UP! # uname -a Linux flexfive 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # drbdadm --version DRBD module version: 8.3.13 userland version: 8.3.11 you should upgrade your drbd tools! DRBDADM_BUILDTAG=GIT-hash:\ 0de839cee13a4160eed6037c4bddd066645e23c5\ build\ by\ buildd@allspice\,\ 2011-07-05\ 19:51:07 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030d DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I was able to fix this by downgrading drbd8-utils as explained in #71, Pacemaker/heartbeat. CRM is again UP! # uname -a Linux flexfive 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # drbdadm --version DRBD module version: 8.3.13 userland version: 8.3.11 you should upgrade your drbd tools! DRBDADM_BUILDTAG=GIT-hash:\ 0de839cee13a4160eed6037c4bddd066645e23c5\ build\ by\ buildd@allspice\,\ 2011-07-05\ 19:51:07 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030d DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
FTR, my reported bug was triggered by the environment variable DRBD_DONT_WARN_ON_VERSION_MISMATCH, which was set on my systems. To work around this bug: unset DRBD_DONT_WARN_ON_VERSION_MISMATCH restart pacemaker (do this before installing drbd8-utils 8.4.3-0ubuntu0.12.04.x) See also: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1314598 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
FTR, my reported bug was triggered by the environment variable DRBD_DONT_WARN_ON_VERSION_MISMATCH, which was set on my systems. To work around this bug: unset DRBD_DONT_WARN_ON_VERSION_MISMATCH restart pacemaker (do this before installing drbd8-utils 8.4.3-0ubuntu0.12.04.x) See also: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1314598 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I hope if I can get someone to sponsor the upload. Of course every positive feedback about the last version helps me in my argument. :) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I still have problems after upgrading to drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4. Especially the pacemaker drbd agent does not work (/usr/lib/ocf/resource.d/linbit/drbd). For example, there is a line do_drbdadm $DRBD_TO_PEER -v adjust $DRBD_RESOURCE which translates to drbdadm -c /etc/drbd.conf --peer host01.example.com -v adjust res1. This results in an error: drbdsetup new-resource res1 USAGE: drbdsetup device command arguments options Device is usually /dev/drbdX or /dev/drbd/X. General options: --create-device, --set-defaults Commands are: [lots ofcommands...] To get more details about a command issue 'drbdsetup help cmd'. invalid command Command 'drbdsetup new-resource res1' terminated with exit code 20 $ uname -a Linux coreboso-vsb02.coreboso.de 3.2.0-60-generic #91-Ubuntu SMP Wed Feb 19 03:54:44 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux drbd version 8.3.11 I really think that 2:8.4.3-0ubuntu0.12.04.1 should be removed from udpates until this issue is resolved. It breaks working pacemaker clusters. Many thanks for all your work and efforts! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I can confirm that drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4 works fine, at least for me. I put one node to standby, installed drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4, did not change drbd.conf, brought node up again and migrated all resources to that node. Everything is working as expected: Master/Slave Set: ms_drbd_r0 [p_drbd_r0] Masters: [ www6b ] Slaves: [ www6a ] # uname -a Linux www6b 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # cat /proc/drbd version: 8.3.13 (api:88/proto:86-96) srcversion: C0F510A918B92928FB51EE3 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r- ns:72 nr:788 dw:860 dr:7561 al:0 bm:8 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Thilo, this is odd. Locally I see the same adjust command but it will get translated into a drbdadm-83 call which works. Would it be possible for you to create '/tmp/drbd.ocf.ra.debug', set it to chmod 700 for root and touch /tmp/drbd.ocf.ra.debug/log as root. Then service corosync restart will restart the cluster and execution of the resource agent gets logged into /tmp. That file would help to help to figure out what is going wrong. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Thilo, I looked at the debug data you sent me and somehow it seems that using hearbeat runs a different resource agent. So drbd itself ships a resource agent in /usr/lib/ocf/resource.d/linbit/drbd but hearbeat uses another one (.../resource.d/heartbeat/drbd) that comes with a different package (resource-agents). I could not yet compare the scripts but glancing on the output this looks pretty similar. If you create a backup of the drbd file in the heartbeat directory and then copy the drbd file from linbit over to the heartbeat directory would that work? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Must admit the two scripts as they are installed on my test system differ more. Weirdly in your output there was a version check of ++ DRBDADM_VERSION_CODE=0x08030b ++ DRBDADM_VERSION=8.3.11 + (( 0x08030b = 0x080302 )) and that check I cannot find in the heartbeat/drbd script. And the linbit/drbd script in rc4 would compare against 0x080400. So I am not sure what script is actually running. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
That really depends on the Pacemaker configuration. If the primitive DRBD resource uses ocf::heartbeat::drbd, it's the resource agent from resource-agents, /usr/lib/ocf/resource.d/heartbeat/drbd, which is ancient and shouldn't be used. If the primitive, however, uses ocf::linbit::drbd, it's the one in /usr/lib/ocf/resource.d/linbit/drbd, which should be fine. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Thanks, Martin, fot the clarification. The ocf::linbit::drbd agent is (and was) configured, so that's not the source of the problem. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Right, thanks Martin. So Thilo, the mysterious question is what is actually executed. If you manually unpack the rc4 deb: dpkg -x drbd8-utils_8.4.3-0ubuntu0.12.04.2~rc4_amd64.deb unpack and compare unpack/usr/lib/ocf/resource.d/linbit/drbd with what is in /usr/lib/... they should be the same. And if you look at the script you should find the version check (look for 080400) and if the version is lower the binary names are replaced by -83 compat variants... -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
regression is tracked under bug 1314289 ** Description changed: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack + upload caused regression bug 1314289. + ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I hope if I can get someone to sponsor the upload. Of course every positive feedback about the last version helps me in my argument. :) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I still have problems after upgrading to drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4. Especially the pacemaker drbd agent does not work (/usr/lib/ocf/resource.d/linbit/drbd). For example, there is a line do_drbdadm $DRBD_TO_PEER -v adjust $DRBD_RESOURCE which translates to drbdadm -c /etc/drbd.conf --peer host01.example.com -v adjust res1. This results in an error: drbdsetup new-resource res1 USAGE: drbdsetup device command arguments options Device is usually /dev/drbdX or /dev/drbd/X. General options: --create-device, --set-defaults Commands are: [lots ofcommands...] To get more details about a command issue 'drbdsetup help cmd'. invalid command Command 'drbdsetup new-resource res1' terminated with exit code 20 $ uname -a Linux coreboso-vsb02.coreboso.de 3.2.0-60-generic #91-Ubuntu SMP Wed Feb 19 03:54:44 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux drbd version 8.3.11 I really think that 2:8.4.3-0ubuntu0.12.04.1 should be removed from udpates until this issue is resolved. It breaks working pacemaker clusters. Many thanks for all your work and efforts! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I can confirm that drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4 works fine, at least for me. I put one node to standby, installed drbd8-utils 2:8.4.3-0ubuntu0.12.04.2~rc4, did not change drbd.conf, brought node up again and migrated all resources to that node. Everything is working as expected: Master/Slave Set: ms_drbd_r0 [p_drbd_r0] Masters: [ www6b ] Slaves: [ www6a ] # uname -a Linux www6b 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux # cat /proc/drbd version: 8.3.13 (api:88/proto:86-96) srcversion: C0F510A918B92928FB51EE3 0: cs:Connected ro:Primary/Secondary ds:UpToDate/UpToDate C r- ns:72 nr:788 dw:860 dr:7561 al:0 bm:8 lo:0 pe:0 ua:0 ap:0 ep:1 wo:f oos:0 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Thilo, this is odd. Locally I see the same adjust command but it will get translated into a drbdadm-83 call which works. Would it be possible for you to create '/tmp/drbd.ocf.ra.debug', set it to chmod 700 for root and touch /tmp/drbd.ocf.ra.debug/log as root. Then service corosync restart will restart the cluster and execution of the resource agent gets logged into /tmp. That file would help to help to figure out what is going wrong. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Thilo, I looked at the debug data you sent me and somehow it seems that using hearbeat runs a different resource agent. So drbd itself ships a resource agent in /usr/lib/ocf/resource.d/linbit/drbd but hearbeat uses another one (.../resource.d/heartbeat/drbd) that comes with a different package (resource-agents). I could not yet compare the scripts but glancing on the output this looks pretty similar. If you create a backup of the drbd file in the heartbeat directory and then copy the drbd file from linbit over to the heartbeat directory would that work? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Must admit the two scripts as they are installed on my test system differ more. Weirdly in your output there was a version check of ++ DRBDADM_VERSION_CODE=0x08030b ++ DRBDADM_VERSION=8.3.11 + (( 0x08030b = 0x080302 )) and that check I cannot find in the heartbeat/drbd script. And the linbit/drbd script in rc4 would compare against 0x080400. So I am not sure what script is actually running. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
That really depends on the Pacemaker configuration. If the primitive DRBD resource uses ocf::heartbeat::drbd, it's the resource agent from resource-agents, /usr/lib/ocf/resource.d/heartbeat/drbd, which is ancient and shouldn't be used. If the primitive, however, uses ocf::linbit::drbd, it's the one in /usr/lib/ocf/resource.d/linbit/drbd, which should be fine. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Thanks, Martin, fot the clarification. The ocf::linbit::drbd agent is (and was) configured, so that's not the source of the problem. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Right, thanks Martin. So Thilo, the mysterious question is what is actually executed. If you manually unpack the rc4 deb: dpkg -x drbd8-utils_8.4.3-0ubuntu0.12.04.2~rc4_amd64.deb unpack and compare unpack/usr/lib/ocf/resource.d/linbit/drbd with what is in /usr/lib/... they should be the same. And if you look at the script you should find the version check (look for 080400) and if the version is lower the binary names are replaced by -83 compat variants... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
regression is tracked under bug 1314289 ** Description changed: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack + upload caused regression bug 1314289. + ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Stefan, thank you for the fixes! Will your version find its way to the update-repo for 12.04lts? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Stefan, thank you for the fixes! Will your version find its way to the update-repo for 12.04lts? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I tried the fixed package in comment 60. Unfortunately, the fix did not completely resolve the problems I had with my Corosync/Pacemaker cluster. I also noticed, that I had problems with the new global_common.conf parameters, that is being installed with drbd-utils 8.4.3: # service drbd start * Starting DRBD resources drbd.d/global_common.conf:47: Parse error: 'an option keyword' expected, but got 'resync-rate' So then I restored the old global_common.conf again. Now I could start DRBD services manually, but the cluster still did not work: Apr 25 08:37:32 www6a lrmd: [1183]: info: RA output: (p_drbd_r0:0:start:stderr) drbdadm: Unknown command 'syncer' I can't really say what the problem is, but it seems the service scripts use drbd-utils version 8.3 and the cluster uses drbd-utils 8.4 or something like that. Any ideas? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Well yes, there are already plenty of hints in this thread. The problem is that while having a config option to enable those compat binaries, those do not seem to be very well tested. I am working on it but its a bit of a mess. I think I got the ra script in a state now where it seems to work in the normal case but trying to use migrate from LCMC ended in a split-brain state. Also LCMC seems to decide whether it allows to set up a drbd mirror based on some magic I have not yet figured out. So that gets deactivated as soon as one side installs the new package. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Updated http://people.canonical.com/~smb/lp1185756/ with packages that seem to fix normal corosync startup at least. Still not perfect. Migrate through the LCMC gui might still be a problem. I need to look into that next. Also if someone knows from the top of their head what the LCMC gui does to decide whether on can create a new drbd mirror on top of an existing volume, please let me know. That gets disabled when one side runs the new package and I can figure out why. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
** Patch added: Debdiff for rc2 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096314/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Finally figured out the problem with LCMC which maybe also improves other drbdsetup oddness. The problem is that unlike drbdadm, drbdsetup did not use the kernel drbd module version to decide whether it should run the legacy binary. Instead it waited for some socket connection to fail. But that happened relatively late and so at least the xml help would only be processed by the main command. And of course the arguments for that have been changed by upstream as well (help-xml instead of xml). I added some code to additionally check /proc/drbd and in case of a module version 8.4.0 run the legacy drbdsetup immediately. So far this allowed to use LCMC to define a new drbd resource and selecting migrate for the resource would display it as migrated instead of exploding. This should also be tested after installing a later kernel. But if the version as it is now unbreaks at least the users of 3.2 kernels its probably best to go with that and make fixes to the lts-kernel case later on top. Better than breaking current installs. ** Patch added: Debdiff for rc3 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096607/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
*sigh* Final update, at least this week. With rc4 my code actually does the right thing. Updated the kernel on one side to a 3.11 one and then the other side to the new package (keeping the 3.2 kernel there). From what I can tell, the cluster seems happy with that. ** Patch added: Debdiff for rc4 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096710/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Stefan, your rc4 update seems to have nailed it! My cluster running the 3.2 kernel is now happy. The new fix you used also pleases Ganeti. Thanks! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I tried the fixed package in comment 60. Unfortunately, the fix did not completely resolve the problems I had with my Corosync/Pacemaker cluster. I also noticed, that I had problems with the new global_common.conf parameters, that is being installed with drbd-utils 8.4.3: # service drbd start * Starting DRBD resources drbd.d/global_common.conf:47: Parse error: 'an option keyword' expected, but got 'resync-rate' So then I restored the old global_common.conf again. Now I could start DRBD services manually, but the cluster still did not work: Apr 25 08:37:32 www6a lrmd: [1183]: info: RA output: (p_drbd_r0:0:start:stderr) drbdadm: Unknown command 'syncer' I can't really say what the problem is, but it seems the service scripts use drbd-utils version 8.3 and the cluster uses drbd-utils 8.4 or something like that. Any ideas? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Well yes, there are already plenty of hints in this thread. The problem is that while having a config option to enable those compat binaries, those do not seem to be very well tested. I am working on it but its a bit of a mess. I think I got the ra script in a state now where it seems to work in the normal case but trying to use migrate from LCMC ended in a split-brain state. Also LCMC seems to decide whether it allows to set up a drbd mirror based on some magic I have not yet figured out. So that gets deactivated as soon as one side installs the new package. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
** Patch added: Debdiff for rc2 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096314/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Updated http://people.canonical.com/~smb/lp1185756/ with packages that seem to fix normal corosync startup at least. Still not perfect. Migrate through the LCMC gui might still be a problem. I need to look into that next. Also if someone knows from the top of their head what the LCMC gui does to decide whether on can create a new drbd mirror on top of an existing volume, please let me know. That gets disabled when one side runs the new package and I can figure out why. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Finally figured out the problem with LCMC which maybe also improves other drbdsetup oddness. The problem is that unlike drbdadm, drbdsetup did not use the kernel drbd module version to decide whether it should run the legacy binary. Instead it waited for some socket connection to fail. But that happened relatively late and so at least the xml help would only be processed by the main command. And of course the arguments for that have been changed by upstream as well (help-xml instead of xml). I added some code to additionally check /proc/drbd and in case of a module version 8.4.0 run the legacy drbdsetup immediately. So far this allowed to use LCMC to define a new drbd resource and selecting migrate for the resource would display it as migrated instead of exploding. This should also be tested after installing a later kernel. But if the version as it is now unbreaks at least the users of 3.2 kernels its probably best to go with that and make fixes to the lts-kernel case later on top. Better than breaking current installs. ** Patch added: Debdiff for rc3 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096607/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
*sigh* Final update, at least this week. With rc4 my code actually does the right thing. Updated the kernel on one side to a 3.11 one and then the other side to the new package (keeping the 3.2 kernel there). From what I can tell, the cluster seems happy with that. ** Patch added: Debdiff for rc4 level. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4096710/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Stefan, your rc4 update seems to have nailed it! My cluster running the 3.2 kernel is now happy. The new fix you used also pleases Ganeti. Thanks! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I also had a problem starting DRBD with my Corosync/Pacemaker cluster after upgrading drbd8-utils to 8.4.3. This is a line from the log file where it is failing: Apr 24 08:21:02 www6a lrmd: [1183]: info: RA output: (p_drbd_r0:0:start:stderr) Could not connect to 'drbd' generic netlink family Command 'drbdsetup new-resource r0' terminated with exit code 20 I am running Linux kernel 3.5.0-48 on Ubuntu 12.04.4 LTS # uname -a Linux www6a 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux DRBD module was always at version 8.3.13 # cat /proc/drbd version: 8.3.13 (api:88/proto:86-96) srcversion: C0F510A918B92928FB51EE3 I was able to fix it by downgrading drbd8-utils again: # apt-get install drbd8-utils=2:8.3.11-0ubuntu1 Also removing startup scripts: # update-rc.d -f drbd remove -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Rocco, the problem is that there did not seem to be any sane way to do a separate package and dependencies. You cannot depend on it in the lts kernel package because drbd is not a required package. In don't know of any way in Debian packaging to declare complex relationships like if package a gets installed and package b is installed then replace b with c. And even if there would, installing the lts-kernel package does not automatically remove the non-hwe kernels (for people that installed with the original release or .1 update images). So since the kernels can be installed in parallel, the two drbd package would need to be there in parallel, too. So backporting the newer drbd userspace and enabling the compat binaries looked to be the best way. And at least testing with a resource defined in drbd, I could install the new package and get the drbd disk up with old-kernel/old package, old kernel/new package and newer kernel/newer package. And only because of that we went ahead with the backport. So right now it seems like people who only use drbd resource are ok but clusters using drbd (pacemaker only or others?) are unfortunately broken. Hopefully we can figure out what goes wrong quickly. Unfortunately setting up a test cluster is not the most trivial thing to do when starting from zero. I started but right now I got the general config ok but no drbd resources defined. So far, the only way with a 3.2 kernel and the new packager where I can get the drbdadm syncer command to fail like it was reported is to remove the drbd module. Then there is no /proc/drbd and drbdadm --version reports the 8.4 .x version. And that does not cause the drbdadm-83 binary to be chain-executed. So syncer is no valid command. The drbd package ships with a drbd.ocf file (from reading guides on the web it feels like that could be related to use drbd from pacemaker). That script also does call drbdadm --version to decide whether to use the syncer command or not. But maybe there are places in pacemaker code that run drbdadm commands directly. Still, if those execute the drbdadm command that comes with the new drbd package that should automatically execute the compat binary as long as the old kernel is running and the drbd module is loaded. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hello, the Linux Cluster Management Console (LCMC) makes it quite easy to setup a DRBD/Pacemaker cluster. http://lcmc.sourceforge.net/ Christoph - Ursprüngliche Mail - Von: Stefan Bader stefan.ba...@canonical.com An: cmita...@thomas-krenn.com Gesendet: Donnerstag, 24. April 2014 10:35:01 Betreff: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 @Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to:
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
My clusters are configured to use Linbit:drbd which is: /usr/lib/ocf/resource.d/linbit/drbd and that file is in drbd8-utils On Thu, Apr 24, 2014 at 10:45 AM, Christoph Mitasch cmita...@thomas-krenn.com wrote: Hello, the Linux Cluster Management Console (LCMC) makes it quite easy to setup a DRBD/Pacemaker cluster. http://lcmc.sourceforge.net/ Christoph - Ursprüngliche Mail - Von: Stefan Bader stefan.ba...@canonical.com An: cmita...@thomas-krenn.com Gesendet: Donnerstag, 24. April 2014 10:35:01 Betreff: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 @Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- You received this
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I'm not sure if anyone has mentioned it yet, but the command syntax to the drbdsetup command has changed totally between drbd8-utils 8.3 and 8.4 e.g. if you are using drbd-utils 8.3 then the command is drbdsetup /dev/drbd0 show if you are using drbd-utils 8.4 then the command is drbdsetup show /dev/drbd0 Therefore if you upgrade your kernel to the raring enablement one, your pacemaker (etc) scripts will break too. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hmm, just to clarify: when using the drbd8-utils 8.4 package and the kernel module 8.3, then drbdsetup execs the drbdsetup-83 compatibility module which implements the old syntax, and will also if necessary swap the first two arguments for forward compatibility However there are some commands that drbdsetup from drbd8-utils 8.3.10 accepts but drbdsetup-83 doesn't. For example, ganeti issues the following command: drbdsetup /dev/drbd2 disk /dev/xenvg/a614fd3b-d016-44a1-a6d6-c51334190757.disk0_data /dev/xenvg/a614fd3b-d016-44a1-a6d6-c51334190757.disk0_meta 0 -e detach --create-device -d 1024m This works with drbd8-utils 8.3.10, but gives USAGE: drbdsetup command device arguments options with 8.4 -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I also had a problem starting DRBD with my Corosync/Pacemaker cluster after upgrading drbd8-utils to 8.4.3. This is a line from the log file where it is failing: Apr 24 08:21:02 www6a lrmd: [1183]: info: RA output: (p_drbd_r0:0:start:stderr) Could not connect to 'drbd' generic netlink family Command 'drbdsetup new-resource r0' terminated with exit code 20 I am running Linux kernel 3.5.0-48 on Ubuntu 12.04.4 LTS # uname -a Linux www6a 3.5.0-48-generic #72~precise1-Ubuntu SMP Tue Mar 11 20:09:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux DRBD module was always at version 8.3.13 # cat /proc/drbd version: 8.3.13 (api:88/proto:86-96) srcversion: C0F510A918B92928FB51EE3 I was able to fix it by downgrading drbd8-utils again: # apt-get install drbd8-utils=2:8.3.11-0ubuntu1 Also removing startup scripts: # update-rc.d -f drbd remove -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Rocco, the problem is that there did not seem to be any sane way to do a separate package and dependencies. You cannot depend on it in the lts kernel package because drbd is not a required package. In don't know of any way in Debian packaging to declare complex relationships like if package a gets installed and package b is installed then replace b with c. And even if there would, installing the lts-kernel package does not automatically remove the non-hwe kernels (for people that installed with the original release or .1 update images). So since the kernels can be installed in parallel, the two drbd package would need to be there in parallel, too. So backporting the newer drbd userspace and enabling the compat binaries looked to be the best way. And at least testing with a resource defined in drbd, I could install the new package and get the drbd disk up with old-kernel/old package, old kernel/new package and newer kernel/newer package. And only because of that we went ahead with the backport. So right now it seems like people who only use drbd resource are ok but clusters using drbd (pacemaker only or others?) are unfortunately broken. Hopefully we can figure out what goes wrong quickly. Unfortunately setting up a test cluster is not the most trivial thing to do when starting from zero. I started but right now I got the general config ok but no drbd resources defined. So far, the only way with a 3.2 kernel and the new packager where I can get the drbdadm syncer command to fail like it was reported is to remove the drbd module. Then there is no /proc/drbd and drbdadm --version reports the 8.4 .x version. And that does not cause the drbdadm-83 binary to be chain-executed. So syncer is no valid command. The drbd package ships with a drbd.ocf file (from reading guides on the web it feels like that could be related to use drbd from pacemaker). That script also does call drbdadm --version to decide whether to use the syncer command or not. But maybe there are places in pacemaker code that run drbdadm commands directly. Still, if those execute the drbdadm command that comes with the new drbd package that should automatically execute the compat binary as long as the old kernel is running and the drbd module is loaded. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hello, the Linux Cluster Management Console (LCMC) makes it quite easy to setup a DRBD/Pacemaker cluster. http://lcmc.sourceforge.net/ Christoph - Ursprüngliche Mail - Von: Stefan Bader stefan.ba...@canonical.com An: cmita...@thomas-krenn.com Gesendet: Donnerstag, 24. April 2014 10:35:01 Betreff: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 @Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to:
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
My clusters are configured to use Linbit:drbd which is: /usr/lib/ocf/resource.d/linbit/drbd and that file is in drbd8-utils On Thu, Apr 24, 2014 at 10:45 AM, Christoph Mitasch cmita...@thomas-krenn.com wrote: Hello, the Linux Cluster Management Console (LCMC) makes it quite easy to setup a DRBD/Pacemaker cluster. http://lcmc.sourceforge.net/ Christoph - Ursprüngliche Mail - Von: Stefan Bader stefan.ba...@canonical.com An: cmita...@thomas-krenn.com Gesendet: Donnerstag, 24. April 2014 10:35:01 Betreff: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 @Andreas, that particular error is fixed by the test packages (see comment #60). There could be one in conjunction with pacemaker which reports an error about drbdadm syncer not being a valid command. Unfortunately I don't think anyone who is running a pacemaker cluster really can afford to help debugging as that causes disruptions. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia: Ubuntu-Server 12.04.1 LTS Precise Pangolin - Release amd64 (20120817.3) MarkForUpload: True SourcePackage: linux-lts-raring UpgradeStatus: No upgrade log present (probably fresh install) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- You received this
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I'm not sure if anyone has mentioned it yet, but the command syntax to the drbdsetup command has changed totally between drbd8-utils 8.3 and 8.4 e.g. if you are using drbd-utils 8.3 then the command is drbdsetup /dev/drbd0 show if you are using drbd-utils 8.4 then the command is drbdsetup show /dev/drbd0 Therefore if you upgrade your kernel to the raring enablement one, your pacemaker (etc) scripts will break too. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hmm, just to clarify: when using the drbd8-utils 8.4 package and the kernel module 8.3, then drbdsetup execs the drbdsetup-83 compatibility module which implements the old syntax, and will also if necessary swap the first two arguments for forward compatibility However there are some commands that drbdsetup from drbd8-utils 8.3.10 accepts but drbdsetup-83 doesn't. For example, ganeti issues the following command: drbdsetup /dev/drbd2 disk /dev/xenvg/a614fd3b-d016-44a1-a6d6-c51334190757.disk0_data /dev/xenvg/a614fd3b-d016-44a1-a6d6-c51334190757.disk0_meta 0 -e detach --create-device -d 1024m This works with drbd8-utils 8.3.10, but gives USAGE: drbdsetup command device arguments options with 8.4 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
It is a bit odd. Ok, some warnings seems to be coming from pacemaker commands. Like the WARN: decode_transition_key: Bad UUID (crm-resource-3048) in sscanf result (3) for 0:0:crm-resource-3048 I guess the problem is this: Apr 22 21:55:43 storage0 lrmd: [1242]: info: RA output: (p_drbd_bigpool:0:start:stderr) drbdadm: Unknown command 'syncer' Apr 22 21:55:43 storage0 drbd[3079]: ERROR: bigpool: Called drbdadm -c /etc/drbd.conf syncer bigpool This would mean that drbdadm did not pass control on drbdadm-83. And that would only happen if the current version did not seem to be 8.3. That version number looks to be read from /proc/drbd and would reflect the version of the kernel module. At least as long as reading from /proc/drbd is not failing. Then it would fall back to a version number defined in the command (which would be wrong). Would have been interesting to find out whether calling drbdadm syncer bigpool manually would fail the same way but that would need another maintenance window. Maybe try to see what /proc/drbd is showing. I probably would suggest that we open a new bug report for the cluster case, so this one can be closed with the fix to drbdsetup. Then at least the direct usage seems to work. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
On a side note, I'm not sure why a new package where released for the raring stack? Is there a really brilliant reason for not having two different packages? On 23 Apr 2014 12:06, Stefan Bader stefan.ba...@canonical.com wrote: It is a bit odd. Ok, some warnings seems to be coming from pacemaker commands. Like the WARN: decode_transition_key: Bad UUID (crm-resource-3048) in sscanf result (3) for 0:0:crm-resource-3048 I guess the problem is this: Apr 22 21:55:43 storage0 lrmd: [1242]: info: RA output: (p_drbd_bigpool:0:start:stderr) drbdadm: Unknown command 'syncer' Apr 22 21:55:43 storage0 drbd[3079]: ERROR: bigpool: Called drbdadm -c /etc/drbd.conf syncer bigpool This would mean that drbdadm did not pass control on drbdadm-83. And that would only happen if the current version did not seem to be 8.3. That version number looks to be read from /proc/drbd and would reflect the version of the kernel module. At least as long as reading from /proc/drbd is not failing. Then it would fall back to a version number defined in the command (which would be wrong). Would have been interesting to find out whether calling drbdadm syncer bigpool manually would fail the same way but that would need another maintenance window. Maybe try to see what /proc/drbd is showing. I probably would suggest that we open a new bug report for the cluster case, so this one can be closed with the fix to drbdsetup. Then at least the direct usage seems to work. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia:
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
This was done because later point releases of 12.04 come with newer kernels and the drbd module in later kernels needed the newer userspace. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Rocco, that said (and not remembering), could it be that that server uses a kernel version 3.2.x? What does /proc/drbd say? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
~# cat /proc/drbd version: 8.3.11 (api:88/proto:86-96) srcversion: 93CE421BB73A731BDC72D8E ~# uname -a Linux zed1 3.2.0-60-generic #91-Ubuntu @smb I mean like it states in the header: But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. Why wasn't the new drbd userspace tools needed for the lts-raring stack released as drbd8-utils-lts-raring? Then us people whom installed 12.04 during the beginning wouldn't be affected and people using the newer 12.04.x still could use drbd. The state now is that people whom have upgraded to the raring stack are fine (one of my clusters are that, but here I had to compile the drbd tools myself to get drbd working since the old one provided didn't work, AKA what this bug is about from the start), and everyone else is borked So same problem just the other way around... -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
It is a bit odd. Ok, some warnings seems to be coming from pacemaker commands. Like the WARN: decode_transition_key: Bad UUID (crm-resource-3048) in sscanf result (3) for 0:0:crm-resource-3048 I guess the problem is this: Apr 22 21:55:43 storage0 lrmd: [1242]: info: RA output: (p_drbd_bigpool:0:start:stderr) drbdadm: Unknown command 'syncer' Apr 22 21:55:43 storage0 drbd[3079]: ERROR: bigpool: Called drbdadm -c /etc/drbd.conf syncer bigpool This would mean that drbdadm did not pass control on drbdadm-83. And that would only happen if the current version did not seem to be 8.3. That version number looks to be read from /proc/drbd and would reflect the version of the kernel module. At least as long as reading from /proc/drbd is not failing. Then it would fall back to a version number defined in the command (which would be wrong). Would have been interesting to find out whether calling drbdadm syncer bigpool manually would fail the same way but that would need another maintenance window. Maybe try to see what /proc/drbd is showing. I probably would suggest that we open a new bug report for the cluster case, so this one can be closed with the fix to drbdsetup. Then at least the direct usage seems to work. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
On a side note, I'm not sure why a new package where released for the raring stack? Is there a really brilliant reason for not having two different packages? On 23 Apr 2014 12:06, Stefan Bader stefan.ba...@canonical.com wrote: It is a bit odd. Ok, some warnings seems to be coming from pacemaker commands. Like the WARN: decode_transition_key: Bad UUID (crm-resource-3048) in sscanf result (3) for 0:0:crm-resource-3048 I guess the problem is this: Apr 22 21:55:43 storage0 lrmd: [1242]: info: RA output: (p_drbd_bigpool:0:start:stderr) drbdadm: Unknown command 'syncer' Apr 22 21:55:43 storage0 drbd[3079]: ERROR: bigpool: Called drbdadm -c /etc/drbd.conf syncer bigpool This would mean that drbdadm did not pass control on drbdadm-83. And that would only happen if the current version did not seem to be 8.3. That version number looks to be read from /proc/drbd and would reflect the version of the kernel module. At least as long as reading from /proc/drbd is not failing. Then it would fall back to a version number defined in the command (which would be wrong). Would have been interesting to find out whether calling drbdadm syncer bigpool manually would fail the same way but that would need another maintenance window. Maybe try to see what /proc/drbd is showing. I probably would suggest that we open a new bug report for the cluster case, so this one can be closed with the fix to drbdsetup. Then at least the direct usage seems to work. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 Status in “drbd8” package in Ubuntu: Invalid Status in “drbd8” source package in Precise: Fix Released Bug description: Request for SRU: [Impact] DRBD will not work (hang) on fresh install using Ubuntu 12.04.3 media, and will stop working on sites where the Raring Enablement Stacks is manually installed as the API between older and newer drbd kernel modules has changed. [Fix] The current version of drbd8 utils in Saucy/Raring can be compiled with legacy utils enabled (basically drbdadm and drbdsetup) and automatically switches to use the legacy version when an older kernel module is found. Comparing the code of those two legacy tools showed them to be mostly the same (except some things that actually look like bug fixes). I only found two small issues, one was the init.d script which was changed to use a new command of drbdadm to activate resources. This would fail if drbdadm fell back to the legacy version. So I picked the shell function that the current util uses and verified that this still works with the new binary. The other problem was the default config file which contained a new open which would cause the legacy util to fail. It does not seem to be a required one in the new tools to commenting it out by default seems to work in both cases, too. Lastly (this did not seem to be a real issue) the legacy tools claimed to be a version 3.8.10 while the the code really looked like the 3.8.11 version we have in Precise. Since that also matches the version number of the drbd module in Precise I modified the legacy tools version to be 3.8.11. [Test Case] For testing compatibility with the Precise 3.2 based kernels, either just install the prepared package and verify everything still works as before (before installing any HWE kernel). Or if already having installed a HWE kernel and experiencing the issue, boot into the 3.2 kernel before installing the proposed package (or follow the downgrade instructions before booting back). To test functionality with HWE kernels, install the Raring kernel in Precise, install/configure DRBD: you get No response from the DRBD driver! Is the module loaded?. With the proposed backport the mirror continues to work. Only for switching back to an older kernel a special procedure must be followed (see comment #21): http://www.drbd.org/users-guide/s-downgrading-drbd84.html --- I've just installed linux-generic-lts-raring on 12.04.2 and my drbd device stoped working. Seems like drbd8-utils is not compatible with DRBD 8.4 in Kernel 3.8. I see that we can't upgrade the package since this would break compatibility with the older Kernels in Precise. But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. kind regards [1] https://wiki.ubuntu.com/Kernel/LTSEnablementStack ProblemType: Bug DistroRelease: Ubuntu 12.04 Package: linux-image-3.8.0-22-generic 3.8.0-22.33~precise1 ProcVersionSignature: Ubuntu 3.8.0-22.33~precise1-generic 3.8.11 Uname: Linux 3.8.0-22-generic x86_64 ApportVersion: 2.0.1-0ubuntu17.2 Architecture: amd64 Date: Thu May 30 11:53:13 2013 InstallationMedia:
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
This was done because later point releases of 12.04 come with newer kernels and the drbd module in later kernels needed the newer userspace. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Rocco, that said (and not remembering), could it be that that server uses a kernel version 3.2.x? What does /proc/drbd say? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
~# cat /proc/drbd version: 8.3.11 (api:88/proto:86-96) srcversion: 93CE421BB73A731BDC72D8E ~# uname -a Linux zed1 3.2.0-60-generic #91-Ubuntu @smb I mean like it states in the header: But since the new Plans for the LTS-Enablement Stack [1] there should be a package like drbd8-utils-lts-raring. And the dependancies should be resolved automatically with apt. Why wasn't the new drbd userspace tools needed for the lts-raring stack released as drbd8-utils-lts-raring? Then us people whom installed 12.04 during the beginning wouldn't be affected and people using the newer 12.04.x still could use drbd. The state now is that people whom have upgraded to the raring stack are fine (one of my clusters are that, but here I had to compile the drbd tools myself to get drbd working since the old one provided didn't work, AKA what this bug is about from the start), and everyone else is borked So same problem just the other way around... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Thomas, Simon, can you reveal whether there are maybe special options enabled in the global config or for the resource configs? Both other sides are running 12.04 (Precise) and have not been upgraded, right? The difference is that Simon did not reboot the upgraded machine but Thomas did and sees the error even after the reboot, correct? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I have the same symptoms on my kernel 3.2 cluster indeed: drbdsetup show all Could not connect to 'drbd' generic netlink family I'm sorry I didn't notice this in my tests - I never use drbdsetup which is supposed to be a low-level tool. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hm, ok. So we where only using drbdadm in testing? In theory there is also a compat version of drbdsetup there and like for drbdadm the fallback should be drbdsetup-83 (in /lib/drbd) ... -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Looks very much like drbdsetup does not fall back to the 8.3 version, even
though it should according to this commit:
http://git.drbd.org/gitweb.cgi?p=drbd-8.4.git;a=commit;h=b5ef99654f8008a7b6632261f39fc908b4e84210
Anyway, executing /lib/drbd/drbdsetup-83 instead of /sbin/drbdsetup seems to
work at my end, try it if you need an emergency workaround.
/lib/drbd/drbdsetup-83 show 1
disk {
size0s _is_default; # bytes
... lots of bla bla
}
I'll ask for advice on the DRBD user's ML too but for the moment I'
can't help any further than that.
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to drbd8 in Ubuntu.
https://bugs.launchpad.net/bugs/1185756
Title:
drbd8-utils not compatible with linux-lts-raring kernel in 12.04
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
i see no uncommon options in my configs, i built the cluster basically of linbits dox. i run a standard pp with no extra repos and did not upgrade to 8.4 whatsoever. (the updated) node storage0: root@storage1:~# ssh storage0 cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=12.04 DISTRIB_CODENAME=precise DISTRIB_DESCRIPTION=Ubuntu 12.04.4 LTS root@storage1:~# ssh storage0 uname -a Linux storage0... 3.2.0-60-generic #91-Ubuntu SMP Wed Feb 19 03:54:44 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux root@storage1:~# ssh storage0 drbdadm --version DRBDADM_BUILDTAG=GIT-hash:\ 89a294209144b68adb3ee85a73221f964d3ee515\ build\ by\ phil@fat-tyre\,\ 2013-02-05\ 15:35:49 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030b DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 (the unupdated) node storage1: root@storage1:~# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=12.04 DISTRIB_CODENAME=precise DISTRIB_DESCRIPTION=Ubuntu 12.04.3 LTS root@storage1:~# uname -a Linux storage1... 3.2.0-57-generic #87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux root@storage1:~# drbdadm --version DRBDADM_BUILDTAG=GIT-hash:\ 0de839cee13a4160eed6037c4bddd066645e23c5\ build\ by\ buildd@allspice\,\ 2011-07-05\ 19:51:07 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030b DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 i did an normal node standby/dist-upgrade on storage0 and after reboot the drbd master/slave service would not start. as the cluster is in productive use i didnt upgrade the second node yet. i can start drdb on storage0 with service drdb start (and have to do so ...) and the drdb devices are in sync and secondary on storage0. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
thx stefan lionel, will try your suggestions ASAP. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
As a workaround verified at my end, you may simply symlink the 8.3 tools somewhere in the path, so that drbdsetup will find them: ln -s /lib/drbd/drbdsetup-83 /sbin Alternatively, you may revert drbd-utils to the 8.3 bersion which is still available from the release repository and freeze it until the problem is solved. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I can confirm the problem with the netlink error.
Apr 20 11:54:59 node1 lrmd: [3636]: info: RA output:
(res_drbd_1:0:monitor:stderr) Could not connect to 'drbd' generic
netlink family
I'm using 12.04 with 3.2 kernel (3.2.0-60-generic).
The Pacemaker resource agent is also shipped in a new version with
drbd8-utils.
I debugged the agent:
export OCF_ROOT=/usr/lib/ocf/
export OCF_RESKEY_drbd_resource=r1
export OCF_RESKEY_CRM_meta_clone_max=2
export OCF_RESKEY_CRM_meta_master_max=1
export OCF_RESKEY_CRM_meta_notify=true
/usr/lib/ocf/resource.d/linbit/drbd status
drbd[31110]: WARNING: You may be disappointed: This RA is intended for
pacemaker 1.0 or better!
Could not connect to 'drbd' generic netlink family
bash -x /usr/lib/ocf/resource.d/linbit/drbd status
...
+ DRBD_ROLE_LOCAL=(Unconfigured)
+ DRBD_ROLE_REMOTE=(Unknown)
+ DRBD_CSTATE=(Unconfigured)
+ DRBD_DSTATE_LOCAL=(Unconfigured)
+ DRBD_DSTATE_REMOTE=(DUnknown)
++ drbdsetup r1 sh-status
Could not connect to 'drbd' generic netlink family
+ eval ''
+ case ${DRBD_ROLE_LOCAL[*]} in
+ rc=7
+ return 7
The problem seems to be the command drbdsetup r1 sh-status.
I've also compiled 8.4.4, but that did not resolve the problem.
After that I've straced the command.
execve(/usr/local/sbin/drbdsetup-83, [drbdsetup, sh-status,
/dev/drbd1], [/* 20 vars */]) = -1 ENOENT (No such file or directory)
execve(/usr/local/bin/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1],
[/* 20 vars */]) = -1 ENOENT (No such file or directory)
execve(/usr/sbin/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1], [/*
20 vars */]) = -1 ENOENT (No such file or directory)
execve(/usr/bin/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1], [/*
20 vars */]) = -1 ENOENT (No such file or directory)
execve(/sbin/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1], [/* 20
vars */]) = -1 ENOENT (No such file or directory)
execve(/bin/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1], [/* 20
vars */]) = -1 ENOENT (No such file or directory)
execve(/usr/games/drbdsetup-83, [drbdsetup, sh-status, /dev/drbd1], [/*
20 vars */]) = -1 ENOENT (No such file or directory)
write(2, Could not connect to 'drbd' gene..., 51Could not connect to 'drbd'
generic netlink family
) = 51
exit_group(20)
The problem seems that drbdsetup-83 cannot be found bei drbdsetup.
I created a symlink to /usr/local/bin/ and it worked.
Obviously the path of the two binaries
/lib/drbd/drbd/drbdadm-83|drbdsetup-83 must be changed.
--
You received this bug notification because you are a member of Ubuntu
Server Team, which is subscribed to drbd8 in Ubuntu.
https://bugs.launchpad.net/bugs/1185756
Title:
drbd8-utils not compatible with linux-lts-raring kernel in 12.04
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions
--
Ubuntu-server-bugs mailing list
Ubuntu-server-bugs@lists.ubuntu.com
Modify settings or unsubscribe at:
https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
From my (quick) reading of the source code, drbdadmin works because it adds /lib/drbd to the path using add_lib_drbd_to_path(), and drbdsetup seems not to. One reason for this could be that the driver calls drbdsetup with an abolute path and the source says in case drbdsetup is called with an absolute or relative pathname look for the legacy drbdsetup binary in the same location(...). So I suggest that adding a symlink from /lib/drbd/drbdsetup-83 to /sbin is an acceptable fix for this regression. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I would rather fix drbdsetup in the same way drbdadm works (so add the libpath). That way the compat binaries are not exposed in the normal search path. Which I believe is intentional as from the user perspective there should be only one command. I am working on a patch and some test binaries which I will post here when I am done. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Also lost my slave on prod system today, pacemaker,crm cluster with drbd. lrmd: [1952]: info: RA output: (res_drbd_1:1:monitor:stderr) Could not connect to 'drbd' generic netlink family My resources are marked as Unconfigured on slave, but still Primary on master. Have not rebooted. What is the best way of getting back on track? Link one of both of the binaries to /usr/local/bin and restart cluster/drbd? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Anyone seeing the error message, try the proposed package on the upgraded server. Those are for Precise (12.04) and you will need only the one matching your installation (64bit or 32bit). -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Proposing to fix this by adding the patch in drbdsetup, too. See attached debdiff. Test packages can be found at http://people.canonical.com/~smb/lp1185756/ ** Patch added: Debdiff of proposed fix. https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4092580/+files/drbdsetup-fix.debdiff -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Stefan, your proposed fix (http://people.canonical.com/~smb/lp1185756/) worked for me on Precise 64bit with kernel 3.2. Thanks! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Linking the /lib/drbd/drbdsetup-8.3 to /sbin did NOT solve the problem for me. Had to revert to to old packages then everyting worked after cluster restart. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
The proposed package fixes the issue at my end too. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Rocco, could you try whether the proposed packages from comment #59 would work? The error message only in the drbdsetup code when it fails to find the compat binary. So I hope that you will not loose the connection again. I know it really would suck if not but it would give higher confidence in getting that update out soon. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@smb I'm afraid I can't. The problem with the upgrade of drbd8-utils cause downtime on your main (production) DB-cluster today. I can look though the logs tomorrow, but it was the drbd ocf master/slave in pacemaker that was failing, causing drbd to get unconfigured on both nodes. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
got a maintainance-window today and tried drbd8-utils_8.4.3-0ubuntu0.12.04.2~rc1_amd64.deb which doesnt help the cluster cause. attached a cleanup result of one of the drbd resources. service drbd start still works. ** Attachment added: error_cluster_drbd.log https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+attachment/4093103/+files/error_cluster_drbd.log -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to drbd8 in Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
@Thomas, Simon, can you reveal whether there are maybe special options enabled in the global config or for the resource configs? Both other sides are running 12.04 (Precise) and have not been upgraded, right? The difference is that Simon did not reboot the upgraded machine but Thomas did and sees the error even after the reboot, correct? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
I have the same symptoms on my kernel 3.2 cluster indeed: drbdsetup show all Could not connect to 'drbd' generic netlink family I'm sorry I didn't notice this in my tests - I never use drbdsetup which is supposed to be a low-level tool. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Hm, ok. So we where only using drbdadm in testing? In theory there is also a compat version of drbdsetup there and like for drbdadm the fallback should be drbdsetup-83 (in /lib/drbd) ... -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
Looks very much like drbdsetup does not fall back to the 8.3 version, even
though it should according to this commit:
http://git.drbd.org/gitweb.cgi?p=drbd-8.4.git;a=commit;h=b5ef99654f8008a7b6632261f39fc908b4e84210
Anyway, executing /lib/drbd/drbdsetup-83 instead of /sbin/drbdsetup seems to
work at my end, try it if you need an emergency workaround.
/lib/drbd/drbdsetup-83 show 1
disk {
size0s _is_default; # bytes
... lots of bla bla
}
I'll ask for advice on the DRBD user's ML too but for the moment I'
can't help any further than that.
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1185756
Title:
drbd8-utils not compatible with linux-lts-raring kernel in 12.04
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1185756] Re: drbd8-utils not compatible with linux-lts-raring kernel in 12.04
i see no uncommon options in my configs, i built the cluster basically of linbits dox. i run a standard pp with no extra repos and did not upgrade to 8.4 whatsoever. (the updated) node storage0: root@storage1:~# ssh storage0 cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=12.04 DISTRIB_CODENAME=precise DISTRIB_DESCRIPTION=Ubuntu 12.04.4 LTS root@storage1:~# ssh storage0 uname -a Linux storage0... 3.2.0-60-generic #91-Ubuntu SMP Wed Feb 19 03:54:44 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux root@storage1:~# ssh storage0 drbdadm --version DRBDADM_BUILDTAG=GIT-hash:\ 89a294209144b68adb3ee85a73221f964d3ee515\ build\ by\ phil@fat-tyre\,\ 2013-02-05\ 15:35:49 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030b DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 (the unupdated) node storage1: root@storage1:~# cat /etc/lsb-release DISTRIB_ID=Ubuntu DISTRIB_RELEASE=12.04 DISTRIB_CODENAME=precise DISTRIB_DESCRIPTION=Ubuntu 12.04.3 LTS root@storage1:~# uname -a Linux storage1... 3.2.0-57-generic #87-Ubuntu SMP Tue Nov 12 21:35:10 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux root@storage1:~# drbdadm --version DRBDADM_BUILDTAG=GIT-hash:\ 0de839cee13a4160eed6037c4bddd066645e23c5\ build\ by\ buildd@allspice\,\ 2011-07-05\ 19:51:07 DRBDADM_API_VERSION=88 DRBD_KERNEL_VERSION_CODE=0x08030b DRBDADM_VERSION_CODE=0x08030b DRBDADM_VERSION=8.3.11 i did an normal node standby/dist-upgrade on storage0 and after reboot the drbd master/slave service would not start. as the cluster is in productive use i didnt upgrade the second node yet. i can start drdb on storage0 with service drdb start (and have to do so ...) and the drdb devices are in sync and secondary on storage0. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1185756 Title: drbd8-utils not compatible with linux-lts-raring kernel in 12.04 To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/drbd8/+bug/1185756/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
