Does drbd work outside of pacemaker? I suspect perhaps not from these lines in
your log:
Mar 4 14:27:59 nomen modprobe: FATAL: Module drbd not found.
Mar 4 14:27:59 nomen lrmd: [29900]: info: RA output: (drbd0:0:start:stdout) Could not
stat("/proc/drbd"): No such file or directory do you need to load the module?
try: modprobe drbd Command 'drbdsetup /dev/drbd0 disk /dev/sda5 /dev/sda5 internal
--set-defaults --create-device --on-io-error=pass_on' terminated with exit code 20
drbdadm attach r0: exited with code 20
Mar 4 14:27:59 nomen drbd[30169]: ERROR: r0 start: not in Secondary mode after
start.
Try starting drbd "by hand" with pacemaker turned off; it should come up on
both nodes, with
both nodes as "secondary". If it doesn't they you have to fix drbd first
before trying to
add pacemaker to the mix.
Neil
Jerome Yanga wrote:
Hi! I am having issues with getting DRBD to work with Pacemaker. I can get
Pacemaker and DRBD run individually but not DRBD managed by Pacemaker. I tried
following the instruction in the site below but the resources will not go
online.
http://clusterlabs.org/wiki/DRBD_HowTo_1.0
Below is my configuration.
Installed applications:
=======================
kernel-2.6.18-128.el5
drbd-8.3.0-3
heartbeat-2.99.2-6.1
pacemaker-1.0.1-3.1
drbd.conf:
==========
global {
usage-count no;
}
resource r0 {
protocol C;
handlers {
pri-on-incon-degr "echo o > /proc/sysrq-trigger ; halt -f";
pri-lost-after-sb "echo o > /proc/sysrq-trigger ; halt -f";
local-io-error "echo o > /proc/sysrq-trigger ; halt -f";
outdate-peer "/usr/lib/heartbeat/drbd-peer-outdater -t 5";
pri-lost "echo pri-lost. Have a look at the log files. | mail -s 'DRBD Alert'
root";
out-of-sync "/usr/lib/drbd/notify-out-of-sync.sh root";
}
startup {
wfc-timeout 0;
}
disk {
on-io-error pass_on;
}
net {
max-buffers 2048;
after-sb-0pri disconnect;
after-sb-1pri disconnect;
after-sb-2pri disconnect;
rr-conflict disconnect;
}
syncer {
rate 100M;
al-extents 257;
}
on nomen.esri.com {
device /dev/drbd0;
disk /dev/sda5;
address 192.168.0.1:7789;
meta-disk internal;
}
on rubric.esri.com {
device /dev/drbd0;
disk /dev/sda5;
address 192.168.0.2:7789;
meta-disk internal;
}
}
Cib.xml:
========
<cib admin_epoch="0" validate-with="pacemaker-1.0" crm_feature_set="3.0"
have-quorum="1" dc-uuid="a5
e95310-f27d-418e-9cb9-42e50310f702" epoch="56" num_updates="0"
cib-last-written="Wed Mar 4 14:27:59
2009">
<configuration>
<crm_config>
<cluster_property_set id="cib-bootstrap-options">
<nvpair id="cib-bootstrap-options-dc-version" name="dc-version"
value="1.0.1-node: 6fc5ce830
2abf145a02891ec41e5a492efbe8efe"/>
</cluster_property_set>
</crm_config>
<nodes>
<node id="3a8b681c-a14b-4037-a8e6-2d4af2eff88e" uname="nomen.esri.com"
type="normal"/>
<node id="a5e95310-f27d-418e-9cb9-42e50310f702" uname="rubric.esri.com"
type="normal"/>
</nodes>
<resources>
<master id="ms-drbd0">
<meta_attributes id="ms-drbd0-meta_attributes">
<nvpair id="ms-drbd0-meta_attributes-clone-max" name="clone-max"
value="2"/>
<nvpair id="ms-drbd0-meta_attributes-notify" name="notify"
value="true"/>
<nvpair id="ms-drbd0-meta_attributes-globally-unique" name="globally-unique"
value="false"
/>
<nvpair name="target-role" id="ms-drbd0-meta_attributes-target-role"
value="Started"/>
</meta_attributes>
<primitive class="ocf" id="drbd0" provider="heartbeat" type="drbd">
<instance_attributes id="drbd0-instance_attributes">
<nvpair id="drbd0-instance_attributes-drbd_resource" name="drbd_resource"
value="r0"/>
</instance_attributes>
<operations id="drbd0-ops">
<op id="drbd0-monitor-59s" interval="59s" name="monitor" role="Master"
timeout="30s"/>
<op id="drbd0-monitor-60s" interval="60s" name="monitor" role="Slave"
timeout="30s"/>
</operations>
</primitive>
</master>
</resources>
<constraints/>
</configuration>
</cib>
/var/log/messages:
==================
Mar 4 14:27:58 nomen crm_resource: [30167]: info: Invoked: crm_resource --meta
-r ms-drbd0 -p target-role -v Started
Mar 4 14:27:58 nomen cib: [29899]: info: cib_process_xpath: Processing cib_query op for
//cib/configuration/resources//*...@id="ms-drbd0"]//meta_attributes//nvpa...@name="target-role"]
(/cib/configuration/resources/master/meta_attributes/nvpair[4])
Mar 4 14:27:59 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=5:5:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_start_0 )
Mar 4 14:27:59 nomen haclient: on_event:evt:cib_changed
Mar 4 14:27:59 nomen lrmd: [29900]: info: rsc:drbd0:0: start
Mar 4 14:27:59 nomen cib: [30168]: info: write_cib_contents: Wrote version
0.56.0 of the CIB to disk (digest: 2365d9802f1b9c55e0ed87b8ebda5db3)
Mar 4 14:27:59 nomen cib: [30168]: info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig)
Mar 4 14:27:59 nomen cib: [29899]: info: Managed write_cib_contents process
30168 exited with return code 0.
Mar 4 14:27:59 nomen modprobe: FATAL: Module drbd not found.
Mar 4 14:27:59 nomen lrmd: [29900]: info: RA output: (drbd0:0:start:stdout)
Mar 4 14:27:59 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:27:59 nomen lrmd: [29900]: info: RA output: (drbd0:0:start:stdout) Could not
stat("/proc/drbd"): No such file or directory do you need to load the module?
try: modprobe drbd Command 'drbdsetup /dev/drbd0 disk /dev/sda5 /dev/sda5 internal
--set-defaults --create-device --on-io-error=pass_on' terminated with exit code 20
drbdadm attach r0: exited with code 20
Mar 4 14:27:59 nomen drbd[30169]: ERROR: r0 start: not in Secondary mode after
start.
Mar 4 14:27:59 nomen lrmd: [29900]: WARN: Managed drbd0:0:start process 30169
exited with return code 1.
Mar 4 14:27:59 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_start_0 (call=3, rc=1, cib-update=13, confirmed=true) complete unknown
error
Mar 4 14:27:59 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:27:59 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:00 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=41:6:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_notify_0 )
Mar 4 14:28:00 nomen lrmd: [29900]: info: rsc:drbd0:0: notify
Mar 4 14:28:00 nomen lrmd: [29900]: info: Managed drbd0:0:notify process 30310
exited with return code 0.
Mar 4 14:28:00 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_notify_0 (call=4, rc=0, cib-update=14, confirmed=true) complete ok
Mar 4 14:28:00 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:00 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:00 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:01 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=2:6:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_stop_0 )
Mar 4 14:28:01 nomen lrmd: [29900]: info: rsc:drbd0:0: stop
Mar 4 14:28:01 nomen lrmd: [29900]: info: Managed drbd0:0:stop process 30324
exited with return code 0.
Mar 4 14:28:01 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_stop_0 (call=5, rc=0, cib-update=15, confirmed=true) complete ok
Mar 4 14:28:01 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:01 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:01 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:02 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=10:6:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:1_start_0 )
Mar 4 14:28:02 nomen lrmd: [29900]: info: rsc:drbd0:1: start
Mar 4 14:28:02 nomen modprobe: FATAL: Module drbd not found.
Mar 4 14:28:02 nomen lrmd: [29900]: info: RA output: (drbd0:1:start:stdout)
Mar 4 14:28:02 nomen lrmd: [29900]: info: RA output: (drbd0:1:start:stdout) Could not
stat("/proc/drbd"): No such file or directory do you need to load the module?
try: modprobe drbd Command 'drbdsetup /dev/drbd0 disk /dev/sda5 /dev/sda5 internal
--set-defaults --create-device --on-io-error=pass_on' terminated with exit code 20
drbdadm attach r0: exited with code 20
Mar 4 14:28:02 nomen drbd[30338]: ERROR: r0 start: not in Secondary mode after
start.
Mar 4 14:28:02 nomen lrmd: [29900]: WARN: Managed drbd0:1:start process 30338
exited with return code 1.
Mar 4 14:28:02 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:1_start_0 (call=6, rc=1, cib-update=16, confirmed=true) complete unknown
error
Mar 4 14:28:02 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:02 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:02 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:03 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=44:7:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:1_notify_0 )
Mar 4 14:28:03 nomen lrmd: [29900]: info: rsc:drbd0:1: notify
Mar 4 14:28:03 nomen lrmd: [29900]: info: Managed drbd0:1:notify process 30472
exited with return code 0.
Mar 4 14:28:03 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:1_notify_0 (call=7, rc=0, cib-update=17, confirmed=true) complete ok
Mar 4 14:28:03 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:03 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:03 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:04 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=2:7:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:1_stop_0 )
Mar 4 14:28:04 nomen lrmd: [29900]: info: rsc:drbd0:1: stop
Mar 4 14:28:04 nomen lrmd: [29900]: info: Managed drbd0:1:stop process 30486
exited with return code 0.
Mar 4 14:28:04 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:1_stop_0 (call=8, rc=0, cib-update=18, confirmed=true) complete ok
Mar 4 14:28:04 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:04 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:04 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:05 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=7:7:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_start_0 )
Mar 4 14:28:05 nomen lrmd: [29900]: info: rsc:drbd0:0: start
Mar 4 14:28:05 nomen modprobe: FATAL: Module drbd not found.
Mar 4 14:28:05 nomen lrmd: [29900]: info: RA output: (drbd0:0:start:stdout)
Mar 4 14:28:05 nomen lrmd: [29900]: info: RA output: (drbd0:0:start:stdout) Could not
stat("/proc/drbd"): No such file or directory do you need to load the module?
try: modprobe drbd Command 'drbdsetup /dev/drbd0 disk /dev/sda5 /dev/sda5 internal
--set-defaults --create-device --on-io-error=pass_on' terminated with exit code 20
drbdadm attach r0: exited with code 20
Mar 4 14:28:05 nomen drbd[30500]: ERROR: r0 start: not in Secondary mode after
start.
Mar 4 14:28:05 nomen lrmd: [29900]: WARN: Managed drbd0:0:start process 30500
exited with return code 1.
Mar 4 14:28:05 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_start_0 (call=9, rc=1, cib-update=19, confirmed=true) complete unknown
error
Mar 4 14:28:05 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:05 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:06 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=38:8:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_notify_0 )
Mar 4 14:28:06 nomen lrmd: [29900]: info: rsc:drbd0:0: notify
Mar 4 14:28:06 nomen lrmd: [29900]: info: Managed drbd0:0:notify process 30634
exited with return code 0.
Mar 4 14:28:06 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_notify_0 (call=10, rc=0, cib-update=20, confirmed=true) complete ok
Mar 4 14:28:06 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:06 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:07 nomen crmd: [29903]: info: do_lrm_rsc_op: Performing
key=1:8:0:d4b86e31-ca4a-4033-8437-6486622eb19f op=drbd0:0_stop_0 )
Mar 4 14:28:07 nomen lrmd: [29900]: info: rsc:drbd0:0: stop
Mar 4 14:28:07 nomen lrmd: [29900]: info: Managed drbd0:0:stop process 30648
exited with return code 0.
Mar 4 14:28:07 nomen crmd: [29903]: info: process_lrm_event: LRM operation
drbd0:0_stop_0 (call=11, rc=0, cib-update=21, confirmed=true) complete ok
Mar 4 14:28:07 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:07 nomen mgmtd: [29904]: info: CIB query: cib
Mar 4 14:28:08 nomen haclient: on_event: from message queue: evt:cib_changed
Mar 4 14:28:08 nomen mgmtd: [29904]: info: CIB query: cib
FYI, I had to add the following line to /etc/init.d/drbd to get it working.
insmod /lib/modules/2.6.18-92.1.22.el5/kernel/drivers/block/drbd.ko
Help.
Regards,
Jerome
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems
