Hello,
having pacemaker 1.0.8 for drbd resource testing on 2 x rh el 5 32bit
systems.
It was working before and then I tried to add an nfs resource, extending the
former nfs-group group.
problems arose after commiting change.
Tried to close both nodes and start one of them (ha1), keeping off the other
(ha2)
It seems I'm not able to start the LV... if I understood correctly
any clue?
Also, why crm_mon doesn't tell me that my nfs-group was unable to start....?
Last updated: Wed May 5 18:49:46 2010
Stack: openais
Current DC: ha1 - partition WITHOUT quorum
Version: 1.0.8-9881a7350d6182bae9e8e557cf20a3cc5dac3ee7
2 Nodes configured, 2 expected votes
3 Resources configured.
============
Online: [ ha1 ]
OFFLINE: [ ha2 ]
Master/Slave Set: NfsData
Masters: [ ha1 ]
Stopped: [ nfsdrbd:1 ]
Clone Set: cl-pinggw
Started: [ ha1 ]
Stopped: [ pinggw:1 ]
In messages:
May 5 18:39:43 ha1 LVM[2784]: INFO: Deactivating volume group
vg_nfsdata_drbd
May 5 18:39:43 ha1 kernel: drbd: initialized. Version: 8.3.6
(api:88/proto:86-91)
May 5 18:39:43 ha1 kernel: drbd: GIT-hash:
f3606c47cc6fcf6b3f086e425cb34af8b7a81bbf build by r...@ha1, 2010-04-28
09:01:04
May 5 18:39:43 ha1 kernel: drbd: registered as block device major 147
May 5 18:39:43 ha1 kernel: drbd: minor_table @ 0xd7fefa40
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stdout)
May 5 18:39:43 ha1 kernel: block drbd0: Starting worker thread (from
cqueue/0 [68])
May 5 18:39:43 ha1 kernel: drbd: bd_claim(dfa3e0c0,d341e000); failed
[e09364f0;e09364f0;2]
May 5 18:39:43 ha1 kernel: block drbd0: drbd_bm_resize called with capacity
== 0
May 5 18:39:43 ha1 kernel: block drbd0: worker terminated
May 5 18:39:43 ha1 kernel: block drbd0: Terminating worker thread
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
0: Failure: (114) Lower device is already claimed. This usually means it is
mounted.
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
Command '
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
drbdsetup
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
0
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
disk
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
/dev/sdc
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
/dev/sdc
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stderr)
internal --set-defaults --create-device --fencing=resource-only' terminated
with exit code 10
May 5 18:39:43 ha1 drbd[2781]: ERROR: nfsdata: Called drbdadm -c
/etc/drbd.conf up nfsdata
May 5 18:39:43 ha1 drbd[2781]: ERROR: nfsdata: Exit code 1
May 5 18:39:43 ha1 drbd[2781]: ERROR: nfsdata: Command output:
May 5 18:39:43 ha1 lrmd: [1675]: info: RA output: (nfsdrbd:0:start:stdout)
the line
May 5 18:39:43 ha1 kernel: drbd: bd_claim(dfa3e0c0,d341e000); failed
[e09364f0;e09364f0;2]
is also in cosnole of the server....
I don't understand the line
Lower device is already claimed.
Who could have it?
In my lvm.conf
[r...@ha1 ~]# grep "filter =" /etc/lvm/lvm.conf | grep -v "# filter"
#filter = [ "a/.*/" ]
filter = [ "r|/dev/sdc|", "a/.*/" ]
and /dev/sdc is the disk defined as drbd0
my current situation
pvs
PV VG Fmt Attr PSize PFree
/dev/drbd0 vg_nfsdata_drbd lvm2 a- 4.00G 0
/dev/sdb1 VolGroup00 lvm2 a- 4.00G 0
vgs
VG #PV #LV #SN Attr VSize VFree
VolGroup00 1 1 0 wz--n- 4.00G 0
vg_nfsdata_drbd 1 1 0 wz--n- 4.00G 0
lvs
LV VG Attr LSize Origin Snap% Move Log Copy%
Convert
lv_usrlocal VolGroup00 -wi-ao 4.00G
lv_nfsdata_drbd vg_nfsdata_drbd -wi--- 4.00G
[r...@ha1 ~]# crm configure show
node ha1 \
attributes standby="off"
node ha2 \
attributes standby="off"
primitive NfsFS ocf:heartbeat:Filesystem \
params device="/dev/vg_nfsdata_drbd/lv_nfsdata_drbd" directory="/nfsdata"
fstype="ext3" \
op start interval="0" timeout="60" \
op stop interval="0" timeout="60"
primitive VIPlbtest ocf:heartbeat:IPaddr2 \
params ip="10.4.4.140" cidr_netmask="32" nic="eth1" \
op monitor interval="30s"
primitive lv_nfsdata_drbd ocf:heartbeat:LVM \
params volgrpname="vg_nfsdata_drbd" exclusive="yes" \
op monitor interval="10" timeout="30" depth="0" \
op start interval="0" timeout="30" \
op stop interval="0" timeout="30"
primitive nfsdrbd ocf:linbit:drbd \
params drbd_resource="nfsdata" \
op monitor interval="60s" \
op start interval="0" timeout="240" \
op stop interval="0" timeout="100"
primitive nfssrv ocf:heartbeat:nfsserver \
params nfs_init_script="/etc/init.d/nfs" nfs_notify_cmd="/sbin/rpc.statd"
nfs_shared_infodir="/var/lib/nfs" nfs_ip="10.4.4.140" \
op start interval="0" timeout="40"
primitive pinggw ocf:pacemaker:pingd \
params host_list="10.4.4.250" multiplier="100" \
op monitor interval="15s" timeout="20s" \
op start interval="0" timeout="90" \
op stop interval="0" timeout="100"
group nfs-group lv_nfsdata_drbd NfsFS VIPlbtest nfssrv \
meta target-role="Started"
ms NfsData nfsdrbd \
meta master-max="1" master-node-max="1" clone-max="2" clone-node-max="1"
notify="true"
clone cl-pinggw pinggw \
meta globally-unique="false"
location nfs-group-with-pinggw nfs-group \
rule $id="nfs-group-with-pinggw-rule" -inf: not_defined pinggw or pinggw lte
0
colocation nfs_on_drbd0 inf: nfs-group NfsData:Master
order NfsFS-after-NfsData inf: NfsData:promote nfs-group:start
property $id="cib-bootstrap-options" \
dc-version="1.0.8-9881a7350d6182bae9e8e557cf20a3cc5dac3ee7" \
cluster-infrastructure="openais" \
expected-quorum-votes="2" \
stonith-enabled="false" \
no-quorum-policy="ignore"
rsc_defaults $id="rsc-options" \
resource-stickiness="100"
[r...@ha1 ~]# cat /proc/drbd
version: 8.3.6 (api:88/proto:86-91)
GIT-hash: f3606c47cc6fcf6b3f086e425cb34af8b7a81bbf build by r...@ha1,
2010-04-28 09:01:04
0: cs:WFConnection ro:Primary/Unknown ds:UpToDate/Outdated C r----
ns:0 nr:0 dw:0 dr:232 al:0 bm:7 lo:0 pe:0 ua:0 ap:0 ep:1 wo:b oos:28508
Where am I wrong?
Thanks in advance,
Gianluca
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems
