Hello all,
I have configured Heartbeat in openfiler-2.3 system, I can run heartbeat
successfully in R1 style configuration, but if i run in *crm* mode the
heartbeat server all resources will go to stop state.
Using these command i have created resources and added to the cim.xml file.
[r...@gtt4 ~]#* /usr/lib64/heartbeat/haresources2cib.py --stdout -c
/etc/ha.d/ha.cf /etc/ha.d/haresources > /tmp/cib.xml*
[r...@gtt4 ~]# *cibadmin -U -x /tmp/cib.xml *
*System configuration *
Linux gtt4.linux.com 2.6.26.8-1.0.11.smp.gcc3.4.x86_64
*Openfiler *Version 2.3
*heartbeat *Version 2.1.3
*drbd* Version 8.2.7
*ha.cf Configuration File*
*[r...@gtt4 ~]# vi /etc/ha.d/ha.cf
*
debugfile /var/log/ha-debug
logfile /var/log/ha-log
logfacility local0
keepalive 2
deadtime 120
warntime 10
initdead 120
udpport 694
bcast eth1
auto_failback on
*crm yes*
*autojoin any*
node gtt4.linux.com
node gtt5.linux.com
1.
If i check drbd status it will show the all secondary state.
*[r...@gtt4 ~]# service drbd status*
drbd driver loaded OK; device status:
version: 8.2.7 (api:88/proto:86-88)
GIT-hash: 61b7f4c2fc34fe3d2acf7be6bcc1fc2684708a7d build by p...@fat-tyre,
2008-11-12 16:47:11
m:res cs st ds p mounted fstype
0:cluster_metadata Connected* Secondary/Secondary* UpToDate/UpToDate C
1:vg0_drbd Connected *Secondary/Secondary* UpToDate/Diskless C
1.
This crm_mon command status,
*[r...@gtt4 ~]# crm_mon *
============
Last updated: Thu Aug 13 20:11:39 2009
Current DC: gtt5.linux.com (7d892d6c-d277-45c2-beb6-331fca5b3920)
2 Nodes configured.
1 Resources configured.
============
Node: gtt5.linux.com (7d892d6c-d277-45c2-beb6-331fca5b3920): online
Node: gtt4.linux.com (87dc2dcc-791b-4bfb-a971-b30fbd909255): online
Resource Group: group_1
MailTo_1 (heartbeat::ocf:MailTo): Started gtt4.linux.com
IPaddr_192_168_2_20 (heartbeat::ocf:IPaddr): Stopped
drbddisk_3 (heartbeat:drbddisk): Stopped
LVM_4 (heartbeat::ocf:LVM): Stopped
Filesystem_5 (heartbeat::ocf:Filesystem): Stopped
MakeMounts_6 (heartbeat:MakeMounts): Stopped
Filesystem_7 (heartbeat::ocf:Filesystem): Stopped
Filesystem_8 (heartbeat::ocf:Filesystem): Stopped
httpd_9 (lsb:httpd): Stopped
proftpd_10 (lsb:proftpd): Stopped
nfs_11 (lsb:nfs): Stopped
smb_12 (lsb:smb): Stopped
acpid_13 (lsb:acpid): Stopped
openfiler_14 (lsb:openfiler): Stopped
Failed actions:
IPaddr_192_168_2_20_start_0 (node=gtt4.linux.com, call=19, rc=1): Error
IPaddr_192_168_2_20_start_0 (node=gtt5.linux.com, call=19, rc=1): Error
3) This my ha log when i was trying to restart the heartbeat i got these
log message
*[r...@gtt4 ~]# tail -f /var/log/ha-log *
ccm[4509]: 2009/08/13_20:25:01 info: client (pid=4510) removed from ccm
heartbeat[4503]: 2009/08/13_20:25:01 info: killing /usr/lib64/heartbeat/ccm
process group 4509 with signal 15
ccm[4509]: 2009/08/13_20:25:01 info: received SIGTERM, going to shut down
heartbeat[4503]: 2009/08/13_20:25:02 info: killing HBFIFO process 4505 with
signal 15
heartbeat[4503]: 2009/08/13_20:25:02 info: killing HBWRITE process 4506 with
signal 15
heartbeat[4503]: 2009/08/13_20:25:02 info: killing HBREAD process 4507 with
signal 15
heartbeat[4503]: 2009/08/13_20:25:02 info: Core process 4506 exited. 3
remaining
heartbeat[4503]: 2009/08/13_20:25:02 info: Core process 4507 exited. 2
remaining
heartbeat[4503]: 2009/08/13_20:25:02 info: Core process 4505 exited. 1
remaining
heartbeat[4503]: 2009/08/13_20:25:02 info: gtt4.linux.com Heartbeat shutdown
complete.
heartbeat[4914]: 2009/08/13_20:27:12 info: Version 2 support: yes
heartbeat[4914]: 2009/08/13_20:27:12 WARN: Logging daemon is disabled
--enabling logging daemon is recommended
heartbeat[4914]: 2009/08/13_20:27:12 info: **************************
heartbeat[4914]: 2009/08/13_20:27:12 info: Configuration validated. Starting
heartbeat 2.1.3
heartbeat[4915]: 2009/08/13_20:27:12 info: heartbeat: version 2.1.3
heartbeat[4915]: 2009/08/13_20:27:12 info: Heartbeat generation: 1248852527
heartbeat[4915]: 2009/08/13_20:27:12 info: glib: UDP Broadcast heartbeat
started on port 694 (694) interface eth1
heartbeat[4915]: 2009/08/13_20:27:12 info: glib: UDP Broadcast heartbeat
closed on port 694 interface eth1 - Status: 1
heartbeat[4915]: 2009/08/13_20:27:12 info: G_main_add_TriggerHandler: Added
signal manual handler
heartbeat[4915]: 2009/08/13_20:27:12 info: G_main_add_TriggerHandler: Added
signal manual handler
heartbeat[4915]: 2009/08/13_20:27:12 info: G_main_add_SignalHandler: Added
signal handler for signal 17
heartbeat[4915]: 2009/08/13_20:27:12 info: Local status now set to: 'up'
heartbeat[4915]: 2009/08/13_20:27:13 info: Link gtt5.linux.com:eth1 up.
heartbeat[4915]: 2009/08/13_20:27:13 info: Status update for node
gtt5.linux.com: status active
heartbeat[4915]: 2009/08/13_20:27:13 info: Link gtt4.linux.com:eth1 up.
heartbeat[4915]: 2009/08/13_20:29:13 info: Comm_now_up(): updating status to
active
heartbeat[4915]: 2009/08/13_20:29:13 info: Local status now set to: 'active'
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/ccm" (106,106)
heartbeat[4921]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/ccm" as uid 106 gid 106 (pid 4921)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/cib" (106,106)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/lrmd -r" (0,0)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/stonithd" (0,0)
heartbeat[4922]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/cib" as uid 106 gid 106 (pid 4922)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/attrd" (106,106)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/crmd" (106,106)
heartbeat[4915]: 2009/08/13_20:29:13 info: Starting child client
"/usr/lib64/heartbeat/mgmtd -v" (0,0)
cib[4922]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 15
cib[4922]: 2009/08/13_20:29:13 info: G_main_add_TriggerHandler: Added signal
manual handler
cib[4922]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 17
cib[4922]: 2009/08/13_20:29:13 info: main: Retrieval of a per-action CIB:
disabled
cib[4922]: 2009/08/13_20:29:13 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig)
heartbeat[4923]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/lrmd -r" as uid 0 gid 0 (pid 4923)
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <cib generated="false" admin_epoch="0" epoch="1"
have_quorum="false" ignore_dtd="false" num_peers="0"
cib_feature_revision="2.0" num_updates="1" cib-last-written="Thu Aug 13
20:22:25 2009">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <configuration>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <crm_config>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <cluster_property_set id="cib-bootstrap-options">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-dc-version" name="dc-version"
value="2.1.3-node: 4a3eac571f442c7cfcefc18fcaad35314460c1f6"/>
heartbeat[4924]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/stonithd" as uid 0 gid 0 (pid 4924)
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-symmetric-cluster"
name="symmetric-cluster" value="true"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-no-quorum-policy"
name="no-quorum-policy" value="stop"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-default-resource-stickiness"
name="default-resource-stickiness" value="0"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair
id="cib-bootstrap-options-default-resource-failure-stickiness"
name="default-resource-failure-stickiness" value="0"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-stonith-enabled"
name="stonith-enabled" value="false"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-stonith-action"
name="stonith-action" value="reboot"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-startup-fencing"
name="startup-fencing" value="true"/>
heartbeat[4925]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/attrd" as uid 106 gid 106 (pid 4925)
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-stop-orphan-resources"
name="stop-orphan-resources" value="true"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-stop-orphan-actions"
name="stop-orphan-actions" value="true"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-remove-after-stop"
name="remove-after-stop" value="false"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-short-resource-names"
name="short-resource-names" value="true"/>
heartbeat[4926]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/crmd" as uid 106 gid 106 (pid 4926)
heartbeat[4927]: 2009/08/13_20:29:13 info: Starting
"/usr/lib64/heartbeat/mgmtd -v" as uid 0 gid 0 (pid 4927)
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-transition-idle-timeout"
name="transition-idle-timeout" value="5min"/>
mgmtd[4927]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 15
mgmtd[4927]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 10
lrmd[4923]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 15
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-default-action-timeout"
name="default-action-timeout" value="20s"/>
mgmtd[4927]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 12
ccm[4921]: 2009/08/13_20:29:13 info: Hostname: gtt4.linux.com
stonithd[4924]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 10
attrd[4925]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 15
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-is-managed-default"
name="is-managed-default" value="true"/>
crmd[4926]: 2009/08/13_20:29:13 info: main: CRM Hg Version: node:
4a3eac571f442c7cfcefc18fcaad35314460c1f6
lrmd[4923]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 17
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-cluster-delay"
name="cluster-delay" value="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-pe-error-series-max"
name="pe-error-series-max" value="-1"/>
attrd[4925]: 2009/08/13_20:29:13 info: register_with_ha: Hostname:
gtt4.linux.com
crmd[4926]: 2009/08/13_20:29:13 info: crmd_init: Starting crmd
lrmd[4923]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 10
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-pe-warn-series-max"
name="pe-warn-series-max" value="-1"/>
stonithd[4924]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 12
crmd[4926]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 15
lrmd[4923]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 12
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="cib-bootstrap-options-pe-input-series-max"
name="pe-input-series-max" value="-1"/>
stonithd[4924]: 2009/08/13_20:29:13 info: Signing in with heartbeat.
crmd[4926]: 2009/08/13_20:29:13 info: G_main_add_TriggerHandler: Added
signal manual handler
attrd[4925]: 2009/08/13_20:29:13 info: register_with_ha: UUID:
87dc2dcc-791b-4bfb-a971-b30fbd909255
lrmd[4923]: 2009/08/13_20:29:13 info: Started.
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
crmd[4926]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 17
mgmtd[4927]: 2009/08/13_20:29:13 info: init_crm
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </cluster_property_set>
mgmtd[4927]: 2009/08/13_20:29:13 info: login to cib: 0, ret:-10
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </crm_config>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nodes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <node id="7d892d6c-d277-45c2-beb6-331fca5b3920" uname="
gtt5.linux.com" type="normal"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <node id="87dc2dcc-791b-4bfb-a971-b30fbd909255" uname="
gtt4.linux.com" type="normal"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </nodes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <resources>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <group id="group_1">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="ocf" id="MailTo_1" provider="heartbeat"
type="MailTo">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="MailTo_1_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="MailTo_1_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="MailTo_1_attr_0" name="email" value="r...@localhost"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="MailTo_1_attr_1" name="subject"
value="ClusterFailover"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="ocf" id="IPaddr_192_168_2_20"
provider="heartbeat" type="IPaddr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="IPaddr_192_168_2_20_mon" interval="5s" name="monitor"
timeout="5s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="IPaddr_192_168_2_20_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="IPaddr_192_168_2_20_attr_0" name="ip"
value="192.168.2.20"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="IPaddr_192_168_2_20_attr_1" name="nic" value="24"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="heartbeat" id="drbddisk_3" provider="heartbeat"
type="drbddisk">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="drbddisk_3_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="drbddisk_3_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="drbddisk_3_attr_1" name="1"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="ocf" id="LVM_4" provider="heartbeat" type="LVM">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="LVM_4_mon" interval="120s" name="monitor" timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="LVM_4_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="LVM_4_attr_0" name="volgrpname" value="vg0_drbd"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="ocf" id="Filesystem_5" provider="heartbeat"
type="Filesystem">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="Filesystem_5_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="Filesystem_5_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_5_attr_0" name="device"
value="/dev/drbd0"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_5_attr_1" name="directory"
value="/cluster_metadata"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_5_attr_2" name="fstype" value="ext3"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_5_attr_3" name="options"
value="defaults,noatime"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="heartbeat" id="MakeMounts_6"
provider="heartbeat" type="MakeMounts">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="MakeMounts_6_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="Filesystem_7_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="Filesystem_7_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_7_attr_0" name="device"
value="/dev/vg0_drbd/lvm2"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_7_attr_1" name="directory"
value="/mnt/vg0_drbd/lvm2"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_7_attr_2" name="fstype" value="ext3"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_7_attr_3" name="options"
value="defaults,usrquota,grpquota,acl,user_xattr"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="ocf" id="Filesystem_8" provider="heartbeat"
type="Filesystem">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="Filesystem_8_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <instance_attributes id="Filesystem_8_inst_attr">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_8_attr_0" name="device"
value="/dev/vg0_drbd/lvm3"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_8_attr_1" name="directory"
value="/mnt/vg0_drbd/lvm3"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_8_attr_2" name="fstype" value="ext3"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <nvpair id="Filesystem_8_attr_3" name="options"
value="defaults,usrquota,grpquota,acl,user_xattr"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </instance_attributes>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="httpd_9" provider="heartbeat"
type="httpd">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="httpd_9_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="proftpd_10" provider="heartbeat"
type="proftpd">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="proftpd_10_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="nfs_11" provider="heartbeat"
type="nfs">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="nfs_11_mon" interval="120s" name="monitor" timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="smb_12" provider="heartbeat"
type="smb">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="smb_12_mon" interval="120s" name="monitor" timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="acpid_13" provider="heartbeat"
type="acpid">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="acpid_13_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <primitive class="lsb" id="openfiler_14" provider="heartbeat"
type="openfiler">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <op id="openfiler_14_mon" interval="120s" name="monitor"
timeout="60s"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </operations>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </primitive>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </group>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </resources>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <constraints>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <rsc_location id="rsc_location_group_1" rsc="group_1">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <rule id="prefered_location_group_1" score="100">
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <expression attribute="#uname" id="prefered_location_group_1_expr"
operation="eq" value="gtt4.linux.com"/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </rule>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </rsc_location>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </constraints>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </configuration>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] <status/>
cib[4922]: 2009/08/13_20:29:13 info: log_data_element: readCibXmlFile:
[on-disk] </cib>
cib[4922]: 2009/08/13_20:29:13 info: startCib: CIB Initialization completed
successfully
cib[4922]: 2009/08/13_20:29:13 info: cib_register_ha: Signing in with
Heartbeat
stonithd[4924]: 2009/08/13_20:29:13 notice: /usr/lib64/heartbeat/stonithd
start up successfully.
stonithd[4924]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added
signal handler for signal 17
ccm[4921]: 2009/08/13_20:29:13 info: G_main_add_SignalHandler: Added signal
handler for signal 15
cib[4922]: 2009/08/13_20:29:13 info: cib_register_ha: FSA Hostname:
gtt4.linux.com
cib[4922]: 2009/08/13_20:29:13 info: ccm_connect: Registering with CCM...
cib[4922]: 2009/08/13_20:29:14 info: cib_init: Starting cib mainloop
cib[4930]: 2009/08/13_20:29:14 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig)
cib[4930]: 2009/08/13_20:29:14 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig)
cib[4930]: 2009/08/13_20:29:14 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest:
/var/lib/heartbeat/crm/cib.xml.sig.last)
cib[4930]: 2009/08/13_20:29:14 info: write_cib_contents: Wrote version 0.1.1
of the CIB to disk (digest: a881e5a92e1c741373bcc0c4812c733e)
cib[4930]: 2009/08/13_20:29:14 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml (digest:
/var/lib/heartbeat/crm/cib.xml.sig)
cib[4930]: 2009/08/13_20:29:14 info: retrieveCib: Reading cluster
configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest:
/var/lib/heartbeat/crm/cib.xml.sig.last)
cib[4922]: 2009/08/13_20:29:14 info: cib_client_status_callback: Status
update: Client gtt4.linux.com/cib now has status [join]
cib[4922]: 2009/08/13_20:29:14 info: cib_client_status_callback: Status
update: Client gtt4.linux.com/cib now has status [online]
crmd[4926]: 2009/08/13_20:29:14 info: do_cib_control: CIB connection
established
cib[4922]: 2009/08/13_20:29:14 info: cib_null_callback: Setting
cib_refresh_notify callbacks for crmd: on
crmd[4926]: 2009/08/13_20:29:14 info: register_with_ha: Hostname:
gtt4.linux.com
cib[4922]: 2009/08/13_20:29:14 info: cib_null_callback: Setting
cib_diff_notify callbacks for mgmtd: on
crmd[4926]: 2009/08/13_20:29:15 info: register_with_ha: UUID:
87dc2dcc-791b-4bfb-a971-b30fbd909255
cib[4922]: 2009/08/13_20:29:15 info: cib_client_status_callback: Status
update: Client gtt5.linux.com/cib now has status [online]
crmd[4926]: 2009/08/13_20:29:15 info: populate_cib_nodes: Requesting the
list of configured nodes
mgmtd[4927]: 2009/08/13_20:29:15 info: Started.
crmd[4926]: 2009/08/13_20:29:16 notice: populate_cib_nodes: Node:
gtt5.linux.com (uuid: 7d892d6c-d277-45c2-beb6-331fca5b3920)
crmd[4926]: 2009/08/13_20:29:17 notice: populate_cib_nodes: Node:
gtt4.linux.com (uuid: 87dc2dcc-791b-4bfb-a971-b30fbd909255)
crmd[4926]: 2009/08/13_20:29:17 info: do_ha_control: Connected to Heartbeat
crmd[4926]: 2009/08/13_20:29:17 info: do_ccm_control: CCM connection
established... waiting for first callback
crmd[4926]: 2009/08/13_20:29:17 info: do_started: Delaying start, CCM
(0000000000100000) not connected
crmd[4926]: 2009/08/13_20:29:17 info: crmd_init: Starting crmd's mainloop
crmd[4926]: 2009/08/13_20:29:17 notice: crmd_client_status_callback: Status
update: Client gtt4.linux.com/crmd now has status [online]
crmd[4926]: 2009/08/13_20:29:17 notice: crmd_client_status_callback: Status
update: Client gtt4.linux.com/crmd now has status [online]
crmd[4926]: 2009/08/13_20:29:17 notice: crmd_client_status_callback: Status
update: Client gtt5.linux.com/crmd now has status [online]
crmd[4926]: 2009/08/13_20:29:18 info: do_started: Delaying start, CCM
(0000000000100000) not connected
crmd[4926]: 2009/08/13_20:29:18 info: mem_handle_event: Got an event
OC_EV_MS_NEW_MEMBERSHIP from ccm
crmd[4926]: 2009/08/13_20:29:18 info: mem_handle_event: instance=12,
nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
crmd[4926]: 2009/08/13_20:29:18 info: crmd_ccm_msg_callback: Quorum
(re)attained after event=NEW MEMBERSHIP (id=12)
crmd[4926]: 2009/08/13_20:29:18 info: ccm_event_detail: NEW MEMBERSHIP:
trans=12, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
crmd[4926]: 2009/08/13_20:29:18 info: ccm_event_detail: CURRENT:
gtt5.linux.com [nodeid=1, born=2]
crmd[4926]: 2009/08/13_20:29:18 info: ccm_event_detail: CURRENT:
gtt4.linux.com [nodeid=0, born=12]
crmd[4926]: 2009/08/13_20:29:18 info: ccm_event_detail: NEW:
gtt5.linux.com[nodeid=1, born=2]
crmd[4926]: 2009/08/13_20:29:18 info: ccm_event_detail: NEW:
gtt4.linux.com[nodeid=0, born=12]
crmd[4926]: 2009/08/13_20:29:18 info: do_started: The local CRM is
operational
crmd[4926]: 2009/08/13_20:29:18 info: do_state_transition: State transition
S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK
origin=do_started ]
cib[4922]: 2009/08/13_20:29:18 info: mem_handle_event: Got an event
OC_EV_MS_NEW_MEMBERSHIP from ccm
cib[4922]: 2009/08/13_20:29:18 info: mem_handle_event: instance=12, nodes=2,
new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
cib[4922]: 2009/08/13_20:29:18 info: cib_ccm_msg_callback: PEER:
gtt5.linux.com
cib[4922]: 2009/08/13_20:29:18 info: cib_ccm_msg_callback: PEER:
gtt4.linux.com
crmd[4926]: 2009/08/13_20:29:20 info: update_dc: Set DC to gtt5.linux.com(2.0)
crmd[4926]: 2009/08/13_20:29:21 info: update_dc: Set DC to gtt5.linux.com(2.0)
crmd[4926]: 2009/08/13_20:29:21 info: do_state_transition: State transition
S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE
origin=do_cl_join_finalize_respond ]
cib[4922]: 2009/08/13_20:29:21 info: cib_replace_notify: Replaced: 0.1.1 ->
0.1.214 from <null>
crmd[4926]: 2009/08/13_20:29:21 info: populate_cib_nodes: Requesting the
list of configured nodes
crmd[4926]: 2009/08/13_20:29:22 notice: populate_cib_nodes: Node:
gtt5.linux.com (uuid: 7d892d6c-d277-45c2-beb6-331fca5b3920)
crmd[4926]: 2009/08/13_20:29:23 notice: populate_cib_nodes: Node:
gtt4.linux.com (uuid: 87dc2dcc-791b-4bfb-a971-b30fbd909255)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=MailTo_1_monitor_0 key=5:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:23 info: rsc:MailTo_1: monitor
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=IPaddr_192_168_2_20_monitor_0
key=6:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:23 info: rsc:IPaddr_192_168_2_20: monitor
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=drbddisk_3_monitor_0 key=7:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:23 info: rsc:drbddisk_3: monitor
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=LVM_4_monitor_0 key=8:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:23 info: rsc:LVM_4: monitor
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=Filesystem_5_monitor_0 key=9:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:23 info: rsc:Filesystem_5: monitor
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=MakeMounts_6_monitor_0 key=10:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=Filesystem_7_monitor_0 key=11:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=Filesystem_8_monitor_0 key=12:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=httpd_9_monitor_0 key=13:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=proftpd_10_monitor_0 key=14:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=nfs_11_monitor_0 key=15:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=smb_12_monitor_0 key=16:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=acpid_13_monitor_0 key=17:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: do_lrm_rsc_op: Performing
op=openfiler_14_monitor_0 key=18:32:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:23 info: process_lrm_event: LRM operation
drbddisk_3_monitor_0 (call=4, rc=7) complete
crmd[4926]: 2009/08/13_20:29:23 info: process_lrm_event: LRM operation
MailTo_1_monitor_0 (call=2, rc=7) complete
lrmd[4923]: 2009/08/13_20:29:23 info: RA output: (LVM_4:monitor:stderr) File
descriptor 4 left open
File descriptor 5 left open
File descriptor 6 left open
File descriptor 7 left open
File descriptor 8 left open
File descriptor 9 left open
File descriptor 10 left open
File descriptor 11 left open
File descriptor 12 left open
File descriptor 14 left open
lrmd[4923]: 2009/08/13_20:29:23 info: RA output: (LVM_4:monitor:stderr)
Using volume group(s) on command line
lrmd[4923]: 2009/08/13_20:29:23 info: RA output: (LVM_4:monitor:stderr)
Finding volume group "vg0_drbd"
crmd[4926]: 2009/08/13_20:29:23 info: process_lrm_event: LRM operation
Filesystem_5_monitor_0 (call=6, rc=7) complete
crmd[4926]: 2009/08/13_20:29:23 info: process_lrm_event: LRM operation
IPaddr_192_168_2_20_monitor_0 (call=3, rc=7) complete
lrmd[4923]: 2009/08/13_20:29:23 info: RA output: (LVM_4:monitor:stderr)
Wiping cache of LVM-capable devices
lrmd[4923]: 2009/08/13_20:29:23 info: RA output: (LVM_4:monitor:stderr)
Volume group "vg0_drbd" not found
LVM[4936]: 2009/08/13_20:29:23 INFO: LVM Volume vg0_drbd is offline
crmd[4926]: 2009/08/13_20:29:23 info: process_lrm_event: LRM operation
LVM_4_monitor_0 (call=5, rc=7) complete
attrd[4925]: 2009/08/13_20:29:23 info: main: Starting mainloop...
lrmd[4923]: 2009/08/13_20:29:24 info: rsc:MakeMounts_6: monitor
lrmd[4923]: 2009/08/13_20:29:24 info: rsc:Filesystem_7: monitor
lrmd[4923]: 2009/08/13_20:29:24 info: rsc:Filesystem_8: monitor
lrmd[4923]: 2009/08/13_20:29:24 info: rsc:httpd_9: monitor
Filesystem[5006]: 2009/08/13_20:29:24 WARNING: Couldn't find device
[/dev/vg0_drbd/lvm2]. Expected /dev/??? to exist
crmd[4926]: 2009/08/13_20:29:24 info: process_lrm_event: LRM operation
MakeMounts_6_monitor_0 (call=7, rc=7) complete
crmd[4926]: 2009/08/13_20:29:24 info: process_lrm_event: LRM operation
httpd_9_monitor_0 (call=10, rc=7) complete
Filesystem[5007]: 2009/08/13_20:29:24 WARNING: Couldn't find device
[/dev/vg0_drbd/lvm3]. Expected /dev/??? to exist
crmd[4926]: 2009/08/13_20:29:24 info: process_lrm_event: LRM operation
Filesystem_7_monitor_0 (call=8, rc=7) complete
crmd[4926]: 2009/08/13_20:29:24 info: process_lrm_event: LRM operation
Filesystem_8_monitor_0 (call=9, rc=7) complete
lrmd[4923]: 2009/08/13_20:29:25 info: rsc:proftpd_10: monitor
lrmd[4923]: 2009/08/13_20:29:25 info: rsc:nfs_11: monitor
lrmd[4923]: 2009/08/13_20:29:25 info: rsc:smb_12: monitor
lrmd[4923]: 2009/08/13_20:29:25 info: rsc:acpid_13: monitor
crmd[4926]: 2009/08/13_20:29:25 info: process_lrm_event: LRM operation
smb_12_monitor_0 (call=13, rc=0) complete
lrmd[4923]: 2009/08/13_20:29:25 info: RA output: (nfs_11:monitor:stderr)
touch:
lrmd[4923]: 2009/08/13_20:29:25 info: RA output: (nfs_11:monitor:stderr)
cannot touch `/etc/exports'
lrmd[4923]: 2009/08/13_20:29:25 info: RA output: (nfs_11:monitor:stderr) :
No such file or directory
lrmd[4923]: 2009/08/13_20:29:25 info: RA output: (nfs_11:monitor:stderr)
crmd[4926]: 2009/08/13_20:29:25 info: process_lrm_event: LRM operation
proftpd_10_monitor_0 (call=11, rc=0) complete
crmd[4926]: 2009/08/13_20:29:25 info: process_lrm_event: LRM operation
nfs_11_monitor_0 (call=12, rc=0) complete
lrmd[4923]: 2009/08/13_20:29:26 WARN: G_SIG_dispatch: Dispatch function for
SIGCHLD was delayed 980 ms (> 100 ms) before being called (GSource:
0x519ed8)
lrmd[4923]: 2009/08/13_20:29:26 info: G_SIG_dispatch: started at 1718383106
should have started at 1718383008
lrmd[4923]: 2009/08/13_20:29:26 info: rsc:openfiler_14: monitor
crmd[4926]: 2009/08/13_20:29:26 info: process_lrm_event: LRM operation
acpid_13_monitor_0 (call=14, rc=0) complete
crmd[4926]: 2009/08/13_20:29:26 info: process_lrm_event: LRM operation
openfiler_14_monitor_0 (call=15, rc=7) complete
crmd[4926]: 2009/08/13_20:29:27 info: do_lrm_rsc_op: Performing
op=MailTo_1_start_0 key=5:33:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:27 info: rsc:MailTo_1: start
crmd[4926]: 2009/08/13_20:29:27 info: process_lrm_event: LRM operation
MailTo_1_start_0 (call=16, rc=0) complete
crmd[4926]: 2009/08/13_20:29:28 info: do_lrm_rsc_op: Performing
op=MailTo_1_start_0 key=6:34:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:28 info: rsc:MailTo_1: start
crmd[4926]: 2009/08/13_20:29:28 info: process_lrm_event: LRM operation
MailTo_1_start_0 (call=17, rc=0) complete
crmd[4926]: 2009/08/13_20:29:30 info: do_lrm_rsc_op: Performing
op=MailTo_1_monitor_120000 key=7:34:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
crmd[4926]: 2009/08/13_20:29:30 info: do_lrm_rsc_op: Performing
op=IPaddr_192_168_2_20_start_0
key=8:34:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:30 info: rsc:IPaddr_192_168_2_20: start
crmd[4926]: 2009/08/13_20:29:30 info: process_lrm_event: LRM operation
MailTo_1_monitor_120000 (call=18, rc=0) complete
lrmd[4923]: 2009/08/13_20:29:30 info: RA output:
(IPaddr_192_168_2_20:start:stderr) 24: unknown interface: No such device
lrmd[4923]: 2009/08/13_20:29:30 info: RA output:
(IPaddr_192_168_2_20:start:stderr)
/usr/lib64/heartbeat/findif version 2.1.3 Copyright Alan Robertson
Usage: /usr/lib64/heartbeat/findif [-C]
Options:
-C: Output netmask as the number of bits rather than as 4 octets.
Environment variables:
OCF_RESKEY_ip ip address (mandatory!)
OCF_RESKEY_cidr_netmask netmask of interface
OCF_RESKEY_broadcast broadcast address for interface
OCF_RESKEY_nic interface to assign to
IPaddr[5164]: 2009/08/13_20:29:30 ERROR: /usr/lib64/heartbeat/findif failed
[rc=1].
crmd[4926]: 2009/08/13_20:29:30 ERROR: process_lrm_event: LRM operation
IPaddr_192_168_2_20_start_0 (call=19, rc=1) Error unknown error
crmd[4926]: 2009/08/13_20:29:31 info: do_lrm_rsc_op: Performing
op=IPaddr_192_168_2_20_stop_0 key=2:36:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:31 info: rsc:IPaddr_192_168_2_20: stop
crmd[4926]: 2009/08/13_20:29:31 info: do_lrm_rsc_op: Performing
op=acpid_13_stop_0 key=12:36:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:31 info: rsc:acpid_13: stop
lrmd[5217]: 2009/08/13_20:29:31 WARN: For LSB init script, no additional
parameters are needed.
lrmd[4923]: 2009/08/13_20:29:31 info: RA output: (acpid_13:stop:stdout)
Stopping acpi daemon:
lrmd[4923]: 2009/08/13_20:29:31 info: RA output: (acpid_13:stop:stdout) [
lrmd[4923]: 2009/08/13_20:29:31 info: RA output: (acpid_13:stop:stdout)
FAILED]^M
lrmd[4923]: 2009/08/13_20:29:31 info: RA output: (acpid_13:stop:stdout)
crmd[4926]: 2009/08/13_20:29:31 info: process_lrm_event: LRM operation
acpid_13_stop_0 (call=21, rc=0) complete
lrmd[4923]: 2009/08/13_20:29:31 info: RA output:
(IPaddr_192_168_2_20:stop:stdout) In IP Stop
crmd[4926]: 2009/08/13_20:29:31 info: process_lrm_event: LRM operation
IPaddr_192_168_2_20_stop_0 (call=20, rc=0) complete
crmd[4926]: 2009/08/13_20:29:33 info: do_lrm_rsc_op: Performing
op=smb_12_stop_0 key=11:36:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:33 info: rsc:smb_12: stop
lrmd[5239]: 2009/08/13_20:29:33 WARN: For LSB init script, no additional
parameters are needed.
crmd[4926]: 2009/08/13_20:29:33 info: process_lrm_event: LRM operation
smb_12_stop_0 (call=22, rc=0) complete
crmd[4926]: 2009/08/13_20:29:34 info: do_lrm_rsc_op: Performing
op=nfs_11_stop_0 key=10:36:0fe2c5fe-c2e3-4d6a-b0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:34 info: rsc:nfs_11: stop
lrmd[5242]: 2009/08/13_20:29:34 WARN: For LSB init script, no additional
parameters are needed.
lrmd[4923]: 2009/08/13_20:29:34 info: RA output: (nfs_11:stop:stderr) touch:
lrmd[4923]: 2009/08/13_20:29:34 info: RA output: (nfs_11:stop:stderr) cannot
touch `/etc/exports'
lrmd[4923]: 2009/08/13_20:29:34 info: RA output: (nfs_11:stop:stderr) : No
such file or directory
lrmd[4923]: 2009/08/13_20:29:34 info: RA output: (nfs_11:stop:stderr)
lrmd[4923]: 2009/08/13_20:29:34 info: RA output: (nfs_11:stop:stdout)
/etc/exports does not exist
crmd[4926]: 2009/08/13_20:29:34 info: process_lrm_event: LRM operation
nfs_11_stop_0 (call=23, rc=0) complete
crmd[4926]: 2009/08/13_20:29:35 info: do_lrm_rsc_op: Performing
op=proftpd_10_stop_0 key=9:36:0fe2c5fe-c2e3-4d6
ab0be-ee527184b247)
lrmd[4923]: 2009/08/13_20:29:35 info: rsc:proftpd_10: stop
lrmd[5246]: 2009/08/13_20:29:35 WARN: For LSB init script, no additional
parameters are needed.
lrmd[4923]: 2009/08/13_20:29:35 info: RA output: (proftpd_10:stop:stdout)
Shutting down proftpd:
lrmd[4923]: 2009/08/13_20:29:35 info: RA output: (proftpd_10:stop:stdout)
[FAILED
lrmd[4923]: 2009/08/13_20:29:35 info: RA output: (proftpd_10:stop:stdout)
]^M
lrmd[4923]: 2009/08/13_20:29:35 info: RA output: (proftpd_10:stop:stdout)
crmd[4926]: 2009/08/13_20:29:35 info: process_lrm_event: LRM operation
proftpd_10_stop_0 (call=24, rc=0) complete
Please help me where a iam doing wrong, for this error i have spent one
week.
Thanks
*Prakash, k, h. *
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems
