On Wed, Sep 21, 2011 at 3:43 AM, kevins7189 <[email protected]> wrote:
>
> Having an issue with my cluster testing.  I have a simple 2 node
> drbd/nfs/mysql cluster.  Working on configuring stonith (which is not
> working for me), but while testing failover scenarios, running into a issue
> where crmd terminates on both nodes.  It successfully switches the
> resources, but crmd is gone, on both nodes.  I don't understand why that is
> happening?

Looking for ERROR in the logs is often a good place to start:

Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] ERROR:
pcmk_cluster_id_callback: Invalid message: Node 16777343 claimed to be node
56862912
...
Sep 20 13:01:20 fse0-pre2 crmd: [10117]: ERROR: check_dead_member: We're not
part of the cluster anymore

Try setting a fixed nodeid instead of having corosync calculate one
from the node's IP address - which would appear to be changing when
corosync rebinds after the interface is taken down.

>
> Here is what I believe to be the crmd stopping (its stops on BOTH nodes, but
> resources still switch).  The test I was performing was downing the DRBD
> interface on the active node.
>
> Sep 20 13:01:16 fse0-pre2 corosync[10099]:   [TOTEM ] A processor failed,
> forming new configuration.
> Sep 20 13:01:16 fse0-pre2 corosync[10099]:   [TOTEM ] The network interface
> is down.
> Sep 20 13:01:17 fse0-pre2 stonith: external/ipmi device OK.
> Sep 20 13:01:17 fse0-pre2 stonith-ng: [10112]: info: log_operation:
> Operation 'monitor' [30634] for device 'stonith_fse0-pre1' returned: 0
> Sep 20 13:01:19 fse0-pre2 stonith-ng: [10112]: info: stonith_device_action:
> Operation monitor on stonith_fse0-pre1 active with pid: 30684
> Sep 20 13:01:19 fse0-pre2 stonith-ng: [10112]: info: stonith_command:
> Processed st_execute from lrmd: rc=30684
> Sep 20 13:01:19 fse0-pre2 external/ipmi[30689]: [30699]: debug: ipmitool
> output: Chassis Power is on
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] CLM CONFIGURATION
> CHANGE
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] New Configuration:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ]   r(0) ip(127.0.0.1)
> r(1) ip(10.10.11.102)
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] Members Left:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ]   r(0)
> ip(192.168.99.3) r(1) ip(10.10.11.102)
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] Members Joined:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] notice:
> pcmk_peer_update: Transitional membership event on ring 692: memb=1, new=0,
> lost=1
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> pcmk_peer_update: memb: .unknown. 16777343
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> pcmk_peer_update: lost: fse0-pre2 56862912
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] CLM CONFIGURATION
> CHANGE
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] New Configuration:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ]   r(0) ip(127.0.0.1)
> r(1) ip(10.10.11.102)
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] Members Left:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [CLM   ] Members Joined:
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] notice:
> pcmk_peer_update: Stable membership event on ring 692: memb=1, new=0, lost=0
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info: update_member:
> Creating entry for node 16777343 born on 692
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info: update_member:
> Node 16777343/unknown is now: member
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> pcmk_peer_update: MEMB: .pending. 16777343
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] ERROR:
> pcmk_peer_update: Something strange happened: 1
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> ais_mark_unseen_peer_dead: Node fse0-pre1 was not seen in the previous
> transition
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info: update_member:
> Node 40085696/fse0-pre1 is now: lost
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> ais_mark_unseen_peer_dead: Node fse0-pre2 was not seen in the previous
> transition
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info: update_member:
> Node 56862912/fse0-pre2 is now: lost
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] info:
> send_member_notification: Sending membership update 692 to 2 children
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [TOTEM ] A processor joined or
> left the membership and a new membership was formed.
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [pcmk  ] ERROR:
> pcmk_cluster_id_callback: Invalid message: Node 16777343 claimed to be node
> 56862912
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: notice: ais_dispatch: Membership
> 692: quorum lost
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: ais_status_callback: status:
> fse0-pre1 is now lost (was member)
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: crm_update_peer: Node
> fse0-pre1: id=40085696 state=lost (new) addr=r(0) ip(192.168.99.2) r(1)
> ip(10.10.11.101)  votes=1 born=688 seen=688
> proc=00000000000000000000000000151312
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: ais_status_callback: status:
> fse0-pre2 is now lost (was member)
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: crm_update_peer: Node
> fse0-pre2: id=56862912 state=lost (new) addr=r(0) ip(192.168.99.3) r(1)
> ip(10.10.11.102)  votes=1 born=644 seen=688
> proc=00000000000000000000000000151312
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: crm_new_peer: Node <null> now
> has id: 16777343
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: crm_update_peer: Node (null):
> id=16777343 state=member (new) addr=(null) votes=0 born=0 seen=0
> proc=00000000000000000000000000000000
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: erase_node_from_join: Removed
> node fse0-pre2 from join calculations: welcomed=0 itegrated=0 finalized=0
> confirmed=1
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: ERROR: check_dead_member: We're not
> part of the cluster anymore
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: erase_node_from_join: Removed
> node fse0-pre1 from join calculations: welcomed=0 itegrated=0 finalized=0
> confirmed=1
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: notice: ais_dispatch: Membership
> 692: quorum lost
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: info: crm_update_peer: Node
> fse0-pre1: id=40085696 state=lost (new) addr=r(0) ip(192.168.99.2) r(1)
> ip(10.10.11.101)  votes=1 born=688 seen=688
> proc=00000000000000000000000000151312
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: info: crm_update_peer: Node
> fse0-pre2: id=56862912 state=lost (new) addr=r(0) ip(192.168.99.3) r(1)
> ip(10.10.11.102)  votes=1 born=644 seen=688
> proc=00000000000000000000000000151312
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: info: crm_new_peer: Node <null> now
> has id: 16777343
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: info: crm_update_peer: Node (null):
> id=16777343 state=member (new) addr=(null) votes=0 born=0 seen=0
> proc=00000000000000000000000000000000
> Sep 20 13:01:20 fse0-pre2 corosync[10099]:   [EVT   ] recovery error node:
> r(0) ip(127.0.0.1) r(1) ip(10.10.11.102)  not found
> Sep 20 13:01:20 fse0-pre2 crmd: [10117]: info: crm_update_quorum: Updating
> quorum status to false (call=1263)
> Sep 20 13:01:20 fse0-pre2 cib: [10113]: info: cib_process_request: Operation
> complete: op cib_modify for section nodes (origin=local/crmd/1261,
> version=0.261.11): ok (rc=0)
> Sep 20 13:01:20 fse0-pre2 attrd: [10115]: ERROR: ais_dispatch: Receiving
> message body failed: (2) Library error: Resource temporarily unavailable
> (11)
> Sep 20 13:01:20 fse0-pre2 attrd: [10115]: ERROR: ais_dispatch: AIS
> connection failed
> Sep 20 13:01:20 fse0-pre2 stonith-ng: [10112]: ERROR: ais_dispatch:
> Receiving message body failed: (2) Library error: Resource temporarily
> unavailable (11)
> Sep 20 13:01:20 fse0-pre2 attrd: [10115]: CRIT: attrd_ais_destroy: Lost
> connection to OpenAIS service!
> Sep 20 13:01:20 fse0-pre2 stonith-ng: [10112]: ERROR: ais_dispatch: AIS
> connection failed
> Sep 20 13:01:20 fse0-pre2 attrd: [10115]: info: main: Exiting...
> Sep 20 13:01:20 fse0-pre2 stonith-ng: [10112]: ERROR:
> stonith_peer_ais_destroy: AIS connection terminated
> Sep 20 13:01:20 fse0-pre2 attrd: [10115]: ERROR:
> attrd_cib_connection_destroy: Connection to the CIB terminated...
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092012] block drbd0: PingAck did
> not arrive in time.
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092021] block drbd0: peer(
> Secondary -> Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate ->
> DUnknown )
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092033] block drbd0: asender
> terminated
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092036] block drbd0: short read
> expecting header on sock: r=-512
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092039] block drbd0: Terminating
> asender thread
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092065] block drbd0: Creating new
> current UUID
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092222] block drbd0: Connection
> closed
> Sep 20 13:01:20 fse0-pre2 kernel: [184886.092228] block drbd0: helper
> command: /sbin/drbdadm fence-peer minor-0
> Sep 20 13:01:20 fse0-pre2 crm-fence-peer.sh[30703]: invoked for fse0-drbd
> Sep 20 13:01:20 fse0-pre2 cibadmin: [30707]: info: Invoked: cibadmin -Ql
> Sep 20 13:01:20 fse0-pre2 lrm-stonith: [30683]: ERROR: stonith_send_command:
> STONITH disconnected: 3
> Sep 20 13:01:20 fse0-pre2 lrm-stonith: [30683]: WARN: map_ra_retvalue:
> Mapped the invalid return code -4.
> Sep 20 13:01:21 fse0-pre2 cib: [10113]: ERROR: send_ais_text: Sending
> message 835: FAILED (rc=2): Library error: Connection timed out (110)
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: info: log_data_element: cib:diff: -
> <cib have-quorum="1" admin_epoch="0" epoch="261" num_updates="12" />
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: info: log_data_element: cib:diff: +
> <cib have-quorum="0" admin_epoch="0" epoch="262" num_updates="1" />
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: info: cib_process_request: Operation
> complete: op cib_modify for section cib (origin=local/crmd/1263,
> version=0.262.1): ok (rc=0)
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: ERROR: send_ais_message: Not
> connected to AIS
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: ERROR: ais_dispatch: Receiving
> message body failed: (2) Library error: Resource temporarily unavailable
> (11)
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: ERROR: ais_dispatch: AIS connection
> failed
> Sep 20 13:01:22 fse0-pre2 cib: [10113]: ERROR: cib_ais_destroy: AIS
> connection terminated
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: crm_ais_dispatch: Setting
> expected votes to 2
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: do_log: FSA: Input I_ERROR
> from check_dead_member() received in state S_IDLE
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_state_transition: State
> transition S_IDLE -> S_RECOVERY [ input=I_ERROR cause=C_FSA_INTERNAL
> origin=check_dead_member ]
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: do_recover: Action A_RECOVER
> (0000000001000000) not supported
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: WARN: do_election_vote: Not voting
> in election, we're in state S_RECOVERY
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_dc_release: DC role
> released
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: pe_connection_destroy:
> Connection to the Policy Engine released
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_te_control: Transitioner
> is now inactive
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: do_log: FSA: Input
> I_TERMINATE from do_recover() received in state S_RECOVERY
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_state_transition: State
> transition S_RECOVERY -> S_TERMINATE [ input=I_TERMINATE
> cause=C_FSA_INTERNAL origin=do_recover ]
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_shutdown: Disconnecting
> STONITH...
> Sep 20 13:01:22 fse0-pre2 mgmtd: [10118]: CRIT: cib_native_dispatch: Lost
> connection to the CIB service [10113/callback].
> Sep 20 13:01:22 fse0-pre2 mgmtd: [10118]: CRIT: cib_native_dispatch: Lost
> connection to the CIB service [10113/command].
> Sep 20 13:01:22 fse0-pre2 mgmtd: [10118]: ERROR: Connection to the CIB
> terminated... exiting
> Sep 20 13:01:22 fse0-pre2 crm-fence-peer.sh[30703]: Signon to CIB failed:
> connection failed
> Sep 20 13:01:22 fse0-pre2 crm-fence-peer.sh[30703]: Init failed, could not
> perform requested operations
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource
> drbd_nfs:0 was active at shutdown.  You may ignore this error if it is
> unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource
> mysql was active at shutdown.  You may ignore this error if it is unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: notice:
> ghash_print_pending_for_rsc: Recurring action mysql:327
> (mysql_monitor_60000) incomplete at shutdown
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423038] block drbd0: helper
> command: /sbin/drbdadm fence-peer minor-0 exit code 1 (0x100)
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423042] block drbd0: fence-peer
> helper broken, returned 1
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423049] block drbd0: Considering
> state change from bad state. Error would be: 'Refusing to be Primary while
> peer is not outdated'
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423053] block drbd0:  old = {
> cs:NetworkFailure ro:Primary/Unknown ds:UpToDate/DUnknown r--- }
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423056] block drbd0:  new = {
> cs:Unconnected ro:Primary/Unknown ds:UpToDate/DUnknown r--- }
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423060] block drbd0: conn(
> NetworkFailure -> Unconnected )
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource ip1
> was active at shutdown.  You may ignore this error if it is unmanaged.
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423068] block drbd0: receiver
> terminated
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: notice:
> ghash_print_pending_for_rsc: Recurring action ip1:137 (ip1_monitor_5000)
> incomplete at shutdown
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423070] block drbd0: Restarting
> receiver thread
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423073] block drbd0: receiver
> (re)started
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423076] block drbd0: Considering
> state change from bad state. Error would be: 'Refusing to be Primary while
> peer is not outdated'
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423080] block drbd0:  old = {
> cs:Unconnected ro:Primary/Unknown ds:UpToDate/DUnknown r--- }
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423083] block drbd0:  new = {
> cs:WFConnection ro:Primary/Unknown ds:UpToDate/DUnknown r--- }
> Sep 20 13:01:22 fse0-pre2 kernel: [184887.423085] block drbd0: conn(
> Unconnected -> WFConnection )
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource
> ip1arp was active at shutdown.  You may ignore this error if it is
> unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource
> fs_nfs was active at shutdown.  You may ignore this error if it is
> unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource nfs
> was active at shutdown.  You may ignore this error if it is unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: verify_stopped: Resource
> stonith_fse0-pre1 was active at shutdown.  You may ignore this error if it
> is unmanaged.
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: notice:
> ghash_print_pending_for_rsc: Recurring action stonith_fse0-pre1:36
> (stonith_fse0-pre1_monitor_15000) incomplete at shutdown
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: notice:
> ghash_print_pending_for_rsc: Recurring action stonith_fse0-pre1:333
> (stonith_fse0-pre1_monitor_20000) incomplete at shutdown
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: notice:
> ghash_print_pending_for_rsc: Recurring action stonith_fse0-pre1:330
> (stonith_fse0-pre1_monitor_20000) incomplete at shutdown
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_lrm_control: Disconnected
> from the LRM
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_ha_control: Disconnected
> from OpenAIS
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_cib_control: Disconnecting
> CIB
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: send_ipc_message: IPC
> Channel to 10113 is not connected
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: ERROR: cib_native_perform_op:
> Sending message to CIB service FAILED
> Sep 20 13:01:22 fse0-pre2 crmd: [10117]: info: do_exit: Performing A_EXIT_0
> - gracefully exiting the CRMd
>
>
> here is my configs
>
> corsync.conf
> aisexec {
>        #Group to run aisexec as. Needs to be root for Pacemaker
>
>        group:  root
>
>        #User to run aisexec as. Needs to be root for Pacemaker
>
>        user:   root
>
> }
> service {
>        #Default to start mgmtd with pacemaker
>
>        use_mgmtd:      yes
>
>        ver:    0
>
>        name:   pacemaker
>
> }
> totem {
>        #The mode for redundant ring. None is used when only 1 interface
> specified, otherwise, only active or passive may be choosen
>
>        rrp_mode:       passive
>
>        #How long to wait for join messages in membership protocol. in ms
>
>        join:   60
>
>        #The maximum number of messages that may be sent by one processor on
> receipt of the token.
>
>        max_messages:   20
>
>        #The virtual synchrony filter type used to indentify a primary
> component. Change with care.
>
>        vsftype:        none
>
>        #Timeout for a token lost. in ms
>
>        token:  3000
>
>        #How long to wait for consensus to be achieved before starting a new
> round of membership configuration.
>
>        consensus:      4000
>
>        #HMAC/SHA1 should be used to authenticate all message
>
>        secauth:        on
>
>        #How many token retransmits should be attempted before forming a new
> configuration.
>
>        token_retransmits_before_loss_const:    10
>
>        #How many threads should be used to encypt and sending message. Only
> have meanings when secauth is turned on
>
>        threads:        4
>
>        #The only valid version is 2
>
>        version:        2
>
>        interface {
>                #Network Address to be bind for this interface setting
>
>                bindnetaddr:    192.168.99.0
>
>                #The multicast address to be used
>
>                mcastaddr:      224.0.0.69
>
>                #The multicast port to be used
>
>                mcastport:      6969
>
>                #The ringnumber assigned to this interface setting
>
>                ringnumber:     0
>
>        }
>        interface {
>                #Network Address to be bind for this interface setting
>
>                bindnetaddr:    10.10.11.0
>
>                #The multicast address to be used
>
>                mcastaddr:      224.0.0.169
>
>                #The multicast port to be used
>
>                mcastport:      6969
>
>                #The ringnumber assigned to this interface setting
>
>                ringnumber:     1
>
>        }
>        #To make sure the auto-generated nodeid is positive
>
>        clear_node_high_bit:    yes
>
> }
> logging {
>        #Log to a specified file
>
>        to_logfile:     no
>
>        #Log to syslog
>
>        to_syslog:      yes
>
>        #Whether or not turning on the debug information in the log
>
>        debug:  off
>
>        #Log timestamp as well
>
>        timestamp:      on
>
>        #Log to the standard error output
>
>        to_stderr:      yes
>
>        #Logging file line in the source code as well
>
>        fileline:       off
>
>        #Facility in syslog
>
>        syslog_facility:        daemon
>
> }
> amf {
>        #Enable or disable AMF
>
>        mode:   disable
>
> crm config
>
> node fse0-pre1 \
>        attributes standby="off"
> node fse0-pre2 \
>        attributes standby="off"
> primitive drbd_nfs ocf:linbit:drbd \
>        params drbd_resource="fse0-drbd" \
>        op monitor interval="15s"
> primitive fs_nfs ocf:heartbeat:Filesystem \
>        params device="/dev/drbd0" directory="/pub" fstype="ext3" \
>        op start interval="0" timeout="60" \
>        op stop interval="0" timeout="120" \
>        meta target-role="Started"
> primitive ip1 ocf:heartbeat:IPaddr2 \
>        params ip="10.10.11.201" nic="bond0" \
>        op monitor interval="5s"
> primitive ip1arp ocf:heartbeat:SendArp \
>        params ip="10.10.11.201" nic="bond0"
> primitive mysql ocf:heartbeat:mysql \
>        params binary="/usr/local/mysql/bin/mysqld_safe"
> config="/etc/my.cnf" datadir="/usr/local/mysql/mysql-data"
> socket="/var/run/mysql/mysql.sock" pid="/var/run/mysql/mysqld.pid" \
>        op start interval="0" timeout="120" \
>        op stop interval="0" timeout="120" \
>        op monitor interval="60" timeout="30" depth="0" \
>        meta target-role="Started"
> primitive nfs lsb:nfsserver \
>        meta target-role="Started"
> primitive stonith_fse0-pre1 stonith:external/ipmi \
>        params hostname="fse0-pre1-ipmi" ipaddr="10.10.11.103" userid="root"
> passwd="reverse" interface="lan" \
>        op start interval="0" timeout="20" \
>        op stop interval="0" timeout="60" \
>        op monitor interval="20" timeout="30" \
>        meta target-role="Started"
> primitive stonith_fse0-pre2 stonith:external/ipmi \
>        params hostname="fse0-pre2" ipaddr="10.10.11.104" userid="root"
> passwd="reverse" interface="lan" \
>        op start interval="0" timeout="20" \
>        op stop interval="0" timeout="60" \
>        op monitor interval="20" timeout="30" \
>        meta target-role="Started"
> group HAServices ip1 ip1arp fs_nfs nfs mysql \
>        meta target-role="Started"
> ms ms_drbd_nfs drbd_nfs \
>        meta master-max="1" master-node-max="1" clone-max="2"
> clone-node-max="1" notify="true"
> location drbd-fence-by-handler-ms_drbd_nfs ms_drbd_nfs \
>        rule $id="drbd-fence-by-handler-rule-ms_drbd_nfs" $role="Master"
> -inf: #uname ne fse0-pre1
> location stonith_fse0-pre1_loc stonith_fse0-pre1 -inf: fse0-pre1
> location stonith_fse0-pre2_loc stonith_fse0-pre2 -inf: fse0-pre2
> colocation ms-drbd-nfs-with-haservices inf: ms_drbd_nfs:Master HAServices
> order fs-nfs-before-nfs inf: fs_nfs:start nfs:start
> order ip-before-arp inf: ip1:start ip1arp:start
> order ip-before-ms-drbd-nfs inf: ip1:start ms_drbd_nfs:promote
> order ms-drbd-nfs-before-fs-nfs inf: ms_drbd_nfs:promote fs_nfs:start
> order ms-drbd-nfs-before-mysql inf: ms_drbd_nfs:promote mysql:start
> property $id="cib-bootstrap-options" \
>        dc-version="1.1.2-2e096a41a5f9e184a1c1537c82c6da1093698eb5" \
>        cluster-infrastructure="openais" \
>        expected-quorum-votes="2" \
>        stonith-enabled="true" \
>        stonith-action="reboot" \
>        no-quorum-policy="ignore" \
>        cluster-recheck-interval="0"
> rsc_defaults $id="rsc-options" \
>        resource-stickiness="100"
>
>
> --
> View this message in context: 
> http://old.nabble.com/Cluster-corosync-issues%2C-crmd-terminating-tp32501089p32501089.html
> Sent from the Linux-HA mailing list archive at Nabble.com.
>
> _______________________________________________
> Linux-HA mailing list
> [email protected]
> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> See also: http://linux-ha.org/ReportingProblems
>
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems

Reply via email to