Feb 20 09:21:00 postit heartbeat: [4356]: info: Clock jumped backwards. Compensating.
Feb 20 09:22:32 postit root: Mark:HB_REPORT:1203517352
Feb 20 09:22:43 postit crmadmin: [6136]: info: Invoked: crmadmin -D 
Feb 20 09:22:43 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:22:44 postit cibadmin: [6140]: info: Invoked: cibadmin -Ql 
Feb 20 09:22:44 postit ccm_tool: [6141]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:22:44 postit ccm_tool: [6141]: info: mem_handle_event: instance=7, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:22:44 postit ccm: [4371]: info: client (pid=6141) removed from ccm
Feb 20 09:22:44 postit crm_verify: [6144]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on postit.mtu.edu: Error
Feb 20 09:22:44 postit crm_verify: [6144]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on postit.mtu.edu
Feb 20 09:22:44 postit crm_verify: [6144]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on linux.mtu.edu: Error
Feb 20 09:22:44 postit crm_verify: [6144]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on linux.mtu.edu
Feb 20 09:22:44 postit crmadmin: [6164]: info: Invoked: crmadmin -D 
Feb 20 09:22:44 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:22:54 postit crmd: [7525]: info: main: CRM Hg Version: node: 552305612591183b1628baa5bc6e903e0f1e26a3 
Feb 20 09:24:05 postit root: Mark:HB_REPORT:1203517431
Feb 20 09:24:11 postit crmadmin: [7975]: info: Invoked: crmadmin -D 
Feb 20 09:24:11 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:24:11 postit cibadmin: [7978]: info: Invoked: cibadmin -Ql 
Feb 20 09:24:11 postit ccm_tool: [7979]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:24:11 postit ccm_tool: [7979]: info: mem_handle_event: instance=7, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:24:11 postit ccm: [4371]: info: client (pid=7979) removed from ccm
Feb 20 09:24:11 postit crm_verify: [7982]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on postit.mtu.edu: Error
Feb 20 09:24:11 postit crm_verify: [7982]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on postit.mtu.edu
Feb 20 09:24:11 postit crm_verify: [7982]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on linux.mtu.edu: Error
Feb 20 09:24:11 postit crm_verify: [7982]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on linux.mtu.edu
Feb 20 09:24:11 postit crmadmin: [8002]: info: Invoked: crmadmin -D 
Feb 20 09:24:11 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:24:17 postit crmd: [9363]: info: main: CRM Hg Version: node: 552305612591183b1628baa5bc6e903e0f1e26a3 
Feb 20 09:24:27 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:24:29 postit crmd: [4376]: info: handle_request: Current ping state: S_IDLE
Feb 20 09:28:22 postit cib: [4372]: info: cib_stats: Processed 4 operations (2500.00us average, 0% utilization) in the last 10min
Feb 20 09:28:57 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/mgmtd -v process group 4377 with signal 15
Feb 20 09:28:57 postit mgmtd: [4377]: info: mgmtd is shutting down
Feb 20 09:28:57 postit haclient: on_event:evt:disconnected
Feb 20 09:28:57 postit mgmtd: [4377]: ERROR: Connection to the CIB terminated... exiting
Feb 20 09:28:57 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/crmd process group 4376 with signal 15
Feb 20 09:28:57 postit crmd: [4376]: info: crm_shutdown: Requesting shutdown
Feb 20 09:28:57 postit crmd: [4376]: info: do_state_transition: State transition S_IDLE -> S_POLICY_ENGINE [ input=I_SHUTDOWN cause=C_SHUTDOWN origin=crm_shutdown ]
Feb 20 09:28:57 postit crmd: [4376]: info: do_state_transition: All 2 cluster nodes are eligible to run resources.
Feb 20 09:28:57 postit crmd: [4376]: info: do_shutdown_req: Sending shutdown request to DC: postit.mtu.edu
Feb 20 09:28:57 postit crmd: [4376]: info: do_shutdown_req: Processing shutdown locally
Feb 20 09:28:57 postit crmd: [4376]: info: handle_shutdown_request: Creating shutdown request for postit.mtu.edu
Feb 20 09:28:57 postit tengine: [4385]: info: extract_event: Aborting on shutdown attribute for aaed2ff6-07cd-476f-8d98-259570a5480e
Feb 20 09:28:57 postit tengine: [4385]: info: update_abort_priority: Abort priority upgraded to 1000000
Feb 20 09:28:57 postit pengine: [4386]: info: determine_online_status: Node postit.mtu.edu is shutting down
Feb 20 09:28:57 postit pengine: [4386]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on postit.mtu.edu: Error
Feb 20 09:28:57 postit pengine: [4386]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on postit.mtu.edu
Feb 20 09:28:57 postit pengine: [4386]: info: determine_online_status: Node linux.mtu.edu is online
Feb 20 09:28:57 postit pengine: [4386]: WARN: unpack_rsc_op: Processing failed op Apache_start_0 on linux.mtu.edu: Error
Feb 20 09:28:57 postit pengine: [4386]: WARN: unpack_rsc_op: Compatability handling for failed op Apache_start_0 on linux.mtu.edu
Feb 20 09:28:57 postit pengine: [4386]: notice: group_print: Resource Group: Webserver
Feb 20 09:28:57 postit pengine: [4386]: notice: native_print:     IP	(heartbeat::ocf:IPaddr2):	Started postit.mtu.edu
Feb 20 09:28:57 postit pengine: [4386]: notice: native_print:     Apache	(heartbeat::ocf:apache):	Stopped 
Feb 20 09:28:57 postit pengine: [4386]: WARN: native_color: Resource Apache cannot run anywhere
Feb 20 09:28:57 postit pengine: [4386]: notice: NoRoleChange: Move  resource IP	(postit.mtu.edu -> linux.mtu.edu)
Feb 20 09:28:57 postit pengine: [4386]: notice: StopRsc:   postit.mtu.edu	Stop IP
Feb 20 09:28:57 postit pengine: [4386]: notice: StartRsc:  linux.mtu.edu	Start IP
Feb 20 09:28:57 postit pengine: [4386]: info: stage6: Scheduling Node postit.mtu.edu for shutdown
Feb 20 09:28:57 postit crmd: [4376]: info: do_state_transition: State transition S_POLICY_ENGINE -> S_TRANSITION_ENGINE [ input=I_PE_SUCCESS cause=C_IPC_MESSAGE origin=route_message ]
Feb 20 09:28:57 postit tengine: [4385]: info: unpack_graph: Unpacked transition 42: 8 actions in 8 synapses
Feb 20 09:28:57 postit tengine: [4385]: info: te_pseudo_action: Pseudo action 9 fired and confirmed
Feb 20 09:28:57 postit tengine: [4385]: info: te_pseudo_action: Pseudo action 13 fired and confirmed
Feb 20 09:28:57 postit tengine: [4385]: info: send_rsc_command: Initiating action 5: IP_stop_0 on postit.mtu.edu
Feb 20 09:28:57 postit crmd: [4376]: info: do_lrm_rsc_op: Performing op=IP_stop_0 key=5:42:4fe91bda-9521-4be5-bcce-247dc640f773)
Feb 20 09:28:57 postit lrmd: [4373]: info: rsc:IP: stop
Feb 20 09:28:57 postit pengine: [4386]: WARN: process_pe_message: Transition 42: WARNINGs found during PE processing. PEngine Input stored in: /var/lib/heartbeat/pengine/pe-warn-1335.bz2
Feb 20 09:28:57 postit pengine: [4386]: info: process_pe_message: Configuration WARNINGs found during PE processing.  Please run "crm_verify -L" to identify issues.
Feb 20 09:28:58 postit heartbeat: [4356]: WARN: G_SIG_dispatch: Dispatch function for SIGCHLD took too long to execute: 380 ms (> 30 ms) (GSource: 0x96293d8)
Feb 20 09:28:58 postit heartbeat: [4356]: WARN: Gmain_timeout_dispatch: Dispatch function for check for signals was delayed 580 ms (> 510 ms) before being called (GSource: 0x962b138)
Feb 20 09:28:58 postit heartbeat: [4356]: info: Gmain_timeout_dispatch: started at 430208774 should have started at 430208716
Feb 20 09:28:58 postit IPaddr2[9562]: [9591]: INFO: ip -f inet addr delete 192.168.1.30/24 dev eth0
Feb 20 09:28:58 postit IPaddr2[9562]: [9593]: INFO: ip -o -f inet addr show eth0
Feb 20 09:28:58 postit crmd: [4376]: info: process_lrm_event: LRM operation IP_stop_0 (call=29, rc=0) complete 
Feb 20 09:28:58 postit tengine: [4385]: info: match_graph_event: Action IP_stop_0 (5) confirmed on postit.mtu.edu (rc=0)
Feb 20 09:28:58 postit crmd: [4376]: info: handle_request: Shutting ourselves down (DC)
Feb 20 09:28:58 postit tengine: [4385]: info: te_pseudo_action: Pseudo action 10 fired and confirmed
Feb 20 09:28:58 postit crmd: [4376]: info: do_state_transition: State transition S_TRANSITION_ENGINE -> S_STOPPING [ input=I_STOP cause=C_IPC_MESSAGE origin=route_message ]
Feb 20 09:28:58 postit tengine: [4385]: info: te_pseudo_action: Pseudo action 4 fired and confirmed
Feb 20 09:28:58 postit crmd: [4376]: info: do_dc_release: DC role released
Feb 20 09:28:58 postit tengine: [4385]: info: te_crm_command: Executing crm-event (12): do_shutdown on postit.mtu.edu
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to pengine: [4386]
Feb 20 09:28:58 postit tengine: [4385]: info: te_crm_command: Skipping wait for 12
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit tengine: [4385]: info: te_pseudo_action: Pseudo action 7 fired and confirmed
Feb 20 09:28:58 postit pengine: [4386]: info: pengine_shutdown: Exiting PEngine (SIGTERM)
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the pengine
Feb 20 09:28:58 postit tengine: [4385]: info: send_rsc_command: Initiating action 6: IP_start_0 on linux.mtu.edu
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to pengine: [4386]
Feb 20 09:28:58 postit tengine: [4385]: info: update_abort_priority: Abort priority upgraded to 1000000
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:58 postit tengine: [4385]: info: update_abort_priority: Abort action 0 superceeded by 3
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:58 postit crmd: [4376]: WARN: register_fsa_input_adv: do_shutdown stalled the FSA with pending inputs
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:58 postit crmd: [4376]: WARN: do_log: [[FSA]] Input I_RELEASE_SUCCESS from do_dc_release() received in state (S_STOPPING)
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the pengine
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to pengine: [4386]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:58 postit crmd: [4376]: info: crmdManagedChildDied: Process pengine:[4386] exited (signal=0, exitcode=0)
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:58 postit crmd: [4376]: info: process_client_disconnect: Received HUP from pengine:[-1]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:58 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:58 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:59 postit tengine: [4385]: info: match_graph_event: Action IP_start_0 (6) confirmed on linux.mtu.edu (rc=0)
Feb 20 09:28:59 postit crmd: [4376]: info: process_client_disconnect: Received HUP from tengine:[4385]
Feb 20 09:28:59 postit tengine: [4385]: info: run_graph: Transition 42: (Complete=8, Pending=0, Fired=0, Skipped=0, Incomplete=0)
Feb 20 09:28:59 postit crmd: [4376]: info: do_shutdown: Terminating the tengine
Feb 20 09:28:59 postit tengine: [4385]: info: notify_crmd: Exiting after transition
Feb 20 09:28:59 postit crmd: [4376]: info: stop_subsystem: Sent -TERM to tengine: [4385]
Feb 20 09:28:59 postit tengine: [4385]: info: te_init: Exiting tengine
Feb 20 09:28:59 postit crmd: [4376]: info: do_shutdown: Waiting for subsystems to exit
Feb 20 09:28:59 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:59 postit crmd: [4376]: info: crmdManagedChildDied: Process tengine:[4385] exited (signal=0, exitcode=0)
Feb 20 09:28:59 postit crmd: [4376]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:28:59 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/attrd process group 4375 with signal 15
Feb 20 09:28:59 postit crmd: [4376]: info: do_lrm_control: Disconnected from the LRM
Feb 20 09:28:59 postit ccm: [4371]: info: client (pid=4376) removed from ccm
Feb 20 09:28:59 postit crmd: [4376]: info: do_ha_control: Disconnected from Heartbeat
Feb 20 09:28:59 postit attrd: [4375]: info: attrd_shutdown: Exiting
Feb 20 09:28:59 postit crmd: [4376]: info: do_cib_control: Disconnecting CIB
Feb 20 09:28:59 postit attrd: [4375]: info: main: Exiting...
Feb 20 09:28:59 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/stonithd process group 4374 with signal 15
Feb 20 09:28:59 postit stonithd: [4374]: notice: /usr/lib/heartbeat/stonithd normally quit.
Feb 20 09:28:59 postit crmd: [4376]: info: crmd_cib_connection_destroy: Connection to the CIB terminated...
Feb 20 09:28:59 postit attrd: [4375]: info: attrd_cib_connection_destroy: Connection to the CIB terminated...
Feb 20 09:28:59 postit crmd: [4376]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd
Feb 20 09:28:59 postit crmd: [4376]: info: free_mem: Dropping I_TERMINATE: [ state=S_STOPPING cause=C_FSA_INTERNAL origin=do_stop ]
Feb 20 09:28:59 postit crmd: [4376]: info: do_exit: [crmd] stopped (0)
Feb 20 09:28:59 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/lrmd -r process group 4373 with signal 15
Feb 20 09:28:59 postit lrmd: [4373]: info: lrmd is shutting down
Feb 20 09:28:59 postit cib: [4372]: info: cib_process_readwrite: We are now in R/O mode
Feb 20 09:28:59 postit cib: [4372]: WARN: send_via_callback_channel: Cannot find client for token 4ea08773-96d5-4d40-aff0-fe886383d7d3
Feb 20 09:28:59 postit cib: [4372]: WARN: do_local_notify: A-Sync reply to 4376 failed: client left before we could send reply
Feb 20 09:28:59 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/cib process group 4372 with signal 15
Feb 20 09:28:59 postit cib: [4372]: info: cib_shutdown: Disconnected 0 clients
Feb 20 09:28:59 postit cib: [4372]: info: cib_process_disconnect: All clients disconnected...
Feb 20 09:28:59 postit cib: [4372]: info: initiate_exit: Sending disconnect notification to 2 peers...
Feb 20 09:29:01 postit cib: [4372]: info: cib_process_shutdown_req: Shutdown ACK from linux.mtu.edu
Feb 20 09:29:01 postit cib: [4372]: info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat
Feb 20 09:29:01 postit cib: [4372]: info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting
Feb 20 09:29:01 postit cib: [4372]: info: main: Done
Feb 20 09:29:01 postit heartbeat: [4356]: info: killing /usr/lib/heartbeat/ccm process group 4371 with signal 15
Feb 20 09:29:01 postit ccm: [4371]: info: client (pid=4372) removed from ccm
Feb 20 09:29:01 postit ccm: [4371]: info: received SIGTERM, going to shut down
Feb 20 09:29:02 postit heartbeat: [4356]: info: killing HBFIFO process 4359 with signal 15
Feb 20 09:29:02 postit heartbeat: [4356]: info: killing HBWRITE process 4360 with signal 15
Feb 20 09:29:02 postit heartbeat: [4356]: info: killing HBREAD process 4361 with signal 15
Feb 20 09:29:02 postit heartbeat: [4356]: info: Core process 4359 exited. 3 remaining
Feb 20 09:29:02 postit heartbeat: [4356]: info: Core process 4360 exited. 2 remaining
Feb 20 09:29:02 postit heartbeat: [4356]: info: Core process 4361 exited. 1 remaining
Feb 20 09:29:02 postit heartbeat: [4356]: info: postit.mtu.edu Heartbeat shutdown complete.
Feb 20 09:29:23 postit heartbeat: [9616]: info: Version 2 support: on
Feb 20 09:29:23 postit heartbeat: [9616]: WARN: File /etc/ha.d/haresources exists.
Feb 20 09:29:23 postit heartbeat: [9616]: WARN: This file is not used because crm is enabled
Feb 20 09:29:23 postit heartbeat: [9616]: info: Enabling logging daemon 
Feb 20 09:29:23 postit heartbeat: [9616]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
Feb 20 09:29:23 postit heartbeat: [9616]: WARN: logd is enabled but logfile/debugfile/logfacility is still configured in ha.cf
Feb 20 09:29:23 postit heartbeat: [9616]: info: **************************
Feb 20 09:29:23 postit heartbeat: [9616]: info: Configuration validated. Starting heartbeat 2.1.3
Feb 20 09:29:23 postit heartbeat: [9617]: info: heartbeat: version 2.1.3
Feb 20 09:29:23 postit heartbeat: [9617]: info: Heartbeat generation: 36
Feb 20 09:29:23 postit heartbeat: [9617]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Feb 20 09:29:23 postit heartbeat: [9617]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Feb 20 09:29:23 postit heartbeat: [9617]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:29:23 postit heartbeat: [9617]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:29:23 postit heartbeat: [9617]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:29:23 postit heartbeat: [9617]: info: Local status now set to: 'up'
Feb 20 09:29:24 postit heartbeat: [9617]: info: Link linux.mtu.edu:eth1 up.
Feb 20 09:29:24 postit heartbeat: [9617]: info: Status update for node linux.mtu.edu: status active
Feb 20 09:29:24 postit heartbeat: [9617]: info: Link postit.mtu.edu:eth1 up.
Feb 20 09:29:25 postit heartbeat: [9617]: info: Comm_now_up(): updating status to active
Feb 20 09:29:25 postit heartbeat: [9617]: info: Local status now set to: 'active'
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/ccm" (90,90)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/cib" (90,90)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/attrd" (90,90)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/crmd" (90,90)
Feb 20 09:29:25 postit heartbeat: [9617]: info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0)
Feb 20 09:29:25 postit heartbeat: [9617]: WARN: G_CH_dispatch_int: Dispatch function for read child took too long to execute: 80 ms (> 50 ms) (GSource: 0x90e9440)
Feb 20 09:29:25 postit heartbeat: [9624]: info: Starting "/usr/lib/heartbeat/ccm" as uid 90  gid 90 (pid 9624)
Feb 20 09:29:25 postit heartbeat: [9625]: info: Starting "/usr/lib/heartbeat/cib" as uid 90  gid 90 (pid 9625)
Feb 20 09:29:25 postit cib: [9625]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:25 postit cib: [9625]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:29:25 postit cib: [9625]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:29:25 postit cib: [9625]: info: main: Retrieval of a per-action CIB: disabled
Feb 20 09:29:25 postit cib: [9625]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk] <cib generated="false" admin_epoch="0" epoch="24" have_quorum="false" ignore_dtd="false" ccm_transition="7" num_peers="2" cib_feature_revision="2.0" num_updates="1" cib-last-written="Tue Feb 19 18:27:13 2008">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]   <configuration>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     <crm_config>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       <cluster_property_set id="cib-bootstrap-options">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         <attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.1.3-node: 552305612591183b1628baa5bc6e903e0f1e26a3"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1203463617"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         </attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       </cluster_property_set>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     </crm_config>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     <nodes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       <node id="aaed2ff6-07cd-476f-8d98-259570a5480e" uname="postit.mtu.edu" type="normal"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       <node id="488d1100-f844-4e7b-a726-44cf37cb3d0b" uname="linux.mtu.edu" type="normal"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     </nodes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     <resources>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       <group id="Webserver">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="Webserver_meta_attrs">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="Webserver_metaattr_ordered" name="ordered" value="true"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="Webserver_metaattr_collocated" name="collocated" value="true"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           </attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="IP" class="ocf" type="IPaddr2" provider="heartbeat">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <instance_attributes id="IP_instance_attrs">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="adacda48-02dc-4127-9371-543ea7d79a87" name="ip" value="192.168.1.30"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           </instance_attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="Apache" class="ocf" type="apache" provider="heartbeat">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <instance_attributes id="Apache_instance_attrs">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="92d737eb-81ad-40c7-a330-788425a64b6a" name="configfile" value="/opt/apache-2.0.61/conf/httpd.conf"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           </instance_attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           <meta_attributes id="Apache_meta_attrs">
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="Apache_metaattr_target_role" name="target_role" value="started"/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]           </meta_attributes>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]       </group>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     </resources>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]     <constraints/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]   </configuration>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk]   <status/>
Feb 20 09:29:25 postit cib: [9625]: info: log_data_element: readCibXmlFile: [on-disk] </cib>
Feb 20 09:29:25 postit cib: [9625]: info: startCib: CIB Initialization completed successfully
Feb 20 09:29:25 postit cib: [9625]: info: cib_register_ha: Signing in with Heartbeat
Feb 20 09:29:25 postit ccm: [9624]: info: Hostname: postit.mtu.edu
Feb 20 09:29:25 postit heartbeat: [9627]: info: Starting "/usr/lib/heartbeat/stonithd" as uid 0  gid 0 (pid 9627)
Feb 20 09:29:25 postit stonithd: [9627]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:29:25 postit stonithd: [9627]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:29:25 postit heartbeat: [9628]: info: Starting "/usr/lib/heartbeat/attrd" as uid 90  gid 90 (pid 9628)
Feb 20 09:29:25 postit heartbeat: [9629]: info: Starting "/usr/lib/heartbeat/crmd" as uid 90  gid 90 (pid 9629)
Feb 20 09:29:25 postit heartbeat: [9630]: info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0  gid 0 (pid 9630)
Feb 20 09:29:25 postit cib: [9625]: info: cib_register_ha: FSA Hostname: postit.mtu.edu
Feb 20 09:29:25 postit cib: [9625]: info: ccm_connect: Registering with CCM...
Feb 20 09:29:25 postit cib: [9625]: WARN: ccm_connect: CCM Activation failed
Feb 20 09:29:25 postit cib: [9625]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Feb 20 09:29:25 postit heartbeat: [9626]: info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0  gid 0 (pid 9626)
Feb 20 09:29:26 postit lrmd: [9626]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:26 postit lrmd: [9626]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:29:26 postit lrmd: [9626]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:29:26 postit lrmd: [9626]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:29:26 postit lrmd: [9626]: info: Started.
Feb 20 09:29:26 postit stonithd: [9627]: info: Signing in with heartbeat.
Feb 20 09:29:26 postit attrd: [9628]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:26 postit stonithd: [9627]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Feb 20 09:29:26 postit stonithd: [9627]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:29:26 postit attrd: [9628]: info: register_with_ha: Hostname: postit.mtu.edu
Feb 20 09:29:26 postit attrd: [9628]: info: register_with_ha: UUID: aaed2ff6-07cd-476f-8d98-259570a5480e
Feb 20 09:29:26 postit crmd: [9629]: info: main: CRM Hg Version: node: 552305612591183b1628baa5bc6e903e0f1e26a3 
Feb 20 09:29:26 postit crmd: [9629]: info: crmd_init: Starting crmd
Feb 20 09:29:26 postit crmd: [9629]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:26 postit crmd: [9629]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:29:26 postit crmd: [9629]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:29:26 postit mgmtd: [9630]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:26 postit mgmtd: [9630]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:29:26 postit mgmtd: [9630]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:29:26 postit mgmtd: [9630]: info: init_crm
Feb 20 09:29:26 postit ccm: [9624]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:29:28 postit cib: [9625]: info: ccm_connect: Registering with CCM...
Feb 20 09:29:29 postit cib: [9625]: info: cib_init: Starting cib mainloop
Feb 20 09:29:29 postit cib: [9634]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:29:29 postit cib: [9634]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:29:29 postit cib: [9634]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
Feb 20 09:29:29 postit crmd: [9629]: info: do_cib_control: CIB connection established
Feb 20 09:29:29 postit cib: [9625]: info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on
Feb 20 09:29:29 postit crmd: [9629]: info: register_with_ha: Hostname: postit.mtu.edu
Feb 20 09:29:29 postit cib: [9625]: info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on
Feb 20 09:29:29 postit cib: [9625]: info: cib_client_status_callback: Status update: Client postit.mtu.edu/cib now has status [join]
Feb 20 09:29:29 postit cib: [9625]: info: cib_client_status_callback: Status update: Client postit.mtu.edu/cib now has status [online]
Feb 20 09:29:29 postit crmd: [9629]: info: register_with_ha: UUID: aaed2ff6-07cd-476f-8d98-259570a5480e
Feb 20 09:29:29 postit crmd: [9629]: info: populate_cib_nodes: Requesting the list of configured nodes
Feb 20 09:29:29 postit cib: [9625]: info: cib_client_status_callback: Status update: Client linux.mtu.edu/cib now has status [online]
Feb 20 09:29:30 postit cib: [9625]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:29:30 postit cib: [9625]: info: mem_handle_event: instance=9, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:29:30 postit cib: [9625]: info: cib_ccm_msg_callback: PEER: linux.mtu.edu
Feb 20 09:29:30 postit cib: [9625]: info: cib_ccm_msg_callback: PEER: postit.mtu.edu
Feb 20 09:29:30 postit cib: [9634]: info: write_cib_contents: Wrote version 0.24.1 of the CIB to disk (digest: aac7b4a8ca9337bb67e9b11726b05048)
Feb 20 09:29:30 postit cib: [9634]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:29:30 postit cib: [9634]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
Feb 20 09:29:30 postit crmd: [9629]: notice: populate_cib_nodes: Node: postit.mtu.edu (uuid: aaed2ff6-07cd-476f-8d98-259570a5480e)
Feb 20 09:29:30 postit crmd: [9629]: notice: populate_cib_nodes: Node: linux.mtu.edu (uuid: 488d1100-f844-4e7b-a726-44cf37cb3d0b)
Feb 20 09:29:30 postit crmd: [9629]: info: do_ha_control: Connected to Heartbeat
Feb 20 09:29:30 postit crmd: [9629]: info: do_ccm_control: CCM connection established... waiting for first callback
Feb 20 09:29:30 postit crmd: [9629]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 20 09:29:30 postit crmd: [9629]: info: crmd_init: Starting crmd's mainloop
Feb 20 09:29:30 postit crmd: [9629]: notice: crmd_client_status_callback: Status update: Client postit.mtu.edu/crmd now has status [online]
Feb 20 09:29:31 postit crmd: [9629]: notice: crmd_client_status_callback: Status update: Client postit.mtu.edu/crmd now has status [online]
Feb 20 09:29:31 postit mgmtd: [9630]: info: Started.
Feb 20 09:29:31 postit crmd: [9629]: notice: crmd_client_status_callback: Status update: Client linux.mtu.edu/crmd now has status [online]
Feb 20 09:29:31 postit crmd: [9629]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 20 09:29:31 postit crmd: [9629]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:29:31 postit crmd: [9629]: info: mem_handle_event: instance=9, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:29:31 postit crmd: [9629]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=9)
Feb 20 09:29:31 postit crmd: [9629]: info: ccm_event_detail: NEW MEMBERSHIP: trans=9, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Feb 20 09:29:31 postit crmd: [9629]: info: ccm_event_detail: 	CURRENT: linux.mtu.edu [nodeid=0, born=7]
Feb 20 09:29:31 postit crmd: [9629]: info: ccm_event_detail: 	CURRENT: postit.mtu.edu [nodeid=1, born=9]
Feb 20 09:29:31 postit crmd: [9629]: info: ccm_event_detail: 	NEW:     linux.mtu.edu [nodeid=0, born=7]
Feb 20 09:29:31 postit crmd: [9629]: info: ccm_event_detail: 	NEW:     postit.mtu.edu [nodeid=1, born=9]
Feb 20 09:29:31 postit crmd: [9629]: info: do_started: The local CRM is operational
Feb 20 09:29:31 postit crmd: [9629]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
Feb 20 09:29:33 postit crmd: [9629]: info: update_dc: Set DC to linux.mtu.edu (2.0)
Feb 20 09:29:34 postit crmd: [9629]: info: update_dc: Set DC to linux.mtu.edu (2.0)
Feb 20 09:29:34 postit crmd: [9629]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Feb 20 09:29:34 postit cib: [9625]: info: cib_replace_notify: Replaced: 0.24.1 -> 0.24.9 from <null>
Feb 20 09:29:34 postit crmd: [9629]: info: populate_cib_nodes: Requesting the list of configured nodes
Feb 20 09:29:34 postit attrd: [9628]: info: main: Starting mainloop...
Feb 20 09:29:34 postit crmd: [9629]: notice: populate_cib_nodes: Node: postit.mtu.edu (uuid: aaed2ff6-07cd-476f-8d98-259570a5480e)
Feb 20 09:29:34 postit crmd: [9629]: notice: populate_cib_nodes: Node: linux.mtu.edu (uuid: 488d1100-f844-4e7b-a726-44cf37cb3d0b)
Feb 20 09:29:35 postit lrmd: [9626]: info: rsc:IP: monitor
Feb 20 09:29:35 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=IP_monitor_0 key=3:2:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:35 postit lrmd: [9626]: info: rsc:Apache: monitor
Feb 20 09:29:35 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=Apache_monitor_0 key=4:2:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:35 postit crmd: [9629]: info: process_lrm_event: LRM operation Apache_monitor_0 (call=3, rc=7) complete 
Feb 20 09:29:35 postit crmd: [9629]: info: process_lrm_event: LRM operation IP_monitor_0 (call=2, rc=7) complete 
Feb 20 09:29:36 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=IP_start_0 key=8:2:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:36 postit lrmd: [9626]: info: rsc:IP: start
Feb 20 09:29:36 postit IPaddr2[9671]: [9700]: INFO: ip -f inet addr add 192.168.1.30/24 brd 192.168.1.255 dev eth0
Feb 20 09:29:36 postit IPaddr2[9671]: [9702]: INFO: ip link set eth0 up
Feb 20 09:29:36 postit IPaddr2[9671]: [9704]: INFO: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-192.168.1.30 eth0 192.168.1.30 auto not_used not_used
Feb 20 09:29:36 postit crmd: [9629]: info: process_lrm_event: LRM operation IP_start_0 (call=4, rc=0) complete 
Feb 20 09:29:37 postit lrmd: [9626]: info: rsc:IP: start
Feb 20 09:29:37 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=IP_start_0 key=6:3:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:38 postit haclient: on_event: from message queue: evt:cib_changed
Feb 20 09:29:38 postit last message repeated 10 times
Feb 20 09:29:38 postit crmd: [9629]: info: process_lrm_event: LRM operation IP_start_0 (call=5, rc=0) complete 
Feb 20 09:29:39 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=Apache_start_0 key=7:3:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:39 postit lrmd: [9626]: info: rsc:Apache: start
Feb 20 09:29:39 postit haclient: on_event:evt:cib_changed
Feb 20 09:29:39 postit apache[9744]: [9751]: ERROR: No valid httpd found! Please revise your <HTTPDLIST> item
Feb 20 09:29:39 postit crmd: [9629]: ERROR: process_lrm_event: LRM operation Apache_start_0 (call=6, rc=6) Error not configured
Feb 20 09:29:40 postit lrmd: [9626]: info: rsc:Apache: stop
Feb 20 09:29:40 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=Apache_stop_0 key=1:5:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:29:40 postit haclient: on_event:evt:cib_changed
Feb 20 09:29:40 postit haclient: on_event:evt:cib_changed
Feb 20 09:29:40 postit crmd: [9629]: info: process_lrm_event: LRM operation Apache_stop_0 (call=7, rc=0) complete 
Feb 20 09:29:41 postit haclient: on_event:evt:cib_changed
Feb 20 09:37:51 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/mgmtd -v process group 9630 with signal 15
Feb 20 09:37:51 postit haclient: on_event:evt:disconnected
Feb 20 09:37:51 postit mgmtd: [9630]: info: mgmtd is shutting down
Feb 20 09:37:51 postit mgmtd: [9630]: ERROR: Connection to the CIB terminated... exiting
Feb 20 09:37:51 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/crmd process group 9629 with signal 15
Feb 20 09:37:51 postit crmd: [9629]: info: crm_shutdown: Requesting shutdown
Feb 20 09:37:51 postit crmd: [9629]: info: do_shutdown_req: Sending shutdown request to DC: linux.mtu.edu
Feb 20 09:37:52 postit crmd: [9629]: info: do_lrm_rsc_op: Performing op=IP_stop_0 key=5:6:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:37:52 postit lrmd: [9626]: info: rsc:IP: stop
Feb 20 09:37:52 postit IPaddr2[9795]: [9824]: INFO: ip -f inet addr delete 192.168.1.30/24 dev eth0
Feb 20 09:37:52 postit IPaddr2[9795]: [9826]: INFO: ip -o -f inet addr show eth0
Feb 20 09:37:52 postit crmd: [9629]: info: process_lrm_event: LRM operation IP_stop_0 (call=8, rc=0) complete 
Feb 20 09:37:53 postit crmd: [9629]: info: do_state_transition: State transition S_NOT_DC -> S_STOPPING [ input=I_STOP cause=C_HA_MESSAGE origin=route_message ]
Feb 20 09:37:53 postit crmd: [9629]: info: do_shutdown: All subsystems stopped, continuing
Feb 20 09:37:53 postit crmd: [9629]: info: do_lrm_control: Disconnected from the LRM
Feb 20 09:37:53 postit crmd: [9629]: info: do_ha_control: Disconnected from Heartbeat
Feb 20 09:37:53 postit crmd: [9629]: info: do_cib_control: Disconnecting CIB
Feb 20 09:37:53 postit ccm: [9624]: info: client (pid=9629) removed from ccm
Feb 20 09:37:53 postit crmd: [9629]: info: crmd_cib_connection_destroy: Connection to the CIB terminated...
Feb 20 09:37:53 postit crmd: [9629]: info: do_exit: Performing A_EXIT_0 - gracefully exiting the CRMd
Feb 20 09:37:53 postit crmd: [9629]: info: free_mem: Dropping I_TERMINATE: [ state=S_STOPPING cause=C_FSA_INTERNAL origin=do_stop ]
Feb 20 09:37:53 postit crmd: [9629]: info: do_exit: [crmd] stopped (0)
Feb 20 09:37:53 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/attrd process group 9628 with signal 15
Feb 20 09:37:53 postit cib: [9625]: WARN: send_via_callback_channel: Client 281299e8-d7fb-4863-b4f6-fceeb79376f5 has disconnected
Feb 20 09:37:53 postit cib: [9625]: WARN: do_local_notify: A-Sync reply to 9629 failed: client left before we could send reply
Feb 20 09:37:53 postit cib: [9625]: WARN: send_via_callback_channel: Cannot find client for token 281299e8-d7fb-4863-b4f6-fceeb79376f5
Feb 20 09:37:53 postit cib: [9625]: WARN: do_local_notify: A-Sync reply to 9629 failed: client left before we could send reply
Feb 20 09:37:53 postit attrd: [9628]: info: attrd_shutdown: Exiting
Feb 20 09:37:53 postit attrd: [9628]: info: main: Exiting...
Feb 20 09:37:53 postit attrd: [9628]: info: attrd_cib_connection_destroy: Connection to the CIB terminated...
Feb 20 09:37:53 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/stonithd process group 9627 with signal 15
Feb 20 09:37:53 postit stonithd: [9627]: notice: /usr/lib/heartbeat/stonithd normally quit.
Feb 20 09:37:53 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/lrmd -r process group 9626 with signal 15
Feb 20 09:37:53 postit lrmd: [9626]: info: lrmd is shutting down
Feb 20 09:37:53 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/cib process group 9625 with signal 15
Feb 20 09:37:53 postit cib: [9625]: info: cib_shutdown: Disconnected 0 clients
Feb 20 09:37:53 postit cib: [9625]: info: cib_process_disconnect: All clients disconnected...
Feb 20 09:37:53 postit cib: [9625]: info: initiate_exit: Sending disconnect notification to 2 peers...
Feb 20 09:37:54 postit cib: [9625]: info: cib_process_shutdown_req: Shutdown ACK from linux.mtu.edu
Feb 20 09:37:54 postit heartbeat: [9617]: info: killing /usr/lib/heartbeat/ccm process group 9624 with signal 15
Feb 20 09:37:54 postit cib: [9625]: info: terminate_ha_connection: cib_process_shutdown_req: Disconnecting heartbeat
Feb 20 09:37:54 postit ccm: [9624]: info: client (pid=9625) removed from ccm
Feb 20 09:37:54 postit cib: [9625]: info: cib_ha_connection_destroy: Heartbeat disconnection complete... exiting
Feb 20 09:37:54 postit ccm: [9624]: info: received SIGTERM, going to shut down
Feb 20 09:37:54 postit cib: [9625]: info: main: Done
Feb 20 09:37:55 postit heartbeat: [9617]: info: killing HBFIFO process 9619 with signal 15
Feb 20 09:37:55 postit heartbeat: [9617]: info: killing HBWRITE process 9620 with signal 15
Feb 20 09:37:55 postit heartbeat: [9617]: info: killing HBREAD process 9621 with signal 15
Feb 20 09:37:55 postit heartbeat: [9617]: info: Core process 9619 exited. 3 remaining
Feb 20 09:37:55 postit heartbeat: [9617]: info: Core process 9620 exited. 2 remaining
Feb 20 09:37:55 postit heartbeat: [9617]: info: Core process 9621 exited. 1 remaining
Feb 20 09:37:55 postit heartbeat: [9617]: info: postit.mtu.edu Heartbeat shutdown complete.
Feb 20 09:38:15 postit heartbeat: [9849]: info: Version 2 support: on
Feb 20 09:38:15 postit heartbeat: [9849]: WARN: File /etc/ha.d/haresources exists.
Feb 20 09:38:15 postit heartbeat: [9849]: WARN: This file is not used because crm is enabled
Feb 20 09:38:15 postit heartbeat: [9849]: info: Enabling logging daemon 
Feb 20 09:38:15 postit heartbeat: [9849]: info: logfile and debug file are those specified in logd config file (default /etc/logd.cf)
Feb 20 09:38:15 postit heartbeat: [9849]: WARN: logd is enabled but logfile/debugfile/logfacility is still configured in ha.cf
Feb 20 09:38:15 postit heartbeat: [9849]: info: **************************
Feb 20 09:38:15 postit heartbeat: [9849]: info: Configuration validated. Starting heartbeat 2.1.3
Feb 20 09:38:15 postit heartbeat: [9850]: info: heartbeat: version 2.1.3
Feb 20 09:38:15 postit heartbeat: [9850]: info: Heartbeat generation: 37
Feb 20 09:38:16 postit heartbeat: [9850]: info: glib: UDP Broadcast heartbeat started on port 694 (694) interface eth1
Feb 20 09:38:16 postit heartbeat: [9850]: info: glib: UDP Broadcast heartbeat closed on port 694 interface eth1 - Status: 1
Feb 20 09:38:16 postit heartbeat: [9850]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:38:16 postit heartbeat: [9850]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:38:16 postit heartbeat: [9850]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:38:16 postit heartbeat: [9850]: info: Local status now set to: 'up'
Feb 20 09:38:17 postit heartbeat: [9850]: info: Link linux.mtu.edu:eth1 up.
Feb 20 09:38:17 postit heartbeat: [9850]: info: Status update for node linux.mtu.edu: status active
Feb 20 09:38:17 postit heartbeat: [9850]: info: Link postit.mtu.edu:eth1 up.
Feb 20 09:38:17 postit heartbeat: [9850]: info: Comm_now_up(): updating status to active
Feb 20 09:38:17 postit heartbeat: [9850]: info: Local status now set to: 'active'
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/ccm" (90,90)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/cib" (90,90)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/lrmd -r" (0,0)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/stonithd" (0,0)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/attrd" (90,90)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/crmd" (90,90)
Feb 20 09:38:17 postit heartbeat: [9850]: info: Starting child client "/usr/lib/heartbeat/mgmtd -v" (0,0)
Feb 20 09:38:17 postit heartbeat: [9857]: info: Starting "/usr/lib/heartbeat/ccm" as uid 90  gid 90 (pid 9857)
Feb 20 09:38:17 postit heartbeat: [9858]: info: Starting "/usr/lib/heartbeat/cib" as uid 90  gid 90 (pid 9858)
Feb 20 09:38:17 postit heartbeat: [9859]: info: Starting "/usr/lib/heartbeat/lrmd -r" as uid 0  gid 0 (pid 9859)
Feb 20 09:38:17 postit heartbeat: [9860]: info: Starting "/usr/lib/heartbeat/stonithd" as uid 0  gid 0 (pid 9860)
Feb 20 09:38:17 postit heartbeat: [9861]: info: Starting "/usr/lib/heartbeat/attrd" as uid 90  gid 90 (pid 9861)
Feb 20 09:38:17 postit attrd: [9861]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:17 postit ccm: [9857]: info: Hostname: postit.mtu.edu
Feb 20 09:38:17 postit attrd: [9861]: info: register_with_ha: Hostname: postit.mtu.edu
Feb 20 09:38:17 postit heartbeat: [9862]: info: Starting "/usr/lib/heartbeat/crmd" as uid 90  gid 90 (pid 9862)
Feb 20 09:38:17 postit heartbeat: [9863]: info: Starting "/usr/lib/heartbeat/mgmtd -v" as uid 0  gid 0 (pid 9863)
Feb 20 09:38:17 postit attrd: [9861]: info: register_with_ha: UUID: aaed2ff6-07cd-476f-8d98-259570a5480e
Feb 20 09:38:17 postit cib: [9858]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:17 postit cib: [9858]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:38:17 postit cib: [9858]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:38:17 postit cib: [9858]: info: main: Retrieval of a per-action CIB: disabled
Feb 20 09:38:17 postit cib: [9858]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk] <cib generated="false" admin_epoch="0" epoch="24" have_quorum="false" ignore_dtd="false" num_peers="0" cib_feature_revision="2.0" num_updates="1" cib-last-written="Wed Feb 20 09:29:29 2008">
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]   <configuration>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     <crm_config>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       <cluster_property_set id="cib-bootstrap-options">
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         <attributes>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" value="2.1.3-node: 552305612591183b1628baa5bc6e903e0f1e26a3"/>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <nvpair id="cib-bootstrap-options-last-lrm-refresh" name="last-lrm-refresh" value="1203463617"/>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         </attributes>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       </cluster_property_set>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     </crm_config>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     <nodes>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       <node id="aaed2ff6-07cd-476f-8d98-259570a5480e" uname="postit.mtu.edu" type="normal"/>
Feb 20 09:38:17 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       <node id="488d1100-f844-4e7b-a726-44cf37cb3d0b" uname="linux.mtu.edu" type="normal"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     </nodes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     <resources>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       <group id="Webserver">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         <meta_attributes id="Webserver_meta_attrs">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="Webserver_metaattr_ordered" name="ordered" value="true"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             <nvpair id="Webserver_metaattr_collocated" name="collocated" value="true"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           </attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         </meta_attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="IP" class="ocf" type="IPaddr2" provider="heartbeat">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <instance_attributes id="IP_instance_attrs">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="adacda48-02dc-4127-9371-543ea7d79a87" name="ip" value="192.168.1.30"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           </instance_attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         <primitive id="Apache" class="ocf" type="apache" provider="heartbeat">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <instance_attributes id="Apache_instance_attrs">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="92d737eb-81ad-40c7-a330-788425a64b6a" name="configfile" value="/opt/apache-2.0.61/conf/httpd.conf"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           </instance_attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           <meta_attributes id="Apache_meta_attrs">
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             <attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]               <nvpair id="Apache_metaattr_target_role" name="target_role" value="started"/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]             </attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]           </meta_attributes>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]         </primitive>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]       </group>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     </resources>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]     <constraints/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]   </configuration>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk]   <status/>
Feb 20 09:38:18 postit cib: [9858]: info: log_data_element: readCibXmlFile: [on-disk] </cib>
Feb 20 09:38:18 postit cib: [9858]: info: startCib: CIB Initialization completed successfully
Feb 20 09:38:18 postit cib: [9858]: info: cib_register_ha: Signing in with Heartbeat
Feb 20 09:38:18 postit cib: [9858]: info: cib_register_ha: FSA Hostname: postit.mtu.edu
Feb 20 09:38:18 postit cib: [9858]: info: ccm_connect: Registering with CCM...
Feb 20 09:38:18 postit cib: [9858]: WARN: ccm_connect: CCM Activation failed
Feb 20 09:38:18 postit cib: [9858]: WARN: ccm_connect: CCM Connection failed 1 times (30 max)
Feb 20 09:38:18 postit lrmd: [9859]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:18 postit stonithd: [9860]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:38:18 postit stonithd: [9860]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:38:18 postit lrmd: [9859]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:38:18 postit lrmd: [9859]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:38:18 postit lrmd: [9859]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:38:18 postit lrmd: [9859]: info: Started.
Feb 20 09:38:18 postit stonithd: [9860]: info: Signing in with heartbeat.
Feb 20 09:38:18 postit crmd: [9862]: info: main: CRM Hg Version: node: 552305612591183b1628baa5bc6e903e0f1e26a3 
Feb 20 09:38:18 postit crmd: [9862]: info: crmd_init: Starting crmd
Feb 20 09:38:18 postit crmd: [9862]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:18 postit crmd: [9862]: info: G_main_add_TriggerHandler: Added signal manual handler
Feb 20 09:38:18 postit crmd: [9862]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:38:18 postit stonithd: [9860]: notice: /usr/lib/heartbeat/stonithd start up successfully.
Feb 20 09:38:18 postit stonithd: [9860]: info: G_main_add_SignalHandler: Added signal handler for signal 17
Feb 20 09:38:18 postit mgmtd: [9863]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:18 postit mgmtd: [9863]: info: G_main_add_SignalHandler: Added signal handler for signal 10
Feb 20 09:38:18 postit mgmtd: [9863]: info: G_main_add_SignalHandler: Added signal handler for signal 12
Feb 20 09:38:18 postit mgmtd: [9863]: info: init_crm
Feb 20 09:38:19 postit ccm: [9857]: info: G_main_add_SignalHandler: Added signal handler for signal 15
Feb 20 09:38:21 postit cib: [9858]: info: ccm_connect: Registering with CCM...
Feb 20 09:38:21 postit cib: [9858]: info: cib_init: Starting cib mainloop
Feb 20 09:38:21 postit cib: [9866]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:38:21 postit cib: [9866]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:38:21 postit cib: [9866]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
Feb 20 09:38:21 postit cib: [9858]: info: cib_client_status_callback: Status update: Client postit.mtu.edu/cib now has status [join]
Feb 20 09:38:21 postit cib: [9858]: info: cib_client_status_callback: Status update: Client postit.mtu.edu/cib now has status [online]
Feb 20 09:38:21 postit crmd: [9862]: info: do_cib_control: CIB connection established
Feb 20 09:38:21 postit cib: [9858]: info: cib_null_callback: Setting cib_refresh_notify callbacks for crmd: on
Feb 20 09:38:21 postit cib: [9858]: info: cib_null_callback: Setting cib_diff_notify callbacks for mgmtd: on
Feb 20 09:38:21 postit cib: [9858]: info: cib_client_status_callback: Status update: Client linux.mtu.edu/cib now has status [online]
Feb 20 09:38:21 postit crmd: [9862]: info: register_with_ha: Hostname: postit.mtu.edu
Feb 20 09:38:21 postit cib: [9866]: info: write_cib_contents: Wrote version 0.24.1 of the CIB to disk (digest: 47853c790b2f68816d126b0606b6745a)
Feb 20 09:38:21 postit cib: [9866]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml (digest: /var/lib/heartbeat/crm/cib.xml.sig)
Feb 20 09:38:21 postit cib: [9866]: info: retrieveCib: Reading cluster configuration from: /var/lib/heartbeat/crm/cib.xml.last (digest: /var/lib/heartbeat/crm/cib.xml.sig.last)
Feb 20 09:38:22 postit crmd: [9862]: info: register_with_ha: UUID: aaed2ff6-07cd-476f-8d98-259570a5480e
Feb 20 09:38:22 postit crmd: [9862]: info: populate_cib_nodes: Requesting the list of configured nodes
Feb 20 09:38:22 postit cib: [9858]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:38:22 postit cib: [9858]: info: mem_handle_event: instance=11, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:38:22 postit cib: [9858]: info: cib_ccm_msg_callback: PEER: linux.mtu.edu
Feb 20 09:38:22 postit cib: [9858]: info: cib_ccm_msg_callback: PEER: postit.mtu.edu
Feb 20 09:38:23 postit crmd: [9862]: notice: populate_cib_nodes: Node: postit.mtu.edu (uuid: aaed2ff6-07cd-476f-8d98-259570a5480e)
Feb 20 09:38:23 postit crmd: [9862]: notice: populate_cib_nodes: Node: linux.mtu.edu (uuid: 488d1100-f844-4e7b-a726-44cf37cb3d0b)
Feb 20 09:38:23 postit crmd: [9862]: info: do_ha_control: Connected to Heartbeat
Feb 20 09:38:23 postit crmd: [9862]: info: do_ccm_control: CCM connection established... waiting for first callback
Feb 20 09:38:23 postit crmd: [9862]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 20 09:38:23 postit crmd: [9862]: info: crmd_init: Starting crmd's mainloop
Feb 20 09:38:23 postit crmd: [9862]: notice: crmd_client_status_callback: Status update: Client postit.mtu.edu/crmd now has status [online]
Feb 20 09:38:24 postit crmd: [9862]: notice: crmd_client_status_callback: Status update: Client postit.mtu.edu/crmd now has status [online]
Feb 20 09:38:24 postit crmd: [9862]: notice: crmd_client_status_callback: Status update: Client linux.mtu.edu/crmd now has status [online]
Feb 20 09:38:24 postit crmd: [9862]: info: do_started: Delaying start, CCM (0000000000100000) not connected
Feb 20 09:38:24 postit crmd: [9862]: info: mem_handle_event: Got an event OC_EV_MS_NEW_MEMBERSHIP from ccm
Feb 20 09:38:24 postit crmd: [9862]: info: mem_handle_event: instance=11, nodes=2, new=2, lost=0, n_idx=0, new_idx=0, old_idx=4
Feb 20 09:38:24 postit crmd: [9862]: info: crmd_ccm_msg_callback: Quorum (re)attained after event=NEW MEMBERSHIP (id=11)
Feb 20 09:38:24 postit crmd: [9862]: info: ccm_event_detail: NEW MEMBERSHIP: trans=11, nodes=2, new=2, lost=0 n_idx=0, new_idx=0, old_idx=4
Feb 20 09:38:24 postit crmd: [9862]: info: ccm_event_detail: 	CURRENT: linux.mtu.edu [nodeid=0, born=7]
Feb 20 09:38:24 postit crmd: [9862]: info: ccm_event_detail: 	CURRENT: postit.mtu.edu [nodeid=1, born=11]
Feb 20 09:38:24 postit crmd: [9862]: info: ccm_event_detail: 	NEW:     linux.mtu.edu [nodeid=0, born=7]
Feb 20 09:38:24 postit crmd: [9862]: info: ccm_event_detail: 	NEW:     postit.mtu.edu [nodeid=1, born=11]
Feb 20 09:38:24 postit crmd: [9862]: info: do_started: The local CRM is operational
Feb 20 09:38:24 postit crmd: [9862]: info: do_state_transition: State transition S_STARTING -> S_PENDING [ input=I_PENDING cause=C_CCM_CALLBACK origin=do_started ]
Feb 20 09:38:24 postit mgmtd: [9863]: info: Started.
Feb 20 09:38:26 postit crmd: [9862]: info: update_dc: Set DC to linux.mtu.edu (2.0)
Feb 20 09:38:27 postit crmd: [9862]: info: update_dc: Set DC to linux.mtu.edu (2.0)
Feb 20 09:38:27 postit cib: [9858]: info: cib_replace_notify: Replaced: 0.24.1 -> 0.24.26 from <null>
Feb 20 09:38:27 postit crmd: [9862]: info: do_state_transition: State transition S_PENDING -> S_NOT_DC [ input=I_NOT_DC cause=C_HA_MESSAGE origin=do_cl_join_finalize_respond ]
Feb 20 09:38:27 postit crmd: [9862]: info: populate_cib_nodes: Requesting the list of configured nodes
Feb 20 09:38:27 postit attrd: [9861]: info: main: Starting mainloop...
Feb 20 09:38:28 postit crmd: [9862]: notice: populate_cib_nodes: Node: postit.mtu.edu (uuid: aaed2ff6-07cd-476f-8d98-259570a5480e)
Feb 20 09:38:28 postit crmd: [9862]: notice: populate_cib_nodes: Node: linux.mtu.edu (uuid: 488d1100-f844-4e7b-a726-44cf37cb3d0b)
Feb 20 09:38:29 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=IP_monitor_0 key=3:7:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:29 postit lrmd: [9859]: info: rsc:IP: monitor
Feb 20 09:38:29 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=Apache_monitor_0 key=4:7:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:29 postit lrmd: [9859]: info: rsc:Apache: monitor
Feb 20 09:38:29 postit crmd: [9862]: info: process_lrm_event: LRM operation Apache_monitor_0 (call=3, rc=7) complete 
Feb 20 09:38:29 postit crmd: [9862]: info: process_lrm_event: LRM operation IP_monitor_0 (call=2, rc=7) complete 
Feb 20 09:38:30 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=IP_start_0 key=8:7:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:30 postit lrmd: [9859]: info: rsc:IP: start
Feb 20 09:38:30 postit IPaddr2[9902]: [9931]: INFO: ip -f inet addr add 192.168.1.30/24 brd 192.168.1.255 dev eth0
Feb 20 09:38:30 postit IPaddr2[9902]: [9933]: INFO: ip link set eth0 up
Feb 20 09:38:30 postit IPaddr2[9902]: [9935]: INFO: /usr/lib/heartbeat/send_arp -i 200 -r 5 -p /var/run/heartbeat/rsctmp/send_arp/send_arp-192.168.1.30 eth0 192.168.1.30 auto not_used not_used
Feb 20 09:38:30 postit crmd: [9862]: info: process_lrm_event: LRM operation IP_start_0 (call=4, rc=0) complete 
Feb 20 09:38:31 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=IP_start_0 key=6:8:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:31 postit lrmd: [9859]: info: rsc:IP: start
Feb 20 09:38:31 postit crmd: [9862]: info: process_lrm_event: LRM operation IP_start_0 (call=5, rc=0) complete 
Feb 20 09:38:32 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=Apache_start_0 key=7:8:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:32 postit lrmd: [9859]: info: rsc:Apache: start
Feb 20 09:38:32 postit apache[9976]: [9983]: ERROR: No valid httpd found! Please revise your <HTTPDLIST> item
Feb 20 09:38:32 postit crmd: [9862]: ERROR: process_lrm_event: LRM operation Apache_start_0 (call=6, rc=6) Error not configured
Feb 20 09:38:33 postit haclient: on_event: from message queue: evt:cib_changed
Feb 20 09:38:33 postit last message repeated 11 times
Feb 20 09:38:33 postit crmd: [9862]: info: do_lrm_rsc_op: Performing op=Apache_stop_0 key=1:9:4746c560-21ca-4bf3-93a4-2a2f7919abc9)
Feb 20 09:38:33 postit lrmd: [9859]: info: rsc:Apache: stop
Feb 20 09:38:33 postit haclient: on_event:evt:cib_changed
Feb 20 09:38:33 postit crmd: [9862]: info: process_lrm_event: LRM operation Apache_stop_0 (call=7, rc=0) complete 
Feb 20 09:38:34 postit haclient: on_event: from message queue: evt:cib_changed
Feb 20 09:38:35 postit haclient: on_event:evt:cib_changed
Feb 20 09:44:17 postit root: Mark:HB_REPORT:1203518646
