> On 30 Oct 2014, at 5:57 am, Keith Ouellette <kei...@fibermountain.com> wrote: > > I am running two servers (Ubuntu 14.04 LTS) as an HA setup for an application > that uses mysql. I am using DRBD to replicate the data between the servers > and am able to manually start mysql on each server. The DRBD replication is > also working fine and Pacemaker (version 1.1.10) seems to handle that > properly. I then created a resource for mysql to start it on the active node. > > All this I am doing with LCMC (although, I hope that should not matter). When > I start the mysql resource, it shows that it is started: > > fmadmin@AOS1:/$ sudo crm status > Last updated: Wed Oct 29 14:43:31 2014 > Last change: Wed Oct 29 13:56:10 2014 via crm_resource on AOS1 > Stack: corosync > Current DC: AOS1 (172655985) - partition with quorum > Version: 1.1.10-42f2063 > 2 Nodes configured > 5 Resources configured > > > Online: [ AOS1 AOS2 ] > > Master/Slave Set: ms_drbd_1 [res_drbd_1] > Masters: [ AOS1 ] > Slaves: [ AOS2 ] > res_Filesystem_1 (ocf::heartbeat:Filesystem): Started AOS1 > res_IPaddr2_1 (ocf::heartbeat:IPaddr2): Started AOS1 > res_mysql_1 (service:mysql): Started AOS1 > > However, the service did not start: > > fmadmin@AOS1:/$ sudo service mysql status > mysql stop/waiting > > > I see the following error in syslog: > > Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: Entity: > line 1: parser error : Start tag expected, '<' not found > Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: Usage: > /etc/init.d/mysql start|stop|restart|reload|force-reload|status > Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_xml_err: XML Error: ^ > Oct 29 13:56:12 AOS1 crmd[40578]: warning: string2xml: Parsing failed > (domain=1, level=3, code=4): Start tag expected, '<' not found > Oct 29 13:56:12 AOS1 crmd[40578]: error: crm_abort: string2xml: Forked > child 21538 to record non-fatal assert at xml.c:589 : Cannot parse an empty > string > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: /usr/bin/mysql_upgrade: > the '--basedir' option is always ignored > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: Looking for 'mysql' as: > /usr/bin/mysql > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: Looking for 'mysqlcheck' > as: /usr/bin/mysqlcheck > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21533]: This installation of > MySQL is already upgraded to 5.5.40, use --force if you still need to run > mysql_upgrade > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21550]: Checking for insecure > root accounts. > Oct 29 13:56:12 AOS1 /etc/mysql/debian-start[21555]: Triggering > myisam-recover for all MyISAM tables > Oct 29 13:56:12 AOS1 crmd[40578]: error: get_rsc_restart_list: Metadata > for (null)::service:mysql is not valid XML > Oct 29 13:56:12 AOS1 crmd[40578]: notice: process_lrm_event: LRM operation > res_mysql_1_start_0 (call=334, rc=0, cib-update=84, confirmed=true) ok > Oct 29 13:56:12 AOS1 crmd[40578]: notice: te_rsc_command: Initiating action > 43: monitor res_mysql_1_monitor_15000 on AOS1 (local) > > > It looks like the resource agent is giving a bad command?
Thats the metadata command failing, but the agent start gets started: "LRM operation res_mysql_1_start_0 ... ok" > Or at least that is what it appears to be. Any ideas? You might be better off using the OCF agent instead. Its a bit smarter. > > Here is a dump of the configuration: > > fmadmin@AOS1:/$ sudo cibadmin --query > <cib epoch="210" num_updates="3" admin_epoch="0" > validate-with="pacemaker-1.2" crm_feature_set="3.0.7" cib-last-written="Wed > Oct 29 13:56:10 2014" update-origin="AOS1" update-client="crm_resource" > have-quorum="1" dc-uuid="172655985"> > <configuration> > <crm_config> > <cluster_property_set id="cib-bootstrap-options"> > <nvpair id="cib-bootstrap-options-stonith-enabled" > name="stonith-enabled" value="false"/> > <nvpair id="cib-bootstrap-options-dc-version" name="dc-version" > value="1.1.10-42f2063"/> > <nvpair id="cib-bootstrap-options-no-quorum-policy" > name="no-quorum-policy" value="ignore"/> > <nvpair id="cib-bootstrap-options-cluster-infrastructure" > name="cluster-infrastructure" value="corosync"/> > <nvpair id="cib-bootstrap-options-last-lrm-refresh" > name="last-lrm-refresh" value="1414603959"/> > </cluster_property_set> > </crm_config> > <nodes> > <node id="172655986" uname="AOS2"/> > <node id="172655985" uname="AOS1"/> > </nodes> > <resources> > <master id="ms_drbd_1"> > <meta_attributes id="ms_drbd_1-meta_attributes"> > <nvpair id="ms_drbd_1-meta_attributes-clone-max" name="clone-max" > value="2"/> > <nvpair id="ms_drbd_1-meta_attributes-notify" name="notify" > value="true"/> > <nvpair id="ms_drbd_1-meta_attributes-interleave" name="interleave" > value="true"/> > </meta_attributes> > <primitive id="res_drbd_1" class="ocf" provider="linbit" type="drbd"> > <instance_attributes id="res_drbd_1-instance_attributes"> > <nvpair id="nvpair-res_drbd_1-drbd_resource" name="drbd_resource" > value="r0"/> > </instance_attributes> > <operations id="res_drbd_1-operations"> > <op interval="0" id="op-res_drbd_1-start" name="start" > timeout="240"/> > <op interval="0" id="op-res_drbd_1-promote" name="promote" > timeout="90"/> > <op interval="0" id="op-res_drbd_1-demote" name="demote" > timeout="90"/> > <op interval="0" id="op-res_drbd_1-stop" name="stop" > timeout="100"/> > <op id="op-res_drbd_1-monitor" name="monitor" interval="10" > timeout="20" start-delay="0"/> > <op interval="0" id="op-res_drbd_1-notify" name="notify" > timeout="90"/> > </operations> > <meta_attributes id="res_drbd_1-meta_attributes"/> > </primitive> > </master> > <primitive id="res_Filesystem_1" class="ocf" provider="heartbeat" > type="Filesystem"> > <instance_attributes id="res_Filesystem_1-instance_attributes"> > <nvpair id="nvpair-res_Filesystem_1-device" name="device" > value="/dev/drbd/by-res/r0/0"/> > <nvpair id="nvpair-res_Filesystem_1-directory" name="directory" > value="/var/lib/mysql/data"/> > <nvpair id="nvpair-res_Filesystem_1-fstype" name="fstype" > value="ext4"/> > </instance_attributes> > <operations id="res_Filesystem_1-operations"> > <op interval="0" id="op-res_Filesystem_1-start" name="start" > timeout="60"/> > <op interval="0" id="op-res_Filesystem_1-stop" name="stop" > timeout="60"/> > <op id="op-res_Filesystem_1-monitor" name="monitor" interval="20" > timeout="40" start-delay="0"/> > <op interval="0" id="op-res_Filesystem_1-notify" name="notify" > timeout="60"/> > </operations> > <meta_attributes id="res_Filesystem_1-meta_attributes"/> > </primitive> > <primitive id="res_IPaddr2_1" class="ocf" provider="heartbeat" > type="IPaddr2"> > <instance_attributes id="res_IPaddr2_1-instance_attributes"> > <nvpair id="nvpair-res_IPaddr2_1-ip" name="ip" > value="10.74.133.120"/> > <nvpair id="nvpair-res_IPaddr2_1-cidr_netmask" name="cidr_netmask" > value="24"/> > </instance_attributes> > <operations id="res_IPaddr2_1-operations"> > <op interval="0" id="op-res_IPaddr2_1-start" name="start" > timeout="20"/> > <op interval="0" id="op-res_IPaddr2_1-stop" name="stop" > timeout="20"/> > <op id="op-res_IPaddr2_1-monitor" name="monitor" interval="10" > timeout="20" start-delay="0"/> > </operations> > <meta_attributes id="res_IPaddr2_1-meta_attributes"/> > </primitive> > <primitive id="res_mysql_1" class="service" type="mysql"> > <operations id="res_mysql_1-operations"> > <op interval="0" id="op-res_mysql_1-start" name="start" > timeout="15"/> > <op interval="0" id="op-res_mysql_1-stop" name="stop" timeout="15"/> > <op id="op-res_mysql_1-monitor" name="monitor" interval="15" > timeout="15" start-delay="15"/> > </operations> > <meta_attributes id="res_mysql_1-meta_attributes"> > <nvpair id="res_mysql_1-meta_attributes-target-role" > name="target-role" value="started"/> > </meta_attributes> > </primitive> > </resources> > <constraints> > <rsc_colocation id="col_res_Filesystem_1_ms_drbd_1" score="INFINITY" > with-rsc-role="Master" rsc="res_Filesystem_1" with-rsc="ms_drbd_1"/> > <rsc_order id="ord_ms_drbd_1_res_Filesystem_1" score="INFINITY" > first-action="promote" then-action="start" first="ms_drbd_1" > then="res_Filesystem_1"/> > <rsc_colocation id="col_res_IPaddr2_1_res_Filesystem_1" > score="INFINITY" rsc="res_IPaddr2_1" with-rsc="res_Filesystem_1"/> > <rsc_order id="ord_res_Filesystem_1_res_IPaddr2_1" score="INFINITY" > first="res_Filesystem_1" then="res_IPaddr2_1"/> > <rsc_colocation id="col_res_mysql_1_res_IPaddr2_1" score="INFINITY" > rsc="res_mysql_1" with-rsc="res_IPaddr2_1"/> > <rsc_order id="ord_res_IPaddr2_1_res_mysql_1" score="INFINITY" > first="res_IPaddr2_1" then="res_mysql_1"/> > </constraints> > <rsc_defaults> > <meta_attributes id="rsc-options"/> > </rsc_defaults> > </configuration> > <status> > <node_state id="172655985" uname="AOS1" in_ccm="true" crmd="online" > crm-debug-origin="do_update_resource" join="member" expected="member"> > <lrm id="172655985"> > <lrm_resources> > <lrm_resource id="res_IPaddr2_1" type="IPaddr2" class="ocf" > provider="heartbeat"> > <lrm_rsc_op id="res_IPaddr2_1_last_failure_0" > operation_key="res_IPaddr2_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="6:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;6:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="239" rc-code="0" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="329" queue-time="1" > op-digest="7f04d9658437ab9175a91b9f55323554"/> > <lrm_rsc_op id="res_IPaddr2_1_monitor_10000" > operation_key="res_IPaddr2_1_monitor_10000" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="41:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;41:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="249" rc-code="0" op-status="0" interval="10000" > last-rc-change="1414602514" exec-time="137" queue-time="0" > op-digest="d7b2c923b15841dad31e4a017ffc8994"/> > </lrm_resource> > <lrm_resource id="res_Filesystem_1" type="Filesystem" class="ocf" > provider="heartbeat"> > <lrm_rsc_op id="res_Filesystem_1_last_failure_0" > operation_key="res_Filesystem_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="5:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;5:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="237" rc-code="0" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="430" queue-time="0" > op-digest="4abfd90c648656839a548d5fd571549e"/> > <lrm_rsc_op id="res_Filesystem_1_monitor_20000" > operation_key="res_Filesystem_1_monitor_20000" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="38:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;38:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="247" rc-code="0" op-status="0" interval="20000" > last-rc-change="1414602514" exec-time="159" queue-time="0" > op-digest="f4c52ea5791702decf57d3bc7d72019a"/> > </lrm_resource> > <lrm_resource id="res_drbd_1" type="drbd" class="ocf" > provider="linbit"> > <lrm_rsc_op id="res_drbd_1_last_failure_0" > operation_key="res_drbd_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="4:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:8;4:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="235" rc-code="8" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="553" queue-time="0" > op-digest="c0e018b73fdf522b6cdd355e125af15e"/> > </lrm_resource> > <lrm_resource id="res_mysql_1" type="mysql" class="service"> > <lrm_rsc_op id="res_mysql_1_last_0" > operation_key="res_mysql_1_start_0" operation="start" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="42:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;42:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="334" rc-code="0" op-status="0" interval="0" last-run="1414605370" > last-rc-change="1414605370" exec-time="2193" queue-time="0" > op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/> > <lrm_rsc_op id="res_mysql_1_monitor_15000" > operation_key="res_mysql_1_monitor_15000" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="43:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;43:77:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="337" rc-code="0" op-status="0" interval="15000" > last-rc-change="1414605387" exec-time="29" queue-time="15001" > op-digest="02a5bcf940fc8d3239701acb11438d6a"/> > </lrm_resource> > </lrm_resources> > </lrm> > <transient_attributes id="172655985"> > <instance_attributes id="status-172655985"> > <nvpair id="status-172655985-master-res_drbd_1" > name="master-res_drbd_1" value="10000"/> > <nvpair id="status-172655985-probe_complete" name="probe_complete" > value="true"/> > <nvpair id="status-172655985-last-failure-res_mysql_1" > name="last-failure-res_mysql_1" value="1414603330"/> > </instance_attributes> > </transient_attributes> > </node_state> > <node_state id="172655986" uname="AOS2" in_ccm="true" crmd="online" > crm-debug-origin="do_update_resource" join="member" expected="member"> > <lrm id="172655986"> > <lrm_resources> > <lrm_resource id="res_IPaddr2_1" type="IPaddr2" class="ocf" > provider="heartbeat"> > <lrm_rsc_op id="res_IPaddr2_1_last_0" > operation_key="res_IPaddr2_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="11:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:7;11:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="184" rc-code="7" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="119" queue-time="1" > op-digest="7f04d9658437ab9175a91b9f55323554"/> > </lrm_resource> > <lrm_resource id="res_Filesystem_1" type="Filesystem" class="ocf" > provider="heartbeat"> > <lrm_rsc_op id="res_Filesystem_1_last_0" > operation_key="res_Filesystem_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="10:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:7;10:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="182" rc-code="7" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="161" queue-time="0" > op-digest="4abfd90c648656839a548d5fd571549e"/> > </lrm_resource> > <lrm_resource id="res_drbd_1" type="drbd" class="ocf" > provider="linbit"> > <lrm_rsc_op id="res_drbd_1_last_failure_0" > operation_key="res_drbd_1_monitor_0" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="9:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;9:57:7:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="180" rc-code="0" op-status="0" interval="0" last-run="1414602513" > last-rc-change="1414602513" exec-time="221" queue-time="0" > op-digest="c0e018b73fdf522b6cdd355e125af15e"/> > <lrm_rsc_op id="res_drbd_1_monitor_10000" > operation_key="res_drbd_1_monitor_10000" operation="monitor" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="11:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;11:58:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="192" rc-code="0" op-status="0" interval="10000" > last-rc-change="1414602514" exec-time="72" queue-time="0" > op-digest="db2fb3216fa7207fdc0b2bf31bbd09c1"/> > </lrm_resource> > <lrm_resource id="res_mysql_1" type="mysql" class="service"> > <lrm_rsc_op id="res_mysql_1_last_0" > operation_key="res_mysql_1_stop_0" operation="stop" > crm-debug-origin="do_update_resource" crm_feature_set="3.0.7" > transition-key="42:72:0:92c79007-7c90-4700-8214-0f89457a3dd7" > transition-magic="0:0;42:72:0:92c79007-7c90-4700-8214-0f89457a3dd7" > call-id="212" rc-code="0" op-status="0" interval="0" last-run="1414604049" > last-rc-change="1414604049" exec-time="2078" queue-time="0" > op-digest="f2317cad3d54cec5d7d7aa7d0bf35cf8"/> > </lrm_resource> > </lrm_resources> > </lrm> > <transient_attributes id="172655986"> > <instance_attributes id="status-172655986"> > <nvpair id="status-172655986-master-res_drbd_1" > name="master-res_drbd_1" value="10000"/> > <nvpair id="status-172655986-probe_complete" name="probe_complete" > value="true"/> > </instance_attributes> > </transient_attributes> > </node_state> > </status> > </cib> > <fm-logo69d803.jpeg> > Keith Ouellette > > kei...@fibermountain.com > > 700 West Johnson Avenue > Cheshire, CT06410 > www.fibermountain.com <redlineef0ed4.jpeg> P. (203) 806-4046 > C. (860) 810-4877 > F. (845) 358-7882 > Disclaimer: The information contained in this communication is confidential, > may be privileged and is intended for the exclusive use of the above named > addressee(s). If you are not the intended recipient(s), you are expressly > prohibited from copying, distributing, disseminating, or in any other way > using any information contained within this communication. If you have > received this communication in error, please contact the sender by telephone > or by response via mail. We have taken precautions to minimize the risk of > transmitting software viruses, but we advise you to carry out your own virus > checks on this message, as well as any attachments. We cannot accept > liability for any loss or damage caused by software viruses. > > _______________________________________________ > Pacemaker mailing list: Pacemaker@oss.clusterlabs.org > http://oss.clusterlabs.org/mailman/listinfo/pacemaker > > Project Home: http://www.clusterlabs.org > Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf > Bugs: http://bugs.clusterlabs.org _______________________________________________ Pacemaker mailing list: Pacemaker@oss.clusterlabs.org http://oss.clusterlabs.org/mailman/listinfo/pacemaker Project Home: http://www.clusterlabs.org Getting started: http://www.clusterlabs.org/doc/Cluster_from_Scratch.pdf Bugs: http://bugs.clusterlabs.org