Dejan,
Just a thought after reading other posts. Could the pacemaker packages be
needed as their functionality has been seperated out?
Thanks,
Amy
-----Original Message-----
From: [EMAIL PROTECTED]
Sent: Wednesday, February 13, 2008 11:11am
To: Dejan Muhamedagic <[EMAIL PROTECTED]>
Subject: Re: [Linux-HA] mysql OCF issue on CentOS 5.1 after upgrading to
heartbeat 2.1.3-3
Dejan,
Thanks for your response.
passwd and group both in the stard location /etc
nssswitch.conf
passwd: files
shadow: files
group: files
Here is the output from the command line before I end it after getting stuck at
the same place:
# OCF_RESKEY_datadir="/replicated/mysql/data" sh -x
/usr/lib/ocf/resource.d/heartbeat/mysql start
+ . /usr/lib/ocf/resource.d/heartbeat/.ocf-shellfuncs
++ unset LC_ALL
++ export LC_ALL
++ unset LANGUAGE
++ export LANGUAGE
+++ basename /usr/lib/ocf/resource.d/heartbeat/mysql
++ __SCRIPT_NAME=mysql
++ . /etc/ha.d/shellfuncs
+++ prefix=/usr
+++ exec_prefix=/usr
+++ : /etc/ha.d
+++ : /etc/ha.d/rc.d
+++ : /etc/ha.d/conf
+++ : /etc/ha.d/ha.cf
+++ : /var/lib/heartbeat
+++ : /var/run/heartbeat/rsctmp
+++ : /var/lib/heartbeat/fifo
+++ : /usr/lib/heartbeat
+++ : /usr/share/heartbeat
+++ : '%Y/%m/%d_%T '
+++ : /dev/null
+++ : /etc/ha.d/resource.d
+++ : /usr/share/doc/heartbeat
+++ : mysql
+++ : 'mysql[7507]'
+++ : /var/run/
+++ : /var/lock/subsys/
+++ : /usr/sbin
+++ export HA_DIR HA_RCDIR HA_FIFO HA_BIN
+++ export HA_DEBUGLOG HA_LOGFILE HA_LOGFACILITY
+++ export HA_DATEFMT HA_RESOURCEDIR HA_DOCDIR
+++ MKTEMP=/bin/mktemp
+++ TESTPROG=/usr/bin/test
+++
PATH=/usr/lib/heartbeat:/usr/sbin:/usr/share/heartbeat:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin
++++ echo
/usr/lib/heartbeat:/usr/sbin:/usr/share/heartbeat:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin
++++ sed -e s%::%% -e 's%:\.:%:%' -e 's%^:%%' -e 's%^\.:%%'
+++
PATH=/usr/lib/heartbeat:/usr/sbin:/usr/share/heartbeat:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin
+++ export PATH
++ '[' -z /usr/lib/ocf ']'
++ . /usr/lib/ocf/resource.d/heartbeat/.ocf-binaries
+++
PATH=/usr/lib/heartbeat:/usr/sbin:/usr/share/heartbeat:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/sbin:/bin:/usr/sbin:/usr/bin
+++
PATH=/usr/lib/heartbeat:/usr/sbin:/usr/share/heartbeat:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/root/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/ucb
+++ export PATH
+++ : /bin/gawk
+++ : '/bin/grep -E'
+++ : -a
+++ : mailx
+++ : /bin/mktemp
+++ : /bin/ping
+++ : /usr/bin/rpmbuild
+++ : /bin/sh
+++ : /usr/bin/test
+++ : /usr/bin/test
+++ : basename
+++ : blockdev
+++ : cat
+++ : fsck
+++ : fuser
+++ : getent
+++ : grep
+++ : ifconfig
+++ : iptables
+++ : ip
+++ : mdadm
+++ : modprobe
+++ : mount
+++ : msgfmt
+++ : netstat
+++ : perl
+++ : python
+++ : raidstart
+++ : raidstop
+++ : route
+++ : umount
+++ : reboot
+++ : poweroff
+++ : wget
+++ : whoami
+++ : strings
+++ : scp
+++ : ssh
+++ : swig
+++ : /bin/mktemp
+++ : gzip
+++ : tar
+++ : md5
+++ : drbdadm
+++ : drbdsetup
++ . /usr/lib/ocf/resource.d/heartbeat/.ocf-returncodes
+++ OCF_SUCCESS=0
+++ OCF_ERR_GENERIC=1
+++ OCF_ERR_ARGS=2
+++ OCF_ERR_UNIMPLEMENTED=3
+++ OCF_ERR_PERM=4
+++ OCF_ERR_INSTALLED=5
+++ OCF_ERR_CONFIGURED=6
+++ OCF_NOT_RUNNING=7
+++ OCF_RUNNING_MASTER=8
+++ OCF_FAILED_MASTER=9
++ . /usr/lib/ocf/resource.d/heartbeat/.ocf-directories
+++ prefix=/usr
+++ exec_prefix=/usr
+++ : /etc/init.d
+++ : /etc/ha.d
+++ : /etc/ha.d/rc.d
+++ : /etc/ha.d/conf
+++ : /etc/ha.d/ha.cf
+++ : /var/lib/heartbeat
+++ : /var/run/heartbeat/rsctmp
+++ : /var/lib/heartbeat/fifo
+++ : /usr/lib/heartbeat
+++ : /usr/sbin
+++ : %Y/%m/%d_%T
+++ : /dev/null
+++ : /etc/ha.d/resource.d
+++ : /usr/share/doc/heartbeat
+++ : mysql
+++ : 'mysql[7507]'
+++ : /var/run/
+++ : /var/lock/subsys/
++ __ocf_set_defaults start
++ __OCF_ACTION=start
++ unset LANG
++ LC_ALL=C
++ export LC_ALL
++ '[' -z '' ']'
++ : 0
++ '[' '!' -d /usr/lib/ocf ']'
++ '[' -z '' ']'
++ : mysql
++ '[' -z '' ']'
++ : We are being invoked as an init script.
++ : Fill in some things with reasonable values.
++ : default
++ return 0
++ uname
+ HOSTOS=Linux
+ '[' XLinux == XOpenBSD ']'
+ OCF_RESKEY_binary_default=/usr/bin/safe_mysqld
+ OCF_RESKEY_config_default=/etc/my.cnf
+ OCF_RESKEY_datadir_default=/var/lib/mysql
+ OCF_RESKEY_user_default=mysql
+ OCF_RESKEY_group_default=mysql
+ OCF_RESKEY_log_default=/var/log/mysqld.log
+ OCF_RESKEY_pid_default=/var/run/mysql/mysqld.pid
+ OCF_RESKEY_socket_default=/var/lib/mysql/mysql.sock
+ OCF_RESKEY_test_user_default=root
+ OCF_RESKEY_test_table_default=mysql.user
+ OCF_RESKEY_test_passwd_default=
+ OCF_RESKEY_enable_creation_default=0
+ OCF_RESKEY_additional_parameters_default=
+ : /usr/bin/safe_mysqld
++ dirname /usr/bin/safe_mysqld
+ MYSQL_BINDIR=/usr/bin
+ : /etc/my.cnf
+ : /replicated/mysql/data
+ : mysql
+ : mysql
+ : /var/log/mysqld.log
+ : /var/run/mysql/mysqld.pid
+ : /var/lib/mysql/mysql.sock
+ : root
+ : mysql.user
+ :
+ : 0
+ :
+ case "$1" in
+ mysql_validate
+ '[' '!' -f /etc/my.cnf ']'
+ '[' '!' -d /replicated/mysql/data ']'
+ getent passwd mysql
+ '[' '!' 0 -eq 0 ']'
+ getent group mysql
+ '[' '!' 0 -eq 0 ']'
+ mysql_start
+ mysql_status
+ '[' '!' -e /var/run/mysql/mysqld.pid ']'
+ ocf_log debug 'MySQL is not running'
+ '[' 2 -lt 2 ']'
+ __OCF_PRIO=debug
+ shift
+ __OCF_MSG='MySQL is not running'
+ case "${__OCF_PRIO}" in
+ __OCF_PRIO=DEBUG
+ '[' DEBUG = DEBUG ']'
+ ha_debug 'DEBUG: MySQL is not running'
+ '[' x = xyes ']'
+ '[' -n '' ']'
+ '[' -n /dev/null ']'
+ : appending to /dev/null
++ hadate
++ date '+%Y/%m/%d_%T '
+ Echo 'mysql[7507]: 2008/02/13_10:14:30' 'DEBUG: MySQL is not running'
+ echo 'mysql[7507]: 2008/02/13_10:14:30' 'DEBUG: MySQL is not running'
+ return 7
+ '[' 7 == 0 ']'
+ touch /var/log/mysqld.log
+ chown mysql:mysql /var/log/mysqld.log
+ chmod 0640 /var/log/mysqld.log
+ '[' -x /sbin/restorecon ']'
+ /sbin/restorecon /var/log/mysqld.log
+ '[' 0 -a '!' -d /replicated/mysql/data/mysql ']'
+ /usr/bin/safe_mysqld --defaults-file=/etc/my.cnf
--pid-file=/var/run/mysql/mysqld.pid --socket=/var/lib/mysql/mysql.sock
--datadir=/replicated/mysql/data --user=mysql
+ rc=0
+ '[' 0 '!=' 0 ']'
+ start_wait=1
+ '[' 1 = 1 ']'
+ mysql_status
+ '[' '!' -e /var/run/mysql/mysqld.pid ']'
+ ocf_log debug 'MySQL is not running'
+ '[' 2 -lt 2 ']'
+ __OCF_PRIO=debug
+ shift
+ __OCF_MSG='MySQL is not running'
+ case "${__OCF_PRIO}" in
+ __OCF_PRIO=DEBUG
+ '[' DEBUG = DEBUG ']'
+ ha_debug 'DEBUG: MySQL is not running'
+ '[' x = xyes ']'
+ '[' -n '' ']'
+ '[' -n /dev/null ']'
+ : appending to /dev/null
++ hadate
++ date '+%Y/%m/%d_%T '
+ Echo 'mysql[7507]: 2008/02/13_10:14:30' 'DEBUG: MySQL is not running'
+ echo 'mysql[7507]: 2008/02/13_10:14:30' 'DEBUG: MySQL is not running'
+ return 7
+ rc=7
+ '[' 7 = 0 ']'
+ '[' 7 '!=' 7 ']'
+ sleep 2
+ '[' 1 = 1 ']'
+ mysql_status
+ '[' '!' -e /var/run/mysql/mysqld.pid ']'
+ ocf_log debug 'MySQL is not running'
+ '[' 2 -lt 2 ']'
+ __OCF_PRIO=debug
+ shift
+ __OCF_MSG='MySQL is not running'
+ case "${__OCF_PRIO}" in
+ __OCF_PRIO=DEBUG
+ '[' DEBUG = DEBUG ']'
+ ha_debug 'DEBUG: MySQL is not running'
+ '[' x = xyes ']'
+ '[' -n '' ']'
+ '[' -n /dev/null ']'
+ : appending to /dev/null
++ hadate
++ date '+%Y/%m/%d_%T '
+ Echo 'mysql[7507]: 2008/02/13_10:14:32' 'DEBUG: MySQL is not running'
+ echo 'mysql[7507]: 2008/02/13_10:14:32' 'DEBUG: MySQL is not running'
+ return 7
+ rc=7
+ '[' 7 = 0 ']'
+ '[' 7 '!=' 7 ']'
+ sleep 2
Thanks again,
Amy
-----Original Message-----
From: Dejan Muhamedagic <[EMAIL PROTECTED]>
Sent: Wednesday, February 13, 2008 5:46am
To: [EMAIL PROTECTED], General Linux-HA mailing list
<[email protected]>
Subject: Re: [Linux-HA] mysql OCF issue on CentOS 5.1 after upgrading to
heartbeat 2.1.3-3
Hi,
On Tue, Feb 12, 2008 at 12:16:13PM -0500, [EMAIL PROTECTED] wrote:
> I have been using the mysql OCF on heartbeat-2.1.2-3 for some time on centOS
> 5.1 with no problems
>
> Feb 12 12:11:42 utnode1 haclient: on_event:evt:cib_changed
> Feb 12 12:11:44 utnode1 mysql[12728]: [12807]: INFO: MySQL started
> Feb 12 12:11:44 utnode1 crmd: [12025]: info: process_lrm_event: LRM operation
> mysql_repl_start_0 (call=27, rc=0) complete
> Feb 12 12:11:44 utnode1 crmd: [12025]: info: build_operation_update: Digest
> for 0:0;10:37:50df748e-1a0e-45b3-ad16-0dd37fbf9450 (mysql_repl_start_0) was
> 6caa97789ad6bbd931da5b3e8677b611
> Feb 12 12:11:44 utnode1 crmd: [12025]: info: log_data_element:
> build_operation_update: digest:source <parameters target_role="started"
> datadir="/replicated/mysql/data"/>
> Feb 12 12:11:46 utnode1 haclient: on_event:evt:cib_changed
>
> When attempting the start up after upgrading all other resources start with
> no problems but when it gets to MySQL I get
>
> Feb 12 12:00:50 utnode1 lrmd: [11257]: WARN: operation start[14] on
> ocf::mysql::mysql_repl for client 11260, its parameters:
> target_role=[started] CRM_meta_timeout=[20000] crm_feature_set=[1.0.9]
> datadir=[/replicated/mysql/data] : pid [11555] timed out
> Feb 12 12:00:50 utnode1 crmd: [11260]: ERROR: process_lrm_event: LRM
> operation mysql_repl_start_0 (14) Timed Out (timeout=20000ms)
It's hard to say why the mysql script timed out. Probably network
related. You could try to run the mysql RA by hand:
# export OCF_ROOT=/usr/lib/ocf
# OCF_RESKEY_datadir="/replicated/mysql/data" sh -x
/usr/lib/ocf/resource.d/heartbeat/mysql
and see where it blocks.
> Feb 12 12:00:52 utnode1 crmd: [11260]: info: do_lrm_rsc_op: Performing
> op=mysql_repl_stop_0 key=1:25:50df748e-1a0e-45b3-ad16-0dd37fbf9450)
> Feb 12 12:00:52 utnode1 lrmd: [11257]: info: rsc:mysql_repl: stop
>
> Reinstalling the previous heartbeat version restored
> functionality with no changes to the cib.xml made or to
> anything else besides the heartbeat RPMs.
That means that there's a regression in the mysql RA. Just looked
through the changelog and there's a change in how uid are
resolved: instead of grep /etc/passwd, getent is used. Where are
the security databases (passwd/group)? How's your nsswitch.conf setup?
Thanks,
Dejan
>
> Any help appreciated,
>
> Amy
>
> _______________________________________________
> Linux-HA mailing list
> [email protected]
> http://lists.linux-ha.org/mailman/listinfo/linux-ha
> See also: http://linux-ha.org/ReportingProblems
_______________________________________________
Linux-HA mailing list
[email protected]
http://lists.linux-ha.org/mailman/listinfo/linux-ha
See also: http://linux-ha.org/ReportingProblems
