Server hanging once a week (Solaris 8)
Hi all; I have a Mysql 3.2.58 server running on Solaris 8 (the latest 3.2 version downloaded from Mysql.com). The system is a Ultra-250 server with multiple CPUs and 2G RAM. There are many databases but they're not large and the load on the system is not high at all. We're using this older version because we developed the database with the 3.2.x release, years ago, and don't have the manpower to check to see if the newer version will work or fix issues we might run into--although we may have to find a way. This version worked without problems for over a year. But, for the last 4-6 weeks we've seen a problem once every 8-10 days where the server hangs and will not come back. Attempts to attach normally hang; current operations hang; etc. Using processlist shows some processes which have existed for a long time; that may or may not be correct, I'm not sure. Almost all our queries are coming in through the Perl DBI/DBD interface. When I try to use mysqladmin kill they don't die; they do go to a state of killed though. When I try to myqladmin flush-tables, that hangs. Flush-logs works but there is nothing interesting in the logs. When I try to run mysqld stop, the server process doesn't stop, although most of the hung requests When I run strace on the PID, I get this: lwp_sema_wait(0x1bfe50 then it hangs until I ^C. I have to kill -9 the server PID to bring it down. Then I check my tables but so far (cross fingers) they've all been fine except they are not shut properly, so I fix that with myisamchk. Since I have not changed anything I suspect that the IS folks have installed some new patch on the Solaris system which is causing this problem to appear, but I have no proof of that. Does anyone have any advice or information for me: places to look, things to do, etc. etc.? While so far we haven't lost any data this is a problem since it seems like it will continue to happen. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
Hello. Very often similar symptoms causes various lock problems. Do you use InnoDB? Try log_slow_queries to find hung queries. Paul Smith [EMAIL PROTECTED] wrote: Hi all; I have a Mysql 3.2.58 server running on Solaris 8 (the latest 3.2 version downloaded from Mysql.com). The system is a Ultra-250 server with multiple CPUs and 2G RAM. There are many databases but they're not large and the load on the system is not high at all. We're using this older version because we developed the database with the 3.2.x release, years ago, and don't have the manpower to check to see if the newer version will work or fix issues we might run into--although we may have to find a way. This version worked without problems for over a year. But, for the last 4-6 weeks we've seen a problem once every 8-10 days where the server hangs and will not come back. Attempts to attach normally hang; current operations hang; etc. Using processlist shows some processes which have existed for a long time; that may or may not be correct, I'm not sure. Almost all our queries are coming in through the Perl DBI/DBD interface. When I try to use mysqladmin kill they don't die; they do go to a state of killed though. When I try to myqladmin flush-tables, that hangs. Flush-logs works but there is nothing interesting in the logs. When I try to run mysqld stop, the server process doesn't stop, although most of the hung requests When I run strace on the PID, I get this: lwp_sema_wait(0x1bfe50 then it hangs until I ^C. I have to kill -9 the server PID to bring it down. Then I check my tables but so far (cross fingers) they've all been fine except they are not shut properly, so I fix that with myisamchk. Since I have not changed anything I suspect that the IS folks have installed some new patch on the Solaris system which is causing this problem to appear, but I have no proof of that. Does anyone have any advice or information for me: places to look, things to do, etc. etc.? While so far we haven't lost any data this is a problem since it seems like it will continue to happen. -- For technical support contracts, goto https://order.mysql.com/?ref=ensita This email is sponsored by Ensita.NET http://www.ensita.net/ __ ___ ___ __ / |/ /_ __/ __/ __ \/ /Gleb Paharenko / /|_/ / // /\ \/ /_/ / /__ [EMAIL PROTECTED] /_/ /_/\_, /___/\___\_\___/ MySQL AB / Ensita.NET ___/ www.mysql.com -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
%% Gleb Paharenko [EMAIL PROTECTED] writes: gp Very often similar symptoms causes various lock problems. Do you gp use InnoDB? Try log_slow_queries to find hung queries. I'm using MyISAM tables. When I wrote this application InnoDB wasn't even an option :-). I don't think it's hung queries, because even new queries that I know are very fast fail. Heck, I can't even attach to the DB except through the admin interface (mysqladmin). Unless you're saying that the hung queries are using up the processes/threads in the DB so that new queries can't get through? Thanks for the response... -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
When the database is in a `hung` state, is the file system where the MYI, MYD and frm files accessible? Paul Smith wrote: %% Gleb Paharenko [EMAIL PROTECTED] writes: gp Very often similar symptoms causes various lock problems. Do you gp use InnoDB? Try log_slow_queries to find hung queries. I'm using MyISAM tables. When I wrote this application InnoDB wasn't even an option :-). I don't think it's hung queries, because even new queries that I know are very fast fail. Heck, I can't even attach to the DB except through the admin interface (mysqladmin). Unless you're saying that the hung queries are using up the processes/threads in the DB so that new queries can't get through? Thanks for the response... -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
%% Victor Pendleton [EMAIL PROTECTED] writes: vp When the database is in a `hung` state, is the file system where vp the MYI, MYD and frm files accessible? Definitely. I can log in, see the files, run the mysqladmin commands, etc. The databases live on the local disk, not a remote server (I do backups every night to a remote server). Other operations and services on that server continue to work. Thanks for the response! -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
What state are the queries in while they are hung? What command or SQL are they executing? Paul Smith wrote: %% Victor Pendleton [EMAIL PROTECTED] writes: vp When the database is in a `hung` state, is the file system where vp the MYI, MYD and frm files accessible? Definitely. I can log in, see the files, run the mysqladmin commands, etc. The databases live on the local disk, not a remote server (I do backups every night to a remote server). Other operations and services on that server continue to work. Thanks for the response! -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
%% Victor Pendleton [EMAIL PROTECTED] writes: vp What state are the queries in while they are hung? What command or vp SQL are they executing? Unfortunately I lost the output of the processlist command. Whenever the server hangs it's always a crazy race to get it back up again. Next time it happens I'll be sure to stow the list somewhere before restarting the server. However, IIRC there were a mix of queries: some were Wait, some were Sleep. -- --- Paul D. Smith [EMAIL PROTECTED] HASMAT--HA Software Mthds Tools Please remain calm...I may be mad, but I am a professional. --Mad Scientist --- These are my opinions---Nortel Networks takes no responsibility for them. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Server hanging once a week (Solaris 8)
Understandable. The state, command and info values from `show processlist` could shed some light on what is occurring. Paul Smith wrote: %% Victor Pendleton [EMAIL PROTECTED] writes: vp What state are the queries in while they are hung? What command or vp SQL are they executing? Unfortunately I lost the output of the processlist command. Whenever the server hangs it's always a crazy race to get it back up again. Next time it happens I'll be sure to stow the list somewhere before restarting the server. However, IIRC there were a mix of queries: some were Wait, some were Sleep. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
