Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
Hi, I think I located the problem, but will have to see what happens at the full backups this weekend. It might be a hardware problem (servers are recycled/old). When I went to the box it had a lot of swap_pager: indefinate wait buffer in the console. I swapped the RAID array to a different box. Will update after the weekend to see if the problems disappear. Well it happens with a local MySQL and a remote MySQL. I'm pretty certain is actually not to do with the job at all and is probably a bug in the scheduler somewhere. As for using gdb being slower I doubt very much if you'd notice the difference between gdb and not. As for whether MySQL is faster? I'm not sure what you mean. Cheers, Dom -- blog: http://www.mostlygeek.com --- This SF.Net email is sponsored by xPML, a groundbreaking scripting language that extends applications into web and mobile media. Attend the live webcast and join the prime developer group breaking into this new coding territory! http://sel.as-us.falkag.net/sel?cmd=lnkkid0944bid$1720dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
Serial console / Display shows? Display shows nothing. It crashes to the point were I can't even type anything in. Does it happen at the same time every day/period? There seems to be 2 problems, which may be related. Sometimes it crashes so hard I have to physically reboot the server. Right now it responds to pings (very fast) but I can't SSH in. Only seen this once before when an NFS server died and something has been waiting for it to recover (hard mounted). There might be a problem with bacula trying to backup a something and is stuck in an infinite loop. Seems to become unusably mostly after full backups. If yes that might indicate a software-triggered problem. If no, perhaps check the hardware first. If you stop bacula and let it run, does it crash? Haven't tried that yet. What discs/controller are you using? SATA/SCSI? FreeBSD drivers ata/... 3WARE 8006-2LP + 2x300GB SATA Seagate drives What threading library (kse, thr) are you using for Bacula? (Default on 6 is kse) I believe it's default. Bacula-server was built from ports. The system responds to pings (sometimes), but I can not SSH in. Before it crashed so bad the local keyboard didn't even work. A reboot would fix things, but it would become unstable again quickly. I have similar How quickly? Miliseonds. I have a daily Bacula crash which I have had for ages on FreeBSD 5.4 and 6.0. I'm pretty sure it only happens with my configurations and not the standard ones. Something about my setup causes it to crash right before the job to backup the catalogue, but before it actually started to run that job. It is easy to fix, just restart bacula at midnight from cron. One of these days I'll build a -ggdb bacula and get a core dump... Hmm... mine is running on a local mysql. Is it better to use gdb? Isn't mysql faster? --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
Benson Wong wrote: Serial console / Display shows? Display shows nothing. It crashes to the point were I can't even type anything in. Does it happen at the same time every day/period? There seems to be 2 problems, which may be related. Sometimes it crashes so hard I have to physically reboot the server. Right now it responds to pings (very fast) but I can't SSH in. Only seen this once before when an NFS server died and something has been waiting for it to recover (hard mounted). There might be a problem with bacula trying to backup a something and is stuck in an infinite loop. Seems to become unusably mostly after full backups. If yes that might indicate a software-triggered problem. If no, perhaps check the hardware first. If you stop bacula and let it run, does it crash? Haven't tried that yet. That would be a good start. What discs/controller are you using? SATA/SCSI? FreeBSD drivers ata/... 3WARE 8006-2LP + 2x300GB SATA Seagate drives I have a very similar setup at work for one of our SDs. To quote: FreeBSD 6-STABLE Bacula 1.38.5 (only SD and FD) AMCC (3ware) 8000 series SATA controller 2x Western Digital discs It has never displayed any instability. What threading library (kse, thr) are you using for Bacula? (Default on 6 is kse) I believe it's default. Bacula-server was built from ports. It will be kse unless you had deliberately changed it. It is probably irrelevant anyway. The system responds to pings (sometimes), but I can not SSH in. Before it crashed so bad the local keyboard didn't even work. A reboot would fix things, but it would become unstable again quickly. I have similar How quickly? Miliseonds. Sorry, I meant how long before it becomes unstable again. I have a daily Bacula crash which I have had for ages on FreeBSD 5.4 and 6.0. I'm pretty sure it only happens with my configurations and not the standard ones. Something about my setup causes it to crash right before the job to backup the catalogue, but before it actually started to run that job. It is easy to fix, just restart bacula at midnight from cron. One of these days I'll build a -ggdb bacula and get a core dump... Hmm... mine is running on a local mysql. Is it better to use gdb? Isn't mysql faster? Well it happens with a local MySQL and a remote MySQL. I'm pretty certain is actually not to do with the job at all and is probably a bug in the scheduler somewhere. As for using gdb being slower I doubt very much if you'd notice the difference between gdb and not. As for whether MySQL is faster? I'm not sure what you mean. Cheers, Dom --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
Hi, I'm trying to isolate a problem. I have bacula 1.38.5 running on FreeBSD 6.0R and the system seems to be crashing hard. It doesn't seem to core dump, and there is nothing in the logs, it just stop becoming responsive. The system responds to pings (sometimes), but I can not SSH in. Before it crashed so bad the local keyboard didn't even work. A reboot would fix things, but it would become unstable again quickly. I have similar hardware running FreeBSD 4.9 and 5.4 with no stability problems. The server is a dedicated backup box so there are no other network daemons (besides SSH/sendmail) running. Anybody have similar problems? I'm thinking it may be a weird hardware problem with the RAM or the CPU, and was going to swap HDDs into a spare box. I wanted to ask here first before tearing the box apart. Thanks. Ben. -- blog: http://www.mostlygeek.com --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
Benson Wong wrote: Hi, I'm trying to isolate a problem. I have bacula 1.38.5 running on FreeBSD 6.0R and the system seems to be crashing hard. It doesn't seem to core dump, and there is nothing in the logs, it just stop becoming responsive. Serial console / Display shows? Does it happen at the same time every day/period? If yes that might indicate a software-triggered problem. If no, perhaps check the hardware first. If you stop bacula and let it run, does it crash? What discs/controller are you using? SATA/SCSI? FreeBSD drivers ata/... What threading library (kse, thr) are you using for Bacula? (Default on 6 is kse) The system responds to pings (sometimes), but I can not SSH in. Before it crashed so bad the local keyboard didn't even work. A reboot would fix things, but it would become unstable again quickly. I have similar How quickly? hardware running FreeBSD 4.9 and 5.4 with no stability problems. Not automatically indicative of anything. The server is a dedicated backup box so there are no other network daemons (besides SSH/sendmail) running. Anybody have similar problems? I'm thinking it may be a weird hardware problem with the RAM or the CPU, and was going to swap HDDs into a spare box. I wanted to ask here first before tearing the box apart. I have a daily Bacula crash which I have had for ages on FreeBSD 5.4 and 6.0. I'm pretty sure it only happens with my configurations and not the standard ones. Something about my setup causes it to crash right before the job to backup the catalogue, but before it actually started to run that job. It is easy to fix, just restart bacula at midnight from cron. One of these days I'll build a -ggdb bacula and get a core dump... Thanks. Ben. -- blog: http://www.mostlygeek.com --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=kkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Dom --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
On 20 Feb 2006 at 16:08, Benson Wong wrote: Hi, I'm trying to isolate a problem. I have bacula 1.38.5 running on FreeBSD 6.0R and the system seems to be crashing hard. It doesn't seem to core dump, and there is nothing in the logs, it just stop becoming responsive. The system responds to pings (sometimes), but I can not SSH in. Before it crashed so bad the local keyboard didn't even work. A reboot would fix things, but it would become unstable again quickly. I have similar hardware running FreeBSD 4.9 and 5.4 with no stability problems. If you're not running Bacula, does the same problem occur? The server is a dedicated backup box so there are no other network daemons (besides SSH/sendmail) running. It could be something unrelated to bacula. Try a tail -F /var/log/messages and leave it running in an SSH session. Anybody have similar problems? I'm thinking it may be a weird hardware problem with the RAM or the CPU, and was going to swap HDDs into a spare box. I wanted to ask here first before tearing the box apart. Start with the PSU. -- Dan Langille : Software Developer looking for work my resume: http://www.freebsddiary.org/dan_langille.php --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FreeBSD 6.0 + Bacula 1.38.5 Crashing
spare box. I wanted to ask here first before tearing the box apart. Start with the PSU. google memtest86 and burn the ISO, often the cause of PC problems. could be heat, but you can monitor that using sensors/alarms. ~lava smime.p7s Description: S/MIME cryptographic signature
