[Bacula-users] MySQL server has gone away
Dear Bacula community,
I have a problem with a Bacula server producing the following error
every 24-48 hours:MySQL server has gone away. After such time, Bacula
can be restarted and all is well for a day or so.
Some Hardware/software info:
Platform: Dell 2850 Dual 3.0GHZ Xeon, 2G RAM
Redhat el4
Kernel: 2.6.9-11.ELsmp
Bacula: bacula-1.38.5 compiled from source
Mysql: mysql-5.0.16compiled from source
This is my second Bacula system. On a nearly identical Dell system, I am
running the version bacula-1.36.3 and mysql-4.1.12, with no problems.
In the beginning, I was running bacula-1.36.3 and mysql-4.1.12 on the
second system, but this combination was producing the 'MySQL server has
gone away' error. So I have tried other Bacula versions. I have also
tried other versions of Mysql, but in every case the outcome is the
same: 'MySQL server has gone away' after some period of random time
usually 1-2 days but sometimes overnight.
All data that Bacula saves are saved to local disk resources on both
systems. No NFS resources are used with Bacula. No tape resources.
Here is an example log of a failure:
29-Jan 09:10 storm-dir: BackupCatalog.2006-01-29_09.10.00 Fatal error:
sql_create.c:85 sql_create.c:85 insert INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
failed:
MySQL server has gone away
29-Jan 09:10 storm-dir: sql_create.c:85 INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
29-Jan 09:10 storm-dir: BackupCatalog.2006-01-29_09.10.00 Fatal error:
sql_create.c:87 Create DB Job record INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
failed. ERR=MySQL server has gone away
I've searched the Bacula list servers ,and the web for that matter, and
have not found a definite explanation or any guidance. It is strange
that one system works and one system doesn't. The main difference in
these systems is the operating system. The system that works is a Fedora
Core 3 system and the system with the error is the Redhat EL4.
Both system are designed to back up around 250-300 gig-a-bytes weekly
from local network hosts. I've experimented with non-overlapping
schedules on the odd chance that Bacula was overloading the Mysql
database server. No change. As far as I can tell, there seems to be no
rhythm or reason in the Bacula/Mysql loading: The error will occur
regardless if small backup job(s) are performed or large backup jobs are
performed.
Any ideas on how to fix this would be appreciated.
My Bacula configure:
./configure \
--sbindir=/usr/local/bacula/bin \
--sysconfdir=/etc/bacula/ \
--with-pid-dir=/usr/local/bacula/working \
--with-scriptdir=/etc/bacula \
--with-subsys-dir=/usr/local/bacula/working \
--with-working-dir=/usr/local/bacula/bin/working \
[EMAIL PROTECTED] \
[EMAIL PROTECTED] \
--with-smtp-host=mailhost.mydomain.edu \
--with-tcp-wrappers=/usr/lib \
--with-libwrap \
--with-x \
--enable-conio \
--with-mysql=/usr/local/mysql \
--with-dir-user=root \
--with-dir-group=bacula \
--with-sd-user=root \
--with-sd-group=bacula \
--with-fd-user=root \
--with-fd-group=bacula \
--with-baseport=9101 \
--enable-tray-monitor \
--enable-smartalloc \
--disable-readline
Mysql configure:
./configure --with-unix-socket-path=/tmp/mysql.sock
--enable-thread-safe-client --prefix=/usr/local/mysql
My /etc/bacula/bacula-dir.conf is 725 lines long, but if it is needed I
will be happy to provide it.
Bob
--
Robert Leche - System Administrator
Louisiana State University - Southern Regional Climate Center
East 328 Howe-Russell Building - Baton Rouge, La. 70803
rleche at srcc.lsu.edu - 225 578 5023
---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] MySQL server has gone away
Robert Leche wrote:
Dear Bacula community,
I have a problem with a Bacula server producing the following error
every 24-48 hours:MySQL server has gone away. After such time, Bacula
can be restarted and all is well for a day or so.
Some Hardware/software info:
Platform: Dell 2850 Dual 3.0GHZ Xeon, 2G RAM
Redhat el4
Kernel: 2.6.9-11.ELsmp
Bacula: bacula-1.38.5 compiled from source
Mysql: mysql-5.0.16compiled from source
This is my second Bacula system. On a nearly identical Dell system, I
am running the version bacula-1.36.3 and mysql-4.1.12, with no
problems. In the beginning, I was running bacula-1.36.3 and
mysql-4.1.12 on the second system, but this combination was producing
the 'MySQL server has gone away' error. So I have tried other Bacula
versions. I have also tried other versions of Mysql, but in every
case the outcome is the same: 'MySQL server has gone away' after some
period of random time usually 1-2 days but sometimes overnight.
All data that Bacula saves are saved to local disk resources on both
systems. No NFS resources are used with Bacula. No tape resources.
Here is an example log of a failure:
29-Jan 09:10 storm-dir: BackupCatalog.2006-01-29_09.10.00 Fatal error:
sql_create.c:85 sql_create.c:85 insert INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
failed:
MySQL server has gone away
29-Jan 09:10 storm-dir: sql_create.c:85 INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
29-Jan 09:10 storm-dir: BackupCatalog.2006-01-29_09.10.00 Fatal error:
sql_create.c:87 Create DB Job record INSERT INTO
Job(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate) VALUES
('BackupCatalog.2006-01-29_09.10.00','BackupCatalog','B','F','C','2006-01-2909:10:00',1138547400)
failed. ERR=MySQL server has gone away
I've searched the Bacula list servers ,and the web for that matter,
and have not found a definite explanation or any guidance. It is
strange that one system works and one system doesn't. The main
difference in these systems is the operating system. The system that
works is a Fedora Core 3 system and the system with the error is the
Redhat EL4.
Both system are designed to back up around 250-300 gig-a-bytes weekly
from local network hosts. I've experimented with non-overlapping
schedules on the odd chance that Bacula was overloading the Mysql
database server. No change. As far as I can tell, there seems to be no
rhythm or reason in the Bacula/Mysql loading: The error will occur
regardless if small backup job(s) are performed or large backup jobs
are performed.
Any ideas on how to fix this would be appreciated.
My Bacula configure:
./configure \
--sbindir=/usr/local/bacula/bin \
--sysconfdir=/etc/bacula/ \
--with-pid-dir=/usr/local/bacula/working \
--with-scriptdir=/etc/bacula \
--with-subsys-dir=/usr/local/bacula/working \
--with-working-dir=/usr/local/bacula/bin/working \
[EMAIL PROTECTED] \
[EMAIL PROTECTED] \
--with-smtp-host=mailhost.mydomain.edu \
--with-tcp-wrappers=/usr/lib \
--with-libwrap \
--with-x \
--enable-conio \
--with-mysql=/usr/local/mysql \
--with-dir-user=root \
--with-dir-group=bacula \
--with-sd-user=root \
--with-sd-group=bacula \
--with-fd-user=root \
--with-fd-group=bacula \
--with-baseport=9101 \
--enable-tray-monitor \
--enable-smartalloc \
--disable-readline
Mysql configure:
./configure --with-unix-socket-path=/tmp/mysql.sock
--enable-thread-safe-client --prefix=/usr/local/mysql
My /etc/bacula/bacula-dir.conf is 725 lines long, but if it is needed
I will be happy to provide it.
Bob
Hi Robert,
You may like to look here :
http://dev.mysql.com/doc/refman/4.1/en/gone-away.html
It may not give the solution but might be able to put you on the right
track. There maybe a timeout on the tcp connection to mysql or a number
of different problems.
Regards
--
David Logan
South Australia
when in trouble, or in doubt
run in circles, scream and shout
---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] One host, two directors?
Hi all Sorry, two questions in one day... :) Is it possible to have two directors backup one host? (Not at the same time I might add!). Is it just a case of adding the second director entry to the fd.conf on the host (as well as adding the normal config to the backup dir.conf). I am specifically thinking about my laptop, where I would like to back it up both at work and at home. Many thanks for your help, it is greatly appreciated. -- Steve Loughran Network Infrastructure Manager Sony Computer Entertainment (Cambridge) --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: bacula killing disks?
Two of the boxes have SCSI drives. It's happening on 3 different machines: Dell 2450 4 SCSI drives (3 RAID 0 striped), Windows 2003 P III whitebox 2 SCSI drives, Fedora FC2 P IV whitebox 2 IDE drives, Windows 2000 yet it backs up other 2 other PIII whiteboxes, Windows and FC3, and a couple of laptops just fine. Anywhere I can start looking? -Rob Date: Mon, 30 Jan 2006 11:25:13 -0800 (PST) From: [EMAIL PROTECTED] Reply-To: [EMAIL PROTECTED] Subject: Re: [Bacula-users] bacula killing disks? To: Jeffrey L. Taylor [EMAIL PROTECTED], [EMAIL PROTECTED], bacula-users@lists.sourceforge.net Is there a promise ide controller on the board? I have had serious problems (with the same error messages that you have posted) with some combinations of promise ide controllers, kernels. My solution was either to disable dma or replace the controller with a hotpoint one. John --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] tape did not come out
Am 31.01.2006 um 08:43 schrieb Natxo Asenjo: 30-Jan 20:00 vpn-sd: NightlySave.2006-01-30_20.00.00 Fatal error: dev.c:387 dev.c:381 Unable to open device Tape (/dev/nst0): ERR=Read-only file system Is the operating system disk okay? Bacula can not open the device node for writing, so I guess it's mounted read only for some reason. --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula-dir.9101.state ERR=Ioctl() inappropr ié pour un périphérique
Hello, At one unexpected hour (no job in progress or just finished or scheduled) bacula's deamon indicates : ERROR in bsys.c:536 Could not create state file. /home/bacula/working/bacula-dir.9101.state ERR=Ioctl() inapproproprié pour un périphérique bacula-fd.9102.state and bacula-sd.9103.state are created at the same time. Why this error ? How bacula uses these state's files ? Which are the consequences if bacula-dir.9101.state is not created ? Thanks, Evelyne Cangini --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regular error message ...
i still didn't find a reason for my problem ... bacula prunes old jobs, then i get an error no volume available, THEN the volume gets recycled and backup starts i'll attach the messages, maybe someone can help me with that; i don't really like to get an error message every couple days Florian --- 31-Jan 21:00 erde-dir: Start Backup JobId 1108, Job=Cetus_Job.2006-01-31_21.00.00 31-Jan 21:00 erde-dir: Max configured use duration exceeded. Marking Volume HD03 as Used. 31-Jan 21:01 erde-dir: Pruned 6 Jobs on Volume HD01 from catalog. 31-Jan 21:01 erde-sd: Job Cetus_Job.2006-01-31_21.00.00 waiting. Cannot find any appendable volumes. Please use the label command to create a new Volume for: Storage: FileStorage Media type: File Pool: DaylyPool 31-Jan 22:01 erde-dir: Recycled volume HD01 31-Jan 22:02 erde-sd: Recycled volume HD01 on device /opt/baculaHD, all previous data lost. --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Spooling speed
On Tue, 31 Jan 2006, Ryan Novosielski wrote: So, I have switched to spooling, on the advice I've seen written recently... sounds like the way to go, especially if you only have one tape drive. I expected a speed increase too, as the drive would be used more efficiently. What I did not expect is the 1000Kps speed DECREASE. Can anyone tell me why this might be? This is a Solaris 9, Sun UE450 box, 3x296 with a DAT72 drive. Bear in mind that the data is being written to disk and then spooled to tape. It may work out a fraction slower overall on full backups, but it's usually faster on incrementals/differentials and it really does help in terms of drive wear-and-tear AB --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] The table 'File' is full
27-Jan 00:45 alexandria-dir: LogicBackupAvr32.2006-01-27_00.05.10 Fatal error: sql_create.c:732 sql_create.c:732 insert INSERT INTO File (FileIndex,JobId,PathId,FilenameId,LStat,MD5) VALUES (55527,829,2825202,2033976,'Bc sHVV IGk B Yc Y CwOuQ WvE BAA C4 BD0Kbs BD0Kbs BD2MTW A A C','0') failed: The table 'File' is full I`m running bacula 1.38.2, with standard install besides som alteration in the chio.changer scripts, on a FreeBSD 6.0-RELEASE My MySQL database is 6.8G, while the File.MYD is 4.0G My backup with most files are like this: FD Files Written: 3,876,210 SD Files Written: 3,876,210 FD Bytes Written: 256,133,597,826 SD Bytes Written: 256,774,755,561 And i got ca 10 similar jobs, I have been running since 9/des-2005 How could this happend? Roger Kvam --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: The table 'File' is full
mysql select count(*) from File; +--+ | count(*) | +--+ | 47405618 | +--+ 1 row in set (0.00 sec) Frank Sweetser wrote: On Wed, Feb 01, 2006 at 03:37:11PM +0100, Roger Kvam wrote: 27-Jan 00:45 alexandria-dir: LogicBackupAvr32.2006-01-27_00.05.10 Fatal error: sql_create.c:732 sql_create.c:732 insert INSERT INTO File (FileIndex,JobId,PathId,FilenameId,LStat,MD5) VALUES (55527,829,2825202,2033976,'Bc sHVV IGk B Yc Y CwOuQ WvE BAA C4 BD0Kbs BD0Kbs BD2MTW A A C','0') failed: The table 'File' is full If you start up the mysql client, what does the query select count(*) from File; return? --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] The table 'File' is full
Hi ! Roger Kvam wrote: My MySQL database is 6.8G, while the File.MYD is 4.0G You ran into a mysql-limit there. The File Table apparently uses MyISAM as storage engine and the max-limit there is 4 GB. Fire up mysql-administrator and change the storage engine to InnoDB then you`re fine. (On my system i changed all tables to InnoDB - just in case). Best regards, -- Daniel HoltkampRiege Software International GmbH System Administration Mollsfeld 10 40670 Meerbusch, Germany Phone: +49-2159-9148-41 mail: holtkamp [at] riege.comFax: +49-2159-9148-11 --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: The table 'File' is full
What will happend to the MyISAM file, will it be converted, or just left behind an I need to start my backups from scratch? Roger Kvam Daniel Holtkamp wrote: Hi ! Roger Kvam wrote: My MySQL database is 6.8G, while the File.MYD is 4.0G You ran into a mysql-limit there. The File Table apparently uses MyISAM as storage engine and the max-limit there is 4 GB. Fire up mysql-administrator and change the storage engine to InnoDB then you`re fine. (On my system i changed all tables to InnoDB - just in case). Best regards, --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] include all dot-files from $HOME
Stephan Holl wrote:
Hello Phil,
On Tue, 31 Jan 2006 15:07:35 -0500 Phil Stracchino
[EMAIL PROTECTED] wrote:
Stephan Holl wrote:
I am trying to implement all dot-files into a fileset. but cannot
manage it correctly. Perhaps someone has done that successfully.
# TEST-fileset
FileSet {
Name = testfileset
Include {
Options {
wildfile = *.
}
Options {
Exclude = yes
RegexFile = .?*$
}
File=/home/user
}
}
Perhaps anybody has done this kind of task successfully, because I
do not have any luck using regex.
I'm not sure why you'd want JUST the dotfiles, but the usual Unix
shell regex for selecting dotfiles and ONLY dotfiles is: .??*
Thanks for that. I will give it a try asap. So only files, no
dot-folders I guess.
As I am an apsolute RegEx-Dummy, I would kindly ask you to help out
here.
Perhaps my choice of words was misleading. In the Unix shell, the regex
.??* will select any file OR FOLDER whose name begins with a dot and
then contains at least two additional characters. This regex is
typically ised to select all dotfiles (and folders) without also
selecting . and .. at the same time.
The same principle should be applicable to a Bacula file selection regex.
I am curious, though, why you want to back up the dotfiles, but not any
other contents of the directory.
--
Phil Stracchino [EMAIL PROTECTED]
Renaissance Man, Unix generalist, Perl hacker
Mobile: 603-216-7037 Landline: 603-886-3518
---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: The table 'File' is full
Roger wrote: mysql select count(*) from File; +--+ | count(*) | +--+ | 47405618 | +--+ 1 row in set (0.00 sec) Perhaps InnoDB should be the default MySQL database format in the next Bacula release, Kern? Frank Sweetser wrote: On Wed, Feb 01, 2006 at 03:37:11PM +0100, Roger Kvam wrote: 27-Jan 00:45 alexandria-dir: LogicBackupAvr32.2006-01-27_00.05.10 Fatal error: sql_create.c:732 sql_create.c:732 insert INSERT INTO File (FileIndex,JobId,PathId,FilenameId,LStat,MD5) VALUES (55527,829,2825202,2033976,'Bc sHVV IGk B Yc Y CwOuQ WvE BAA C4 BD0Kbs BD0Kbs BD2MTW A A C','0') failed: The table 'File' is full If you start up the mysql client, what does the query select count(*) from File; return? --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Dominic Marks --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] The table 'File' is full
is there no performance impact ? innodb is not that good at inserting data ... Le Mercredi 01 Février 2006 16:08, Daniel Holtkamp a écrit : Hi ! Roger Kvam wrote: My MySQL database is 6.8G, while the File.MYD is 4.0G You ran into a mysql-limit there. The File Table apparently uses MyISAM as storage engine and the max-limit there is 4 GB. Fire up mysql-administrator and change the storage engine to InnoDB then you`re fine. (On my system i changed all tables to InnoDB - just in case). Best regards, --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid3432bid#0486dat1642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: The table 'File' is full
On Wed, Feb 01, 2006 at 05:06:38PM -, Dominic Marks wrote: Perhaps InnoDB should be the default MySQL database format in the next Bacula release, Kern? And if so, perhaps also consider enabling foreign key constraints? This would eliminate 90% of the work that dbcheck currently has to do... -- Frank Sweetser fs at wpi.edu | For every problem, there is a solution that WPI Network Engineer | is simple, elegant, and wrong. - HL Mencken GPG fingerprint = 6174 1257 129E 0D21 D8D4 E8A3 8E39 29E3 E2E8 8CEC --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Drive Compatibility Question
Hi there, We are looking into purchasing an LoaderXpress LTO2 11 tape changer drive and was wondering if anyone has had any experience working with this unit within Bacula. From reading the docs I can see there is support for LTO2 drives, but no mention on this specific model, if you need some more info, here's a link.. http://overlandstorage.com/products/loaderxpress.html# Thanks, Wm --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] bacula restores
All, We have run our first full backup of our data server, and we are in the process of restoring the entire system to a temporary drive. Everything is going great, although when bconsole goes to grab all of the files (before we are able to mark the ones that we want), it take 10-15 minutes before we can mark any files. A full backup consists of 803.4 GB and about 10 million file. mysql select count(*) from File; +--+ | count(*) | +--+ | 9978625 | +--+ 1 row in set (0.00 sec) Currently, with just this full backup (no incrementals yet), the size of the database is 1.7 GB. While the query is executing, bacula-dir consumes over 2GB of memory, then the building of the file tree takes another 600MB. We are planning to keep a record of full backups for a year, and with the current growth rate of the database, it will likely get quite large indeed. The foreseen problem here is that as the size of our full backups grow, so will the amount of memory that the queries need to run. This will pose the biggest problem for situations where a use wants to restore just a few files. Also, the current query takes up almost all of the 1 GB of memory plus 2 GB of swap. The system is a dual PIII-800 with 1G of RAM. Are there people out there restoring a similar size/number of files? If so, I would like to hear what hardware you are running. On the other hand, once the file tree is built, marking files is relatively quick. The restore begins almost as soon as the job is started, whereas our current backup manager (Networker) takes over 12 hours to select all of the files it is going to need, then dies because it has lost its connection to the client. So my question to the community is: Is there any way to speed up the building of the initial file tree? Or is there way of limiting the query size? Best Regards, Ryan Sizemore --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: bacula restores
I had the exact same problem, running out of free memory while having 2GB installed, I had to split the backups into 10 separate jobs, where the biggest consist of 3,8M files and 250GB data, and even this takes a lot of time on my dual xenon system with fibre channels and scsi disks, while building the directory tree. (and please notice the problem I posted earlier to day, where File tables was full) Roger Kvam Ryan Sizemore wrote: All, We have run our first full backup of our data server, and we are in the process of restoring the entire system to a temporary drive. Everything is going great, although when bconsole goes to grab all of the files (before we are able to mark the ones that we want), it take 10-15 minutes before we can mark any files. A full backup consists of 803.4 GB and about 10 million file. mysql select count(*) from File; +--+ | count(*) | +--+ | 9978625 | +--+ 1 row in set (0.00 sec) Currently, with just this full backup (no incrementals yet), the size of the database is 1.7 GB. While the query is executing, bacula-dir consumes over 2GB of memory, then the building of the file tree takes another 600MB. We are planning to keep a record of full backups for a year, and with the current growth rate of the database, it will likely get quite large indeed. The foreseen problem here is that as the size of our full backups grow, so will the amount of memory that the queries need to run. This will pose the biggest problem for situations where a use wants to restore just a few files. Also, the current query takes up almost all of the 1 GB of memory plus 2 GB of swap. The system is a dual PIII-800 with 1G of RAM. Are there people out there restoring a similar size/number of files? If so, I would like to hear what hardware you are running. On the other hand, once the file tree is built, marking files is relatively quick. The restore begins almost as soon as the job is started, whereas our current backup manager (Networker) takes over 12 hours to select all of the files it is going to need, then dies because it has lost its connection to the client. So my question to the community is: Is there any way to speed up the building of the initial file tree? Or is there way of limiting the query size? Best Regards, Ryan Sizemore --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] include all dot-files from $HOME
On Wed, 01 Feb 2006 11:03:36 -0500, Phil Stracchino [EMAIL PROTECTED]
said:
Stephan Holl wrote:
Hello Phil,
On Tue, 31 Jan 2006 15:07:35 -0500 Phil Stracchino
[EMAIL PROTECTED] wrote:
Stephan Holl wrote:
I am trying to implement all dot-files into a fileset. but cannot
manage it correctly. Perhaps someone has done that successfully.
# TEST-fileset
FileSet {
Name = testfileset
Include {
Options {
wildfile = *.
}
Options {
Exclude = yes
RegexFile = .?*$
}
File=/home/user
}
}
Perhaps anybody has done this kind of task successfully, because I
do not have any luck using regex.
I'm not sure why you'd want JUST the dotfiles, but the usual Unix
shell regex for selecting dotfiles and ONLY dotfiles is: .??*
Thanks for that. I will give it a try asap. So only files, no
dot-folders I guess.
As I am an apsolute RegEx-Dummy, I would kindly ask you to help out
here.
Perhaps my choice of words was misleading. In the Unix shell, the regex
.??* will select any file OR FOLDER whose name begins with a dot and
then contains at least two additional characters. This regex is
typically ised to select all dotfiles (and folders) without also
selecting . and .. at the same time.
Right, but I don't think Bacula needs that botch because it doesn't match
against . or .. as a filename. Moreover, it matches the whole path, so I
think following will work:
Options {
# include all files starting with a dot
wildfile = */.*
}
Options {
# exclude everything else
wildfile = *
exclude = yes
}
Note that this also matches all directories. This is necessary if you want to
find non top-level dot files, because the file tree is walked recursively and
so excluding directory /foo/bar would prevent it from considering
/foo/bar/.my-dot-file at all.
BTW, I would avoid calling these things regexes, because it just confuses them
with RegexFile which uses the more traditional regex syntax (not shell
syntax)!
__Martin
---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] include all dot-files from $HOME
Hello,
On 2/1/2006 5:03 PM, Phil Stracchino wrote:
Stephan Holl wrote:
Hello Phil,
On Tue, 31 Jan 2006 15:07:35 -0500 Phil Stracchino
[EMAIL PROTECTED] wrote:
Stephan Holl wrote:
I am trying to implement all dot-files into a fileset. but cannot
manage it correctly. Perhaps someone has done that successfully.
# TEST-fileset
FileSet {
Name = testfileset
Include {
Options {
wildfile = *.
}
Options {
Exclude = yes
RegexFile = .?*$
As has been pointed out before, this is broken. An unescaped . means
anything, ? is IIRC one or none of the characters before, * means
any number of the characters before, and $ is the end-of-line
indicator. So, '.?*' will not work.
}
File=/home/user
}
}
Perhaps anybody has done this kind of task successfully, because I
do not have any luck using regex.
I'm not sure why you'd want JUST the dotfiles, but the usual Unix
shell regex for selecting dotfiles and ONLY dotfiles is: .??*
Thanks for that. I will give it a try asap. So only files, no
dot-folders I guess.
As I am an apsolute RegEx-Dummy, I would kindly ask you to help out
here.
Perhaps my choice of words was misleading. In the Unix shell, the regex
.??* will select any file OR FOLDER whose name begins with a dot and
then contains at least two additional characters. This regex is
typically ised to select all dotfiles (and folders) without also
selecting . and .. at the same time.
The same principle should be applicable to a Bacula file selection regex.
By the way, the shell expansion does not use regular expressions...
To select only stuff starting with a dot, in a regular expression you
should write '\.[^\.].+'. Unless I'm wrong, of course :-)
That RE would be spelled like take everything which starts with a dot,
and is followed by one character which is not a dot, and is followed by
at least one character.
Keep in mind that I, too, am not exactly an expert with REs and usually
need lots of trial-and-error...
I am curious, though, why you want to back up the dotfiles, but not any
other contents of the directory.
Me too...
Arno
--
IT-Service Lehmann[EMAIL PROTECTED]
Arno Lehmann http://www.its-lehmann.de
---
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] regular error message ...
Hello, On 2/1/2006 1:55 PM, Florian Schnabel wrote: i still didn't find a reason for my problem ... bacula prunes old jobs, then i get an error no volume available, THEN the volume gets recycled and backup starts Well, this kind of confirms my suspicion that Baculas recycling algorithm could be improved; I suspect that it first prunes volumes, then jobs and files, and thus only prunes volumes during the next recycling run. i'll attach the messages, maybe someone can help me with that; i don't really like to get an error message every couple days Quite understandable. The easy work-around, and the reason why I usually don't see that problem, might be to simply set up your volumes and retention so that you always have a pruned volume available. Florian --- 31-Jan 21:00 erde-dir: Start Backup JobId 1108, Job=Cetus_Job.2006-01-31_21.00.00 31-Jan 21:00 erde-dir: Max configured use duration exceeded. Marking Volume HD03 as Used. 31-Jan 21:01 erde-dir: Pruned 6 Jobs on Volume HD01 from catalog. 31-Jan 21:01 erde-sd: Job Cetus_Job.2006-01-31_21.00.00 waiting. Cannot find any appendable volumes. Please use the label command to create a new Volume for: Storage: FileStorage Media type: File Pool: DaylyPool 31-Jan 22:01 erde-dir: Recycled volume HD01 One hour later - the next regular try to find a usable volume, I guess. 31-Jan 22:02 erde-sd: Recycled volume HD01 on device /opt/baculaHD, all previous data lost. erde-dir? An older standard SuSE installation? Arno --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- IT-Service Lehmann[EMAIL PROTECTED] Arno Lehmann http://www.its-lehmann.de --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] include all dot-files from $HOME
Arno Lehmann wrote: By the way, the shell expansion does not use regular expressions... To select only stuff starting with a dot, in a regular expression you should write '\.[^\.].+'. Unless I'm wrong, of course :-) That RE would be spelled like take everything which starts with a dot, and is followed by one character which is not a dot, and is followed by at least one character. That's not a bad port of the intent of the standard Unix shell glob trick. Of course, were someone to name a file simply .a, both it and the Unix globbing trick would fail. And, unfprtunately, it is not compliant with the rules of POSIX extended regexes. To catch ALL dotfiles in Bacula, where . and .. are not concerns, one could simply use the following regex: '^\..*' which would denote any filename beginning with a literal . followed by zero or more additional characters. In a more general environment where . and .. are concerns and we don't want recursive selection of current and parent directories, the problem is more complex. We want to accept filenames beginning with a dot and having at least one additional character, with the restriction that the second character may not also be a dot. That would look something like this: '^\.([^.]|\..).*$' Note that there is NOT a \ escaping the . in the bracket expression. This is because matching rules are different within POSIX bracket expressions. Quoting from regex.3: To include a literal `]' in the list, make it the first character (following a possible `^'). To include a lit- eral `-', make it the first or last character, or the sec- ond endpoint of a range. To use a literal `-' as the first endpoint of a range, enclose it in `[.' and `.]' to make it a collating element (see below). With the excep- tion of these and some combinations using `[' (see next paragraphs), all other special characters, including `\', lose their special significance within a bracket expres- sion. The important part of that, for our purpose, is the last sentence, because it means that within a [] pair, a \ is just a \, a . is just a ., a psi is just a psi[1]. So not only is it impossible to escape the dot within a bracket expression but, fortunately, we don't need to. So, the above expression can be read as thus: ^\.Match anything which begins with a literal . ( followed by EITHER [^.] a character which is not a literal . |\.. OR a second literal . followed by ANY character ) (end of the EITHER-OR part) .* followed by ANY ZERO OR MORE additional characters $ and then ends. [1] It'll all become clear, as time goes by. -- Phil Stracchino [EMAIL PROTECTED] Renaissance Man, Unix generalist, Perl hacker Mobile: 603-216-7037 Landline: 603-886-3518 --- This SF.net email is sponsored by: Splunk Inc. Do you grep through log files for problems? Stop! Download the new AJAX search engine that makes searching your log files as easy as surfing the web. DOWNLOAD SPLUNK! http://sel.as-us.falkag.net/sel?cmd=lnkkid=103432bid=230486dat=121642 ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
