Re: [Bacula-users] how to debug a job
Hello, 2015-01-22 3:42 GMT+01:00 Dimitri Maziuk dmaz...@bmrb.wisc.edu: On 01/21/2015 06:41 PM, Bill Arlofski wrote: Bacula has a hard-coded 6 day limit on a job's run time. 518401 seconds = 6.1157 days, so it appears that is the cause for the watchdog killing the job. Hard-coded, huh? Nobody's tried backing up that big data I keep hearing about? Yes, but nobody was interested in changing it to the config parameter. It is possible that someone did that in 7.x, I need to check. Does it ask you for a new volume? No. Good guess, but the storage is a vchanger and it's working just fine. If you are using a vchanger then I guess it is a disk only backup, so why do you spool data? It is not required but making you backup slow down at least 2 times then standard job. You can define an attributes spooling only. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 01/23/2015 09:57 AM, Josh Fisher wrote: ... Have you been able to determine what exactly is slow? I wonder if when the data spool file gets full it triggers a de-spool of both data and attributes, rather than just data? Look like there's something wrong with the spool disk: I replaced it and all 10 clients (1TB+) got backed up overnight. (The whole thing has still failed, though, because make_catalog_backup is no longer there in 5.2.13 and what's there seemingly can't handle @ includes in bacula-dir.conf, but that's an easy fix.) Thanks everyone who replied, -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 01/23/2015 01:33 PM, Heitor Faria wrote: Even though, IMHO, spooling disks backup is just muda (Japanese Term): http://en.wikipedia.org/wiki/Muda_(Japanese_term) shrug/ so are proxies and caching: spool disk is just a variation on that theme. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 01/23/2015 12:22 PM, Radosław Korzeniewski wrote: If you are using a vchanger then I guess it is a disk only backup, so why do you spool data? It is not required but making you backup slow down at least 2 times then standard job. It's 2 times slower if your spool/despool is strictly sequential and the same size pipes go in and out. If you have 10 clients spooling over a 1Gb/s link, that's roughly 10MB/s/client. Iostat clocks ext4/basic sata drives at around 110MB/s write speed, so despooling is 10 times faster. If only the clients could keep the pipe full, it could be ~10 times faster than the standard job. In a purely hypothetical perfectly spherical world of uniform density, obviously, but still: no, 2x slow down is not how it really works. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 1/23/2015 2:33 PM, Heitor Faria wrote: On 01/23/2015 12:22 PM, Radosław Korzeniewski wrote: If you are using a vchanger then I guess it is a disk only backup, so why do you spool data? It is not required but making you backup slow down at least 2 times then standard job. It's 2 times slower if your spool/despool is strictly sequential and the same size pipes go in and out. If you have 10 clients spooling over a 1Gb/s link, that's roughly 10MB/s/client. Iostat clocks ext4/basic sata drives at around 110MB/s write speed, so despooling is 10 times faster. If only the clients could keep the pipe full, it could be ~10 times faster than the standard job. In a purely hypothetical perfectly spherical world of uniform density, obviously, but still: no, 2x slow down is not how it really works. Even though, IMHO, spooling disks backup is just muda (Japanese Term): http://en.wikipedia.org/wiki/Muda_(Japanese_term) No. It is not wasteful if it serves a purpose. The goal is to get the client's part in the job done faster. Fast storage is expensive. A shared spool area on fast disk gets the clients part done faster, and then the SD can de-spool to slower (and cheaper) volume file storage without affecting the client. Using spooling for disk volumes is exactly the same reasoning as using it for tape volumes. -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 01/23/2015 02:33 PM, Radosław Korzeniewski wrote: No, it is not working as you described. Data spooling will read stream from the client, then write it to the temporary disk file, then during despool it is stopping a stream from the client, reads a temporary file and write to destination volume. A standard job will never stop reading a stream and direct write data to the volume. Read the last bulletpoint under Other considerations in http://www.bacula.org/5.2.x-manuals/en/main/main/Data_Spooling.html#SECTION00313 Then read 10 clients again. -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signature.asc Description: OpenPGP digital signature -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
Even though, IMHO, spooling disks backup is just muda (Japanese Term): http://en.wikipedia.org/wiki/Muda_(Japanese_term) Not necessarily - if you have a number of backups that tend to flake out halfway through for whatever reasons (network, client issues, user issues, etc) e.g. then by spooling backups and then de-spooling sequentially to disk you save your disk volumes from filling up with unnecessary cruft - which depending on how everything is configured for you could cause problems. If the community version could restart backups from an aborted point then this probably wouldn't be a potential issue. cheers, --tom -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 01/23/2015 12:22 PM, Radosław Korzeniewski wrote: If you are using a vchanger then I guess it is a disk only backup, so why do you spool data? It is not required but making you backup slow down at least 2 times then standard job. It's 2 times slower if your spool/despool is strictly sequential and the same size pipes go in and out. If you have 10 clients spooling over a 1Gb/s link, that's roughly 10MB/s/client. Iostat clocks ext4/basic sata drives at around 110MB/s write speed, so despooling is 10 times faster. If only the clients could keep the pipe full, it could be ~10 times faster than the standard job. In a purely hypothetical perfectly spherical world of uniform density, obviously, but still: no, 2x slow down is not how it really works. Even though, IMHO, spooling disks backup is just muda (Japanese Term): http://en.wikipedia.org/wiki/Muda_(Japanese_term) Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu Regards, == Heitor Medrado de Faria - LPIC-III | ITIL-F Jan. 26 - Fev. 06 - Novo Treinamento Telepresencial Bacula: http://www.bacula.com.br/?p=2174 61 8268-4220 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: heitorfa...@gmail.com === -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
Hello, 2015-01-23 20:04 GMT+01:00 Dimitri Maziuk dmaz...@bmrb.wisc.edu: On 01/23/2015 12:22 PM, Radosław Korzeniewski wrote: If you are using a vchanger then I guess it is a disk only backup, so why do you spool data? It is not required but making you backup slow down at least 2 times then standard job. It's 2 times slower if your spool/despool is strictly sequential and the same size pipes go in and out. If you have 10 clients spooling over a 1Gb/s link, that's roughly 10MB/s/client. Iostat clocks ext4/basic sata drives at around 110MB/s write speed, so despooling is 10 times faster. I think you should read what a data spooling really is in Bacula. Sorry. It is useful only for tape drives to avoid shoe-sine of tapes. When used with disks it will slow down every backup job, no matter how many of them you will run. If only the clients could keep the pipe full, it could be ~10 times faster than the standard job. No, it is not working as you described. Data spooling will read stream from the client, then write it to the temporary disk file, then during despool it is stopping a stream from the client, reads a temporary file and write to destination volume. A standard job will never stop reading a stream and direct write data to the volume. In a purely hypothetical perfectly spherical world of uniform density, obviously, but still: no, 2x slow down is not how it really works. Yes it is. Every job will be slower. I had this kind of setup for tuning and I realized that I can speed up every backup Job when I disable data spooling. You should distinguish between attributes spooling, data spooling and spooling for tapes vs disks. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
Hello, 2015-01-23 20:57 GMT+01:00 Dimitri Maziuk dmaz...@bmrb.wisc.edu: On 01/23/2015 01:33 PM, Heitor Faria wrote: Even though, IMHO, spooling disks backup is just muda (Japanese Term): http://en.wikipedia.org/wiki/Muda_(Japanese_term) shrug/ so are proxies and caching: spool disk is just a variation on that theme. Data spooling is not working like cache or proxy. It is a different mechanism designed only for tapes. If you do not backup to tapes do not use data spooling. best regards -- Radosław Korzeniewski rados...@korzeniewski.net -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Strange bacula-director error
Hi All,
When I try to start bacula-director, I get the following error:
# service bacula-director start
* Starting Bacula Director...
23-Jan 13:14 bacula-dir: ERROR TERMINATION at parse_conf.c:976
Config error: expected an equals, got: {
: line 2, col 9 of file /etc/bacula/conf.d/filesets.conf
FileSet {
...fail!
Ad here is the filesets.conf (lines 1-10)
# This is the backup of the catalog
FileSet {
Name = Catalog
Include {
Options {
signature = SHA1
}
File = /home/backup/bacula.sql
}
}
Can anyone help point me in the right direction?
Thanks,
-John Elliott
*John Elliott*
Security Team Lead / Systems Administrator - A.I.S.
*C*alifornia *C*ollege of the *A*rts
Phone: 415.551.9228
Zoom Personal Meeting URL: https://cca.zoom.us/j/3677415794
technology.cca.edu | Email: jelli...@cca.edu
*For technical support, contact the ETS Helpdesk:*
Phone: 510.594.5010 | Fax: 510.594.3758
helpdesk.cca.edu | Email: helpd...@cca.edu
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Strange bacula-director error
On Fri, Jan 23, 2015 at 4:17 PM, John Elliott jelli...@cca.edu wrote:
Hi All,
When I try to start bacula-director, I get the following error:
# service bacula-director start
* Starting Bacula Director...
23-Jan 13:14 bacula-dir: ERROR TERMINATION at parse_conf.c:976
Config error: expected an equals, got: {
: line 2, col 9 of file /etc/bacula/conf.d/filesets.conf
FileSet {
...fail!
Ad here is the filesets.conf (lines 1-10)
# This is the backup of the catalog
FileSet {
Name = Catalog
Include {
Options {
signature = SHA1
}
File = /home/backup/bacula.sql
}
}
Can anyone help point me in the right direction?
Something wrong with the include before this include of
/etc/bacula/conf.d/filesets.conf ?
John
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-Web 7.0.2 available
Hi Uwe, Thanks for your feedback, it's fully appreciated ... In order to fix your problem, I'll need 3 things from you. 1. Your web server error logs 2. A screenshot of the buggy catalog selector 3. Your config.php file (don't forget to remove sensitive informations) Best regards Davide On Fri, Jan 23, 2015 at 9:09 AM, Uwe Schuerkamp uwe.schuerk...@nionex.net wrote: On Thu, Jan 22, 2015 at 03:48:52PM +0100, Davide Franco wrote: Dear all, I'm really happy to announce that Bacula-Web version 7.0.2 is available from now. This major bugfix / maintenance release fixes 13 bugs (including 3 major bugs). I'd strongly suggest everyone to upgrade to this version as quickly as possible. The release notes will give you more details about what's included in this version. http://www.bacula-web.org/download.html Thanks again to all contributors for your help and your precious feedbacks. As usual, all questions and feedbacks are welcome. Best regards Davide Franco Hello Davide, thanks much for the update. I have a problem with the catalog select button on the top right of the page: we have six catalogs defined there, but while the main page displays the correct statistics, the catalog select button randomly displays some catalog from the list and hardly ever displays the correct catalog that's currently selected. Any idea what could be wrong? (centos 6.x, stock php, bacula-web installed in a separate directory on the webserver). Cheers, Uwe -- nionex GmbH --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Strange bacula-director error
OMG - thank you so much! I'd never have figured that out!
Thanks,
-John Elliott
*John Elliott*
Security Team Lead / Systems Administrator - A.I.S.
*C*alifornia *C*ollege of the *A*rts
Phone: 415.551.9228
Zoom Personal Meeting URL: https://cca.zoom.us/j/3677415794
technology.cca.edu | Email: jelli...@cca.edu
*For technical support, contact the ETS Helpdesk:*
Phone: 510.594.5010 | Fax: 510.594.3758
helpdesk.cca.edu | Email: helpd...@cca.edu
On Fri, Jan 23, 2015 at 2:00 PM, John Drescher dresche...@gmail.com wrote:
On Fri, Jan 23, 2015 at 4:17 PM, John Elliott jelli...@cca.edu wrote:
Hi All,
When I try to start bacula-director, I get the following error:
# service bacula-director start
* Starting Bacula Director...
23-Jan 13:14 bacula-dir: ERROR TERMINATION at parse_conf.c:976
Config error: expected an equals, got: {
: line 2, col 9 of file /etc/bacula/conf.d/filesets.conf
FileSet {
...fail!
Ad here is the filesets.conf (lines 1-10)
# This is the backup of the catalog
FileSet {
Name = Catalog
Include {
Options {
signature = SHA1
}
File = /home/backup/bacula.sql
}
}
Can anyone help point me in the right direction?
Something wrong with the include before this include of
/etc/bacula/conf.d/filesets.conf ?
John
--
New Year. New Location. New Benefits. New Data Center in Ashburn, VA.
GigeNET is offering a free month of service with a new server in Ashburn.
Choose from 2 high performing configs, both with 100TB of bandwidth.
Higher redundancy.Lower latency.Increased capacity.Completely compliant.
http://p.sf.net/sfu/gigenet___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Linux Virtual Tape Library - MHVTL
Just tripped over MHVTL - it may be of interest for test purposes possibly. Seems to be tested with Bacula already. *mhVTL* https://sites.google.com/site/linuxvtl2; *MHVTL - virtuelle Tape Library* http://www.libe.net/index.php/MHVTL; Für Test oder Demozwecke kann mittels MHVTL eine oder mehrere Bandlaufwerke und Roboter simuliert werden. Wer also keine Hardware zur Verfügung hat und dennoch Backupprogramme und deren Verhalten z.B. Medienrotation, Anhängezeit, Überschreibschutz oder Restores testen will, kann dies mit einer VTL (Virtual Tape Library) machen. -- Ralf Brinkmann -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Offsite Storage
On Thu, Jan 22, 2015 at 06:30:01PM +, Damien Hull wrote: I've asked this question before, but I don't think I got enough information. Here's my situation 1. I have three offices in different physical locations. 2. Each location has between 200 GB to well over 1 TB of data. 3. I would like to backup data between offices for offsite storage. 4. I can't wait weeks for data to be copied between offices I know some commercial software allows you to seed the backup. 1. Copy data to an external drive 2. Mail the drive to another office 3. Copy the data over - Your backup is now seeded 4. Backups are now faster because you don't have to copy everything. Can bacula handle this? Thanks! While I'm not entirely sure bacula could handle *all* of this, I'm pretty certain you can come up with a clever solution based on rsync and bacula. It depends on how much data changes on all of the servers involved, but I'd imagine the following setup would be possible (given that disk space is cheap): - seed the backups using a mailed drive / tape on local storage, ideally connected to your local bacula server - rsync changes nightly over to the offsite locations (runbeforjob?) - backup your local file system copies on a local library at the offsite locations, using the local bacula instance All the best, Uwe -- nionex GmbH --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-Web 7.0.2 available
Hello, For those of you who encountered the same problem with Bacula-Web 7.0.1 or 7.0.2, I found a solution to fix it. As of Bacula-Web version 7.0, the selected catalog_id is stored in the user session. So if you modify the config.php and you remove the same catalog that is used in the web ui. So at the next refresh, Bacula-Web will complain that the catalog_id you were using one page before do not exist anymore, that's normal. The solution is simply to clear you browser cache and it's fixed. In a future version of Bacula-Web, I'll improve the code in order to prevent such kind of problem. About the Mantis Bugtracker sign in page problem, I did a test on my side and unfortunately, I got the error below. APPLICATION ERROR #2800 Invalid form security token. This could be caused by a session timeout, or accidentally submitting the form twice. I'll check the web server log, find out what the problem is and submit a bug request to Mantis BT, if it looks like a bug in the code ... Best regards Davide On Thu, Jan 22, 2015 at 6:35 PM, Polcari, Joe (Contractor) joe_polc...@cable.comcast.com wrote: So when changing the config array from 3 hosts to 2 hosts I get this on 7.01 and 7.02: Sorry to the list but the signup on the bug tracking page isn’t working either or I would have reported it there instead. *Notice*: Undefined index: 2 in */var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php* on line *80* *Exception trace* File: */var/www/html/bacula-web-7.0.2/core/bweb.class.php* on line *83* in function *FileConfig::get_Value* File: */var/www/html/bacula-web-7.0.2/test.php* on line *28* in function *Bweb-__construct* *Application error* *File* /var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php *Line* 83 *Exception code* 0 *Exception message* Configuration error: the catalog id 2 do not exist Have you tried to run the test page http://172.21.151.230:888/test.php ? Check the online documentation on Bacula-Web project site http://www.bacula-web.org/ Rebort a bug or suggest a new feature in the Bacula-Web\'s bugtracking tool http://bugs.bacula-web.org/ *Notice*: Trying to get property of non-object in */var/www/html/bacula-web-7.0.2/test.php* on line *65* *Fatal error*: Call to a member function getAttribute() on a non-object in */var/www/html/bacula-web-7.0.2/core/db/cdb.class.php* on line *63* *From:* Davide Franco [mailto:bacula-...@dflc.ch] *Sent:* Thursday, January 22, 2015 9:49 AM *To:* bacula-users@lists.sourceforge.net *Subject:* [Bacula-users] Bacula-Web 7.0.2 available Dear all, I'm really happy to announce that Bacula-Web version 7.0.2 is available from now. This major bugfix / maintenance release fixes 13 bugs (including 3 major bugs). I'd strongly suggest everyone to upgrade to this version as quickly as possible. The release notes http://bacula-web.org/download.html will give you more details about what's included in this version. Thanks again to all contributors for your help and your precious feedbacks. As usual, all questions and feedbacks are welcome. Best regards Davide Franco Project website http://www.bacula-web.org http://bacula-web.org/home.html -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-Web 7.0.2 available
On Thu, Jan 22, 2015 at 03:48:52PM +0100, Davide Franco wrote: Dear all, I'm really happy to announce that Bacula-Web version 7.0.2 is available from now. This major bugfix / maintenance release fixes 13 bugs (including 3 major bugs). I'd strongly suggest everyone to upgrade to this version as quickly as possible. The release notes will give you more details about what's included in this version. http://www.bacula-web.org/download.html Thanks again to all contributors for your help and your precious feedbacks. As usual, all questions and feedbacks are welcome. Best regards Davide Franco Hello Davide, thanks much for the update. I have a problem with the catalog select button on the top right of the page: we have six catalogs defined there, but while the main page displays the correct statistics, the catalog select button randomly displays some catalog from the list and hardly ever displays the correct catalog that's currently selected. Any idea what could be wrong? (centos 6.x, stock php, bacula-web installed in a separate directory on the webserver). Cheers, Uwe -- nionex GmbH --- Ein Unternehmen der Bertelsmann SE Co. KGaA -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 1/22/2015 12:47 PM, Dimitri Maziuk wrote: On 01/22/2015 10:07 AM, Josh Fisher wrote: There is likely no reason to have SpoolData=yes for disk volumes, and it could actually slow things down. On 01/22/2015 07:32 AM, Clark, Patricia A. wrote: Spooling is for the benefit of tape drives and databases. What is the benefit of spooling data for virtual tapes that are really disks? 1. Job interleaving. 2. If you are running multiple simultaneous jobs, Bacula will continue spooling other jobs while one is despooling to tape, provided there is sufficient spool file space. (TFM - Data Spooling - Other points.) 10 clients, (up to) 10 concurrent jobs, vchanger with one device and plenty of pre-labeled 50GB file volumes, 50GB max spool size/job. I use another approach. I define the vchanger to have multiple virtual drives. Then in the bacula-sd.conf Device stanzas for each drive I put MaximumConcurrentJobs=1. This forces a volume file to only be written by one job at a time. So for 10 concurrent jobs there would be 10 virtual drives and so 10 opened volume files. This way is not necessarily better. It depends on several things. For example, if the spool storage is much faster than the volume file storage, then the way you are doing it might get clients finished faster. On the other hand, if they are close in performance, then the way I'm doing it might be better, since there are 10 separate volumes being written and no job has to wait on another except for the attribute de-spooling. Also, with 10 concurrent files, the vchanger can use multiple physical drives by using pools and dividing the jobs amongst them so that concurrent jobs are writing to volume files on different spindles. With either method, attribute spooling is used. The SD always spools attributes for all jobs to the Bacula work directory. De-spooling attributes is single-threaded. So single-thread performance of the work directory storage is important and of course DB storage random write performance is crucial, even with attribute spooling. Another reason for using the multiple open volume file approach is that in some cases it is better to NOT spool attributes. This would be when the DB storage is on fast SSD and direct DB i/o is simply faster than spooling and then de-spooling from spinning disk. In this case, data spooling must be disabled because Bacula forces attribute spooling whenever data spooling is enabled. Is one of the jobs running concurrently with the failing job backing up the machine SD is running on? Yesno: it's not backing up any of the usual suspects (the spool disk, /var/log, var/lib/pgdata, ...) Certainly, the spool directory should not be on the same disk drives that the database is on. Right. Spool is on a separate tler drive. It does look like the spool disk might have been the bottleneck indeed, and the same client failing over and over again was just a coincidence -- perhaps it has more data than the others of its kind. I won't know until more jobs get to run, but so far the manually started full backup looks promising: 100+ MB/s write speed on the spool. I might switch it to xfs with barriers off and/or get an SSD for it. -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 1/23/2015 9:03 AM, Josh Fisher wrote: I use another approach. I define the vchanger to have multiple virtual drives... So for 10 concurrent jobs there would be 10 virtual drives and so 10 opened volume files. My way also keeps the config simple stupid: as long as the backups complete on time that's worth more to me than performance. Dima -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] how to debug a job
On 1/23/2015 10:36 AM, Dmitri Maziuk wrote: On 1/23/2015 9:03 AM, Josh Fisher wrote: I use another approach. I define the vchanger to have multiple virtual drives... So for 10 concurrent jobs there would be 10 virtual drives and so 10 opened volume files. My way also keeps the config simple stupid: as long as the backups complete on time that's worth more to me than performance. Certainly nothing wrong with that. Have you been able to determine what exactly is slow? I wonder if when the data spool file gets full it triggers a de-spool of both data and attributes, rather than just data? If so, then perhaps it is the de-spooling of attributes to the DB that is slow, rather than de-spooling data to volume(s). Dima -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Offsite Storage
On 1/22/2015 1:30 PM, Damien Hull wrote: I’ve asked this question before, but I don’t think I got enough information. Here’s my situation 1.I have three offices in different physical locations. 2.Each location has between 200 GB to well over 1 TB of data. 3.I would like to backup data between offices for offsite storage. 4.I can’t wait weeks for data to be copied between offices I know some commercial software allows you to “seed” the backup. 1.Copy data to an external drive 2.Mail the drive to another office 3.Copy the data over – Your backup is now “seeded” 4.Backups are now faster because you don’t have to copy everything. Can bacula handle this? Yes. Check out the File Deduplication using Base Jobs chapter at http://www.bacula.org/7.0.x-manuals/en/main/File_Deduplication_using_Ba.html and the Virtual Backup chapter at http://www.bacula.org/7.0.x-manuals/en/main/Released_Version_3_0_3_3_0_.html#SECTION00527000. A base job is an initial backup of files that are not likely to change and is used to minimize the number of files that need to be routinely backed up. A virtual backup merges a full backup with one or more subsequent differential and incremental backups to create a new (synthetic) full backup. With these two concepts, the remote sites need only ever do incremental backups. The virtual backup takes place on the main office server only. In many cases the incremental backups are small and so feasible for backing up remote sites over the internet. Of course, you have to do the initial base and full backups at the remote site. For that it is possible to install the Bacula storage daemon on a laptop and use a USB disk for the volume storage. Back at the main office the volumes on the USB drive(s) can be migrated to tapes and copied to other tapes for offsite storage and etc. just like any other backup. Thanks! ** *Damien Hull* IT Manager Tikigaq Corporation 301 W. Northern Lights Blvd., Suite 660 Anchorage, AK 99503 (907) 365-6249 _dhull@tikigaq.com_ TIKIlogo-222x60 -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Bacula-Web 7.0.2 available
Hello all, The issue with Mantis bug tracker for Bacula-Web project is fixed now. Feel free to sign up and add bug report and/or feature request. Mantis Bug Tracker: http://bugs.bacula-web.org Whish you an excellent week-end Best regards Davide On Fri, Jan 23, 2015 at 9:10 AM, Davide Franco bacula-...@dflc.ch wrote: Hello, For those of you who encountered the same problem with Bacula-Web 7.0.1 or 7.0.2, I found a solution to fix it. As of Bacula-Web version 7.0, the selected catalog_id is stored in the user session. So if you modify the config.php and you remove the same catalog that is used in the web ui. So at the next refresh, Bacula-Web will complain that the catalog_id you were using one page before do not exist anymore, that's normal. The solution is simply to clear you browser cache and it's fixed. In a future version of Bacula-Web, I'll improve the code in order to prevent such kind of problem. About the Mantis Bugtracker sign in page problem, I did a test on my side and unfortunately, I got the error below. APPLICATION ERROR #2800 Invalid form security token. This could be caused by a session timeout, or accidentally submitting the form twice. I'll check the web server log, find out what the problem is and submit a bug request to Mantis BT, if it looks like a bug in the code ... Best regards Davide On Thu, Jan 22, 2015 at 6:35 PM, Polcari, Joe (Contractor) joe_polc...@cable.comcast.com wrote: So when changing the config array from 3 hosts to 2 hosts I get this on 7.01 and 7.02: Sorry to the list but the signup on the bug tracking page isn’t working either or I would have reported it there instead. *Notice*: Undefined index: 2 in */var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php* on line *80* *Exception trace* File: */var/www/html/bacula-web-7.0.2/core/bweb.class.php* on line *83* in function *FileConfig::get_Value* File: */var/www/html/bacula-web-7.0.2/test.php* on line *28* in function *Bweb-__construct* *Application error* *File* /var/www/html/bacula-web-7.0.2/application/libs/fileconfig.class.php *Line* 83 *Exception code* 0 *Exception message* Configuration error: the catalog id 2 do not exist Have you tried to run the test page http://172.21.151.230:888/test.php ? Check the online documentation on Bacula-Web project site http://www.bacula-web.org/ Rebort a bug or suggest a new feature in the Bacula-Web\'s bugtracking tool http://bugs.bacula-web.org/ *Notice*: Trying to get property of non-object in */var/www/html/bacula-web-7.0.2/test.php* on line *65* *Fatal error*: Call to a member function getAttribute() on a non-object in */var/www/html/bacula-web-7.0.2/core/db/cdb.class.php* on line *63* *From:* Davide Franco [mailto:bacula-...@dflc.ch] *Sent:* Thursday, January 22, 2015 9:49 AM *To:* bacula-users@lists.sourceforge.net *Subject:* [Bacula-users] Bacula-Web 7.0.2 available Dear all, I'm really happy to announce that Bacula-Web version 7.0.2 is available from now. This major bugfix / maintenance release fixes 13 bugs (including 3 major bugs). I'd strongly suggest everyone to upgrade to this version as quickly as possible. The release notes http://bacula-web.org/download.html will give you more details about what's included in this version. Thanks again to all contributors for your help and your precious feedbacks. As usual, all questions and feedbacks are welcome. Best regards Davide Franco Project website http://www.bacula-web.org http://bacula-web.org/home.html -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA. GigeNET is offering a free month of service with a new server in Ashburn. Choose from 2 high performing configs, both with 100TB of bandwidth. Higher redundancy.Lower latency.Increased capacity.Completely compliant. http://p.sf.net/sfu/gigenet___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
