Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
Although it will generate lots output, have you tried turning on
debugging on the DIR and SD to see if anything shows up there?
On 2/6/2012 8:15 PM, mark.berg...@uphs.upenn.edu wrote:
In the message dated: Mon, 06 Feb 2012 12:43:41 GMT,
The pithy ruminations from Martin Simmons on
Re: [Bacula-users] critical error -- tape labels get corrupted, previous
backu
ps unreadable were:
Martin,
Thanks again for continuing to respond...I appreciate the feedback and
troubleshooting help.
=On Fri, 03 Feb 2012 20:04:44 -0500, mark bergman said:
=
=I've added more logging to /etc/init.d/bacula-sd to confirm when tapes
are
=ejected and to timestamp the SCSI release commands.
=
=Is it possible that bacula flagged tapes 003231 and 000312 as being in
=the drives because they were loaded when the server crashed, even
though
=they were later ejected (outside of bacula's control)? Could this cause
=bacula to believe that the tapes were at EOT when they do get loaded,
and
=bacula then immediately begins writing (corrupting the label)?
[Unlikely
=that bacula would try to write before reading the label, and would then
=read the label after corrupting the tapes.]
=
= I don't see how this could happen. Bacula issues a rewind command when it
I don't see how it could happen eitherbut I'm searching for any
explanation.
= mounts a tape and should then know that the tape is at the start.
That's what I'd expect too.
=
=
=When the current backup is finished, I'll extract the beginning data
=on each of 003231 and 000312. Is there anything you recommend in terms
=of checking the data on tape to determine whether the tape begins with
=random garbage (possibly caused by the shutdown, startup, scsi reset,
=etc.) or if it begins with valid bacula data that happened to overwrite
=the label instead of being appended?
=
= Do you have a File device defined in the SD? If so, label a new File
volume
No.
= and then append the data from the start of the tape to the end of the file
= volume using dd and cat. You can then examine the file volume using bls
-v -j
= (the File label will allow bls to read it).
Can I do this against a tape directly?
=
=
=Does anyone have suggestions of how to troubleshoot this further,
=or how to make the daemon startup process more resistant to causing
=any corruption?
=
= The important information missing is whether 000312 was already corrupted
at
= 01-Feb 20:11. You could add some commands to the startup part of
HmmmThe only way that I could imagine that happening is if:
bacula loads the tape as needed
bacula reads the volume label
{somehow the tape is rewound, either when the tape is first loaded, or
after some backups are written}
bacula writes to tape
The only thing outside of bacula that touches the tape drive in any way is the
/etc/init.d/bacula-sd script, which unloads any tapes before starting the
daemon after shutting down the daemon.
= /etc/init.d/bacula-sd script before it unloads all tapes. E.g. do mt
status,
= mt rewind and grab a copy of the first few blocks on any loaded tapes.
Sure. I'm thinking that I may modify /opt/bacula/scripts/mtx-changer to
replace the unload operation with:
mt rewind
dd if=$TAPE of=/opt/bacula/working/dump_$VOLUMEID.`date '+%Y-%m-%d_%T'`
ibs=64k count=1024
mtx -f $ctl load $slot $drive
Is that a suitable number of blocks to dump? I've got the dumps from 5
corrupted tapes, and I'm trying to see if they have anything in common (for
example, maybe the first 128k is corrupted, followed by valid data from dumps
that should have been appended to the tape).
=
= Also, you say that infrastructure1 server crashes. Maybe the crash
caused the
= tape to be rewound and some buffer flushed to start of the tape?
I can't see how...
if there was unwritten data in a buffer within the memory of the
server infrastructure1, then when the server crashes it wouldn't
get written to tape. The 'infrastucture' machines are part of
an HA cluster...in this crash, the other nodes determined that
infrastructure1 had lost communication with the quorum disk,
and they powered off the node...even if that action reset the
fibre loop and caused the tape library to rewind both tapes
(unlikely), I don't know how any buffers on the infrastructure1
server could be written when the power was out.
if there was unwritten data in a buffer within the memory of
the tape library, then I believe it must be written before any
rewind command will be honored. If infrastructure1 sends
data to the tape drive, that data is buffered, infrastructure1 then
crashes, infrastructure2 runs /etc/init.d/bacula-sd (which ejects tapes,
thereby rewinding them)...the
[Bacula-users] FD behind NAT
Forgive me if this has been asked and answered. I have a client (FD) behind NAT and I am look for ways to initiate backup jobs from the server without port forwarding on the client side. I have read numerous articles of how to resolve issues with the server (DIR/SD) being behind NAT but to me this is easy. I have even looked over the Dealing with Firewalls section of the manual. In order for bacula to work Dir must be able to contact FD to tell it to start the backup. Port forwarding is not an option as we have numerous clients, Linux and Windows, behind NAT and we cannot assign an external IP to each internal FD. To me this means I have to have a site-to-site VPN tunnel or clients each running OpenVPN for example. I am hoping somone can point me towards something I missed. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FD behind NAT
As you already said, you could use a site-to-site vpn. I don't know your network, but if a non-openvpn site-to-site vpn would works, I guess you could also use one openvpn instance on both sides to establish a site-to-site connection. Or you could nat multiple ports to multiple clients. For example: your offical IP is 123.123.123.123. your internal clients have the IPs 192.168.0.1, 192.168.0.2, 192.168.0.3, 192.168.0.4. You then could nat 123.123.123.123:9111 to 192.168.0.1, 123.123.123.123:9112 to 192.168.0.2, 123.123.123.123:9113 to 192.168.0.3, 123.123.123.123:9114 to 192.168.0.4 ... Personally I would definitely recommend a site-to-site vpn! Kind regards Julian -Ursprüngliche Nachricht- Von: Christopher Geegan [mailto:cgee...@infosecur.biz] Gesendet: Dienstag, 7. Februar 2012 18:56 An: bacula-users Betreff: [Bacula-users] FD behind NAT Forgive me if this has been asked and answered. I have a client (FD) behind NAT and I am look for ways to initiate backup jobs from the server without port forwarding on the client side. I have read numerous articles of how to resolve issues with the server (DIR/SD) being behind NAT but to me this is easy. I have even looked over the Dealing with Firewalls section of the manual. In order for bacula to work Dir must be able to contact FD to tell it to start the backup. Port forwarding is not an option as we have numerous clients, Linux and Windows, behind NAT and we cannot assign an external IP to each internal FD. To me this means I have to have a site-to-site VPN tunnel or clients each running OpenVPN for example. I am hoping somone can point me towards something I missed. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FD behind NAT
On Tue, Feb 7, 2012 at 12:55 PM, Christopher Geegan cgee...@infosecur.biz wrote: Forgive me if this has been asked and answered. I have a client (FD) behind NAT and I am look for ways to initiate backup jobs from the server without port forwarding on the client side. I have read numerous articles of how to resolve issues with the server (DIR/SD) being behind NAT but to me this is easy. I have even looked over the Dealing with Firewalls section of the manual. In order for bacula to work Dir must be able to contact FD to tell it to start the backup. Port forwarding is not an option as we have numerous clients, Linux and Windows, behind NAT and we cannot assign an external IP to each internal FD. To me this means I have to have a site-to-site VPN tunnel or clients each running OpenVPN for example. I am hoping somone can point me towards something I missed. The director needs initiate a connection to the FD and the FD needs initiate a communication channel to the SD. If you can not port forward you can use a vpn tunnel for this. John -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] FD behind NAT
Hi! With *nix machines you can use a sshtunnel! http://wiki.bacula.org/doku.php?id=sshtunnel Working for me in three vps servers flawessly! J. 2012/2/7 Christopher Geegan cgee...@infosecur.biz: Forgive me if this has been asked and answered. I have a client (FD) behind NAT and I am look for ways to initiate backup jobs from the server without port forwarding on the client side. I have read numerous articles of how to resolve issues with the server (DIR/SD) being behind NAT but to me this is easy. I have even looked over the Dealing with Firewalls section of the manual. In order for bacula to work Dir must be able to contact FD to tell it to start the backup. Port forwarding is not an option as we have numerous clients, Linux and Windows, behind NAT and we cannot assign an external IP to each internal FD. To me this means I have to have a site-to-site VPN tunnel or clients each running OpenVPN for example. I am hoping somone can point me towards something I missed. -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users -- _ Francisco Javier Funes Nieto [esen...@gmail.com] CANONIGOS Servicios Informáticos para PYMES. Cl. Cruz 2, 1º Oficina 7 Tlf: 958.536759 / 661134556 Fax: 958.521354 GRANADA - 18002 -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] missing a file during verification
On Mon, 6 Feb 2012 17:48:51 -0800, Doug Sampson said: I've outputted a list of files from this and compared with the bls output. Even though the bconsole 'list' files reports 989 lines, there are actually only 988 lines as far as I can determine. The output between the bls output and the list output is identical in every respect except for the lines of output reported by each. 988 versus 989. Is this a VSS error? It looks like a bug/misfeature in verify of a VSS job. The problem is that the count of files in a VSS backup includes a special object called job_metadata.xml, but this isn't a real file so verify can't find it. I'm not convinced that VolumeToCatalog verify can be used reliably with VSS jobs anyway though, because it will be verifying the current state rather than the snapshot. That can lead to false mismatches, even without the job_metadata.xml issue. __Martin -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] critical error -- tape labels get corrupted, previous backups unreadable
On Mon, 06 Feb 2012 20:15:10 -0500, mark bergman said:
In the message dated: Mon, 06 Feb 2012 12:43:41 GMT,
The pithy ruminations from Martin Simmons on
Re: [Bacula-users] critical error -- tape labels get corrupted, previous
backu
ps unreadable were:
=
=
= When the current backup is finished, I'll extract the beginning data
= on each of 003231 and 000312. Is there anything you recommend in terms
= of checking the data on tape to determine whether the tape begins with
= random garbage (possibly caused by the shutdown, startup, scsi reset,
= etc.) or if it begins with valid bacula data that happened to overwrite
= the label instead of being appended?
=
= Do you have a File device defined in the SD? If so, label a new File
volume
No.
= and then append the data from the start of the tape to the end of the file
= volume using dd and cat. You can then examine the file volume using bls
-v -j
= (the File label will allow bls to read it).
Can I do this against a tape directly?
You could try copying the data from a freshly labeled tape, appending the data
from the start of the bad tape and then writing it back the start of another
tape.
It would be much simpler to add the File device though.
=
=
= Does anyone have suggestions of how to troubleshoot this further,
= or how to make the daemon startup process more resistant to causing
= any corruption?
=
= The important information missing is whether 000312 was already corrupted
at
= 01-Feb 20:11. You could add some commands to the startup part of
HmmmThe only way that I could imagine that happening is if:
bacula loads the tape as needed
bacula reads the volume label
{somehow the tape is rewound, either when the tape is first loaded, or
after some backups are written}
bacula writes to tape
Yes.
The only thing outside of bacula that touches the tape drive in any way is the
/etc/init.d/bacula-sd script, which unloads any tapes before starting the
daemon after shutting down the daemon.
= /etc/init.d/bacula-sd script before it unloads all tapes. E.g. do mt
status,
= mt rewind and grab a copy of the first few blocks on any loaded tapes.
Sure. I'm thinking that I may modify /opt/bacula/scripts/mtx-changer to
replace the unload operation with:
mt rewind
dd if=$TAPE of=/opt/bacula/working/dump_$VOLUMEID.`date '+%Y-%m-%d_%T'`
ibs=64k count=1024
mtx -f $ctl load $slot $drive
Is that a suitable number of blocks to dump?
Yes, that should be plenty.
=
= Also, you say that infrastructure1 server crashes. Maybe the crash caused
the
= tape to be rewound and some buffer flushed to start of the tape?
I can't see how...
if there was unwritten data in a buffer within the memory of the
server infrastructure1, then when the server crashes it wouldn't
get written to tape. The 'infrastucture' machines are part of
an HA cluster...in this crash, the other nodes determined that
infrastructure1 had lost communication with the quorum disk,
and they powered off the node...even if that action reset the
fibre loop and caused the tape library to rewind both tapes
(unlikely), I don't know how any buffers on the infrastructure1
server could be written when the power was out.
if there was unwritten data in a buffer within the memory of
the tape library, then I believe it must be written before any
rewind command will be honored. If infrastructure1 sends
data to the tape drive, that data is buffered, infrastructure1 then
crashes, infrastructure2 runs /etc/init.d/bacula-sd (which ejects tapes,
thereby rewinding them)...the data within the buffer in the tape
drive would still be written before the rewind/eject command was
executed.
Yes, that would be true in an ideal world. OTOH, it probably depends on the
nature of the crash. All kinds of undesirable things might happen before the
crash itself (including SCSI resets etc).
__Martin
--
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Windows Bacula server
Hi, I'm trying to setup a Bacula backup server (5.2.5) and was wondering if someone can help me with a couple of questions. 1. Its running on windows 2008 server, are there any install videos or tutorials you can suggest? 2. Has anyone noticed that the windows install no longer has a server option and seems to want to install a client only? 3. Does anyone know of any automated bacula config file generators? Thank you, Manny image001.png-- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Windows Bacula server
I’m trying to setup a Bacula backup server (5.2.5) and was wondering if someone can help me with a couple of questions. 1. Its running on windows 2008 server, are there any install videos or tutorials you can suggest? I do not know of any windows videos. There are a few freebsd / linux install tutorials however. 2. Has anyone noticed that the windows install no longer has a “server” option and seems to want to install a client only? The developers have removed the server from the windows downloads because it is no longer tested. 3. Does anyone know of any automated bacula config file generators? webmin has a bacula module. John -- Keep Your Developer Skills Current with LearnDevNow! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-d2d ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
