Re: [Bacula-users] recover partial readable tape

2009-03-05 Thread Arno Lehmann
Hi,

04.03.2009 19:07, Thomas Mueller wrote:
 Is there a way to reassemble the two parts of the file and reread
 them with bacula? i've not found any option like skip file 4 to 20
 with the bextract,bscan,bls tools
 You should use a bootstrap file to that purpose. The easiest way would
 be to initiate a restore from the console, and when all is done, instead
 of starting the job, copy the created bootstrap file and cancel the
 restore. Then, in the bootstrap file, remove all records pointing to
 tape files 5 to 19.

 Alternatively, it's not too big a task to manually write a minimal
 bootstrap file, omitting the files in question.
 
...
 I'd use bls with j, k, L, p and v options to get a better idea of what
 actually is in the resulting volume file.
 
 problem: the tape drive doesn't go over file 4, it's running in circles 
 telling me that it skipped a block but next message telling me again that 
 the same block is beeing skipped (and so on).

Ok... somehow I got the impression that you could fsf' over the 
damaged files... which seems to be obvious as you say you fond that 
later tape files are ok.

 if i do an mt fsf 5 i need to rewind the tape to get access again, else 
 it will print i/o error. 

Ok, for me to really understand what happens we need to go back to the 
shell :-)

When you load that tape, you can fsf to, say, file 21, and the tape 
drive reports the correct position.

But when, with the tape freshly loaded, you read to the end of file 
four, you can't fsf and more, not even fsf'ing 17 files to end up 
beyond the damaged area.

Is that a correct description?

Arno

-- 
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] recover partial readable tape (was: I/O error with quantum lto-4)

2009-03-04 Thread Thomas Mueller
hi

i've found out, that the error on tape is between file 4 and 20. i can 
successfull forward space to file 20 (mt -f /dev/nst0 20). 

reading from file 0 with dd if=/dev/nst0 of=/dev/null bs=64512  works 
until file 4 and 235MB. 

Is there a way to reassemble the two parts of the file and reread them 
with bacula? i've not found any option like skip file 4 to 20 with the 
bextract,bscan,bls tools

i've allready read the first part of the tape to a file and 
tried to read it from there. No luck so far:

bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/
bls: butil.c:282 Using device: /srv/backup/vtl for reading.
04-Mar 16:50 bls JobId 0: Ready to read from volume ARCHIVE- on device 
FileStorage (/srv/backup/vtl).
04-Mar 16:50 bls JobId 0: Error: block.c:275 Volume data error at 0:64511! 
Wanted ID: BB02, got . Buffer discarded.
0 files found.
bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE-

seems that not all data is in correct order. if i do a strings ARCHIVE-:

BB02
Bacula 1.0 immortal
ARCHIVE-
Archive
Backup
LTO-4
backuphost
backuphost-sd
Ver. 2.2.8 26 January 2008
Build Mar 28 2008 17:04:06
...

so BB02 seems to be there.

anybody allready did such a tape reassembling? 

or if any programmer is out there: is it a big task to implement a 
skip file(s) option to the volume utilities?

- Thomas


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] recover partial readable tape

2009-03-04 Thread Arno Lehmann
Hi,

04.03.2009 17:01, Thomas Mueller wrote:
 hi
 
 i've found out, that the error on tape is between file 4 and 20. i can 
 successfull forward space to file 20 (mt -f /dev/nst0 20). 

Good start.

 reading from file 0 with dd if=/dev/nst0 of=/dev/null bs=64512  works 
 until file 4 and 235MB. 
 
 Is there a way to reassemble the two parts of the file and reread them 
 with bacula? i've not found any option like skip file 4 to 20 with the 
 bextract,bscan,bls tools

You should use a bootstrap file to that purpose. The easiest way would 
be to initiate a restore from the console, and when all is done, 
instead of starting the job, copy the created bootstrap file and 
cancel the restore. Then, in the bootstrap file, remove all records 
pointing to tape files 5 to 19.

Alternatively, it's not too big a task to manually write a minimal 
bootstrap file, omitting the files in question.

When restoring, I guess you can expect problems with the files that 
have data partly in the affected tape files, but that might still be 
better than getting back nothing at all.

 i've allready read the first part of the tape to a file and 
 tried to read it from there. No luck so far:
 
 bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/
 bls: butil.c:282 Using device: /srv/backup/vtl for reading.
 04-Mar 16:50 bls JobId 0: Ready to read from volume ARCHIVE- on device 
 FileStorage (/srv/backup/vtl).
 04-Mar 16:50 bls JobId 0: Error: block.c:275 Volume data error at 0:64511! 
 Wanted ID: BB02, got . Buffer discarded.
 0 files found.
 bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE-
 
 seems that not all data is in correct order. if i do a strings ARCHIVE-:

I'd use bls with j, k, L, p and v options to get a better idea of what 
actually is in the resulting volume file.

 BB02
 Bacula 1.0 immortal
 ARCHIVE-
 Archive
 Backup
 LTO-4
 backuphost
 backuphost-sd
 Ver. 2.2.8 26 January 2008
 Build Mar 28 2008 17:04:06
 ...
 
 so BB02 seems to be there.

But we don't know if it'S in the right place, i.e. where Bacula 
expects the header data...

 anybody allready did such a tape reassembling? 

Well... kind of.

Not with tape files unreadable, but with extra or missing EOF marks. 
It's not exactly fun, but better than losing data in most cases :-)

 or if any programmer is out there: is it a big task to implement a 
 skip file(s) option to the volume utilities?

I guess you'll get a response similar to manually edit the bootstrap 
file; the feature doesn't seem to be critical to most users, so we 
won't invest much there as long as more pressing projects are pending.

Arno

 - Thomas
 
 
 --
 Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
 -OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
 -Strategies to boost innovation and cut costs with open source participation
 -Receive a $600 discount off the registration fee with the source code: SFAD
 http://p.sf.net/sfu/XcvMzF8H
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
 

-- 
Arno Lehmann
IT-Service Lehmann
Sandstr. 6, 49080 Osnabrück
www.its-lehmann.de

--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] recover partial readable tape

2009-03-04 Thread Thomas Mueller

 
 Is there a way to reassemble the two parts of the file and reread
 them with bacula? i've not found any option like skip file 4 to 20
 with the bextract,bscan,bls tools
 
 You should use a bootstrap file to that purpose. The easiest way would
 be to initiate a restore from the console, and when all is done, instead
 of starting the job, copy the created bootstrap file and cancel the
 restore. Then, in the bootstrap file, remove all records pointing to
 tape files 5 to 19.
 
 Alternatively, it's not too big a task to manually write a minimal
 bootstrap file, omitting the files in question.

the problem is, that the data isn't in the catalog anymore. it got pruned 
after 6 months. the client limit was accidentially set to this value... 
also see my bls comment below.

but just thought about it, and there has to be a backup from the catalog. 
where the ARCHIVE- volume is still available with file entries. 

 
 When restoring, I guess you can expect problems with the files that have
 data partly in the affected tape files, but that might still be better
 than getting back nothing at all.

yeah, better loose 16GB than 1,3TB. :)

 
 i've allready read the first part of the tape to a file and tried to
 read it from there. No luck so far:
 
 bls: match.c:249-0 add_fname_to_include prefix=0 gzip=0 fname=/ bls:
 butil.c:282 Using device: /srv/backup/vtl for reading. 04-Mar 16:50
 bls JobId 0: Ready to read from volume ARCHIVE- on device
 FileStorage (/srv/backup/vtl). 04-Mar 16:50 bls JobId 0: Error:
 block.c:275 Volume data error at 0:64511! Wanted ID: BB02, got .
 Buffer discarded. 0 files found.
 bls: acquire.c:436-0 dir_update_vol_info. label=64 Vol=ARCHIVE-
 
 seems that not all data is in correct order. if i do a strings
 ARCHIVE-:
 
 I'd use bls with j, k, L, p and v options to get a better idea of what
 actually is in the resulting volume file.

problem: the tape drive doesn't go over file 4, it's running in circles 
telling me that it skipped a block but next message telling me again that 
the same block is beeing skipped (and so on).

if i do an mt fsf 5 i need to rewind the tape to get access again, else 
it will print i/o error. 

so the bacula utilities won't give me a file list and restoring the whole 
job doesn't work because of the defective area. sort of henn/egg problem. 


 
 or if any programmer is out there: is it a big task to implement a
 skip file(s) option to the volume utilities?
 
 I guess you'll get a response similar to manually edit the bootstrap
 file; the feature doesn't seem to be critical to most users, so we won't
 invest much there as long as more pressing projects are pending.

think the feature is cirtical for users whose catalog entries got pruned, 
no (maybe a really old one is needed) catalog  backup is available and 
the tape is not in a good state. 

Thanks

- Thomas


--
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users