[Bacula-users] Network error with FD during Backup: ERR=Connection timed out

2008-11-28 Thread Silvian Cretu
Hi,
I am a bacula user for almost 2 years now. But I've encountered a problem,
recently.
Whenever I try to backup files from a specific client I get this errors:


27-Nov 11:23 director JobId 373: Fatal error: Network error with FD
during Backup: ERR=Connection timed out
27-Nov 11:23 storage JobId 373: Job client.2008-11-27_09.11.33 marked
to be canceled.
27-Nov 11:23 storage JobId 373: Job write elapsed time = 02:11:19,
Transfer rate = 37.66 K bytes/second
27-Nov 11:23 director JobId 373: Fatal error: No Job status returned from FD.



The elapsed time is around 2 hours and 11 mins (sometimes 15 seconds, some
other times 16 seconds...) :


Elapsed time:   2 hours 11 mins 21 secs


The problem is similar to these:

http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg12327.html
https://pastebin.sk/en/5119/
http://thread.gmane.org/gmane.comp.sysutils.backup.bacula.general/48716

Does anyone have an idea on how to solve this?

Thank you very much!

-- 
Silvian Cretu
-
http://www.silviancretu.ro/
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Kevin Keane
This might be a totally off-the-wall idea, might not even work - or if 
it does, it may not help in the end.

But how about doing your own subdirectorying. Leave all 800,000 files 
in the directory where they are - and create your own parallel directory 
structure with subdirectories as you like. For instance, one per day.

Then write a script that creates links (maybe soft links will work, else 
use hard links) from the original files into your subdirectories. You 
will probably need to run this script daily. If you use hard links, you 
may be able to use the reference count for the file to find out which 
files have already been linked into your directory, so you can create 
new links only for those files with a reference count of 1.

That way, the fax application will continue seeing the faxes where you 
expect them, and at the same time you have the files organized in a 
backup-friendly structure.

Now instead of backing up the single huge directory, back up the 
directory structure you created yourself.

Whether this will work, I don't know; I'm just trying to be creative. 
Maybe running this script and creating all the links will take 48 hours...

Tobias Bartel wrote:
 Hello,

 i am tasked to set up daily full backups of our entire fax communication
 and they are all stored in one single director ;). There are about
 800.000 files in that directory what makes accessing that directory
 extremely slow. The target device is a LTO3 tape drive with an 8 slots
 changer.

 With my current configuration Bacula needs ~48h to make a complete
 backup which kinda conflicts with the requirement of doing dailys.

 Does anybody have any suggestions on how i could speed things up? 

 THX in advance - Tobi


 PS: I already talked to my boss and our developers and they will change
 the system so the faxes get stored in subdirectories. But changing that
 doesn't have a very high priority and got scheduled for next summer.


 -
 This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
 Build the coolest Linux based applications with Moblin SDK  win great prizes
 Grand prize is a trip for two to an Open Source event anywhere in the world
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users
   


-- 
Kevin Keane
Owner
The NetTech
Turn your NetWORRY into a NetWORK!

Office: 866-642-7116
http://www.4nettech.com

This e-mail and attachments, if any, may contain confidential and/or 
proprietary information. Please be advised that the unauthorized use or 
disclosure of the information is strictly prohibited. The information herein is 
intended only for use by the intended recipient(s) named above. If you have 
received this transmission in error, please notify the sender immediately and 
permanently delete the e-mail and any copies, printouts or attachments thereof.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Kevin Keane
Tobias Bartel wrote:
 Hello,

   
 Even with 800,000 files, that sounds very slow.  How much data is
 involved, how is it stored and how fast is your database server?
 

 It's about 70GB of data, stored on a Raid5 (3Ware controller).

 The database is a SQLite one, on the same machine but on a Software 
 Raid 1.
   
You obviously have a very performance-sensitive situation, and writing 
to a software raid can seriously affect performance. Any chance you can 
move the database to a hardware RAID? For that matter, ideally I would 
recommend completely eliminating the software raid from that machine if 
you can, or at least only put read-only data on it, such as the /usr 
directory.

-- 
Kevin Keane
Owner
The NetTech
Turn your NetWORRY into a NetWORK!

Office: 866-642-7116
http://www.4nettech.com

This e-mail and attachments, if any, may contain confidential and/or 
proprietary information. Please be advised that the unauthorized use or 
disclosure of the information is strictly prohibited. The information herein is 
intended only for use by the intended recipient(s) named above. If you have 
received this transmission in error, please notify the sender immediately and 
permanently delete the e-mail and any copies, printouts or attachments thereof.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] bacula behave diferent that i want to

2008-11-28 Thread Bartosz . c
I have weird situation, when bacula meet a problem (mainly one of
bacula-fd is shuted down) it dont want to continue rest of backups
from the list of jobs, 

only when problem is solved (it mean backuped data [bacula-fd] is
online) it start working and do rest of jobs:

i have no idea how to solve this problem,

screen from times of jobs:
http://www.wrzuta.pl/obraz/lc7lfuxH3J/

my conf file:

http://www.wrzuta.pl/pliki/fPLc49A5fD/

I kindly ask for help
Bartosz.

if I duplicate this post sorry but I still have a problem with my
membership of bacula-users


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Access denied on access files to backup

2008-11-28 Thread s_mendes
Guys,
I figured out what is the real problem. The company implemented a criptografy solution on all laptops called Credant. After this implementation Bacula can't access anymore any file on drive of laptops.
Somebody have any idea or have experienced this kind of situation? What can I do? I can access/copy/move any file on laptops while on network.
Tks!
Em 27/11/2008 22:59, James Harper  escreveu:
 Hello people,  I'm using Bacula-win v. 2.4.3 and everything was working fine;suddenly Bacula stops to make backup of files from the clients. The message is: Cannot open "Path\File..." ERR: Access is denied  The backups are beeing stored on files (I'm not using tapes).  The curious thing is that anything was changed and the backups were working perfectly. I don't know what to do... please someone can helpme? I assume the "cannot open ..." message refers to a file on the Windowssystem... as the Administrator user under Windows, can you access thosefiles? What are the security settings currently?I have definitely seen NTFS get corrupt before in such a way that filesappear to exist but are inaccessible (although this was not using theBackup Api which may or may not have had a problem accessing them).Maybe run a chkdsk /f on the disk?James-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Promoting manually level of jobs.

2008-11-28 Thread Pascal Clermont
I have a daily backup at a incremental level with a 7 days retention 
period and this works fine.

I have one share that is very big and would be alot better if it could 
run its full on fridays. is it possible for me in the bconsole to 
promote the level to full on the fly ?

Or am I obligated to create a custom schedule for that specific share ?


Pascal S. Clermont

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Network error with FD during Backup: ERR=Connection timed out

2008-11-28 Thread Dan Langille
Silvian Cretu wrote:
 Hi,
 I am a bacula user for almost 2 years now. But I've encountered a 
 problem, recently.
 Whenever I try to backup files from a specific client I get this errors:
 
 
 27-Nov 11:23 director JobId 373: Fatal error: Network error with FD during 
 Backup: ERR=Connection timed out
 
 27-Nov 11:23 storage JobId 373: Job client.2008-11-27_09.11.33 marked to be 
 canceled.
 27-Nov 11:23 storage JobId 373: Job write elapsed time = 02:11:19, Transfer 
 rate = 37.66 K bytes/second
 27-Nov 11:23 director JobId 373: Fatal error: No Job status returned from FD.
 
 
 
 The elapsed time is around 2 hours and 11 mins (sometimes 15 seconds, 
 some other times 16 seconds...) :
 
 
 Elapsed time:   2 hours 11 mins 21 secs
 
 
 The problem is similar to these:
 
 http://www.mail-archive.com/bacula-users@lists.sourceforge.net/msg12327.html
 https://pastebin.sk/en/5119/
 http://thread.gmane.org/gmane.comp.sysutils.backup.bacula.general/48716
 
 Does anyone have an idea on how to solve this?
 
 Thank you very much!

Look at adding heartbeat to your configuration.  Possibly to the SD, 
Dir, and FD.  Not sure which.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula behave diferent that i want to

2008-11-28 Thread John Drescher
On Fri, Nov 28, 2008 at 6:39 AM, Bartosz. c [EMAIL PROTECTED] wrote:
 I have weird situation, when bacula meet a problem (mainly one of
 bacula-fd is shuted down) it dont want to continue rest of backups
 from the list of jobs,

 only when problem is solved (it mean backuped data [bacula-fd] is
 online) it start working and do rest of jobs:

 i have no idea how to solve this problem,

 screen from times of jobs:
 http://www.wrzuta.pl/obraz/lc7lfuxH3J/

 my conf file:

 http://www.wrzuta.pl/pliki/fPLc49A5fD/

 I kindly ask for help
 Bartosz.

 if I duplicate this post sorry but I still have a problem with my
 membership of bacula-users


This is normal. Unless you enable concurrency or use a run before
script to test the status of the fd, bacula will retry to connect to a
down fd a few times before giving up. Depending on your timeout
settings this can take 30 minutes or more for bacula to give up on a
client. If you want concurrency you have to enable concurrency on the
storage in bacula-dir.conf You can also restrict the times that bacula
will wait for a client.

John

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Improving catalog performance

2008-11-28 Thread Ryan Novosielski
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Kelly, Brian wrote:
 Arno,
 
 I've been studying different options for improving my database performance. 
 
 After reading your recommendations on improving catalog performance. 
 
 There are two rather simple solutions:
 - Don't keep file information for this job in the catalog. This makes 
 restoring single mails difficult.
 - Tune your catalog database for faster inserts. That can mean moving 
 it to a faster machine, assigning more memory for it, or dropping some 
 indexes (during inserts). If you're not yet using batch inserts, try 
 to recompile Bacula with batch-inserts enabled.
 
 Could you elaborate on how to:
 
 1. Not keep file information for particular jobs in the catalog. 
 2. How does one drop an index during inserts?

Make certain you've done all the optimizations you can before
undertaking something more severe like this, however. I know my copy of
MySQL was set to use very little system memory and I believe only a
single thread, even though the machine it was running on was 3 CPU with
4GB system RAM. my-huge.cnf is a good place to start, if this machine is
allowed to use a lot of resources for the DB. There are also scripts
that can give you some basic advice about how to tune your DB. I was
able to make plenty of gains through this avenue, as well as having the
proper indexes to begin with.

- --
  _  _ _  _ ___  _  _  _
 |Y#| |  | |\/| |  \ |\ |  | |Ryan Novosielski - Systems Programmer II
 |$| |__| |  | |__/ | \| _| |[EMAIL PROTECTED] - 973/972.0922 (2-0922)
 \__/ Univ. of Med. and Dent.|IST/AST - NJMS Medical Science Bldg - C630
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFJMDowmb+gadEcsb4RAlBoAJ9ovtk59+aQ7OzdWH7cemGVOSbDWQCeN2DV
7WmaaBhPETbhG5TGO3Buxoc=
=QmNf
-END PGP SIGNATURE-
begin:vcard
fn:Ryan Novosielski
n:Novosielski;Ryan
org:UMDNJ;IST/AST
adr;dom:MSB C630;;185 South Orange Avenue;Newark;NJ;07103
email;internet:[EMAIL PROTECTED]
title:Systems Programmer II
tel;work:(973) 972-0922
tel;fax:(973) 972-7412
tel;pager:(866) 20-UMDNJ
x-mozilla-html:FALSE
version:2.1
end:vcard

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Cannot find any appendable volumes on MediaType=File

2008-11-28 Thread John Drescher
On Fri, Nov 28, 2008 at 3:38 PM, SZÉKELYI Szabolcs [EMAIL PROTECTED] wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1

 Hi,

 I use files to store my backups, and all scheduled backups ran fine when
 I got the error 'Cannot find any appendable volumes' out of the blue.
 The filesystem that holds the backup file is not even close to full. The
 file that was used previously is there, it's writable, nothing changed
 since the last successful backup.

 What should I do to resolve the situation? I'd like bacula to continue
 using the the file it did before. I tried to run the sd with -d99, but
 looking at the output I still don't know what's wrong.


post the output of list volumes

from bconsole
John

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Re-read of last block OK, but block numbers differ

2008-11-28 Thread Allan Black
Martin Simmons wrote:
 23-Nov 22:06 gershwin-sd JobId 506: Error: Re-read of last block OK, but 
 block numbers differ. Last block=4963 Current block=4963.
 23-Nov 22:06 gershwin-sd JobId 506: End of medium on Volume 
 MainCatalog-004 Bytes=28,148,843,520 Blocks=436,334 at 23-Nov-2008 22:06.
 However: I also think that that catalog backup has actually been
 corrupted, because I think the SD would write the data from block
 4963 at the beginning of the new tape, which means if I restored
 that particular backup, I would find a block of data repeated.
 I would expect it to be OK, as long as the catalog says that block 4963 is on
 the second tape.

Thank for the reply; I am still not sure this is OK, though. Since my original
post, I have done a bit of research, and it looks like some drives actually
behave this way.

[ The block numbers refer to the physical position on the tape, BTW, rather
than being a sequence count within the backup data stream, so the first block
on the next tape will be block 0. I cannot use that to determine whether the
data has been written twice. ]

Apparently, some drives will write until they run out of tape, then they fail
the write and return EOM. However, some drives will detect *impending* end of
tape, and start giving you EOM a little bit before the physical end of the tape,
but they will still successfully write data.

 Have you tried the btape fill test?  That should check Bacula's logic for this
 case.

I admit I cannot now remember if I exhaustively tested this drive; I was
concentrating mainly on the DLT I use for the main backups. I'll dig out
a couple of blank tapes and test it though.

I will also get that catalog backup off the tape, and have a close look at
the SQL file I get back, in case there is a duplicated block of data.

I may move over to the devel list, actually, depending on how the tests work
out, just in case there is a (silent) problem with some drives. If there is,
however, the SD can easily detect the behaviour of the drive, because it gets
the block number back when it re-reads the last block on the tape.

Allan


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Cannot find any appendable volumes on MediaType=File

2008-11-28 Thread SZÉKELYI Szabolcs
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

John Drescher wrote:
 On Fri, Nov 28, 2008 at 3:38 PM, SZÉKELYI Szabolcs [EMAIL PROTECTED] wrote:
 I use files to store my backups, and all scheduled backups ran fine when
 I got the error 'Cannot find any appendable volumes' out of the blue.
 The filesystem that holds the backup file is not even close to full. The
 file that was used previously is there, it's writable, nothing changed
 since the last successful backup.

 What should I do to resolve the situation? I'd like bacula to continue
 using the the file it did before. I tried to run the sd with -d99, but
 looking at the output I still don't know what's wrong.
 
 post the output of list volumes
 
 from bconsole

Here it goes:

 Pool: Default
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
 +-++---+-+---+--+--+-+--+---+---+-+
 |   5 | vol01  | Error |   1 | 5,278,560,968 |1 |   
 31,536,000 |   1 |0 | 0 | File  | 2008-11-26 23:47:24 |
 +-++---+-+---+--+--+-+--+---+---+-+
 Pool: Scratch
 No results to list.

Thanks,
- --
cc

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.9 (GNU/Linux)

iEYEARECAAYFAkkwZ+oACgkQGJRwVVqzMkMeoQCfRG2uIzYfQyMsUdcXpF77jMTi
j9gAoJp45zJgMjc4A5TaqJ4Wqc8RcKsX
=dHE/
-END PGP SIGNATURE-

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Cannot find any appendable volumes on MediaType=File

2008-11-28 Thread Dan Langille
SZÉKELYI Szabolcs wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 John Drescher wrote:
 On Fri, Nov 28, 2008 at 3:38 PM, SZÉKELYI Szabolcs [EMAIL PROTECTED] wrote:
 I use files to store my backups, and all scheduled backups ran fine when
 I got the error 'Cannot find any appendable volumes' out of the blue.
 The filesystem that holds the backup file is not even close to full. The
 file that was used previously is there, it's writable, nothing changed
 since the last successful backup.

 What should I do to resolve the situation? I'd like bacula to continue
 using the the file it did before. I tried to run the sd with -d99, but
 looking at the output I still don't know what's wrong.
 post the output of list volumes

 from bconsole
 
 Here it goes:
 
 Pool: Default
 +-++---+-+---+--+--+-+--+---+---+-+
 | MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
 VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
 +-++---+-+---+--+--+-+--+---+---+-+
 |   5 | vol01  | Error |   1 | 5,278,560,968 |1 |   
 31,536,000 |   1 |0 | 0 | File  | 2008-11-26 23:47:24 |
 +-++---+-+---+--+--+-+--+---+---+-+
 Pool: Scratch
 No results to list.

There's your problem.  That volume has status ERROR.

Change it to Append using update volume within bconsole.

Then issue a mount command.

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] DVD backup problems gone!

2008-11-28 Thread Jari Fredriksson
I went from tape to DVD a month ago, and everything failed.

Bug reports: 

http://bugs.bacula.org/view.php?id=1184
http://bugs.bacula.org/view.php?id=1186


Yahoo! Google!

I downgraded to 2.2.8 for the dir/stored server, and I made it! Backup 
successful!

I don't remember when was it, but the stored code was rewritten. Seems that 
broke the DVD code.

I have not restored yet, but at least each DVD part updates the database, and 
everyting seems to work fine in backup.


Downgrading from latest to 2.2.8 did not need changes in database, and at least 
backup works fine now. I have no idea yet how the recycle bug sorts out, I have 
DVD+RW's for 1 years needs, but let's see next year when they all fill up.

At least backup works! Cool.

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Jari Fredriksson
No, sorry.

Next job fails now with message

29-Nov 04:27 wellington-sd JobId 8982: Fatal error: dvd.c:580 Error writing. 
Current part less than total number of parts (5/5, device=DVD_RW (/dev/hdc))

5 is less than 5 and it fails. Dammit.




 I went from tape to DVD a month ago, and everything
 failed. 
 
 Bug reports:
 
 http://bugs.bacula.org/view.php?id=1184
 http://bugs.bacula.org/view.php?id=1186
 
 
 Yahoo! Google!
 
 I downgraded to 2.2.8 for the dir/stored server, and I
 made it! Backup successful! 
 
 I don't remember when was it, but the stored code was
 rewritten. Seems that broke the DVD code. 
 
 I have not restored yet, but at least each DVD part
 updates the database, and everyting seems to work fine in
 backup.  
 
 
 Downgrading from latest to 2.2.8 did not need changes in
 database, and at least backup works fine now. I have no
 idea yet how the recycle bug sorts out, I have DVD+RW's
 for 1 years needs, but let's see next year when they all
 fill up.
 
 At least backup works! Cool.
 
 -
 This SF.Net email is sponsored by the Moblin Your Move
 Developer's challenge 
 Build the coolest Linux based applications with Moblin
 SDK  win great prizes 
 Grand prize is a trip for two to an Open Source event
 anywhere in the world 
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Dan Langille
Jari Fredriksson wrote:
 
 I went from tape to DVD a month ago, and everything
 failed. 

 Bug reports:

 http://bugs.bacula.org/view.php?id=1184
 http://bugs.bacula.org/view.php?id=1186


 Yahoo! Google!

 I downgraded to 2.2.8 for the dir/stored server, and I
 made it! Backup successful! 

 I don't remember when was it, but the stored code was
 rewritten. Seems that broke the DVD code. 

 I have not restored yet, but at least each DVD part
 updates the database, and everyting seems to work fine in
 backup.  


 Downgrading from latest to 2.2.8 did not need changes in
 database, and at least backup works fine now. I have no
 idea yet how the recycle bug sorts out, I have DVD+RW's
 for 1 years needs, but let's see next year when they all
 fill up.

 At least backup works! Cool.

  No, sorry.
 
  Next job fails now with message
 
  29-Nov 04:27 wellington-sd JobId 8982: Fatal error: dvd.c:580 Error 
writing. Current part less than total number of parts (5/5, 
device=DVD_RW (/dev/hdc))
 
  5 is less than 5 and it fails. Dammit.

Sorry, I can't help you.  But in general, you're better off seeking help 
here first before you file a bug report.

see http://www.bacula.org/en/?page=support

cheers

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with tape capacity

2008-11-28 Thread Alan Brown

Please reply to the list, not me personally. Other people may have the
problem now or in future and the archives are valuable resources.

On Thu, 27 Nov 2008, Willians Vivanco wrote:

 Willians Vivanco wrote:
  Alan Brown wrote:
   On Thu, 27 Nov 2008, Willians Vivanco wrote:
  
  
 What are the permissions of /dev/nst* and what userid are the programs
 running as?


The normal permissions root:tape
   
  
   Bacula-sd and btape usually run as bacula:tape - as a test set the
   /dev/nst devices world writeable and see if the error persists.
  
  
 What happens if you try to write to the tape using tar and related
 programs?

It happens the same error...
   
  
   This indicates a hardware problem.
  
   What about mt -f /dev/nst0 status ?
  
   Is your scsi chain terminated properly? What does the library interface
   say?
  
   I have a MSL6000 and it works perfectly under linux
  
   AB
  
  
  
  What kernel? I'm using 2.6.18 with all lenny updates... It's a good
  configuration?

2.6.18 on RHEL5 but it's worked fine for 5 years on various kernel
versions in Suse 8, 9, 10, RHEL4 and RHEL5

 Let me tell you a little detail... My bacula is running on a server blade and
 is connected with the MSL6000 through the hba interface using 2 similar zones,
 for redundance... Can be this important ?

No, this is similar to what I'm doing.

Just remember that linux multipath utilities only work for disk
entities, not for tapes or scsi generic devices.

I am using FC connections, but there is no logical difference between this
and scsi.

Have you tried using another drive? Our MSL6000 was supplied with _both_
LTO2 drives dead on arrival.

AB

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Large maildir backup

2008-11-28 Thread Alan Brown
On Thu, 27 Nov 2008, Kjetil Torgrim Homme wrote:

 this may be good for Maildir, but with Cyrus IMAPD, which uses short
 filenames like 1432., 1433., this *reduced* performance by a few
 percent in one test we did.

How many files/dorectory were you testing with? In some cases our users
were leaving tens or even hundreds of thousands of files in one directory.

(In one extreme case, 3.5 MILLION files were in one directory.

AB


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backup of in one directory with 800.000 files

2008-11-28 Thread Alan Brown
On Thu, 27 Nov 2008, Tobias Bartel wrote:

 The database is a SQLite one, on the same machine but on a Software
 Raid 1.


SQLite is really oinly intended for testing, not production systems.

Switch to postgres or mysql, things should improve.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Jari Fredriksson
 
 Sorry, I can't help you.  But in general, you're better
 off seeking help here first before you file a bug report.
 
 see http://www.bacula.org/en/?page=support
 
 cheers
 

Cheers.

That page was about different kind ofsupport for Bacula.

1. Professional Support.

I don't want Professional, paid support. I use this at home, have used for 
years without problems, with Tape. But now my streamer died and I converted to 
DVD+RW.

2. Reading Bacula Users and Bacula bugs. I already do that. Have done for years.

3. About not sending messages to Kern. Ok. Trying to stay on Users and Bugs.

I have tried to be clear and concise in my bug reports. It is easy to comment a 
bug report if it is not reasonable.

I have a feeling that some people are using Bacula with DVD+RW with success. I 
have had comments that

Here, same problem

and

Here, all good with 2.0.2

There is no such version as 2.0.2 downloadable. That is why I'm writing here? 
What version works with DVD? Some do, some dont.

I kind of feel betrayed when I have used Bacula for years with my tapes, and 
now I'm offered http://www.bacula.org/en/?page=support


Cheers and thanks.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Dan Langille
Jari Fredriksson wrote:
 Sorry, I can't help you.  But in general, you're better
 off seeking help here first before you file a bug report.

 see http://www.bacula.org/en/?page=support

 cheers

 
 Cheers.
 
 That page was about different kind ofsupport for Bacula.

Yes.  This mailing list is one form of support.

 I have tried to be clear and concise in my bug reports. It is easy to comment 
 a bug report if it is not reasonable.

Bug reports give work to developers.  That's who reads the bug reports. 
  By asking the users mailing list first, you allow other users to 
contribute to the project and at the same time lessen the workload for 
developers.

 I kind of feel betrayed when I have used Bacula for years with my tapes, and 
 now I'm offered http://www.bacula.org/en/?page=support

You aren't being asked to do anything new or being singled out.

The main point was: please post here and seek help *before* filing a bug 
report.  http://www.bacula.org/en/?page=bugs is also quite clear on this 
point.

regards.  :)

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Jari Fredriksson
 
 The main point was: please post here and seek help
 *before* filing a bug report. 
 http://www.bacula.org/en/?page=bugs is also quite clear
 on this point. 
 
 regards.  :)
 

And that is all I have done.

I started this with writing to users.

All help I got was Yes I have the same problem.

Then I downloaded the source and debugged. Tried and tried to understand what 
the code does. Could not do it with my 20 years of C/C++ work history.

THEN I filed a bug report.

As we speak, I'm doing backups with a slightly modified 2.2.28 version, and 
hope to get something out of it.But it's not easy.

Regards


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] DVD backup problems gone!

2008-11-28 Thread Dan Langille
Jari Fredriksson wrote:
 The main point was: please post here and seek help
 *before* filing a bug report. 
 http://www.bacula.org/en/?page=bugs is also quite clear
 on this point. 

 regards.  :)

 
 And that is all I have done.
 
 I started this with writing to users.
 
 All help I got was Yes I have the same problem.
 
 Then I downloaded the source and debugged. Tried and tried to understand what 
 the code does. Could not do it with my 20 years of C/C++ work history.
 
 THEN I filed a bug report.

All very true.  Great.  I suggest that waiting slightly longer than you 
did is generally a good idea.  A period of  24 hours isn't best practice.

 As we speak, I'm doing backups with a slightly modified 2.2.28 version, and 
 hope to get something out of it.But it's not easy.

Great.  It'll be great to see the patches in the bug report.  But as it 
stands now, the bug report is premature. Please, I'm trying to *help* 
you *help* us *help* you.  :)

thanks.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users