Re: [Bacula-users] bacula can't make use of multi drives

2014-11-20 Thread Kern Sibbald

  
  
On 11/20/2014 11:48 AM, Süleyman Kuran
  wrote:


  
  
  On 20-11-2014 12:28, Kern Sibbald
wrote:
  
  

Hello,
  
  There are a number of different ways to write to several
  drives at the same time.  They are listed with the preferred
  solution (for most cases) first and the worst solution last.
  
  1. This is probably the simplest and best.  Simply limit the
  number of simultaneous jobs by putting a Maximum Simultaneous
  Jobs = nn inside each Device resource in your bacula-sd.conf
  file.  Bacula version 7.0.x comes with this directive in the
  Device resources as a default.
  

  
  For multi-drive configs, Maximum Concurrent Jobs = nn setting is
  recommended in Storage and Director resource in bacula-dir.conf
  and storage resource in bacula-sd.conf. Do you suggest to use it
  in only Device resource in bacula-sd.conf omitting the others? 


No.  As I wrote in my previous response, they must all be
consistent, and they all have slightly different ways of limiting
concurrency (i.e. maximum jobs a director can run, maximum jobs for
a Storage definition in the Director, maximum jobs a storage daemon
can run, maximum jobs for a given drive, maximum jobs for a client,
maximum jobs for a given job name, ...)  Some you set to a big (but
not too big) number; others you need to fine tune (Device), a few
others you can ignore (i.e. one usually does not want more than one
simultaneous job running on a given client, though there *are* cases
where this is desirable).

Best regards,
Kern
 
  
  
  
 2. As other people have pointed
  out, direct the output of different jobs to different Pools. 
  This is very good for separating backups by say department,
  but is not an ideal way to limit concurrency.
  
  3. Set Prefer Mounted Volumes = no.  I *strongly* recommend
  against using this directive. It will inevitably lead to
  problems.
  
  Best regards,
  Kern
  
  On 11/18/2014 10:39 AM, Süleyman Kuran wrote:


  
  Hi,
  
  I am trying to make bacula use multi drives in a Fujitsu
  Tape Library with no success. Recently I added 3 more
  drives to bacula configuration to reduce backup time. But
  bacula insists on using only the first drive. Backup jobs
  are not sent to other suitable tape drives. Jobs are
  started at the same time and queued. Jobs in the queue is
  waiting for the previous job to finish even if there is a
  valid media (tape) for the pool and other drives are idle.
  I can mount other drives manually. Is there any other
  setting I'm missing to make use of multi-drives? Please
  advise.
  
  Regards,
  
  Suleyman
  
==
  CentOS release 6.5 (Final) 
  Bacula version 5.0.0-12.el6
  
  Config files:
  
  bacula-sd.conf
==
  Storage { # definition of
  myself
    Name = bacula-sd
    SDPort = 9103  # Director's port  
    WorkingDirectory = "/var/spool/bacula"
    Pid Directory = "/var/run"
    Maximum Concurrent Jobs = 2
  }
  
  Autochanger {
    Name = AYKAutochanger
    Device = Drive-1
    Device = Drive-2
    Device = Drive-3
    Device = Drive-4
    Changer Command = "/usr/libexec/bacula/mtx-changer %c %o
  %S %a %d"
    Changer Device = /dev/sg9
  }
  Device {
    Name = Drive-1
    Drive Index = 0
    Media Type = LTO-5
    Archive Device = /dev/nst0
    AutomaticMount = yes
    AlwaysOpen = yes
    RemovableMedia = yes
    Random Access = no
    Maximum File Size = 10GB
    Changer Command = "/usr/libexec/bacula/mtx-changer %c %o
  %S %a %d"
    Changer Device = /dev/sg9
    AutoChanger = yes
  }
  Device {
    Name = Drive-2
    Drive Index = 1
    Media Type = LTO-5
    Archive Device = /dev/n

Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-14 Thread Kern Sibbald

  
  

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 11/12/2014 09:10 PM, Dimitri Maziuk wrote:
 On 11/12/2014 01:11 PM, Josh
  Fisher wrote:
   On 11/8/2014 1:35 PM, Dmitri Maziuk wrote:
  
   I think there is some confusion about this due to
  "multiple devices"
   being an ambiguous term. There is a difference between
  "multiple devices
   that are only attached one at a time" and "multiple
  devices that may be
   attached all at the same time". For disk storage,
  including virtual disk
   autochanger, the "device" is a directory, and in almost
  all cases it is
   in fact the mount point of a filesystem partition. The
  virtual
   autochanger described in 2.2 will work with any
  filesystem mounted at
   /disk, so multiple disk drive partitions CAN be used, but
  ONLY one at a
   time. This then works similarly to tape.
  
   If this were true you couldn't use more than one tape drive
  of the same
   kind, e.g. the jukeboxes with 2 and more drives would only
  use one.
   Perhaps that is the case and nobody knows about it because
  people who
   can shell out $15K+ on a tape library don't use bacula.
  
   ... When the disk drive partition
   gets full, you must unmount the current disk partition
  and mount the
   next one
  
   ... The not so obvious caveat is that in order to use
   hot-swappable drives with a disk Device you MUST use
  Requires Mount,
   particularly if you are using automatic volume labeling.
  
   Hmm. So I could in theory come up with Mount Command that
  mounts each
   disk in a list (and optionally checks for free space and
  mounts the next
   one if there isn't any) and it all will "Just Work(tm)".
  Maybe someday
   I'll have copious free time and a fresh supply of round
  tuits...
  
   ...
   The other issue, using multiple simultaneously mounted
  filesystems, is
   not so clear. Each Device resource associated with an
  autochanger can
   specify a different Archive Device path. To do so, it is
  also necessary
   to use a different Media Type for each filesystem. Bacula
  expects to be
   able to load any volume of a particular Media Type into
  any Device
   having that same Media Type. A volume file located in one
  Device's
   Archive Device directory cannot be "loaded" into another
  Device with a
   different Archive Device directory
  
   Again, if as Kern says it's all implemented the same way,
  then you also
   should not be able to load an LTO-6 tape in "just any" LTO-6
  drive.
   You'd have to give them media types (e.g.) lto-6-mt0 and
  lto-6-mt1 and
   the tapes would only be loadable into /dev/mt0 and /dev/mt1
  resp.

You are getting confused.  For Bacula, the /dev/mt0 is not at all
equivalent to a directory.  It is much more like a file within a
directory because it is opened directly then read and written like a
file.  A directory is never opened by Bacula (except for more exotic
reasons on Windows).

Loading tapes (mounting) is something that only occurs on tape
drives, so that code is distinct from the code that "loads" (opens)
a volume.  Not all the code for reading/writing tapes is identical
to that for disks, but probably 90-95% is.  That said, there is no
harm in you thinking that tapes and disks are treated very different
in Bacula.


  
   If that isn't the case then there are significant differences
  in how
   tape and disk backups are coded in bacula. Then the "works
  similarly to
   tape" assumption is incorrect.
  
   [vchanger]
   ... It is open source (GPL v2) and
   available on SourceForge, so no "buying it off" is
  needed.
  
   Figure of speech. Though I've no idea what legaleze comes
  with bacula
   enterprise and how it might play with your gpl'ed code.
  (Bareos folks
   might know more about that.)

A Bacula Enterprise user can use vchanger with Bacula Enterprise --
this is permitted by Josh's GPLv2 license.  In fact, any other
proprietary backup program can legally use vchanger.  Perhaps the
best way to see this is that Bacula uses mtx (a GPLv2 program) for
tapes to do something similar to what vchanger does for disks.

Kern


  
   It just so happens that I have recently had some time to
  update
   vchanger.
  
   Cool. Please post a message to the list when it's out.
   Thanks
  
  
  
--
   Comprehensive Server Mon

Re: [Bacula-users] Concurrent Backups with a Virtual Autochanger

2014-11-14 Thread Kern Sibbald
Unfortunately, I no longer have the time to help people debug usage
problems, which I actually enjoy doing, but the other users on this
Bacula email list should be able to help you resolve this.  I do have a
few remarks:

1. There is no reason to set the VolumePoolInterval to anything other
than the default, especially for disk volumes.  Doing so could cause the
SD to consume a lot of unnecessary CPU time if there is an outstanding
mount message.

2. Forcing Bacula to use only one concurrent job per drive is not making
best use of your hardware.  In general, unless you have special needs
(security, tight restore SLAs,...), it is *far* better from operational
and performance standpoints to let Bacula write multiple simultaneous
jobs on a single drive (perhaps 5-10).  This will permit the OS to
reduce disk head movement.

Unfortunately neither of the above points will resolve the problem you
are seeing.

While you have provided some important input, what is missing is the job
log output including the mount message and a listing the volumes known
to the catalog DB (list volumes).

To reassure you, although I have not explicitly tried or tested writing
to multiple disk drives using some of the techniques recently discussed
on this list, I am 100% sure that the Virtual Autochanger code does work
exceptionally well with a single disk drive as is your case, providing
you really have labeled volumes that are available.

Note, by turning on a debug level of probably 100 to 150 in the
Director, and possibly also in the SD, you should be able to see more
clearly why the Director/SD cannot find any volumes that are ready to use.

Best regards,
Kern


On 11/15/2014 12:17 AM, Brady, Mike wrote:
 First of all thanks to Kern and Bacula Systems for making the Best 
 Practices for Disk Based Backup and Disk Back Design documents 
 available.

 I have been playing around with the best way for doing concurrent 
 backups for a while and these documents have helped my understanding 
 considerably.  Using a Virtual Autochanger in particular seems an 
 elegant way of doing what I would like to do.

 However, I am seeing some behaviour in my testing that I did not expect 
 and I need some input.

 At a high level what I am trying to do is use a Virtual Autochanger to 
 write to multiple volumes in the same pool concurrently.

 At the moment I have two devices limited to one concurrent job each.  
 Which, if I have understood things correctly, means that I should have 
 two jobs running concurrently writing to separate volumes.  The schedule 
 below kicks off eight jobs simultaneously with the number of devices 
 limiting concurrency.

 This issue that I am having is that the first job gets FileChgr1-Dev1 
 and a volume as expected.

 The second job gets device FileChgr1-Dev2 as expected, but always says 
 Cannot find any appendable volumes. and issues a mount request.  There 
 are multiple purged volumes with the recycle flag set available in the 
 IncPoool pool. Even if there weren't, the pool has Auto Labelling 
 configured and has not reached the MaximumVolumes limit, so there should 
 always be a volume available.

 Other jobs continue to use the FileChgr1-Dev1 as it becomes available 
 while FileChgr1-Dev2 is waiting for a volume.

 The second job eventually retries on FileChgr1-Dev2, gets an available 
 volume and successfully completes without any operator intervention.

 After this the remaining jobs utilise both FileChgr1-Dev1 and 
 FileChgr1-Dev2 as they become available as I expected.

 Is this behaviour expected (I am assuming some sort of race condition at 
 the start of the schedule with multiple jobs trying to get a volume at 
 the same time) or am I trying to do something fundamentally wrong here?

 My configuration is:

 Pool {
Name = IncPool
Pool Type = Backup
Volume Use Duration = 23 hours
Recycle = yes
Action On Purge = Truncate
Auto Prune = yes
Maximum Volumes = 50
Volume Retention = 2 weeks
Storage = FileStorage01
Next Pool = IncPoolCopy
Label Format = IncPool-
 }

 Storage {
Name = FileStorage01
Address = 192.168.42.45
SDPort = 9103
Password = ***
Device = FileChgr1
Media Type = File01
Maximum Concurrent Jobs = 10
Autochanger = yes
 }

 Autochanger {
Name = FileChgr1
Device = FileChgr1-Dev1, FileChgr1-Dev2
Changer Command = /dev/null # For  7.0.0 and newer releases.
# Changer Command =  # For 5.2 and older releases.
Changer Device = /dev/null
 }

 Device {
Name = FileChgr1-Dev1
Drive Index = 0
Media Type = File01
Archive Device = /bacula_storage/FileDevice
LabelMedia = yes;
Random Access = Yes;
AutomaticMount = yes;
RemovableMedia = no;
AlwaysOpen = no;
Maximum Concurrent Jobs = 1
VolumePollInterval = 5s
Autochanger = yes
 }

 Device {
Name = FileChgr1-Dev2
Drive Index = 1
MediaType = File01
ArchiveDevice = /bacula_storage

Re: [Bacula-users] [Bacula-devel] Load slots timeout

2014-11-10 Thread Kern Sibbald

  
  
There is no need to modify the code. 
  Just modify the bacula-sd.conf file.  It is much easier.
  
  Best regards,
  Kern
  
  On 11/10/2014 04:14 PM, Andrey Chebotarev wrote:


  
  I've modified and recompiled, waiting
for result till next drive cleaning...

  
  

Probably that's it:
  
  stored/stored_conf.c:
  
     {"maximumchangerwait",    store_time,  
  ITEM(res_dev.max_changer_wait), 0, ITEM_DEFAULT, 5 * 60},
  
  


  
  Here example what's going on.
Job logs:

31-Oct 12:35 baculasrv-dir JobId 10967: Start Backup JobId 10967, Job=StorwizeBSRVData2BJob1.2014-10-31_12.35.06_34
31-Oct 12:35 baculasrv-dir JobId 10967: Recycled volume "346AAJL6"
31-Oct 12:35 baculasrv-dir JobId 10967: Using Device "IBM_TS3200_2_drive1" to write.
31-Oct 12:35 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 46, drive 1" command.
31-Oct 12:36 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 12, drive 1" command.
31-Oct 12:36 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 12, drive 1", status is OK.
31-Oct 12:36 baculasrv-sd JobId 10967: Recycled volume "346AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
31-Oct 12:36 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "346AAJL6" as Used.
31-Oct 23:25 baculasrv-sd JobId 10967: End of Volume "346AAJL6" at 2555:8545 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
31-Oct 23:25 baculasrv-sd JobId 10967: Re-read of last block succeeded.
31-Oct 23:25 baculasrv-sd JobId 10967: End of medium on Volume "346AAJL6" Bytes=2,555,387,735,040 Blocks=39,611,044 at 31-Oct-2014 23:25.
31-Oct 23:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 12, drive 1" command.
31-Oct 23:28 baculasrv-dir JobId 10967: Recycled volume "349AAJL6"
31-Oct 23:28 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 34, drive 1" command.
31-Oct 23:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 34, drive 1", status is OK.
31-Oct 23:28 baculasrv-sd JobId 10967: Recycled volume "349AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
31-Oct 23:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "349AAJL6" as Used.
31-Oct 23:28 baculasrv-sd JobId 10967: New volume "349AAJL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 31-Oct-2014 23:28.
01-Nov 10:25 baculasrv-sd JobId 10967: End of Volume "349AAJL6" at 2541:9287 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
01-Nov 10:25 baculasrv-sd JobId 10967: Re-read of last block succeeded.
01-Nov 10:25 baculasrv-sd JobId 10967: End of medium on Volume "349AAJL6" Bytes=2,541,436,498,944 Blocks=39,394,786 at 01-Nov-2014 10:25.
01-Nov 10:25 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 34, drive 1" command.
01-Nov 10:27 baculasrv-dir JobId 10967: Recycled volume "225AAAL6"
01-Nov 10:27 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 3, drive 1" command.
01-Nov 10:28 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 3, drive 1", status is OK.
01-Nov 10:28 baculasrv-sd JobId 10967: Recycled volume "225AAAL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
01-Nov 10:28 baculasrv-dir JobId 10967: Max Volume jobs=1 exceeded. Marking Volume "225AAAL6" as Used.
01-Nov 10:28 baculasrv-sd JobId 10967: New volume "225AAAL6" mounted on device "IBM_TS3200_2_drive1" (/dev/nst0) at 01-Nov-2014 10:28.
01-Nov 23:20 baculasrv-sd JobId 10967: End of Volume "225AAAL6" at 2652:7176 on device "IBM_TS3200_2_drive1" (/dev/nst0). Write of 64512 bytes got -1.
01-Nov 23:20 baculasrv-sd JobId 10967: Re-read of last block succeeded.
01-Nov 23:20 baculasrv-sd JobId 10967: End of medium on Volume "225AAAL6" Bytes=2,652,293,210,112 Blocks=41,113,175 at 01-Nov-2014 23:20.
01-Nov 23:20 baculasrv-sd JobId 10967: 3307 Issuing autochanger "unload slot 3, drive 1" command.
01-Nov 23:22 baculasrv-dir JobId 10967: Recycled volume "345AAJL6"
01-Nov 23:22 baculasrv-sd JobId 10967: 3304 Issuing autochanger "load slot 11, drive 1" command.
01-Nov 23:23 baculasrv-sd JobId 10967: 3305 Autochanger "load slot 11, drive 1", status is OK.
01-Nov 23:23 baculasrv-sd JobId 10967: Recycled volume "345AAJL6" on device "IBM_TS3200_2_drive1" (/dev/nst0), all previous data lost.
01-Nov 23:23 baculasrv-dir JobId 10967: Max Volume 

Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-09 Thread Kern Sibbald
On 11/08/2014 07:35 PM, Dmitri Maziuk wrote:
 On 11/8/2014 5:36 AM, Kern Sibbald wrote:

 I think so.  If I understand correctly, you want disk mount points or
 directories to be treated much like a tape drive, so that you can
 mount multiple disks.

 I think this feature is already implemented, with one difference ...
 that when the device is mounted, it assumes that it has a
 filesystem  on it rather than treating it as a raw device.

 Either way works, filesystem makes it easy to see what's on it, but
 you have to mkfs on a new disk.

 Much like the Virtual Autochanger feature, I am not 100% sure where this
 is documented, so you may have to search for it. The main requirement
 for it to work is to configure the SD Device (even if it is a disk
 device) as removable.

 Devices that require a mount (USB) in
 http://www.bacula.org/7.0.x-manuals/en/main/Storage_Daemon_Configuratio.html#SECTION00173
 says, among other things, write part command must be defined. Write
 part command is somewhat documented in Devices that require a mount
 (DVD) in docs for 5.0 and below, but not in 7.0. Its purpose is
 unclear, my guess would be it's intended for write to optical disk
 but not close it, no idea how or why that would apply to a usb stick.

It looks like the document is out of date.  I am not sure we ever made a
pass through the manual to remove the DVD documentation.  In any case, a
mount command may or may not be necessary for doing USB, but the Write
Part Command is definitely not needed and indeed not used any more.


 From reading that section I can't figure out the config for 12-bay
 hot-swap sata storage server where I can write to all disks and
 replace them as they get full, just like they were tapes. (But see my
 reading comprehension note below.)

I don't remember what the configuration would be, because I have not
used the feature for about 5 years, but the first step would be to play
with setting Removable Media to true, then looking at whether or not
Requires Mount and the Mount Point and Mount Command are needed. 
If you have setup your USB to be automatically mounted, which seems to
be the default now, but was not when I used the feature, you may not
need any mount commands, though if the operator must explicitly remove
and replace a disk, I imagine they will be required.

 By the way, in case you have not noticed, there are three white
 papers posted on the bacula.org web site, two of them, if I am not
 mistaken, document Virtual Autochangers as implemented in the
 community version (slightly different from the Enterprise version).

 I notice now, thanks.

 CommunityDiskBackup.pdf has the same old problem in 2.1 Grouping
 Storage Devices: as usual, it talks multiple devices and shows 2
 Device definitions with Archive Device = /disk in both. Personally I
 don't know how to mount multiple physical devices in the same /disk at
 the same time and keep them separate too.

Bacula can only mount one device in any given Device section at a time,
but in an Autochanger (virtual or not) there are multiple Devices and
each can have its own directory.  However, if you use different
directories, you must use different Media Types otherwise, Bacula will
not know the right directory to look in for fixed disks.


 Same goes for 2.2 Virtual Autochanger: it doesn't let you write to
 multiple (disk) devices, it lets bacula treat a single Archive Device
 as multipe devices -- presumably for concurrent access.

I am not sure why you believe the above.  Each Device can have a
different Archive Device path.  The examples probably use the same
directory so that it does not get too complicated (with Media Types and
all).  I suggest you just try using different disk devices and see what
happens.


 Same goes for section 3 (Multiple Devices) in
 CommunityDiskBackupDesign.pdf

 At least that's what I read in there. Maybe I'm not reading it right:
 the years have not been kind and my leet reading comprehension skillz
 ain't what they used to be.

I think it is just that the examples are simpler than what you want to do.


 The rest of it is very useful but not germane to the topic of using
 multiple hot-swappable disks for storage.

In principle hot-swappable disks should work, but since I don't think
anyone has done it before, there may be hidden problems that I am not
aware of.


 This is all great but so far the only known config I've actually seen
 working is a vchanger. I'd consider buying it off and rolling it into
 bacula proper so instead of much handwaving and allegations of maybe
 documented somewhere features you'd have a definitive and working
 answer for retentive assholes like me.

I would say that if you are already using vchanger and it works for you,
you should stick with it.  If someone is setting up a new configuration,
the Virtual Autochanger feature may or may not be able to solve their needs.

Best regards,
Kern

 Dima

Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-09 Thread Kern Sibbald
On 11/08/2014 09:20 PM, Dmitri Maziuk wrote:
 PS. I should probably clarify that bacula has very convenient
 automatic volume management features that work perfectly well with
 single-filesystem disk backup.  It's a pity bacula's disk backup
 mechnism is apparently designed so you can have either automatic
 volume management or multiple disks, but not both.

As mentioned in a prior response, Bacula *may* actually permit both
providing each disk has its own filesystem (path). 

I would add small nuance to what you wrote:  if Bacula does *only* allow
either automatic volume management or multiple disks, it is not by
design, but rather because other than some elementary USB stick code I
wrote and the no longer used DVD code, we never thought about dealing
with the particularities of hot-swappable disks.

By the way, during my vacation I noticed that you gave some very helpful
advice on this list -- thanks.

Kern


 Dima



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Load slots timeout

2014-11-09 Thread Kern Sibbald

  
  
Hello,
  
  Assuming you are using the Bacula mtx-changer script.
  
  In case of really big problems with the mtx-changer script, the
  first step is to execute it by hand and see what it outputs.  The
  second step is to set the environment variable debug_log=1 and the
  working directory at the file mtx.log.  That should give a better
  idea what is going on.
  
  Best regards,
  Kern
  
  On 11/09/2014 05:14 PM, Dan Langille wrote:


  
  
  
  
  

  On Nov 8, 2014, at 7:28 PM, Dan Langille d...@langille.org wrote:
  
  



  

  On Nov 4, 2014, at 6:55 AM, Andrey
Chebotarev a...@525.su
wrote:
  
  


  
  
  

Hi guys.

I use bacula 5.2.13 with IBM TS3200 library.

Periodically I face problem with load slot time
out. In logs it looks lilke:

22-Sep 00:35 baculasrv-dir JobId
  10471: Recycled volume "220AAAL6"
22-Sep 00:35 baculasrv-sd JobId
  10471: 3304 Issuing autochanger "load slot 1,
  drive 1" command.
22-Sep 00:40 baculasrv-sd JobId
  10471: Fatal error: 3992 Bad autochanger "load
  slot 1, drive 1": ERR=Child died from signal
  15: Termination.
Results=Program killed by Bacula
  (timeout)
22-Sep 00:32 sqcompose-fd JobId
  10471: Fatal error: backup.c:1019 Network send
  error to SD.

As I understood, bacula tries to load slot for 5
minutes and if it's not successful stops job.
I started investigation why bacula sometimes
doesn't manage to load slot in 5 minutes and
find out library stops responding to commands
and starts cleaning drive procedure which takes
more than 5 minutes(Library was configured to
clean drive automatically)

So how can I solve the problem?
I've found place in mtx-changer script where
declared 300 seconds to wait. I've increased it
value to 1800 seconds. Is it only place or I
have to change somthing else in sources?
  
  

  

  
  
  
  

  Hi everybody.
Increasing timeout in mtx-changer script hasn't
helped, I have the same issue. Where in sources I
can increase timeout to 30 minutes?
  

  
  
  
  I don’t see why this is on devel  It should be on users,
  which is cc’d here.

  


  
  Have you ensured everything is correct with the permissions
etc?
  
  
  Five minutes to load a tape is way too long for something
which succeeds.  My hypothesis: there is a problem with the
process.
  
  
  Configuring an autochanger has many places where it can go
astray.
  
  
  I documented some of the pitfalls here: http://www.freebsddiary.org/tape-library.php
  
  
  And more of the odd stuff here: http://www.freebsddiary.org/tape-library-integration.php
  
  
  Hope that helps.
  
  
— 
Dan Langille
  
  
  
  
  
  --

  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Load slots timeout

2014-11-09 Thread Kern Sibbald
On 11/10/2014 06:54 AM, Jesper Krogh wrote:
 On 09/11/2014, at 17.14, Dan Langille d...@langille.org wrote:

 Five minutes to load a tape is way too long for something which succeeds.  
 My hypothesis: there is a problem with the process.
 Yes and no

 If the tape has been closed properly then Yes, if it hasnt the first thing 
 the drive is going to do is to pass over the entire tape to get the 
 end-marker position out of the tape which can take way more than 5 minutes 
 and really isnt an error state.  

When Bacula is using mtx (the mtx-changer script) to load a tape, it
does not move the tape to the end of media marker.  This will happen
later only if Bacula is going to write on the tape.  Thus moving to the
end of the media is not part of the timeout for loading a tape -- unless
you have some really non-standard tape drive or OS kernel driver, which
I have never heard of.

Best regards,
Kern


 And to my knowledge there is no way to detect it other than to wait

 Jesper
 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-08 Thread Kern Sibbald
On 11/07/2014 04:48 PM, Dmitri Maziuk wrote:
 On 11/7/2014 7:10 AM, Kern Sibbald wrote:
 Hello,

 I am not sure, but it sounds like you are proposing that Bacula use a
 raw device for storing a Volume.  This is possible. There might be a
 trivial advantage in terms of performance, but there is no real
 advantage or demand to do it.

 The advantage is you can pull the disk out and stick a new one in,
 just like you do with the tape.

 ...  It is, in general, far better to store
 Volumes in a filesystem rather than on a raw disk for a number of
 reasons.  It would even be preferable to dedicate a disk to Bacula and
 have a filesystem on it such as XFS rather than use it as a raw device.

 I agree, however, in the current implementation volumes are files that
 must reside in a single filesystem (or you need a fake autochanger).
 If volumes were directories (i.e. mountpoints), we could use multiple
 removable disks, pull full disk out, stick new one in.

 Maybe you can be more precise about what you want.

 Was that clear enough?

I think so.  If I understand correctly, you want disk mount points or
directories to be treated much like a tape drive, so that you can mount
multiple disks.

I think this feature is already implemented, with one difference from
what I believe you are requesting.  Bacula can already deal with a mount
point where the physical device is removable such as a USB key,
providing your tell Bacula that it is removable.  The difference is that
when the device is mounted, it assumes that it has a filesystem on it
rather than treating it as a raw device.  When the device is first
mounted, Bacula will scan for what volumes are on that device.

Much like the Virtual Autochanger feature, I am not 100% sure where this
is documented, so you may have to search for it. The main requirement
for it to work is to configure the SD Device (even if it is a disk
device) as removable.  I wrote the code to handle backup to USB keys
while I was on vacation -- I just plugged in any USB key, and if there
were any Volumes on the device, they would be used, which is mostly what
you are requesting.

By the way, in case you have not noticed, there are three white papers
posted on the bacula.org web site, two of them, if I am not mistaken,
document Virtual Autochangers as implemented in the community version
(slightly different from the Enterprise version).

www.bacula.org - Documentation - White Papers

Best regards,
Kern


 Dima




--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with installing bacula systemd unit files

2014-11-07 Thread Kern Sibbald
Hello,

Yes, you are correct, currently there is no Makefile command to install
the systemd files.  I like your idea of adding a new configure option. 
I would probably prefer with-systemd-dir= which corresponds to how the
other directories work, then define a default and as you say just add a
new Makefile target -- probably  make install-systemd.

It sounds like a nice little project that is needed and not too hard to
implement.

Have you done any of the work to accomplish this, or are you asking me
or someone else to do it?

Best regards,
Kern

On 11/07/2014 09:07 AM, Can Şirin wrote:
 Hi,

 I am setting up a new backup server with Bacula 7.0.5 on RHEL7. I am going to
 compile it from the source code. Everything is fine but just systemd  
 integration.

 In the configuration options, I use --with-systemd=/usr/lib/systemd/system

 After make command has been ended, I run the make install but  
 unfortunately
 there is no systemd unit file copied by the bacula installation under the
 /usr/lib/systemd/system directory.

 I thought it was needed to run make install-autoconf. With this way  
 only SysV init files are copied.

 How could I install the systemd unit files, without copying them  
 manually from the source (platform/systemd) dir?

 My configure options are;

 CFLAGS=-g -Wall ./configure \
--sbindir=/opt/bacula/bin \
--sysconfdir=/opt/bacula/etc \
--enable-smartalloc \
--with-postgresql=/usr/pgsql-9.3 \
--with-working-dir=/opt/bacula/working \
--with-pid-dir=/opt/bacula/working \
--with-subsys-dir=/opt/bacula/working \
--with-openssl \
--enable-conio \
--with-openssl \
--enable-acl \
--enable-lzo \
--enable-lockmgr \
--with-tcp-wrappers \
--with-dir-user=bacula \
--with-dir-group=bacula \
--with-sd-user=bacula \
--with-sd-group=bacula \
--enable-bat \
--with-systemd=/usr/lib/systemd/system

 Thanks,
 Can



 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with installing bacula systemd unit files

2014-11-07 Thread Kern Sibbald

  
  
Simone,
  
  Would it be worth while to include your enhanced systemd files in
  the Bacula source release for those users who either want to build
  themselves or who want a more advanced template?
  
  If so, could you please send me your files?  I am a bit lazy to
  download and extract them :-)
  
  Thanks,
  Kern
  
  On 11/07/2014 10:42 AM, Simone Caronni wrote:


  
Hello,


  I'm the maintainer of Bacula in Fedora and I've been providing
  repositories for both Bacula 5.x and Bacula 7.x. These are the
  repositories, based on rebuilt packages that are in Fedora
  rawhide:
  
  https://repos.fedorapeople.org/repos/slaanesh/bacula7/
  https://repos.fedorapeople.org/repos/slaanesh/bacula/
  
  On 7 November 2014 09:07, Can Şirin sirin...@itu.edu.tr
wrote:
I am setting up a new
  backup server with Bacula 7.0.5 on RHEL7. I am going to
  compile it from the source code. Everything is fine but
  just systemd
  integration.


  
  Might I ask you what kind of settings you need that
  requires custom compilation of Bacula 7.0.5 on RHEL?
  
  I would like to know what your requirements are regarding
  the packages, so maybe we can integrate what you need in
  the official packages. It's something I've been doing
  during the past years with various users. You can check
  the changelog of the Bacula packages in the official RHEL
  7 channels, there's my name in.
   

  In the configuration options, I use
  "--with-systemd=/usr/lib/systemd/system"
  
  After "make" command has been ended, I run the "make
  install" but
  unfortunately
  there is no systemd unit file copied by the bacula
  installation under the
  /usr/lib/systemd/system directory.
  
  I thought it was needed to run "make install-autoconf".
  With this way
  only SysV init files are copied.



Fedora/RHEL packages carry a different systemd unit
  file for daemons, those in the Bacula source code are much
  more generic (as they need to work on more distributions),
  while the provided ones are much more specific. You can
  check the package contents here:
  
  http://pkgs.fedoraproject.org/cgit/bacula.git/tree/
  

Regards,

--Simone
  

  
  
  -- 
  
You cannot discover new oceans unless you
  have the courage to lose sight of the shore (R. W.
  Emerson).
  
  http://xkcd.com/229/
  http://negativo17.org/

  

  
  
  
  
  --

  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem with installing bacula systemd unit files

2014-11-07 Thread Kern Sibbald
Hello,

OK, yes, it makes sense that the systemd directory code was probably
implemented at the same time as the systemd files.  Simone is going to
give me some enhanced systemd files, and I will add an appropriate
Makefile target for getting them installed.

Thanks for bringing this up.

Best regards,
Kern

On 11/07/2014 01:57 PM, Can Şirin wrote:
 Quoting Kern Sibbald k...@sibbald.com:

 Hello,

 Yes, you are correct, currently there is no Makefile command to install
 the systemd files.  I like your idea of adding a new configure option.
 I would probably prefer with-systemd-dir= which corresponds to how the
 other directories work, then define a default and as you say just add a
 new Makefile target -- probably  make install-systemd.

 Actually, this is not my idea. Systemd support has already been added
 to configure script. So I just wanted to use it.

 [root@bacula bacula-7.0.5]# ./configure --help | grep systemd
   --with-systemd[=UNITDIR]
   Include systemd support. UNITDIR is where
 systemd
 [root@bacula bacula-7.0.5]#


 It sounds like a nice little project that is needed and not too hard to
 implement.

 Have you done any of the work to accomplish this, or are you asking me
 or someone else to do it?


 I haven't done anything. Because there are generic systemd files under
 the source code directory tree whose path is exactly
 bacula-7.0.5/platforms/systemd/
 I can copy them from this path manually.
 So, for now, I am going on with the SysV init scrit until you
 implement it.

 Kind regards.
 Can

 Best regards,
 Kern

 On 11/07/2014 09:07 AM, Can Şirin wrote:
 Hi,

 I am setting up a new backup server with Bacula 7.0.5 on RHEL7. I am
 going to
 compile it from the source code. Everything is fine but just systemd
 integration.

 In the configuration options, I use
 --with-systemd=/usr/lib/systemd/system

 After make command has been ended, I run the make install but
 unfortunately
 there is no systemd unit file copied by the bacula installation
 under the
 /usr/lib/systemd/system directory.

 I thought it was needed to run make install-autoconf. With this way
 only SysV init files are copied.

 How could I install the systemd unit files, without copying them
 manually from the source (platform/systemd) dir?

 My configure options are;

 CFLAGS=-g -Wall ./configure \
--sbindir=/opt/bacula/bin \
--sysconfdir=/opt/bacula/etc \
--enable-smartalloc \
--with-postgresql=/usr/pgsql-9.3 \
--with-working-dir=/opt/bacula/working \
--with-pid-dir=/opt/bacula/working \
--with-subsys-dir=/opt/bacula/working \
--with-openssl \
--enable-conio \
--with-openssl \
--enable-acl \
--enable-lzo \
--enable-lockmgr \
--with-tcp-wrappers \
--with-dir-user=bacula \
--with-dir-group=bacula \
--with-sd-user=bacula \
--with-sd-group=bacula \
--enable-bat \
--with-systemd=/usr/lib/systemd/system

 Thanks,
 Can



 --

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users






--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-07 Thread Kern Sibbald
Hello,

I am not sure, but it sounds like you are proposing that Bacula use a
raw device for storing a Volume. This is possible. There might be a
trivial advantage in terms of performance, but there is no real
advantage or demand to do it.  It is, in general, far better to store
Volumes in a filesystem rather than on a raw disk for a number of
reasons.  It would even be preferable to dedicate a disk to Bacula and
have a filesystem on it such as XFS rather than use it as a raw device.

Maybe you can be more precise about what you want.

By the way, the Bacula code that writes disk and tape is virtually
identical.  Only the open and close and seek is different.  The seeking
on tape devices is far more complex than seeking on a disk, which is
byte oriented (at least at the application level), rather than
file/block oriented as a tape device is.

Best regards,
Kern

On 10/28/2014 03:59 PM, Dmitri Maziuk wrote:
 On 10/28/2014 8:24 AM, Alan Brown wrote:
 ...
 Tape and disk are different animals and need to be approached differently.

 Virtual autochangers are a kludge to allow for removable disks but in
 most configured installations they do _not_ treat those disks in the
 same way as real tape drives.
 OT comment: I'll probably never understand that, I always thought a 
 block device is a block device and one of the unix's strong points was 
 to abstract away the physical differences and let the same code work 
 with either. AFAICT the only reason they're different (in how SD treats 
 them) is because the software is written that way...

 Dima





--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] WinBin 7.0.5 on w2k3(x86), bat+tray-monitor - missing mingwm10.dll

2014-11-06 Thread Kern Sibbald

  
  

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Hello,

Where did you get the binaries?  Can you show me the full names of
those binaries?

Best regards,
Kern

On 10/27/2014 09:55 AM, Harald Schmalzbauer wrote:
  Hello,
  
   I just upgraded bat from 6.0.6 to 7.0.5. On W2k8(amd64), bat
  now runs
   much more stable!
   On Windows Server 2003 (x86), bat refuses to start with the
  same error
   like bacula-tray-monitor:
   Missing mingwm10.dll.
  
   Unfortunately just taking the on from Bacula 6.0.6 dosn't
  solve the
   problem. The error message vanishes, but both (bat and
  tray-monitor) are
   not starting.
  
   FD just works fine on 2k3 though.
  
   Best regards,
  
   -Harry
  
  
  
  
--
  
  
   ___
   Bacula-users mailing list
   Bacula-users@lists.sourceforge.net
   https://lists.sourceforge.net/lists/listinfo/bacula-users

-BEGIN PGP SIGNATURE-
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlRbr58ACgkQNgfoSvWqwEibrgCfXYMSyhOkQ26zhXW9De34VidW
UPYAoOX53lnV3QzEmtp9+Q8jHs1Q3XDp
=H+MQ
-END PGP SIGNATURE-

  


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-06 Thread Kern Sibbald
On 10/28/2014 02:24 PM, Alan Brown wrote:
 On 28/10/14 12:46, Ana Emília M. Arruda wrote:

 ​You have autochangers resources (fisical for tape librareis and virtual
 for disks) in Bacula. They are a pool of drives to be used by your
 jobs. I still think about having jobs and pools associated with clients
 instead of devices associated with clients are the better choice.
 Devices are not associated with any clients. They're used as-available. 
 Tying devices to clients is an unnecessary restriction on resources and 
 generally indicates accountants gone mad or lack of thought about what 
 you are trying to achieve.

 In spite of this, If you have to work with tape drives (stand alone or
 tape library ones connected directly - not in a fabric topology)
 They are fabric connected.

 , maybe
 a second device definition for a job or pool could be more helpful than
 a bacula-sd.conf reload on-the-fly or the enable/disable commands.
 This does not work. I've tried it.

 If an autochanger tape drive fails, jobs pile up behind it.

 What's far worse than a drive failing is one getting dirty - they spend 
 forever doing rewrites and througput drops from hundreds of Mb per 
 second to 10-20, WITHOUT raising errors in the backup system - and 
 running a cleaning tape doesn't work in a lot of cases (LTO drives are 
 self cleaning, If you need a tape then you're already in trouble)

 This is far from ideal behaviour, especially when there are petabytes of 
 science data involved.


 The only way out of either situation at the moment involves restarting 
 the storage daemon, which kills ALL jobs running on ALL drives.



 Comment: Please don't presume to lecture me about what I should or 
 should not be doing in my enterprise environment, or indeed about the 
 way systems are setup (it's all fabric path for starters and bacula does 
 not do d2d unless you count disk spooling 

I am surprised that you say that Bacula does not do d2d.  With Copy and
Migration jobs that is exactly what it does.

What it does not do is Hierarchical backups as well as it should since
it does not have the concept of cost or speed.


 - which we use intensively), 
 you have no idea of the operational constraints on my site and you're 
 making a bunch of fairly arrogant assumptions about the way things are 
 run which impinge on the way you think Bacula should operate.

 It's this kind of attitude which results in inflexible software that 
 gets sworn at, rather than sworn by.


 Thankfully Kern and his team are well aware that needs vary depending on 
 setups and that multiple-tape drive setups need improvement.

Yes.


 Tape and disk are different animals and need to be approached differently.

 Virtual autochangers are a kludge to allow for removable disks but in 
 most configured installations they do _not_ treat those disks in the 
 same way as real tape drives.

Virtual autochangers were not written for removable disks.  Prior to
virtual autochangers, I wrote code that allows (at least for me) Bacula
to deal with removable disks such as USB sticks.   Virtual autochangers
were written to allow much more flexibility with disks -- i.e. multiple
drives on one Storage, multiple directories, ... For the most part
virtual autochangers with fixed disks functions virtually identically to
tape drives similarly configured.

I am not sure why you consider virtual autochangers a kludge, since it
does *exactly* what I intended it to do for fixed disks.  I have never
tried using *removable* disks with virtual autochangers, nor even
thought about it, so perhaps you are trying to make it do something it
was not designed for.   In fact, there is a chance that removable disks
will work well with virtual autochangers, *provided* you tell Bacula it
is working with a removable device so it can use the removable disk code.

Best regards,
Kern






 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-06 Thread Kern Sibbald

  
  

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 10/28/2014 07:39 PM, Dimitri Maziuk wrote:
 On 10/28/2014 01:04 PM, Alan
  Brown wrote:
  
   Block devices may be block devices, but a tape drive is a
  character device.
  
   Oops. Works either way, disks are char aka "raw" devices too.
  
   People coming from a tape environment tend to see tapes
  (volumes) as
   something you use for a pool of clients or filesets,
  because changing
   volumes is NOT trivial, the tapes are only reated for a
  limited number
   of load cycles and you can only access one volume at a
  time.
  
   If you have more tape drives you can access more volumes
  simultaneously,
   but changing volumes is no less difficult/timeconsuming.
  
   As is changing disks. Skipping from one tarball to another on
  tape may
   take much longer, but that shouldn't make any difference to
  the
   higher-level code.
  
   There is no reason to see file volumes as dedicated to a
  client AFAICT;
   those who want it can do pool per client and volumes per pool
  -- works
   with tapes just as well.
  
   Yes, in general you can access multiple files on the same
  disk
   simultaneously. I don't expect that a backup application
  streaming data
   to or from that disk would -- or should -- actually do that,
  for any
   number of obvious reasons.

The above confuses me, because Bacula can stream multiple
simultaneous job data to a disk -- they will of course be streamed
into separate files, but nevertheless, you can have as many Bacula
steams going simultaneously to a given disk drive.  Bacula can also
have multiple writes to the same disk file, but of course Bacula
must sequence the writes to be able to capture correct disk
addresses for the restore.


  
   Which is why I'll never understand the tape/disk dichotomy.
  
   (As an aside, bacula, specifically, seems to force you to use
  different
   Media Type for each physical device so I don't get how it
  would work
   with multiple drives in the same jukebox, either --
  thankfully I don't
   need to.)

To be more precise, Bacula does not require you to use different
Media Types for different devices.  It only does so for different
disk devices so that it can be sure where the Volume is actually
stored.   For a compatible tape drives in an autochanger, there is
no need to have different Media Types.  However, if you have
multiple separate libraries the Media Type must be different so that
Bacula is sure what library the Volume is in (it actually keeps a
device index, but this is often insufficient).

Best regards,
Kern



  
  
  
--
  
  
   ___
   Bacula-users mailing list
   Bacula-users@lists.sourceforge.net
   https://lists.sourceforge.net/lists/listinfo/bacula-users

-BEGIN PGP SIGNATURE-
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlRbt38ACgkQNgfoSvWqwEjnUQCfSOAEbCisEiI5zfGS2roZ1sEL
V0EAn28D4+yLzkzOcwfszYq5q3qOfy12
=mf19
-END PGP SIGNATURE-

  


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-06 Thread Kern Sibbald
On 10/28/2014 07:46 PM, Alan Brown wrote:
 On 28/10/14 18:39, Dimitri Maziuk wrote:

 There is no reason to see file volumes as dedicated to a client AFAICT;
 Habit, I suspect. It's a bad one, given there's a database driving 
 everything to tell you what is where.

 (As an aside, bacula, specifically, seems to force you to use different
 Media Type for each physical device so I don't get how it would work
 with multiple drives in the same jukebox, either -- thankfully I don't
 need to.)
 It's been more than happy to set the media type to LTO-5 on 7 drives, 
 LTO-2 on 2 (different changer) and LTO-6 on another.

 What it can't handle is that you can load media types LTO4 RW in the 
 LTO5 drives and also LTO3 RO, which would be extremely handy.

This is on our list ...






 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-11-06 Thread Kern Sibbald

  
  

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 10/28/2014 08:23 PM, Dimitri Maziuk wrote:
 On 10/28/2014 01:46 PM, Alan
  Brown wrote:
   On 28/10/14 18:39, Dimitri Maziuk wrote:
  
   (As an aside, bacula, specifically, seems to force
  you to use different
   Media Type for each physical device so I don't get
  how it would work
   with multiple drives in the same jukebox, either --
  thankfully I don't
   need to.)
  
   It's been more than happy to set the media type to LTO-5
  on 7 drives, 
   LTO-2 on 2 (different changer) and LTO-6 on another.
  
   What it can't handle is that you can load media types
  LTO4 RW in the 
   LTO5 drives and also LTO3 RO, which would be extremely
  handy.
  
   We used ait-1 tapes in ait-3 drive with notworker and just
  ignored the
   "premature eot" (or whatever it was) barf.
  
   But I was referring to Kern's
  
   Message-ID: 518dd7f5.7080...@sibbald.com
   Date: Sat, 11 May 2013 07:32:37 +0200
   From: Kern Sibbald k...@sibbald.com
   Subject: Re: [Bacula-users] backup to multiple disks
   ...
   Yes, Media Type is very important.  It must
   be in the Storage resources on the Director
   side, and notice that as I mentioned before, on
   the SD side, Autochanger really just groups a
   number of Devices.  The Media Type must be
   in each Device, because each one can be different
   so it is not in the Autochanger resource.
  
   There is no restriction for multiple devices to have
   the same Media Type, but if they are disk devices
   and don't have the same Archive Device, Bacula
   won't be able to "mount" them.  So, use the same
   Media Type only in Devices that have the same Archive
   Device.
  
   I expect someone had reasons to code it that way for disk
  devices
   specifically, and they may even seemed good at the time

It sounds like you are complaining about the above implementation. 
If it is true that you don't like how it is coded (I assume you mean
designed), how would you want it designed?

Kern


  
  
  
  
--
  
  
   ___
   Bacula-users mailing list
   Bacula-users@lists.sourceforge.net
   https://lists.sourceforge.net/lists/listinfo/bacula-users

-BEGIN PGP SIGNATURE-
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlRbuJ4ACgkQNgfoSvWqwEg2sQCg6kWWf5axcZkjm8KUHEUIoYtw
o30AoNmwTmJMGZAoxd+dUfexFlcfv9+G
=fZ4T
-END PGP SIGNATURE-

  


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] is not a Bacula labeled Volume, because: ERR=block.c:1023 Re

2014-11-06 Thread Kern Sibbald
Someone wrote an end of file on the beginning of the Volume,  you
probably should see if there are multiple files on that tape.  If so,
you may be able to recover some valid data after the tape end of file,
but this is generally tricky and time consuming.

btape has commands that will allow you to scan the tape to see what is
on it.  However, be careful.  It is also easy to write on the tape with
btape.  Better set the read-only tab before referencing it.

Best regards,
Kern

On 10/29/2014 10:47 AM, Che_m wrote:
 I can't even use bextract or bcopy on that one tape. it gives me the same 
 errors.

 Warning: acquire.c:265 Read acquire: Requested Volume AOB760L4 on 
 tape_Drive (/dev/nst0) is not a Bacula labeled Volume, because: 
 ERR=block.c:1023 Read zero bytes at 0:0 on device tape_Drive (/dev/nst0)


 Regards
 Che

 +--
 |This was sent by c...@belnet.be via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--



 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Bacula Status Report

2014-11-06 Thread Kern Sibbald
On 10/29/2014 02:02 PM, Pasi Kärkkäinen wrote:
 On Wed, Oct 15, 2014 at 12:49:33PM +0200, Kern Sibbald wrote:
 Hello,

 On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote:
 On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote:
 Hello,

 Hello,

 I have posted a Bacula Status report to the www.bacula.org site.
 It discusses the following items:

 1. Bacula Release Status

 2. Windows Binaries

 Hmm.. so there are no community windows binaries anymore?
 There have not been any for quite a number of years -- since 5.2.10.
 Yep. I assume those 5.2.10 windows (client) binaries should still work with 
 the latest Bacula server?


 Are the windows binaries shipped by Bacula Systems proprietary or 
 opensource ?
 They are proprietary but they can be obtained freely by Bacula open
 source users, and hopefully by everyone for personal use by the end
 of the year.

 OK.

 The principal reason for only one version of the Windows binaries
 was that for several years I was way too overloaded with work and
 had to reduce somewhere, and since Windows is especially painful,
 that is where I reduced.  I am now much less overloaded, so hope to
 correct a number of such problems by the end of the year.

 I can see that.. any plans to opensource the windows agent,
 at least the core components for basic file backups? 

I have asked Bacula Systems to give the Enterprise version to individual
Bacula community users.  I will know by the end of the year.  That would
probably resolve the problem.  I still do not have the time to maintain
two separate code bases for Windows.  However, if I cannot get
permission to give the Enterprise version free to individual users (this
excludes, enterprises, ...) then I will create a separate community
version of Windows (one or the other will be available by 1Q15).  In the
mean time, if you are a Bacula contributor, you can get the Windows
binaries free, and if not, the price is ridiculously low considering all
the work that goes into making them.

Best regards,
Kern



 Thanks for the reply!

 -- Pasi

  
 Best regards,
 Kern


 Thanks,

 -- Pasi


 3. Bacula Enterprise

 4. Vacation

 5. Bareos

 The following is a link to the report.

 http://blog.bacula.org/bacula-status-report-30-august-2014/

 Best regards,
 Kern



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Bacula Status Report

2014-11-06 Thread Kern Sibbald

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 10/29/2014 06:41 PM, Dan Langille wrote:

 On Oct 29, 2014, at 9:02 AM, Pasi Kärkkäinen pa...@iki.fi wrote:

 On Wed, Oct 15, 2014 at 12:49:33PM +0200, Kern Sibbald wrote:
 Hello,

 On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote:
 On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote:
 Hello,

 Hello,

 I have posted a Bacula Status report to the www.bacula.org site.
 It discusses the following items:

 1. Bacula Release Status

 2. Windows Binaries

 Hmm.. so there are no community windows binaries anymore?

 There have not been any for quite a number of years -- since 5.2.10.

 Yep. I assume those 5.2.10 windows (client) binaries should still
work with the latest Bacula server?



 Are the windows binaries shipped by Bacula Systems proprietary or
opensource ?

 They are proprietary but they can be obtained freely by Bacula open
 source users, and hopefully by everyone for personal use by the end
 of the year.


 OK.

 The principal reason for only one version of the Windows binaries
 was that for several years I was way too overloaded with work and
 had to reduce somewhere, and since Windows is especially painful,
 that is where I reduced.  I am now much less overloaded, so hope to
 correct a number of such problems by the end of the year.


 I can see that.. any plans to opensource the windows agent,
 at least the core components for basic file backups?

 My understanding is the windows agent source code is open source.

This is true, but I stopped updating the Community Windows source as of
5.2.10, then in the 7.0.0 tree, I removed the whole Win32 directory
since it is so out of date, and the old 5.2.9 (or 5.2.10? I forget which
one) is still available.



 The binaries are no longer supplied by the community because the
community stopped building them.

 That’s why Bacula Systems stepped up and starting providing binaries.

Very true.

The Bacula Enterprise Windows binaries are for sale but at a very low
price.  If you are a Bacula contributor (name in AUTHORS file) you get
them free by asking.  I am hoping to have them free by the end of the
year for all individual users.

Best regards,
Kern



 —
 Dan Langille


-BEGIN PGP SIGNATURE-
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlRbvQUACgkQNgfoSvWqwEgr3QCeJl/osbq48Yi+fGcuma/jQj6Q
moIAniAUMICg9i6cktudoSVPHvjhWgC2
=4gxa
-END PGP SIGNATURE-


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] I love Bacula. Have to confess.

2014-11-06 Thread Kern Sibbald
Good idea.  In fact, that is how we looked at the Bacula Conference. 
Most of the presentations are mostly community oriented, but of course,
Bacula Systems has a lot to say also.  The conference is open to everyone.

Best regards,
Kern

On 10/30/2014 11:33 AM, hei...@bacula.com.br wrote:
 Hi there,

 Spreading the love: I think we need to organize a community get together in 
 the next Bacula Conference.

 Regards,
  
 Heitor Medrado de Faria 
 Need Bacula training? 10% discount coupon code at Udemy: bacula-users 
 +55 61 2021-8260 | 8268-4220 
 Site: www.bacula.com.br | Facebook: heitor.faria | Gtalk: 
 heitorfa...@gmail.com 
  


 - Original Message -
 From: Jari Fredrisson ja...@iki.fi
 Cc: bacula-users bacula-users@lists.sourceforge.net
 Sent: Thursday, October 30, 2014 4:45:24 AM
 Subject: Re: [Bacula-users] I love Bacula. Have to confess.

 On 30.10.2014 5:03, Dan Langille wrote:
 On Oct 29, 2014, at 6:08 PM, Jari Fredrisson ja...@iki.fi wrote:

 Hands down the best software I have used Ever. This software has never
 laid me down.

 Thank You, Kern Sibbald and Bacula Systems!
 Which database are you using? :)

 — 
 Dan Langille

 We use Maria DB 5.5. No problems whatsoever with Bacula, while MySQL 5.5
 is sometimes picky with other apps.

 br. jarif



 --

 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO speed optimisation

2014-11-06 Thread Kern Sibbald

  
  
Hello,
  
  I recommend that you use caution when applying information from a
  new fork with relatively young programmers.  Bareos recommends
  setting the block size to 1M.  However, myself, and confirmed by
  Quantum for LTO-4 tapes (may change with LTO-5, 6) is that
  anything greater than 512K may increase throughput but will
  significantly increase errors on dirty drives or old tapes.  Thus
  you risk losing data.
  
  I currently have a project to ease the problems of changing block
  sizes for tapes in Bacula (hopefully by year end).  I have not
  confirmed, but suspect that if you increase the Maximum Block Size
  to 512K, you will be able to read/write new volumes and you will
  also be able to read old volumes.  I am not sure if read/write of
  old volumes would be a good idea though as you would then have a
  volume with two block sizes, which should work, but I wouldn't try
  it.
  
  I think (and hope) that the only problem you will get into, is
  that if you write a volume with 512K blocks, currently, you will
  not be able to read it back with a Bacula configured for 64K block
  sizes.
  
  If you test and confirm or infirm any of my points, please let us
  know.
  
  Best regards,
  Kern
  
  On 11/05/2014 12:48 PM, Roberts, Ben wrote:


  Hi all,
  
  I'd like to try and make some speed improvements to my Bacula
  setup (5.2.13, Solaris11). I have data (and attribute) spooling
  enabled using a pool of 46x 1TB directly-attached SAS disks
  dedicated to this purpose. Data is being despooled to 2x
  directly-attached SAS LTO6 drives at around 100mB/sec each. I
  think I should be able to get closer to the ~160mB/s maximum
  uncompressed thoughput the drives and tape media support (ref: http://docs.oracle.com/cd/E38452_01/en/LTO6_Vol4_E1/LTO6_Vol4_E1.pdf).
  
  I've just done a speed test and can read from the spool array at a
  sustained 300mB/sec even while other jobs are running, so I'm sure
  there's no bottleneck at the disk layer. My suspicion is that the
  bottleneck is at the application layer, probably due to the way I
  have Bacula configured.
  
  Having read through Bareos' tuning paper
  (http://www.bareos.org/en/Whitepapers/articles/Speed_Tuning_of_Tape_Drives.html),
  I've updated the max file size from 1-50GB which increased the
  throughput from ~75 to ~100mB/sec. I believe I need to look at
  tuning the block size to gain the last bit of improvement.
  
  Is it still the case in Bacula that changing the Maximum Block
  Size renders previously used/labelled tapes to become unreadable?
  I'm up to almost 1,000 tape media already written, so making these
  unusable for restores without restarting the SD to change configs
  would be less than ideal. I see Bareos is touting a feature to
  make changes to block size at the pool level rather than the
  storage level and so this problem can be avoided by moving newer
  backups to a different pool while still keeping older backups
  readable. I haven't seen any reference to this in the Bacula
  manual; is it something that's already supported or in the plans
  for a future version?
  
  For reference, this is one of the the relevant drive definitions
  I'm using, just in case there's something else that would help
  which I might have missed:
  Device {
  Name = drive-1-tapestore1 
  Archive Device = /dev/rmt/1mbn
  Device Type = Tape 
  Media Type = LTO6
  AutoChanger = yes
  Removable media = yes
  Random access = no
  Requires Mount = no
  Drive Index = 1
  Maximum Concurrent Jobs = 3
  Maximum Spool Size = 1024G
  Maximum File Size = 50G 
  Autoselect = yes 
  }
  
  Regards,
  Ben Roberts
  
  This email and any files
transmitted with it contain confidential and proprietary
information and is solely for the use of the intended recipient.
If you are not the intended recipient please return the email to
the sender and delete it from your computer and you must not
use, disclose, distribute, copy, print or rely on this email or
its contents. This communication is for informational purposes
only. It is not intended as an offer or solicitation for the
purchase or sale of any financial instrument or as an official
confirmation of any transaction. Any comments or statements made
herein do not necessarily reflect those of GSA Capital. GSA
Capital Partners LLP is authorised and regulated by the
Financial Conduct Authority and is registered in England and
Wales at Stratton House, 5 Stratton Street, London W1J 8LA,
number OC309261. GSA Capital Services Limited

Re: [Bacula-users] Webacula 7. Coming…

2014-10-28 Thread Kern Sibbald

Hello,

It is not particularly easy to parse Bacula configuration files, 
particularly the FileSet resource, and I am not sure it can be done with 
regex.  However, Bacula does read its own conf files, and there is a 
program named DassModus (posted on Internet) that reads Bacula conf 
files in Python partially using regexes ...


Concerning your conf file listed below.  I am 99% sure it is not a 
valid conf file and could not even be scanned by Bacula.


If you are worried about all the things that Bacula permits such as 
spaces in names, simply define a simpler Bacula syntax where names 
cannot have spaces.  Another way is to choose your own format (such as 
xml, which as you know, I do not like) and use it since it is easy to 
parse with web tools, then convert it into Bacula syntax before giving 
it to Bacula.  Converting xml, json, or any other representation into 
Bacula should be a lot easier than going the other way.


Best regards,
Kern

On 14-10-28 04:19 AM, Yuriy Tim wrote:

I  kept  my  old letter  (2011 :)

I tried to parse the bacula-dir.conf.
However, this is probably not possible with simple regexp's.
It turned out that some applications, for example, Webmin does this
with a regexp.

But they're doing it wrong!

For example, here is test configuration (which is written according to
Bacula Main Reference: Customizing the Configuration Files)
contains no errors in terms of Bacula (I checked it) but it would be
wrong parsed (I have not tested it, but I'm sure of it) by 3rd parties
parsers (not native) :

-
# comment1
  # comment2

c  o n s o l e
{ Name=name1; Password = p; \\\a s s w o rd; J o b A C L = *all\*
}Con sole { N a m e = name 2; Pass word = password; JobACL =
job/\1, job2, job3
}

-


I.e. in other words to parse with regexp any Bacula configuration will
be very difficult.


2014-10-28 7:08 GMT+03:00 Victor Hugo dos Santos listas@gmail.com 
mailto:listas@gmail.com:


On Sat, Oct 25, 2014 at 3:09 PM, Kern Sibbald k...@sibbald.com
mailto:k...@sibbald.com wrote:
 On 14-10-05 03:36 AM, Yuriy Tim wrote:

 What I have in mind:
 1 store all config files in the database
 2 to store all the jobs in the database (for example, scheduled
tasks, and
 not only already made)
 3 to store other information in the same database
 4 to have a function that preserves the tree to the the database
for select
 the files and restore. Now it makes BVFS,but for Web-UI is useless.

 I once wrote in the bacula-devel but 

 Bacula configuration files editing ? NOO! :)


 I am not sure why any one would object to doing configuration
file editing
 in a Web based GUI -- we have that in Bacula Enterprise.  Also
who you asked
 to program it and when could make a big difference in the
response ...

 Where I am not very enthusiastic is to put the configuration
files in the
 SQL database.  This would make it harder to recover Bacula
during disaster
 recovery, and if you destroyed your database, it could make it
impossible to
 even start Bacula.

Hi

I think the same with you about the posibility to store the
configuration in database (is a very, very, very bad idea) !!!
but, maybe the idea of this mail (If not, Yuriry can use this idea to
improve webacula) is to use a database to save all the hosts, files,
storages and others only to webacula interface... After the end, the
user will apply the changes and so, the GUI get all the information
from the database and generate a new bacula-dir.conf for example.

that is the same idea that the Centreon project use to make the nagios
configuration files, and IMHO, I believe that is a good idea.

salu2


--
--
Victor Hugo dos Santos
http://www.vhsantos.net
Linux Counter #224399




--
with best regards


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-25 Thread Kern Sibbald
Yes, your definition is clear, and it is what the Director does.  
However, programming it is much more difficult, especially for the SD 
where you are dealing with physical devices that are locked.  In Apache, 
the Bacula Director, and elsewhere there are not physical devices that 
have to be locked when writing.

Anyway, this is something I would like to see, but someone needs to 
program it ...

Kern

On 14-10-24 09:28 AM, Andrea Carpani wrote:
 On 24/10/2014 12:47, Kern Sibbald wrote:
 No, the SD and the FD cannot be reloaded. On the FD in principle it 
 would be easy, but on the SD, it would be complicated if drives 
 changed.  What would you do with Jobs that are using a drive that 
 would be removed from the reload?

 I'm not that deep into backup software, so maybe I'm saying something 
 stupid, but a config reload could do the same thing that other 
 software do, that is:
  - continue servicing current requests with the previous conf and
  -  use the new conf for new requests.

 Something like a graceful restart apache does.

 Does this make sense?

 .a.c.



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-25 Thread Kern Sibbald

Very well said, thanks.

Kern

On 14-10-24 09:55 AM, Bryn Hughes wrote:

On 14-10-24 05:28 AM, Andrea Carpani wrote:

On 24/10/2014 12:47, Kern Sibbald wrote:

No, the SD and the FD cannot be reloaded.  On the FD in principle it
would be easy, but on the SD, it would be complicated if drives
changed.  What would you do with Jobs that are using a drive that
would be removed from the reload?

I'm not that deep into backup software, so maybe I'm saying something
stupid, but a config reload could do the same thing that other software
do, that is:
   - continue servicing current requests with the previous conf and
   -  use the new conf for new requests.

Something like a graceful restart apache does.

Does this make sense?

.a.c.

Sense to humans yes, sense to program code not so much.

The nature of the SD is that its configuration should almost never 
change - all it has for config is an inventory of hardware devices. 
There's a certain elegance in simplicity that would be lost trying to 
cover what should be a fairly narrow use case.


Imagine all the debugging you have to do - is this job failing because 
it is trying to use the config as it appears in the config file, or 
some other config in memory from some time in the past? What happens 
if we now have different device names referring to the same physical 
device, we now need a whole locking mechanism that can cover the use 
case of multiple versions of the SD config accessing the same physical 
device, possibly with different parameters and names.  How would you 
be able to tell which version of the config a given job is using? 
Remember it is easy to start a backup job that can last a couple of 
days - a full backup of a huge fileserver for instance.


Things would get really messy really fast, with practically no 
benefit.  Your SD config likely changes what, once or twice per year?  
If that?  It is much safer to just restart the SD when you have an 
idle period between backups.


Bryn


--


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-25 Thread Kern Sibbald
I am not sure a disable drive command is *exactly* what he needs, but 
that feature is already planned for the not too distant future.

ISP do typically want physical separation of data, which is possible 
with pools and pool naming conventions rather than drives 
(directories).  The simplest approach would be to use drives, each with 
a different directory, but Bacula doesn' t handle that as well as pools 
with names that are specific to a pool.

On 14-10-24 02:02 PM, Bryn Hughes wrote:
 On 14-10-24 09:32 AM, Alan Brown wrote:
 (Why would you want to disable a drive? If it's offline because it
 failed its cleaning cycle, as a f'instance)
 So what you need is a feature request to be able to disable a drive via
 bconsole  Not to be able to dynamically reload the SD configuration.

 Bryn

 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem installing bacula on Solaris 10

2014-10-25 Thread Kern Sibbald

On 14-10-24 09:45 PM, Kenneth Garges wrote:
I’m trying to build  Bacula 7.0.4 on a Solaris 10 box (Sun T5220) but 
am getting this error during the configure:


Doing make of dependencies
==Entering directory /home/garges/bacula-7.0.4/src
==Entering directory /home/garges/bacula-7.0.4/scripts
==Entering directory /home/garges/bacula-7.0.4/src/lib
mksh: Fatal error in reader: = missing from replacement macro reference
Current working directory /home/garges/bacula-7.0.4/src/lib
*** Error code 1
The following command caused the error:
for I in src scripts src/lib src/findlib src/filed  src/console 
src/plugins/fd src/cats src/dird src/stored src/tools manpages; \
do (cd $I; echo ==Entering directory `pwd`; make DESTDIR= depend || 
exit 1); done

make: Fatal error: Command failed for target `depend'
chmod: WARNING: can't access storage-ctl
chmod: WARNING: can't access bsg_persist

Following a suggestion I read on the net I changed line 52 of 
Makefile.in to force configure to use gmake instead of the Solaris make:


-bash-3.2$ more +52 -1 Makefile.in
  do (cd $$I; echo ==Entering directory `pwd`; 
/opt/csw/bin/gmake DESTDIR=$(DESTDIR) $@ || exit 1); done


That changes the error to:

Doing make of dependencies
==Entering directory /home/garges/bacula-7.0.4/src
gmake[1]: Entering directory `/home/garges/bacula-7.0.4/src'
gmake[1]: Nothing to be done for `depend'.
gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/src'
==Entering directory /home/garges/bacula-7.0.4/scripts
gmake[1]: Entering directory `/home/garges/bacula-7.0.4/scripts'
gmake[1]: `depend' is up to date.
gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/scripts'
==Entering directory /home/garges/bacula-7.0.4/src/lib
gmake[1]: Entering directory `/home/garges/bacula-7.0.4/src/lib'
/bin/sh: # DO NOT DELETE: nice dependency list follows: not found
gmake[1]: *** [depend] Error 1
gmake[1]: Leaving directory `/home/garges/bacula-7.0.4/src/lib'
*** Error code 1
The following command caused the error:
for I in src scripts src/lib src/findlib src/filed  src/console 
src/plugins/fd src/cats src/dird src/stored src/tools manpages; \
do (cd $I; echo ==Entering directory `pwd`; /opt/csw/bin/gmake 
DESTDIR= depend || exit 1); done

make: Fatal error: Command failed for target `depend'
chmod: WARNING: can't access storage-ctl
chmod: WARNING: can't access bsg_persist

Trying to run it manually gives the same error:

-bash-3.2$ cd src/lib
-bash-3.2$ /opt/csw/bin/gmake DESTDIR= depend
/bin/sh: # DO NOT DELETE: nice dependency list follows: not found
gmake: *** [depend] Error 1

The error seems to imply the shell is trying to execute the last line 
of the Makefile.in which is a comment!

-bash-3.2$ tail -2 Makefile.in
# DO NOT DELETE: nice dependency list follows

-bash-3.2$ tail -2 Makefile

# ---



So I’m stumped. What should I try next?




Here’s the whole dialog:

*PATH*=/opt/csw/bin:/usr/bin:/usr/ccs/bin:/etc:/usr/openwin/bin:/usr/local/bin:/usr/ucb:/usr/sbin
*export* PATH

*LDFLAGS*=-L/opt/csw/lib -R/opt/csw/lib -L/opt/csw/lib/openssl 
-R/opt/csw/lib/openssl -I/opt/csw/include -I/opt/csw/include/openssl

*export* LDFLAGS
*
*
*CFLAGS*=-g -I/opt/csw/include -lcrypto -lssl -L/opt/csw/lib 
-R/opt/csw/lib

*export* CFLAGS

./*configure* \
--sbindir=/usr/local/bin \
--sysconfdir=/etc/bacula \
--with-postgresql=/opt/csw \
--enable-smartalloc \
--with-pid-dir=/var/bacula/working \
--with-subsys-dir=/var/bacula/subsys \
--with-working-dir=/var/bacula/working \
--with-dir-user=bacula \
--with-dir-group=backup \
--with-sd-user=bacula \
--with-sd-group=backup \
--with-fd-user=root \
--with-fd-group=backup \
--with-dump-email=gar...@ucsc.edu 
mailto:with-dump-email=gar...@ucsc.edu \

--with-job-email=gar...@ucsc.edu mailto:with-job-email=gar...@ucsc.edu \
--with-smtp-host=smtp.ucsc.edu http://smtp.ucsc.edu \
--with-openssl=/opt/csw \
--disable-ipv6 --disable-batch-insert

checking for true... /usr/bin/true
checking for false... /usr/bin/false
configuring for Bacula 7.0.4 (04 June 2014)
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether we are using the GNU C compiler... yes
checking whether gcc accepts -g... yes
checking for gcc option to accept ISO C89... none needed
checking for g++... g++
checking whether we are using the GNU C++ compiler... yes
checking whether g++ accepts -g... yes
checking whether gcc and cc understand -c and -o together... yes
checking how to run the C preprocessor... gcc -E
checking for grep that handles long lines and -e... /usr/xpg4/bin/grep
checking for egrep... /usr/xpg4/bin/grep -E
checking whether gcc needs -traditional... no
checking for g++... /usr/local/bin/g++
checking for a BSD-compatible install... /opt/csw/bin/ginstall -c
checking for 

Re: [Bacula-users] Sparse Files

2014-10-25 Thread Kern Sibbald

On 14-10-20 02:29 PM, Sam M wrote:

Hello,

I'm having issues with Sparse Files in Bacula. My data was being 
backed up with no issues at all. Once I moved my data onto a NetApp 
storage the size of the backup went up from 1.4 TB to 5 TB. I have 
Sparse = yes added in bacula-dir.conf which it worked before the 
move to NetAPP.


Any help would be much appreciated.


Since there is no Bacula client for NetApp, you are probably backing up 
over a NFS or possibly a CIFS (??) network mount.  Network mounts work 
very well (i.e. very fast) on NetApp if you tune them correctly, but 
network mounts are a 3rd class product compared to a directly mounted 
drive.  Basically they have a very primitive API, and in addition, I am 
not even sure that NetApp has the concept of sparse files or if their 
implement of sparse files (assuming they have one) corresponds to what 
Unix/Linux has (i.e. a file with holes in it, which has similar 4096 
blocking size).


Bottom line: if you have sparse files (somewhat unusual except for Linux 
system files) use a regular Linux mount with a filesystem such as EXT4 
that supports sparse files as Bacula expects.


Kern



Thanks,
Sam


--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Webacula 7. Coming…

2014-10-25 Thread Kern Sibbald

On 14-10-05 03:36 AM, Yuriy Tim wrote:



2014-10-05 2:44 GMT+03:00 Heitor Faria hei...@bacula.com.br 
mailto:hei...@bacula.com.br:


Congratulations, Tim! We use Webacula a lot here in Brazil.
Are there any other features on the roadmap? E. g.: configuration
files editing?


Much could be done!
If Bakula would be more friendly to the Web-UI's.

What I have in mind:
1 store all config files in the database
2 to store all the jobs in the database (for example, scheduled tasks, 
and not only already made​​)

3 to store other information in the same database
4 to have a function that preserves the tree to the the database for 
select the files and restore. Now it makes BVFS,but for Web-UI is useless.


I once wrote in the bacula-devel but 

Bacula configuration files editing ? NOO! :)


I am not sure why any one would object to doing configuration file 
editing in a Web based GUI -- we have that in Bacula Enterprise. Also 
who you asked to program it and when could make a big difference in the 
response ...


Where I am not very enthusiastic is to put the configuration files in 
the SQL database.  This would make it harder to recover Bacula during 
disaster recovery, and if you destroyed your database, it could make it 
impossible to even start Bacula.


Best regards,
Kern





Regards,

On Sat, Oct 4, 2014 at 8:05 PM, Yuriy Tim tim4...@gmail.com
mailto:tim4...@gmail.com wrote:

I'll be back :)

New features:

 1.  Compatible with Bacula 7.x
 2. The Webacula Users password hasher implements the Portable
PHP password hashing framework, which is used in
WordPress, Drupal and other.  Now encrypted Webacula users
passwords on all supported databases: MySQL, PostgreSQL,
Sqlite3.
 3. Therefore Webacula 7.x incompatible with prior versions!

http://webacula.tim4dev.com/2014/10/webacula-7-coming/


-- 
with best regards



--
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI
DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White
paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog
Analyzer

http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
mailto:Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




-- 


Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line
pelo site: bacula.com.br http://www.bacula.com.br/?p=2394
Need Bacula training? 10% discount coupon code at Udemy:
bacula-users
https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users
+55 61 2021-8260
+55 61 8268-4220
Site: www.bacula.com.br http://www.bacula.com.br/
Facebook: heitor.faria http://www.facebook.com/heitor.faria
Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com





--
with best regards


--
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] catalog acces ars slow since bacula upgrade

2014-10-25 Thread Kern Sibbald
The default postgres conf files that are installed are very poorly tuned 
for Bacula. You might compare your old postgres conf file with the new one.


Kern

On 14-10-06 09:49 AM, Heitor Faria wrote:


Since i upgrade bacula (5 à 7) + postgresql (8.3 à 9.3),

restore and all access to the catalog are slow.


Postgresql usually gets faster each version, according to benchmarks 
published in the Internet.


Is there something (a script ?) to run when upgrade bacula ? and
postgresql ?


Despite of:

./configure --help | grep batch
 --enable-batch-insert   enable the DB batch insert code [default=yes]

A simple configuration:

./configure --with-postgresql

Does not enable batch insert mode:

Batch insert enabled:None

Witch is 10 times faster mode, according to Bacula Manual.

Thx

*Antoine*


--

Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo 
site: bacula.com.br http://www.bacula.com.br/?p=2394
Need Bacula training? 10% discount coupon code at Udemy: bacula-users 
https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users

+55 61 2021-8260
+55 61 8268-4220
Site: www.bacula.com.br http://www.bacula.com.br/
Facebook: heitor.faria http://www.facebook.com/heitor.faria
Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com


On Mon, Oct 6, 2014 at 9:02 AM, BOURGAULT Antoine 
antoine.bourga...@sib.fr mailto:antoine.bourga...@sib.fr wrote:


Since i upgrade bacula (5 à7) + postgresql (8.3 à9.3), restore and
all access to the catalog are slow.

Is there something (a script ?) to run when upgrade bacula ? and
postgresql ?

Thx

*Antoine *



--
Slashdot TV.  Videos for Nerds.  Stuff that Matters.
http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
mailto:Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users




--

Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo 
site: bacula.com.br http://www.bacula.com.br/?p=2394
Need Bacula training? 10% discount coupon code at Udemy: bacula-users 
https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users

+55 61 2021-8260
+55 61 8268-4220
Site: www.bacula.com.br http://www.bacula.com.br/
Facebook: heitor.faria http://www.facebook.com/heitor.faria
Gtalk: heitorfa...@gmail.com mailto:heitorfa...@gmail.com



--
Slashdot TV.  Videos for Nerds.  Stuff that Matters.
http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] is not a Bacula labeled Volume, because: ERR=block.c:1023 Re

2014-10-24 Thread Kern Sibbald
 From the little I have seen, it looks like your tape was never written 
(the data may be on another tape -- please check) or the tape was 
overwritten.  Using /dev/st0 could *possibly* cause the tape to be 
overwritten, but Bacula attempts to avoid that.

On 14-10-24 04:10 AM, Che_m wrote:
 I already did,
 found nothing useful than you should relabel it, or use /dev/nst0 instead of 
 /dev/st0.
 I've always used /dev/st0

 The correct tape is in the drive, the tape is labeled correct. I can mount 
 all 28 tapes in the library, except that one.
 The last status of the tape was marked append so, it is not in error or 
 anything. Neither have I archived it or taken it out to archive it.

 bacula version is v5.0.1 and is installed from ubuntu (10.04) repository

 +--
 |This was sent by c...@belnet.be via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--



 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Configuration reload for bacula-sd

2014-10-24 Thread Kern Sibbald
No, the SD and the FD cannot be reloaded.  On the FD in principle it 
would be easy, but on the SD, it would be complicated if drives 
changed.  What would you do with Jobs that are using a drive that would 
be removed from the reload?

Kern

On 14-10-24 04:48 AM, Andrea Carpani wrote:
 Hi all,

 I'm still new to the product and I was playing around with Bacula 5.2.6
 (latest packages that come with CentOS 6.5). I added a new storage
 device to the Storage Daemon. I tried to run a job that used this
 device, but the backup failed apparently because bacula-sd wan't aware
 of this new device.

 I tried to use

 service bacula-sd reload

 but this didn't work, so I had to restart bacula-sd, but this broke my
 running backups. So my question is: is there a way to reload bacula-sd
 configuration on the fly?

 regards,

 Andrea
 .a.c.



 --
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to Edit Bacula Volumes comment field?

2014-10-23 Thread Kern Sibbald
There is a Description field on *every* Bacula Resource: Job, FileSet, 
Client, Device, Autochanger, ...


The above are kept in the in-memory resources, so you simply edit the 
.conf files.


There are several Bacula database objects that have a Comment field, but 
they are not connected to the resources, and I think you must use SQL 
commands to set them.


Both of these were added in expectation of GUI commands that would allow 
users to easily view and edit them, but that part is only partially or 
not yet implemented.


Kern

On 14-10-22 07:45 PM, hei...@bacula.com.br wrote:

Mr. Bacula Users,

Just discovered there is a comment field on bacula volumes:

*llist volumes
...

mediaid: 4
volumename: Vol-0004
slot: 0
poolid: 2
mediatype: File1
firstwritten:
...
actiononpurge: 0
*comment:*


Does anyone know how to edit / insert information on this field? lol

Regards,

Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo 
site: bacula.com.br http://www.bacula.com.br/?p=2394
61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 
tel:%2B55%2061%208268-4220
Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: 
heitor.faria http://www.facebook.com/heitor.faria | Gtalk: 
heitorfa...@gmail.com mailto:heitorfa...@gmail.com

=



--


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Inconsistent backups of windows clients

2014-10-23 Thread Kern Sibbald
OK, if you had the German translation files installed, that would 
explain why the message seemed odd to me.  Please disregard my comment 
on that subject.  However, on the actual problem itself, what I wrote is 
the best advice I could give you.


Best regards,
Kern

On 14-10-23 01:50 AM, Florian wrote:

Hello.

It could be that I did not translate the error message 100% correctly.
I translated both freely from german as I thought an english version 
will be more helpful.


The actual german message is: Fatal error: FD hat keinen Jobstatus 
zurückgegeben.

I usually get this message when there are problems with reaching a client.

Current status: No problems for 2 days in a row.

Regards,

Florian S.


ubuntu-dir JobId XXX: Fatal error: bsock.c:118 Unable to connect to Client: 
Client on XXX.XXX.XXX.XXX:9102. ERR=No route to target machine
ubuntu-dir JobId XXX: Fatal error: FD did not reaturn a Job status.


This is very bizarre, because the second line of the message above 
does not exist in any Bacula that I am aware of.
From the above error messages, I would say that your wakeup on WAN is 
not really working or you are not giving the machine enough time to 
come up and Bacula is timing it out.  Trying to backup sleeping 
Clients is probably an unreliable way of running backups -- or you 
must find some way to fully wake up the machine before having Bacula 
try to contact it.  Perhaps simply upping the FD Connect Timeout 
would solve your problem.


Best regards,
Kern




--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to Edit Bacula Volumes comment field?

2014-10-23 Thread Kern Sibbald
There is  a Location table in the DB for the purpose that you want.  
Take a look at the Bacula schema.


On 14-10-23 07:56 AM, hei...@bacula.com.br wrote:

Hi Kern,

Thanks for the reply.
The user wanted to write some comments in the volumes such as the 
physical place description where they are keeping the tapes stored.

I'll check if any GUI has this feature.

Regards,

Heitor Medrado de Faria
Need Bacula training? 10% discount coupon code at Udemy: bacula-users 
https://www.udemy.com/bacula-backup-software/?couponCode=bacula-users
+55 61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 
tel:%2B55%2061%208268-4220
Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: 
heitor.faria http://www.facebook.com/heitor.faria | Gtalk: 
heitorfa...@gmail.com mailto:heitorfa...@gmail.com




*De: *Kern Sibbald k...@sibbald.com
*Para: *hei...@bacula.com.br, Bacula-users@lists.sourceforge.net 
bacula-users@lists.sourceforge.net

*Enviadas: *Quinta-feira, 23 de outubro de 2014 8:59:10
*Assunto: *Re: [Bacula-users] How to Edit Bacula Volumes comment field?

There is a Description field on *every* Bacula Resource: Job, FileSet, 
Client, Device, Autochanger, ...


The above are kept in the in-memory resources, so you simply edit the 
.conf files.


There are several Bacula database objects that have a Comment field, 
but they are not connected to the resources, and I think you must use 
SQL commands to set them.


Both of these were added in expectation of GUI commands that would 
allow users to easily view and edit them, but that part is only 
partially or not yet implemented.


Kern

On 14-10-22 07:45 PM, hei...@bacula.com.br wrote:

Mr. Bacula Users,

Just discovered there is a comment field on bacula volumes:

*llist volumes
...

mediaid: 4
volumename: Vol-0004
slot: 0
poolid: 2
mediatype: File1
firstwritten:
...
actiononpurge: 0
*comment:*


Does anyone know how to edit / insert information on this field? lol

Regards,

Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line
pelo site: bacula.com.br http://www.bacula.com.br/?p=2394
61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220
tel:%2B55%2061%208268-4220
Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook:
heitor.faria http://www.facebook.com/heitor.faria | Gtalk:
heitorfa...@gmail.com mailto:heitorfa...@gmail.com
=




--



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users





--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Inconsistent backups of windows clients

2014-10-22 Thread Kern Sibbald

On 14-10-22 01:17 AM, Florian wrote:

Am 21.10.2014 um 01:31 schrieb Jean Sébastien HEDERER ASPerience:

Hi,

And if you make backups at 4 differents hours, do you have the problem?


The thing is that there could be multiple additional clients in the 
future and I'd like to keep additional configuration per client at a 
minimum.


Am 20.10.2014 um 13:25 schrieb hei...@bacula.com.br:

Florian,

Can you put a sleep between the Powerwake script and the backup 
start, just for test purposes?
Mabe a ClientRunBeforeJob only with sleep. I suspect maybe the lag to 
the machine (and bacula-fd) start is failing the jobs.


Regards,

Heitor Medrado de Faria
Precisa de treinamento Bacula? 15% de desconto no curso on-line pelo 
site: bacula.com.br http://www.bacula.com.br/?p=2394
61 2021-8260 tel:%2B55%2061%202021-8260 | 8268-4220 
tel:%2B55%2061%208268-4220
Site: www.bacula.com.br http://www.bacula.com.br/ | Facebook: 
heitor.faria http://www.facebook.com/heitor.faria | Gtalk: 
heitorfa...@gmail.com mailto:heitorfa...@gmail.com

=
The backups ran with a 30 seconds sleep command after powerwake today. 
All jobs finished successfully.
That's a start, but I will have to observe this a bit more. Like I 
said: It doesn't always happen that a job fails.




*De: *Florian florian.spl...@web.de
*Para: *bacula-users@lists.sourceforge.net
*Enviadas: *Segunda-feira, 20 de outubro de 2014 3:57:34
*Assunto: *[Bacula-users] Inconsistent backups of windows clients

Hello everyone.

So, I am backing up 4 windows clients at the moment, using the 5.2.10 
windows FD.
over the last two weeks I noticed that jobs relatively often end with 
an error, meaning up to 2 clients per day.


It's not even the same clients. Some days, everything works, then 
client 1 ends with an error, the next day maybe client 4 does, while 
client 1 runs completely fine. I cannot see any pattern in the 
occurence of these errors. I just know it is always the same problem:


ubuntu-dir JobId XXX: Fatal error: bsock.c:118 Unable to connect to Client: 
Client on XXX.XXX.XXX.XXX:9102. ERR=No route to target machine
ubuntu-dir JobId XXX: Fatal error: FD did not reaturn a Job status.


This is very bizarre, because the second line of the message above does 
not exist in any Bacula that I am aware of.


Some more information that might help:
The 4 backup jobs for the clients are started at the same time.
Each job starts by activating the machine using powerwake.
Each client has its personal backup device in the storage daemon's 
config.


I hope anybody can help me out here, because the backup-system is 
just too unreliable like this...


From the above error messages, I would say that your wakeup on WAN is 
not really working or you are not giving the machine enough time to come 
up and Bacula is timing it out.  Trying to backup sleeping Clients is 
probably an unreliable way of running backups -- or you must find some 
way to fully wake up the machine before having Bacula try to contact 
it.  Perhaps simply upping the FD Connect Timeout would solve your problem.


Best regards,
Kern


Regards,
Florian S.




--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Despooling attrs does not finish

2014-10-19 Thread Kern Sibbald
Hello Ulrich,

Perhaps Bacula 7.0.5 is incompatible with such an old Windows binary -- 
I cannot imagine, but it is a possibility.  Since you can get a free 
Bacula Enterprise 7.0.5 Windows file daemon from Bacula Systems (because 
you are listed in the AUTHORS file), why don't you try it?

Best regards,
Kern


On 14-10-19 01:02 PM, Ulrich Leodolter wrote:
 Hello Dan,

 On Sat, 2014-10-18 at 13:32 -0400, Dan Langille wrote:
 On Oct 18, 2014,
 at 4:03 AM, Ulrich Leodolter ulrich.leodol...@obvsg.at wrote:

 Hello,

 we have Win7 backup which does not come to an end within MaxRunTime=12h.
 server runs 7.0.5 (28 July 2014),  the client has installed the
 bacula-enterprise-win64-7.0.5.exe.  but the problem started about 2
 months ago,  at that time windows client 5.2.10 was installed on the
 machine.

 the backup itself is about 100GB compressed and seems to finish
 on the client after about 6 hours, below are the last messages of
 the job before it gets stuck.

 2014-10-18 03:18:09 troll-sd JobId 635821: Committing spooled data to
 Volume Backup-0779. Despooling 1,692,736,419 bytes ...
 2014-10-18 03:18:18 troll-sd JobId 635821: Despooling elapsed time = 
 00:00:09, Transfer rate = 188.0 M Bytes/second
 2014-10-18 03:18:19 troll-sd JobId 635821: Elapsed time=06:11:45, Transfer 
 rate=4.691 M Bytes/second
 2014-10-18 03:18:22 troll-sd JobId 635821: Sending spooled attrs to the 
 Director. Despooling 603,449,667 bytes .

 mysql status at the same time:

 # echo show full processlist | mysql
 Id  UserHostdb  Command TimeState   Info
 6854bacula  localhost   bacula  Sleep   522 NULL
 6873bacula  localhost   bacula  Query   21143   Sending data
 INSERT INTO File (FileIndex, JobId, PathId, FilenameId, LStat, MD5, 
 DeltaSeq) SELECT batch.FileIndex, batch.JobId, Path.PathId, 
 Filename.FilenameId,batch.LStat, batch.MD5, batch.DeltaSeq FROM batch JOIN 
 Path ON (batch.Path = Path.Path) JOIN Filename ON (batch.Name = 
 Filename.Name)
 6899rootlocalhost   NULLQuery   0   NULLshow 
 full processlist


 we have a bunch of other clients (about 30), a mixture of linux, win7 and 
 mac powerpc.
 all other backups run without problems for years now.  there are even 
 larger backups,
 in size and in number of files.


 does anyone have an idea why this single batch insert does not complete?

 do i need to analyze the attrs spool file itself ?

 yesterday i optimized the bacula database, but that doesn't help.
 there must be something special in the attrs spool file which the
 mysql server can't handle. the server runs on standard CentOS 6.5 x86_64.
 This is something which should be asked in the user mailing list, not the 
 devel mailing list.  I am replying to that list instead.

 Ok

 Is this a large number of files?

 about 75,  not very large.

 I had something which took a while.  I sped it up by giving PostgreSQL more 
 memory.  Perhaps MySQL can do the same.

 Here’s what I did: https://plus.google.com/+DanLangille/posts/AKXoRido3U1

 the mysql database is already optimized and has enough memory.
 backups up 400 files and 700GB run without problems.

 below are last job messages of the last failed jobs, it was canceled
 after 12 hours max run time.

 2014-10-19 02:49:15 troll-sd JobId 635915: Elapsed time=05:43:32, Transfer 
 rate=5.095 M Bytes/second
 2014-10-19 02:49:16 troll-sd JobId 635915: Sending spooled attrs to the 
 Director. Despooling 603,418,522 bytes ...
 2014-10-19 09:05:43 troll-dir JobId 635915: Fatal error: Max run time 
 exceeded. Job canceled.
 2014-10-19 09:41:17 troll-dir JobId 635915: Error: Bacula troll-dir 7.0.5 
 (28Jul14):

 the database shows already about 600k files for this jobs.

 mysql select count(*) from File where JobId = '635915' and LStat is not
 null;
 +--+
 | count(*) |
 +--+
 |   616848 |
 +--+
 1 row in set (0.00 sec)


 is it possible that some special file attr brings the mysql datebase
 into troubles ?  i really cant imagine.  the mysql database is almost
 idle after first 600k have been inserted.  there is no io traffic and
 cpu usage is also low.

 it seems i have to dump spooled attrs files tomorrow and compare to
 database to see at which attrs have been inserted and at which one it
 stops.

 has anyone a better idea how to debug this problem?
 i am little bit lost :) because in the last 6 years since
 i am using bacula i never run into a problem like this.


 best regards
 ulrich




 --
 Comprehensive Server Monitoring with Site24x7.
 Monitor 10 servers for $9/Month.
 Get alerted through email, SMS, voice calls or mobile push notifications.
 Take corrective actions from your mobile device.
 http://p.sf.net/sfu/Zoho
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Recycling problem.

2014-10-17 Thread Kern Sibbald

Hello,

I have not seen your original post so I respond only to comments you 
mention below without understanding the full issue.  Yes, there can be 
typically a few seconds delay between when a volume is chosen for use 
and when it expires.  The use duration is only checked when the volume 
is first selected and not at any other time during running the job.  
This can mean that a volume will be used for more time than specified in 
the use duration.  It would not be easy to fix this, and any simple fix 
might cause performance problems so you must be aware of this restriction.


By the way, there were quite a few race conditions concerning use 
durations and other time periods that affect whether or not a volume can 
continue to be used.  Many of these race conditions were fixed in 
7.0.5.  If you are having problems with volumes, I strongly recommend 
upgrading.


Best regards,
Kern

On 14-10-16 07:28 PM, Giuseppe Vitillaro wrote:

Apologies for appending to my own post, but I found
another occurence of the same pattern, I didn't notice,
in another job of some months ago, again attached to
this message. The same volumes are involved, and these,
for what I can see from my logs, are the only occurences
of the pattern.

It looks like that a volume exceeding the use duration
once the job has choosed the backup volume, create this
problem.

May I guess the routine find_next_volume_for_append()
in the source next_vol.c of the director could have
a bug, at least in the version 5.2.13 (19Jan13) I'm using?

In all the other cases I've verified, almost one year
of correctly running jobs, the use duration
have not been checked just after the beginning of the
job, once the director has already decided the volume
to use, but at a different time.

I may be on the wrong track, but if I'm right bacula
may overwrite a non empty, not purged volume.

Something, I guess, all the bacula users would hate,
isn't?

G. Vitillaro.


I can't understand why the bacula director, 5.2.13 under a stable 
updated gentoo, recycled one volume 000506L4, the correct one in 
the slot 9 of my changer, but instead the storage daemon recycled the 
current volume mounted in drive1, from slot4, volume 000529L4 and 
without actually doing any pruning on the volume, pruning that was 
correctly performed for the 000506L4 volume.


Note that the volume 000506L4 exceeded Max configure use duration 
just before the records for volume 000506L4 had been pruned.


After this I've just a sequence, complete log attached to this 
message, of


Recycled volume 000506L4 Recycled volume 000529L4 on device 
lto1 (/dev/nlto1), all previous data lost.


This configuration of bacula had been running for quite a while 
without a glitch, almost 10 months now and I had not any hardware 
error on my library at the time of this job, at least for what I can 
see.


I can't understand what is going on.

Any clue?

Regards, G. Vitillaro.





--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] can't run concurrent restores using multiple tape drives

2014-10-17 Thread Kern Sibbald
There is nothing I know in Bacula that specifically restricts concurrent 
read jobs on a storage device. If you use defaults, read/write are 
treated the same and are limited to maximum values configured.  It is 
possibly, however, to restrict the number of simultaneous read jobs (at 
least in version 7.0).  So, if your restore jobs are waiting on storage, 
it is most likely some restriction such as a pool or a volume that is 
already in uses.

In version 7.0, you can even do simultaneous reads from the same disk 
volume, but with the restriction that there is only one job per device.  
I.e. with multiple devices, you can read the same disk volume 
simultaneously.  For tapes, only one job can read from a given volume at 
any one time -- this is a physical limitation of the device rather than 
any Bacula restriction.

Best regards,
Kern

On 14-10-13 03:54 PM, jaredk51 wrote:
 I'm working with Amazon VTL (Virtual Tape Library) and Bacula v 5.2.6 which
 functions well and can run concurrent jobs to multiple tape drives just
 fine.
 I want to speed up restores for DR purposes and make use of the 10 virtual
 tape drives VTL gives you.
 I am not sure if bacula supports restoring to multiple tape drives at the
 same time and haven't been able to find anything in the documentation as
 such.

 I have created multiple restore jobs and ran them concurrently just fine but
 each restore job waits for the first tape drive to complete before running.

   JobId Level   Name   Status
 ==
 423 RestoreFiles.2014-10-13_19.35.32_03 is running
 424 RestoreFiles2.2014-10-13_19.35.53_04 is waiting on Storage
 Tape1

 So running concurrent restores doesn't provide any net benefit as they can
 only run 1 at a time.
 If anyone has any information regarding running restore jobs at the same
 time using multiple tape drives please let me know. Thanks in advance.


 My restore job configs look like this:

 ##
 Job {
 Name = RestoreFiles
 Type = Restore
 Client = backup02
 FileSet = Full Set
 Pool = Disk
 Messages = Standard
 Where = /mnt/restores
 Maximum Concurrent Jobs = 10
 Prefer Mounted Volumes = no
 }

 Job {
 Name = RestoreFiles2
 Type = Restore
 Client = backup02
 FileSet = Full Set2
 Pool = Disk
 Messages = Standard
 Where = /mnt/restores
 Maximum Concurrent Jobs = 10
 Prefer Mounted Volumes = no
 }


 autochanger and Devices from bacula-sd.conf

 Autochanger {
Name = Autochanger
Device = Drive-1, Drive-2, Drive-3, Drive-4, Drive-5, Drive-6, Drive-7,
 Drive-8, Drive-9, Drive-10
Changer Command = /etc/bacula/scripts/mtx-changer %c %o %S %a %d
Changer Device = /dev/sg10
 }


 Device {
Name = Drive-1
Drive Index = 0
Media Type = LTO
Archive Device =
 /dev/tape/by-path/ip-192.168.1.1:3260-iscsi-iqn.1997-05.com.amazon:sgw-bcb95cd5-tapedrive-01-lun-0-nst
AutomaticMount = yes;   # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
LabelMedia = yes;
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
SpoolDirectory = /etc/bacula/spool
 }

 Device {
Name = Drive-2
Drive Index = 1
Media Type = LTO
Archive Device =
 /dev/tape/by-path/ip-192.168.1.1:3260-iscsi-iqn.1997-05.com.amazon:sgw-bcb95cd5-tapedrive-02-lun-0-nst
AutomaticMount = yes;   # when device opened, read it
AlwaysOpen = yes;
RemovableMedia = yes;
RandomAccess = no;
LabelMedia = yes;
AutoChanger = yes
# Enable the Alert command only if you have the mtx package loaded
Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
SpoolDirectory = /etc/bacula/spool
 }

 Device {
Name = Drive-3
Drive Index = 2
Media Typ.



 --
 View this message in context: 
 http://bacula.10910.n7.nabble.com/can-t-run-concurrent-restores-using-multiple-tape-drives-tp79446.html
 Sent from the Bacula - Users mailing list archive at Nabble.com.

 --
 Comprehensive Server Monitoring with Site24x7.
 Monitor 10 servers for $9/Month.
 Get alerted through email, SMS, voice calls or mobile push notifications.
 Take corrective actions from your mobile device.
 http://p.sf.net/sfu/Zoho
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
___
Bacula-users mailing list
Bacula

Re: [Bacula-users] Recycling problem.

2014-10-17 Thread Kern Sibbald
All the messages that you show below seem to be very consistent with the 
way that Bacula does/did pruning in version 5.2.x.  To know exactly why 
it chose to recycle a particular volume, you would have to look in 
detail at the Volume information just before it was recycled.  During 
the pruning process, multiple volumes can be marked purged, even if they 
are not immediately recycled.  Even though a volume is recycled, by the 
Director, it may not be rewritten if the SD does not want to use it.  
The SD issues a message when the data has been overwritten.  In your 
case, it appears that two volumes were recycled, but only one was 
actually used by the SD, at least in that particular job output.  From 
what you show, it would be hard to conclude that Bacula has made an 
error (I am not saying that Bacula has no errors).


Best regards,
Kern

On 14-10-15 05:57 AM, Giuseppe Vitillaro wrote:


I can't understand why the bacula director, 5.2.13 under a stable

updated gentoo, recycled one volume 000506L4, the correct one in

the slot 9 of my changer, but instead the storage daemon recycled

the current volume mounted in drive1, from slot4, volume 000529L4

and without actually doing any pruning on the volume, pruning that

was correctly performed for the 000506L4 volume.

Note that the volume 000506L4 exceeded Max configure use duration

just before the records for volume 000506L4 had been pruned.

After this I've just a sequence, complete log attached to this message,

of

Recycled volume 000506L4

Recycled volume 000529L4 on device lto1 (/dev/nlto1), all previous 
data lost.


This configuration of bacula had been running for quite a while without

a glitch, almost 10 months now and I had not any hardware error on my

library at the time of this job, at least for what I can see.

I can't understand what is going on.

Any clue?

Regards, G. Vitillaro.



--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Bacula Status Report

2014-10-15 Thread Kern Sibbald
Hello,

On 14-10-13 09:38 PM, Pasi Kärkkäinen wrote:
 On Fri, Sep 05, 2014 at 11:23:31PM +0200, Kern Sibbald wrote:
 Hello,

 Hello,

 I have posted a Bacula Status report to the www.bacula.org site.
 It discusses the following items:

 1. Bacula Release Status

 2. Windows Binaries

 Hmm.. so there are no community windows binaries anymore?

There have not been any for quite a number of years -- since 5.2.10.

 Are the windows binaries shipped by Bacula Systems proprietary or opensource ?

They are proprietary but they can be obtained freely by Bacula open 
source users, and hopefully by everyone for personal use by the end of 
the year.

The principal reason for only one version of the Windows binaries was 
that for several years I was way too overloaded with work and had to 
reduce somewhere, and since Windows is especially painful, that is where 
I reduced.  I am now much less overloaded, so hope to correct a number 
of such problems by the end of the year.

Best regards,
Kern



 Thanks,

 -- Pasi


 3. Bacula Enterprise

 4. Vacation

 5. Bareos

 The following is a link to the report.

 http://blog.bacula.org/bacula-status-report-30-august-2014/

 Best regards,
 Kern



--
Comprehensive Server Monitoring with Site24x7.
Monitor 10 servers for $9/Month.
Get alerted through email, SMS, voice calls or mobile push notifications.
Take corrective actions from your mobile device.
http://p.sf.net/sfu/Zoho
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] compatibility

2014-09-26 Thread Kern Sibbald
It is highly unlikely it is compatible, and even if it works, at some
point in time, it is likely to fail.  I do not recommend trying it.

Kern

On 09/26/2014 02:16 PM, Andreas Frömmel wrote:
 Hello,

 is the bacula-client 7.05 compatible with the bacula-server 5.2.6 ?
 Best regards,

 --
 Andreas Frömmel



 --
 Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
 Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
 Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
 Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
 http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Meet PCI DSS 3.0 Compliance Requirements with EventLog Analyzer
Achieve PCI DSS 3.0 Compliant Status with Out-of-the-box PCI DSS Reports
Are you Audit-Ready for PCI DSS 3.0 Compliance? Download White paper
Comply to PCI DSS 3.0 Requirement 10 and 11.5 with EventLog Analyzer
http://pubads.g.doubleclick.net/gampad/clk?id=154622311iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Mac OSX 10.8 and above support

2014-09-19 Thread Kern Sibbald

  
  
Hello,
  
  You probably have already sufficient responses, but a few points
  might interest you (one already mentioned).
  
  1. You only need to load MacPorts on one machine to build the
  package.
  
  2. If you have an older Mac version loaded somewhere, the current
  scripts work, and apparently run perfectly fine on the new Macs.
  
  I'll see if I can build one on my old Mac here this weekend.
  
  Best regards,
  Kern
  
  On 09/18/2014 08:01 PM, bwellsnc wrote:


  Hey everyone, I am trying to see if anyone has done
work on the platforms/osx code base.  I am wanting to build a
dmg client so I can distribute it within my network.  The
problem is, it looks like it has been built for 10.4 which will
not work since this is still PPC code.  I have tried to get it
to build on 10.8 and above but with no luck.  I do not want to
use MacPorts since this means I have to install MacPorts on all
of my machines as well.  If anyone can help, I would appreciate
it.  Thanks!

Brent
  
  
  
  
  --
Slashdot TV.  Video for Nerds.  Stuff that Matters.
http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Slashdot TV.  Video for Nerds.  Stuff that Matters.
http://pubads.g.doubleclick.net/gampad/clk?id=160591471iu=/4140/ostg.clktrk___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fwd: Bacula: Backup Canceled of lsales2-fd Full

2014-09-17 Thread Kern Sibbald

  
  
I've seen a number of cases like this,
  and it is a problem with VSS.  Typically a reboot fixes the
  problem, and if not, it may be that VSS is not installed or not
  automatically started (perhaps the service was deactivated).
  
  Best regards,
  Kern
  
  On 09/17/2014 03:10 PM, Gary Stainburn wrote:


  I have a laptop FD which has suddenly stopped backing up. It's struggling with 
the VSS snapshot generation by the looks of it, but I don't know why.

It did have a few disk errors which I fixed using chkdsk. I have uninstalled 
and re-installed the Baula FD client software.
I've looked in the Windows system event log and found nothing.

Can anyone suggest where I go next to try to fix it?

Cheers

Gary

--  Forwarded Message  --
17-Sep 12:56 eddie1-dir JobId 90804: shell command: run 
BeforeJob "/etc/bacula/jobcheck.sh lsales2-fd"
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: PING 10.6.104.200 
(10.6.104.200) 56(84) bytes of data.
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 64 bytes from 10.6.104.200: 
icmp_seq=1 ttl=125 time=2.71 ms
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: --- 10.6.104.200 ping 
statistics ---
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: 1 packets transmitted, 1 
received, 0% packet loss, time 0ms
17-Sep 12:56 eddie1-dir JobId 90804: BeforeJob: rtt min/avg/max/mdev = 
2.711/2.711/2.711/0.000 ms
17-Sep 12:56 eddie1-dir JobId 90804: Start Backup JobId 90804, 
Job=lsales2.2014-09-17_12.56.12_36
17-Sep 12:56 eddie1-dir JobId 90804: Using Device "DoncStorage" to write.
17-Sep 12:56 lou-sd JobId 90804: Volume "donc14207" previously written, moving 
to end of data.
17-Sep 12:56 lou-sd JobId 90804: Ready to append to end of Volume "donc14207" 
size=3623008925
17-Sep 12:56 lou-sd JobId 90804: Spooling data ...
17-Sep 12:56 lsales2-fd JobId 90804: Generate VSS snapshots. Driver="Win64 
VSS", Drive(s)="C"
17-Sep 13:00 lsales2-fd JobId 90804: Fatal error: CreateSGenerate VSS 
snapshots failed. ERR=The operation completed successfully.

17-Sep 13:00 lsales2-fd JobId 90804: Error: VSS API failure 
calling "BackupComplete". ERR=Object is not initialized; called during 
restore or not called in correct sequence.
17-Sep 13:00 lou-sd JobId 90804: Committing spooled data to 
Volume "donc14207". Despooling 392 bytes ...
17-Sep 13:00 eddie1-dir JobId 90804: Error: Bacula eddie1-dir 5.2.13 
(19Jan13):
  Build OS:   x86_64-redhat-linux-gnu redhat Cat)
  JobId:  90804
  Job:lsales2.2014-09-17_12.56.12_36
  Backup Level:   Full
  Client: "lsales2-fd" 5.2.10 (28Jun12) Microsoft Windows 7 
Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:"Windows 7" 2012-02-14 14:22:52
  Pool:   "Donc" (From Job resource)
  Catalog:"MyCatalog" (From Client resource)
  Storage:"lou-donc" (From Job resource)
  Scheduled time: 17-Sep-2014 12:56:06
  Start time: 17-Sep-2014 12:56:15
  End time:   17-Sep-2014 13:00:45
  Elapsed time:   4 mins 30 secs
  Priority:   10
  FD Files Written:   0
  SD Files Written:   0
  FD Bytes Written:   0 (0 B)
  SD Bytes Written:   0 (0 B)
  Rate:   0.0 KB/s
  Software Compression:   None
  VSS:yes
  Encryption: no
  Accurate:   no
  Volume name(s): 
  Volume Session Id:  72
  Volume Session Time:1410876246
  Last Volume Bytes:  3,623,008,925 (3.623 GB)
  Non-fatal FD errors:2
  SD Errors:  0
  FD termination status:  Error
  SD termination status:  Running
  Termination:*** Backup Error ***

17-Sep 13:00 eddie1-dir JobId 90804: Rescheduled Job 
lsales2.2014-09-17_12.56.12_36 at 17-Sep-2014 13:00 to re-run in 600 seconds 
(17-Sep-2014 13:10).
17-Sep 13:00 eddie1-dir JobId 90804: Job lsales2.2014-09-17_12.56.12_36 
waiting 600 seconds for scheduled start time.
17-Sep 13:06 eddie1-dir JobId 90804: Bacula eddie1-dir 5.2.13 (19Jan13):
  Build OS:   x86_64-redhat-linux-gnu redhat Cat)
  JobId:  90804
  Job:lsales2.2014-09-17_12.56.12_36
  Backup Level:   Full
  Client: "lsales2-fd" 5.2.10 (28Jun12) Microsoft Windows 7 
Professional Service Pack 1 (build 7601), 64-bit,Cross-compile,Win64
  FileSet:"Windows 7" 2012-02-14 14:22:52
  Pool:   "Donc" (From Job resource)
  Catalog:"MyCatalog" (From Client resource)
  Storage:"lou-donc" (From Job resource)
  Scheduled time: 17-Sep-2014 12:56:06
  Start time: 

Re: [Bacula-users] Cryptic SD status: zero despooling speed

2014-09-14 Thread Kern Sibbald
Hello,

The rates that are shown in the status report are meant to be the
incoming data rates, and as you say do not take into account
spooling/despooling.  I will be very surprised if there is any decrease
in throughput from version 2.4.x to 7.0.x.  Concerning reporting
despooling rates: as far as I can see from your output, version 7.0.x is
indeed reporting the despooling rate, which is larger than for 2.4.x. 

The despooling rate is only reported in the job log when the spool is
committed typically at the end of the job, but if it despools multiple
times, it can be reported multiple times. 

If I remember right the status command will give you despooling rates if
the command is done during despooling, but that rate is shown with the
drive information not the job information.

Also it appears that the precise wording of the output has changed to
make it more specific (accurate).  If you were previously running 5.2.x
I would check to see if there is any real change in the code, which I
doubt because that part of the SD hasn't changed at least from 5.2.x --
however, 2.4.x is too old any comparison of the code would probably not
be useful.

Bottom line: I don't see a problem other than the labels for the
statistics are slightly different.

Best regards,
Kern



On 09/14/2014 05:06 AM, Ivan Adzhubey wrote:
 On Saturday, September 13, 2014 06:37:31 PM Ivan Adzhubey wrote:
 The Running Jobs Files, Bytes, AveBytes/sec, and LastBytes/sec track 
 spooling process only. These counters stop as soon as the spooling to disk
 is  completed. They do *not* track despooling at all. Despooling to tape is
 only tracked under corresponding Device sections.
 I've also discovered the following inconsistency in backup job logs between 
 v2.4.4 (which I had previously installed) and v 7.0.5 I am running now:

 v2.4.4:

 10-Sep 08:39 rosalind-dir JobId 52600: Start Backup JobId 52600, 
 Job=BackupCatalog.2014-09-10_08.30.00.48
 10-Sep 08:39 rosalind-dir JobId 52600: Using Device Drive-1
 10-Sep 08:39 rosalind-sd JobId 52600: Spooling data ...
 10-Sep 08:42 rosalind-sd JobId 52600: Job write elapsed time = 00:02:38, 
 Transfer rate = 11.14 M bytes/second

 ## Note: The line above reports spooling stage transfer rate

 10-Sep 08:42 rosalind-sd JobId 52600: Committing spooled data to Volume 
 LF0033. Despooling 1,762,247,516 bytes ...
 10-Sep 08:43 rosalind-sd JobId 52600: Despooling elapsed time = 00:01:08, 
 Transfer rate = 25.91 M bytes/second

 ## Note: Here the transfer rate during despooling to tape is reported

 10-Sep 08:43 rosalind-sd JobId 52600: Sending spooled attrs to the Director. 
 Despooling 289 bytes ...
 10-Sep 08:43 rosalind-dir JobId 52600: Bacula rosalind-dir 2.4.4 (28Dec08): 
 10-Sep-2014 08:43:34

 V7.0.5 (logs for the same job):

 13-Sep 22:47 rosalind-dir JobId 52636: Start Backup JobId 52636, 
 Job=BackupCatalog.2014-09-13_22.36.44_48
 13-Sep 22:47 rosalind-dir JobId 52636: Using Device Drive-1 to write.
 13-Sep 22:47 rosalind-sd JobId 52636: Spooling data ...

 ## Note: No transfer rate is now reported for the spooling stage at all

 13-Sep 22:51 rosalind-sd JobId 52636: Committing spooled data to Volume 
 LF0033. Despooling 2,102,934,459 bytes ...
 13-Sep 22:52 rosalind-sd JobId 52636: Despooling elapsed time = 00:01:27, 
 Transfer rate = 24.17 M Bytes/second
 13-Sep 22:52 rosalind-sd JobId 52636: Elapsed time=00:05:02, Transfer 
 rate=6.956 M Bytes/second

 ## Note: Transfer rate during despooling to tape is still reported

 13-Sep 22:52 rosalind-sd JobId 52636: Sending spooled attrs to the Director. 
 Despooling 291 bytes ...
 13-Sep 22:52 rosalind-dir JobId 52636: Bacula rosalind-dir 7.0.5 (28Jul14)

 Why this has been changed?

 --Ivan


 --
 Want excitement?
 Manually upgrade your production database.
 When you want reliability, choose Perforce
 Perforce version control. Predictably reliable.
 http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Cryptic SD status: zero despooling speed

2014-09-14 Thread Kern Sibbald
Hello,

My comments are below ...

On 09/14/2014 09:25 AM, Ivan Adzhubey wrote:
 Hi Kern,

 Thank you for taking your time and trying to help me. Please scroll down for 
 my comments.

 On Sunday, September 14, 2014 08:26:23 AM Kern Sibbald wrote:
 Hello,

 The rates that are shown in the status report are meant to be the
 incoming data rates, and as you say do not take into account
 spooling/despooling.
 Hmm, I never said they do not take into account despooling.
Agreed, I wasn't contesting anything you said only trying to clarify.

 I will be very surprised if there is any decrease
 in throughput from version 2.4.x to 7.0.x.
 Me too, but at this point all I was trying to do is to figure out how to 
 track 
 the transfer rates with 7.0.5 (which was easier with 2.4.4) since that's what 
 I need to be able to do to debug the problem.
One of the problems I have is that you have clipped the output just
before the place where I would expect the information to be printed. 
With numerous clipped outputs, I cannot really follow.  If you want a
better opinion, I suggest that you send me the *full* job output report
from 2.4.4 and the equivalent from 7.0.5, then perhaps I can see what is
going on.  In a number of your listings, I have problems knowing whether
it is 2.4.4 output or 7.0.5 output, so if you include the *full* output,
it should be clearer to me.

 Since I am not sure I interpreted version 7.0.5 status reports correctly I 
 can't tell what's going on at this point. One thing I am sure is that the 
 backup jobs which used to take about 8 hours total with 2.4.4 took more than 
 48 hours after the upgrade. But I am still not sure why this happened.
The most likely reason is some bottleneck in the catalog, especially if
you are using MySQL or you have updated the MySQL/Postgres versions. 
The default configuration files are horribly tuned for Bacula.  You can
verify this by looking at the amount of time that it takes to despool.

 Concerning reporting
 despooling rates: as far as I can see from your output, version 7.0.x is
 indeed reporting the despooling rate, which is larger than for 2.4.x.
 That's correct for this particular job. I have specifically chosen the most 
 simple single job for comparisons. This was done only to compare the format 
 and contents of the status reports between 2.4.4 and 7.0.5.

 The despooling rate is only reported in the job log when the spool is
 committed typically at the end of the job, but if it despools multiple
 times, it can be reported multiple times.
 Yep, I am aware of this fact. Here's another example where a large full 
 backup 
 job exhausted disk spooling limit and required two iterations of 
 spooling/despooling (and a tape change). The despooling rates were reported 
 twice in the logs, for each despooling operation separately. No spooling 
 rates 
 were ever reported for the spooling parts of the process:

 12-Sep 01:24 rosalind-dir JobId 52615: Using Device Drive-0 to write.
 12-Sep 01:24 rosalind-sd JobId 52615: Volume LI0004 previously written, 
 moving to end of data.
 12-Sep 01:25 rosalind-sd JobId 52615: Ready to append to end of Volume 
 LI0004 at file=106.
 12-Sep 01:25 rosalind-sd JobId 52615: Spooling data ...
 13-Sep 03:27 rosalind-sd JobId 52615: User specified Device spool size 
 reached: 
 DevSpoolSize=884,763,273,281 MaxDevSpoolSize=884,763,262,976

 ## Note: Spooling hits the configured limit and job switches to despooling 
 but 
 no spooling rates are reported

 13-Sep 03:27 rosalind-sd JobId 52615: Writing spooled data to Volume. 
 Despooling 884,763,273,281 bytes ...
 13-Sep 09:17 rosalind-sd JobId 52615: End of Volume LI0004 at 827:8233 on 
 device Drive-0 (/dev/nst0). Write of 64512 bytes got -1.
 13-Sep 09:18 rosalind-sd JobId 52615: Re-read of last block succeeded.
 13-Sep 09:18 rosalind-sd JobId 52615: End of medium on Volume LI0004 
 Bytes=781,013,366,784 Blocks=12,106,481 at 13-Sep-2014 09:18.
 13-Sep 09:18 rosalind-sd JobId 52615: 3307 Issuing autochanger unload slot 
 4, 
 drive 0 command.
 13-Sep 09:20 rosalind-dir JobId 52615: There are no more Jobs associated with 
 Volume LI0007. Marking it purged.
 13-Sep 09:20 rosalind-dir JobId 52615: All records pruned from Volume 
 LI0007; marking it Purged
 13-Sep 09:20 rosalind-dir JobId 52615: Recycled volume LI0007
 13-Sep 09:20 rosalind-sd JobId 52615: 3304 Issuing autochanger load slot 7, 
 drive 0 command.
 13-Sep 09:20 rosalind-sd JobId 52615: 3305 Autochanger load slot 7, drive 
 0, 
 status is OK.
 13-Sep 09:21 rosalind-sd JobId 52615: Recycled volume LI0007 on tape device 
 Drive-0 (/dev/nst0), all previous data lost.
 13-Sep 09:21 rosalind-sd JobId 52615: New volume LI0007 mounted on device 
 Drive-0 (/dev/nst0) at 13-Sep-2014 09:21.
 13-Sep 11:04 rosalind-sd JobId 52615: Despooling elapsed time = 07:32:43, 
 Transfer rate = 32.57 M Bytes/second

 ## First despooling iteration completed in 07:32 hours, at 32.57 M 
 Bytes/second (despooling rate reported)

 13-Sep 11:27 rosalind

Re: [Bacula-users] Cryptic SD status: zero despooling speed

2014-09-13 Thread Kern Sibbald
Hello,

The AveBytes/sec is the total number of bytes read from the FD for that
job divided by the total number of seconds the job has been running.

The LastBytes/sec is the number of bytes read from the FD for that job
since the last status command using a trivial smoothing algorithm that
includes the prior value of LastBytes.  Note, if you use multiple status
commands the LastBytes/sec will be updated if you wait at least 10
seconds between status commands.

Part of the calculation is done with 32 bit integer arithmetic, so there
is a possibility that there is a truncation error once the TotalBytes
exceed 4 billion -- i.e. there may be a bug in the calculation that I
will look at.

If you can check to see if the calculations look good during the first 4
GB of backup, but then drop to zero, please open a bug report. 

Best regards,
Kern

On 09/13/2014 04:49 AM, Ivan Adzhubey wrote:
 Hi all,

 I have recently upgraded to Bacula 7.0.5 on my old backup server, which seems 
 to have worked fine. However, I am now trying to figure out how to interpret 
 rather detailed status messages produced by various status command. One 
 particular puzzling thing is the following Storage status line:

 *status sd

 -sd Version: 7.0.5 (28 July 2014) i686-pc-linux-gnu ubuntu 8.04
 Daemon started 12-Sep-14 01:21. Jobs: run=2, running=2.

 ...

 Running Jobs:
 Writing: Full Backup job  JobId=52618 Volume=LF0033
 pool=LargeFull device=Drive-1 (/dev/nst1)
 spooling=0 despooling=1 despool_wait=0
 Files=292,872 Bytes=63,980,083,815 AveBytes/sec=0 LastBytes/sec=0
 FDReadSeqNo=3,388,503 in_msg=2576431 out_msg=9 fd=19

 The strange part is that the AveBytes/sec and LastBytes/sec values are 
 always zero while at the same both Files and Bytes counters keep 
 incrementing. 
 The job seems to be busy despooling and making progress but the speed-o-meter 
 readings are not reflecting this.

 Is this a known problem?

 Thanks,
 Ivan




--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fwd: Restore from dead client

2014-09-11 Thread Kern Sibbald
On 09/10/2014 02:58 PM, Martin Simmons wrote:
 On Tue, 09 Sep 2014 20:25:18 +0200, Kern Sibbald said:
 On 09/09/2014 07:46 PM, Martin Simmons wrote:
 It looks like removing readfifo=yes will not help, because the restore code
 doesn't look at it.

 The restore will not work without a process already reading from the fifo.
 The simplest Bacula restore doesn't use a fifo. That is what I am
 recommending that he try.
 Yes, but it looks like his backup contains data of type FT_FIFO, so the
 restore will always try to write it back into a fifo.

Yes, good point.  That just proves the complexity and problems one can
have with a fifo.  It shows the advantage of using the bpipe plugin at
least one can later restore the file without the plugin.

Regards,
Kern


 __Martin


However it seems that the configuration is
 quite complete (at least for me).
 Best regards,
 Kern
 __Martin


 On Tue, 9 Sep 2014 10:57:59 -0400, Kenny Noe said:
 Kern, et al

 I tried another backup.  Here is my cliconfig.  I parred it down to just
 the restore stuff.
 #
 # bluewhale
 #
Client {
   Name   = bluewhale
   Address= bluewhale.backup.bnesystems.com
   Catalog= BS01-Catalog
   Password   = xx
   FileRetention  = 15 days
   JobRetention   = 15 days
   AutoPrune  = yes
   MaximumConcurrentJobs  = 1
}
Job {
   Name   = Restore_mail_bluewhale
   FileSet= Full_mail_bluewhale
   Type   = Restore
   Pool   = Pool_mail_bluewhale
   Client = bluewhale
   Messages   = Standard
}
Pool {
   Name   = Pool_mail_bluewhale
   PoolType   = Backup
   Storage= Storage_bluewhale
   MaximumVolumeJobs  = 1
   CatalogFiles   = yes
   AutoPrune  = yes
   VolumeRetention= 1 week
   Recycle= yes
   LabelFormat= mail-
}
Storage {
   Name   = Storage_bluewhale
   Address= 10.10.10.199
   SDPort = 9103
   Password   = imadirector
   Device = File_bluewhale
   MediaType  = NAS_bluewhale
   MaximumConcurrentJobs  = 1
}
Schedule {
   Name   = Schedule_mail_bluewhale
   Run= Level=Full sun-sat at 01:00
}
FileSet {
   Name = Full_mail_bluewhale
   Include {
  Options {
 signature=SHA1
  }
  File=mail.tar
   }
}


 During the restore I ran status storage from the console.  I get this

 *status sto
 The defined Storage resources are:
  1: Storage_asterisk
  2: Storage_besc-4dvapp
  3: Storage_besc-bs01
  4: Storage_besc-unixmgr01
  5: Storage_bluewhale
  6: Storage_demo
  7: Storage_dev
  8: Storage_mako
 Select Storage resource (1-8): 5
 Connecting to Storage daemon Storage_bluewhale at 10.10.10.199:9103

 BS01-SD1 Version: 5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu
 11.10
 Daemon started 09-Sep-14 09:19. Jobs: run=1, running=0.
  Heap: heap=598,016 smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949
  Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0

 Running Jobs:
 Reading: Full Restore job Restore_mail_bluewhale JobId=12922
 Volume=mail-0386
 pool=Pool_mail_bluewhale device=File_bluewhale
 (/nas/bacula/bluewhale)
 Files=0 Bytes=0 Bytes/sec=0
 FDReadSeqNo=6 in_msg=6 out_msg=2320699 fd=6
 

 Jobs waiting to reserve a drive:
 

 Terminated Jobs:
  JobId  LevelFiles  Bytes   Status   FinishedName
 ===
  12913  Incr10873.85 M  OK   08-Sep-14 20:02 Backup_os_dev
  12912  Full  461.80 G  OK   08-Sep-14 20:24 
 Backup_app_demo
  12914  Incr23057.85 M  OK   09-Sep-14 00:00
 Backup_os_asterisk
  12916  Incr 3168.06 M  OK   09-Sep-14 00:01
 Backup_os_besc-unixmgr01
  12917  Incr  0 0   Cancel   09-Sep-14 00:03
 Backup_os_bluewhale
  12918  Full  4501.3 M  OK   09-Sep-14 00:04 Backup_app_dev
  12915  Incr2561.099 G  OK   09-Sep-14 00:06
 Backup_os_besc-bs01
  12919  Full  454.41 G  OK   09-Sep-14 01:04 
 Backup_app_mako
  129200 0   Cancel   09-Sep-14 09:17
 Restore_mail_bluewhale
  129210 0   OK   09-Sep-14 09:43
 Restore_mail_bluewhale
 

 Device status:
 Device File_asterisk (/nas/bacula/asterisk) is not open.
 Device

Re: [Bacula-users] Bacula writing in wrong volumes

2014-09-09 Thread Kern Sibbald

  
  
Hello,
  
  The problem is basically because you have one idea about how to do
  backups and Bacula has another idea.  You want Bacula to put data
  on the *exact* Volume that you specify.  The whole logic of Bacula
  is that Bacula will deal with what is on volumes and it will
  choose the volumes it wants, within certain constraints setup by
  the administrator.  This is not to say that Bacula is right and
  you are wrong, or vise-versa, but that your views of volumes were
  different.
  
  At the beginning of a job if Bacula needs to label a volume, it
  will, then it will proceed with the backup.  Only at the end of
  the job does Bacula learn that there was nothing to backup.
  
  In general is is difficult to force Bacula to use certain volumes
  and only those volumes.   If you want to clearly separate Volume
  by clients, jobs,  or by some other criteria, you probably should
  be using different Pools.  Different pools are the most reliable
  way to ensure that only particular jobs, clients, ... go to a
  particular volume.
  
  Best regards,
  Kern
  
  On 09/09/2014 04:31 PM, Gean Michel Ceretta wrote:


  Dear users,

I'm using file-based backups and configurated Bacula[bacula-dir Version:
5.2.13 (19 February 2013)] to write one volume per job, with an
exclusive label containing the client name, data and time as shown
bellow in the config files attached.

The problems is: 

1º Why Bacula creates a volume for a job if the job has no data to be
backed up? That causes the created volume to stay open for writing, what
causes another problem:

2º Instead of creating a new volume for the next client to be backed-up,
Bacula writes in the empity volume created at problem 1.

I'm dealing with a situation where an client named Git has no
modifications, but a volume Git-{data}... was created.

Then, the next job starts, for the client Samba, and the data end-up
being recorded on the volume Git-{data}... because the empty volume
created on the previous job that has no modifications, was not closed.

What I've donne wrong? Suggestions?



  
  
  
  --
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce.
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce.
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fwd: Restore from dead client

2014-09-09 Thread Kern Sibbald

  
  
Hello,
  
  Unfortunately, is seems like your Storage definition is not
  correct.  Also unfortunately, while I try to give occasional tips,
  I cannot supply full support, which is what you need at this
  point.  In fact, I am very good in writing Bacula core code, but
  not very good in doing support.   
  
  Best regards,
  Kern
  
  On 09/09/2014 04:57 PM, Kenny Noe wrote:


  Kern, et al


I tried another backup.  Here is my cliconfig.  I parred it
  down to just the restore stuff.

  #
  # bluewhale
  #
     Client {
        Name          
          = bluewhale
        Address        
         = bluewhale.backup.bnesystems.com
        Catalog        
         = BS01-Catalog
        Password      
          = "xx"
        FileRetention  
         = 15 days
        JobRetention  
          = 15 days
        AutoPrune      
         = yes
       
  MaximumConcurrentJobs  = 1
     }
     Job {
        Name          
          = Restore_mail_bluewhale
        FileSet        
         = Full_mail_bluewhale
        Type          
          = Restore
        Pool          
          = Pool_mail_bluewhale
        Client        
          = bluewhale
        Messages      
          = Standard
     }
     Pool {
        Name          
          = Pool_mail_bluewhale
        PoolType      
          = Backup
        Storage        
         = Storage_bluewhale
       
  MaximumVolumeJobs      = 1
        CatalogFiles  
          = yes
        AutoPrune      
         = yes
        VolumeRetention
         = 1 week
        Recycle        
         = yes
        LabelFormat    
         = "mail-"
     }
     Storage {
        Name          
          = Storage_bluewhale
        Address        
         = 10.10.10.199
        SDPort        
          = 9103
        Password      
          = "imadirector"
        Device        
          = File_bluewhale
        MediaType      
         = NAS_bluewhale
       
  MaximumConcurrentJobs  = 1
     }
     Schedule {
        Name          
          = Schedule_mail_bluewhale
        Run            
         = Level=Full sun-sat at 01:00
     }
     FileSet {
        Name =
  Full_mail_bluewhale
        Include {
           Options {
             
  signature=SHA1
           }
         
   File="mail.tar"
        }
     }





During the restore I ran status storage from the console.
   I get this



  *status sto
  The defined Storage
  resources are:
       1:
  Storage_asterisk
       2:
  Storage_besc-4dvapp
       3:
  Storage_besc-bs01
       4:
  Storage_besc-unixmgr01
       5:
  Storage_bluewhale
       6: Storage_demo
       7: Storage_dev
       8: Storage_mako
  Select Storage
  resource (1-8): 5
  Connecting to Storage
  daemon Storage_bluewhale at 10.10.10.199:9103
  

  BS01-SD1 Version:
  5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu
  11.10
  Daemon started
  09-Sep-14 09:19. Jobs: run=1, running=0.
   Heap: heap=598,016
  smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949
   Sizes: boffset_t=8
  size_t=8 int32_t=4 int64_t=8 mode=0,0
  

  Running Jobs:
  Reading: Full Restore
  job Restore_mail_bluewhale JobId=12922 Volume="mail-0386"
     
  pool="Pool_mail_bluewhale" device="File_bluewhale"
  (/nas/bacula/bluewhale)
      Files=0 Bytes=0
  Bytes/sec=0
 

Re: [Bacula-users] Fwd: Restore from dead client

2014-09-09 Thread Kern Sibbald
On 09/09/2014 07:46 PM, Martin Simmons wrote:
 It looks like removing readfifo=yes will not help, because the restore code
 doesn't look at it.

 The restore will not work without a process already reading from the fifo.
The simplest Bacula restore doesn't use a fifo. That is what I am
recommending that he try.  However it seems that the configuration is
quite complete (at least for me).
Best regards,
Kern

 __Martin


 On Tue, 9 Sep 2014 10:57:59 -0400, Kenny Noe said:
 Kern, et al

 I tried another backup.  Here is my cliconfig.  I parred it down to just
 the restore stuff.
 #
 # bluewhale
 #
Client {
   Name   = bluewhale
   Address= bluewhale.backup.bnesystems.com
   Catalog= BS01-Catalog
   Password   = xx
   FileRetention  = 15 days
   JobRetention   = 15 days
   AutoPrune  = yes
   MaximumConcurrentJobs  = 1
}
Job {
   Name   = Restore_mail_bluewhale
   FileSet= Full_mail_bluewhale
   Type   = Restore
   Pool   = Pool_mail_bluewhale
   Client = bluewhale
   Messages   = Standard
}
Pool {
   Name   = Pool_mail_bluewhale
   PoolType   = Backup
   Storage= Storage_bluewhale
   MaximumVolumeJobs  = 1
   CatalogFiles   = yes
   AutoPrune  = yes
   VolumeRetention= 1 week
   Recycle= yes
   LabelFormat= mail-
}
Storage {
   Name   = Storage_bluewhale
   Address= 10.10.10.199
   SDPort = 9103
   Password   = imadirector
   Device = File_bluewhale
   MediaType  = NAS_bluewhale
   MaximumConcurrentJobs  = 1
}
Schedule {
   Name   = Schedule_mail_bluewhale
   Run= Level=Full sun-sat at 01:00
}
FileSet {
   Name = Full_mail_bluewhale
   Include {
  Options {
 signature=SHA1
  }
  File=mail.tar
   }
}


 During the restore I ran status storage from the console.  I get this

 *status sto
 The defined Storage resources are:
  1: Storage_asterisk
  2: Storage_besc-4dvapp
  3: Storage_besc-bs01
  4: Storage_besc-unixmgr01
  5: Storage_bluewhale
  6: Storage_demo
  7: Storage_dev
  8: Storage_mako
 Select Storage resource (1-8): 5
 Connecting to Storage daemon Storage_bluewhale at 10.10.10.199:9103

 BS01-SD1 Version: 5.2.2 (26 November 2011) x86_64-unknown-linux-gnu ubuntu
 11.10
 Daemon started 09-Sep-14 09:19. Jobs: run=1, running=0.
  Heap: heap=598,016 smbytes=386,922 max_bytes=405,712 bufs=947 max_bufs=949
  Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0

 Running Jobs:
 Reading: Full Restore job Restore_mail_bluewhale JobId=12922
 Volume=mail-0386
 pool=Pool_mail_bluewhale device=File_bluewhale
 (/nas/bacula/bluewhale)
 Files=0 Bytes=0 Bytes/sec=0
 FDReadSeqNo=6 in_msg=6 out_msg=2320699 fd=6
 

 Jobs waiting to reserve a drive:
 

 Terminated Jobs:
  JobId  LevelFiles  Bytes   Status   FinishedName
 ===
  12913  Incr10873.85 M  OK   08-Sep-14 20:02 Backup_os_dev
  12912  Full  461.80 G  OK   08-Sep-14 20:24 Backup_app_demo
  12914  Incr23057.85 M  OK   09-Sep-14 00:00
 Backup_os_asterisk
  12916  Incr 3168.06 M  OK   09-Sep-14 00:01
 Backup_os_besc-unixmgr01
  12917  Incr  0 0   Cancel   09-Sep-14 00:03
 Backup_os_bluewhale
  12918  Full  4501.3 M  OK   09-Sep-14 00:04 Backup_app_dev
  12915  Incr2561.099 G  OK   09-Sep-14 00:06
 Backup_os_besc-bs01
  12919  Full  454.41 G  OK   09-Sep-14 01:04 Backup_app_mako
  129200 0   Cancel   09-Sep-14 09:17
 Restore_mail_bluewhale
  129210 0   OK   09-Sep-14 09:43
 Restore_mail_bluewhale
 

 Device status:
 Device File_asterisk (/nas/bacula/asterisk) is not open.
 Device File_besc-4dvapp (/nas/bacula/besc-4dvapp) is not open.
 Device File_besc-bs01 (/nas/bacula/besc-bs01) is not open.
 Device File_besc-unixmgr01 (/nas/bacula/besc-unixmgr01) is not open.
 Device File_bluewhale (/nas/bacula/bluewhale) is mounted with:
 Volume:  mail-0386
 Pool:*unknown*
 Media type:  NAS_bluewhale
 Total Bytes Read=17,923,756,032 Blocks Read=277,836 Bytes/block=64,512
 Positioned at File=4 Block=743,886,199
 Device File_demo (/nas/bacula/demo

Re: [Bacula-users] Bacula for OSX 10.9

2014-09-08 Thread Kern Sibbald
Hello Martin,

Have you been talking to Dimitri?  :-) 

Bacula Systems has no secret script for building Mac OS.  It is done
using the scripts in bacula/platforms/osx with only some trivial name
changes that I personally made (e.g. Bacula - Bacula Enterprise, ...).  

All Bacula Systems low level scripts (.rpm, .deb, ...) are published in
the community version, with only one exception.  The exception is the
scripts to build Solaris packages, which were written by Marco van
Wieringen.  They are not released because his build system is too
complicated (at least for me) and is 3GB+ in size the last time I backed
it up :-(  Some day, when I take a break from writing new features, I
will rewrite it in a very simple way that should be smaller than 100KB.

I wasn't aware that Apple has changed the package routines.  All Bacula
Enterprise binaries are still build using this original script, so I
will request the build sysadmin to look into the current way of doing
things.

If you have any tips, they would be appreciated.

Best regards,
Kern

On 09/08/2014 03:27 PM, Martin Simmons wrote:
 Unfortunately the cake is rotten now :-)  PackageMaker is no longer supported
 by Apple so the script doesn't work on OSX 10.9.

 Please encourage Bacula Systems to contribute a fix to this script back to the
 community version and build its binaries from that, rather than using a secret
 cake recipe.

 __Martin


 On Sun, 07 Sep 2014 16:34:00 +0200, Kern Sibbald said:
 The Mac OS X client for Bacula should be a standard Mac OS X package --
 a xxx.dmg file.
 Anything that is a tar or other form is not very professional.  I am not
 sure what homebrew supplies, but if they have done it right it is a .dmg.

 The instructions for building it yourself on a Mac are in the Bacula
 source distribution in:

   bacula/platforms/osx/README

 Once you have the developer tools installed, it is a piece of cake.

 Best regards,
 Kern

 On 09/07/2014 04:06 PM, Paul Mather wrote:
 On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote:

 On 09/07/2014 07:33 AM, Eric Dannewitz wrote:
 I'm interested in perhaps deploying this in my k-8 school, but I have not 
 found a good tutorial of how to install it. Or if it even works right on 
 Mac.

 Anyone have some insights on this? My idea would be to back about 30 macs 
 to an Ubuntu server.
 This would be a good way to setup Bacula.  The Director, SD and catalog
 work well on a Ubuntu server -- I recommend Trusty (14.04).  For the
 Mac's someone probably has made the binaries and distributes them on the
 Internet.  Otherwise if you load all the appropriate build tools on the
 Mac, you can easily build the FD.   Later this year, Bacula Systems will
 provide free binaries for MacOSX which should also help.
 I've not used Bacula on a Mac, but I do notice that Homebrew 
 (http://brew.sh) has a formula for bacula-fd, which could be used to 
 install the client.  Right now, it's only for the 5.x version (5.2.13), 
 though.

 I hope this helps.

 Cheers,

 Paul.


 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for OSX 10.9

2014-09-08 Thread Kern Sibbald
Hello Robert,

Thanks for the tips.

Best regards,
Kern

On 09/08/2014 04:16 PM, Robert Oschwald wrote:
 You can use MacPorts to build Bacula 7.0.4 (client by default, also supports 
 MySQL-, PostgreSQL- and SQLite3 Server variants)

 Install macports (macports.org), then perform 
 „sudo port install bacula“

 This by default installs the client fd.

 Configure the client in /opt/local/etc/bacula/bacula-fd.conf
 When configured, perform
 „sudo port load bacula-fd“

 To build a DMG file for standalone installation on other machines (which do 
 not have MacPorts installed), you can perform

 sudo port mdmg bacula
 cd `port work bacula`

 .. there you find bacula-7.0.4.dmg which includes all dependencies.

 It’s recommended to use a separate MacPorts installation path for standalone 
 dmg files. 
 See 
 https://guide.macports.org/chunked/using.binaries.html#using.binaries.binary-packages

 Robert



 Am 07.09.2014 um 07:33 schrieb Eric Dannewitz edannew...@rdschool.org:

 I'm interested in perhaps deploying this in my k-8 school, but I have not 
 found a good tutorial of how to install it. Or if it even works right on Mac.

 Anyone have some insights on this? My idea would be to back about 30 macs to 
 an Ubuntu server.

 Thanks!

 Sent from my iSomething
 --


 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 --
 Want excitement?
 Manually upgrade your production database.
 When you want reliability, choose Perforce
 Perforce version control. Predictably reliable.
 http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for OSX 10.9

2014-09-08 Thread Kern Sibbald
Hello Martin,

See below ...

On 09/08/2014 06:12 PM, Martin Simmons wrote:
 Thanks, I just didn't want to OSX binaries to go down the path of the Windows
 binaries.

No, OSX has no particular code written by Bacula Systems that is not in
the community version, whereas for Windows Bacula Systems has spent a
great deal of time (CHF) working on it and is willing to give out
binaries but wants to wait a bit before backporting the new source
code.  Note, the Windows binaries are now available free to community
contributors.  Hopefully that will be extended to more people in the
next couple of months.

Best regards,
Kern


 There is a new Xcode command productbuild, but I've not explored how to use it
 yet.

 __Martin


 On Mon, 08 Sep 2014 15:46:26 +0200, Kern Sibbald said:
 Hello Martin,

 Have you been talking to Dimitri?  :-) 

 Bacula Systems has no secret script for building Mac OS.  It is done
 using the scripts in bacula/platforms/osx with only some trivial name
 changes that I personally made (e.g. Bacula - Bacula Enterprise, ...).  

 All Bacula Systems low level scripts (.rpm, .deb, ...) are published in
 the community version, with only one exception.  The exception is the
 scripts to build Solaris packages, which were written by Marco van
 Wieringen.  They are not released because his build system is too
 complicated (at least for me) and is 3GB+ in size the last time I backed
 it up :-(  Some day, when I take a break from writing new features, I
 will rewrite it in a very simple way that should be smaller than 100KB.

 I wasn't aware that Apple has changed the package routines.  All Bacula
 Enterprise binaries are still build using this original script, so I
 will request the build sysadmin to look into the current way of doing
 things.

 If you have any tips, they would be appreciated.

 Best regards,
 Kern

 On 09/08/2014 03:27 PM, Martin Simmons wrote:
 Unfortunately the cake is rotten now :-)  PackageMaker is no longer 
 supported
 by Apple so the script doesn't work on OSX 10.9.

 Please encourage Bacula Systems to contribute a fix to this script back to 
 the
 community version and build its binaries from that, rather than using a 
 secret
 cake recipe.

 __Martin


 On Sun, 07 Sep 2014 16:34:00 +0200, Kern Sibbald said:
 The Mac OS X client for Bacula should be a standard Mac OS X package --
 a xxx.dmg file.
 Anything that is a tar or other form is not very professional.  I am not
 sure what homebrew supplies, but if they have done it right it is a .dmg.

 The instructions for building it yourself on a Mac are in the Bacula
 source distribution in:

   bacula/platforms/osx/README

 Once you have the developer tools installed, it is a piece of cake.

 Best regards,
 Kern

 On 09/07/2014 04:06 PM, Paul Mather wrote:
 On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote:

 On 09/07/2014 07:33 AM, Eric Dannewitz wrote:
 I'm interested in perhaps deploying this in my k-8 school, but I have 
 not found a good tutorial of how to install it. Or if it even works 
 right on Mac.
 Anyone have some insights on this? My idea would be to back about 30 
 macs to an Ubuntu server.
 This would be a good way to setup Bacula.  The Director, SD and catalog
 work well on a Ubuntu server -- I recommend Trusty (14.04).  For the
 Mac's someone probably has made the binaries and distributes them on the
 Internet.  Otherwise if you load all the appropriate build tools on the
 Mac, you can easily build the FD.   Later this year, Bacula Systems will
 provide free binaries for MacOSX which should also help.
 I've not used Bacula on a Mac, but I do notice that Homebrew 
 (http://brew.sh) has a formula for bacula-fd, which could be used to 
 install the client.  Right now, it's only for the 5.x version (5.2.13), 
 though.

 I hope this helps.

 Cheers,

 Paul.

 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want excitement?
Manually upgrade your production database.
When you want reliability, choose Perforce
Perforce version control. Predictably reliable.
http://pubads.g.doubleclick.net/gampad/clk?id=157508191iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fwd: Restore from dead client

2014-09-08 Thread Kern Sibbald
On 09/09/2014 02:34 AM, Kenny Noe wrote:
 Kern,

 I tried this tonight.  Marked the mail.tar file only and redid the
 restore.   It failed again with the same error.

 Any other suggestions?

Yes, I probably should have mentioned to remove all runbefore scripts
and any other thing that you may have in the job or in the fileset.  It
should be a very simple FileSet that has no plugins, no special condition.

Best regards,
Kern


 ---Kenny

 On Mon, Sep 8, 2014 at 5:46 PM, Kern Sibbald k...@sibbald.com wrote:
 Hello,

 It looks to me from the name /fifo/ and the error you are getting that you
 may be asking Bacula to restore a fifo, and that could easily lead to
 problems.

 I suggest one more attempt to restore.  Do everything pretty much as you
 have outlined here, but instead of doing a mark *  cd down to the file
 mail.tar and mark only it.  Then attempt the restore.  When you do the
 mark * you are in fact asking Bacula to restore all the directories at a
 higher level, and if one is a fifo, that is where there could be problems.

 Best regards,
 Kern

 On 09/08/2014 09:53 PM, Kenny Noe wrote:

 Heitor,

 Yes, I did change to local (/tmp) this past attempt.

 *restore

 First you select one or more JobIds that contain files
 to be restored. You will be presented several methods
 of specifying the JobIds. Then you will be allowed to
 select which files from those JobIds are to be restored.

 To select the JobIds, you have the following choices:
  1: List last 20 Jobs run
  2: List Jobs where a given File is saved
  3: Enter list of comma separated JobIds to select
  4: Enter SQL list command
  5: Select the most recent backup for a client
  6: Select backup for a client before a specified time
  7: Enter a list of files to restore
  8: Enter a list of files to restore before a specified time
  9: Find the JobIds of the most recent backup for a client
 10: Find the JobIds for a backup for a client before a specified time
 11: Enter a list of directories to restore for found JobIds
 12: Select full restore to a specified Job date
 13: Cancel
 Select item:  (1-13): 3
 Enter JobId(s), comma separated, to restore: 12510
 You have selected the following JobId: 12510

 Building directory tree for JobId(s) 12510 ...
 1 files inserted into the tree.

 You are now entering file selection mode where you add (mark) and
 remove (unmark) files to be restored. No files are initially added, unless
 you used the all keyword on the command line.
 Enter done to leave this mode.

 cwd is: /
 $ mark *
 1 file marked.
 $ done
 Bootstrap records written to /etc/bacula/BS01-DIR1.restore.3.bsr

 The job will require the following
Volume(s) Storage(s)SD Device(s)
 ===

 mail-0386 Storage_bluewhale File_bluewhale

 Volumes marked with * are online.


 1 file selected to be restored.

 The defined Restore Job resources are:
  1: Restore_os_asterisk
  2: Restore_os_besc-4dvapp
  3: Restore_db_besc-bs01
  4: Restore_os_besc-bs01
  5: Restore_os_besc-unixmgr01
  6: Restore_mail_bluewhale
  7: Restore_os_bluewhale
  8: Restore_os_demo
  9: Restore_app_demo
 10: Restore_os_dev
 11: Restore_app_dev
 12: Restore_os_mako
 13: Restore_app_mako
 Select Restore Job (1-13): 6
 Defined Clients:
  1: asterisk
  2: besc-4dvapp
  3: besc-bs01
  4: besc-unixmgr01
  5: bluewhale
  6: demo
  7: dev
  8: mako
  9: qa
 10: qa2
 11: smart
 Select the Client (1-11): 5
 Run Restore job
 JobName: Restore_mail_bluewhale
 Bootstrap:   /etc/bacula/BS01-DIR1.restore.3.bsr
 Where:   *None*
 Replace: always
 FileSet: Full_mail_bluewhale
 Backup Client:   bluewhale
 Restore Client:  bluewhale
 Storage: Storage_bluewhale
 When:2014-09-08 15:29:31
 Catalog: BS01-Catalog
 Priority:10
 Plugin Options:  *None*
 OK to run? (yes/mod/no): mod
 Parameters to modify:
  1: Level
  2: Storage
  3: Job
  4: FileSet
  5: Restore Client
  6: When
  7: Priority
  8: Bootstrap
  9: Where
 10: File Relocation
 11: Replace
 12: JobId
 13: Plugin Options
 Select parameter to modify (1-13): 5
 The defined Client resources are:
  1: asterisk
  2: besc-4dvapp
  3: besc-bs01
  4: besc-unixmgr01
  5: bluewhale
  6: demo
  7: dev
  8: mako
 Select Client (File daemon) resource (1-8): 3
 Run Restore job
 JobName: Restore_mail_bluewhale
 Bootstrap:   /etc/bacula/BS01-DIR1.restore.3.bsr
 Where:   *None*
 Replace: always
 FileSet: Full_mail_bluewhale
 Backup Client:   bluewhale
 Restore Client:  besc-bs01
 Storage: Storage_bluewhale
 When:2014-09-08 15:29:31
 Catalog: BS01-Catalog
 Priority

Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume

2014-09-07 Thread Kern Sibbald
Hello,

It is not a question that I will not document something, why would I
write code and discuss it if I did not want to document it?  It *was* a
question that I incorrectly thought it was already documented. 

What some people tend to forget is that I am doing this for free, I
volunteer for this.  Most people have a job and they use Bacula to get
their job done, and they get paid for what they do -- not me.   For
transparency: I do have a salary for Bacula Systems, but it is only
symbolic.  I make less than any other employee in Bacula Systems, and
probably less than the cleaning lady -- this is no exaggeration.

That simply means that I do everything for Bacula for free, as I have
done so for 14 years.   With volunteers such as myself, if one wants
something, the agreeable approach that 99.9% of the people on this list
take is more in the non-contemptuous spirit of this list and much more
likely to get results.

Thanks for pointing out the problems and undocumented features.  Despite
having my motivation sapped, I will see what I can do.

Best regards,
Kern

On 09/07/2014 12:03 AM, Dmitri Maziuk wrote:
 On 9/6/2014 2:59 PM, Kern Sibbald wrote:
 ...
 perhaps I am overly sensitive

 I've been dealing with other people's software for a living for close
 to two decades now and familiarity brings contempt. So yeah, I don't
 like software -- with very few exceptions, and bacula isn't one of
 them, I am jaded and sarcastic, and I don't like your position in the
 bareos debacle. So you're to some (large) extent correct on all
 counts. Keep telling us about wonderful features of your product that
 you won't document because I looked at you funny, see how many fans
 that wins you.

 Dimitri



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Restore from dead client

2014-09-07 Thread Kern Sibbald
On 09/07/2014 02:38 AM, Kenny Noe wrote:
 Dan,

 Appreciate the reply   Yes this is exactly what I want to do.
 However when I try to just do a simple restore, the job finishes
 with the error previously given.

 Any suggestions to do this would be appreciated.

Working with pipes or fifos is tricky, and the message about interrupted
system call (or something along that line) indicates that your the
conditions to make the pipe/fifo work are not properly setup.

I recommend simplifying things.

Best regards,
Kern


 Thanks--Kenny

 On Sat, Sep 6, 2014 at 5:51 PM, Dan Langille d...@langille.org wrote:
 On Sep 5, 2014, at 5:48 PM, Kenny Noe knoe...@gmail.com wrote:

 Birre,

 Thanks for the reply.   I guess this is where I get lost...



 The fifo is reading a file that was created in the pre-process called
 mail.tar.  The mail.tar is made from the following directories /opt/zimbra
 and /var/mail/zimbra.  This is where the Zimbra files and mailstore were
 kept.

 This pre-process is a script that has this :

 MailBackup.bash
 #!/bin/bash

 exec /dev/null

 MKDIR=/bin/mkdir
 MKFIFO=/usr/bin/mkfifo
 RM=/bin/rm
 TAR=/bin/tar

 DEFCODE=0
 DUMPBASE=/data/backups

 errCode=${DEFCODE}
 mailDir=/var/mail/zimbra
 zimbraDir=/opt/zimbra

 Main()
{
service zimbra stop

RunMailRestore

service zimbra start

ExitScript ${errCode}
}

 RunMailRestore()
{
EXTENSION=.tar

dumpDir=${DUMPBASE}/mail
fifoDir=${dumpDir}/fifo

RebuildFifoDir

${MKFIFO} ${fifoDir}/mail${EXTENSION}

${TAR} -xpf ${fifoDir}/mail${EXTENSION} 21 /dev/null 
}

 RebuildFifoDir()
{
if [ -d ${fifoDir} ]
then
   ${RM} -rf ${fifoDir}
fi

${MKDIR} -p ${fifoDir}
}

 ExitScript()
{
exit ${1}
}

 Main

 The restore script simply does a tar xpf instead of a tar cpf.


 Perhaps instead of doing that, just restore the data, and then do the tar
 xpf later.
 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for OSX 10.9

2014-09-07 Thread Kern Sibbald
On 09/07/2014 07:33 AM, Eric Dannewitz wrote:
 I'm interested in perhaps deploying this in my k-8 school, but I have not 
 found a good tutorial of how to install it. Or if it even works right on Mac.

 Anyone have some insights on this? My idea would be to back about 30 macs to 
 an Ubuntu server.

This would be a good way to setup Bacula.  The Director, SD and catalog
work well on a Ubuntu server -- I recommend Trusty (14.04).  For the
Mac's someone probably has made the binaries and distributes them on the
Internet.  Otherwise if you load all the appropriate build tools on the
Mac, you can easily build the FD.   Later this year, Bacula Systems will
provide free binaries for MacOSX which should also help.

If you have the budget, I *strongly* recommend taking the Bacula Systems
Admin I training.  It will provide you with everything you need to know
and if you ask in advance, they can probably help you with the Mac builds.

Best regards,
Kern


 Thanks!

 Sent from my iSomething
 --


 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for OSX 10.9

2014-09-07 Thread Kern Sibbald
The Mac OS X client for Bacula should be a standard Mac OS X package --
a xxx.dmg file.
Anything that is a tar or other form is not very professional.  I am not
sure what homebrew supplies, but if they have done it right it is a .dmg.

The instructions for building it yourself on a Mac are in the Bacula
source distribution in:

  bacula/platforms/osx/README

Once you have the developer tools installed, it is a piece of cake.

Best regards,
Kern

On 09/07/2014 04:06 PM, Paul Mather wrote:
 On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote:

 On 09/07/2014 07:33 AM, Eric Dannewitz wrote:
 I'm interested in perhaps deploying this in my k-8 school, but I have not 
 found a good tutorial of how to install it. Or if it even works right on 
 Mac.

 Anyone have some insights on this? My idea would be to back about 30 macs 
 to an Ubuntu server.
 This would be a good way to setup Bacula.  The Director, SD and catalog
 work well on a Ubuntu server -- I recommend Trusty (14.04).  For the
 Mac's someone probably has made the binaries and distributes them on the
 Internet.  Otherwise if you load all the appropriate build tools on the
 Mac, you can easily build the FD.   Later this year, Bacula Systems will
 provide free binaries for MacOSX which should also help.
 I've not used Bacula on a Mac, but I do notice that Homebrew 
 (http://brew.sh) has a formula for bacula-fd, which could be used to 
 install the client.  Right now, it's only for the 5.x version (5.2.13), 
 though.

 I hope this helps.

 Cheers,

 Paul.



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula for OSX 10.9

2014-09-07 Thread Kern Sibbald
Hello,

No I am not familiar with homebrew.  Sorry, I guess I was not very
clear, but my comment about not very professional was not at all
directed at homebrew.  It was directed at people who produce xx.tar
files when there are package systems available for a particular platform
whether it be .rpm, .deb, .dmg, ...  My point was that it is more
professional to use packages (if they exist) than .tar files.

The package built by the Bacula script does not itself do automatic
package updates, though it is possible that with a mac package manager
it all would work.  Other than having run the scripts and produced
Bacula Mac packages, I am not at all familiar with the details.

Best regards,
Kern

On 09/07/2014 06:03 PM, Paul Mather wrote:
 On Sep 7, 2014, at 10:34 AM, Kern Sibbald k...@sibbald.com wrote:

 The Mac OS X client for Bacula should be a standard Mac OS X package --
 a xxx.dmg file.
 Anything that is a tar or other form is not very professional.  I am not
 sure what homebrew supplies, but if they have done it right it is a .dmg.
 Oh, I see you're not familiar with Homebrew.  It is a package manager 
 for OS X, sort of in the same vein as Fink and MacPorts.  It's popular 
 with a lot of people who want access to lots of Unix open source 
 software and be able to manage it on an ongoing basis.

 I wouldn't decry it as being not very professional unless you also 
 consider the likes of yum, apt-get, pkg, etc. to be not very 
 professional, too.  Sure, it's a different way, but not an unfamiliar 
 metaphor for someone working with an Ubuntu server (as the OP 
 mentioned), which is the only reason I mentioned it.

 I agree that using .dmg files is more commonplace on OS X.  Does the OS 
 X version include an option to check for updates?  I've never used it.

 As you pointed out in your original reply, For the Mac's someone 
 probably has made the binaries and distributes them on the Internet.  
 I did a quick Web search and it seemed that was not the case.  I 
 couldn't find any.  So, it's great that Bacula Systems will be 
 providing free OS X binaries later this year.  That will be another 
 excellent resource for the Bacula community.

 In the meantime, folks can build their own from source, or maybe use 
 Homebrew to do the same. ;-)

 The instructions for building it yourself on a Mac are in the Bacula
 source distribution in:

  bacula/platforms/osx/README

 Once you have the developer tools installed, it is a piece of cake.
 It's pretty easy to install with Homebrew, too: brew install bacula-fd

 Cheers,

 Paul.

 Best regards,
 Kern

 On 09/07/2014 04:06 PM, Paul Mather wrote:
 On Sep 7, 2014, at 5:42 AM, Kern Sibbald k...@sibbald.com wrote:

 On 09/07/2014 07:33 AM, Eric Dannewitz wrote:
 I'm interested in perhaps deploying this in my k-8 school, but I have not 
 found a good tutorial of how to install it. Or if it even works right on 
 Mac.

 Anyone have some insights on this? My idea would be to back about 30 macs 
 to an Ubuntu server.
 This would be a good way to setup Bacula.  The Director, SD and catalog
 work well on a Ubuntu server -- I recommend Trusty (14.04).  For the
 Mac's someone probably has made the binaries and distributes them on the
 Internet.  Otherwise if you load all the appropriate build tools on the
 Mac, you can easily build the FD.   Later this year, Bacula Systems will
 provide free binaries for MacOSX which should also help.
 I've not used Bacula on a Mac, but I do notice that Homebrew 
 (http://brew.sh) has a formula for bacula-fd, which could be used to 
 install the client.  Right now, it's only for the 5.x version (5.2.13), 
 though.

 I hope this helps.

 Cheers,

 Paul.



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Error: block.c:255 Write errors?

2014-09-06 Thread Kern Sibbald
Hello,

I was about to write to you based on your first email containing only
the error that tape errors should be extremely rare and even
non-existent.  The exception is when tapes fill, the information that
Bacula gets depends on the tape drive.  In from what I see below, as
already commented by others, this seems to be a somewhat normal end of
tape condition, where Bacula receives a return indicating that the
block was not written. Unfortunately, the error it gets is generally not
distinguishable from an end of tape condition.  In that case it then
writes an end of file mark and attempts to re-read the last good block. 
If it succeeds as it did in your case, there is probably a 99.999%
chance that the tape is perfectly valid.

The only other thing to check is to see if the amount of data that was
written on the volume corresponds roughly to what you expect --
generally there is a 2/1 compression done by the tape drive, but that is
rather general it can vary from 1/1 (already compressed data) to 3/1 for
pure text.

Best regards,
Kern

On 09/05/2014 10:12 PM, Stephen Thompson wrote:
 Huh, maybe this is a misdiagnosis of the end of tape and a write error 
 only in the sense that there is no tape left.

 05-Sep 00:41 SD_L100_ JobId 389348: Error: block.c:255 Write error at 
 610:412 on device L100-Drive-0 (/dev/L100-Drive-0). ERR=Input/output 
 error.
 05-Sep 00:41 SD_L100_ JobId 389348: Re-read of last block succeeded.
 05-Sep 00:41 SD_L100_ JobId 389348: End of medium on Volume IM0161 
 Bytes=1,090,307,051,520 Blocks=520,103 at 05-Sep-2014 00:41.


 On 09/05/2014 09:42 AM, Stephen Thompson wrote:
 Hello,

 I sporadically get these types of alerts for one on my bacula tape
 libraries...

 05-Sep 00:41 lawson-sd_L100_ JobId 389348: Error: block.c:255 Write
 error at 610:412 on device L100-Drive-0 (/dev/L100-Drive-0).
 ERR=Input/output error.

 Am I correct in assuming that this was indeed a tape write error, but
 that bacula will attempt a 2nd write of the same block of data and if
 that 2nd attempt succeeds proceed on and ultimately have a successfully
 run job (one that can be restored without issue)?

 In other words, should this error worry me if it doesn't happen often?
 It does consistently happen -- with 100's of jobs a night, it probably
 happens 3-4 times a week.

 thanks,
 Stephen


 --
 Slashdot TV.
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume

2014-09-06 Thread Kern Sibbald

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On 09/05/2014 09:16 PM, Dimitri Maziuk wrote:
 On 09/05/2014 01:41 PM, Josh Fisher wrote:

 On 9/5/2014 1:48 PM, Dimitri Maziuk wrote:
 I've another bacula setup that writes to a single filesystem. It's been
 running with about zero problems (knock on wood) and zero maintenance
 for years: auto-labelling works, volume recycling works, the only
 problems are spinning rust and lsi's ugly raid manglement software.

 The whole point of vchanger is to use multiple filesystems as a single
 autochanger.  For a single filesystem I would recommend Bacula's
 built-in disk autochanger capability or else Bacula's standard disk
 storage handling.

 Right, that's my point: when you use bacula's standard disk storage
 handling you get
 - automatic volume labeling,
 - automatic volume recycling,
 and generally near zero maintenance overhead.

 With vchanger I
 - have a job split over different disks,
 - need to manually fix the catalog every time I sneeze,
 - get into weird intervention needed loops where bacula mounts a
 volume it's just filled up and complains it couldn't write to some other
 volume it shouldn't have tried in the first place.

 Ergo, if you want to use multiple filesystems, the smart move would be
 to fake the standard disk storage over multiple filesystems.

 (As for built-in disk autochanger, Kern's explanation of it never made
 much sense to me: maybe it's useful for debugging or something...)

Can you tell me what my explanation of the disk autochanger was and why
it did not make sense to you?

By the way the built-in disk autochanger is typically called the
virtual autochanger.

Providing you use pools and media types correctly the virtual
autochanger can actually handle multiple filesystems.  Even without, I
have documented in the manual how to use multiple filesystems with
symlinks (a slight bit more annoying to setup).  I ran very small data
center in that configuration for about 10 years.  The only maintenance
was to update Bacula and add additional disk drives when the user's data
volume increased.

A very large number of our enterprise clients are using the virtual
autochanger with a lot of success.   As you say, once you install it, it
just runs.   I have absolutely nothing against vchanger, because a lot
of people are very happy with it.  However, it is not a Bacula product,
and it seems that it works like a tape autochanger which requires much
more maintenance than the virtual autochanger, which is just a simple
extension of individual disk Devices.

Best regards,
Kern


-BEGIN PGP SIGNATURE-
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iEYEARECAAYFAlQKwWcACgkQNgfoSvWqwEi5vQCff51zbNhqAX/FHugOSq9W7HXz
/bAAoOwykZVB4I0c+66tiOebi8cLv8ms
=VJKk
-END PGP SIGNATURE-


--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Socket error after upgrade to 7.x

2014-09-06 Thread Kern Sibbald
Hello,

It seems to me that was because your system does not support IPv6, for
which Bacula was checking.  You didn't mention the exact 7.0.x version,
but it seems to me that this was quickly fixed.

Best regards,
Kern

On 09/06/2014 12:21 PM, Andrea Venturoli wrote:
 Hello.

 I've got several Bacula setup on FreeBSD 8.4.

 After the upgrade to 7.x all jobs results switched from Ok to Ok with 
 warning.

 I believe it's due to the following error:
 Error: bsock.c:226 Socket open error. proto=28 port=9103. ERR=Protocol not 
 supported
 However I don't have a clue where it comes from.
 Any hint?

   bye  Thanks
   av.

 --
 Slashdot TV.  
 Video for Nerds.  Stuff that matters.
 http://tv.slashdot.org/
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula-dir stuck trying to mount the wrong volume

2014-09-06 Thread Kern Sibbald
Hello,

Yes, I likely chimed in with the statement you said, and it seems like
most everything you say is correct -- I cannot find the documentation on
these features.

I now remember why I didn't answer you the last time and why I probably
won't this time either.  It is because when I read what you write to me,
perhaps I am overly sensitive, but I get the feeling that you don't like
Bacula, you don't like me, and you are being sarcastic.  I hope I am
completely wrong on all those points, but that is how I take it, so the
best response is just silence.

Kern



On 09/06/2014 06:43 PM, Dmitri Maziuk wrote:
 On 9/6/2014 3:10 AM, Kern Sibbald wrote:

 Can you tell me what my explanation of the disk autochanger was and why
 it did not make sense to you?

 The goal was to write file volumes -- same pool, same backup set, to a
 set of filesystems (hosted on removable disks). The thread went on a
 for a couple of weeks and the conclusion was vchanger is the only way
 to do it.

 As I recall somewhere in the middle you chimed in with there's
 virtual autochanger and it works or something along those lines.
 Pretty much what you wrote again in the message I'm replying to. I
 haven't seen any documentation on how it works or what it does, so a)
 I believe you and b) it's of no use to me.

 Similarly, you've documented how to use symlinks for this? Great!
 Where? Basic Volume Management - Backing Up to Multiple Disks from
 7.0 looks the same as it ever was. Is that in the enterprise manual only?

 Dimitri



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula Status Report

2014-09-05 Thread Kern Sibbald
Hello,

I have posted a Bacula Status report to the www.bacula.org site.
It discusses the following items:

1. Bacula Release Status

2. Windows Binaries

3. Bacula Enterprise

4. Vacation

5. Bareos

The following is a link to the report.

http://blog.bacula.org/bacula-status-report-30-august-2014/

Best regards,
Kern

--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Stop unfinished backup, retain data

2014-08-28 Thread Kern Sibbald
Hello,

The Bacula Enterprise Edition has this feature.  At some point in time
(at the latest about 4 years from now) this feature will be back ported
to the community version.

Best regards,
Kern

On 08/27/2014 06:57 PM, Richard Fox wrote:
 Hi All,

 I use Bacula 5.2.6. If I'm not mistaken when I have a backup running and I 
 cancel it, Bacula discards the backup records for the data it has taken to 
 tape 
 which requires Bacula to back up the same files again on the next run. Isn't 
 that correct?

 If that is correct, is there any way to stop a running backup in which Bacula 
 retains what it has managed to backup so far and picks up where it left off 
 on 
 the next run?

 Thanks,
 Rich.



--
Slashdot TV.  
Video for Nerds.  Stuff that matters.
http://tv.slashdot.org/
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Recycling issue

2014-08-06 Thread Kern Sibbald
Hello Martin,

Bacula never checks the Media Type vs what is in the label.

The problem for users who have not understood the importance of making
the Media Types unique will be to modify their catalog database.  Before
making this change, I will provide some reasonable solution.

Best regards,
Kern

On 08/06/2014 12:44 PM, Martin Simmons wrote:
 On Wed, 06 Aug 2014 07:41:59 +0200, Kern Sibbald said:
 In the next Bacula version, I will probably modify the SD and
 possibly the Dir to require unique MediaTypes, then this problem
 will be resolved.
 I hope that forcing users to change the configured MediaType won't cause a
 problem with old media (because the label contains the media type and won't
 match anymore).

 __Martin



--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error

2014-08-06 Thread Kern Sibbald
Hello Patti,

Are you sure this is happening on 7.0.x?  I worked hard on this problem
between 5.2.x and 7.0.x, and I thought I had fixed the problem -- unless
there is some code path I missed.   It is possible that this is
happening only when there is no other drive that the 3rd job can use,
but if there are other drives available, Job 3 should select a different
volume.

Best regards,
Kern

On 08/06/2014 03:16 PM, Clark, Patricia A. wrote:
 Kern,

 This is exactly the problems that myself and others have been reporting with 
 autochanger and tape volumes.  Thank you Josh for the very descriptive 
 details.

 One additional issue that these race conditions can also create, if the 1st 2 
 jobs fill the volume that the 3rd job is waiting for, the 3rd job will fail 
 when it finds that it has mounted a read-only volume.

 Patti Clark
 Linux System Administrator
 RD Systems Support Oak Ridge National Laboratory

 From: Kern Sibbald k...@sibbald.commailto:k...@sibbald.com
 Date: Wednesday, August 6, 2014 at 1:52 AM
 To: Josh Fisher jfis...@pvct.commailto:jfis...@pvct.com, 
 bacula-users@lists.sourceforge.netmailto:bacula-users@lists.sourceforge.net
  
 bacula-users@lists.sourceforge.netmailto:bacula-users@lists.sourceforge.net
 Subject: Re: [Bacula-users] Disk based backup using vchanger, volumes being 
 marked as Error

 On 08/04/2014 06:43 PM, Josh Fisher wrote:

  ...

 Have you set PreferMountedVolumes=no in the Job resource in bacula-dir.conf? 
 If 3 jobs start and want to write to volumes in the same pool, then all three 
 can be assigned the same volume. In fact, if PreferMountedVolumes=yes, (the 
 default), then all three WILL be assigned the same volume unless the pool 
 restricts the max number of jobs that the volume may contain. However, your 
 device (drive) restricts the max concurrent jobs to 2. Therefore one of those 
 three jobs will not be able to select the drive where the volume is mounted 
 and will be forced to select another unused drive. That third job will 
 nevertheless select the same volume as the other two and attempt to move the 
 volume from the drive it is in into the drive that it has been assigned to. 
 The configuration has a built-in race condition.
 This is the first time that I have heard this explained so clearly.  I am 
 going to try to duplicate this problem now that you have so clearly explained 
 it.  By the way, I am not really sure I would classify this as a race 
 condition, because theoretically the SD is not blocked, the third job just 
 waits until the Volume is free (at least that is what I programmed).  
 However, this is clearly very inefficient.

 I would like to fix this, but one must keep in mind one important difficulty 
 with Bacula.  The SD knows what is going on with Volumes, but the Dir does 
 not, and it is the Dir that proposes Volumes to the SD.  Currently there is 
 no good atomic way to pass the information in the SD to the Dir so that it 
 can make better decisions.

 So, with the (current) restraint that the solution must involve changing only 
 the SD algorithm, how could one prevent this from happening?  I have some 
 ideas, but wonder what you think.


 Setting PreferMountedVolumes=no causes the three jobs to select a drive that 
 is NOT already mounted with a volume from the pool. This allows jobs writing 
 to the same pool to select different volumes from the pool, rather than all 
 selecting the same next available volume. This has its own caveats. It 
 doesn't necessarily prevent two jobs from selecting the same volume in some 
 cases, meaning that they will want to swap the volume back and forth between 
 drives, which is another type of race condition. I have used this method 
 successfully for a pool containing full backups only by setting 
 PreferMountedVolumes=no in the job resource and setting MaximumVolumeJobs=1 
 in the pool resource. Since Bacula selects the volume for a job in an atomic 
 manner, this forces an exclusive set of volumes for each job, thus preventing 
 the race condition. This means that concurrency is limited only by the number 
 of drives, but at the expense of creating a greater number of smaller 
 volume files. I quote e
 xpense because on a disk vchanger it isn't usually a big issue to have more 
volume files. Doing this with a tape autochanger would use a lot more tapes and 
be truly more expensive. Of course unlimited concurrency is theoretical, since 
the hardware limits the USEFUL concurrency.

 I really do not like the PreferMountedVolumes = No option (I have probably 
 said this many times), but I find your use of it very well explained and very 
 interesting.

 Best regards,
 Kern

 ...





--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu

Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error

2014-08-05 Thread Kern Sibbald

  
  
On 08/05/2014 02:10 PM, Josh Fisher
  wrote:


  
  On 8/5/2014 1:36 AM, Kern Sibbald
wrote:
  
  

Hello Josh,
  
  Please see below ...
  
  On 08/04/2014 06:43 PM, Josh Fisher wrote:


  
  On 8/1/2014 12:27 PM, Joseph
Dickson wrote:
  
  
Greetings :-)
  
  
  I've run into this problem with Bacula in a previous
installation, and I can't seem to recall if there was
ever a resolution..  I'm using Bacula for disk based
backups only, and I am using vchanger to manage my
virtual library.  
  
  
  I've configured a vchanger library with 100 slots and
8 drives, and have set a Maximum Volume Bytes of 100G on
the pool definition that I am using, to limit each slot
in the library to 100G.  I have also set a Maximum
Concurrent Jobs = 2 setting on each of the virtual tape
drive devices in my storage director config, so that
only two jobs can write to a device at a time to
minimize interleaving.
  
  
  Everything works perfectly as long as I only kick a
few jobs off at a time.. however, when my main backup
windows run and 30 or 40 backup jobs kick off, I often
end up with jobs that output the following sequence in
the logs:

  
  
  Have you set PreferMountedVolumes=no in the Job resource in
  bacula-dir.conf? If 3 jobs start and want to write to volumes
  in the same pool, then all three can be assigned the same
  volume. In fact, if PreferMountedVolumes=yes, (the default),
  then all three WILL be assigned the same volume unless the
  pool restricts the max number of jobs that the volume may
  contain. However, your device (drive) restricts the max
  concurrent jobs to 2. Therefore one of those three jobs will
  not be able to select the drive where the volume is mounted
  and will be forced to select another unused drive. That third
  job will nevertheless select the same volume as the other two
  and attempt to move the volume from the drive it is in into
  the drive that it has been assigned to. The configuration has
  a built-in race condition.


I have recently done quite a bit of work to try to avoid race
conditions such as the one you describe above.  Does this still
happen on version 7.0.x?   I ask because there is now code that
*should* detect this and explicitly makes the third job (as you
describe above) wait.  Now it is possible that there is some
code path in the SD where the new code does not apply, so I
cannot exclude problems, but if any exist in 7.0.x I would like
to know so I can work on it some more.  With the new code, the
Volume will be moved around, but at least it should be done
correctly without some deadlock or failure.

  
  
  I haven't had a chance to update to 7.0.x yet, so I can't say. My
  thought is that the volume itself should have a "Maximum
  Concurrent Jobs" setting, in addition to the SD Device. Better
  still, it could be automated by forcing the volume's max
  concurrency to that of the SD device at mount time. That should
  eliminate the need for "Prefer Mounted Volumes" altogether, since
  once the "Maximum Concurrent Jobs" have selected the volume,
  subsequent jobs would reject it as unavailable and so see the
  drive it is mounted in as unavailable at drive selection time.
  Once a drive is selected, that volume would be viewed as
  unavailable and rejected during volume selection, at least until
  one of the jobs using the volume ends. So by setting "Max
  Concurrent Jobs" to 1, one could guarantee a volume would never be
  selected by more than one job at a time.


Yes, I would like to do something like what you say, but
unfortunately I concerned that it opens up other possibilities for
race conditions due to the fact that there are 3 components dealing
with the data (SD, DIR, and the catalog).

I have some ideas, and I hope to implement them in the next major
Bacula version.

Best regards,
Kern
...
  


--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http:

Re: [Bacula-users] Recycling issue

2014-08-05 Thread Kern Sibbald

  
  
Hello,
  
  Probably 95% of all such problems are due to configurations where
  the MediaType is not properly set. 
  
  - If you are using any form of autochanger, each autochanger must
  have a *unique* MediaType.
  
  - Each Device configuration in the SD must have a unique MediaType
  for each different ArchiveDevice definition.  Said the other way
  around, each ArchiveDevice definition must have its own unique
  MediaType.
  
  The .conf files you list are incomplete, so it is not possible to
  analyze them, but when I see:  MediaType = File, that raises a red
  flag that indicates that there may be other Storage devices with
  the same MediaType, and if that is the case, sooner or later, you
  will find that Bacula is very confused.
  
  In the next Bacula version, I will probably modify the SD and
  possibly the Dir to require unique MediaTypes, then this problem
  will be resolved.
  
  I don't usually supply "support"  because I don't have the time,
  but this particular problem interests me from the standpoint that
  I would like to prevent it, but with no console/job output showing
  the failures and incomplete DIR and SD confs I cannot do any more.
  
  Best regards,
  Kern
  
  On 08/05/2014 03:08 PM, Joe Rhodes wrote:


  
  I’m also running into this issue.  
  
  
  In my case, I’ve setup a disk-based auto-changer (vchanger)
with two pools:  Full and Weekly.  Each pool has multiple drives
with 8 volumes on each drive.  The script that mounts the disk
also issues an “update slots” command in bconsole, and I can
verify that bacula sees the correct volumes as “InChanger”.
  
  
  When I swap out disks (weekly), Bacula continues to look for
volumes that were append-able, but on the previous disk (and not
currently marked as “InChanger”) and refuses to write to the
append-able volumes on the new disk that are marked as
“InChanger”.  It marks all the previous volumes it cannot access
as “Error”, and only then will it begin writing to the currently
loaded volumes.
  
  
  This  line from the “Recycling Algorithm” led me to believe
that it would use a volume that was InChanger first:  "If the
request is for an Autochanger device, look only for Volumes in
the Autochanger (i.e. with InChanger set and that have the
correct Storage device).”
  
  
  But it seems I’m missing something.  I’ve included relevant
bits from my bacula-dir.conf file if anyone can see what I’m
doing wrong.  I’m getting this on two systems, one running
Bacula 5.2.12 and one running 7.0.4.
  
  
  My other option is to split these all into separate pools,
but that’s going to make scheduling much harder.
  
  
  Thanks in advance!
  -Joe Rhodes
  
  
  
  
  # Definition of file Virtual Autochanger device

Storage {
  Name = removeable-drives
  Address = 10.11.1.2
  SDPort = 9103
  Password = “password"
  Device = ExternalDrives
  Media Type = File
  Maximum Concurrent Jobs = 1
}

  
  # Pools
  Pool {
  Name = FullSet
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Use Duration = 1 week
  #We're on an 2 month rotation
  VolumeRetention = 58 days
  Maximum Volumes = 32  # 4 drives with 8 volumes on each
  Storage = removeable-drives
}

  
  
  
  Pool {
  Name = Weekly
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Use Duration = 1 week
  VolumeRetention =  3 weeks
  Maximum Volumes = 40  # 5 drives with 8 volumes on each
  Storage = removeable-drives
}

  
  
  
  And my bacula-sd.conf:
  
  
  # Define a Virtual autochanger

Autochanger {
  Name = ExternalDrives
  Device = ExternalDrives-Drive1
  Changer Command = "/usr/local/bin/vchanger -u root  %c %o %S
%a %d"
  Changer Device = "/etc/bacula/vchanger1.conf"
}

Device {
  Name = ExternalDrives-Drive1
  DriveIndex = 0
  Autochanger = yes
  DeviceType = File
  Media Type = File
  Archive Device = /var/lib/bacula/removeable-drives/0/drive0
  Random Access = Yes;
  AutomaticMount = yes;              
  RemovableMedia = no;
  AlwaysOpen = no;
  Maximum Concurrent Jobs = 5;
  Maximum Volume Size = 476250 M;  # with 8 volumes pe

Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error

2014-08-05 Thread Kern Sibbald

  
  
On 08/04/2014 06:43 PM, Josh Fisher
  wrote:
  
   ...


  
  
  Have you set PreferMountedVolumes=no in the Job resource in
  bacula-dir.conf? If 3 jobs start and want to write to volumes in
  the same pool, then all three can be assigned the same volume. In
  fact, if PreferMountedVolumes=yes, (the default), then all three
  WILL be assigned the same volume unless the pool restricts the max
  number of jobs that the volume may contain. However, your device
  (drive) restricts the max concurrent jobs to 2. Therefore one of
  those three jobs will not be able to select the drive where the
  volume is mounted and will be forced to select another unused
  drive. That third job will nevertheless select the same volume as
  the other two and attempt to move the volume from the drive it is
  in into the drive that it has been assigned to. The configuration
  has a built-in race condition.

This is the first time that I have heard this explained so clearly. 
I am going to try to duplicate this problem now that you have so
clearly explained it.  By the way, I am not really sure I would
classify this as a race condition, because theoretically the SD is
not blocked, the third job just waits until the Volume is free (at
least that is what I programmed).  However, this is clearly very
inefficient.  

I would like to fix this, but one must keep in mind one important
difficulty with Bacula.  The SD knows what is going on with Volumes,
but the Dir does not, and it is the Dir that proposes Volumes to the
SD.  Currently there is no good atomic way to pass the information
in the SD to the Dir so that it can make better decisions.  

So, with the (current) restraint that the solution must involve
changing only the SD algorithm, how could one prevent this from
happening?  I have some ideas, but wonder what you think.

 
  Setting PreferMountedVolumes=no causes the three jobs to select a
  drive that is NOT already mounted with a volume from the pool.
  This allows jobs writing to the same pool to select different
  volumes from the pool, rather than all selecting the same next
  available volume. This has its own caveats. It doesn't necessarily
  prevent two jobs from selecting the same volume in some cases,
  meaning that they will want to swap the volume back and forth
  between drives, which is another type of race condition. I have
  used this method successfully for a pool containing full backups
  only by setting PreferMountedVolumes=no in the job resource and
  setting MaximumVolumeJobs=1 in the pool resource. Since Bacula
  selects the volume for a job in an atomic manner, this forces an
  exclusive set of volumes for each job, thus preventing the race
  condition. This means that concurrency is limited only by the
  number of drives, but at the "expense" of creating a greater
  number of smaller volume files. I quote "expense" because on a
  disk vchanger it isn't usually a big issue to have more volume
  files. Doing this with a tape autochanger would use a lot more
  tapes and be truly more expensive. Of course unlimited concurrency
  is theoretical, since the hardware limits the USEFUL concurrency.


I really do not like the PreferMountedVolumes = No option (I have
probably said this many times), but I find your use of it very well
explained and very interesting.

    Best regards,
Kern

...


  


--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Disk based backup using vchanger, volumes being marked as Error

2014-08-04 Thread Kern Sibbald

  
  
Hello Josh,
  
  Please see below ...
  
  On 08/04/2014 06:43 PM, Josh Fisher wrote:


  
  On 8/1/2014 12:27 PM, Joseph Dickson
wrote:
  
  
Greetings :-)
  
  
  I've run into this problem with Bacula in a previous
installation, and I can't seem to recall if there was ever a
resolution..  I'm using Bacula for disk based backups only,
and I am using vchanger to manage my virtual library.  
  
  
  I've configured a vchanger library with 100 slots and 8
drives, and have set a Maximum Volume Bytes of 100G on the
pool definition that I am using, to limit each slot in the
library to 100G.  I have also set a Maximum Concurrent Jobs
= 2 setting on each of the virtual tape drive devices in my
storage director config, so that only two jobs can write to
a device at a time to minimize interleaving.
  
  
  Everything works perfectly as long as I only kick a few
jobs off at a time.. however, when my main backup windows
run and 30 or 40 backup jobs kick off, I often end up with
jobs that output the following sequence in the logs:

  
  
  Have you set PreferMountedVolumes=no in the Job resource in
  bacula-dir.conf? If 3 jobs start and want to write to volumes in
  the same pool, then all three can be assigned the same volume. In
  fact, if PreferMountedVolumes=yes, (the default), then all three
  WILL be assigned the same volume unless the pool restricts the max
  number of jobs that the volume may contain. However, your device
  (drive) restricts the max concurrent jobs to 2. Therefore one of
  those three jobs will not be able to select the drive where the
  volume is mounted and will be forced to select another unused
  drive. That third job will nevertheless select the same volume as
  the other two and attempt to move the volume from the drive it is
  in into the drive that it has been assigned to. The configuration
  has a built-in race condition.


I have recently done quite a bit of work to try to avoid race
conditions such as the one you describe above.  Does this still
happen on version 7.0.x?   I ask because there is now code that
*should* detect this and explicitly makes the third job (as you
describe above) wait.  Now it is possible that there is some code
path in the SD where the new code does not apply, so I cannot
exclude problems, but if any exist in 7.0.x I would like to know so
I can work on it some more.  With the new code, the Volume will be
moved around, but at least it should be done correctly without some
deadlock or failure.

Best regards,
Kern

 
  Setting PreferMountedVolumes=no causes the three jobs to select a
  drive that is NOT already mounted with a volume from the pool.
  This allows jobs writing to the same pool to select different
  volumes from the pool, rather than all selecting the same next
  available volume. This has its own caveats. It doesn't necessarily
  prevent two jobs from selecting the same volume in some cases,
  meaning that they will want to swap the volume back and forth
  between drives, which is another type of race condition. I have
  used this method successfully for a pool containing full backups
  only by setting PreferMountedVolumes=no in the job resource and
  setting MaximumVolumeJobs=1 in the pool resource. Since Bacula
  selects the volume for a job in an atomic manner, this forces an
  exclusive set of volumes for each job, thus preventing the race
  condition. This means that concurrency is limited only by the
  number of drives, but at the "expense" of creating a greater
  number of smaller volume files. I quote "expense" because on a
  disk vchanger it isn't usually a big issue to have more volume
  files. Doing this with a tape autochanger would use a lot more
  tapes and be truly more expensive. Of course unlimited concurrency
  is theoretical, since the hardware limits the USEFUL concurrency.
  
  

  
  
  31-Jul

  21:00 bacula1-dir JobId 692: Start Backup JobId 692,
  Job=job-evolvereports-main.2014-07-31_21.00.00_48
31-Jul

  21:00 bacula1-dir JobId 692: Using Device "chg1-drive-1"
  to write.
31-Jul

  21:00 evolvereports-fd JobId 692: DIR and FD clocks differ
  by 50 seconds, FD automatically compensating.
31-Jul

  21:05 bacula1-sd JobId 692: 3307 Issuing autochanger
  "unload slot 74, drive 1" command.
31-Jul

  21:

Re: [Bacula-users] Using two pools for backup

2014-08-01 Thread Kern Sibbald
Hello,

Some points:

1. You can combine your Full and Differential run directives on two
directives, which will in my opinion be easier to read with:

   Run = Level=Full Pool=File on 1st sun jan,mar,may,jul,sep,nov at 00:00
   Run = Level=Differential Pool=File on 1st sun feb,apr,jun,aug,oct,dec
at 00:00

2. Separating jobs into Pools separates them for pruning (i.e.
expiration) but does not separate them for restoration.  This is because
when doing backups and restores, Bacula considers all the jobs of the
same name as a group or in its entirety.  To completely disassociate the
Incrementals, you need to use a different Job name.  The first will
upgrade to a Full, then your incrementals will be separate and more or
less duplicate what you backup in the other job.

3. You can probably do something closer to what you really want, but it
is a bit more complicated, by having everything running under the same
job, but periodically you do a Virtual Full, which would essentially
combine your Full, Differential, and all your Incrementals into one big
full.  To make it reliable, I recommend that you run the Accurate option
on your Incremental jobs.  That ensures that you will never miss backing
up an important file. 

4. If you do not do a Virtual Full, you will need to keep all of your
incrementals at lease as long as the period between your last Full or
Differential (i.e. one month).  This is quite possible, but you may end
up requiring a very large number of incremental jobs to do a Full restore.

Best regards,
Kern



On 08/01/2014 09:16 PM, Ross Williamson wrote:
 Hi All,

 Pretty new to bacula so apologies if this is dumb..I would like to
 simulate a Mac Time Machine feature. My setup is to have a full
 backup every 2 months, a differential every other month (out of sync
 with the full) and an incremental every day.  I think I have this
 setup as expected and it all writes to a pool.

 What I'm now trying to do is setup a short term hourly pool which will
 allow me to roll back upto say a day or twos work on hourly
 increments.  For this I've setup a second pool that writes to a
 different disk.  The question I have is when the incremental is done
 on the daily basis does it look at the other pools data (which gets
 refreshed after 23 hours) or the last incremental on the main backup
 pool? Sorry if this is confusing - I've posted relevant sections from
 the bacula-dir.conf below:

 Many thanks


 JobDefs {
   Name = DefaultJob
   Type = Backup
   Level = Incremental
   Client = seacat-fd
   FileSet = Home Directory
   Schedule = TwoMonth
   Storage = File
   Messages = Standard
   Pool = File
   Priority = 10
   Write Bootstrap = /var/lib/bacula/%c.bsr
 }

 Job {
   Name = BackupHome
   JobDefs = DefaultJob
 }

 Schedule {
   Name = TwoMonth
   Run = Level=Full Pool=File on 1st sun jan at 00:00
   Run = Level=Differential Pool=File on 1st sun feb at 00:00
   Run = Level=Full Pool=File on 1st sun mar at 00:00
   Run = Level=Differential Pool=File on 1st sun apr at 00:00
   Run = Level=Full Pool=File on 1st sun may at 00:00
   Run = Level=Differential Pool=File on 1st sun jun at 00:00
   Run = Level=Full Pool=File on 1st sun jul at 00:00
   Run = Level=Differential Pool=File on 1st sun aug at 00:00
   Run = Level=Full Pool=File on 1st sun sep at 00:00
   Run = Level=Differential Pool=File on 1st sun oct at 00:00
   Run = Level=Full Pool=File on 1st sun nov at 00:00
   Run = Level=Differential Pool=File on 1st sun dec at 00:00

   Run = Level=Incremental Pool=File mon-sat at 23:05

   Run = Level=Incremental Pool=HourlyPool mon-sun at 00:00 01:00 02:00
 03:00 04:00 05:00 06:00 07:00 08:00 09:00 10:00 11:00 12:00 13:00
 14:00 15:00 16:00 17:00 18:00 19:00 20:00 21:00 22:00
 }


 # File Pool definition
 Pool {
   Name = File
   Pool Type = Backup
   Recycle = yes   # Bacula can automatically recycle 
 Volumes
   AutoPrune = yes # Prune expired volumes
   Volume Retention = 180 days # half a year
   Maximum Volume Bytes = 50G  # Limit Volume size to something
 reasonable
   Maximum Volumes = 30  # Limit number of Volumes in Pool
   LabelFormat = Vol
 }

 Pool {
  Name = HourlyPool
  Pool Type = Backup
  Volume Retention = 23 hours
  Recycle = yes
  AutoPrune = yes
  Maximum Volume Bytes = 10G
  Maximum Volumes = 50
  LabelFormat = Hourly
 }



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] New user with Bacula

2014-07-30 Thread Kern Sibbald

  
  
To me a "NetApp Client" means a file
  daemon that runs inside the NetApp box and has access to all its
  disks and thus can backup the NetApp box using Bacula directly
  without NDMP or NFS/CIFS.
  
  Best regards,
  Kern
  
  On 07/30/2014 02:56 PM, Radosław Korzeniewski wrote:


  Hello,

  2014-07-29 20:40 GMT+02:00 Kern
Sibbald k...@sibbald.com:

  Hello,
  
  No unfortunately, NetApp will not let us create a NetApp
  client :-(
  



Could you explain what "NetApp Client" is/will be/could
  be, please. What do you mean by "NetApp Client". I'd like
  to understand this thread, but I'm not an english native
  speaker so I miss the main point of this thread.


Thanks in advance.


best regards
  
  -- 
  Radosław Korzeniewski
  rados...@korzeniewski.net

  


  


--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] New user with Bacula

2014-07-29 Thread Kern Sibbald
Hello,

No unfortunately, NetApp will not let us create a NetApp client :-(

Best regards,
Kern

On 07/29/2014 04:43 PM, Dmitri Maziuk wrote:
 On 7/29/2014 2:59 AM, leandro.cu...@reedglobal.com wrote:
 Hi Dimitri,

 Thank you for your return. My requirement is just to keep some snapshots
 for a period of 30 days, and once a month an infinity retention job.
 I expect you'll have to mount netapp volumes someplace and run bacula 
 client there. Unless Kern has a netapp client in the enterprise codebase.

 Dimitri



 --
 Infragistics Professional
 Build stunning WinForms apps today!
 Reboot your WinForms applications with our WinForms controls. 
 Build a bridge from your legacy apps to the future.
 http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Infragistics Professional
Build stunning WinForms apps today!
Reboot your WinForms applications with our WinForms controls. 
Build a bridge from your legacy apps to the future.
http://pubads.g.doubleclick.net/gampad/clk?id=153845071iu=/4140/ostg.clktrk
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula.org web site non-functional?

2014-07-27 Thread Kern Sibbald
Hello,

Thanks for the tip.  Although there are a lot of very nice features in
wordpress, style sheets and such are *far* more complicated than the old
php website.  That means that I am more or less lost in wordpress.

Thanks to you pointing to the exact place, I have reduced the minimum
width to 800 and adjusted the box hight to be slightly larger which
makes a bit less of an overlap with a small screen size.

Hopefully everyone will find this a lot better than what it was.  Thanks
again for the help.

Best regards,
Kern

On 07/26/2014 11:54 PM, Mike Ruskai wrote:
 On 7/26/2014 3:51 PM, Brady, Mike wrote:
 On 2014-07-26 19:07, Wolfgang Denk wrote:
 Dear Luc Van der Veken,

 In message
 F41F2F82D41438499ECDB25322DA5D9E184F13EE@mail.wimionline.local you
 wrote:
 The Blog and Recent Topics sections at the top remain the same
 everywhere and take up so much space that I have to page down to see
 the actual content, which *is* there.
 Ah, indeed.  Same for me.

 Well, this is a really unusable web design.

 Best regards,

 Wolfgang Denk

 What may be causing some confusion is that the bacula.org web site
 displays differently depending on the width of your browser window. On
 my Fedora 20 (Chrome and Firefox) the Blog and Recent Topics display in
 their own narrow box/column on the left of the window and the main page
 content is in a wider box/column on the right of the window.

 If I reduce the width of the window, it gets to a point where the Blog
 and Recent Topics box/column changes to being full window width at the
 top of each page.  My monitor is 1920x1200 and I would say that the
 layout changes at about 1280 wide.

 Regards

 Mike

 In the CSS of the page, one finds this:

 @media(min-width: 1200px){
 .col-lg-1, .col-lg-2, .col-lg-3, .col-lg-4, .col-lg-5, .col-lg-6, 
 .col-lg-7, .col-lg-8, .col-lg-9, .col-lg-10, .col-lg-11, .col-lg-12 {
 float: left;
 }

 This is the culprit here.  That's an unreasonably large minimum size.  
 Setting it to 800px results in the column remaining on the left for much 
 smaller windows.  It introduces some formatting problems with the boxes 
 under How to find what you need, which only allocate two lines for the 
 title of each box. Setting it to 1000px avoids this and would make the 
 page work better on a maximized browser at 1024x768.



 --
 Want fast and easy access to all the code in your enterprise? Index and
 search up to 200,000 lines of code with a free copy of Black Duck
 Code Sight - the same software that powers the world's largest code
 search on Ohloh, the Black Duck Open Hub! Try it now.
 http://p.sf.net/sfu/bds
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Purged volumes not being moved to recycling pool

2014-07-26 Thread Kern Sibbald
Hello,

Once a volume is marked disabled, Bacula should do *nothing* with it. We
might even consider if we want to turn off pruning of disabled volumes,
but I am not sure that would be a good idea as it could lead to a
catalog that grows.

Best regards,
Kern

On 07/26/2014 07:37 PM, Bill Arlofski wrote:
 OK, since I am having such a nice conversation with myself, I thought I would
 re-open this issue and continue on.

 OK, that is not the real reason.   hehe :)


 Kern, I use vchanger with several removable eSATA drives, and also use a
 script I wrote to set the Enabled field when I change drives which sets all
 volumes' Enabled field to '0' except for the volumes currently available on
 the inserted drive - those are of course set to '1'.   This solves a different
 problem which we have conversed about in the past on the list.


 My question is this:

 It looks like if a volume's Enabled field is set to '0', Bacula will purge it
 when it is supposed to, but does not move it to the defined Scratch pool, and
 instead purges it and leaves it in its current pool.


 This was the cause of my confusion which started this thread, because when I
 look for a vchanger magazine to use when Bacula asks for a volume, I do a:

 list volumes Pool=Offsite-eSATA-Scratch

 and was not finding anything available there. That is when I listed all media
 and noticed that I had purged volumes stuck in other pools - and ultimately
 realized that those purged volumes had their Enabled field set to '0'

 As a test, just now Bacula was waiting on a volume.  I listed my volumes, saw
 that several volumes on vchanger magazine #2 were purged but left in the
 Offsite-eSATA-Diff pool.

 I inserted vchanger volume #2, ran my script which sets those volumes' Enabled
 field to '1', and ran an update slots command in bconsole.

 Bacula immediately did:

 26-Jul 13:13 bacula-dir JobId 27448: Recycled volume c0_0002_0031

 and the job(s) continued on.


 I realize that setting the Enabled field outside of Bacula is a little
 non-standard, but don't you think that Bacula should move a volume to its
 specified recycle pool even it the volume is not currently enabled?   I mean,
 even though the volume is disabled, Bacula is respecting the retention periods
 and is purging all the data on the volume from the db, so why not also respect
 the Recycle Pool?


 Thanks!

 And thanks for Bacula!





--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula.org web site non-functional?

2014-07-25 Thread Kern Sibbald
Hello,

www.bacula.org is perfectly functional.

What OS and browser are you using.

Systems known to work, Windows IE, Mac Safari, Linux Firefox,  Windows
Chrome, ...

Kern

On 07/25/2014 09:41 AM, Wolfgang Denk wrote:
 Hi,

 is it only for me that the bacula.org web site is non-functional?
 I get always only an entry page, and no matter which link I click, the
 content will not change - exception: the links in the Downloads menu
 still work.

 Especially, it is impossible to get access to the documentation...

 Or am I missing something?

 Best regards,

 Wolfgang Denk



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fatal error: askdir.c:355 NULL Volume name. This shouldn't happen!!!

2014-07-23 Thread Kern Sibbald
On 07/22/2014 11:34 PM, Clark, Patricia A. wrote:
 Sadly, this error is still present in v7.0.4.  There is another error, too, 
 where there is no writeable media in the tape drive.
 Fatal error: spool.c:263 Fatal append error on device LTO5-2 
 (/dev/tape-admin2): ERR=tape_dev.c:161 Unable to open device LTO5-2 
 (/dev/tape-admin2): ERR=No medium found
 Both of these are a result of race conditions occurring on tape libraries 
 with multiple tape drives, one job per drive, and several backup jobs running 
 nearly simultaneously.  Frequently, the storage daemon requires a restart in 
 order to release the tape drive affected by the error since the SD still sees 
 a running job, however, the director has already indicated the error, sent 
 the notification, and does not have a running job to cancel.  On a busy 
 system, restarting the SD can be problematic, and losing one or more tape 
 drives is also a problem.

 My question, why isn't Bacula happy with a writeable volume from the same 
 pool if one is mounted in the tape drive assigned to a job?

I don't know the answer to the question otherwise I would fix the
problem. It could be for a number of reasons one being that the Volume
has been pruned or otherwise expired.  Most often triggering the problem
has something to do with your particular configuration, which judging by
where you work, is probably large and/or complicated.

If you can provide more information on this, it is worth posting a bug
report.  I will need copies of you bacula-dir.conf and bacula-sd.conf
(with passwords removed please) as well as a status storage, status
dir, list Volumes, and llist volume=xxx for each Volume that is
stuck on the SD when the problem occurs.  This will show me a bit what
is going on.  Given the complexity of the problem, you will probably
need to install gdb on your SD so we can examine the internal state of
the SD when it gets into this condition.

Are you doing Volume pruning?  If so, is your Volume Retention Period
set to an exact multiple of 24 hours.  If that is the case, set your
Volume retention to a multiple of 24 hours minus 2 hours, then sure that
you properly reload your configuration and that you update all your
current Volumes.  If the first two conditions (pruning) are true, this
has about 95% chance of eliminating your problems. If this eliminates
your problems, I won't need a bug report.  For the case I have just
described, I know the problem, but I am not yet 100% sure what the best
way to fix it is.

Best regards,
Kern

 Patti Clark
 Linux System Administrator
 RD Systems Support Oak Ridge National Laboratory


 --
 Want fast and easy access to all the code in your enterprise? Index and
 search up to 200,000 lines of code with a free copy of Black Duck
 Code Sight - the same software that powers the world's largest code
 search on Ohloh, the Black Duck Open Hub! Try it now.
 http://p.sf.net/sfu/bds
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] issue with setuid/gid on restored files

2014-07-23 Thread Kern Sibbald
Different Linux OSes have very different behaviors, which OS are you
running (distribution and version)?

On 07/23/2014 12:10 AM, Stephen Thompson wrote:
 I'm running 7.0.4.



 Here's an example...

 (before backup)
 # ls -ld /bin
 dr-xr-xr-x 2 root root 4096 Jul 22 09:56 /bin
 # ls -l /bin/ping
 -rwsr-xr-x 1 root root 40760 Sep 17  2013 /bin/ping

 (after restore selecting file /bin/ping)
 # ls -ld  /bin
 drwsr-xr-x 2 root root 4096 Jul 22 14:38 bin
 # ls -l /bin/ping
 -rwxr-xr-x 1 root root 40760 Sep 17  2013 ping

 (after restore selecting file /bin/ping and directory /bin)
 # ls -ld  /bin
 dr-xr-xr-x 2 root root 4096 Jul 22 14:38 bin
 # ls -l /bin/ping
 -rwxr-xr-x 1 root root 40760 Sep 17  2013 ping


 In the first restore case, looks like the dir has user-write permissions 
 as well, which isn't right, but perhaps that comes from the umask of the 
 restore since the directory wasn't part of the restore selection. 
 However, the setuid bit certainly wouldn't be coming from the umask. 
 I'm jumping to the conclusion that whatever's doing the setuid bit is 
 messing up and doing it to the parent directory instead of to the file.

 Stephen





 On 7/22/14 2:58 PM, Stephen Thompson wrote:

 Sorry if I have not researched this enough before bringing it to the
 list, but what I'm seeing is very odd.  Someone else must have run into
 this before me.

 If I restore a setuid or setgid file, the file is restored without the
 setuid/setgid bit set.  However, the directory containing the file
 (which did not have it's setuid/setgid bit set during the backup) winds
 up with the setuid/setgid bit being set.

 If I restore both the directory and the file, the directory ends up with
 the proper non-setuid/setgid attributes, but the file once again ends
 up without the setuid/setgid bit set.  I'm assuming the directory has
 the bit set during an interim stage of the restore, but is then properly
 set when it's attributes are set during the restore (which must happen
 after the files that it contains).

 I can't say authoritatively, but I don't believe this is the way bacula
 used to behave for me.  And to say the least, this is far from
 acceptable.  I discovered this during a bare metal restore, and have
 loads of issues from no setuid or setgid bits being set on the restored
 system.

 thanks,
 Stephen


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] issue with setuid/gid on restored files

2014-07-23 Thread Kern Sibbald
On 07/23/2014 04:04 PM, Stephen Thompson wrote:


 Redhat 6.5 x86_64

OK, that is a particularly tricky system as they have added additional
system security which does not permit certain sequences of API calls
even as root which other Linux OSes permit :-(  I.e. we test on the
latest debian/ubuntu and the code works, but not on RHEL 6.x ...

I will look at the code as I may have a patch that will help, but I
don't remember it having to do with the setuid bit.

I recommend that you submit a bug report on this, because if I get
distracted this weekend, I might miss coming back to this problem.  With
a bug report, it remains very visible until it is corrected.

Best regards,
Kern


 On 7/23/14 12:50 AM, Kern Sibbald wrote:
 Different Linux OSes have very different behaviors, which OS are you
 running (distribution and version)?

 On 07/23/2014 12:10 AM, Stephen Thompson wrote:
 I'm running 7.0.4.



 Here's an example...

 (before backup)
 # ls -ld /bin
 dr-xr-xr-x 2 root root 4096 Jul 22 09:56 /bin
 # ls -l /bin/ping
 -rwsr-xr-x 1 root root 40760 Sep 17  2013 /bin/ping

 (after restore selecting file /bin/ping)
 # ls -ld  /bin
 drwsr-xr-x 2 root root 4096 Jul 22 14:38 bin
 # ls -l /bin/ping
 -rwxr-xr-x 1 root root 40760 Sep 17  2013 ping

 (after restore selecting file /bin/ping and directory /bin)
 # ls -ld  /bin
 dr-xr-xr-x 2 root root 4096 Jul 22 14:38 bin
 # ls -l /bin/ping
 -rwxr-xr-x 1 root root 40760 Sep 17  2013 ping


 In the first restore case, looks like the dir has user-write
 permissions
 as well, which isn't right, but perhaps that comes from the umask of
 the
 restore since the directory wasn't part of the restore selection.
 However, the setuid bit certainly wouldn't be coming from the umask.
 I'm jumping to the conclusion that whatever's doing the setuid bit is
 messing up and doing it to the parent directory instead of to the file.

 Stephen





 On 7/22/14 2:58 PM, Stephen Thompson wrote:

 Sorry if I have not researched this enough before bringing it to the
 list, but what I'm seeing is very odd.  Someone else must have run
 into
 this before me.

 If I restore a setuid or setgid file, the file is restored without the
 setuid/setgid bit set.  However, the directory containing the file
 (which did not have it's setuid/setgid bit set during the backup)
 winds
 up with the setuid/setgid bit being set.

 If I restore both the directory and the file, the directory ends up
 with
 the proper non-setuid/setgid attributes, but the file once again
 ends
 up without the setuid/setgid bit set.  I'm assuming the directory has
 the bit set during an interim stage of the restore, but is then
 properly
 set when it's attributes are set during the restore (which must happen
 after the files that it contains).

 I can't say authoritatively, but I don't believe this is the way
 bacula
 used to behave for me.  And to say the least, this is far from
 acceptable.  I discovered this during a bare metal restore, and have
 loads of issues from no setuid or setgid bits being set on the
 restored
 system.

 thanks,
 Stephen



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] v7.0.4 migrate: StartTime older than SchedTime

2014-07-23 Thread Kern Sibbald
Hello Tom,

If I remember right, I am waiting for an FLA to be able to integrate
your patches.  Any status on that?

Best regards,
Kern

On 07/23/2014 04:30 PM, Thomas Lohman wrote:
 StartTime does not get updated when migrating a job. Is this a bug or
 is it the way it is supposed to be?

 I believe that this is the way it is supposed to work.  When 
 copying/migrating a job or when creating a virtual Full job from 
 previous jobs, the start time of the new job gets set to the start time 
 of the copied/migrated job or in the case of a Virtual Full to the start 
 time of the last backup used to create the Virtual Full.  This, I 
 believe, is because that start time is used when looking to see what 
 needs to be backed up if you're doing another backup that will be based 
 off of that job.  This can cause issues if you're assuming start time is 
 the real start time of a job as you've discovered.  I went ahead and 
 added a realstarttime attribute to a job as part of some of my 
 patches/extensions but those were for 5.2.13 and not the latest release 
 7.0.x.


 --tom


 --
 Want fast and easy access to all the code in your enterprise? Index and
 search up to 200,000 lines of code with a free copy of Black Duck
 Code Sight - the same software that powers the world's largest code
 search on Ohloh, the Black Duck Open Hub! Try it now.
 http://p.sf.net/sfu/bds
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Corrupted filesystem using iSCSI

2014-07-22 Thread Kern Sibbald
Hello,

In my opinion, using network mounted disks for backup is a risky
business.  Bacula is designed to work with direct attached disks and
tapes, so when you connect them instead by a network, you introduce more
errors (networks have more faults than direct attached devices), delays
(latency), and buffering problems.  Latency problems are particularly
bad for a SCSI device because it is a very chatty protocol.

Bottom line: a lot of people use NFS/CIFS or iSCSI, but I wouldn't bet
my data on them.

NFS tends to be very unfriendly with Bacula for two reasons:

1. If the NFS connection drops, Bacula can wait forever (something dumb
in the implementation) hanging on a system call.

2. If the NFS partition fills, you may not know about it until the
device is closed (end of Job) and then it is too late to do much of
anything.

Best regards,
Kern

Best regards,
Kern

On 07/21/2014 07:20 PM, Fábio R. Medeiros wrote:
 Hello folks!

 I've running Bacula 5.2 in a FreeBSD box. We use an iSCSI NAS as the 
 storage device...

 Today I tried to make a restore test and FreeBSD says me that the iSCSI 
 target's filesystem (UFS2+j) was corrupted and needed to be repaired. I 
 ran fsck and all gets fine. Is this normal? If so, are there any 
 workarounds (i.e. spool or run before/after job directives) in order 
 to minimize the need of these checks?

 Does anyone have experience with Bacula and iSCSI devices?

 Here is my Device resource config on bacula-sd.conf:

 Device {
Name = STORAGE
Media Type = File
Archive Device = /mnt/bkp
LabelMedia = Yes
Random Access = Yes
AutomaticMount = Yes
RemovableMedia = No
AlwaysOpen = Yes
Minimum Block Size = 32768
Maximum Block Size = 32768
Block Checksum = Yes
 }

 Regards!!

 Fábio

 --
 Want fast and easy access to all the code in your enterprise? Index and
 search up to 200,000 lines of code with a free copy of Black Duck
 Code Sight - the same software that powers the world's largest code
 search on Ohloh, the Black Duck Open Hub! Try it now.
 http://p.sf.net/sfu/bds
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users

a

--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] automatic volume counter

2014-07-19 Thread Kern Sibbald

  
  
On 07/18/2014 11:35 AM, andreas graeper
  wrote:


  

  

  

  

  
hi, 

1) 
  the keys in config file 

DB Pass

DBpass

dbpass

are the whitespaces removed and the keys
  converted to lower/upper case internally ? i
  found differences in documentation. 

  

  

  

  

  


Please read the manual. This is clearly explained and is a
fundamental part of Bacula conf files.

I leave the rest of the questions to the list ...

Kern


  

  

  

  

  




2) after testing i want to cleanup the
  storage and have two Pools with FormatLabel
  "client1-" and "client2-" i.e. 

the prefixes are used, but both use the
  same counter and it does not start from zero
  again. i found mysql.bacula.Pools.NumVols and
  set it manually back to 0 but no success. the
  next volumn got an high index and the entry
  NumVols got the inkremented previous value
  again. what is to do ?

different automatic counter for different
  pools ? 


  3)
  i want to backup different things from a
  client by two directors (dont know wether this
  makes sense. maybe a local one and a remote
  one) and i would like to send message to the 
  Message { Name=m1; Director=d1=all; append =
  /var/log/bacula/x1.log; }

Message { Name=m2; Director=d2=all; append =
/var/log/bacula/x2.log; }
  
  now i would like to know, how can i connect the
  director with the correct message resource ?

till now i had to use Message.Name=Standard to get
it work. 
  
  i could not find infos. 



4) most important question: 
  
  when using -d100 in service-scripts the output is on
  stdout / stderr 

but would be great if it was written to /var/log/.. 
  
  i would like to see on client what jobs was requested and i
  would like to see if it succeeded, too. how can i achieve it ?
  
  

thanks in advance 
  andreas

  
  
  
  
  --
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] automatic volume counter

2014-07-19 Thread Kern Sibbald

  
  
On 07/19/2014 10:35 AM, Kern Sibbald
  wrote:


  
  On 07/18/2014 11:35 AM, andreas
graeper wrote:
  
  

  

  

  

  

  hi, 
  
  1) 
the keys in config file 
  
  DB Pass
  
  DBpass
  
  dbpass
  
  are the whitespaces removed and the keys
converted to lower/upper case internally ? i
found differences in documentation. 
  

  

  

  

  

  
  
  Please read the manual. This is clearly explained and is a
  fundamental part of Bacula conf files.


Sorry, I forgot to add the key point: all the above variations of
dbpass are identical to Bacula.

 
  I leave the rest of the questions to the list ...
  
  Kern
  
  

  

  

  

  

   
  
  
  2) after testing i want to cleanup the
storage and have two Pools with FormatLabel
"client1-" and "client2-" i.e. 
  
  the prefixes are used, but both use the
same counter and it does not start from zero
again. i found mysql.bacula.Pools.NumVols
and set it manually back to 0 but no
success. the next volumn got an high index
and the entry NumVols got the inkremented
previous value again. what is to do ?
  
  different automatic counter for different
pools ? 
  
  
3)
i want to backup different things from a
client by two directors (dont know wether
this makes sense. maybe a local one and a
remote one) and i would like to send message
to the 
Message { Name=m1; Director=d1=all; append =
/var/log/bacula/x1.log; }
  
  Message { Name=m2; Director=d2=all; append =
  /var/log/bacula/x2.log; }

now i would like to know, how can i connect the
director with the correct message resource ?
  
  till now i had to use Message.Name=Standard to get
  it work. 

i could not find infos. 
  
  
  
  4) most important question: 

when using -d100 in service-scripts the output is on
stdout / stderr 
  
  but would be great if it was written to /var/log/.. 

i would like to see on client what jobs was requested and i
would like to see if it succeeded, too. how can i achieve it
? 

  
  thanks in advance 
andreas
  




--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

  
  
  
  
  
  --
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's

Re: [Bacula-users] Problem accessing MySQL database: no tables ?

2014-07-19 Thread Kern Sibbald

  
  
Hello,
  
  Despite you not finding anything in the manual, there *is* a whole
  chapter entitled "Installing Bacula" that specifically talks about
  the subject as well as specific chapters on MySQL and PostgreSQL.
  
  Given your insistence on getting an answer on the weekend, I
  suggest investing in a Gold support contract (just kidding, of
  course) :-)
  
      
  Kern
  
  On 07/19/2014 12:43 PM, Huub Van Niekerk wrote:


  
Hi,


After
  installing Bacula 5 from source with MySQL already running, I
  can't start Bacula but get the message it can't access the
  database. I've tried to find out how to create which tables,
  but so far I can't find any info about it in the manual.
  Suggestions are welcome...


Thanks
  
  
  
  
  --
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Problem accessing MySQL database: no tables ?

2014-07-19 Thread Kern Sibbald

  
  
Hello,
  
  If the files are not there, then you probably installed binaries
  from some distribution (e.g. Ubuntu, Debian, ...), which you did
  not mention. If that is the case, you should ask the author of
  the packages. If it was a .deb package system, they generally
  take a lot of care to make sure that everything is installed
  correctly :-), if it was an rpm package system, sometimes the
  don't do all the hard work and silently put the needed files
  somewhere on your system forcing you to find them and install them
  manually :-(,
  
  If you built and installed from the Bacula source files, then
  those files you mention are definitely somewhere, and you should
  re-ask the list specifying this new information stating what you
  actually did to install Bacula.
  
  Best regards,
  Kern
  
  On 07/19/2014 03:51 PM, Huub Van Niekerk wrote:


  On Saturday, July 19, 2014 2:42
  PM, Kern Sibbald k...@sibbald.com wrote:


  


  
 
  
  

  
Hello,
  
  Despite you not finding anything in the
  manual, there *is* a whole chapter entitled
  "Installing Bacula" that specifically talks
  about the subject as well as specific chapters on
  MySQL and PostgreSQL.
  
  Given your insistence on getting an answer on
  the weekend, I suggest investing in a Gold support
  contract (just kidding, of course) :-)
  
  Hi,
  
  Thank you for taking the time to answer me, even
  in the weekend :)
  
  Let me rephrase: yes, I indeed found information
  about installation and database in the manual.
  However, in the manual is stated that after
  installation several executables should be there,
  such as make_bacula_tables. This, and the other
  database related commands, are missing and as far
  as I can find there is no information about this
  situation. So should I conclude then I did
  something wrong with respect to the database
  during installation? Or is something else wrong ?


  

  

  

  


  


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory

2014-07-18 Thread Kern Sibbald

  
  
On 07/17/2014 08:41 PM, Stefan Lamby
  wrote:


  
   Got the point. 
I'll think about buying 2 more SATA HDs using software raid to
store the precious Volumes on those. 
  

That should work well.

  Btw., using md, is there something wrong with using it in
partnership with bacula? 
  

What is md?

Kern

   
Cheers, 
Stefan 

  
  
Kern Sibbald k...@sibbald.com hat am 17. Juli 2014 um
19:38 geschrieben: 

 On 07/17/2014 10:38 AM, Stefan
  Lamby wrote: 

   You wrote writing Volumes directly to a CIFS mount is
not really a good idea for a number of reasons. 
   What do you recommend as best practice instead? 


Write your Volumes to a natively mounted (not network mount)
Linux filesystem. 
   

Best regards, 
Kern 

  
 Best regards, 
 Stefan 
  
Kern Sibbald k...@sibbald.com
hat am 10. Juli 2014 um 17:36 geschrieben: 

 Unfortunately, neither CIFS nor
  NFS include a truncate() function, and this problem was not
  noticed because not many people write Volumes directly to a
  CIFS/NFS mount. Doing so is not really a good idea for a
  number of reasons reasons. 
  
  Any way, once it was discovered (quite a long time ago), I
  fixed it by "emulating" a truncate. Consequently, I suspect
  that if you upgrade to a more recent version of Bacula, it
  will probably work. 
  
  Best regards, 
  Kern 
  
  On 07/10/2014 01:22 PM, Stefan Lamby wrote: 
 Hello List. 
  
 Once a week I got this error, when performing a backup. 
 19 out of 20 backup jobs work well, one fails. 
 The nas_01 device is a small 1 TB NAS, mounted via fstab:

 //192.168.1.9/Volume_1 /nas01_backup cifs
  soft,username=**,password=**,uid=107,gid=107 0 0 
  
 The /nas01_backup/backup/ directory exists on the device
  and other jobs are using it successfully. 
  
 Here is the output of the status mail: 
  
 13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId
  11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 
  13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01"
  
  13-Jun 23:39 backnix05-sd JobId 11348: Fatal error:
  label.c:464 Truncate error on device "nas_01"
  (/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate
  device "nas_01" (/nas01_backup/backup). ERR=No such file or
  directory 
  
  13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume
  "bkp-nas-0265" in Error in Catalog. 
  13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348
  canceled. 
  13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390
  Bad response to Append Data command. Wanted 3000 OK data 
  , got 3903 Error append data 
  
 Do you have any advice/idea? 
  
 Thank you very much. 
 Stefan 


--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

 
   


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

  
   
 


  


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Bl

Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory

2014-07-17 Thread Kern Sibbald

  
  
On 07/17/2014 10:38 AM, Stefan Lamby
  wrote:


  
   You wrote writing Volumes directly to a CIFS mount is not
really a good idea for a number of reasons. 
   What do you recommend as best practice instead? 


Write your Volumes to a natively mounted (not network mount) Linux
filesystem.

Best regards,
Kern



   Best regards, 
   Stefan 

  
Kern Sibbald k...@sibbald.com hat am 10. Juli 2014 um
17:36 geschrieben: 

 Unfortunately, neither CIFS nor
  NFS include a truncate() function, and this problem was not
  noticed because not many people write Volumes directly to a
  CIFS/NFS mount. Doing so is not really a good idea for a
  number of reasons reasons. 
  
  Any way, once it was discovered (quite a long time ago), I
  fixed it by "emulating" a truncate. Consequently, I suspect
  that if you upgrade to a more recent version of Bacula, it
  will probably work. 
  
  Best regards, 
  Kern 
  
  On 07/10/2014 01:22 PM, Stefan Lamby wrote: 

   Hello List. 

   Once a week I got this error, when performing a backup.
  
   19 out of 20 backup jobs work well, one fails. 
   The nas_01 device is a small 1 TB NAS, mounted via
fstab: 
   //192.168.1.9/Volume_1 /nas01_backup cifs
soft,username=**,password=**,uid=107,gid=107 0 0 

   The /nas01_backup/backup/ directory exists on the device
and other jobs are using it successfully. 

   Here is the output of the status mail: 

   13-Jun 23:39 backnix05-dir JobId 11348: Start Backup
JobId 11348,
Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 
13-Jun 23:39 backnix05-dir JobId 11348: Using Device
"nas_01" 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error:
label.c:464 Truncate error on device "nas_01"
(/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate
device "nas_01" (/nas01_backup/backup). ERR=No such file or
directory 

13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume
"bkp-nas-0265" in Error in Catalog. 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job
11348 canceled. 
13-Jun 22:40 extranix-fd JobId 11348: Fatal error:
job.c:2390 Bad response to Append Data command. Wanted 3000
OK data 
, got 3903 Error append data 

   Do you have any advice/idea? 

   Thank you very much. 
   Stefan 
  
  
  --
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


  
   
 
  
  
  
  --
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula 7 will only see the first storage resource in bacula-dir.conf

2014-07-16 Thread Kern Sibbald

  
  
Hello,
  
  I suggest you read the new features for 7.0 in the manual. The
  fourth item talks specifically about the status sd command. I see
  absolutely nothing wrong with your config file or with what Bacula
  is doing. As the manual says, if you enter:
  
  status select storage
  
  you will probably get what you expected, but you will also get
  "duplicate" entries listed.
  
  Best regards,
  Kern
  
  On 07/16/2014 05:01 AM, Joe Rhodes wrote:

Hey everyone!
  
  
  Im running Bacula 7.0.4 on Ubuntu 14.04. Im backing up to
two different devices. One is a hot-swap hard drive bay which
Im treating as a changer using the vchanger program.  These
drives get changed out and rotated off site.  The other is a
fixed drive. The two devices will use two distinct pools.
  
  
  The issue Im having is that no matter what I do, Bacula
seems to see the FIRST storage resource only. This ultimately
causes problems because bacula will look to the wrong device for
volumes associated with the pool the job calls for.
  
  
  I have a similar setup on a Bacula 5.2 setup that is working
great. So Im not sure what Im doing wrong. Config files look
the same between the two.  If anyone has some suggestions, Id
be eternally grateful.
  
  
  The stanzas from bacula-dir.com:
  
  
  
#
#
# Storage
#
#


# Definition of file Virtual
  Autochanger device
Storage
  {

  Name = removeable-drives

Address = 10.11.1.2   # N.B. Use a fully
  qualified name here

  SDPort = 9103

Password = "RoundHouseBackup"

  Device = ExternalDrives

  Media Type = File

  Maximum Concurrent Jobs = 1# run up to 10 jobs a the same time
}


Storage
  {

  Name = LocalStorage

Address = 10.11.1.2   # N.B. Use a fully
  qualified name here

  SDPort = 9103

Password = "RoundHouseBackup"

  Device = LocalStorage

  Media Type = File1

  Maximum Concurrent Jobs = 1# run up to 10 jobs a the same time
}
  
  
  
  
  
  And the stanzas from my bacula-sd.conf:
  
  
  
  
  
# Define a Virtual autochanger
#
Autochanger
  {

  Name = ExternalDrives

  Device = ExternalDrives-Drive1

Changer Command = "/usr/local/bin/vchanger -u root
  %c %o %S %a %d"

Changer Device = "/etc/bacula/vchanger1.conf"
}


Device
  {

  Name = ExternalDrives-Drive1

  DriveIndex = 0

  Autochanger = yes

  DeviceType = File

  Media Type = File

  Archive Device = /var/lib/bacula/removeable-drives/0/drive0
 #LabelMedia
  = yes;  # lets Bacula label unlabeled media

  Random Access = Yes;

  AutomaticMount = yes;# when device opened, read it

  RemovableMedia = no;

  AlwaysOpen = no;

  Maximum Concurrent Jobs = 5;

Maximum Volume Size = 476250 MB; # with 8 volumes
  per drive, this should leave about
   
# 4,800 MB free for other
  things, or about 0.125%
}


Device
  {

  Name = LocalStorage

  Device Type = File

  Media Type = File1

  Archive Device = /mnt/localstorage/

  LabelMedia = yes;  # lets Bacula label unlabeled media

  Random Access = Yes;

  AutomaticMount = yes;# when device opened, read it

  RemovableMedia = no;

  AlwaysOpen = no;

  Maximum Volume Size = 237500 MB
}
  
  
  
  
  
  When I execute status sd in bconsole, I get this:
  
  
  
  
  

  *status sd
  Automatically selected Storage:
removeable-drives
  Connecting to Storage daemon
removeable-drives at 10.11.1.2:9103
  
  
  mail.roundhouse.local-sd Version:
7.0.4 (04 June 2014) x86_

Re: [Bacula-users] Monthly backup on 1st day except on saturdays

2014-07-12 Thread Kern Sibbald

  
  
Hello Ana,
  
  Interesting problem. Please see below ...
  
  On 07/12/2014 04:00 PM, Ana Emlia M. Arruda wrote:


  
Hi
  Fabio,



  I'm quite sure about a Kern's post here where he said that
  there is a "not" keyword for schedules. Have you tried
  something like the bellow?
  


I think I was referring to a not operator such as ! However, I must
have been confused with the ! in the Messages destination list.
Bottom line: I don't think there is a not operator, and the "not" in
your schedule below isn't likely to work. However, in including
only the days/dates you want, you can effectively exclude certain
combinations.

The following should accomplish what you want:

Schedule {
 ...
 Run = level=Full sun-fri on 1 at 2:30
 ...
}

Although I cannot guarantee it, this schedule should run jobs only
on Sunday through Friday (i.e. not Saturday) and on the first day of
the month.

Try the command:

status schedule days=500

I get:

*status schedule days=500

Scheduled Jobs:
Level Type Pri Scheduled Job Name
Schedule
=
Full Backup 10 Sun 03-Aug 02:30 NightlySave
TestSched
Full Backup 10 Tue 05-Aug 02:30 NightlySave
TestSched
Full Backup 10 Wed 03-Sep 02:30 NightlySave
TestSched
Full Backup 10 Fri 05-Sep 02:30 NightlySave
TestSched
Full Backup 10 Fri 03-Oct 02:30 NightlySave
TestSched
Full Backup 10 Sun 05-Oct 02:30 NightlySave
TestSched
Full Backup 10 Mon 03-Nov 02:30 NightlySave
TestSched
Full Backup 10 Wed 05-Nov 02:30 NightlySave
TestSched
Full Backup 10 Wed 03-Dec 02:30 NightlySave
TestSched
Full Backup 10 Fri 05-Dec 02:30 NightlySave
TestSched
Full Backup 10 Mon 05-Jan 02:30 NightlySave
TestSched
Full Backup 10 Tue 03-Feb 02:30 NightlySave
TestSched
Full Backup 10 Thu 05-Feb 02:30 NightlySave
TestSched
Full Backup 10 Tue 03-Mar 02:30 NightlySave
TestSched
Full Backup 10 Thu 05-Mar 02:30 NightlySave
TestSched
Full Backup 10 Fri 03-Apr 02:30 NightlySave
TestSched
Full Backup 10 Sun 05-Apr 02:30 NightlySave
TestSched
Full Backup 10 Sun 03-May 02:30 NightlySave
TestSched
Full Backup 10 Tue 05-May 02:30 NightlySave
TestSched
Full Backup 10 Wed 03-Jun 02:30 NightlySave
TestSched
Full Backup 10 Fri 05-Jun 02:30 NightlySave
TestSched
Full Backup 10 Fri 03-Jul 02:30 NightlySave
TestSched
Full Backup 10 Sun 05-Jul 02:30 NightlySave
TestSched
Full Backup 10 Mon 03-Aug 02:30 NightlySave
TestSched
Full Backup 10 Wed 05-Aug 02:30 NightlySave
TestSched
Full Backup 10 Thu 03-Sep 02:30 NightlySave
TestSched
Full Backup 10 Mon 05-Oct 02:30 NightlySave
TestSched
Full Backup 10 Tue 03-Nov 02:30 NightlySave
TestSched
Full Backup 10 Thu 05-Nov 02:30 NightlySave
TestSched


    Best regards,
Kern



  

  

Schedule
  {

  Name = ...

   Run = Level=Full sat at xx:xx not on 1 at xx:xx
}



  Regards,
Ana



  On Fri, Jul 11, 2014 at 10:17 AM,
"Fbio R. Medeiros" fab...@unicamp.br wrote:
Hi
  guys,
  
  I've defined the schedule with a weekly and monthly cycle.
  The weekly
  cycle runs a Full backup on saturdays and the monthly
  cycle run a full
  backup every 1st day of month.
  
  Are there any way to tells Bacula to do NOT run the full
  backup of
  monthly cycle if the 1st day of the month is a saturday.
  If so, it would
  run the monthly full backup on sunday, the 2nd day of the
  month...
  
  Fabio
  
--
  Open source business process management suite built on
  Java and Eclipse
  Turn processes into business applications with Bonita BPM
  Community Edition
  Quickly connect people, data, and systems into organized
  workflows
  Winner of BOSSIE, CODIE, OW2 and Gartner awards
  http://p.sf.net/sfu/Bonitasoft
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.n

Re: [Bacula-users] Monthly backup on 1st day except on saturdays

2014-07-12 Thread Kern Sibbald

  
  
Hello,
  
  Oops ...
  
  When I look at the schedule that was produced, it does not
  correspond to what I wanted to show. The status schedule was
  actually made with:
  
   Run = level=Full sun-fri on 3,5 at 2:30
  
  which made reading the output of "show schedule" easier to read.
  The real "status schedule" that I should have attached for the
  following statement:
  
   Run = level=Full sun-fri on 1 at 2:30
  
  is:
  
  *status schedule days=500
  
  Scheduled Jobs:
  Level Type Pri Scheduled Job Name
  Schedule
=
  Full Backup 10 Fri 01-Aug 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 01-Sep 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 01-Oct 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 01-Dec 02:30 NightlySave
  TestSched
  Full Backup 10 Thu 01-Jan 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 01-Feb 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 01-Mar 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 01-Apr 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 01-May 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 01-Jun 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 01-Jul 02:30 NightlySave
  TestSched
  Full Backup 10 Tue 01-Sep 02:30 NightlySave
  TestSched
  Full Backup 10 Thu 01-Oct 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 01-Nov 02:30 NightlySave
  TestSched
  
  
  which looks a lot more like what Fbio wanted.
  
  Best regards,
  Kern
  
  
  On 07/12/2014 06:03 PM, Kern Sibbald wrote:


  
  Hello Ana,

Interesting problem. Please see below ...

On 07/12/2014 04:00 PM, Ana Emlia M. Arruda wrote:
  
  

  Hi Fabio,
  
  
   I'm quite sure about
a Kern's post here where he said that there is a "not"
keyword for schedules. Have you tried something like the
bellow?

  
  
  I think I was referring to a not operator such as ! However, I
  must have been confused with the ! in the Messages destination
  list. Bottom line: I don't think there is a not operator, and the
  "not" in your schedule below isn't likely to work. However, in
  including only the days/dates you want, you can effectively
  exclude certain combinations.
  
  The following should accomplish what you want:
  
  Schedule {
   ...
   Run = level=Full sun-fri on 1 at 2:30
   ...
  }
  
  Although I cannot guarantee it, this schedule should run jobs only
  on Sunday through Friday (i.e. not Saturday) and on the first day
  of the month.
  
  Try the command:
  
  status schedule days=500
  
  I get:
  
  *status schedule days=500
  
  Scheduled Jobs:
  Level Type Pri Scheduled Job Name
  Schedule
=
  Full Backup 10 Sun 03-Aug 02:30 NightlySave
  TestSched
  Full Backup 10 Tue 05-Aug 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 03-Sep 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 05-Sep 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 03-Oct 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 05-Oct 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 03-Nov 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 05-Nov 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 03-Dec 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 05-Dec 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 05-Jan 02:30 NightlySave
  TestSched
  Full Backup 10 Tue 03-Feb 02:30 NightlySave
  TestSched
  Full Backup 10 Thu 05-Feb 02:30 NightlySave
  TestSched
  Full Backup 10 Tue 03-Mar 02:30 NightlySave
  TestSched
  Full Backup 10 Thu 05-Mar 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 03-Apr 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 05-Apr 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 03-May 02:30 NightlySave
  TestSched
  Full Backup 10 Tue 05-May 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 03-Jun 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 05-Jun 02:30 NightlySave
  TestSched
  Full Backup 10 Fri 03-Jul 02:30 NightlySave
  TestSched
  Full Backup 10 Sun 05-Jul 02:30 NightlySave
  TestSched
  Full Backup 10 Mon 03-Aug 02:30 NightlySave
  TestSched
  Full Backup 10 Wed 05-Aug 02:30 NightlySave
  TestSched
  Full Backup 10 Thu 03-Sep 02:30 NightlySave
   

[Bacula-users] Windows binaries

2014-07-12 Thread Kern Sibbald
Hello,

I have been working on the next version of the Windows binaries, and I
would like two people to help me testing it.  One person running 5.2.x
and one person running 7.0.x.  These are the Bacula Enterprise Windows
binaries (the *very* latest source code) that I have (I hope) tweaked to
be compatible with the community DIR and SD.  These binaries are not yet
heavily tested so need to be used in production with caution.

If you help me testing them, you will have the right to the final
version that will be released (of course at no charge).  You must be the
first to apply and you will have to have the time to do some real
testing on several different versions until it is finally released.  If
you don't have enough time, please do not apply.

By the way, in discussing the Windows binaries with Bacula Systems, they
have given me permission to give them away to my friends.  First, I
considered that fantastic, then I had a problem deciding who my friends
are -- there are many, many friends out there.  Some vocal, others just
there happily (I hope) using Bacula.  In the light of the Bareos affair,
I will a longer blog about the quality of being a friend and how
important it is.  But in the short run, I really have a problem
discerning who should be classified as a friend, because my own
inclination would be to make a very broad definition -- perhaps too
broad for Bacula Systems.

In the end, I decided that I will apply the Bacula Systems offer by for
the purpose of giving away the Enterprise Windows binaries to all those
people who have contributed to the Bacula project as that is something
that I can more easily (but not without a bit of subjectivity) define.

This means that everyone who has contributed to the Bacula project (I
will define that a bit later) at some point in the near future will be
able to download the next version of the Enterprise Windows binaries,
which I am working on now.  Furthermore, if you are not a contributor
and you have previously purchased a Windows binary, the upgrade to the
new version will be at half price.

Best regards,
Kern



--
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory

2014-07-10 Thread Kern Sibbald

  
  
Unfortunately, neither CIFS nor NFS
  include a truncate() function, and this problem was not noticed
  because not many people write Volumes directly to a CIFS/NFS
  mount. Doing so is not really a good idea for a number of reasons
  reasons. 
  
  Any way, once it was discovered (quite a long time ago), I fixed
  it by "emulating" a truncate. Consequently, I suspect that if you
  upgrade to a more recent version of Bacula, it will probably work.
  
  Best regards,
  Kern
  
  On 07/10/2014 01:22 PM, Stefan Lamby wrote:


  
   Hello List. 

   Once a week I got this error, when performing a backup. 
   19 out of 20 backup jobs work well, one fails. 
   The nas_01 device is a small 1 TB NAS, mounted via fstab: 
   //192.168.1.9/Volume_1 /nas01_backup cifs
soft,username=**,password=**,uid=107,gid=107 0 0 

   The /nas01_backup/backup/ directory exists on the device and
other jobs are using it successfully. 

   Here is the output of the status mail: 

   13-Jun 23:39 backnix05-dir JobId 11348: Start Backup JobId
11348, Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 
13-Jun 23:39 backnix05-dir JobId 11348: Using Device "nas_01" 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: label.c:464
Truncate error on device "nas_01" (/nas01_backup/backup):
ERR=dev.c:2023 Unable to truncate device "nas_01"
(/nas01_backup/backup). ERR=No such file or directory 

13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume
"bkp-nas-0265" in Error in Catalog. 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job 11348
canceled. 
13-Jun 22:40 extranix-fd JobId 11348: Fatal error: job.c:2390
Bad response to Append Data command. Wanted 3000 OK data 
, got 3903 Error append data 

   Do you have any advice/idea? 

   Thank you very much. 
   Stefan 
  
  
  
  --
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Fatal error: label.c:464 Truncate error on device - ERR=No such file or directory

2014-07-10 Thread Kern Sibbald

  
  
Version 5.0.3 is quite old.
  
  You must upgrade the Director and all the SDs at the same time to
  the same version, as well as any FD on either the Dir or SD
  machine. Other FDs do not need to be updated.
  
  Best regards,
  Kern
  
  On 07/10/2014 06:32 PM, Stefan Lamby wrote:


  
   Thank you very much for pointing this out. 

   My Version is 5.0.3 and it is running at an opensuse 11.4
version. 
   Could it work if I just compile a new sd executable and put
the new one with depending libraries to that machine? 
   Or to be more spefic: will director 5.0.3 and the other
(old) components work together with a current sd or do I have to
renew everything? 

   Thanks, 
   Stefan 

  
Kern Sibbald k...@sibbald.com hat am 10. Juli 2014 um
17:36 geschrieben: 

 Unfortunately, neither CIFS nor
  NFS include a truncate() function, and this problem was not
  noticed because not many people write Volumes directly to a
  CIFS/NFS mount. Doing so is not really a good idea for a
  number of reasons reasons. 
  
  Any way, once it was discovered (quite a long time ago), I
  fixed it by "emulating" a truncate. Consequently, I suspect
  that if you upgrade to a more recent version of Bacula, it
  will probably work. 
  
  Best regards, 
  Kern 
  
  On 07/10/2014 01:22 PM, Stefan Lamby wrote: 

   Hello List. 

   Once a week I got this error, when performing a backup.
  
   19 out of 20 backup jobs work well, one fails. 
   The nas_01 device is a small 1 TB NAS, mounted via
fstab: 
   //192.168.1.9/Volume_1 /nas01_backup cifs
soft,username=**,password=**,uid=107,gid=107 0 0 

   The /nas01_backup/backup/ directory exists on the device
and other jobs are using it successfully. 

   Here is the output of the status mail: 

   13-Jun 23:39 backnix05-dir JobId 11348: Start Backup
JobId 11348,
Job=extranix-bkpdir-full-nas.2014-06-13_23.30.00_57 
13-Jun 23:39 backnix05-dir JobId 11348: Using Device
"nas_01" 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error:
label.c:464 Truncate error on device "nas_01"
(/nas01_backup/backup): ERR=dev.c:2023 Unable to truncate
device "nas_01" (/nas01_backup/backup). ERR=No such file or
directory 

13-Jun 23:39 backnix05-sd JobId 11348: Marking Volume
"bkp-nas-0265" in Error in Catalog. 
13-Jun 23:39 backnix05-sd JobId 11348: Fatal error: Job
11348 canceled. 
13-Jun 22:40 extranix-fd JobId 11348: Fatal error:
job.c:2390 Bad response to Append Data command. Wanted 3000
OK data 
, got 3903 Error append data 

   Do you have any advice/idea? 

   Thank you very much. 
   Stefan 
  
  
  --
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


  
   
 
  
  
  
  --
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft___
Bacula-use

Re: [Bacula-users] Bacula 7.0.4 + bacula-fd 6.0.6 still produce failed verify jobs on windows

2014-07-10 Thread Kern Sibbald
The next version of the Windows FD will have that problem fixed.  It is
something that I will work on in the next few weeks.

Best regards,
Kern

On 07/10/2014 07:43 PM, J. Echter wrote:
 Hi,

 i upgraded to bacula 7.x and bought the bacula 6.x enterprise binarys
 for my windows boxes, hoping the verify error will go away.

 Sadly, it didn't...

 Here' the log from the backup:

 08-Jul 20:00 bacula-dir JobId 3271: No prior Full backup Job record found.
 08-Jul 20:00 bacula-dir JobId 3271: No prior or suitable Full backup found in 
 catalog. Doing FULL backup.
 09-Jul 00:32 bacula-dir JobId 3271: shell command: run BeforeJob 
 /etc/bacula/holiday.sh
 09-Jul 00:32 bacula-dir JobId 3271: BeforeJob: Date is not a known vacation 
 day.
 09-Jul 00:32 bacula-dir JobId 3271: Start Backup JobId 3271, 
 Job=Datev.2014-07-08_20.00.01_37
 09-Jul 00:32 bacula-dir JobId 3271: Using Device File to write.
 09-Jul 00:32 datev-fd JobId 3271: Generate VSS snapshots. Driver=Win64 VSS, 
 Drive(s)=C
 09-Jul 00:34 bacula-sd JobId 3271: End of medium on Volume file-0074 
 Bytes=1,073,719,618 Blocks=16,651 at 09-Jul-2014 00:34.
 09-Jul 00:34 bacula-dir JobId 3271: There are no more Jobs associated with 
 Volume file-0075. Marking it purged.
 09-Jul 00:34 bacula-dir JobId 3271: All records pruned from Volume 
 file-0075; marking it Purged
 09-Jul 00:34 bacula-dir JobId 3271: Recycled volume file-0075
 09-Jul 00:34 bacula-sd JobId 3271: Recycled volume file-0075 on file device 
 File (/BACKUP/archivefiles), all previous data lost.
 09-Jul 00:34 bacula-sd JobId 3271: New volume file-0075 mounted on device 
 File (/BACKUP/archivefiles) at 09-Jul-2014 00:34.
 09-Jul 00:40 bacula-sd JobId 3271: End of medium on Volume file-0075 
 Bytes=1,073,737,773 Blocks=16,644 at 09-Jul-2014 00:40.
 09-Jul 00:40 bacula-dir JobId 3271: There are no more Jobs associated with 
 Volume file-0076. Marking it purged.
 09-Jul 00:40 bacula-dir JobId 3271: All records pruned from Volume 
 file-0076; marking it Purged
 09-Jul 00:40 bacula-dir JobId 3271: Recycled volume file-0076
 09-Jul 00:40 bacula-sd JobId 3271: Recycled volume file-0076 on file device 
 File (/BACKUP/archivefiles), all previous data lost.
 09-Jul 00:40 bacula-sd JobId 3271: New volume file-0076 mounted on device 
 File (/BACKUP/archivefiles) at 09-Jul-2014 00:40.
 09-Jul 00:46 bacula-sd JobId 3271: End of medium on Volume file-0076 
 Bytes=1,073,737,794 Blocks=16,644 at 09-Jul-2014 00:46.
 09-Jul 00:46 bacula-dir JobId 3271: There are no more Jobs associated with 
 Volume file-0077. Marking it purged.
 09-Jul 00:46 bacula-dir JobId 3271: All records pruned from Volume 
 file-0077; marking it Purged
 09-Jul 00:46 bacula-dir JobId 3271: Recycled volume file-0077
 09-Jul 00:46 bacula-sd JobId 3271: Recycled volume file-0077 on file device 
 File (/BACKUP/archivefiles), all previous data lost.
 09-Jul 00:46 bacula-sd JobId 3271: New volume file-0077 mounted on device 
 File (/BACKUP/archivefiles) at 09-Jul-2014 00:46.
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Task 
 Scheduler Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): VSS Metadata 
 Store Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Performance 
 Counters Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): System 
 Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): ASR Writer, 
 State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): MSSearch 
 Service Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): COM+ REGDB 
 Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): 
 SqlServerWriter, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Shadow Copy 
 Optimization Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): Registry 
 Writer, State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): WMI Writer, 
 State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: VSS Writer (BackupComplete): BITS Writer, 
 State: 0x1 (VSS_WS_STABLE)
 09-Jul 00:50 datev-fd JobId 3271: shell command: run ClientAfterJob 
 c:/netstart.bat
 09-Jul 00:50 bacula-sd JobId 3271: Elapsed time=00:17:30, Transfer rate=2.640 
 M Bytes/second
 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: 
 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: C:\Windows\system32net 
 start MSSQL$DATEV_DBEngine 
 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: SQL Server (DATEV_DBENGINE) 
 wird gestartet..
 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: SQL Server (DATEV_DBENGINE) 
 wurde erfolgreich gestartet.
 09-Jul 00:50 datev-fd JobId 3271: ClientAfterJob: 
 09-Jul 00:50 bacula-dir JobId 3271: Bacula bacula-dir

Re: [Bacula-users] Why do Concurrend Jobs on same Client wait for another?

2014-07-02 Thread Kern Sibbald

  
  
Hello,
  
  If the client is a Windows machine as shown below, and you have
  VSS=yes set, then the FD forces them to be sequential. That is
  the VSS code as it is currently written is not re-entrant. If you
  turn off VSS, you can run as many simultaneous jobs as you want on
  the client, but then they cannot backup files that are open, which
  is generally not what you want.
  
  This restriction will be removed in some future version.
  
  Best regards,
  Kern
  
  On 07/02/2014 08:40 PM, Ralph Cunnington wrote:

Hi Bacula-Users,
  
  giving: Bacula_5.2.13 (Dir and SD
)on
SuSE 13.1
  
  Clients:
  
  Bacula 5.0.3 (Win64) on WinServer
2008R2,
WinServer 2003
  
  
  I've got 2 concurrend jobs on the
same
client, same Pri waiting one for the other to finish.
  
  Concurrend jobs all set in
client, Storage,
Director... using seperate Pools and FileTypes and Storage
Devices.
  
  
  *status client=win08-fd
  
  Running Jobs:
  
  Writing: Full Backup job
jw08-notes
JobId=64 Volume="nTgm-0038"
  
pool="nTag"
device="DevNotes1tg" (/media/da2/tga/client1)
  
spooling=0 despooling=0
despool_wait=0
  
Files=4
Bytes=3,829,306,501
AveBytes/sec=11,195,095 LastBytes/sec=11,609,243
  
FDReadSeqNo=74,623
in_msg=74612 out_msg=5 fd=5
  
  Writing: Full Backup job
jw08-notes-mail
JobId=65 Volume="nTgm-0039"
  
pool="nTagm"
device="DevNotes2tg" (/media/da2/tgb/client2)
  
spooling=0 despooling=0
despool_wait=0
  
Files=0 Bytes=0
AveBytes/sec=0
LastBytes/sec=0
  
FDReadSeqNo=5 in_msg=4
out_msg=3 fd=8
  
  
  
  
  
  *status storage
  
  
  
  Used Volume status:
  
  nTgm-0038 on device "DevNotes1tg"
(/media/da2/tga/client1)
  
Reader=0 writers=1 reserves=0
volinuse=1
  
  nTgm-0039 on device "DevNotes2tg"
(/media/da2/tgb/client2)
  
Reader=0 writers=0 reserves=1
volinuse=1
  
  
  
  
  why does Volume "nTgm-0039"
(writers=0, reserves=1 ?) wait and how can I fix it ??
  
  
  Has anybody had seen an similar
Situation,
any ideas ?
  
  
  best regards
Ralph Cunnington
---
IT-Support und Systementwicklung Paderborn

b.i.b. International College, Frstenallee 3-5, 33102 Paderborn
Tel:+49(0)5251-30101 - Fax:+49(0)5251-301161
Ralph(dot)Cunnington[at]bib(dot)de - www.bib.de
-
Trger: Bildungszentrum fr informationsverarbeitende Berufe
e.V., Paderborn
Vorstand: Felicitas Schneider, Dr. Bernhard Hartung, Thomas
Hommes, Prof.
Dr. Michael Lwe 
Geschftsfhrer: Georg Herrmann / Registergericht: Amtsgericht
Paderborn
/ Registernummer: VR 639 
  
  
  
  --
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Unintended effect of bconsole's reload command?

2014-07-01 Thread Kern Sibbald
Hello,

The reload command reloads the conf file, so whatever is in your
bacula-dir.conf file will be used for all jobs that start after the reload.

Since the disable command for jobs does not modify the .conf file, all
disabled jobs will be lost after a reload.

Best regards,
Kern

On 06/30/2014 03:23 PM, Bill Arlofski wrote:
 Hi list, Hi Kern,

 Recently, I have been noticing that jobs I have temporarily disabled at the
 bconsole prompt had been 'randomly' showing back up in the list of scheduled
 nightly jobs.

 I just noticed that this happened again to me this morning, and determined
 that I had just modified a config file (I made some indents and formatting
 changes, no actual backup configuration changes were made), and then I issued
 the reload command.

 Is the reload command supposed to enable all disabled jobs, or is this an
 unintended consequence?

 Using v7.04

 Thanks!


 Bill




--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Block checksum mismatch on file storage

2014-07-01 Thread Kern Sibbald
On 06/30/2014 10:35 PM, John Stoffel wrote:
 Kern Yes, it is clear that one can do read-only tests that do not destroy
 Kern data.  However, in this case, it seems to me more useful to do
 Kern read/write (it is actually write/read) tests as it appears that the
 Kern problem is more likely in the write ... 

 Absolutely.  And hopefully, this way you don't corrupt the existing
 data on the disk, but you do force the disk to do a low level
 re-allocation of bad blocks and sectors.  But if you are seeing bad
 blocks on the disk, then it's time to start thinking about retiring
 it.  
Hmm. I learn something new every day; re-allocation of bad blocks.  That
sounds very interesting.  Thanks for the information, it could be very
useful for situations like this.

Best regards,
Kern


 Kern I have never heard of a non-destructive read/write test, which I assume
 Kern reads then rewrites the disk.  Although that is clever and could be
 Kern useful, in this case it sounds to me risky on a disk that seems to be
 Kern failing.

 Kern Best regards,
 Kern Kern

 Kern On 06/29/2014 09:04 PM, John Stoffel wrote:
 Kern 3. Run read/write disk tests on your USB disk (note: this will
 Kern destroy any existing data). 
 This isn't quite right.  You can run read-write tests on a quiescent
 filesystem (ie unmounted) without problems:

 badblocks -svn /dev/sd?

 will scan the entire disk using non-destructive read-write mode.  But
 as Kern said, check your logs as well.

 John



--
Open source business process management suite built on Java and Eclipse
Turn processes into business applications with Bonita BPM Community Edition
Quickly connect people, data, and systems into organized workflows
Winner of BOSSIE, CODIE, OW2 and Gartner awards
http://p.sf.net/sfu/Bonitasoft
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


<    5   6   7   8   9   10   11   12   13   14   >