Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Phil Stracchino]

On 2020-01-30 11:29, dmaziuk via Bacula-users wrote:
> On 1/30/2020 9:20 AM, Phil Stracchino wrote:
> 
>> There is not a way to stream the same backup job to two different
>> storage devices simultaneously, no.  That question has come up before.
>> But as Davide suggests, you could copy the job(s) afterwards.  I'm doing
>> something along these lines; my backups go to disk, but Full backups
>> then get post-copied to removable disk sets.
> 
> And when the disk decides to go titsup in the middle of a job, you lose 
> everything since the last full.

Yes, I consider that an acceptable risk in my environment because if
something drastic enough happens that I simultaneously lose the highly
redundant NAS storage AND all of the clients, it probably means that my
entire infrastructure and possibly the house itself is gone.


-- 
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[dmaziuk via Bacula-users]

On 1/30/2020 9:20 AM, Phil Stracchino wrote:


There is not a way to stream the same backup job to two different
storage devices simultaneously, no.  That question has come up before.
But as Davide suggests, you could copy the job(s) afterwards.  I'm doing
something along these lines; my backups go to disk, but Full backups
then get post-copied to removable disk sets.


And when the disk decides to go titsup in the middle of a job, you lose 
everything since the last full.


I have a post-script that rsyncs the current "magazine" to a spare disk, 
this way I only lose the last backup.


Amanda had "RAIT" since forever.

Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bacula - waiting to reserve a device

[Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via Bacula-users]

Hi,

After I upgraded to bacula-7.4.4 I am getting the following message from Bacula 
when a job is waiting in the queue for the tape drive to become available to 
mount the tape from a different pool needed for this job to run:

"waiting to reserve a device"

Example:
I have 3 tape drives (1,2, &3)
Tape drive 1 and 2 are running FULL backups using tapes from pool "server-full"
Tape 3 is running Incremental backups using tapes from pool "server-partial"

Now there are desktop backup jobs waiting in the queue because it needs a tape 
from "desktop-pool"

I find that until one of the three tape drives become available for the tape 
from desktop-pool to mount I keep getting emails from bacula saying ""waiting 
to reserve a device".
How can I disable this annoying messages? Please let me know.

In the bacula-sd.conf I have

Storage {
.
.
.
.
  Maximum Concurrent Jobs = 20
  }

Thank you.
UR.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Heitor Faria]

Hello Uthra, 

You have currently 3 options: 

1. Copy Jobs (already suggested). Ref.: [ 
https://www.bacula.org/9.4.x-manuals/en/main/Migration_Copy.html | 
https://www.bacula.org/9.4.x-manuals/en/main/Migration_Copy.html ] ; 
2. Two simultaneous similar Jobs, using different Pools and Storage (one for 
tape and other for cloud). I think it is better to have different Job names for 
this option. E.g. host-backup-tape, host-backup-cloud. Same data will be read 
from the client twice, but is still do-able. 
3. You can have one Job configuration that spawns others for different storages 
(Clone Jobs), that will run in a serial fashion. Same data will be read from 
the client twice, but is still do-able. 

"Run = job-name 
The Run directive (not to be confused with the Run option in a Schedule) allows 
you to start other jobs or to clone jobs. By using the cloning keywords (see 
below), you can backup the same data (or almost the same data) to two or more 
drives at the same time. The job-name is normally the same name as the current 
Job resource (thus creating a clone). However, it may be any Job name, so one 
job may start other related jobs. 

The part after the equal sign must be enclosed in double quotes, and can 
contain any string or set of options (overrides) that you can specify when 
entering the Run command from the console. For example storage=DDS-4  In 
addition, there are two special keywords that permit you to clone the current 
job. They are level=%l and since=%s. The %l in the level keyword permits 
entering the actual level of the current job and the %s in the since keyword 
permits putting the same time for comparison as used on the current job. Note, 
in the case of the since keyword, the %s must be enclosed in double quotes, and 
thus they must be preceded by a backslash since they are already inside quotes. 
For example: 

run = "Nightly-backup level=%l since=\"%s\" storage=DDS-4" 

A cloned job will not start additional clones, so it is not possible to 
recurse. 

Please note that all cloned jobs, as specified in the Run directives are 
submitted for running before the original job is run (while it is being 
initialized). This means that any clone job will actually start before the 
original job, and may even block the original job from starting until the 
original job finishes unless you allow multiple simultaneous jobs. Even if you 
set a lower priority on the clone job, if no other jobs are running, it will 
start before the original job. 

If you are trying to prioritize jobs by using the clone feature (Run 
directive), you will find it much easier to do using a RunScript resource, or a 
RunBeforeJob directive." - Ref.: [ 
https://www.bacula.org/9.4.x-manuals/en/main/Configuring_Director.html#SECTION00203
 | 
https://www.bacula.org/9.4.x-manuals/en/main/Configuring_Director.html#SECTION00203
 ] 

If NASA needs help I'm Florida and could drop by to assist you. =) 

Regards, 

> From: "bacula-users" 
> To: "Davide Franco, dev" 
> Cc: "bacula-users" 
> Sent: Thursday, January 30, 2020 10:12:51 AM
> Subject: Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

> Thank you all for your response to my question. So, it looks like there is no
> easy way one can set-up bacula to backup simultaneously to the tape and to the
> cloud.

> UR.

> From: Davide Franco 
> Sent: Thursday, January 30, 2020 12:41 AM
> To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] 
> Cc: bacula-users@lists.sourceforge.net
> Subject: [EXTERNAL] Re: [Bacula-users] bacula cloud backup

> Hello,

> IMHO, I’m not sure you can perform simultaneous backup jobs to both tape and 
> S3
> (please let me know if I’m wrong).

> I’d suggest maybe to use copy jobs like this

> 1. Backup to tapes

> 2. Copy job to S3 bucket based on previous backup on tapes.

> I don’t have huge experience with copy jobs, hopefully someone reading this 
> can
> give more hints.

> Best,

> Davide

> On Tue, 28 Jan 2020 at 20:18, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] 
> via
> Bacula-users < [ mailto:bacula-users@lists.sourceforge.net |
> bacula-users@lists.sourceforge.net ] > wrote:

>> I have recently upgraded my bacula server to version 9.4.4 and wanted to test
>> the cloud backup feature. Currently we are backing up to LTO7 tapes. Is it
>> possible to set-up bacula to backup both to the tape and to the cloud
>> simultaneously?

>> If so I would appreciate some help with that.

>> Thank you.

>> UR.

>> ___
>> Bacula-users mailing list
>> [ mailto:Bacula-users@lists.sourceforge.net | 
>> Bacula-users@lists.sourceforge.net
>> ]
>> [
>> https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.sourceforge.net_lists_listinfo_bacula-2Dusers=DwMFaQ=ApwzowJNAKKw3xye91w7BE1XMRKi2LN9kiMk5Csz9Zk=_PbJdGqESxb4LeUrghLRI8P-Cax353zDEnqGLRxjtQU=V9cQYvLFFDWwIK2sjo_4beZX-iY1vUDBSyFXS2TrMWI=zs8ooiaoNRRjQPNNFjZunVUZAGW-FN5Ln-N2tEleqbo=
>> | 

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Phil Stracchino]

On 2020-01-30 10:12, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via
Bacula-users wrote:
> Thank you all for your response to my question. So, it looks like there
> is no easy way one can set-up bacula to backup simultaneously to the
> tape and to the cloud.


There is not a way to stream the same backup job to two different
storage devices simultaneously, no.  That question has come up before.
But as Davide suggests, you could copy the job(s) afterwards.  I'm doing
something along these lines; my backups go to disk, but Full backups
then get post-copied to removable disk sets.



-- 
  Phil Stracchino
  Babylon Communications
  ph...@caerllewys.net
  p...@co.ordinate.org
  Landline: +1.603.293.8485
  Mobile:   +1.603.998.6958


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via Bacula-users]

Thank you all for your response to my question. So, it looks like there is no 
easy way one can set-up bacula to backup simultaneously to the tape and to the 
cloud.

UR.


From: Davide Franco 
Sent: Thursday, January 30, 2020 12:41 AM
To: Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] 
Cc: bacula-users@lists.sourceforge.net
Subject: [EXTERNAL] Re: [Bacula-users] bacula cloud backup

Hello,

IMHO, I’m not sure you can perform simultaneous backup jobs to both tape and S3 
(please let me know if I’m wrong).

I’d suggest maybe to use copy jobs like this

1. Backup to tapes
2. Copy job to S3 bucket based on previous backup on tapes.

I don’t have huge experience with copy jobs, hopefully someone reading this can 
give more hints.

Best,

Davide

On Tue, 28 Jan 2020 at 20:18, Rao, Uthra R. (GSFC-672.0)[ADNET SYSTEMS INC] via 
Bacula-users 
mailto:bacula-users@lists.sourceforge.net>> 
wrote:
I have recently upgraded my bacula server to version 9.4.4 and wanted to test 
the cloud backup feature. Currently we are backing up to LTO7 tapes. Is it 
possible to set-up bacula to backup both to the tape and to the cloud 
simultaneously?
If so I would appreciate some help with that.

Thank you.
UR.
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] FD / SD Traffic question

[Uwe Schuerkamp]

Thanks Heitor!

All the best,

Uwe

-- 
Uwe Schürkamp | email: 









___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] FD / SD Traffic question

[Heitor Faria]

> Hi folks,

Hello,
 
> just a quick question about traffic flow within bacula:
> 
> If I configure a 2nd storage daemon on a separate network which
> includes a few clients and then run a backup of said client on the
> 2nd storage daemon, the traffic will not involve the director except for
> backup job details (files, attributes etc), correct?

Yes, that's correct.

> I'm asking because I'd like to use a single director for two networks
> separated by firewall with a 1 gigabit connection which would be
> clogged up if I backup the other network's client to the local
> director / storage daemon.
> 
> Thanks in advance & all the best,
> 
> Uwe

Regards,
-- 
MSc Heitor Faria 
CEO Bacula LATAM 
mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why would bacula consider duplicate jobs as fatal?

[Martin Simmons]

> On Wed, 29 Jan 2020 16:16:31 +, William Muriithi said:
> 
> Hello,
> 
> Was trying to reduce the number of mails coming from Bacula, and was combing
> through the logs to see what I can filter out.  Currently, almost all noise
> comes from bacula attempting to schedule a job and then realizing the
> previous isn't yet done.  I have configured bacula not to allow duplicates
> to avoid jobs piling up in case I miss replacing tapes when all are full.
> 
> Anyway as I was doing so, I noticed that, sometime, bacula do consider
> duplicate fatal?  How would this make sense considering it was intentionally
> configured?  Kind of confused by these instances.
> 
> 22-Jan 17:50 bacula-dir JobId 25338: Fatal error: JobId 25266 already 
> running. Duplicate job not allowed.

It was a fatal in the sense that the job did not run.

However, check the "Termination" line of the output -- it should be should be
"Backup Canceled" even though it says "Fatal error" in the message.

__Martin


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] FD / SD Traffic question

[Uwe Schuerkamp]

Hi folks,

just a quick question about traffic flow within bacula:

If I configure a 2nd storage daemon on a separate network which
includes a few clients and then run a backup of said client on the
2nd storage daemon, the traffic will not involve the director except for
backup job details (files, attributes etc), correct?

I'm asking because I'd like to use a single director for two networks
separated by firewall with a 1 gigabit connection which would be
clogged up if I backup the other network's client to the local
director / storage daemon.

Thanks in advance & all the best,

Uwe

-- 
Uwe Schürkamp | email: 








___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users