Re: [Bacula-users] Backup restauration question

2020-02-13 Thread Dimitri Maziuk via Bacula-users
On 2/13/20 12:47 PM, Jean Mark Orfali wrote:
> Hello Phil,
> 
> Thank you for your answer. But what if I need a complete folder and some file 
> has been changed but no other?

There's a Russian saying: "go there I don't know where, bring me that I
don't know what".

One advantage of having on-line browsable filesystem snapshots is that
you can tell the user where they can `cd` to and knock themselves out
looking for that they don't know what.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-11 Thread Dimitri Maziuk via Bacula-users
On 2/11/20 10:59 AM, Radosław Korzeniewski wrote:

> Because a community _always_ know better then developers. :) Just read some
> hot threads on this group.

BS. This is IT 101: users don't know what they want.

>>
> This is a small tip of the ideberg! and the devil is in the details -
> always! I.e. how you want a single SD disconnection and reconnection to be
> handled? Do you want to fail the whole job? or continue on remaining one?
...

My point exactly.

Now that I figured out how to keep zfs snaphots forever, mounted and
browsable, on the backup box and garbage-collect them on the clients
too, I am very rapidly losing interest in the "tape backup" paradigm
anyway. So, like, whatever...

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-10 Thread Dimitri Maziuk via Bacula-users
On 2/10/20 4:12 AM, Radosław Korzeniewski wrote:

> So, why not to design a special kind of SD which will get data from FD and
> then save it on different backend SD synchronously defining full and
> flexible RAIT or EC solution?

How should I know why you need a "specail" SD instead of a "regular" one?

> This is a kind of help I want to get from community as you always complain
> about decisions which developers take himself.

I personally only care about failure of my HDD "magazine" being written
to. SD writing to two file descriptors instead of one is all *I* want.

I don't even care for having the 2nd copy in the catalog: I just want
the same exact volume file on two physical drives. Once full, I'll put
one of them on the shelf and wipe out the other, to be reused w/ the
next magazine.

Somebody else may want the copy to go to "the cloud" instead, that may
or may not require a different approach.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-02-10 Thread Dimitri Maziuk via Bacula-users
On 2/10/20 11:31 AM, Josh Fisher wrote:

> What about a SD writing to multiple local 'Device' objects? And segueing
> into a related subject, why is a job locked into a particular Device at
> job startup? Rather than a one-time allocation of device and then one or
> more subsequent allocations of volume(s) as separate operations, why not
> allocate device and volume together as a pair in a single atomic
> operation? This would allow a job to potentially change devices when a
> different volume was needed and would be beneficial for autochangers
> that have more than one drive, including virtual disk autochangers.

Why is media type tied to a device? I never understood this: I get that
you may not want to stick an lto-1 tape into an lto-4 drive, but those
are device *types* -- nothing's stopping me from having two lto-1 drives
in my jukebox and have two devices capable of using lto-1 media.

(Or is it no longer the case)
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

2020-01-31 Thread Dimitri Maziuk via Bacula-users
On 1/31/20 10:36 AM, Josh Fisher wrote:
> 
> Actually, it is pretty tricky from user space and why the need for the
> md kernel module in Linux. For true RAIT, like for RAID, it should be a
> device driver.

Yes, iff you need true RAIT. If all you want is to write to 2 file
descriptors instead of one, I'll need to dig up my Stevens and do some
light reading to refresh my memory and see if a simple dup() will
suffice. And no, that's not the same as a copy job: one is parallel, the
other: serial.

I expect the fun bit is fitting it into bacula's universe of tapes and
volumes and catalogs. Like if you want to restore, how do you chose the
copy to restore from.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Backups to S3

2020-01-17 Thread Dimitri Maziuk via Bacula-users
On 1/17/20 1:03 PM, Jason Voorhees wrote:
...
> I'll start playing around with it. I'll let you know if anything does
> not work as expected.

You made me look: what I can find on amazon is VTL is
- $125/mo/gateway
- $0.30/restore
- $0.09/GB/month in regular or $0.01/GB/month in "glacial" storage.

S3 pricing appears to be
- $0.023/GB/month in "standard", $0.01 in "infrequent", and $0.004 in
"glacial" tiers.

However you pay half a penny per put and $0.0004 for get request on
"standard", and about an order of magnitude more on the other tries.

Please let us know how much you end up paying, too: 4TB NAS HDD is about
a hundred bucks, one-off, whereas 4TB of VTL storage is $368.64 *every
month*. In "infrequent" S3 it's "only" forty-one bucks per month (so on
the 3rd month you're better off with the hard drive), but the
interesting question is how much you rake up in data transfer fees.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to verify copy job written on cartridge ?

2019-12-05 Thread Dimitri Maziuk via Bacula-users

On 12/5/2019 3:18 AM, Frédéric F. wrote:

Hello,

Nobody has an idea to verify tapes data ?


FWIW back in the Legato days we used to have a post-backup job that 
picked a random file and restored it.


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Dimitri Maziuk via Bacula-users
On 10/21/19 11:00 AM, Alan Brown wrote:

> I spend an awful lot of time making things work in a RHEL environment 
> when it "just works" in Debianish ones, but the choice of environment 
> isn't my call.

It was a rhetorical question.

Although I do think the "scientific community" is beginning to wake up:
all the reproducibility whining and gnashing of tees, and singularity,
are getting us there. Slowly.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

2019-10-21 Thread Dimitri Maziuk via Bacula-users

On 10/21/2019 9:14 AM, Clark, Patti via Bacula-users wrote:
...

My question (rhetorical), why do you want to use an OS that is recently 
released and still bleeding for a backup server?  I understand upgrade 
headaches, but backup servers need to be rock solid.


Why use any RHEL > 6 for any kind of server?

Dima



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] SAS HBA support on Linux

2019-10-18 Thread Dimitri Maziuk via Bacula-users
On 10/18/19 4:45 PM, William Muriithi wrote:
> Hello,
> 
> Have any of you deployed RHEL 8/Centos 8 and would be willing to share what 
> HBA card they are using?
> 

On centos 7

> # lspci
...
> 03:00.0 Serial Attached SCSI controller: Broadcom / LSI SAS2308 PCI-Express 
> Fusion-MPT SAS-2 (rev 05)

HTH
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-27 Thread Dimitri Maziuk via Bacula-users

(This originally went to Gary instead of the list)

On 9/26/2019 7:41 AM, Gary R. Schmidt wrote:

Would it be very difficult to change Bacula so that rather than trying 
every five (or whatever) minutes it did an exponential back-off?


One problem with exponential back-off is it's pretty easy to get to the 
state where everyone's connected and everyone's backing off. IIRC with 
the original Ethernet that happened at e^10 collision rate or something 
around 30%.


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-20 Thread Dimitri Maziuk via Bacula-users
On 9/20/19 5:25 PM, David Brodbeck wrote:

> That's fair, although most cloud backup schemes are zero-knowledge, i.e.
> the data is encrypted before it leaves your premises. I don't know how hard
> that is to set up with Bacula because I haven't tried. (One hard truth
> about academia is it's easier to get money for one-time costs than for
> subscriptions.)

Encryption is a double-edged sword: you need to be very sure nobody will
never get the keys. Unless they need to:
https://www.inc.com/bill-murphy-jr/a-ceo-died-he-never-shared-his-passwords-now-his-customers-are-out-190-million-that-cant-be-accessed.html

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-18 Thread Dimitri Maziuk via Bacula-users
On 9/18/19 12:38 PM, Phil Stracchino wrote:

> ...  But I've *got* to get
> away from tape.

*I* want to get away from backups. The group where we use HDDs and
vchanger has data archival policy, that's what that "backup" is: an
archive.

But the other group, we keep the 36-bay ZFS bacula box largely because
it's there and it doesn't cost much to keep it. We mostly moved to this
century's kit by now and between gluster and git and ZFS and syncthing
and streaming replication I have really little use for "traditional
backups" anymore.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-18 Thread Dimitri Maziuk via Bacula-users
On 9/18/19 11:19 AM, Phil Stracchino wrote:
> On 9/18/19 11:50 AM, Josh Fisher wrote:
>>
>> ... I see around 120 MB/s write speeds.
> 
> But ... that's painfully slow even compared to the LTO-4 drive I just
> gave up on, which writes at up to twice that.

Well, I get ~300MB/s despooling to SATA (ZFS w/ ZIL on SSD), but only
around a hundred over the gigabit wire connecting the clients... If
that's too slow you probaly want to stay with LTO-dujour for a while.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 6:23 PM, Phil Stracchino wrote:

> And just use Bacula's vchanger, you say?  I've never actually played
> with that yet.

Not bacula changer, Josh's vchanger. It has its quirks but you get a
"magazine" per disk with "volume" files and it all stays in the catalog.
So if you ever need to restore something, it'll tell you which disk to
put in.

It cuts down on manual mucking around quite a bit.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 5:01 PM, Dimitri Maziuk via Bacula-users wrote:

>  I think you really want at least 4 drives for this setup

PS. but only one of them really needs to be removable...

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 3:05 PM, Phil Stracchino wrote:

> ... I'd prefer to have my full backup media actually
> physically offline and airgapped when not actually running.  Which is
> why I was asking for people's experiences with removable-drive setups
> and how best to do it in Bacula.

Basic hot-swap SATA + vchanger works. But I think you really want at
least 4 drives for this setup: I've an SSD spool, the "copy", the "data
cartridge", and the system. It's doable in a typical 1U server chassis
but will probably be painful with external drives.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Looking to move away from tape

2019-09-17 Thread Dimitri Maziuk via Bacula-users
On 9/17/19 1:08 PM, Phil Stracchino wrote:

> What are folks using for removable-drive backup storage, how do you have
> it configured in Bacula, and how well is it working out for you?  I
> desperately need a better solution here.

We stick the old and the cheapest desktop SATA drives into a server w/
hot-swap disk slots, and pull them out an put them on the shelf when
they're full.

There are problems with it, most notably bacula's inability to spool to
two devices at once: if you disk fails, you lose the whole thing. We
have a post-job rsync to a separate drive, so we only lose the last
backup, but amanda-style "rait" would be so much better.

The other one we have is a 36-bay chassis with ZFS. We started with 4TB
"NAS" drives in it and by now replaced them all with 8TB "archive"
ones... And when it starts getting tight we'll go for 12 or 16 or
whatever it's gonna be by then. With this one I don't have to muck
around with vchanger, labeling barcodes and updating slots and all that.
And everything's on-line at all times.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [EXTERNAL] Re: Bacula-FD - RedHat

2019-08-19 Thread Dimitri Maziuk via Bacula-users

On 8/19/2019 8:16 AM, Clark, Patti via Bacula-users wrote:

I highly disagree with the RHEL 8 suggestion.  You don't need to be fighting 
new release problems with an OS on a backup server that will require frequent 
patching and reboots.

As for Bacula community don't use the RHEL provided packages, they are way too 
old.


If one even has a say in the choice of version and/or distro and/or 
os... That's not always the case.


OP: install docker, provided it's "officially supported" by deadrat, and 
roll up a centos 6 + bacula 5.x container.


Dima


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-07-23 Thread Dimitri Maziuk via Bacula-users

On 7/23/2019 6:02 AM, Martin Simmons wrote:


If this is being caused by the PathVisibility table then you could try to
either delete that table if it is empty or alter its schema definition to use
bigint instead of int8 and integer instead of int4. (I'm assuming you are
working with a copy of the bacula.db file, not the live one.)


If this is reading from sql dump, s/int8/bigint/g before the conversion 
may work


Dima




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula performance

2019-06-03 Thread Dimitri Maziuk via Bacula-users
On 6/3/19 2:06 PM, ce wrote:

> running multiple jobs for the same client at the same time makes it
> worse...!!!

I use neither encryption nor windows, but this hints at disk i/o. I'm
sure sysinternals have some iostat equivalent, or you maybe you could
try watching it in task manager/perfmon?

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] How to backup structured fodler tree (avoiding incremental as much as possible)?

2019-05-31 Thread Dimitri Maziuk via Bacula-users
On 5/31/19 3:24 PM, Lloyd Brown wrote:

> Use a script to generate the list of directories to backup, and shove
> that into the FileSet definition.

E.g. this:

FileSet {
...
Include {
File = "\\|sh -c 'find /home \\( -name fid -o -name ser \\)
-mmin +60 -exec dirname \\{} \\; | sort | uniq'"
...
}
}

works (watch out for wordwrap), but you lose timestamps on all
intermediate directories. As in you can't see those when selecting files
for restores.

Unless they fixed it in v. 9.someting -- we're still on 7.x.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Multiple bacula jobs at the same time

2019-05-16 Thread Dimitri Maziuk via Bacula-users
On 5/16/19 12:06 PM, ce wrote:
> Hi,
> 
> How can I setup bacula to run multiple bacula jobs at the same time for the
> same windows client?
> should I just set Maximum Concurrent Jobs to more than one, can I set 3 or
> 4 concurrent bacula jobs for a windows client? is that possible?

Setting that in the Job definition should work. My "server"-side setup is

> 
> enable concurrency in 4 places:
> - Storage stanza in bacula-sd.conf
> - Device stanza in bacula-sd.conf
> - Storage stanza in bacula-dir.conf
> - Director stanza in bacula-dir.conf
> 
> Specifically, "Storage" is in both config files.

and for some clients I have 2 jobs run in parallel ("configs" and "data
dirs").

However if you want to run 4 long jobs in parallel, I'd first make sure
the network has the bandwidth for it.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] multiple bacula jobs at the same time

2019-05-16 Thread Dimitri Maziuk via Bacula-users
On 5/16/19 11:12 AM, ce wrote:

> This message was sent on May 16, 2019 at 9:13:03 AM PDT
> You can open it by clicking the link below. This link will only work for 
> bacula-users@lists.sourceforge.net.

It seems AI has evolved itself a built-in IQ test.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-05-10 Thread Dimitri Maziuk via Bacula-users
On 5/9/19 5:41 PM, David Brodbeck wrote:
> On Wed, May 1, 2019 at 3:14 PM Phil Stracchino  wrote:

>> Surely you could have just bscanned the media you had?
>>

... Obviously now that
> the SQLite rug is going to be pulled out from under me I may have to
> revisit the bscan idea.

I haven't tried this myself, this is purely theoretical, etc., etc., but
there's this: https://github.com/dimitri/pgloader -- just don't delete
the dump file at the end of catalog backup job, create postgres database
using bacula's scripts, and see if you can get that dump file in.

Of course if you only have a couple of volumes, on-disk, bscan'ing them
in will be faster.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-05-02 Thread Dimitri Maziuk via Bacula-users
On 5/2/19 1:35 PM, Tilman Schmidt wrote:
> Am 02.05.2019 um 00:14 schrieb Phil Stracchino:
>> Surely you could have just bscanned the media you had?
> 
> s/just/hired a few temps who'd/ :-)

Might still be cheaper than hiring one database guru to hand-edit
catalog.sql for psql. ;)

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-05-01 Thread Dimitri Maziuk via Bacula-users
On 5/1/19 3:47 AM, Kern Sibbald wrote:

> Aside from the work it takes to maintain the code, please be aware that if 
> ever 
> a SQLite database
> becomes corrupted, to the best of my knowledge there are no tools to correct 
> it.
That is a valid argument, however, the fix for that is rather simple:
don't run /usr/libexec/bacula/delete_catalog_backup after BackupCatalog.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Failed to connect to Client -fd

2019-04-30 Thread Dimitri Maziuk via Bacula-users
On 4/30/19 11:42 AM, William Muriithi wrote:
> Heitor,
> 
> He is using Centos, and version 5.2.13 ended up being whats shipped by 
> RedHat. Very understandable
> 
> Do you know why RedHat does ship something newer?  Like even version 7?

RedHat gets paid for supporting their customers. Presumably they have
reasons for not supporting newer bacula versions. At least 5.2.13 is
still in base, there have been several instances where they dropped
software supported by other commercial entities altogether. DRBD, for
example.

Of course on centos you needn't care about RH support terms so you may
as well install from upstream repo.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-04-29 Thread Dimitri Maziuk via Bacula-users
On 4/29/19 1:57 PM, Josip Deanovic wrote:

> Because of the reasons Kern already wrote.

Yes, but they have nothing to do with the question.

> It's not that SQLite is bad or does not have the needed capabilities

Precisely: back when it was supported there was nothing wrong with using
it, provided one understood how it scales.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bacula and SQLite

2019-04-29 Thread Dimitri Maziuk via Bacula-users
On 4/29/19 10:54 AM, Phil Stracchino wrote:

> Was SQLite *ever* actually *recommended* for production?

For a small dataset with a very limited number of volumes and backup
cycles, why not?

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-24 Thread Dimitri Maziuk via Bacula-users
On 4/24/19 11:44 AM, Radosław Korzeniewski wrote:

> To make a reschedule after restart possible a Director should save
> reschedule state in catalog database. It should save the number of
> reschedules passed and an exact time when last reschedule pass started to
> checks if it is required to continue any rescheduled jobs.

If you have a multi-terabyte job that takes 20 hours to complete, and
the backup schedule is every 24 hours, you're better off just leaving it
be until the next scheduled backup.

I.e. IMO auto-rescheduling failed jobs has bigger problems than
persisting the state across director restarts.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-19 Thread Dimitri Maziuk via Bacula-users
On 4/19/19 11:56 AM, Radosław Korzeniewski wrote:

> When you implement Bacula in the shared storage cluster, you can failover
> backup service from node to node in any direction in just a seconds. Your
> shared storage cluster can do it for you automatically as soon as it check
> that a service is unavailable.

...as long as you are not actually using it, as in you don't have a
backup running.

When you fail over during (per Murphy's Law: 99% into) a running backup,
the above is no longer entirely correct. You have to restart the backup,
from scratch, at a different point in time, and probably having wasted
the tapes written by this point as well.

If you define your service as "having a usable backup, on schedule", you
can't fail that service over "in seconds".

Don't get me wrong, I have any number of HA pairs that work exactly as
you describe, with configs, spools, and upload areas on DRBD, and so on.
Just not bacula.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 1:22 PM, Josip Deanovic wrote:

> The usual way to do it is a shared storage.
> Servers would need to be able to connect to the storage and see the
> exported LUN over fibre channel, iSCSI or similar protocol.

And what I was saying is that at this point DRBD would be very low on my
list of shared storage options for this application.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
Not sure how this happened:

> The easy way you migrate a running from one host to another VM is have

-- it was meant to be "a running VM from one host to another".

8-\ boggle
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 10:04 AM, Josip Deanovic wrote:

> NFS and DRBD are not really comparable that way.

The easy way you migrate a running from one host to another VM is have
the image on an NFS mounted on both hosts.

The hard way involves copying the actual image file, however, if you use
ZFS you may get away with only copying a small incremental snapshot.

Last but not least, you can set it up on DRBD and make sure you get your
HA stack set up to migrate everything over correctly. With all the
network-controlled power outlets and the rest of the bloat you need to
make corosync/pacemaker run.

Personally I believe in simple stupid; all my VMs live behind door number 1.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Doubts about Bacula

2019-04-16 Thread Dimitri Maziuk via Bacula-users
On 4/16/19 10:27 AM, Josh Fisher wrote:
> 
> 
> Running jobs will fail, but the automated "Reschedule On Error" feature
> allows restarting them after the fail-over. Also, fail-over doesn't
> affect scheduled jobs that haven't started yet at the time of fail-over.
> Putting the OS on DRBD and running in a VM (or container) allows
> continuation of backup services without operator intervention. What is
> wrong with that?

Nothing, I just doubt migrating the VM itself is all that seamless and
stable without operator intervention. Admittedly, I have not played with
that in years... but last I looked if you actually *failed* without an
orderly VM shutdown, booting it up on the other node was a crap shoot.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Run ClientBeforeJob script in background instead of waiting for it.

2019-02-06 Thread Dimitri Maziuk via Bacula-users
On 2/6/19 4:14 PM, David Brodbeck wrote:

> I think I'm barking up the wrong tree and the ClientBeforeJob functionality
> just isn't meant for this sort of thing. I gather from earlier conversation
> that it was only working for me in 7.4.x because of a bug.

From a brief look at google it seems you're barking up the wrong tree in
that it is caffeinate that won't detach from the terminal because it
must catch its Ctrl+C to decaf.

I would look at using pmset to disable sleep in Before and re-enable in
AfterJob -- though it's probably a PITA if you have custom power
settings and want to restore them after.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [External] Re: [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 4:15 PM, mark.berg...@uphs.upenn.edu wrote:

> Putting it very bluntly, the data in Bacula's database is the only
> important component. Your tool -- and every other GUI front-end -- is a
> convenience, not a necessary part of the backup infrastructure, and your
> tool (and every other GUI front-end to Bacula) is much, much less mature
> and less trusted.

Even if it is, unless it comes with bacula from bacula, there is no
guarantee that the next version of the core software will not add more
database objects with a name clash. Or change the schema in a way that
breaks your tool. Having the pieces fall in the same database that holds
my super-important backup catalog is just... like I said: !@#$ck no.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 3:03 PM, Radosław Korzeniewski wrote:
> Hello,
> 
> czw., 24 sty 2019 o 20:28 Dimitri Maziuk via Bacula-users <
> bacula-users@lists.sourceforge.net> napisał(a):
> 
>>  !@#ck no, are you kidding?
>>
>>
> Thanks for feedback.

:)

Like I said, if someone has paranoid requirements like that, *and* wants
to use IBAdmin, they could play with roles and grants...

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] IBAdmin

2019-01-24 Thread Dimitri Maziuk via Bacula-users
On 1/24/19 12:47 PM, Radosław Korzeniewski wrote:

> I assume the Bacula Catalog are all the objects used by Bacula Director to
> perform its operations, so, no. IBAdmin does not store its configuration
> data in Bacula Catalog but stores it in the same Postgresql database.

You can isolate admin stuff in a sub-schema (which I believe in mysql
will just create a separate database). A more sophisticated approach
would be to create a role with fine-grained permissions.

And if I were serious about my backups, I wouldn't give a 3rd-party app
write access to my backup catalog either. !@#ck no, are you kidding?

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Run ClientBeforeJob script in background instead of waiting for it.

2019-01-07 Thread Dimitri Maziuk via Bacula-users
On 1/7/19 12:32 PM, David Brodbeck wrote:
> Hmm, good catch on the redirect, but it still doesn't work. Neither does
> adding the exec line.

nohup just does what is says: no HUP. You may want to try `CMD & ;
disown` if your shell has disown, or `setsid CMD`. You'd still ned the
redirects.

Or rewrite your script in something that lets you do a proper double-fork.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Nagios notification setup

2018-12-04 Thread Dimitri Maziuk via Bacula-users
On 12/04/2018 12:57 PM, Donna Hofmeister wrote:
> On Tue, Dec 4, 2018 at 11:26 AM Dimitri Maziuk via Bacula-users <
> bacula-users@lists.sourceforge.net> wrote:

>> How do you monitor for bacula's critical notifications?
>>
> 
> I'm not doing any rocket science -- I'm simply monitoring to see if the
> services are running.

This was addressed to OP as I am not sure if they meant notifications of
failing backups or notifications of dying daemons.

I also have nagios monitoring the latter w/ per-host config files,
contact groups and all that. I have a feeling that may not have been the
question though.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Nagios notification setup

2018-12-04 Thread Dimitri Maziuk via Bacula-users
On 12/03/2018 06:27 PM, Elma wrote:
> Hi,
> 
> I wonder if we can send nagios critical notification of specific clients to
> a separate email address.
> right now one email address is used for all the critical notification.

How do you monitor for bacula's critical notifications?

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-26 Thread Dimitri Maziuk via Bacula-users
On 11/26/2018 11:40 AM, George via Bacula-users wrote:

> Just one more question: when automating the backup of
> all postgresql databases, should I also backup
> template1? I have found that template0 cannot be
> backed up due to how postgresql works but couldn't
> find similar info about template1.

I don't bother with its built-in databases: IME reinstalling postgres
(which restores them) is as fast or faster than restoring from backup.

If you're after high availability-level of backup, set up another server
and run streaming replication to it.
-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-23 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 06:32 PM, George Anchev via Bacula-users wrote:

> $ du -hs pg_wal/
> 769Mpg_wal/
> $ psql -U postgres -d postgres -c checkpoint
> CHECKPOINT
> $ du -hs pg_wal/
> 769Mpg_wal/

If it still hasn't gone down, check your postgresql.conf for

#wal_level = replica# minimal, replica, or logical
# (change requires restart)

If the above is what you have, you could change it to
 wal_level = minimal
and restart.

FWIW I just checked another of out postgresql-10 hosts, this one does a
lot of truncates and loaded on a 10^6+ rows DB, it has
#max_wal_size = 1GB
and ~999.5MB in pg_wal when idle.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
PS

https://www.postgresql.org/docs/10/sql-checkpoint.html

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu





signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 04:56 PM, George Anchev via Bacula-users wrote:

> On the link I read wal_keep_segments "Specifies the
> *minimum* number of past log file segments kept in the
> pg_wal directory". Isn't there a setting which
> controls the *maximum* number/volume/retention of those
> files? (like in a log rotation)

Not that I know of. They keep transactions, so they're not necessarily
correspond to database size. Normally they get auto-recycled unless
either a) archiving is on, but archive command keeps failing, or b)
replication is on but the stand-by(s) keep failing to fetch them.

Check that wal archive_mode is off in postgresql.conf and also all
replication-related stuff.

Try `psql -U postgres -d postgres -c checkpoint` and see if the files
start disappearing after that.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-20 Thread Dimitri Maziuk via Bacula-users
On 11/20/2018 03:49 PM, George Anchev via Bacula-users wrote:
> On Mon, 19 Nov 2018 17:16:52 -0600 Dimitri Maziuk via
> Bacula-users wrote:
> 
>> https://www.postgresql.org/docs/10/routine-vacuuming.html
> 
> Good info. Thanks.
> 
>> WAL: don't worry about it unless you want to archive
>> them or replicate your database.
> 
> But the pg_wal directory is way too big and I have no
> idea how to decrease it (without damaging anything).
> Hence the whole question: how to manage that? Is there
> a way to (auto)vacuum this too?

I've 320MB on a server that replicates a database of a few million rows,
and ~100MB on our bacula server w/ a year's worth of backups. What do
you call "too big"?

There is wal_keep_segments:
https://www.postgresql.org/docs/10/runtime-config-replication.html
but if replication is not on, it's normally only a handful of 16MB files
in there, like 6 or so.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] PostgreSQL: WAL and log management

2018-11-19 Thread Dimitri Maziuk via Bacula-users
On 11/19/2018 04:12 PM, George Anchev via Bacula-users wrote:

> 1. Am I doing everything correctly?

https://www.postgresql.org/docs/10/routine-vacuuming.html

> 2. How to manage WAL and logs so that old unnecessary
> data doesn't fill up disk (and backup tape) space?

Logs: https://www.postgresql.org/docs/10/logfile-maintenance.html

"Stock" postgresql.conf rotates them by day of the week in data/pg_log
but check your postgresql.conf.

WAL: don't worry about it unless you want to archive them or replicate
your database.

> 3. Should I backup WAL, logs or the
> whole /var/lib/pgsql? Or should I rather look for a
> script which backs up each DB in a separate file
> (currently I have use such script for mysql).

Bacula's backup_catalog should do it for bacula. For other databases you
could e.g. run pg_dump from a cron job. If you're after high
availability you could set up streaming replication to another postgres
instance, that's where some WAL-related stuff comes in.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 05:06 PM, George Anchev via Bacula-users wrote:

>> -bash-4.2$ echo $PGDATA
>> /var/lib/pgsql/data
> 
> I get the same echo output but:
> 
> # ls /var/lib/pgsql/data
> ls: cannot access '/var/lib/pgsql/data': No such file or directory

Well, that's b0rk3d.

> POSTGRES_DATADIR="~postgres/data"

This is probably it. Check ~postgres/data/pg_hba.conf as per previous
message: specifically, if auth method is "ident", it won't work without
identd server. "peer" should work and "trust" will work.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 04:25 PM, George Anchev via Bacula-users wrote:

> I still wonder though why there is nothing postgresql
> related in /etc... Need I install any other packages
> or how should this be set up?

# su - postgres
Last login: Wed Jan 24 15:59:20 CST 2018 on pts/1
-bash-4.2$ echo $PGDATA
/var/lib/pgsql/data

This is on centos, suse may have put it someplace else. .conf files are
in there, though you may not even need to touch them for a basic bacula
setup. You may need to edit pg_hba.conf and set method to "trust" for
local connections, that's about it.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Migrating from MariaDB to PostgreSQL

2018-11-16 Thread Dimitri Maziuk via Bacula-users
On 11/16/2018 12:15 PM, Martin Simmons wrote:
>> On Fri, 16 Nov 2018 12:50:12 +0200, George Anchev via Bacula-users said:

>> nm: '/usr/lib/libpq.a': No such file

> Also, you may only have .so files installed, 

That is the most likely cause, many distros don't even ship .a's in
-devel packages anymore as nobody can figure out how to build static
binaries with gunk libtool anyway... They definitely wouldn't be in the
regular -libs packages.

... in which case try> objdump -T ...path..to..libpq.so... | grep
pthread_mutex_lock
> 
> and look for something like:
> 
>   DF *UND*  GLIBC_2.2.5 
> pthread_mutex_lock

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] modifying established jobs

2018-10-26 Thread Dimitri Maziuk via Bacula-users
On 10/26/2018 04:51 PM, Phil Stracchino wrote:

> Simple.  A reload *does its best* to properly reinitialize all of the
> relevant data in the Director without interrupting any running jobs, but
> there have been plenty of reports in the past that the Director can
> become unstable after multiple reloads.  So prudence says, yes, reload
> now, but restart your Director when you get a chance.  Just to be safe.

This isn't specific to bacula, FWIW. There's plenty of services that you
can gracefully reload and get the delegated, proxied, underlying, etc.
resources out of whack if you don't restart whatever provides those.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula SD on a QNAP TS-231

2018-10-12 Thread Dimitri Maziuk via Bacula-users
On 10/12/2018 03:46 PM, Tilman Schmidt wrote:
> Hello Heitor,
> 
> On 12.10.2018 19:27 Heitor Faria wrote:
> [in reply to Andrea Venturoli's question:]
>>> Is there any way I could install bacula storage daemon on the NAS in
>>> subject?
> [...]>> Of course I could use NFS, but I'd *REALLY* like to avoid it.
>>
>> Just use iSCSI: https://www.qnap.com/en/product/ts-231/specs/software
> 
> Interesting idea. Could you elaborate on that?
> How would one proceed to back up a QNAP data volume via iSCSI?

You don't need storage daemon on qnap if you want to backup up a qnap
volume. You need it bacula-fd.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Ubuntu 18.04 / Bacula 9.0.6 and Postgres 10

2018-09-06 Thread Dimitri Maziuk via Bacula-users
On 09/06/2018 01:34 PM, Ivan Adzhubey wrote:
> Just to clarify, this is my problem:
> 
> $ pg_lsclusters
> Ver Cluster Port Status OwnerData directory   Log file
> 9.5 main5432 online postgres /var/lib/postgresql/9.5/main /var/log/
> postgresql/postgresql-9.5-main.log
> 10  main5433 online postgres /var/lib/postgresql/10/main  /var/log/
> postgresql/postgresql-10-main.log

They're set up to coexist. You could switch port to 5434 and give v.10 a
try but I have a suspicion there is no sane way to do that in bacula.

FWIW we have not seen any compatibility problems in v.10, but we're not
using it with bacula. All I can see in bacula is
/usr/libexec/bacula/create_postgresql_database:

> case ${PSQLVERSION} in
>9.*)
> ENCODING="ENCODING 'SQL_ASCII' LC_COLLATE 'C' LC_CTYPE 'C'"
>;;
>8.[456789])
> ENCODING="ENCODING 'SQL_ASCII' LC_COLLATE 'C' LC_CTYPE 'C'"
> ;;
> *)
> ENCODING="ENCODING 'SQL_ASCII'"
> ;;
> esac

I don't see why duplicating the "9.*)" block for "10.*)" wouldn't work.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Trying to restore, but can't

2018-06-13 Thread Dimitri Maziuk via Bacula-users

On 6/13/2018 5:59 AM, Josh Fisher wrote:


I suggest moving the catalog to postgres on SSD storage, while you're at it.


Mine's on spinning rust and it still works OK given enough RAM.

I think another issue here is the expectations: we ran a one-CPU 
(relatively) low-RAM test server for a while and saw that in testing. So 
when we started using bacula in production we already knew restores 
could take a while.


(And ditch mysql: allegedly it can be tuned up for tolerable 
performance, but why bother when there's postgres.)


Dima

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Trying to restore, but can't

2018-06-12 Thread Dimitri Maziuk via Bacula-users
On 06/12/2018 11:35 AM, Ryan Butler wrote:

> We're on version 7.0.5, which I know is old, and I have plans to update it 
> after this disaster.
> 
> Here's the details on that particular Job:
> 
> JobFiles: 2,927,789

Version has nothing to do with it. There are several SQL joins involved
in getting from job to file, plus as Phil said: through all incrementals
to the last full. You simply need a database and hardware that can do
that on 3M files in a tolerable timeframe.

My production machines have 16-24 cores and 64-256GB RAM. And postgres.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula h/w write fails, but tar writes w/out error?

2018-06-09 Thread Dimitri Maziuk via Bacula-users

On 6/9/2018 7:36 AM, Josh Fisher wrote:


... The 
shear volume of media for large sites makes LTO cheaper and D2D2T makes 
more sense.


I think it depends on your definition of "sheer" as well as site's 
retention policies.


Tapes are only cheaper to archive, as in write once and put on the shelf 
forever. If you try re-using them they tend to go bad fast.


A 36-bay chassis filled with seagate "archive" drives can keep quite a 
bit of data, and with a single filesystem on it, bacula will run pretty 
much unattended. And SuperMicro chassis go up to 90 3.5" hot-swap bays.


So if you only need to keep a limited number of backup cycles, it's only 
a matter of time before a box like that becomes cheaper than tape 
monkey's salary and replacement tapes.


Dima

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula h/w write fails, but tar writes w/out error?

2018-06-08 Thread Dimitri Maziuk via Bacula-users
On 06/08/2018 01:26 PM, Phil Stracchino wrote:
> 
> I have to declare I'm getting awful tired of replacing my tape drive
> every few years, and I'm looking forward to being able to replace it
> with some kind of cartridge SSD.

Just get a "hot swap" enclosure and use non-cartridge HDDs. Bacula sucks
at it but tapes suck harder.

-- 
Dimitri Maziuk
Programmer/sysadmin
BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu



signature.asc
Description: OpenPGP digital signature
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users