Bump,

Anybody have an idea of using keys in the Bacula Cloud bucket name?

Levi Wilbert
HPC & Linux Systems Administrator
ARCC - Division of Research and Economic Development
Information Technology Ctr 226
1000 E. University Avenue, Laramie, WY 82071-200




________________________________
From: Levi Wilbert <lwilb...@uwyo.edu>
Sent: Thursday, December 21, 2023 5:06 PM
To: bacula-users@lists.sourceforge.net <bacula-users@lists.sourceforge.net>
Subject: [Bacula-users] Bacula S3 Cloud Folders?


◆ This message was sent from a non-UWYO address. Please exercise caution when 
clicking links or opening attachments from external sources.

I'm using Bacula 13.0.3 w/ the libs3 driver. I have it working well, uploading 
backups to a bucket on Ceph storage.

However, when Bacula uploads the backups from the local cache ("archive 
directory") to Ceph, it uploads the volume w/ the part files inside directly in 
the root of the bucket.

For example, say I have a backup I've just taken which is stored locally in the 
cache in /backups/HOST001, which corresponds to this host's volume. In this 
folder, I then have several cloud part files, "part.1", "part.2", "part.3", etc.

When Bacula uploads this particular backup to the cloud, it puts them directly 
into <my-bucket>:/HOST001.

Is there any way to specify an object prefix when uploading to the Cloud? So in 
that way, I could do something like:
<my-bucket>:/HOST_BACKUPS/HOST001/part.[1-n]

In the device definition, the "archive device" only specifies the local folder 
to use as a cache, which doesn't impact where the backups go on the cloud.

I've tried specifying the prefix w/ the bucket name in the Cloud object 
definition, like so:
Cloud {
  Name = CEPH
  Driver = "S3"
  Host Name = "CEPH.MYDOMAIN.COM"
  Bucket Name = "<my-bucket>/<prefix>"
  <...>
}

...but this leads to the SD crashing after the director connects to it:
21-Dec 17:01 bacula-dev-dir JobId 359: Sending Accurate information to the FD.
21-Dec 17:01 bacula-dev-fd JobId 359: Error: openssl.c:81 TLS read/write 
failure.: ERR=error:0A000126:SSL routines::unexpected eof while reading
21-Dec 17:01 bacula-dev-fd JobId 359: Fatal error: job.c:3492 Comm error with 
SD. bad response to Append Data. ERR=Bad file descriptor

I really don't want to use a separate bucket for each and every host I backup, 
but I would like to keep the host volumes organized in Ceph.

Anyone know how to accomplish this?



Levi Wilbert
HPC & Linux Systems Administrator
ARCC - Division of Research and Economic Development
Information Technology Ctr 226
1000 E. University Avenue, Laramie, WY 82071-200



_______________________________________________
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Reply via email to