Re: [Bacula-users] Data spooling failing with Permission Denied

2020-06-18 Thread Ryan Sizemore
Hi Martin,

Thank you very much. That was the issue.

Regards,

Ryan

On Thu, Jun 18, 2020 at 5:37 AM Martin Simmons  wrote:

> > On Wed, 17 Jun 2020 20:35:41 -0700, Ryan Sizemore said:
> >
> > The spool directory is owned by bacula (and permissioned to allow write
> by
> > all for troubleshooting):
> >
> > root@pacific:/etc/bacula# ls -lsa /scratch/
> > total 28
> >  4 drw---  4 bacula bacula  4096 Jun 18 01:55 .
> >  4 drwxr-xr-x 26 root   root4096 Jun 18 01:55 ..
> > 16 drwx--  2 root   root   16384 Jun 17 19:45 lost+found
> >  4 drwxrwxrwx  2 bacula bacula  4096 Jun 18 03:03 spool
>
> The contents of /scratch is not accessible to the bacula user (the x
> permission is missing).
>
> __Martin
>


-- 
Ryan Sizemore
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Data spooling failing with Permission Denied

2020-06-18 Thread Pierre Bernhardt
Am 18.06.20 um 05:35 schrieb Ryan Sizemore:
> Device {
>   Name = LTO-4
>   Media Type = LTO-4
>   Archive Device = /dev/nst0
>   AutomaticMount = yes;
>   AlwaysOpen = yes;
>   RemovableMedia = yes;
>   RandomAccess = no;
>   Maximum File Size = 10GB
>   AutoChanger = yes
>   Maximum Spool Size = 1000GB
>   Spool Directory = "/scratch/spool"
> }
> 
> Here are the JobDefs and Job from the director:
> 
> JobDefs {
>   Name = "DefaultJob"
>   Type = Backup
>   Level = Incremental
>   Client = pacific-fd
>   FileSet = "Full Set"
>   Schedule = "WeeklyCycle"
>   Storage = File1
>   Messages = Standard
>   Pool = File
>   SpoolAttributes = yes
>   Priority = 10
>   Write Bootstrap = "/var/lib/bacula/%c.bsr"
> }
> 
> Job {
>   Name = "SynologyTest"
>   JobDefs = "DefaultJob"
>   FileSet = "SynologyTestFileSet"
>   Storage = LTO-4
>   Pool = TapePool
>   SpoolData = yes
> }
Be aware that /scratch will not be backup if spooling is enabled
which should be excluded in the SynologyTestFileSet configuration
if the backup server will be backup itself with this job.

Cheers,



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Data spooling failing with Permission Denied

2020-06-18 Thread Pierre Bernhardt
> root@pacific:/etc/bacula# ls -lsa /scratch/
> total 28
>  4 drw---  4 bacula bacula  4096 Jun 18 01:55 .
>  4 drwxr-xr-x 26 root   root4096 Jun 18 01:55 ..
> 16 drwx--  2 root   root   16384 Jun 17 19:45 lost+found
>  4 drwxrwxrwx  2 bacula bacula  4096 Jun 18 03:03 spool
> 
Maybe the bacula-sd process it running with tape-group rights.
It could be also helpfull to change the group right to tape
and set rwx also für the group right.

Cheers,




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Data spooling failing with Permission Denied

2020-06-18 Thread Martin Simmons
> On Wed, 17 Jun 2020 20:35:41 -0700, Ryan Sizemore said:
> 
> The spool directory is owned by bacula (and permissioned to allow write by
> all for troubleshooting):
> 
> root@pacific:/etc/bacula# ls -lsa /scratch/
> total 28
>  4 drw---  4 bacula bacula  4096 Jun 18 01:55 .
>  4 drwxr-xr-x 26 root   root4096 Jun 18 01:55 ..
> 16 drwx--  2 root   root   16384 Jun 17 19:45 lost+found
>  4 drwxrwxrwx  2 bacula bacula  4096 Jun 18 03:03 spool

The contents of /scratch is not accessible to the bacula user (the x
permission is missing).

__Martin


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Data spooling failing with Permission Denied

2020-06-18 Thread Josh Fisher


On 6/17/2020 11:35 PM, Ryan Sizemore wrote:

Hi,

I have a Job that I want to use data spooling with. The Job reads from 
a locally-mounted NFS share, and writes to an LTO-4 tape. Since 
writing to tape will be faster than reading over the network, I want 
to spool the data locally. However, when I run the job, it terminates 
with an error that it cannot write to the spool directory.


Here is a message log from a job run that fails:

18-Jun 03:18 pacific-dir JobId 32: Start Backup JobId 32, 
Job=SynologyTest.2020-06-18_03.18.31_03

18-Jun 03:18 pacific-dir JobId 32: Using Device "LTO-4" to write.
18-Jun 03:18 pacific-sd JobId 32: No slot defined in catalog (slot=0) 
for Volume "Vol-A-0001" on "LTO-4" (/dev/nst0).
18-Jun 03:18 pacific-sd JobId 32: Cartridge change or "update slots" 
may be required.
18-Jun 03:18 pacific-sd JobId 32: Volume "Vol-A-0001" previously 
written, moving to end of data.
18-Jun 03:18 pacific-sd JobId 32: Ready to append to end of Volume 
"Vol-A-0001" at file=2.
18-Jun 03:18 pacific-sd JobId 32: Fatal error: Open data spool file 
/scratch/spool/pacific-sd.data.32.SynologyTest.2020-06-18_03.18.31_03.LTO-4.spool 
failed: ERR=Permission denied



The user:group that pacific-sd runs as does not have write permission on 
/scratch/spool. This could be Unix permissions or SELinux permissions.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Data spooling failing with Permission Denied

2020-06-17 Thread Ryan Sizemore
Hi,

I have a Job that I want to use data spooling with. The Job reads from a
locally-mounted NFS share, and writes to an LTO-4 tape. Since writing to
tape will be faster than reading over the network, I want to spool the data
locally. However, when I run the job, it terminates with an error that it
cannot write to the spool directory.

Here is a message log from a job run that fails:

18-Jun 03:18 pacific-dir JobId 32: Start Backup JobId 32,
Job=SynologyTest.2020-06-18_03.18.31_03
18-Jun 03:18 pacific-dir JobId 32: Using Device "LTO-4" to write.
18-Jun 03:18 pacific-sd JobId 32: No slot defined in catalog (slot=0) for
Volume "Vol-A-0001" on "LTO-4" (/dev/nst0).
18-Jun 03:18 pacific-sd JobId 32: Cartridge change or "update slots" may be
required.
18-Jun 03:18 pacific-sd JobId 32: Volume "Vol-A-0001" previously written,
moving to end of data.
18-Jun 03:18 pacific-sd JobId 32: Ready to append to end of Volume
"Vol-A-0001" at file=2.
18-Jun 03:18 pacific-sd JobId 32: Fatal error: Open data spool file
/scratch/spool/pacific-sd.data.32.SynologyTest.2020-06-18_03.18.31_03.LTO-4.spool
failed: ERR=Permission denied
18-Jun 03:18 pacific-sd JobId 32: Fatal error: append.c:124 Write session
label failed. ERR=
18-Jun 03:18 pacific-sd JobId 32: Elapsed time=00:00:01, Transfer rate=0
 Bytes/second
18-Jun 03:18 pacific-fd JobId 32: Error: bsock.c:649 Write error sending
137 bytes to Storage daemon:127.0.0.1:9103: ERR=Broken pipe
18-Jun 03:18 pacific-fd JobId 32: Fatal error: backup.c:1028 Network send
error to SD. ERR=Broken pipe
18-Jun 03:18 pacific-fd JobId 32: Error: bsock.c:537 Socket has errors=1 on
call to Storage daemon:127.0.0.1:9103
18-Jun 03:18 pacific-fd JobId 32: Error: bsock.c:537 Socket has errors=1 on
call to Storage daemon:127.0.0.1:9103
18-Jun 03:18 pacific-dir JobId 32: Error: Bacula pacific-dir 9.0.6
(20Nov17):
  Build OS:   x86_64-pc-linux-gnu ubuntu 18.04
  JobId:  32
  Job:SynologyTest.2020-06-18_03.18.31_03
  Backup Level:   Incremental, since=2020-06-18 02:08:02
  Client: "pacific-fd" 9.0.6 (20Nov17)
x86_64-pc-linux-gnu,ubuntu,18.04
  FileSet:"SynologyTestFileSet" 2020-06-17 23:05:00
  Pool:   "TapePool" (From Job resource)
  Catalog:"MyCatalog" (From Client resource)
  Storage:"LTO-4" (From Job resource)
  Scheduled time: 18-Jun-2020 03:18:29
  Start time: 18-Jun-2020 03:18:33
  End time:   18-Jun-2020 03:18:51
  Elapsed time:   18 secs
  Priority:   10
  FD Files Written:   1
  SD Files Written:   0
  FD Bytes Written:   0 (0 B)
  SD Bytes Written:   0 (0 B)
  Rate:   0.0 KB/s
  Software Compression:   None
  Comm Line Compression:  None
  Snapshot/VSS:   no
  Encryption: no
  Accurate:   no
  Volume name(s):
  Volume Session Id:  1
  Volume Session Time:1592450219
  Last Volume Bytes:  391,523,328 (391.5 MB)
  Non-fatal FD errors:3
  SD Errors:  1
  FD termination status:  Error
  SD termination status:  Error
  Termination:*** Backup Error ***

Here is the device configuration from bacula-sd.conf:

Device {
  Name = LTO-4
  Media Type = LTO-4
  Archive Device = /dev/nst0
  AutomaticMount = yes;
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
  Maximum File Size = 10GB
  AutoChanger = yes
  Maximum Spool Size = 1000GB
  Spool Directory = "/scratch/spool"
}

Here are the JobDefs and Job from the director:

JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Client = pacific-fd
  FileSet = "Full Set"
  Schedule = "WeeklyCycle"
  Storage = File1
  Messages = Standard
  Pool = File
  SpoolAttributes = yes
  Priority = 10
  Write Bootstrap = "/var/lib/bacula/%c.bsr"
}

Job {
  Name = "SynologyTest"
  JobDefs = "DefaultJob"
  FileSet = "SynologyTestFileSet"
  Storage = LTO-4
  Pool = TapePool
  SpoolData = yes
}

The spool directory is configured to use /scratch/spool and /spool is a
RAID0 array. The array is mounted as read-write:

root@pacific:/etc/bacula# mount | grep scratch
/dev/md127p1 on /scratch type ext4 (rw,relatime,stripe=384,data=ordered)

The spool directory is owned by bacula (and permissioned to allow write by
all for troubleshooting):

root@pacific:/etc/bacula# ls -lsa /scratch/
total 28
 4 drw---  4 bacula bacula  4096 Jun 18 01:55 .
 4 drwxr-xr-x 26 root   root4096 Jun 18 01:55 ..
16 drwx--  2 root   root   16384 Jun 17 19:45 lost+found
 4 drwxrwxrwx  2 bacula bacula  4096 Jun 18 03:03 spool

Can someone point out where I am going wrong here? Perhaps this isn't
actually a permission problem?

If I disable the spool directory, the job does complete successfully.

Thanks,

-- 
Ryan Sizemore
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net