Re: [Bacula-users] Syslog errors

2019-09-25 Thread Chris Wilkinson
Yes i think that is most likely the reason. The IP in question is a machine
that runs a network monitor. I wasn't aware that it was sending packets to
the Bacula ports and see no reason why it should since it isn't a port
scanner. It just pings and checks a webserver on port 80 is up.

However, I'll turn it off and see if the errors stop.

Thanks to all for those pointers.

Regards
Chris Wilkinson

On Wed, 25 Sep 2019, 10:22 p.m. David Brodbeck, 
wrote:

>
>
> On Wed, Sep 25, 2019 at 1:37 AM Radosław Korzeniewski <
> rados...@korzeniewski.net> wrote:
>
>> Hello,
>>
>> pon., 23 wrz 2019 o 12:26 Chris Wilkinson 
>> napisał(a):
>>
>>>
>>> Sep 22 10:11:12 HOMESERVER bacula-fd: job.c:508 FD expecting Hello got bad 
>>> command from 192.168.1.30. Len=0.
>>>
>>> Something/someone at 192.168.1.30 is connecting to your (I see all your
>> Bacula Components) server and is trying to chat with Bacula but is not
>> using a bacula network protocol. So the errors.
>>
>> You have to verify what/who it is and disable it.
>>
>
> If you're using a network monitoring system, like Observium or Big
> Brother, that's a likely culprit.
>
> --
> David Brodbeck
> System Administrator, Department of Mathematics
> University of California, Santa Barbara
>
> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users
>
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Syslog errors

2019-09-25 Thread David Brodbeck
On Wed, Sep 25, 2019 at 1:37 AM Radosław Korzeniewski <
rados...@korzeniewski.net> wrote:

> Hello,
>
> pon., 23 wrz 2019 o 12:26 Chris Wilkinson 
> napisał(a):
>
>>
>> Sep 22 10:11:12 HOMESERVER bacula-fd: job.c:508 FD expecting Hello got bad 
>> command from 192.168.1.30. Len=0.
>>
>> Something/someone at 192.168.1.30 is connecting to your (I see all your
> Bacula Components) server and is trying to chat with Bacula but is not
> using a bacula network protocol. So the errors.
>
> You have to verify what/who it is and disable it.
>

If you're using a network monitoring system, like Observium or Big Brother,
that's a likely culprit.

-- 
David Brodbeck
System Administrator, Department of Mathematics
University of California, Santa Barbara
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Andrea Venturoli

On 2019-09-25 18:42, David Brodbeck wrote:
I'm not sure how Max Full Interval solves the problem. I have used it 
(before we switched to virtual full) but it doesn't really pertain to 
resource contention. Maybe I didn't explain the problem very well.


I agree.
I'm *also* using Max Full Interval & co, but I fail to see how this 
relates to the problem we are discussing.


Could you elaborate on this?





It's a minor issue, so I'm not too concerned about it.


Yes: as I said it's not a big problem, just an annoyance.
*Not* solving the resource contention problem, but just avoiding to nag 
about it would probably be enough (at least to me).




 bye & Thanks
av.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Problem for Restore after bscan

2019-09-25 Thread Jose Alberto
Hi.

I have Bacula 9 on Debian with Postgres.

The problem, for error, the sysadmin delete (prune and purge), 6 job
(example jobid  10,20,30,40,50 and 60) but have jobid 70 (no delete)   on
volumen. (lto5).

The jobid 70restore all fine.

For solve:  i delete volume on pool,after  exe bscan  volumen.


I view now  the jobs  with other numbers ID.

but but but but.   Restore good is number 100 (before 70).But the
restore 101,102,104,104,105,106) (before 10,20,30,40,50,60).no run.

Ready to read from volume,   It stays there in an endless cycle.

After having removed the volume and running bscan, should anything else be
done?

Thanks

PD: bextrack  all fine.












-- 
#
#   Sistema Operativo: Debian  #
#Caracas, Venezuela  #
#
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] labeling error

2019-09-25 Thread Radosław Korzeniewski
Hello,

śr., 25 wrz 2019 o 10:15 Adam Weremczuk 
napisał(a):

> Yes, brand new tapes.
> Same error for all four I've added.
> I've already written to and read from one of them and everything appears
> to be fine.
>
What Bacula version are you using?

The problem is outside Bacula generally. The brand new tapes which are
never written cannot be read, so a drive reports I/O Error on this
operation. This error is then reported to user by Bacula during label.
You can avoid this kind of errors by writing a single block to tape or just
mark the start of the tape with eod.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread David Brodbeck
I'm not sure how Max Full Interval solves the problem. I have used it
(before we switched to virtual full) but it doesn't really pertain to
resource contention. Maybe I didn't explain the problem very well.

At any rate, I understand the fundamental problem here is I'm trying to use
software originally written to back up always-online servers to back up
workstations. It's a minor issue, so I'm not too concerned about it.

On Wed, Sep 25, 2019 at 8:32 AM Kern Sibbald  wrote:

> Hello,
>
> Bacula was not designed to handle the case you are describing where you
> have multiple clients that are offline.  This was not really a design
> decision, but rather a design limitation because when the code was
> implemented there was no restart functionality.
>
> A possible way to fix the problem would be to use Max Full Interval and
> Max Diff Interval ...
>
> Best regards,
> Kern
>
> On 9/21/19 12:19 AM, David Brodbeck wrote:
>
>
>
> On Thu, Sep 19, 2019 at 6:33 AM Kern Sibbald  wrote:
>
>> Hello,
>>
>> I concur with David.  When these jobs are scheduled, Bacula will attempt
>> to acauire the needed Storage resources.  When the resources are busy the
>> job waits, and after a certain time, Bacula will inform you that the
>> resources are not available.
>>
>> These messages generally occur when you over commit the SD resources.  If
>> you are using disk, increasing the maximum simultaneous jobs in the Device
>> resource and restarting the SD will generally solve the problem, but you
>> might also have to assign more Storage devices depending on what you are
>> doing.
>>
>
> I think this is a somewhat unfortunate design decision, to be honest. I
> back up a fairly large number of workstations, and on any given night a
> certain number of them will be off or otherwise unavailable. I have these
> jobs set to reschedule on failure so that they run when the workstation
> eventually gets switched on.
>
> The problem is, with the behavior you mention, I can't accurately control
> how many simultaneous *running* jobs are using storage. If I set the max to
> the number of jobs that I actually want to be able to use storage
> simultaneously, I end up with some jobs that could otherwise run waiting
> for resources because those resources are committed to a job that's
> retrying a workstation that may or may not appear. If I compensate by
> setting the max higher, I risk overcommitting my storage bandwidth on
> nights when all the workstations *are* available.
>
> --
> David Brodbeck
> System Administrator, Department of Mathematics
> University of California, Santa Barbara
>
>
>

-- 
David Brodbeck
System Administrator, Department of Mathematics
University of California, Santa Barbara
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Kern Sibbald

  
  
Hello,

Bacula was not designed to handle the case you are describing where
you have multiple clients that are offline.  This was not really a
design decision, but rather a design limitation because when the
code was implemented there was no restart functionality. 

A possible way to fix the problem would be to use Max Full Interval
and Max Diff Interval ...

Best regards,
Kern

On 9/21/19 12:19 AM, David Brodbeck
  wrote:


  
  




  On Thu, Sep 19, 2019 at 6:33
AM Kern Sibbald  wrote:
  
  

  Hello,
  
  
  I
concur with David.  When these jobs are scheduled,
Bacula will attempt to acauire the needed Storage
resources.  When the resources are busy the job waits,
and after a certain time, Bacula will inform you that
the resources are not available.
  
  
  These
messages generally occur when you over commit the SD
resources.  If you are using disk, increasing the
maximum simultaneous jobs in the Device resource and
restarting the SD will generally solve the problem, but
you might also have to assign more Storage devices
depending on what you are doing.

  
  
  
  I think this is a somewhat unfortunate design decision,
to be honest. I back up a fairly large number of
workstations, and on any given night a certain number of
them will be off or otherwise unavailable. I have these jobs
set to reschedule on failure so that they run when the
workstation eventually gets switched on.
  
  
  The problem is, with the behavior you mention, I can't
accurately control how many simultaneous *running* jobs are
using storage. If I set the max to the number of jobs that I
actually want to be able to use storage simultaneously, I
end up with some jobs that could otherwise run waiting for
resources because those resources are committed to a job
that's retrying a workstation that may or may not appear. If
I compensate by setting the max higher, I risk
overcommitting my storage bandwidth on nights when all the
workstations *are* available.
  
  

-- 

  David Brodbeck
System Administrator, Department of Mathematics
  University of California, Santa Barbara
  
  

  

  


  


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Storage Group with multiple disks

2019-09-25 Thread Kern Sibbald

  
  
Hello,

It sounds like you need to learn how Bacula uses the Media Type
directive.  By defining different Media Types for different devices,
you ensure that Bacula can find the right device.  In general every
device that has a different device location (different i-scsi or a
different path to the device location) should have a different Media
Type.  That way, the Director will know what device to use for
Volumes it needs to read.

Best regards,
Kern

On 9/24/19 8:12 AM, Shaligram Bhagat,
  Yateen (Nokia - IN/Bangalore) wrote:


  
  
  
  
Hi All,
 
I am a newbie to Bacula.
 
We are piloting Bacula v
9.4.4 for my project and intend to use the VirtualFull
backup scheme.
 
We have 20 number of
 i-scsi disks  (disk1 through disk20) on Bacula SD server.

We have defined a
storage group StorageGroup consolidating the abovementioned
disks defined as 20 Devices, each Device configured to refer
to each of the scsi disk.
e.g. Device1 à disk1, Device2
  à disk2 ..and so on.
 
Things went fine with
the initial full backups of various clients simultaneously.
Bacula  picked up the next available device and created
volumes under the selected Device’s disk.
Then we took incremental
backups. Again Bacula wrote the incremental volumes on the
selected Device’s disk.
 
However when we tried to
do a VirtualFull job, Bacula again tried to use the next
available drive, lets say Device1(disk1) and tried to read
the constituent volumes (previous full + incremental )
However the constituent
 volumes had been created through a different Device, lets
say disk7. So Bacula reported that the candidate volume is
not found under the current job’s Device (disk1).
 
Question is : In case of
VirtualFull job;  how to tell Bacula to locate/read the
constituent volumes through the Device (disk) where they
were originally created.
 
Thanks in advance,
 
Yateen Bhagat
 

 
 
 
  
  
  
  
  
  ___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



  


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Josh Fisher

On 9/25/2019 4:50 AM, Andrea Venturoli wrote:

On 2019-09-25 10:19, Radosław Korzeniewski wrote:

Hello,

sob., 21 wrz 2019 o 00:52 David Brodbeck > napisał(a):


    I think this is a somewhat unfortunate design decision, to be
    honest. (...)


So what should be the best design in this case which should solve the 
problem?


I'm not so into the code to tell for sure.
Maybe rescheduling should release the SD once the job first fails and 
reserve again when it starts the next time?



I've always thought that these device and/or volume contention issues 
could be resolved by selecting both device and volume in an atomic 
manner. Currently, the write device is selected once per job, then 
separately, volumes are selected as needed. My thought is to select both 
device and volume as a pair each time that a volume is needed. (The 
device-volume pair selection would need to be atomic to prevent a race 
condition.) This place the focus on the volume, rather than the device 
it happens to be on. This would seem to be less efficient, since every 
volume selection would also require a device selection, but keep in mind 
that device and volume selection do not happen that often, even with 
large installations, and are a small part of the overall job time.




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] external storage

2019-09-25 Thread Heitor Faria
> Hi,

Dear Marting,
 
> Complete newbie - what I'm trying to do.
> 
> I am running bacula off a Raspberry Pi device. My thought is to use it
> as a backup server for the computers on my home network and backing up
> stuff to an external NAS.
> 
> Can I add the NAS as an external device using the IP-address?
> Is Bacula a suitable tool for this?
> Can someone point me to documentation that describes how to set this up?

You will have to use Linux iscsi tools to mount the disks in the Raspberry and 
give bacula user rw permission. E.g.: 
http://www.bacula.lat/how-to-mount-iscsi-nas-storages-to-bacula-sd/?lang=en
You should be able to find specific iscsi guides for your OS. 

> //Martin S

Regards,

> ___
> Bacula-users mailing list
> Bacula-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/bacula-users

-- 
MSc Heitor Faria 
CEO Bacula LATAM 
mobile1: + 1 909 655-8971 
mobile2: + 55 61 98268-4220 
[ https://www.linkedin.com/in/msc-heitor-faria-5ba51b3 ] 
[ http://www.bacula.com.br/ ] 

América Latina 
[ http://bacula.lat/ | bacula.lat ] | [ http://www.bacula.com.br/ | 
bacula.com.br ]


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Gary R. Schmidt

On 25/09/2019 18:19, Radosław Korzeniewski wrote:

Hello,

sob., 21 wrz 2019 o 00:52 David Brodbeck > napisał(a):


I think this is a somewhat unfortunate design decision, to be
honest. (...)


So what should be the best design in this case which should solve the 
problem?



The standard exponential back-off sort of thing springs to mind...

Cheers,
GaryB-)


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Andrea Venturoli

On 2019-09-25 10:19, Radosław Korzeniewski wrote:

Hello,

sob., 21 wrz 2019 o 00:52 David Brodbeck > napisał(a):


I think this is a somewhat unfortunate design decision, to be
honest. (...)


So what should be the best design in this case which should solve the 
problem?


I'm not so into the code to tell for sure.
Maybe rescheduling should release the SD once the job first fails and 
reserve again when it starts the next time?


 bye & Thanks
av.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] labeling error

2019-09-25 Thread Radosław Korzeniewski
Hello,

pt., 20 wrz 2019 o 10:46 Adam Weremczuk 
napisał(a):

> Hi all,
>
> bconsole
> *label
> Automatically selected Storage: bacula_sd_lto
> Enter new Volume name: LTO-W20190920A
> Defined Pools:
>  1: lto_specials_pool
>  2: lto_test_pool
>  3: lto_weekly_pool
>  4: lto_monthly_pool
>  5: lto_archive_pool
> Select the Pool (1-5): 3
> Connecting to Storage daemon bacula_sd_lto at bacula:9103 ...
> Sending label command for Volume "LTO-W20190920A" Slot 0 ...
> *block.c:1001 Read error on fd=5 at file:blk 0:0 on device "Quantum LTO-4
> HH" (/dev/nst0). ERR=Input/output error.*
> 3000 OK label. VolBytes=64512 DVD=0 Volume="LTO-W20190920A"
> Device="Quantum LTO-4 HH" (/dev/nst0)
> Catalog record for Volume "LTO-W20190920A", Slot 0  successfully created.
> Requesting to mount Quantum LTO-4 HH ...
> 3001 Mounted Volume: LTO-W20190920A
> 3001 Device ""Quantum LTO-4 HH" (/dev/nst0)" is mounted with Volume
> "LTO-W20190920A"
>
> I haven't done much labeling but can't recall seeing this error before.
>
> Can it be safely ignored?
>
Did you use a fresh and never written tapes? If yes then you can ignore it.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Syslog errors

2019-09-25 Thread Radosław Korzeniewski
Hello,

pon., 23 wrz 2019 o 12:26 Chris Wilkinson 
napisał(a):

> I'm seeing a series of errors in the syslog.
>
>
> Debian 9, Bacula v9.2.2
>
>
> Dir/sd/fd are all on the same server with storage on a local NAS.
>
>
> A recent syslog sample is below though they go way back and I hadn't noticed.
>
>
> Backups are running normally without errors.
>
>
> What would some things be to check the origin of these errors?
>
> 
>
> Sep 22 10:11:12 HOMESERVER bacula-fd: job.c:508 FD expecting Hello got bad 
> command from 192.168.1.30. Len=0.
>
> Something/someone at 192.168.1.30 is connecting to your (I see all your
Bacula Components) server and is trying to chat with Bacula but is not
using a bacula network protocol. So the errors.

You have to verify what/who it is and disable it.

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] external storage

2019-09-25 Thread Martin S
Hi,

Complete newbie - what I'm trying to do.

I am running bacula off a Raspberry Pi device. My thought is to use it
as a backup server for the computers on my home network and backing up
stuff to an external NAS.

Can I add the NAS as an external device using the IP-address?
Is Bacula a suitable tool for this?
Can someone point me to documentation that describes how to set this up?

//Martin S


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] False "Intervention needed" flood

2019-09-25 Thread Radosław Korzeniewski
Hello,

sob., 21 wrz 2019 o 00:52 David Brodbeck 
napisał(a):

> I think this is a somewhat unfortunate design decision, to be honest. (...)
>

So what should be the best design in this case which should solve the
problem?

best regards
-- 
Radosław Korzeniewski
rados...@korzeniewski.net
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] labeling error

2019-09-25 Thread Adam Weremczuk

Yes, brand new tapes.
Same error for all four I've added.
I've already written to and read from one of them and everything appears 
to be fine.



On 25/09/19 09:12, Radosław Korzeniewski wrote:

Hello,

pt., 20 wrz 2019 o 10:46 Adam Weremczuk > napisał(a):


Hi all,

bconsole
*label
Automatically selected Storage: bacula_sd_lto
Enter new Volume name: LTO-W20190920A
Defined Pools:
 1: lto_specials_pool
 2: lto_test_pool
 3: lto_weekly_pool
 4: lto_monthly_pool
 5: lto_archive_pool
Select the Pool (1-5): 3
Connecting to Storage daemon bacula_sd_lto at bacula:9103 ...
Sending label command for Volume "LTO-W20190920A" Slot 0 ...
*block.c:1001 Read error on fd=5 at file:blk 0:0 on device
"Quantum LTO-4 HH" (/dev/nst0). ERR=Input/output error.*
3000 OK label. VolBytes=64512 DVD=0 Volume="LTO-W20190920A"
Device="Quantum LTO-4 HH" (/dev/nst0)
Catalog record for Volume "LTO-W20190920A", Slot 0 successfully
created.
Requesting to mount Quantum LTO-4 HH ...
3001 Mounted Volume: LTO-W20190920A
3001 Device ""Quantum LTO-4 HH" (/dev/nst0)" is mounted with
Volume "LTO-W20190920A"

I haven't done much labeling but can't recall seeing this error
before.

Can it be safely ignored?

Did you use a fresh and never written tapes? If yes then you can 
ignore it.


best regards
--
Radosław Korzeniewski
rados...@korzeniewski.net 


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users