[Bacula-users] Backup restore missing a directory

[William Muriithi]

Hello,

I have attempted a restore and I can get all files and directories with 
exception of one folder.

This is on Windows server 2016  (bacula client - 9.0.8 (28May18) Microsoft 
Standard Edition (build 9200)) and it is running as local system.

The storage and director are on 9.0.6 on Centos 8

Question, what would cause an issue where bacula selectively ignore one 
directory?

Regards,
William
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Volume (Tapes) go Read-only on mounting

[William Muriithi]

Hello

I have a problem where the tapes I have loaded are going to Read-Only every 
time I have loaded it.

|2*| 04L6 | Read-Only | LTO-6   | windows_regular   
 |

The tapes were already marked ("Recycle |Purged") available for backup when I 
originally loaded them:

william@bacula ~]$ echo 'list media' | bconsole | grep 04L6
| 137 | 04L6   | Read-Only |   1 | 1 |0 |   
 5,184,000 |   1 |0 | 1 | LTO-6 |   2 |0 | 
2022-03-12 13:47:55 |

When I enable debug logging, I see this error:

18-Jun 13:07 eng-backup02-sd JobId 47726: Warning: mount.c:215 Open of Tape 
device "ULTRIUM-HH6" (/dev/nst0) Volume "15L6" failed: ERR=tape_dev.c:170 
Unable to open device "ULTRI
UM-HH6" (/dev/nst0): ERR=Read-only file system

This is on all tapes that I have plugged to this system.  This system has 
already been working previously, so configuration is likely correct.  The media 
changer doesn't show any error on the LCD, and mount and dismount tapes fine.

What would be the next step in debugging here?

Regards,
William



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Waiting for a volume already in the drive

[William Muriithi]

Morning,

I think I figured it out.  It looks like the system that was being backed 
disconnected while despooling

Is there a way to avoid the whole bacula hanging if bacula SD server have a 
temporary disconnection ?

Time: 2022-05-24 05:03:10
 LogText: bacula-dir JobId 46250: Using Device "ULTRIUM-HH7" to write.

Time: 2022-05-24 05:03:11
 LogText: eng-backup01-sd JobId 46250: Spooling data ...

Time: 2022-05-24 07:46:51
 LogText: bacula-fd JobId 46250: Error: bsock.c:649 Write error sending 33912 
bytes to Storage daemon:eng-backup01.example.com:9103: ERR=Connection timed out

Time: 2022-05-24 07:46:51
 LogText: bacula-fd JobId 46250: Fatal error: backup.c:843 Network send error 
to SD. ERR=Connection timed out

Time: 2022-05-24 07:47:01
 LogText: bacula-fd JobId 46250: Error: bsock.c:537 Socket has errors=1 on call 
to Storage daemon:eng-backup01.example.com:9103

Time: 2022-05-24 08:00:13
 LogText: bacula-dir JobId 46250: Error: Director's connection to SD for this 
Job was lost.

Time: 2022-05-24 08:00:13


Regards,
William

From: Pierre Bernhardt 
Sent: May 27, 2022 5:18 AM
To: bacula-users@lists.sourceforge.net 
Subject: Re: [Bacula-users] Waiting for a volume already in the drive

CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you recognize the sender and know the content 
is safe.


Hello,

it's looks like an issue which I had from time to time.

I tried to unload the media and reload it. By the way it was really a rare 
situation and I could
not trigger it by planned actions.

Maybe it is a good Idea to check also the status of the tapedrive itself e.g by
tapeinfo -f 

Cheers,
Pierre




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Waiting for a volume already in the drive

[William Muriithi]

Hello,

I have a problem that I don't seem to understand.  Backups stopped because they 
needed a specific tape.  However, the tape is already in the drive.

I can't mount it, since its already in place.  What would trigger bacula into 
this logic?

Device status:
Autochanger "SuperLoader3" with devices:
   "ULTRIUM-HH7" (/dev/nst0)

Device Tape is "ULTRIUM-HH7" (/dev/nst0) waiting for:
Volume:  24L7
Pool:eng_father
Media type:  LTO-6
Total Bytes Read=0 Blocks Read=0 Bytes/block=0
Positioned at File=1 Block=0
   Device is BLOCKED waiting for media.
   Slot 16 is loaded in drive 0.
==


Used Volume status:
Reserved volume: 24L7 on Tape device "ULTRIUM-HH7" (/dev/nst0)
Reader=0 writers=4 reserves=1 volinuse=0


Data spooling: 4 active jobs, 3,422,884,983,811 bytes; 29 total jobs, 
3,422,884,983,811 max bytes/job.
Attr spooling: 4 active jobs, 0 bytes; 29 total jobs, 2,575,911,306 max bytes.

Regards,
William
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] bacula fd cleanup assistance

[William Muriithi]

Hello

This morning, I wanted to clear some running jobs so that I can do a quick 
restore.   After cancelling all the jobs on one of my storage system, one of 
the jobs hang and it I have tried every trick to clear it without success.

Running Jobs:
Writing: Incremental Backup job teamcity01-data-job-e JobId=39337 Volume=""
pool="windows_regular" device="ULTRIUM-HH6" (/dev/nst0)
spooling=0 despooling=1 despool_wait=0
Files=9,592,122 Bytes=4,851,978,768,263 AveBytes/sec=13,040,359 
LastBytes/sec=73,734
FDReadSeqNo=153,264,736 in_msg=126339092 out_msg=6 fd=13



I noticed when I cancelled the tapes went into initialing mode and then 
dismounted.  I didn't trigger dismounting, so this is also odd and sharing in 
case you notice there is no assigned tape in the above job.

>From the director's perspective, this job shouldn't exist.


 39337  Incr9,591,2424.849 T  Cancel   10-Jan-22 11:54 
teamcity01-data-job-e

So why would the director and storage be so disconnected about a job status and 
how can one do to avoid it in future.

Regards,
William


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Backup Error with "SD despooling Attributes"

[William Muriithi]

I believe there is a strong chance your root partitions is getting full during 
the backup.
1,3G is too low, specially if you use the bacula default Catalog backup script 
to generate a dump during the backup.


+1
The partition where bacula director spool directory lives on filling up during 
backup


William
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Doing backup and restore simultaneously on two device setups

[William Muriithi]

Hello

We are using bacula version 9 and we have been happy with it.  We have 2 
quantum superloader 3 we use to offload the data, one for Linux system and the 
other one for Windows systems.  In short, the two storage devices don't have 
any inter-dependency other than they share the same director.

Whenever, we attempt to do any data restore for verification, we find that we 
have to stop backup running from both the storage systems?  For example, if 
cancel all the Windows jobs, and the run a restore job from one of the Windows 
machine to another windows machine, wouldn't  one expect this to execute 
irrespective of the status of the alternate storage subsystem? 

However, that is not what we notice.  The restore job on one superloader end up 
waiting for a backup on the alternate superloader finishing.Is this what is 
expected?  Its nothing to do with concurrent jobs, because if I start a new job 
on the Windows superloader (Storage), it start spooling asap.

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bacula & Multiple Tape Devices

[William Muriithi]

Hello.

I have two QUANTUM media changer and currently, I have been unable to use them 
with bacula concurrently.  I have googled and attempted multiple changes on 
configuration, no luck.  I have also attempted to separate the hardware as much 
as possible to avoid inter-dependency, its not working.

Here is the setup:

Bacula director  runs on server1
Storage 1 on server2 (HBA card  and one of the quantum tape device attached to 
server2)
Storage 2 on server3 (HBA card  and the second  quantum tape device attached to 
server3)

All windows systems are running bacula file server and submitting the backup to 
server3
All Linux systems are also running bacula file server and submitting backup to 
server2

Essentially, minimal dependency between the two storage systems.

I have on director:
Maximum Concurrent Jobs = 5

I have set on clients:
Maximum Concurrent Jobs = 5

On bacula-dir.conf, under storage, for each of above:
Storage {
  Name = QUANTUM(1/1)
  Address = 192.168.20.x   
  SDPort = 9103
  Password = "v"
  Maximum Concurrent Jobs = 3
  Device = ULTRIUM-HH(1/2)
  Media Type = LTO-6
  Autochanger = yes
}


I have set on one storage, server3 (Linux):
Maximum Concurrent Jobs = 3

On the second storage (Windows):
Maximum Concurrent Jobs = 2

The intent of this setup is to make sure that both storage can be processing 
backup concurrently.  I have looked at pools too, as it seem to be common 
search suggestion and there is no configuration that control job concurrency

This is what I observe:
5 jobs are running concurrently, but most of the time, all on one storage 
system.  The other stay idle unless there is less that 5 jobs queued that are 
from Linux, at which point, Windows jobs seem to start getting processed.  
Needless to say, sometimes, I don't run any Windows job

What am I missing here?  How can I for example set 3 jobs maximum on each of 
the two storage for a maximum of 5 concurrent jobs?

>From the comment on this reading, it seem possible, but for the life on me, 
>can't seem to get it working

https://serverfault.com/questions/396970/bacula-multiple-tape-devices-and-so-on

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] LTO-7 btape speed test

[William Muriithi]

Hmm

What is the default block size for bacula 9 ?  I am assuming it's what Kern 
said due to his authority in the project.

Can one change in on a current production system or its something you set on 
initial setup only?

William


From: fk+bacula--- via Bacula-users 
Sent: April 21, 2021 10:20 AM
To: bacula-users@lists.sourceforge.net 
Subject: Re: [Bacula-users] LTO-7 btape speed test


CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you recognize the sender and know the content 
is safe.


Thanks Kern,

I will ask Quantum about the best setting for the Block Size.
The file size I have set to 20 GB at the moment.

Thanks, Frank

Am 21.04.2021 um 12:09 schrieb Kern Sibbald:
>From my experience (up to LTO-5), using 524288 as a block size is a reasonable 
>size.  However LTO-7 drives are even faster, so you might try some tests with 
>Maximum block size = 1048576.  Some people recommend much larger sizes, but in 
>my tests (LTO-5) there is little speed gain with even bigger block sizes, and 
>according to a Quantum technical tape specialist, you might experience more 
>errors.

Also you should set Maximum File Size = 5G or bigger.  This determines how 
often Bacula writes EOF marks, which really slow down writing.  The bigger 
Maximum File Size is the faster (in general) Bacula can stream to tape.  
However, if you set it too big it will take longer to get a single file back.  
Bacula can position quickly to a block boundary but must search within a block 
for any given file.  If you are restoring everything, then Bacula will only 
have to search on the first file to be restored -- all the rest of the files 
will be found sequentially.
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Unable to Edit bacula-fd.conf and bat.conf on Windows 10 Machine

[William Muriithi]

Hi JW

Do you mind opening your editor as administrator?  It should be fine editing 
the config after that.

Regards,
William


From: J W 
Sent: March 3, 2021 9:24 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Unable to Edit bacula-fd.conf and bat.conf on Windows 
10 Machine

CAUTION: This email originated from outside of the organization. Do not click 
links or open attachments unless you recognize the sender and know the content 
is safe.


I installed Bacula 9.44 file director on my Windows 10 machine. Afterwards,  I 
am unable to edit bacula-fd.conf or bat.conf.

I get msgs like, "Access to c:/Program Files/Bacula/bacula-fd.conf was denied.

I can edit bconsole.conf.

I notice the owner of bconsole.conf is Administrators. Owner of the other two 
files is not shown.

I have tried to change owner of those two files without success.

If i uninstall Bacula and reinstall it then I get the same results.

Any suggestions how to fix?

I chose 9.44 because I already have a running 9.44 director and storage device 
and backing up Linux systems.

Thanks.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Problem with autoloader

[William Muriithi]

Hello

I have a problem where bacula seem to be rejecting most of my tapes.  I had 
lapsed using tapes for a couple of months as I was working remote due to covid. 
  Recently, I re-started my tape backups and struggling as some tapes are 
working fine, but others are a pain.

For example, or jobs in the queue need tape 06L6.   I mounted it through 
bacula, it came online, went into initializing, but bacula unmount it and them 
mount tape 000118L6.


That don't work out too and leave bacula in usable state as seen below:

Device status:
Autochanger "SuperLoader3" with devices:
   "ULTRIUM-HH7" (/dev/nst0)

Device Tape is "ULTRIUM-HH7" (/dev/nst0) waiting for:
Volume:  000118L6
Pool:eng_father
Media type:  LTO-6
Total Bytes Read=64,512 Blocks Read=1 Bytes/block=64,512
Positioned at File=0 Block=0
   Device is BLOCKED waiting for mount of volume "06L6",
   Pool:eng_father
   Media type:  LTO-6
   Slot 7 is loaded in drive 0.

What would be the best way to work around this?

Regards,
William

18-Feb 00:07 bacula-dir JobId 137: Using Device "ULTRIUM-HH7" to write.
18-Feb 00:07 eng-backup01-sd JobId 137: Warning: Director wanted Volume 
"06L6".
Current Volume "000118L6" not acceptable because:
1998 Volume "000118L6" catalog status is Purged, not in Pool.
18-Feb 00:07 eng-backup01-sd JobId 137: 3307 Issuing autochanger "unload Volume 
06L6, Slot 7, Drive 0" command.
18-Feb 00:08 eng-backup01-sd JobId 137: 3304 Issuing autochanger "load Volume 
06L6, Slot 7, Drive 0" command.
18-Feb 00:09 eng-backup01-sd JobId 137: 3305 Autochanger "load Volume 06L6, 
Slot 7, Drive 0", status is OK.
18-Feb 00:09 eng-backup01-sd JobId 137: Warning: Director wanted Volume 
"06L6".
Current Volume "000118L6" not acceptable because:
1998 Volume "000118L6" catalog status is Purged, not in Pool.
18-Feb 00:09 eng-backup01-sd JobId 137: 3307 Issuing autochanger "unload Volume 
06L6, Slot 7, Drive 0" command.

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Adding a volume in a library

[William Muriithi]

Hello,

I recently added 5 tapes that were new to the library.   Bacula is configured 
to put expired tapes on Scratch pool, but I couldn't be able to label the tapes 
under that pool, so I labelled it under eng_father.

[william@backup ~]$ echo "list volume" | bconsole | grep 06L6
| 132 | 06L6   | Append|   1 | 64,512 |0 |  
  5,184,000 |   1 |9 | 1 | LTO-6 |   0 |0 | 
NULL| NULL  |
[william@backup ~]$ echo "list volume" | bconsole | less


Everything seems fine, but the system never seem to be able to use the tapes.  
Its stuck in this state.

Device status:
Autochanger "SuperLoader3" with devices:
   "ULTRIUM-HH7" (/dev/nst0)

Device Tape is "ULTRIUM-HH7" (/dev/nst0) waiting for:
Volume:  06L6
Pool:eng_father
Media type:  LTO-6
Total Bytes Read=0 Blocks Read=0 Bytes/block=0
Positioned at File=1 Block=0
   Device is being initialized.
   Slot 9 is loaded in drive 0.
==


Used Volume status:
Reserved volume: 06L6 on Tape device "ULTRIUM-HH7" (/dev/nst0)
Reader=0 writers=3 reserves=25 volinuse=1


What could I be doing wrong here?

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bar code labels suggestion

[William Muriithi]

Hello,

We have 2 dozen tapes that we haven't been using because we don't have extra 
bar code labels.  The odd thing is most places, they wouldn't sell the bar code 
labels if you aren't buying tapes.  This is not ideal, as we obviously already 
have more than enough tapes.

What have you guys done when faced with similar problem?  I googled, and it 
looks like there is sites that can generate this label, but what about the 
media where one have to print?  Does it need to have a specific attribute?

Regards,
William  

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] How does Bacula treat data on a tape from a failed job?

[William Muriithi]

Hello,

I have a single fairly job that failed due to network issue but it had already 
put slightly above a TB into the tape.  It was a full job unfortunately, and 
have set it to do a full job twice a month and differential/incremental in 
between.   When I restarted the job, I see its doing another full backup.

So I got curious, is bacula able to continue from where the job was prior to 
the previous job dying?  I am suspecting no, since data would then be owned by 
two jobs.   So what does happen?There seem to be two options;

- Leave the data in the tape but clean it on the catalog
- Leave it on both the catalog and the tape?

Would be glad if someone have this knowledge and would be willing to share it

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Baculum installation issue.

[William Muriithi]

Erik,

> Is 9.4.4 an older version?

No, very recent version.  Heitor just made a small mistake

/etc/bacula is used by Linux distribution packaged bacula.   /opt/bacula is 
from source or just picked straight from bacula developers.

Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Why would bacula consider duplicate jobs as fatal?

[William Muriithi]

Morning Radosław,


> I think I do miss your point. Why anyone on Earth would like to configure a 
> backup job in such a way that the next job will intentionally run when a 
> previous job did not complete and intentionally setup cancelation of the 
> duplicated job?
> IMVHO if I knew that my backup job is running for i.e. 8H then I'll never 
> schedule next backup job on 4H period and setup a cancellation of the 
> duplicate job because it will cancel every second job by design. It would be 
> insane, right?

That is how I initially set it up.  The problem is, sometimes, the tapes run 
out on weekend or at night and jobs fall behind.  So over time, you end up with 
2 or 3 jobs scheduled to backup the same file.  Instead of restarting to 
cleanup the backlog, I thought rejecting duplicates was less involving.

How do you handle these cases without configuring bacula to avoid duplicates?

> Well, this is a job message which inform you about the cause of the job 
> cancelation, as the job termination status is "cancelled" and not "fatal 
> error". What would you like to change in this message?

Agree, cancelled is fine.  I find fatal a bit excessive.  That name, I would 
only use for things that require intervention, not something configured to 
happen intentionally.  Its just a view point, and understand how hard to code 
against all edge cases.  Thought the feedback is worth it though.

Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] Re: bacula cloud backup

[William Muriithi]

Hi Dima,

>> Also, how do you backup the backup box itself?
> 
> I don't. ;)
> 
> Yes, it you want all your change history in a tape archive in a vault 
> somewhere far away, that would be a problem because snapshots are not visible 
> to your tape backup software. But then you may want to consider putting your 
> stuff on GitHub: it's better at tracking version history than incremental 
> tapes, easier to restore, and might actually cost less than the tapes and the 
> vault and the monkey to cart the tapes there and back.

I really wish you aren't that dismissive.  He had raised a valid gap in your 
risk analysis, and honestly understandable.  The way you respond may make 
someone reading this thread down the line to miss the risk involved, and only 
learn the hard way.  Backup is an exercise of balancing the risk with expenses.

A better way would have been to say, yes, I understand I am exposed if someone 
was to get in my network and delete both the data  and the backup, but I accept 
and plans to live with that risk..

Regards,
William




___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Why would bacula consider duplicate jobs as fatal?

[William Muriithi]

Hello,

Was trying to reduce the number of mails coming from Bacula, and was combing 
through the logs to see what I can filter out.  Currently, almost all noise 
comes from bacula attempting to schedule a job and then realizing the previous 
isn't yet done.  I have configured bacula not to allow duplicates to avoid jobs 
piling up in case I miss replacing tapes when all are full.

Anyway as I was doing so, I noticed that, sometime, bacula do consider 
duplicate fatal?  How would this make sense considering it was intentionally 
configured?  Kind of confused by these instances.  

22-Jan 17:50 bacula-dir JobId 25338: Fatal error: JobId 25266 already running. 
Duplicate job not allowed.

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Disk setup for best performance on backups

[William Muriithi]

Hi

> I'm planning a Bacula deployment on AWS in the following weeks. I have some 
> doubts about disk performance for Disk based backups.
I use tapes, so you should take my response with a grain of salt. Question 
though, how do one protect the backup from being damaged if one is compromised 
and there is no air gap?  If you look at the Riviera Beach for example, they 
did have backup, but ransomware encrypted them too.

> - Does it matter a lot choosing XFS instead of ext4 as filesystem?
Really don't make a big difference what filesystem you choose if your files are 
large.  But if you have too many tinny files, use XFS as it allocate metadata 
space dynamically
> - How can I know the amount of IOPS needed for my local disk?
You need to test, every setup have different IOPS requirements.  But anyway, if 
you want a generic answer, it depends with how many concurrent jobs you are 
willing to run.  And what do you mean by local?  On the bacula storage?   On 
the bacula client? How many bacula clients do you have?  Better define these 
details to get a better answer from the rest of the team.
> - What does Bacula need most: high IOPS or throughput (MB/s)?
Again, depends.  In general, I would say full backups would need throughput and 
differentials/incremental need more IOPS.  But for the storage, I guess IOPS 
irrespective of the type of jobs if you are running too many concurrent jobs?
> - Based on the previous question, should I choose SSD over HDD disks?
Use HDD, SSD are too expensive for backups in my humble opinion
> - Is it worth using RAID1 or RAID10 for improving performance?
Wouldn't make a difference in my opinion, bacula level details would make more 
difference 

>By the way, I pretend to use an external DB (Amazon RDS) for myCatalog, so my 
>Storage daemon wouldn't share the same underlying storage.
If you are using mysql and you have a lot of file, make sure to have a big temp 
space.  During pruning, mysql, does generate a really odd queries that can fill 
up most ramdisks. Use SHOW VARIABLES LIKE 'tmpdir'; to figure what you are 
currently using 

> I hope someone can share some ideas about disk performance.
You really seem intent to optimize your disk performance.  Consider dm-cache 
then.   Petty effective in my experience.

Regards,
William


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

[William Muriithi]

Happy new year,

> First of all, MariaDB is not very recommended for using with Bacula, but you 
> can use for you own risk.

He can't use mysql 8 with the version of bacula he is deploying, so this 
instruction will lead him to other issues

> This error is it looks is caused by SQL_MODE, that I guess is very similar of 
> MySQL errors. Take a look in the link below:
> https://github.com/wanderleihuttel/bacula-utils/blob/master/dicas/mysql_sql-mode.md

Surprised he is still using the default sql_mode.   I had mentioned it will 
never work with this mode back on November.  Using the mode myself.
"sql_mode = NO_ENGINE_SUBSTITUTION"

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

[William Muriithi]

Hi Erwan,

Honestly, your problem has nothing to do with bacula, its purely database 
related.

First, if you insist on using mysql 8, you can't use the version you are using. 
 You need at least Bacula Release 9.4.3.  This is because you will need this 
bug fix.

Change mysql my_bool to bool as it was removed from mysql  - Done on May 2019


Second, the error bacula reported during insert "ERR=Field 'StartTime' doesn't 
have a default value" is because, previously mysql used to allow null dates.  
Current sql_mode don't allow that any more.  Google on sql_mode and dates and 
you should get an idea on what to do that suites Gentoo.

In short, your pains are all caused by mysql and require just mysql skills to 
resolve.

Regards,
William


From: Erwan RIGOLLOT 
Sent: December 23, 2019 9:41 AM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

Hi all,

Anyone can help me ?

Thanks

Erwan

-Message d'origine-
De : Erwan RIGOLLOT 
Envoyé : jeudi 28 novembre 2019 16:18
À : bacula-users@lists.sourceforge.net
Objet : Re: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

Hi William and all,

I have a catalog backup before update.
So I have try this "sql_mode = NO_ENGINE_SUBSTITUTION" because I would like to 
keep version of my distribution (gentoo).
(But if i have to do different, i will do).

The script /usr/libexec/bacula/update_mysql_tables run good:
This script will update a Bacula MySQL database from version 12-15 to 16

Depending on the current version of your catalog, you may have to run this 
script multiple times.

Enter password:
Enter password:
Update of Bacula MySQL tables 15 to 16 succeeded.
Enter password:

So I try to do backup, and doesn't work :
28-nov. 16:13 obiwan-dir JobId 0: Fatal error: sql_create.c:84 Create DB Job 
record INSERT INTO Job 
(Job,Name,Type,Level,JobStatus,SchedTime,JobTDate,ClientId,Comment) VALUES 
('Backup-tardis.2019-11-28_16.13.50_03','Backup-tardis','B','I','C','2019-11-28 
16:13:48',1574954028,5,'') failed. ERR=Field 'StartTime' doesn't have a default 
value

I don't understand because the script update_mysql_tables remove default value 
?!?

Can you help me ?

Thanks and have a good day !



-Message d'origine-
De : William Muriithi  Envoyé : vendredi 22 novembre 
2019 16:41 À : Erwan RIGOLLOT ; 
bacula-users@lists.sourceforge.net
Objet : Re: /usr/libexec/bacula/update_mysql_tables


Hi Erwan,

Hope you had made a catalog backup before schema upgrade.

You can't use bacula 9.0 with mysql 8.   mysql made some change that were only 
fixed in a later bacula version, think bacula 9.2.

So if you have to use mysql 8, please use the latest bacula binaries.  
Alternatively, use Mariadb, which would be my advice as it don't change your 
plans at all.

Also, change the sql mode to match that of earlier versions.  Something like 
this "sql_mode = NO_ENGINE_SUBSTITUTION"

Anyway, all this depends on whether you have a backup.

Regard,
William






From: Erwan RIGOLLOT 

Sent: November 22, 2019 9:50 AM

To: bacula-users@lists.sourceforge.net 

Subject: [Bacula-users] /usr/libexec/bacula/update_mysql_tables




Hello,

I have try to update bacula database after update Mysql (8.0.17) and bacula ( 
9.0.8-r1).

I have get this result and backup don't work  :


This script will update a Bacula MySQL database from version 12-15 to 16

Depending on the current version of your catalog, you may have to run this 
script multiple times.

mysql: [Warning] Using a password on the command line interface can be insecure.
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1067 (42000) at line 3: Invalid default value for 'FirstWritten'
ERROR 1060 (42S21) at line 4: Duplicate column name 'VolParts'
ERROR 1067 (42000) at line 5: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 6: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 7: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 13: Invalid default value for 'StartTime'
ERROR 1067 (42000) at line 14: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 15: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 16: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 17: Invalid default value for 'StartTime'
ERROR 1067 (42000) at line 18: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 19: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 20: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 23: Invalid default value for 'LastWritten'
ERROR 1067 (42000) at line 24: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 25: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 26: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 29: Invalid default value for 'SchedTime'
Update o

Re: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

[William Muriithi]

Hi Erwan,

Hope you had made a catalog backup before schema upgrade.

You can't use bacula 9.0 with mysql 8.   mysql made some change that were only 
fixed in a later bacula version, think bacula 9.2.

So if you have to use mysql 8, please use the latest bacula binaries.  
Alternatively, use Mariadb, which would be my advice as it don't change your 
plans at all.  

Also, change the sql mode to match that of earlier versions.  Something like 
this "sql_mode = NO_ENGINE_SUBSTITUTION"

Anyway, all this depends on whether you have a backup.  

Regard,
William  






From: Erwan RIGOLLOT 

Sent: November 22, 2019 9:50 AM

To: bacula-users@lists.sourceforge.net 

Subject: [Bacula-users] /usr/libexec/bacula/update_mysql_tables

 


Hello,
 
I have try to update bacula database after update Mysql (8.0.17) and bacula ( 
9.0.8-r1).
 
I have get this result and backup don’t work …….. :
 
 
This script will update a Bacula MySQL database from version 12-15 to 16
 
Depending on the current version of your catalog,
you may have to run this script multiple times.
 
mysql: [Warning] Using a password on the command line interface can be insecure.
mysql: [Warning] Using a password on the command line interface can be insecure.
ERROR 1067 (42000) at line 3: Invalid default value for 'FirstWritten'
ERROR 1060 (42S21) at line 4: Duplicate column name 'VolParts'
ERROR 1067 (42000) at line 5: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 6: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 7: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 13: Invalid default value for 'StartTime'
ERROR 1067 (42000) at line 14: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 15: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 16: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 17: Invalid default value for 'StartTime'
ERROR 1067 (42000) at line 18: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 19: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 20: Invalid default value for 'SchedTime'
ERROR 1067 (42000) at line 23: Invalid default value for 'LastWritten'
ERROR 1067 (42000) at line 24: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 25: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 26: Invalid default value for 'FirstWritten'
ERROR 1067 (42000) at line 29: Invalid default value for 'SchedTime'
Update of Bacula MySQL tables 15 to 16 succeeded.
mysql: [Warning] Using a password on the command line interface can be insecure.
 
 
Thanks,
 
Erwan



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] installing Bacula on UBUNTU

[William Muriithi]

Hello Eli,

If you are completely green (Not too much Linux experience), don't use that 
link, what you find on that link is source files, and that require you to be 
comfortable with Linux for a couple of reasons:


  *   An installation from source will require you to deal with dependencies, 
like the compiler which complicate the problem more
  *   The resulting setup is unique that when using packaged bacula and it make 
getting help online a tad harder

So if you are using Ubuntu, use apt and pull whatever the distribution packages.

You will have to try use command line though.   Only the console have some GUI 
element, but that too require changing text configuration to make it usable

Regards,
William

From: Eli Goldhar 
Sent: November 14, 2019 9:38 AM
To: bacula-users@lists.sourceforge.net 
Subject: [Bacula-users] installing Bacula on UBUNTU

Hi guys, and greetings

 full disclosure, i have little knowledge with Linux OS (NOR UBUNTU)

I need to make a backup server that will backup data from several computers 
(almost all run the UBUNTU OS) on my network to a central location, Can be an 
external HDD or locally on the server.

I saw Bacula and it looks great.
The problem is that, as said, i know very little on UBUNTU and it's command 
line and how to operate it via the command line, and i would like to have the 
GUI version, I download Bacula from the site 
(https://www.bacula.org/source-download-center/) and got some tar.gz files. i 
see docs there and GUI and some other files.
(here is the full list of files:
bacula-9.4.4.tar.gz
bacula-docs-9.4.4.tar.bz2
bacula-gui-9.4.4.tar.gz
bacula-regress-9.4.4.tar.gz
bacula-sigs-9.4.4.tar.gz
)

How do i install those files on ubuntu?
what file i need to install anyway? is it the GUI? is it the 1st file? ( 
bacula-9.4.4.tar.gz)

Can anyone help please?

Thanks.
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Why is Maximum File Size not 5GB by default?

[William Muriithi]

Hello,

I was reading through the page (link below) and this sentence looks very 
interesting from performance perspective.  I am using the default on version 9 
and it seems to be 1 GB, but  according to this document, 5 GB is better.  So 
the question is, why isn't 5GB the default?  Asking because, I suspect there is 
might be side effect of increasing it and hence the lower default.

Do most of you change it?  If you have changed it, did you notice any side 
effect after applying the change? 

=
If you have LTO-3 or LTO-4 drives, you should be able to fairly good transfer 
rates; from 60 to 150 MB/second, providing you have fast disks; GigaBit 
Ethernet connections (probably 2); you are running multiple simultaneous jobs; 
you have Bacula data spooling enabled; your tape block size is set to 131072 or 
262144; and you have set Maximum File Size = 5G.
===

https://www.bacula.org/5.0.x-manuals/en/problems/problems/Testing_Your_Tape_Drive.html


Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Upgrading from bacula 5.2.13 to bacula 9

[William Muriithi]

Hello,

I have googled a bit on this and there is just a number of dated discussions, 
mainly on migrating from 5 to 7.  So I am wondering if there is anyone who has 
gone through this process recently and would share some experience.

My plan:
- Set up a separate system and install bacula director version 9.  Then, copy 
the same configuration on 5.2.13 and also dump and import mysql data.
- They update the schema for the new version:  update_mysql_tables -u root -p
- Update the bacula storage to version 9, same configuration
- Leave the rest as they are today

Would this be a proper procedure?   Do I have to go to version 7, before 
upgrading again to version 9?

Would be grateful for any comment, especially if you notice a problem in the 
above steps.

Regards,
William



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

[William Muriithi]

Hi Clark,

> Try the hardware compatibility list for the card on Redhat's website.  Second 
> choice, the manufacturer's website.  The issue is the driver.

Ya, its definitely driver issue.  I had checked RedHat hardware compatibility 
list but it only list servers, not PCI cards.  Essentially, it doesn't list a 
single HBA card.

> My question (rhetorical), why do you want to use an OS that is recently 
> released and still bleeding for a backup server?  I understand upgrade 
> headaches, but backup servers need to be rock solid.

Precisely, I know Centos 7 will be supported for a long time, but I also use 
this server to keep rsync backups so that user can recover their files easily 
without having to wait to a potentially off site tapes.

The hot data sit on a Virtual Data Optimizer device.  It does a great job, 
compressing and de-duplicating 84TB data into  21TB.  However, Virtual Data 
Optimizer has a bug that I experienced once and its not going to be fixed on 
RHEL 7.  When the physical device fill up before the logical device is full, 
you loose your data.  That make one be too conservative on RHEL 7, but its fine 
on RHEL 8, hence why I am adopting it early.

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

[William Muriithi]

Hi Arne,

> There appars to be some conflation of lsscsi and lspci here
>
> lsscsi will show attached SCSI targets
Agree 

> From the lsscsi -g output, it is showing two arrays, a tape drive, and
> a library changer, when the library is removed, it is expected that
> both the tape drive and the library will no longer show.
Precisely what I observed on Friday and something new I learned on Friday.  
Before then, I assumed it was the HBA card :( 

> To see if the HBA is detected, lspci is the command to run.
Its always detected, even when I know it wouldn't work.  So the detection alone 
isn't a full proof test.

>The lspci command cannot tell you if a card will or will not work with
> a tape library, only if the card is detected, and what driver it is
> using. lspci -v might be more useful than -nn

Ah, that is definitely helpful and seem to provide a better way to evaluate 
support.  Thanks a lot.  For anyone else who may have the same issue, this is 
what I found based on  Arne suggestion.  Look out for this line.  "Kernel 
driver in use"

(I have yet to plug the tape storage system as they are in different location, 
but will update if it works once the HBA is delivered.  I am a bit far 
confident though)

Supported:
[root@eng-backup01 ~]# sdiff -sb pci_device_no_storage__card2-2.txt  
pci_device_dell_storage__card2-23.txt
I/O behind bridge: None   | I/O 
behind bridge: d000-dfff [size=4K]
Memory behind bridge: None| Memory 
behind bridge: d400-d4ff [size=16M]
  >
  > 42:00.0 Serial 
Attached SCSI controller: LSI Logic / Symbios 
  > 
Subsystem: Dell 12Gbps HBA
  > Flags: 
bus master, fast devsel, latency 0, IRQ 96, NU
  > I/O 
ports at dc00 [size=256]
  > Memory 
at d4ff (64-bit, non-prefetchable) [size=6
  > Memory 
at d4e0 (64-bit, non-prefetchable) [size=1
  > 
Expansion ROM at d400 [disabled] [size=1M]
  > 
Capabilities: [50] Power Management version 3
  > 
Capabilities: [68] Express Endpoint, MSI 00
  > 
Capabilities: [a8] MSI: Enable- Count=1/1 Maskable+ 6
  > 
Capabilities: [c0] MSI-X: Enable+ Count=96 Masked-
  > 
Capabilities: [100] Advanced Error Reporting
  > 
Capabilities: [1e0] #19
  > 
Capabilities: [1c0] Power Budgeting 
  > 
Capabilities: [190] #16
  > 
Capabilities: [150] Single Root I/O Virtualization (S
  > 
Capabilities: [148] Alternative Routing-ID Interpreta
  > Kernel 
driver in use: mpt3sas
  > Kernel 
modules: mpt3sas

None supported:
[root@eng-backup01 ~]# sdiff -sb pci_device_no_storage__card2-2.txt  
pci_device_atto_card2-2.txt
Memory behind bridge: None| Memory 
behind bridge: d400-d4ff [size=16M]
  >
  > 42:00.0 Serial 
Attached SCSI controller: ATTO Technology, Inc
  > 
Subsystem: ATTO Technology, Inc. ExpressSAS H680
  > Flags: 
bus master, fast devsel, latency 0, IRQ 15, NU
  > Memory 
at d4fc (64-bit, non-prefetchable) [size=6
  > Memory 
at d4fd (64-bit, non-prefetchable) [size=6
  > Memory 
at d4fe (32-bit, non-prefetchable) [size=6
  > Memory 
at 

Re: [Bacula-users] [EXTERNAL] SAS HBA support on Linux

[William Muriithi]

Hi Brown,

> Rhel8 isn't the issue. Dell PERC controllers ARE.
>
>
> https://www.dell.com/downloads/global/products/pvaul/en/dell-perc-h710p-spec-sheet.pdf
>
>
>This is a MPTSAS raid card, not a HBA. It will _probably_ work OK for
>you if it's detecting the tape drive and tape library but experience
>shows they work better in full HBA mode.
Actually, I have two HBA card.  The MPTSAS is only connected to the disk array. 
 The tape storage plug on a different HBA card.  Look closely at the device 
number assigned by Linux kernel and you will notice its two HBA -  0:2  vs 1:0:2

>  [0:2:0:0]diskDELL PERC H710P   3.13  /dev/sda   /dev/sg0
>  [0:2:1:0]diskDELL PERC H710P   3.13  /dev/sdb   /dev/sg1
>  [1:0:2:0]tapeIBM  ULTRIUM-HH6  E4J1  /dev/st0   /dev/sg2
>  [1:0:2:1]mediumx QUANTUM  UHDL 0091  /dev/sch0  /dev/sg3 

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] SAS HBA support on Linux

[William Muriithi]

Hello,

Have any of you deployed RHEL 8/Centos 8 and would be willing to share what HBA 
card they are using?

Anyway, attempting to purchase HBA card and looking for a way to figure out 
what will work without having access to the tape library. Lets say that you 
don't have access to the tape device, but you have a server that have RHEL 8 
installed.  You plug in a SAS HBA card in the slot and bring it up and them on 
the console, you want to check if the card is supported by the operating system.

What would one check?   This is what I have done and not viable test without 
the storage system:

[root@eng-backup02 ~]# lsscsi -g
[0:2:0:0]diskDELL PERC H710P   3.13  /dev/sda   /dev/sg0 
[0:2:1:0]diskDELL PERC H710P   3.13  /dev/sdb   /dev/sg1 
[1:0:2:0]tapeIBM  ULTRIUM-HH6  E4J1  /dev/st0   /dev/sg2 
[1:0:2:1]mediumx QUANTUM  UHDL 0091  /dev/sch0  /dev/sg3

The /dev/sg2 and /dev/sg3 only show up with the tape library attached.   If I 
de-attach the tape, but leave the HBA card on the system, the device disappears.

I have also attempted this:

lspci -nn

The problem with this is even a HBA card that I know will not work when I 
attach the tape library is detected by the operating system and will be listed 
on lspci result.  So I can't ask someone remote to use that to separate 
supported to unsupported.  

So what else can one do the achieve this objective?

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula-FD - RedHat

[William Muriithi]

Hello Maurizio,

If you are deploying on a new server, don't use RHEL 7.  Use RHEL 8.

It will allow you to yum install a more recent Bacula-fd.

Alternatively, you avoid RedHat provided rpm and use upstream RPM instead.

Regards,
William


From: Maurizio Caloro 
Sent: August 16, 2019 12:37 PM
To: bacula-users@lists.sourceforge.net
Subject: [Bacula-users] Bacula-FD - RedHat

Hello Together

Please i have here meny differnt older linux Server’s and the Backup Bacula 
Server are running Version 5.2.5.
I know this are outdated. But i need to install Bacula-fd to this new Red Hat 
Enterprise Linux Server release 7.7 (Maipo)

Please can are possible you can give me the possibilities so that i install the 
FD Deamon to communication with Bacula 5.2.5 ?

On me envirement i have older Linux Version that dont support any newer 
Bacula-FD Version.

Thanks and best regards
M



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula-FD - RedHat

[William Muriithi]

Hi Maurizio

Hmm, now I understand.  Disregard my previous answer.

Your director and storage are 5.2.5, so the best suggestion is as per Alexey 
suggestion.  Use 5.2.13.

Its still don't look like its likely to work considering the fd will be newer 
than director, but you could try...

Or just update the director and storage if that don't work

Regards,
William


From: Maurizio Caloro 
Sent: August 16, 2019 2:33 PM
To: William Muriithi
Cc: Maurizio Caloro; bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula-FD - RedHat

Hello William
Thanks for your fast answer !
The decission are fall redhat 7. i know that i newer version of Bacula-fd cant 
speak with the old version of Bacula daemon, this have see in the meantime meny 
times.

If iam wrong please update me statement!
Regards and thanks for answering
Regards
Maurizio

Von meinem iPhone gesendet

> Am 16.08.2019 um 18:55 schrieb William Muriithi :
>
> Hello Maurizio,
>
> If you are deploying on a new server, don't use RHEL 7.  Use RHEL 8.
>
> It will allow you to yum install a more recent Bacula-fd.
>
> Alternatively, you avoid RedHat provided rpm and use upstream RPM instead.
>
> Regards,
> William
>
> 
> From: Maurizio Caloro 
> Sent: August 16, 2019 12:37 PM
> To: bacula-users@lists.sourceforge.net
> Subject: [Bacula-users] Bacula-FD - RedHat
>
> Hello Together
>
> Please i have here meny differnt older linux Server’s and the Backup Bacula 
> Server are running Version 5.2.5.
> I know this are outdated. But i need to install Bacula-fd to this new Red Hat 
> Enterprise Linux Server release 7.7 (Maipo)
>
> Please can are possible you can give me the possibilities so that i install 
> the FD Deamon to communication with Bacula 5.2.5 ?
>
> On me envirement i have older Linux Version that dont support any newer 
> Bacula-FD Version.
>
> Thanks and best regards
> M
>



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Restore job failure reasons

[William Muriithi]

Hello

We have a bacula server that been running fine for a while.  I have previously 
done test restore to ensure that the backups are usable with success until now.

So this being the first time I have seen a failed restore, I am trying to 
figure out why it failed and haven't gone far using google.  The job that I was 
trying to restore had completed successfully, so all I could think of it tape 
issue.

Would there be another cause that I can investigate?  Anyone else seen this 
error before? 

15-Aug 02:37 bacula-dir JobId 13304: Using Device "ULTRIUM-HH7" to read.
15-Aug 02:37 backup-sd JobId 13304: 3307 Issuing autochanger "unload slot 1, 
drive 0" command.
15-Aug 02:39 backup-sd JobId 13304: 3304 Issuing autochanger "load slot 10, 
drive 0" command.
15-Aug 02:40 backup-sd JobId 13304: 3305 Autochanger "load slot 10, drive 0", 
status is OK.
15-Aug 02:40 backup-sd JobId 13304: Ready to read from volume "000317L6" on 
device "ULTRIUM-HH7" (/dev/nst0).
15-Aug 02:40 backup-sd JobId 13304: Forward spacing Volume "000317L6" to 
file:block 2408:1.
15-Aug 02:47 backup-sd JobId 13304: Error: block.c:1045 Read error on fd=7 at 
file:blk 3193:0 on device "ULTRIUM-HH7" (/dev/nst0). ERR=Input/output error.
15-Aug 02:47 backup-sd JobId 13304: End of Volume at file 3193 on device 
"ULTRIUM-HH7" (/dev/nst0), Volume "000317L6"
15-Aug 02:47 backup-sd JobId 13304: Fatal error: acquire.c:75 Acquire read: 
num_writers=1 not zero. Job 13304 canceled.
15-Aug 02:47 backup-sd JobId 13304: Fatal error: mount.c:876 Cannot open 
Dev="ULTRIUM-HH7" (/dev/nst0), Vol=000317L6
15-Aug 02:47 backup-sd JobId 13304: End of all volumes.

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] deleting data written to volume

[William Muriithi]

Adam,

>> no, I don't think so. If you run parallel Jobs the data will be interleaved 
>> on the tape, and a tape being a seq. access medium you are out of luck here.
> How about if I set:

> Maximum Concurrent Jobs = 1

> Then all jobs will be written on continuous tape segments.

Not necessary.  Suppose you are doing some spooling.  The is a chance of bacula 
pushing all the data on the spool to the tape, pausing that job, picking 
another job which has more data on the spool do de-spool as the previous 
previous job attempt to build up its spooled data again.

In that case, the data would still be interleaved even though you have no 
concurrent jobs running.

If this isn't a one time thing, the best method is to play around with 
retention times...  Something like this

  Volume Retention = 40 days # 2 months
  File Retention = 7 days
  Job Retention = 30 days 


Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] AWS S3 Backup

[William Muriithi]

Ken,

Slightly unrelated but still think it fit well on this thread.

One of the purpose of using tapes is so that one can remove it later from the 
system and make it only physically available.  In case the system is 
compromised, you still have something that can only be destroyed by someone 
local to the data owners.

If one is using S3, how does bacula prevent a case like the Florida city where 
they had backups, but the backups were reachable from the compromised system?

Just trying to see if there is something I am missing as this solution seem to 
have a hole from my point of view.

Regards,
William


From: Kern Sibbald 
Sent: July 19, 2019 6:50:03 AM
To: Bryan Sockel; Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net)
Subject: Re: [Bacula-users] AWS S3 Backup


On 7/18/19 10:14 PM, Bryan Sockel wrote:
Looking over my setup again.  I am not sure if the S3 Cloud driver is being 
compiled correctly.  How can i tell to see if the if it was compiled correctly.

I am following the process here: 
https://stackoverflow.com/questions/12172504/installing-the-libs3-on-linux but 
with the drivers from the bacula.org website.  I am never able to find the 
dependencies in step 5.  Tried installing the 2 rpm's created with the the 
nodep switch.



Thank You

From: "Bryan Sockel 
(bryan.soc...@mdaemon.com)" 

To: "Bryan Sockel" , 
"Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net)"
 
,
 "Kern Sibbald (k...@sibbald.com)" 

Date: Thu, 18 Jul 2019 10:11:07 -0500
Subject: Re: [Bacula-users] AWS S3 Backup

Should i be concerned that the plugins are being Rejected?

plugins.c:133-0 Rejected plugin: want=-sd.so name=s3 len=2
plugins.c:133-0 Rejected plugin: want=-sd.so name=libnss3.so len=10
plugins.c:133-0 Rejected plugin: want=-sd.so name=libs3.so.3 len=10


These objects (files) are not Bacula plugins.  I suspect that your definition 
of the PluginDirectory is not pointing to the Bacula plugins directory.

You are probably using some old distro supplied configuration, which installs 
Bacula in may directories on your filesystem -- this is *very* bad particularly 
for disaster recovery.  I recommend that you remove all old binaries, rebuild 
with the recommended Bacula ./configure set (installs almost everything in 
/opt/bacula/...).  Then try again.

Best regards,

Kern




Thank You,

Bryan Sockel
Systems Administrator
o: 817-601-3222 ext: 233e: 
bryan.soc...@mdaemon.com

MDaemon Technologies
Simple Secure Email

Visit us on Facebook | 
LinkedIn | 
YouTube

Sent using the MDaemon Messaging Server

From: "Bryan Sockel via Bacula-users 
(bacula-users@lists.sourceforge.net)"
 
To: "Kern Sibbald (k...@sibbald.com)" 
, 
bacula-users@lists.sourceforge.net
Date: Thu, 18 Jul 2019 08:04:17 -0500
Subject: Re: [Bacula-users] AWS S3 Backup

Hello,

Here is the requested Information:

Plugin Directory = "/usr/lib64"
ls  /usr/lib64/bacula-sd-cloud-driver-9.4.4.so
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so


bacula-sd -d20
[root@bacula bacula]# bacula-sd: address_conf.c:274-0 Initaddr 0.0.0.0:9103
bacula-sd: init_dev.c:435-0 Open SD driver at 
/usr/lib64/bacula-sd-cloud-driver-9.4.4.so
bacula-sd: bnet_server.c:86-0 Addresses 0.0.0.0:9103
bacula-sd: init_dev.c:440-0 Lookup "BaculaSDdriver" in driver=cloud
bacula-sd: init_dev.c:442-0 Driver=cloud entry point=7f295e762e90
bacula-sd: stored.c:610-0 SD init done CloudStorage-1
List plugins. Hook count=0
List plugins. Hook count=0


status storage=Cloud
Connecting to Storage daemon Cloud at bacula:9103
bacula-sd Version: 9.4.4 (28 May 2019) x86_64-pc-linux-gnu redhat (Core)
Daemon started 18-Jul-19 07:48. Jobs: run=0, running=0.
 Heap: heap=135,168 smbytes=31,242 max_bytes=150,467 bufs=89 max_bufs=91
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0 newbsr=0
 Res: ndevices=1 nautochgr=0
 Drivers: cloud
Running Jobs:
No Jobs running.

Jobs waiting to reserve a drive:

Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName
===
 1  Full  0 0   Error17-Jul-19 16:04 BackupClient1
 2  Full  0 0   Error17-Jul-19 16:29 BackupClient1
 3  Full  0 0   Error17-Jul-19 23:15 BackupClient1
 4  Full   

Re: [Bacula-users] BLOCKED waiting to create a volume on labelled volume

[William Muriithi]

Hi Martin,

Thank you for your suggestion.  It actually lead me to figure the root cause.

When I run "status dir", I couldn't find jobid 10504.  That was petty odd.  Its 
at  this time that I tried to recall what I had done 2 days before and 
remembered I had restarted the director but didn't restart the storage.  I 
always assumed the storage kills all the current jobs when the director is 
restarted.

Anyway, after recalling that, I decided to restart both the director and the 
two storage to see what happens and indeed they have been running backup since 
then.

Regards,
William


From: Martin Simmons 
Sent: July 17, 2019 8:49:07 AM
To: William Muriithi
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] BLOCKED waiting to create a volume on labelled 
volume

What does "status dir" show about running jobs?  In particular, is jobid 10504
still running?

Does the console log show which job is asking for the new volume?

Also, have you run the update slots command since changing tapes?  It seems
strange that both 000302L6 and 000131L6 are shown as being in slot 1.

__Martin



>>>>> On Tue, 16 Jul 2019 15:18:17 +, William Muriithi said:
>
> Hello,
>
> I had a working bacula, till I recently run out of tapes.  After, I changed 
> the file and job retention period and prune was able to identify some usable 
> tapes.  When a tape is pruned, I have it moved to scratch pool.
>
> I thought that was all I needed to do, but the system hasn't managed to run a 
> successful backup since then.  Its in a blocked status.  This only have 
> happened when I had unlabelled volume, but this isn't the case this time.  
> Can't really make sense whats happening here. For example, it seem to be 
> attempting to write to a full tape.  Any chance you may have come across a 
> similar problem?
>
> This is the status of the storage system:
>
> Daemon started 04-Jun-19 18:02. Jobs: run=1441, running=5.
>  Heap: heap=135,168 smbytes=1,361,115 max_bytes=1,459,564 bufs=305 
> max_bufs=2,659
>  Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0
>
> Running Jobs:
> Writing: Full Backup job deuterium-sparrow-job JobId=10504 Volume="000152L6"
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=0 despool_wait=1
> Files=5,687,567 Bytes=3,291,363,396,950 AveBytes/sec=138,469 
> LastBytes/sec=0
> FDReadSeqNo=97,415,374 in_msg=81503899 out_msg=5 fd=12
> Writing: Full Backup job eng-backup01-niobium-job JobId=10643 
> Volume="000152L6"
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=0 despool_wait=0
> Files=8,695,889 Bytes=397,583,989,107 AveBytes/sec=13,892 LastBytes/sec=0
> FDReadSeqNo=70,935,857 in_msg=49043683 out_msg=5 fd=7
> Writing: Differential Backup job eng-backup02-repos-job JobId=10843 Volume=""
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=1 despool_wait=0
> Files=7,571 Bytes=563,263,802,969 AveBytes/sec=21,262 LastBytes/sec=0
> FDReadSeqNo=8,649,492 in_msg=8630895 out_msg=5 fd=16
> Writing: Incremental Backup job earth-ftp-data-job JobId=10865 
> Volume="000301L6"
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=0 despool_wait=0
> Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
> FDReadSeqNo=6 in_msg=6 out_msg=4 fd=19
> Writing: Incremental Backup job eng-backup01-fisheye-job JobId=10952 
> Volume="000312L6"
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=0 despool_wait=0
> Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
> FDReadSeqNo=6 in_msg=6 out_msg=4 fd=23
> Writing: Differential Backup job eng-backup02-earth-job JobId=11005 
> Volume="000312L6"
> pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
> spooling=0 despooling=0 despool_wait=0
> Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
> FDReadSeqNo=6 in_msg=6 out_msg=4 fd=25
> 
>
> Jobs waiting to reserve a drive:
> 
>
> Terminated Jobs:
>  JobId  LevelFiles  Bytes   Status   FinishedName
> ===
>  10835  Incr  0 0   OK   12-Jul-19 23:05 
> eng-backup02-earth-job
>  10836  Incr  0 0   OK   12-Jul-19 23:05 
> eng-backup02-hydrogen-job
>  10837  Incr  0 0   OK   12-Jul-19 23:05 
> eng-backup02-jupiter-job
>  10838  Incr  0 0   OK   12-Jul-19 23:05 
> eng-backup02-lithium-job
>  10781

[Bacula-users] BLOCKED waiting to create a volume on labelled volume

[William Muriithi]

Hello,

I had a working bacula, till I recently run out of tapes.  After, I changed the 
file and job retention period and prune was able to identify some usable tapes. 
 When a tape is pruned, I have it moved to scratch pool.

I thought that was all I needed to do, but the system hasn't managed to run a 
successful backup since then.  Its in a blocked status.  This only have 
happened when I had unlabelled volume, but this isn't the case this time.  
Can't really make sense whats happening here. For example, it seem to be 
attempting to write to a full tape.  Any chance you may have come across a 
similar problem?

This is the status of the storage system:

Daemon started 04-Jun-19 18:02. Jobs: run=1441, running=5.
 Heap: heap=135,168 smbytes=1,361,115 max_bytes=1,459,564 bufs=305 
max_bufs=2,659
 Sizes: boffset_t=8 size_t=8 int32_t=4 int64_t=8 mode=0,0

Running Jobs:
Writing: Full Backup job deuterium-sparrow-job JobId=10504 Volume="000152L6"
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=0 despool_wait=1
Files=5,687,567 Bytes=3,291,363,396,950 AveBytes/sec=138,469 LastBytes/sec=0
FDReadSeqNo=97,415,374 in_msg=81503899 out_msg=5 fd=12
Writing: Full Backup job eng-backup01-niobium-job JobId=10643 Volume="000152L6"
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=0 despool_wait=0
Files=8,695,889 Bytes=397,583,989,107 AveBytes/sec=13,892 LastBytes/sec=0
FDReadSeqNo=70,935,857 in_msg=49043683 out_msg=5 fd=7
Writing: Differential Backup job eng-backup02-repos-job JobId=10843 Volume=""
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=1 despool_wait=0
Files=7,571 Bytes=563,263,802,969 AveBytes/sec=21,262 LastBytes/sec=0
FDReadSeqNo=8,649,492 in_msg=8630895 out_msg=5 fd=16
Writing: Incremental Backup job earth-ftp-data-job JobId=10865 Volume="000301L6"
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDReadSeqNo=6 in_msg=6 out_msg=4 fd=19
Writing: Incremental Backup job eng-backup01-fisheye-job JobId=10952 
Volume="000312L6"
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDReadSeqNo=6 in_msg=6 out_msg=4 fd=23
Writing: Differential Backup job eng-backup02-earth-job JobId=11005 
Volume="000312L6"
pool="eng_father" device="ULTRIUM-HH7" (/dev/nst0)
spooling=0 despooling=0 despool_wait=0
Files=0 Bytes=0 AveBytes/sec=0 LastBytes/sec=0
FDReadSeqNo=6 in_msg=6 out_msg=4 fd=25


Jobs waiting to reserve a drive:


Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName 
===
 10835  Incr  0 0   OK   12-Jul-19 23:05 
eng-backup02-earth-job
 10836  Incr  0 0   OK   12-Jul-19 23:05 
eng-backup02-hydrogen-job
 10837  Incr  0 0   OK   12-Jul-19 23:05 
eng-backup02-jupiter-job
 10838  Incr  0 0   OK   12-Jul-19 23:05 
eng-backup02-lithium-job
 10781  Diff 983.909 G  OK   12-Jul-19 23:19 earth-ftp-data-job
 10839  Incr 52,1127.373 G  OK   12-Jul-19 23:22 
eng-backup02-copper-job
 10840  Incr 10230.1 M  OK   13-Jul-19 01:31 
eng-backup02-tellurium-job
 10841  Incr385247.9 M  OK   13-Jul-19 01:31 
eng-backup02-nitrogen-job
 10842  Incr  0 0   OK   13-Jul-19 01:31 
eng-backup02-bacula-job
 10951  Incr  0 0   Cancel   15-Jul-19 23:05 earth-ftp-data-job


Device status:
Autochanger "SuperLoader3" with devices:
   "ULTRIUM-HH7" (/dev/nst0)

Device "ULTRIUM-HH7" (/dev/nst0) is waiting for:
Volume:  000312L6
Pool:eng_father
Media type:  LTO-6
Device is BLOCKED waiting to create a volume for:
   Pool:eng_father
   Media type:  LTO-6
Slot 15 is loaded in drive 0.
Total Bytes Read=64,512 Blocks Read=1 Bytes/block=64,512
Positioned at File=0 Block=0
==


Used Volume status:
000312L6 on device "ULTRIUM-HH7" (/dev/nst0)
Reader=0 writers=3 reserves=3 volinuse=0


\Data spooling: 2 active jobs, 53,481,749,471 bytes; 753 total jobs, 
3,138,735,672,227 max bytes/job.
Attr spooling: 3 active jobs, 0 bytes; 1435 total jobs, 14,058,244,089 max 
bytes.




Pool: eng_father
+-++---+-++--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes   | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-++--+--+-+--+---+---+-+
|  27 | 000301L6   | Recycle   

[Bacula-users] Safely reusing tapes that are still labelled as Full

[William Muriithi]

Hello

I stated using bacula about 6 months ago.  When I originally set it up, I just 
specified Volume retention period.  The File Retention period, and the Job 
Retention period periods are longer and hence most of the tapes aren't still 
labelled as ready for recycle.

Since I have almost used up all the tapes now, I want to re-use the older once 
but I am wondering what would be the safest way to ensure I can choose tapes 
that will never be needed should I require getting some data from the backups.?

Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] IBM LTO-4 TS3200 Changer

[William Muriithi]

Jasen

Not really related to the autochanger, but why do you prefer Centos 6 instead 
of Centos 7 at this time?  Remember, end next year, RedHat will  stop providing 
support for RHEL 6 and hence centos 6 will also be affected.

Regards,
William


From: Jasen Lentz 
Sent: June 19, 2019 11:05:41 AM
To: Heitor Faria
Cc: bacula-users
Subject: Re: [Bacula-users] IBM LTO-4 TS3200 Changer

Any suggestions on what I need to install for Centos6 drivers?

Thanks!
Jasen

From: Heitor Faria 
Sent: Wednesday, June 19, 2019 10:53 AM
To: Jasen Lentz 
Cc: bacula-users 
Subject: Re: [Bacula-users] IBM LTO-4 TS3200 Changer

Hello Lentz,
Has anyone had any luck in getting an IBM LTO4 TS3200 autochanger working?  I 
have the lin_tape loaded from IBM and the devices shows up as /dev/IBMTape0 and 
/dev/IBMChanger0
Several customers in Brazil use this model.
Don't use the IBM drivers. Native Debian/CentOS drivers are much better and 
easier to install (just plug and play).

Regards,
--

MSc Heitor Faria
CEO Bacula LATAM
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220
[linkedin%20icon]
[logo]
América Latina
bacula.lat | bacula.com.br



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] IBM LTO-4 TS3200 Changer

[William Muriithi]

Hi Jasen

Sorry for top posting, outlook is horrible with anything other than top posting 

In my experience, /dev/sch0 don't work.  It should have an alternate name. 

[root@eng-backup01 ~]# lsscsi -g
[0:2:0:0]diskDELL PERC H710P   3.13  /dev/sda   /dev/sg0 
[0:2:1:0]diskDELL PERC H710P   3.13  /dev/sdb   /dev/sg1 
[1:0:4:0]tapeIBM  ULTRIUM-HH7  J4D1  /dev/st0   /dev/sg2 
[1:0:4:1]mediumx QUANTUM  UHDL 0094  /dev/sch0  /dev/sg3 

In my case, its /dev/sg3.  Use the above command to find the name of your 
device. 

Before starting bacula, verify that the autochanger you are pointing to do 
indeed work.  Something like this:

/opt/bacula/scripts/mtx-changer /dev/sg3 list

Regards,
William





From: Jasen Lentz 
Sent: June 19, 2019 12:53 PM
To: Alan Brown; William Muriithi; Heitor Faria
Cc: bacula-users
Subject: RE: [Bacula-users] IBM LTO-4 TS3200 Changer

Ok, got them installed and lin_tape completely removed.  The drive is /dev/st0 
and the changer is /dev/sch0.  I have a feeling I am close, but missing 
something as it seems to not see the slots in my autoloader:

Connecting to Director BACKUP:9101
1000 OK: 103 BACKUP-dir Version: 9.4.3 (02 May 2019)
Enter a period to cancel a command.
*update slots 1
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
Storage resource "1": not found
The defined Storage resources are:
 1: File1
 2: File2
 3: IBM-3573-TL
Select Storage resource (1-3): 3
Connecting to Storage daemon IBM-3573-TL at BACKUP:9103 ...
3306 Issuing autochanger "slots" command.
Device "ULT3580-TD4" has 0 slots.
No slots in changer to scan.

My configs follow:

#
# Default Bacula Director Configuration file
#
#  The only thing that MUST be changed is to add one or more
#   file or directory names in the Include directive of the
#   FileSet resource.
#
#  For Bacula release 9.4.3 (02 May 2019) -- redhat
#
#  You might also want to change the default email address
#   from root to your address.  See the "mail" and "operator"
#   directives in the Messages resource.
#
# Copyright (C) 2000-2017 Kern Sibbald
# License: BSD 2-Clause; see file LICENSE-FOSS
#

Director {# define myself
  Name = BACKUP-dir
  DIRport = 9101# where we listen for UA connections
  QueryFile = "/opt/bacula/scripts/query.sql"
  WorkingDirectory = "/opt/bacula/working"
  PidDirectory = "/opt/bacula/working"
  Maximum Concurrent Jobs = 20
  Password =  # Console password
  Messages = Daemon
}

JobDefs {
  Name = "DefaultJob"
  Type = Backup
  Level = Incremental
  Client = BACKUP-fd
  FileSet = "Full Set"
  Schedule = "WeeklyCycle"
  Storage = File1
  Messages = Standard
  Pool = File
  SpoolAttributes = yes
  Priority = 10
  Write Bootstrap = "/opt/bacula/working/%c.bsr"
}


#
# Define the main nightly save backup job
#   By default, this job will back up to disk in /tmp
Job {
  Name = "BackupClient1"
  JobDefs = "DefaultJob"
}

#Job {
#  Name = "BackupClient2"
#  Client = BACKUP2-fd
#  JobDefs = "DefaultJob"
#}

#Job {
#  Name = "BackupClient1-to-Tape"
#  JobDefs = "DefaultJob"
#  Storage = LTO-4
#  Spool Data = yes# Avoid shoe-shine
#  Pool = Default
#}

#}

# Backup the catalog database (after the nightly save)
Job {
  Name = "BackupCatalog"
  JobDefs = "DefaultJob"
  Level = Full
  FileSet="Catalog"
  Schedule = "WeeklyCycleAfterBackup"
  # This creates an ASCII copy of the catalog
  # Arguments to make_catalog_backup.pl are:
  #  make_catalog_backup.pl 
  RunBeforeJob = "/opt/bacula/scripts/make_catalog_backup.pl MyCatalog"
  # This deletes the copy of the catalog
  RunAfterJob  = "/opt/bacula/scripts/delete_catalog_backup"
  Write Bootstrap = "/opt/bacula/working/%n.bsr"
  Priority = 11   # run after main backup
}

#
# Standard Restore template, to be changed by Console program
#  Only one such job is needed for all Jobs/Clients/Storage ...
#
Job {
  Name = "RestoreFiles"
  Type = Restore
  Client=BACKUP-fd
  Storage = File1
# The FileSet and Pool directives are not used by Restore Jobs
# but must not be removed
  FileSet="Full Set"
  Pool = File
  Messages = Standard
  Where = /tmp/bacula-restores
}


# List of files to be backed up
FileSet {
  Name = "Full Set"
  Include {
Options {
  signature = MD5
}
#
#  Put your list of files here, preceded by 'File =', one per line
#or include an external list with:
#
#File =   # password for FileDaemon
  File Retention = 60 days# 60 days
  Job Retention = 6 months# six months
  AutoPrune = yes # Prune expired Jobs/Files
}

#

Re: [Bacula-users] Autochanger not working?

[William Muriithi]

Hi Robert,

===

Autochanger {
  Name = LTO5
  Device = Drive-1
  Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
  Changer Device = /dev/sg3
}

Be aware that /dev/sg3 can change when the system is rebooted.  

===
Device {
  Name = Drive-1
  Drive Index = 0
  Device Type = Tape
  Media Type = LTO-5
  Archive Device = /dev/nst0
  Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
  Label Media = yes;   # lets Bacula label unlabeled media
  Random Access = Yes;
  Automatic Mount = yes;   # when device opened, read it
  Removable Media = yes;
  Always Open = yes;
  Maximum Concurrent Jobs = 5
}
==

Don't have "Drive Index = 0", think its only needed when your tape devices have 
multiple drives/head
Use  "Random Access = no"  since you are using the tapes


Device "Drive-1" (/dev/nst0) open but no Bacula volume is currently mounted.
Total Bytes Read=64,512 Blocks Read=1 Bytes/block=64,512
Positioned at File=0 Block=0
==
You may not have labelled the tapes, so bacula didn't attempt loading them.

Try manually attempting to load them from bconsole and see what happens.

Sorry for the formatting, using a horrible mail client called outlook, hence 
the mess 

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Does bacula schedule cleaning by default?

[William Muriithi]

Hello,

I noticed today that the tape hardware - Quantum Superloader 3 - had a warning 
that the tape head needs cleaning and that got me surprised.  We already have a 
cleaner tape on the system and had always assumed this is happening already.

How would one go about doing this?  Yes, I know I can kill all the jobs, umount 
the current tape and mount the cleaner tape but this looks a bit rough.  I am 
looking for a way the system can work with bacula so that clean up scheduling 
happen automatically.  IS it possible also to know if their has been cleaning 
in the past from bacula's perspective?   Would really appreciate any lead

*list volume=CLN005L1
+-++---+-+--+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+--+--+--+-+--+---+---+-+
|  75 | CLN005L1   | Cleaning  |   1 |0 |0 |
3,456,000 |   1 |0 | 0 |   | -00-00 00:00:00 |
+-++---+-+--+--+--+-+--+---+---+-+
*
 
Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Failed to connect to Client -fd

[William Muriithi]

Heitor,

He is using Centos, and version 5.2.13 ended up being whats shipped by RedHat. 
Very understandable

Do you know why RedHat does ship something newer?  Like even version 7?

Regards,
William


From: Heitor Faria 
Sent: April 30, 2019 12:35:25 PM
To: preash raj
Cc: bacula-users
Subject: Re: [Bacula-users] Failed to connect to Client -fd

Hello Preash,

I strongly recommend using the newer 9.4.x versions from the Bacula.org 
project: 
http://bacula.us/script-installation-bacula-community-9-x-official-packages/
The 5.x versions do not really have any kind of support anymore.

Regards,


From: "preash raj" 
To: "bacula-users" 
Sent: Tuesday, April 30, 2019 2:46:25 AM
Subject: [Bacula-users] Failed to connect to Client -fd

Hi,

I've installed and configured the free Bacula version 5.2.13, but I'm not able 
to establish the connection with remote client the local backup works fine. IP 
and port has been allowed in the firewall and telnet in both machines works 
fine. All the configurations are done as per the document: 
https://www.digitalocean.com/community/tutorials/how-to-install-bacula-server-on-centos-7

  *   OS: CentOS Linux release 7.6.1810 (Core)
  *   Bacula Version: 5.2.13

=

[root@baculaserver ~]# bconsole
Connecting to Director localhost:9101
1000 OK: bacula-dir Version: 5.2.13 (19 February 2013)
Enter a period to cancel a command.
*status client
The defined Client resources are:
 1: bacula-fd
 2: client1.hostname-fd
 3: client2.hostname-fd
Select Client (File daemon) resource (1-3): 2
Connecting to Client client1.hostname-fd at client1.hostname:9102
Failed to connect to Client client1.hostname-fd.

You have messages.
=

# tail -f /var/log/bacula/bacula.log

28-Apr 23:10 bacula-dir JobId 71: Begin pruning Files.
28-Apr 23:10 bacula-dir JobId 71: No Files found to prune.
28-Apr 23:10 bacula-dir JobId 71: End auto prune.

28-Apr 23:10 bacula-dir JobId 71: shell command: run AfterJob 
"/usr/libexec/bacula/delete_catalog_backup"
29-Apr 07:49 bacula-dir JobId 0: Fatal error: Unable to authenticate with File 
daemon at "client1.hostname:9102". Possible causes:
Passwords or names not the same or
Maximum Concurrent Jobs exceeded on the FD or
FD networking messed up (restart daemon).
Please see 
http://www.bacula.org/en/rel-manual/Bacula_Freque_Asked_Questi.html#SECTION0026
 for help.

=

# vi /etc/bacula/conf.d/clients.conf

Client {
  Name = client1.hostname-fd
  Address = client1.hostname
  FDPort = 9102
  Catalog = MyCatalog
  Password = "mypassword"  # password for Remote FileDaemon
  File Retention = 30 days# 30 days
  Job Retention = 6 months# six months
  AutoPrune = yes # Prune expired Jobs/Files
}

Job {
  Name = "Backupclient1.hostname"
  JobDefs = "DefaultJob"
  Client = client1.hostname-fd
  Pool = RemoteFile
  FileSet="Home and Etc"
}
=
# cat /etc/bacula/bacula-fd.conf


Director {
  Name = servername-dir
  Password = "mypassword"
}

Director {
  Name = bacula-mon
  Password = "mypassword"
  Monitor = yes
}

FileDaemon {  # this is me
  Name = client1.hostname-fd
  FDAddress = 
  FDport = 9102  # where we listen for the director
  WorkingDirectory = /var/spool/bacula
  Pid Directory = /var/run
  Maximum Concurrent Jobs = 20
}

# Send all messages except skipped files back to Director
Messages {
  Name = Standard
  director = servername-dir = all, !skipped, !restored
}
=

kindly update me any solution for this, let me know if you require any further 
details.


Regards,

Preash.


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--

MSc Heitor Faria
CEO Bacula LATAM
mobile1: + 1 909 655-8971
mobile2: + 55 61 98268-4220
[linkedin icon]


[logo]

América Latina
bacula.lat | bacula.com.br





___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Tape capacity issue

[William Muriithi]

Hello,

I have 4 dozen of tapes that have the same product number, are labelled 6.25 TB 
capacity and hence should all be holding about 6 TB.  However, I have noticed 
no consistency in their capacity at all.  Sometime, they fill up with as little 
as 2 TB and oddly can sometime handle 9TB, which is above the tape capacity.

Why is there such inconsistency?  Is it a configuration issue or is this 
something that is expected with bacula backups? 


+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|   1 | 000106L6   | Full  |   1 | 4,671,714,797,568 |4,679 |   
30,758,400 |   1 |   15 | 1 | LTO-6 | 2019-03-05 19:24:11 |
|   2 | CLN006L1   | Cleaning  |   1 | 1 |0 |   
30,758,400 |   1 |   16 | 1 |   | -00-00 00:00:00 |
|   3 | 000115L6   | Full  |   1 | 2,932,657,072,128 |2,933 |   
30,758,400 |   1 |1 | 1 | LTO-6 | 2019-03-06 06:45:27 |
|   4 | 000121L6   | Full  |   1 | 3,109,714,771,968 |3,110 |   
30,758,400 |   1 |3 | 1 | LTO-6 | 2019-03-06 18:48:47 |
|   5 | 000107L6   | Full  |   1 | 4,136,115,787,776 |4,147 |   
30,758,400 |   1 |7 | 1 | LTO-6 | 2019-03-07 23:49:06 |
|   6 | 000316L6   | Full  |   1 | 5,397,488,280,576 |5,400 |   
30,758,400 |   1 |2 | 1 | LTO-6 | 2019-03-09 07:26:13 |
|   7 | 000309L6   | Full  |   1 | 2,517,516,352,512 |2,518 |   
30,758,400 |   1 |4 | 1 | LTO-6 | 2019-03-09 16:28:44 |
|   8 | 000307L6   | Full  |   1 | 2,517,506,288,640 |2,518 |   
30,758,400 |   1 |5 | 1 | LTO-6 | 2019-03-10 01:25:54 |
|   9 | 000310L6   | Full  |   1 | 4,018,391,064,576 |4,019 |   
30,758,400 |   1 |6 | 1 | LTO-6 | 2019-03-10 20:01:51 |
|  10 | 000125L6   | Full  |   1 | 6,265,599,040,512 |6,267 |   
30,758,400 |   1 |9 | 1 | LTO-6 | 2019-03-11 17:55:31 |
|  11 | 000124L6   | Full  |   1 | 9,206,410,816,512 |9,208 |   
30,758,400 |   1 |   10 | 1 | LTO-6 | 2019-03-13 04:13:46 |
|  12 | 000104L6   | Append|   1 | 3,309,788,160,000 |3,310 |   
30,758,400 |   1 |   11 | 1 | LTO-6 | 2019-03-13 16:40:30 |
|  13 | 000103L6   | Append|   1 |64,512 |0 |   
30,758,400 |   1 |   12 | 1 | LTO-6 | -00-00 00:00:00 |
|  14 | 000108L6   | Append|   1 |64,512 |0 |   
30,758,400 |   1 |   13 | 1 | LTO-6 | -00-00 00:00:00 |
+-++---+-+---+--+--+-+--+---+---+-+

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Bacula message feature configuration guidance

[William Muriithi]

Hello,

I am trying to separate informational emails from emails that require me to fix 
something and I am struggling a bit.  Initially I thought using a separate 
email address for mail and operator will do the trick but that don't seem to 
have any difference.  google don't pull a previous discussion that can help.

For example this happened yesterday:

06-Mar 22:28 bacula-fd JobId 87: Error: bsock.c:429 Write error sending 6 bytes 
to Storage daemon:eng-backup01.example.com:9103: ERR=Connection reset by peer
06-Mar 22:28 bacula-fd JobId 87: Fatal error: backup.c:1326 Network send error 
to SD. ERR=Connection reset by peer
06-Mar 22:28 bacula-dir JobId 87: Error: Director's comm line to SD dropped.

I would have liked this message to end up on service desk so that I can follow 
up.  It ended up on my office email mailbox, but I have a folder for mails from 
bacula which I don't look at a lot as its mostly about a certain job is done.  
So how do you guys and girls separate "no available volume" emails from other 
nice to have emails like "job xyz is done"?

This is what I have at the moment, which is almost the default config to be 
frank
Messages {
  Name = Standard

  mailcommand = "/usr/sbin/bsmtp -h localhost -f \"\(Bacula\) \<%r\>\" -s 
\"Bacula: %t %e of %n %l on %c\" %r"
  operatorcommand = "/usr/sbin/bsmtp -h localhost -f \"\(Bacula\) \<%r\>\" -s 
\"Bacula: Intervention needed for %j\" %r"
  mail = {{technical_mail}} = all, !skipped
  operator = {{service_desk}} = mount
  console = all, !skipped, !saved
  append = "/var/log/bacula/bacula.log" = all, !skipped
  catalog = all
}


Messages {
  Name = Daemon
  mailcommand = "/usr/sbin/bsmtp -h localhost -f \"\(Bacula\) \<%r\>\" -s 
\"Bacula daemon message\" %r"
  mail = {{technical_mail}} = all, !skipped
  console = all, !skipped, !saved
  append = "/var/log/bacula/bacula.log" = all, !skipped
}

What would I need to change to get it working?

Thanks and appreciate your assistance?

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Persistent device name for autochanger

[William Muriithi]

Hi Sven,

>
> At least in *your* case the system already recognizes the device as SCSI
> changer and sets up the special device /dev/sch0 for you.
> 
> mtx complaining about it not being an /dev/sgX device is more of a bug
> inside mtx clinging to the past device names instead of embracing the
> new world.
I suspected so too.
> 
> What version is your mtx?
Its the default that is shipped with RHEL 7.

[root@eng-backup01 ~]# rpm -qa | grep mtx
mtx-1.3.12-14.el7.x86_64
[root@eng-backup01 ~]#

Regards,
William



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Persistent device name for autochanger

[William Muriithi]

Hi Pedro,

Thanks for the link.  I actually looked at it before Hartge responded and funny 
enough came to the same conclusion.  The info maps the tape nicely but I don't 
get enough info from udev to do the dame with autochanger.

I only get this:

[root@eng-backup01 etc]# udevadm info --name=/dev/sch0  --query=all
P: 
/devices/pci:40/:40:02.0/:42:00.0/host1/port-1:0/end_device-1:0/target1:0:0/1:0:0:1/scsi_changer/sch0
N: sch0
E: DEVNAME=/dev/sch0
E: 
DEVPATH=/devices/pci:40/:40:02.0/:42:00.0/host1/port-1:0/end_device-1:0/target1:0:0/1:0:0:1/scsi_changer/sch0
E: MAJOR=86
E: MINOR=0
E: SUBSYSTEM=scsi_changer

Regards,
William

From: Sven Hartge 
Sent: March 3, 2019 10:21 AM
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Persistent device name for autochanger

On 03.03.19 16:00, Pedro Oliveira wrote:

> https://nonhazardo.us/tape/storage/udev/2016/03/14/udev-persistent-tape-drive-naming.html

This is all well and fine, but only talks about /dev/stX and /dev/nstX.
But persitently naming the tape devices is not the question here.

The real question is on how to peristently name the *generic* SCSI
device associated with the tape changer.

The values you get inside udev for scsi_generic are rather sparse:

P:
/devices/pci:00/:00:01.1/:02:00.0/:03:04.0/host6/target6:0:2/6:0:2:0/scsi_generic/sg5
N: sg5
L: 0
E:
DEVPATH=/devices/pci:00/:00:01.1/:02:00.0/:03:04.0/host6/target6:0:2/6:0:2:0/scsi_generic/sg5
E: DEVNAME=/dev/sg5
E: MAJOR=21
E: MINOR=5
E: SUBSYSTEM=scsi_generic
E: USEC_INITIALIZED=29531657


Nothing really helpful to base a rule on, IMHO.

Grüße,
Sven.



___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Persistent device name for autochanger

[William Muriithi]

Hi guys,

On Centos 7 system and had a working tape storage system. Then I restarted and 
the whole thing stopped working.

I have just noticed that the autochanger changed from /dev/sg2 to /dev/sg3.  My 
initial thought was to use the device UUID, but this device don't seem to use 
UUID.  

I thought I could use the alternate name that I pulled from lsscsi command, but 
it looks like either the device driver or the script only want to use the 
device with sg prefix on the name

[root@eng-backup01 ~]# mtx -f /dev/sch0 status
/dev/sch0 is not an sg device, or old sg driver
[root@eng-backup01 ~]# 

So, how do you guys solve this problem so that it don't fall apart on every 
restart?

[root@eng-backup01 ~]# lsscsi -l
[0:2:0:0]diskDELL PERC H710P   3.13  /dev/sda 
  state=running queue_depth=256 scsi_level=6 type=0 device_blocked=0 timeout=90
[0:2:1:0]diskDELL PERC H710P   3.13  /dev/sdb 
  state=running queue_depth=256 scsi_level=6 type=0 device_blocked=0 timeout=90
[1:0:0:0]tapeIBM  ULTRIUM-HH7  J4D1  /dev/st0 
  state=running queue_depth=256 scsi_level=7 type=1 device_blocked=0 timeout=900
[1:0:0:1]mediumx QUANTUM  UHDL 0094  /dev/sch0
  state=running queue_depth=256 scsi_level=3 type=8 device_blocked=0 timeout=0
[root@eng-backup01 ~]# 


Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Long pause with no logging or any activity at all

[William Muriithi]

Hello Simmons,


> Unless something like Samba is converting the symlink to a directory, Bacula
will not follow it.

Okay, that is great to know.

> Filling /tmp might cause the problem, but it should really fail with an error.

Really wish that is the case but that is the only thing that make sense.  The 
director, storage and clients are all on different hosts.

> According to the "stat client" output, it has written 3.3 TB so far.  If your
data is reasonably compressible then that should fit onto a 2.6 TB LTO-6 tape.

That is what I was suspecting too, I was afraid the autochanger isn't working 
properly or isn't configured well.  I have since re-run the job and it don't 
even make sense any more.  This is the current status of the tapes.

*list volume
Automatically selected Catalog: MyCatalog
Using Catalog "MyCatalog"
Pool: Default
No results to list.
Pool: Tapes
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|   1 | 000128L6   | Append|   1 | 8,605,620,043,776 |8,608 |   
31,536,000 |   1 |2 | 1 | LTO-6 | 2019-02-20 07:12:15 |
|   2 | 000101L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |1 | 1 | LTO-6 | -00-00 00:00:00 |
+-++---+-+---+--+--+-+--+---+---+-+
Pool: Scratch
No results to list.

It seem like 8TB on one tape.  How is this possible?  And the autochanger 
hasn't kicked in.

Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Long pause with no logging or any activity at all

[William Muriithi]

Hi all,

Thanks all for the feedback.  The file path was actually a symlinc that I think 
I had created in a weird way, ended up being recursive.  I used unlink to dump 
it on both the source and backups server.   The backup never progressed

I suspect I may have found the root cause though.  I had scheduled a backup of 
the catalogue database and on Friday, it failed.  I was using the tmp file 
system as mysql tmp file and it had filed up.

I commented it off, restarted the catalogue and restarted the backup job.  Will 
advice if I see the problem again.

Curious, how long should LTO-6 take on average to fill up?  On the third day 
and its yet to need the autochanger.  This kind of feel too slow to me

Regards,
William


From: Martin Simmons 
Sent: February 18, 2019 11:49:41 AM
To: William Muriithi
Cc: uwe.schuerk...@bertelsmann.de; bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Long pause with no logging or any activity at all

>>>>> On Fri, 15 Feb 2019 15:10:13 +, William Muriithi said:
>
> > have you tried the "stat client" command? If you run it a few times you 
> > should be able to spot if there's still data transfer activity.
>
> Daemon started 12-Feb-19 11:53. Jobs: run=4 running=0.
>  Heap: heap=135,168 smbytes=586,060 max_bytes=639,633 bufs=465 max_bufs=515
>  Sizeof: boffset_t=8 size_t=8 debug=0 trace=0
> Running Jobs:
> JobId 7 Job BackupClient2.2019-02-12_16.08.21_03 is running.
> Full Backup Job started: 12-Feb-19 16:08
> Files=14,795,540 Bytes=3,362,575,559,435 Bytes/sec=14,178,390 Errors=0
> Files Examined=14,795,541
> Processing file: 
> /export/eng/deuterium.eng.example.com/eng/tools/synopsys/pa-vrtzr/F-2011.06-SP1/SLS/linux/InnoGUI/wine/localdotwine/dosdevices/z:/export/eng/projects/cad_admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/tools/rhel5/subversion-1.6.18/subversion/libsvn_subr/.libs/libsvn_subr-1.so.0.0.0
> SDReadSeqNo=5 fd=7
> Director connected at: 15-Feb-19 10:01

Is this path with so many nested "admin" directories expected?

Is any of it mounted from another machine (e.g. by Samba)?

The localdotwine directory looks like a Wine directory to me, but it seems
strange that the dosdevices directory contains a directory called z: rather
than a symbolic link.

__Martin


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Long pause with no logging or any activity at all

[William Muriithi]

Hi Uwe,


> have you tried the "stat client" command? If you run it a few times you 
> should be able to spot if there's still data transfer activity.

Daemon started 12-Feb-19 11:53. Jobs: run=4 running=0.
 Heap: heap=135,168 smbytes=586,060 max_bytes=639,633 bufs=465 max_bufs=515
 Sizeof: boffset_t=8 size_t=8 debug=0 trace=0 
Running Jobs:
JobId 7 Job BackupClient2.2019-02-12_16.08.21_03 is running.
Full Backup Job started: 12-Feb-19 16:08
Files=14,795,540 Bytes=3,362,575,559,435 Bytes/sec=14,178,390 Errors=0
Files Examined=14,795,541
Processing file: 
/export/eng/deuterium.eng.example.com/eng/tools/synopsys/pa-vrtzr/F-2011.06-SP1/SLS/linux/InnoGUI/wine/localdotwine/dosdevices/z:/export/eng/projects/cad_admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/admin/tools/rhel5/subversion-1.6.18/subversion/libsvn_subr/.libs/libsvn_subr-1.so.0.0.0
SDReadSeqNo=5 fd=7
Director connected at: 15-Feb-19 10:01


Terminated Jobs:
 JobId  LevelFiles  Bytes   Status   FinishedName 
==
   180  Full  0 0   Error11-Feb-19 13:53 BackupCatalog
 3  Full  0 0   OK   12-Feb-19 14:09 BackupCatalog
 4  Full 102.281 M  Error12-Feb-19 15:08 BackupClient1
 5  Full  0 0   OK   12-Feb-19 15:10 BackupCatalog
 6  Full  0 0   OK   12-Feb-19 15:58 BackupClient2


That has been the status since yesterday

Strace is also silent, look as below since last night but one:

[root@eng-backup01 ~]# strace -p 22956
strace: Process 22956 attached
select(7, [6], NULL, NULL, NULL^[[B

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Long pause with no logging or any activity at all

[William Muriithi]

Hi Martin,

Thanks a lot for your response.

> Is the log really "nothing"?  It should at least show the last thing that 
> happened.

Honestly nothing, the last 3 lines on bacula.log was on 12-Feb 15:58 and that 
was before I started the pending backup job

> Also, try "status dir" to see what the Director is doing.

Hmm, this see to help.  I believe this is the job number 7 that has  a fatal 
error as status.  Wish it was more elaborate than that.  Have you seen that 
error before?

Daemon started 12-Feb-19 16:02. Jobs: run=0, running=5 mode=0,0
 Heap: heap=270,336 smbytes=173,258 max_bytes=174,054 bufs=447 max_bufs=454

Scheduled Jobs:
Level  Type Pri  Scheduled  Name   Volume
===
IncrementalBackup10  15-Feb-19 11:58BackupClient1  000128L6
Full   Backup10  15-Feb-19 15:08BackupClient2  000128L6
Full   Backup11  15-Feb-19 15:10BackupCatalog  000128L6


Running Jobs:
Console connected at 12-Feb-19 16:02
Console connected at 14-Feb-19 16:09
 JobId Level   Name   Status
==
 7 FullBackupClient2.2019-02-12_16.08.21_03 has a fatal error
 8 FullBackupClient1.2019-02-13_11.58.00_07 is waiting execution
 9 FullBackupCatalog.2019-02-13_15.10.00_08 is waiting execution
10 FullBackupClient1.2019-02-14_11.58.00_14 is waiting execution
11 FullBackupCatalog.2019-02-14_15.10.00_15 is waiting execution


Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Long pause with no logging or any activity at all

[William Muriithi]

Hello,

I have a new bacula setup and for the last two day, has been running the first 
large scheduled job.  Sometimes early this morning,  it looks like bacula 
stopped writing to the tape

I was monitoring it using this command:

*list volumes
+-++---+-+---+--+--+-+--+---+---+-+
| MediaId | VolumeName | VolStatus | Enabled | VolBytes  | VolFiles | 
VolRetention | Recycle | Slot | InChanger | MediaType | LastWritten |
+-++---+-+---+--+--+-+--+---+---+-+
|   1 | 000128L6   | Append|   1 | 3,369,784,578,048 |3,374 |   
31,536,000 |   1 |2 | 1 | LTO-6 | 2019-02-14 03:43:09 |
|   2 | 000109L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |3 | 1 | LTO-6 | -00-00 00:00:00 |
|   3 | 000114L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |4 | 1 | LTO-6 | -00-00 00:00:00 |
|   4 | 000113L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |5 | 1 | LTO-6 | -00-00 00:00:00 |
|   5 | 000129L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |6 | 1 | LTO-6 | -00-00 00:00:00 |
|   6 | 000112L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |7 | 1 | LTO-6 | -00-00 00:00:00 |
|   7 | 000130L6   | Append|   1 |64,512 |0 |   
31,536,000 |   1 |8 | 1 | LTO-6 | -00-00 00:00:00 |
+-++---+-+---+--+--+-+--+---+---+-+

That hasn't changed for the last 5 hours.  The director, storage and client are 
all fine and responsive to console, but no activity.  Nothing on the director's 
log too.

So the question is, how would one go around figuring out what is happening in 
this situation?

Regards,
William


___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Assistance with renaming the pool

[William Muriithi]

Hello,

Got a quick question.  This isn't yet a production system so I hope its doable 

I am trying to rename the name of the pool from "File" to something less 
confusing.  I am doing this on the director's configuration as follows:


Pool {
#  Name = File  #  <- From this line
  Name = Tapes  #  <- To this line
  Pool Type = Backup
  Cleaning Prefix = "CLN"
  Recycle = yes   # Bacula can automatically recycle Volumes
  AutoPrune = yes # Prune expired volumes
  Storage = QUANTUM   
Please change this, very 
confusing
  Volume Retention = 365 days

After making the above change and restarting, I am faced with this error.  Have 
googled and found a way of overcoming this.  Someone dealed with this 
successfully in the past?


Device "ultrium1" (/dev/nst0) is mounted with:
Volume:  000101L6
Pool:*unknown*
Media type:  LTO-6
Slot 4 is loaded in drive 0.
Total Bytes Read=0 Blocks Read=0 Bytes/block=0
Positioned at File=0 Block=0

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Problem purging a volume from console

[William Muriithi]

Hello,

Learning bacula so this may be a basic question, but I can't find a way to get 
it done.  In the morning, I had labeled the tapes manually, for example 
bacula1, bacula2 etc.  Then I realized I could use barcode.  So I went about 
purging and them relabeling the tapes.

One of the tables however don't show up when I type "list media".  The system 
has 8 tapes, but only 7 show up now.  Why is this?  I had assumed its on the 
drive, but even if I load a different tape, the 8 tape wouldn't show up on the 
list.

This is the approach I took:

*label barcodes slot=1
Automatically selected Storage: File
Connecting to Storage daemon File at eng-backup02.eng.perasotech.com:9103 ...
3306 Issuing autochanger "slots" command.
Device "SuperLoader3" has 8 slots.
Connecting to Storage daemon File at eng-backup02.eng.perasotech.com:9103 ...
3301 Issuing autochanger "loaded? drive 0" command.
3302 Autochanger "loaded? drive 0", result is Slot 1.
3306 Issuing autochanger "list" command.
The following Volumes will be labeled:
Slot  Volume
==
   1  000315L6
Do you want to label these Volumes? (yes|no): yes
Defined Pools:
 1: Default
 2: File
 3: Scratch
Select the Pool (1-3): 2
Connecting to Storage daemon File at eng-backup02.eng.perasotech.com:9103 ...
Sending label command for Volume "000315L6" Slot 1 ...
3920 Cannot label Volume because it is already labeled: "BACULA1"
Label command failed for Volume 000315L6.
*
*
*purge volume=BACULA1

This command can be DANGEROUS!!!

It purges (deletes) all Files from a Job,
JobId, Client or Volume; or it purges (deletes)
all Jobs from a Client or Volume without regard
to retention periods. Normally you should use the
PRUNE command, which respects retention periods.
sql_get.c:1094 Media record for Volume "BACULA1" not found.

*purge slot=1

What is the proper way of overcoming this issue?

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Assistance with Autochanger configuration

[William Muriithi]

Hi Patti,

> Use /dev/sch0, not /dev/sg2.  Bear in mind, udev is not your friend.  If you 
> ever add another tape drive to your library or expand your device fabric, 
> these device references will/can change with every system boot.  As is, the 
> /dev/sgX references can change with reboots, but if you only have one changer 
> and one drive, the /dev/sch0 and /dev/nst0 devices should remain static.  

He seem to have the same problem too
https://unix.stackexchange.com/questions/193472/interacting-with-tape-library-on-centos-7-via-mtx

Hmm, it doesn't seem to live /dev/sch0.  I agree with you that using /dev/sgX 
isn't reliable, but when I made the change suggested above, it failed with the 
error below:
Tape block granularity is 1024 bytes.
btape: butil.c:290-0 Using device: "/dev/nst0" for writing.
05-Nov 13:17 btape JobId 0: 3991 Bad autochanger "loaded? drive 0" command: 
ERR=Child exited with code 1.
Results=/dev/sch0 is not an sg device, or old sg driver

> Also, you have "Drive Index = 1" commented out.  Uncomment and change it to 
> "Drive Index = 0".  All tape drives in a changer must have an index and the 
> first one is zero.  Give those a try.

Hmm, I have seem this previously and when I implemented it, I had this issue. I 
have 8 tapes, do I believe I need 8 archive device.  However, the system only 3 
sgX devices.  How would one overcome this problem?

[root@eng-backup02 ~]# ls -ltr /dev/sg*
crw-rw. 1 root disk 21, 0 Oct 10 15:42 /dev/sg0
crw-rw. 1 root tape 21, 1 Nov  5 12:16 /dev/sg1
crw-rw. 1 root tape 21, 2 Nov  5 12:16 /dev/sg2
[root@eng-backup02 ~]# 

Regards,
William

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] Assistance with Autochanger configuration

[William Muriithi]

Hello,

We have a quantum superloader 3 that seem to be fine when tested through mt and 
mtx command.

[root@eng-backup02 ~]# lsscsi -g
[0:2:0:0]diskDELL PERC H710P   3.13  /dev/sda   /dev/sg0 
[1:0:2:0]tapeIBM  ULTRIUM-HH6  E4J1  /dev/st0   /dev/sg1 
[1:0:2:1]mediumx QUANTUM  UHDL 0091  /dev/sch0  /dev/sg2 
[root@eng-backup02 ~]#

When we run btape -c test, the command, it come back successful for all tape 
tests.  However, for the autochanger, I am getting this error.  Have anyone 
seen it before and how did you resolve it?

=== Autochanger test ===

3301 Issuing autochanger "loaded" command.
Slot 3 loaded. I am going to unload it.
3302 Issuing autochanger "unload 3 0" command.
unload status=OK 0
3303 Issuing autochanger "load 1 0" command.
3993 Bad autochanger command: /etc/bacula/scripts/mtx-changer /dev/sg2 load 1 
/dev/nst0 0
3993 result="Loading media from Storage Element 1 into drive 0...done
": ERR=Child died from signal 15: Termination
You must correct this error or the Autochanger will not work.
*

Below is my storage configurations:
Autochanger {
  Name = SuperLoader3
  Device = ultrium1 
  Changer Command = "/etc/bacula/scripts/mtx-changer %c %o %S %a %d"
  Changer Device = /dev/sg2
}

Device {
  Name = ultrium1
  Media Type = LTO-6
  Archive Device = /dev/nst0
#  Drive Index = 1
  LabelMedia = yes;   # lets Bacula label unlabeled media
  Random Access = no;
  AutomaticMount = yes;   # when device opened, read it
  RemovableMedia = yes;
  AlwaysOpen = yes;
  Autochanger = yes;
}

Would appreciate any guidance a  lot

Regards,
William 

___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users