Re: [Bacula-users] bug: resumed jobs should not be subject to "max start delay time"

2017-07-20 Thread kern
Please submit a bug report with either the full bacula-dr.conf or all the 
resources concerning the job plus the full job report for the job that failed.
Best RegardsKern


Sent from my Samsung Galaxy smartphone.
 Original message From: mark.berg...@uphs.upenn.edu Date: 
7/21/17  00:55  (GMT+01:00) To: Kern Sibbald  Cc: Bacula 
Users Mailing List  Subject: bug: resumed 
jobs should not be subject to "max start delay time" 
Bacula 7.4.7

When a job is stopped and then 'resumed', the 'max start delay time'
paramater should not be applied. It is inconsistent to restart a job and
then have it canceled immediately because it exceeded the max start delay.

Thanks,

Mark

-- 
Mark Bergman   voice: 215-746-4061  
 
mark.berg...@uphs.upenn.edu  fax: 215-614-0266
https://www.cbica.upenn.edu/
IT Technical Director, Center for Biomedical Image Computing and Analytics
Department of Radiology University of Pennsylvania
  PGP Key: https://www.cbica.upenn.edu/sbia/bergman 
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Aaron Greenblatt
Hi Everyone,

Thanks for your help!

I looked around in HP's Library and Tape Tools software and couldn't find
anything similar to a "Read Past Filemark" setting - the settings were
limited to disabling the eject button and something else that didn't look
very useful. I'm sure that HP has a this setting buried somewhere, but I'd
expect that one has to call HP support to enable it.

Meanwhile, I installed Bacula 7.4.7 and the test passes in that version. I
think the answer for now is to use version 7.4.7 to get my backup server
running.

Is there any sort of information that would be useful for you from versions
9.0.0 or 9.0.1 (both gave me the same problem)?

Thanks,
Aaron

On Thu, Jul 20, 2017 at 11:48 AM, Kern Sibbald  wrote:

> Hello Jim,
>
> Very interesting!  Thanks for telling us.
>
> Best regards,
>
> Kern
>
> On 07/20/2017 08:30 PM, Jim Richardson wrote:
>
> Be sure to factory default your tape drive.  I had the exact issue with my
> LTO7.  The drive was used in a non-linux environment before.  My steps to
> factory reset are a pain, but they got me working.  Yours may be
> different.  Manufacturer dependent.
>
>
>
> # Steps
>
> 1. Install non-RAID HBA
>
> 2. install lin_tape & lin_taped
>
> 3. install ITDT
>
> 4. run full set of tests in ITDT
>
> 5. factory default settings - Specifically the "Read Past Filemark"
> setting MUST BE no
>
>  http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002972=1
>
> 6. remove lin_tape & lin_taped
>
> 7. rmmod st
>
> 8. modprob st
>
> 9. power cycle library
>
> 10. Bacula configuration
>
> 11. btape test
>
>
>
> # tapeinfo -f /dev/nst0
>
> Product Type: Tape Drive
>
> Vendor ID: 'IBM '
>
> Product ID: 'ULT3580-HH7 '
>
> Revision: 'G9Q1'
>
> Attached Changer API: No
>
> SerialNumber: '1097000515'
>
> MinBlock: 1
>
> MaxBlock: 8388608
>
> SCSI ID: 1
>
> SCSI LUN: 0
>
> Ready: yes
>
> BufferedMode: yes
>
> Medium Type: 0x78
>
> Density Code: 0x5c
>
> BlockSize: 0
>
> DataCompEnabled: yes
>
> DataCompCapable: yes
>
> DataDeCompEnabled: yes
>
> CompType: 0xff
>
> DeCompType: 0xff
>
> BOP: yes
>
> Block Position: 0
>
> Partition 0 Remaining Kbytes: -1
>
> Partition 0 Size in Kbytes: -1
>
> ActivePartition: 0
>
> EarlyWarningSize: 0
>
> NumPartitions: 0
>
> MaxPartitions: 3
>
>
>
> # lsscsi -g
>
> [3:0:1:0]tapeIBM  ULT3580-HH7  G9Q1  /dev/st0   /dev/sg5
>
> [3:0:1:1]mediumx IBM  3572-TL  0071  -  /dev/sg6
>
>
>
> Device {
>
>   Name = Drive-1  #
>
>   Drive Index = 0
>
>   Media Type = LTO-7
>
>   Archive Device = /dev/nst0
>
>   AutomaticMount = yes;   # when device opened, read it
>
>   AlwaysOpen = yes;
>
>   RemovableMedia = yes;
>
>   RandomAccess = no;
>
>   AutoChanger = yes
>
>   Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"
>
> }
>
>
>
>
>
>
>
>
>
> *Jim Richardson*
>
>
>
> *From:* Aaron Greenblatt [mailto:aaronbgreenbl...@gmail.com
> ]
> *Sent:* Thursday, July 20, 2017 12:15 PM
> *To:* Kern Sibbald  
> *Cc:* bacula-users@lists.sourceforge.net
> *Subject:* Re: [Bacula-users] Btape Test - Append Files Test
>
>
>
> Hi Kern,
>
> Thanks for your help!
>
> I removed the two lines you mentioned and had the same result.
>
> The btape output is below. I'm running Debian 8.8 (kernel 3.16.0-4-amd64).
> I downloaded the Bacula 9.0.1 source from https://sourceforge.net/
> projects/bacula/files/bacula/9.0.1/ and compiled the binaries on my
> machine. The binaries are dynamically linked, so I added
> "/home/agreenblatt/software-bacula/bacula/src/stored/.libs" to
> /etc/ld.so.conf.d/bacula.conf and ran ldconfig. I assume that the warning
> about plugins in /usr/local/lib can be ignored as a result? (Though, now
> that I look, I see the libs are indeed in /usr/local/lib, so perhaps I
> didn't need to make the extra file in ld.so.conf.d.)
>
> Best,
>
> Aaron
>
>
>
> Full btape output:
>
>
> root@tapebackup:/usr/local/bacula/etc# btape -c bacula-sd.conf /dev/nst0
> Tape block granularity is 1024 bytes.
> 20-Jul 03:11 btape JobId 0: Warning: Failed to find any plugins in
> /usr/local/lib
> btape: butil.c:290-0 Using device: "/dev/nst0" for writing.
> btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
> *test
>
> === Write, rewind, and re-read test ===
>
> I'm going to write 1 records and an EOF
> then write 1 records and an EOF, then rewind,
> and re-read the data to verify that it is correct.
>
> This is an *essential* feature ...
>
> btape: btape.c:1161-0 Wrote 1 blocks of 64412 bytes.
> btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
> btape: btape.c:1177-0 Wrote 1 blocks of 64412 bytes.
> btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
> btape: btape.c:1219-0 Rewind OK.
> 1 blocks re-read correctly.
> Got EOF on tape.
> 1 blocks re-read correctly.
> === Test Succeeded. End Write, rewind, and re-read test ===
>
> btape: btape.c:1286-0 Block position 

[Bacula-users] bug: resumed jobs should not be subject to "max start delay time"

2017-07-20 Thread mark . bergman
Bacula 7.4.7

When a job is stopped and then 'resumed', the 'max start delay time'
paramater should not be applied. It is inconsistent to restart a job and
then have it canceled immediately because it exceeded the max start delay.

Thanks,

Mark

-- 
Mark Bergman   voice: 215-746-4061  
 
mark.berg...@uphs.upenn.edu  fax: 215-614-0266
https://www.cbica.upenn.edu/
IT Technical Director, Center for Biomedical Image Computing and Analytics
Department of Radiology University of Pennsylvania
  PGP Key: https://www.cbica.upenn.edu/sbia/bergman 

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] unable to upgrade bacula database from 14 to 15

2017-07-20 Thread Thing
root@vuwunicobculat1:/etc/bacula#
/usr/share/bacula-director/update_mysql_tables -u root -p

This script will update a Bacula MySQL database from version 12-14 to 15

Depending on the current version of your catalog,
you may have to run this script multiple times.

Enter password:
ERROR 1049 (42000): Unknown database 'XXX_DBNAME_XXX'

Unable to detect database version, you can specify connection information
on the command line.
Error. Cannot upgrade this database.
root@vuwunicobculat1:/etc/bacula#
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] A *different* append test problem with btape

2017-07-20 Thread Steve Garcia
I have a *different* problem with a new tape drive and btape, also failing 
during the append test.

The read/write test passes with no trouble, but the append test not only fails, 
but it takes the tape drive offline.  Once this happens, the drive is not 
accessible until the tape is physically dismounted and then remounted.  Once 
this happens, the drive comes back to life, but it will go offline again if the 
append test is re-attempted.  

The btape failure message suggested using a fixed block size, but making that 
change didn't seem to make any difference.

I tried downloading the IBM ITDT utility and running all its tests, but the 
drive passed with flying colors in the ITDT diagnostics.

I am running bacula 7.4.4 on a new Debian stretch (Debian 9) server with a new 
tape library and tape drive. The new drive is an IBM ULT3580-HH6 LTO-6 drive in 
a Dell TL-2000 library.  I have an existing bacula instance running on a Debian 
jesse (debian 8) server, and my plan is to add the new tape library as an 
additional pool for the existing instance.  For now, though, unless I can get 
the drive to work with bacula, planning how to set bacula itself up doesn't 
matter.

What steps can I do to troubleshoot this?

One thing I notice is that lsscsi shows the tape drive twice, but there is only 
one actual drive.  Could this be a part of the problem?


root@odin:/etc/bacula/scripts# ./mtx-changer /dev/autochanger1 load 1 /dev/nst0 0
Loading media from Storage Element 1 into drive 0...done


root@odin:/etc/bacula/scripts# ./mtx-changer /dev/autochanger1 listall
D:0:F:1:15L6   
S:1:E
S:2:F:18L6   
S:3:F:21L6   
S:4:F:CLNU00L1   
S:5:F:14L6   
S:6:F:17L6   
S:7:F:20L6   
S:8:F:CLN005L3   
S:9:F:13L6   
S:10:F:16L6   
S:11:F:19L6   
S:12:F:12L6   
S:13:F:09L6   
S:14:F:06L6   
S:15:F:03L6   
S:16:F:11L6   
S:17:F:08L6   
S:18:F:05L6   
S:19:F:02L6   
S:20:F:10L6   
S:21:F:07L6   
S:22:F:04L6   
S:23:F:01L6   
I:24:E


root@odin:/etc/bacula/scripts# btape -c ../bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
btape: butil.c:291-0 Using device: "/dev/nst0" for writing.
test
btape: btape.c:471-0 open device "Drive-1" (/dev/nst0): OK
*

=== Write, rewind, and re-read test ===

I'm going to write 1 records and an EOF
then write 1 records and an EOF, then rewind,
and re-read the data to verify that it is correct.

This is an *essential* feature ...

btape: btape.c:1154-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:606-0 Wrote 1 EOF to "Drive-1" (/dev/nst0)
btape: btape.c:1170-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:606-0 Wrote 1 EOF to "Drive-1" (/dev/nst0)
btape: btape.c:1212-0 Rewind OK.
1 blocks re-read correctly.
Got EOF on tape.
1 blocks re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===

btape: btape.c:1279-0 Block position test
btape: btape.c:1291-0 Rewind OK.
Reposition to file:block 0:4
Block 5 re-read correctly.
Reposition to file:block 0:200
Block 201 re-read correctly.
Reposition to file:block 0:
Block 1 re-read correctly.
Reposition to file:block 1:0
Block 10001 re-read correctly.
Reposition to file:block 1:600
Block 10601 re-read correctly.
Reposition to file:block 1:
Block 2 re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===



=== Append files test ===

This test is essential to Bacula.

I'm going to write one record  in file 0,
   two records in file 1,
 and three records in file 2

btape: btape.c:576-0 Rewound "Drive-1" (/dev/nst0)
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:606-0 Wrote 1 EOF to "Drive-1" (/dev/nst0)
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:606-0 Wrote 1 EOF to "Drive-1" (/dev/nst0)
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:1909-0 Wrote one record of 64412 bytes.
btape: btape.c:1911-0 Wrote block to device.
btape: btape.c:606-0 Wrote 1 EOF to "Drive-1" (/dev/nst0)
btape: Fatal Error at btape.c:467 because:
dev open failed: tape_dev.c:164 Unable to open device "Drive-1" (/dev/nst0): 

[Bacula-users] Btape - cannot pass

2017-07-20 Thread Hicks, Daniel CTR OSD DMEA
Hello all,

I am running Bacula 7.4.7 on a Centos 7 server with a HP-Overland tape / 
autoloader.

Within bconsole I can inventory the autoloader, mount and move tapes around.

However, when I run btape -c /etc/bacula/bacula-sd.conf /dev/nst0 I get the 
following:

20-July 11:54 btape: Fatal Error ad device.c:300 because:
Dev open failed: tape_dev.c:164 Unable to open device "HP-Overland" 
(/dev/nst0): ERR=Device or resource busy

Btape: butyl.c:199-0 Cannot open "HP-Overland" (/dev/nst0)
20-Jul 11:59 btape JobId 0: Fatal error: butyl.c:199 Cannot open "HP-Overland" 
(/dev/nst0)

Any help would be great

Thanks

Daniel Hicks
Senior Systems Analyst
FutureWorld Technologies Inc.
DMEA IT Support

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Kern Sibbald

  
  
Hello Jim,
Very interesting!  Thanks for telling us.
Best regards,
Kern


On 07/20/2017 08:30 PM, Jim Richardson
  wrote:


  
  
  
  
Be sure to factory default your tape
  drive.  I had the exact issue with my LTO7.  The drive was
  used in a non-linux environment before.  My steps to factory
  reset are a pain, but they got me working.  Yours may be
  different.  Manufacturer dependent.
 
# Steps
1. Install non-RAID HBA
2. install lin_tape & lin_taped
3. install ITDT
4. run full set of tests in ITDT
5. factory default settings -
  Specifically the "Read Past Filemark" setting MUST BE no
 
http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002972=1
6. remove lin_tape & lin_taped
7. rmmod st
8. modprob st
9. power cycle library
10. Bacula configuration
11. btape test
 
# tapeinfo -f /dev/nst0
Product Type: Tape Drive
Vendor ID: 'IBM '
Product ID: 'ULT3580-HH7 '
Revision: 'G9Q1'
Attached Changer API: No
SerialNumber: '1097000515'
MinBlock: 1
MaxBlock: 8388608
SCSI ID: 1
SCSI LUN: 0
Ready: yes
BufferedMode: yes
Medium Type: 0x78
Density Code: 0x5c
BlockSize: 0
DataCompEnabled: yes
DataCompCapable: yes
DataDeCompEnabled: yes
CompType: 0xff
DeCompType: 0xff
BOP: yes
Block Position: 0
Partition 0 Remaining Kbytes: -1
Partition 0 Size in Kbytes: -1
ActivePartition: 0
EarlyWarningSize: 0
NumPartitions: 0
MaxPartitions: 3
 
# lsscsi -g
[3:0:1:0]    tape    IBM 
  ULT3580-HH7  G9Q1  /dev/st0   /dev/sg5
[3:0:1:1]    mediumx IBM 
  3572-TL  0071  -  /dev/sg6
 
Device {
  Name = Drive-1  #
  Drive Index = 0
  Media Type = LTO-7
  Archive Device = /dev/nst0
  AutomaticMount = yes;   #
  when device opened, read it
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
  AutoChanger = yes
  Alert Command = "sh -c 'tapeinfo -f %c
  |grep TapeAlert|cat'"
}
 
 
 
 
Jim Richardson
 
From: Aaron Greenblatt
  [mailto:aaronbgreenbl...@gmail.com]
  
  Sent: Thursday, July 20, 2017 12:15 PM
  To: Kern Sibbald 
  Cc: bacula-users@lists.sourceforge.net
  Subject: Re: [Bacula-users] Btape Test - Append Files
  Test
 

  

  

  Hi
Kern,

Thanks
  for your help!
  
  I
removed the two lines you mentioned and had the same
result.

The btape
  output is below. I'm running Debian 8.8 (kernel
  3.16.0-4-amd64). I downloaded the Bacula 9.0.1 source from
  https://sourceforge.net/projects/bacula/files/bacula/9.0.1/
  and compiled the binaries on my machine. The binaries are
  dynamically linked, so I added
  "/home/agreenblatt/software-bacula/bacula/src/stored/.libs"
  to /etc/ld.so.conf.d/bacula.conf and ran ldconfig. I
  assume that the warning about plugins in /usr/local/lib
  can be ignored as a result? (Though, now that I look, I
  see the libs are indeed in /usr/local/lib, so perhaps I
  didn't need to make the extra file in ld.so.conf.d.)
  
  
Best,
  
  
Aaron
  
  
 
  
  
Full btape output:
  
  

  root@tapebackup:/usr/local/bacula/etc# btape -c
  bacula-sd.conf /dev/nst0
  Tape block granularity is 1024 bytes.
  20-Jul 03:11 btape JobId 0: Warning: Failed to find any
  plugins in /usr/local/lib
  btape: butil.c:290-0 Using device: "/dev/nst0" for
  writing.
  btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
  *test
  
  === Write, rewind, and re-read test ===
  
  I'm going to write 1 records and an EOF
  then write 1 records and an EOF, then rewind,
  and re-read the data to verify that it is correct.
  
  This is an *essential* feature ...
  
  btape: 

Re: [Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Jim Richardson
Be sure to factory default your tape drive.  I had the exact issue with my 
LTO7.  The drive was used in a non-linux environment before.  My steps to 
factory reset are a pain, but they got me working.  Yours may be different.  
Manufacturer dependent.


# Steps

1. Install non-RAID HBA

2. install lin_tape & lin_taped

3. install ITDT

4. run full set of tests in ITDT

5. factory default settings - Specifically the "Read Past Filemark" setting 
MUST BE no

 http://www-01.ibm.com/support/docview.wss?uid=ssg1S7002972=1

6. remove lin_tape & lin_taped

7. rmmod st

8. modprob st

9. power cycle library

10. Bacula configuration

11. btape test



# tapeinfo -f /dev/nst0

Product Type: Tape Drive

Vendor ID: 'IBM '

Product ID: 'ULT3580-HH7 '

Revision: 'G9Q1'

Attached Changer API: No

SerialNumber: '1097000515'

MinBlock: 1

MaxBlock: 8388608

SCSI ID: 1

SCSI LUN: 0

Ready: yes

BufferedMode: yes

Medium Type: 0x78

Density Code: 0x5c

BlockSize: 0

DataCompEnabled: yes

DataCompCapable: yes

DataDeCompEnabled: yes

CompType: 0xff

DeCompType: 0xff

BOP: yes

Block Position: 0

Partition 0 Remaining Kbytes: -1

Partition 0 Size in Kbytes: -1

ActivePartition: 0

EarlyWarningSize: 0

NumPartitions: 0

MaxPartitions: 3



# lsscsi -g

[3:0:1:0]tapeIBM  ULT3580-HH7  G9Q1  /dev/st0   /dev/sg5

[3:0:1:1]mediumx IBM  3572-TL  0071  -  /dev/sg6



Device {

  Name = Drive-1  #

  Drive Index = 0

  Media Type = LTO-7

  Archive Device = /dev/nst0

  AutomaticMount = yes;   # when device opened, read it

  AlwaysOpen = yes;

  RemovableMedia = yes;

  RandomAccess = no;

  AutoChanger = yes

  Alert Command = "sh -c 'tapeinfo -f %c |grep TapeAlert|cat'"

}






Jim Richardson

From: Aaron Greenblatt [mailto:aaronbgreenbl...@gmail.com]
Sent: Thursday, July 20, 2017 12:15 PM
To: Kern Sibbald 
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Btape Test - Append Files Test

Hi Kern,
Thanks for your help!
I removed the two lines you mentioned and had the same result.
The btape output is below. I'm running Debian 8.8 (kernel 3.16.0-4-amd64). I 
downloaded the Bacula 9.0.1 source from 
https://sourceforge.net/projects/bacula/files/bacula/9.0.1/ and compiled the 
binaries on my machine. The binaries are dynamically linked, so I added 
"/home/agreenblatt/software-bacula/bacula/src/stored/.libs" to 
/etc/ld.so.conf.d/bacula.conf and ran ldconfig. I assume that the warning about 
plugins in /usr/local/lib can be ignored as a result? (Though, now that I look, 
I see the libs are indeed in /usr/local/lib, so perhaps I didn't need to make 
the extra file in ld.so.conf.d.)
Best,
Aaron

Full btape output:

root@tapebackup:/usr/local/bacula/etc# btape -c bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
20-Jul 03:11 btape JobId 0: Warning: Failed to find any plugins in 
/usr/local/lib
btape: butil.c:290-0 Using device: "/dev/nst0" for writing.
btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
*test

=== Write, rewind, and re-read test ===

I'm going to write 1 records and an EOF
then write 1 records and an EOF, then rewind,
and re-read the data to verify that it is correct.

This is an *essential* feature ...

btape: btape.c:1161-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1177-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1219-0 Rewind OK.
1 blocks re-read correctly.
Got EOF on tape.
1 blocks re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===

btape: btape.c:1286-0 Block position test
btape: btape.c:1297-0 Rewind OK.
Reposition to file:block 0:4
Block 5 re-read correctly.
Reposition to file:block 0:200
Block 201 re-read correctly.
Reposition to file:block 0:
Block 1 re-read correctly.
Reposition to file:block 1:0
Block 10001 re-read correctly.
Reposition to file:block 1:600
Block 10601 re-read correctly.
Reposition to file:block 1:
Block 2 re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===



=== Append files test ===

This test is essential to Bacula.

I'm going to write one record  in file 0,
   two records in file 1,
 and three records in file 2

btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.

Re: [Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Aaron Greenblatt
Hi Kern,

Thanks for your help!

I removed the two lines you mentioned and had the same result.

The btape output is below. I'm running Debian 8.8 (kernel 3.16.0-4-amd64).
I downloaded the Bacula 9.0.1 source from
https://sourceforge.net/projects/bacula/files/bacula/9.0.1/ and compiled
the binaries on my machine. The binaries are dynamically linked, so I added
"/home/agreenblatt/software-bacula/bacula/src/stored/.libs" to
/etc/ld.so.conf.d/bacula.conf and ran ldconfig. I assume that the warning
about plugins in /usr/local/lib can be ignored as a result? (Though, now
that I look, I see the libs are indeed in /usr/local/lib, so perhaps I
didn't need to make the extra file in ld.so.conf.d.)

Best,
Aaron

Full btape output:

root@tapebackup:/usr/local/bacula/etc# btape -c bacula-sd.conf /dev/nst0
Tape block granularity is 1024 bytes.
20-Jul 03:11 btape JobId 0: Warning: Failed to find any plugins in
/usr/local/lib
btape: butil.c:290-0 Using device: "/dev/nst0" for writing.
btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
*test

=== Write, rewind, and re-read test ===

I'm going to write 1 records and an EOF
then write 1 records and an EOF, then rewind,
and re-read the data to verify that it is correct.

This is an *essential* feature ...

btape: btape.c:1161-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1177-0 Wrote 1 blocks of 64412 bytes.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1219-0 Rewind OK.
1 blocks re-read correctly.
Got EOF on tape.
1 blocks re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===

btape: btape.c:1286-0 Block position test
btape: btape.c:1297-0 Rewind OK.
Reposition to file:block 0:4
Block 5 re-read correctly.
Reposition to file:block 0:200
Block 201 re-read correctly.
Reposition to file:block 0:
Block 1 re-read correctly.
Reposition to file:block 1:0
Block 10001 re-read correctly.
Reposition to file:block 1:600
Block 10601 re-read correctly.
Reposition to file:block 1:
Block 2 re-read correctly.
=== Test Succeeded. End Write, rewind, and re-read test ===



=== Append files test ===

This test is essential to Bacula.

I'm going to write one record  in file 0,
   two records in file 1,
 and three records in file 2

btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1430-0 Now moving to end of medium.
btape: btape.c:633-0 Moved to end of medium.
We should be in file 3. I am at file 3. This is correct!

Now the important part, I am going to attempt to append to the tape.

btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
Done appending, there should be no I/O errors

Doing Bacula scan of blocks:
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=5, blocks=7, bytes = 451,136
End scanning the tape.
We should be in file 4. I am at file 5. This is NOT correct

The above Bacula scan should have output identical to what follows.
Please double check it ...
=== Sample correct output ===
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=4, blocks=7, bytes = 451,136
=== End sample correct output ===

If the above scan output is not identical to the
sample output, you MUST correct the problem
or Bacula will not be able to write multiple Jobs to
the tape.



=== Forward space files test ===

This test is essential to Bacula.

I'm going to write five files then test forward spacing

btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF 

Re: [Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Kern Sibbald

  
  
Hello,
Please take out the:
 Hardware End of File = no
and
Device Type = Tape
then try the test again.  If it fails please post the btape
  output, the OS you are running, the Bacula version, and where you
  got the binaries.
Best regards,
Kern




On 07/20/2017 05:42 PM, Aaron
  Greenblatt wrote:


  

  
Hello,
  

I am attempting to use Bacula on a backup server and am
having trouble with btape test in the append files section.
I have read the documentation, searched on Google, and
updated the firmware on my SAS card and tape drive. I don't
see any particularly helpful log messages on the system. Any
thoughts on where I should look to continue troubleshooting
this? Could it have something to do with the SCSI driver in
the OS?

  
  Configuration is as follows: Debian 8 with Atto H1280
(also tried H644) SAS HBA and HP LTO6 tape drive. More
details below.
  
  
Thank you.

  
  Best,
  
  Aaron
  
  
  
  Output from btape:
  === Append files test ===
  
  This test is essential to Bacula.
  
  I'm going to write one record  in file 0,
     two records in file 1,
   and three records in file 2
  
  btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
  btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
  btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
  btape: btape.c:1430-0 Now moving to end of medium.
  btape: btape.c:633-0 Moved to end of medium.
  We should be in file 3. I am at file 3. This is correct!
  
  Now the important part, I am going to attempt to append to the
  tape.
  
  btape: btape.c:1917-0 Wrote one record of 64412 bytes.
  btape: btape.c:1919-0 Wrote block to device.
  btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
  btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
  Done appending, there should be no I/O errors
  
  Doing Bacula scan of blocks:
  1 block of 64448 bytes in file 1
  End of File mark.
  2 blocks of 64448 bytes in file 2
  End of File mark.
  3 blocks of 64448 bytes in file 3
  End of File mark.
  1 block of 64448 bytes in file 4
  End of File mark.
  Total files=5, blocks=7, bytes = 451,136
  End scanning the tape.
  We should be in file 4. I am at file 5. This is NOT
correct
  
  The above Bacula scan should have output identical to what
  follows.
  Please double check it ...
  === Sample correct output ===
  1 block of 64448 bytes in file 1
  End of File mark.
  2 blocks of 64448 bytes in file 2
  End of File mark.
  3 blocks of 64448 bytes in file 3
  End of File mark.
  1 block of 64448 bytes in file 4
  End of File mark.
  Total files=4, blocks=7, bytes = 451,136
  === End sample correct output ===
  
  If the above scan output is not identical to the
  sample output, you MUST correct the problem
  or Bacula will not be able to write multiple Jobs to 
  the tape.
  
  
  

bacula-sd.conf (I tried this without the Hardware End of File
line; same result):

Device {
  Name = LTO-6
  Media Type = LTO-6
  Device Type = Tape
  Archive Device = /dev/nst0
  AutomaticMount = yes;   # when device opened, read
it
  AlwaysOpen = yes;
  RemovableMedia = yes;

[Bacula-users] Btape Test - Append Files Test

2017-07-20 Thread Aaron Greenblatt
Hello,

I am attempting to use Bacula on a backup server and am having trouble with
btape test in the append files section. I have read the documentation,
searched on Google, and updated the firmware on my SAS card and tape drive.
I don't see any particularly helpful log messages on the system. Any
thoughts on where I should look to continue troubleshooting this? Could it
have something to do with the SCSI driver in the OS?

Configuration is as follows: Debian 8 with Atto H1280 (also tried H644) SAS
HBA and HP LTO6 tape drive. More details below.

Thank you.

Best,
Aaron

Output from btape:
=== Append files test ===

This test is essential to Bacula.

I'm going to write one record  in file 0,
   two records in file 1,
 and three records in file 2

btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:478-0 open device "LTO-6" (/dev/nst0): OK
btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
btape: btape.c:1430-0 Now moving to end of medium.
btape: btape.c:633-0 Moved to end of medium.
We should be in file 3. I am at file 3. This is correct!

Now the important part, I am going to attempt to append to the tape.

btape: btape.c:1917-0 Wrote one record of 64412 bytes.
btape: btape.c:1919-0 Wrote block to device.
btape: btape.c:612-0 Wrote 1 EOF to "LTO-6" (/dev/nst0)
btape: btape.c:582-0 Rewound "LTO-6" (/dev/nst0)
Done appending, there should be no I/O errors

Doing Bacula scan of blocks:
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=5, blocks=7, bytes = 451,136
End scanning the tape.
*We should be in file 4. I am at file 5. This is NOT correct*

The above Bacula scan should have output identical to what follows.
Please double check it ...
=== Sample correct output ===
1 block of 64448 bytes in file 1
End of File mark.
2 blocks of 64448 bytes in file 2
End of File mark.
3 blocks of 64448 bytes in file 3
End of File mark.
1 block of 64448 bytes in file 4
End of File mark.
Total files=4, blocks=7, bytes = 451,136
=== End sample correct output ===

If the above scan output is not identical to the
sample output, you MUST correct the problem
or Bacula will not be able to write multiple Jobs to
the tape.



bacula-sd.conf (I tried this without the Hardware End of File line; same
result):

Device {
  Name = LTO-6
  Media Type = LTO-6
  Device Type = Tape
  Archive Device = /dev/nst0
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
  Maximum File Size = 5GB
  Hardware End of File = no
}


tapeinfo -f /dev/sg8

Product Type: Tape Drive
Vendor ID: 'HP  '
Product ID: 'Ultrium 6-SCSI  '
Revision: '35GD'
Attached Changer API: No
SerialNumber: 'HUJ4321BY1'
MinBlock: 1
MaxBlock: 16777215
SCSI ID: 0
SCSI LUN: 0
Ready: yes
BufferedMode: yes
Medium Type: Not Loaded
Density Code: 0x5a
BlockSize: 0
DataCompEnabled: yes
DataCompCapable: yes
DataDeCompEnabled: yes
CompType: 0x1
DeCompType: 0x1
BOP: yes
Block Position: 0
ActivePartition: 0
EarlyWarningSize: 0
NumPartitions: 0
MaxPartitions: 3
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [9.0.0] Disabled Jobs don't show in log, "run"-Command nor in Job table

2017-07-20 Thread Kern Sibbald

This is a feature that was requested by users.

Jobs that are disabled are no longer listed in the list of jobs 
available to be run.  If you manually run a disabled job, it will still 
run.


Best regards,

Kern


On 07/20/2017 03:40 PM, Uwe Schuerkamp wrote:

Hi folks,

I have a few jobs that I run manually from time to time and so I've
set them to "Enabled = False" in their job definition.

It seems that as of 9.0.0, running these jobs no longer shows up in
bacula's log nor in the Job table. Also, they're not listed in the job
list anymore when I simply type "run", however when I type

run job=""

they're still recognized.

Everything worked fine in 7.4.4, is this a bug or a feature?

All the best & TIA,

Uwe




--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] [9.0.0] Disabled Jobs don't show in log, "run"-Command nor in Job table

2017-07-20 Thread Uwe Schuerkamp
Hi folks,

I have a few jobs that I run manually from time to time and so I've
set them to "Enabled = False" in their job definition.

It seems that as of 9.0.0, running these jobs no longer shows up in
bacula's log nor in the Job table. Also, they're not listed in the job
list anymore when I simply type "run", however when I type

run job=""

they're still recognized. 

Everything worked fine in 7.4.4, is this a bug or a feature?

All the best & TIA,

Uwe

-- 
Uwe Schürkamp | email: 








--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users