Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-22 Thread Jacky Carimalo 

Le 20/11/2012 16:39, Tilman Schmidt a écrit :

Am 20.11.2012 17:14, schrieb Jacky Carimalo:

Le 20/11/2012 15:32, John Drescher a écrit :

Also you should avoid /dev/st0 and use /dev/nst0 since /dev/st0 can
cause corruption in your tapes.


But I have no choice :

bacula2-64:~/bacula/bin# lsscsi -g
[0:0:0:0]diskIFT  A16F-R2221   347C  /dev/sdb /dev/sg2
[0:0:1:0]tapeHP   Ultrium 3-SCSI   G24H  /dev/st0 /dev/sg3
[0:0:1:1]tapeHP   Ultrium 3-SCSI   G24H  /dev/st1 /dev/sg4
[0:0:1:2]mediumx OVERLAND NEO Series   0604  /dev/sch0 /dev/sg5
[0:0:1:3]process Over NEO VIA FCO  2.22  - /dev/sg6
...

I think you have. Just because /dev/nst0 isn't listed by lsscsi
doesn't mean it isn't there. Look:

[ts@backup ~]$ lsscsi -g
[0:0:0:0]cd/dvd  HL-DT-ST DVDRAM GSA-H12N  UL01  /dev/sr0   /dev/sg0
[2:0:0:0]diskATA  ST3250620NS  3.AE  /dev/sda   /dev/sg1
[3:0:0:0]diskATA  ST3250620NS  3.AE  /dev/sdb   /dev/sg2
[5:0:5:0]tapeHP   Ultrium 3-SCSI   G54W  /dev/st0   /dev/sg3
[5:0:5:1]mediumx HP   1x8 autoloader   1.50  /dev/sch0  /dev/sg4
[ts@backup ~]$ ls -l /dev/*st0*
crw-rw 1 root tape 9, 128 19. Okt 16:59 /dev/nst0
crw-rw 1 root tape 9, 224 19. Okt 16:59 /dev/nst0a
crw-rw 1 root tape 9, 160 19. Okt 16:59 /dev/nst0l
crw-rw 1 root tape 9, 192 19. Okt 16:59 /dev/nst0m
crw-rw 1 root tape 9,   0 19. Okt 16:59 /dev/st0
crw-rw 1 root tape 9,  96 19. Okt 16:59 /dev/st0a
crw-rw 1 root tape 9,  32 19. Okt 16:59 /dev/st0l
crw-rw 1 root tape 9,  64 19. Okt 16:59 /dev/st0m




So, I used as you well indicates : /dev/nst0 and /dev/nst1.

Autochanger {
  Name = OVL_LTO-3
  Device = OVL_LTO-3_Drive-1, OVL_LTO-3_Drive-2
  Changer Device = /dev/changerovllto3
  Changer Command = /root/bacula/bin/mtx-changer %c %o %S %a %d
}

Device {
  Name = OVL_LTO-3_Drive-1
  Drive Index = 0
  Media Type = LTO-3
  AutoChanger = yes
  Archive Device = /dev/nst1
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = yes;
  LabelMedia = yes;
RandomAccess = yes;
  Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
}

Device {
  Name = OVL_LTO-3_Drive-2
  Drive Index = 1
  Media Type = LTO-3
  AutoChanger = yes
  Archive Device = /dev/nst0
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = no;
   LabelMedia = yes;
  RandomAccess = yes;
  Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
}

---
But there are still errors :

dmesg :
Nov 22 12:33:22 singleton.u06.univ-nantes.prive kernel: [72917.185264] 
lpfc :08:00.0: 0:(0):0713 SCSI layer issued Device Reset (1, 1) 
return x2002
Nov 22 12:33:22 singleton.u06.univ-nantes.prive kernel: [72917.190481] 
st1: Sense Key : Unit Attention [current]
Nov 22 12:33:22 singleton.u06.univ-nantes.prive kernel: [72917.190487] 
st1: Add. Sense: Bus device reset function occurred

...
---

with errors in bacula job :
2012-11-22 12:33:22 bacula.u11.univ-nantes.prive-
Error: block.c:590 Write error at 44:14976 on device OVL_LTO-3_Drive-1 
(/dev/nst1). ERR=Input/output error.

Error: Error writing final EOF to tape. This Volume may not be readable.
dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-1 (/dev/nst1). 
ERR=Input/output error.

...
---

I will try cleaning procedures as last solution for me ...

Thanks for your contributions.
Jacky



--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-20 Thread Jacky Carimalo 

I put Volume Use Duration = 36 months,
but always having sometimes :

Error: block.c:590 Write error at 88:2499 on device OVL_LTO-3_Drive-2 
(/dev/st0). ERR=Erreur d'entrée/sortie.

Error: Error writing final EOF to tape. This Volume may not be readable.
dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). 
ERR=Erreur d'entrée/sortie.


Thanks

Jacky
_

Pool {
  Name = Pool_gromel_LTO
  Use Volume Once = no
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Maximum Volumes = 1000
  LabelFormat = Vol_gromel_
  VolumeRetention = 36 months
  Volume Use Duration = 36 months
}


Le 19/11/2012 15:55, Alan Brown a écrit :

On 19/11/12 15:46, Jacky Carimalo wrote:


update Volume={name} VolStatus=append

but it then marked the volume Used, and not enabled for backup on it
again, keeping its first data.

Bacula has decided the volume has been open too long.

This is set with Volume Use Duration and has no default.

It is easier to use a new tape than to mess around with tape settings on
a live system.





--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users



--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-20 Thread Jacky Carimalo 

Yes, LTP102L1 is a tape volume.
I defined Maximum Volumes = 1000 ; as you said, it would be better 
having no line like this ; but I think it would be the same :


having sometimes :
Error: block.c:590 Write error at 88:2499 on device OVL_LTO-3_Drive-2 
(/dev/st0). ERR=Erreur d'entrée/sortie.

Error: Error writing final EOF to tape. This Volume may not be readable.
dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). 
ERR=Erreur d'entrée/sortie.


rarely, it marks the volume full when it is reallyy full like here :
End of Volume 000352L3 at 406:13452 on device OVL_LTO-3_Drive-1 
(/dev/st1). Write of 64512 bytes got -1.

Re-read of last block succeeded.
End of medium on Volume 000352L3 Bytes=406,841,831,424 
Blocks=6,306,451 at 20-nov.-2012 09:27.


Thanks
Jacky

Le 20/11/2012 09:15, Radosław Korzeniewski a écrit :

Hello,

2012/11/19 Jacky Carimalo jacky.carim...@univ-nantes.fr 
mailto:jacky.carim...@univ-nantes.fr


Le 19/11/2012 12:00, Alan Brown a écrit :
 On 19/11/12 11:04, Jacky Carimalo wrote:
 Hello,
 I have the same problem.
 Bacula stopped filling a tape after 4 errors, as described below !
 I would like to be able to tell it to continue ...
 update Volume={name} VolStatus=append


I did :

update Volume={name} VolStatus=append

but it then marked the volume Used, and not enabled for backup on it
again, keeping its first data.


Is LTP102L1 a tape volume? If so why did you define a Max Volume Jobs 
on this kind of volume?


best regards
Radek


*messages
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Start Backup
JobId 12075,
Job=Backup_gromel1d.univ-nantes.prive_di_LTO.2012-11-19_15.42.45_04
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Volume used
once. Marking Volume LTP102L1 as Used.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Using Device
OVL_LTO-3_Drive-1
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot
defined
in catalog (slot=0) for Volume Vol_gromel_6393 on
OVL_LTO-3_Drive-1
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning:
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot
defined
in catalog (slot=0) for Volume Vol_gromel_6393 on
OVL_LTO-3_Drive-1
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning:
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot
defined
in catalog (slot=0) for Volume Vol_gromel_6393 on
OVL_LTO-3_Drive-1
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning:
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot
defined
in catalog (slot=0) for Volume Vol_gromel_6393 on
OVL_LTO-3_Drive-1
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning:
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot
defined
in catalog (slot=0) for Volume Vol_gromel_6393 on
OVL_LTO-3_Drive-1
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning:
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Please mount
Volume Vol_gromel_6393 or label a new one for:
 Job:
Backup_gromel1d.univ-nantes.prive_di_LTO.2012-11-19_15.42.45_04
 Storage:  OVL_LTO-3_Drive-1 (/dev/st1)
 Pool: Pool_gromel_LTO
 Media type:   LTO-3

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-20 Thread Jacky Carimalo 
Le 20/11/2012 15:30, John Drescher a écrit :
 On Tue, Nov 20, 2012 at 10:15 AM, Jacky Carimalo
 jacky.carim...@univ-nantes.fr wrote:
 I put Volume Use Duration = 36 months,
 but always having sometimes :

 Error: block.c:590 Write error at 88:2499 on device OVL_LTO-3_Drive-2
 (/dev/st0). ERR=Erreur d'entrée/sortie.
 Error: Error writing final EOF to tape. This Volume may not be readable.
 dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). ERR=Erreur
 d'entrée/sortie.

 Look at your kernel logs / dmesg for scsi or tape errors.

 John

Definitely, there is a correspondance between kern.log an errors in the 
job ; but how to resolve these errors ?

kern.log on the host machine :
Nov 20 04:49:51 singleton.u06.univ-nantes.prive kernel: [1168599.570017] 
lpfc :08:00.0: 0:(0):0713 SCSI layer issued Device Reset (1, 0) 
return x2002
Nov 20 04:49:51 singleton.u06.univ-nantes.prive kernel: [1168599.574881] 
st0: Sense Key : Unit Attention [current]
Nov 20 04:49:51 singleton.u06.univ-nantes.prive kernel: [1168599.574886] 
st0: Add. Sense: Bus device reset function occurred
Nov 20 07:35:13 singleton.u06.univ-nantes.prive kernel: [1178507.202668] 
lpfc :08:00.0: 0:(0):0713 SCSI layer issued Device Reset (1, 0) 
return x2002
Nov 20 07:35:13 singleton.u06.univ-nantes.prive kernel: [1178507.207654] 
st0: Sense Key : Unit Attention [current]
Nov 20 07:35:13 singleton.u06.univ-nantes.prive kernel: [1178507.207659] 
st0: Add. Sense: Bus device reset function occurred
---
Logs on its virtual machine for the bacula job :

2012-11-20 04:49:51 bacula.u11.univ-nantes.prive-
Error: block.c:590 Write error at 141:9585 on device OVL_LTO-3_Drive-2 
(/dev/st0). ERR=Erreur d'entrée/sortie.
Error: Error writing final EOF to tape. This Volume may not be readable.
dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). 
ERR=Erreur d'entrée/sortie.

2012-11-20 07:35:13 bacula.u11.univ-nantes.prive-
Error: block.c:590 Write error at 67:3714 on device OVL_LTO-3_Drive-2 
(/dev/st0). ERR=Erreur d'entrée/sortie.
Error: Error writing final EOF to tape. This Volume may not be readable.
dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). 
ERR=Erreur d'entrée/sortie.

Jacky




--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-20 Thread Jacky Carimalo 
Le 20/11/2012 15:32, John Drescher a écrit :
 On Tue, Nov 20, 2012 at 9:30 AM, John Drescher dresche...@gmail.com wrote:
 On Tue, Nov 20, 2012 at 10:15 AM, Jacky Carimalo
 jacky.carim...@univ-nantes.fr wrote:
 I put Volume Use Duration = 36 months,
 but always having sometimes :

 Error: block.c:590 Write error at 88:2499 on device OVL_LTO-3_Drive-2
 (/dev/st0). ERR=Erreur d'entrée/sortie.
 Error: Error writing final EOF to tape. This Volume may not be readable.
 dev.c:1566 ioctl MTWEOF error on OVL_LTO-3_Drive-2 (/dev/st0). ERR=Erreur
 d'entrée/sortie.

 Look at your kernel logs / dmesg for scsi or tape errors.
 Also you should avoid /dev/st0 and use /dev/nst0 since /dev/st0 can
 cause corruption in your tapes.

 John
But I have no choice :

bacula2-64:~/bacula/bin# lsscsi -g
[0:0:0:0]diskIFT  A16F-R2221   347C  /dev/sdb /dev/sg2
[0:0:1:0]tapeHP   Ultrium 3-SCSI   G24H  /dev/st0 /dev/sg3
[0:0:1:1]tapeHP   Ultrium 3-SCSI   G24H  /dev/st1 /dev/sg4
[0:0:1:2]mediumx OVERLAND NEO Series   0604  /dev/sch0 /dev/sg5
[0:0:1:3]process Over NEO VIA FCO  2.22  - /dev/sg6
...

Thanks


--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-19 Thread Jacky Carimalo 
 |   10,368,000 |   1 |   18 | 1 | LTO-3 
| |
|   6,358 | LTP115L1   | Append|   1 |  64,512 |
0 |   10,368,000 |   1 |   19 | 1 | LTO-3 
| |
|   6,359 | 84L3   | Append|   1 |  64,512 |
0 |   10,368,000 |   1 |   20 | 1 | LTO-3 
| |
+-++---+-+-+--+--+-+--+---+---+-+
*

*query
Choose a query (1-20): 15 (List Volumes Bacula thinks are in changer)
+-++--+---+--+-+---+---+
| mediaid | volumename | gb   | storage   | slot | pool | mediatype | 
volstatus |
+-++--+---+--+-+---+---+
|   6,340 | LTP102L1   |   25 | OVL_LTO-3 |1 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,341 | 000310L3   |  288 | OVL_LTO-3 |2 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,342 | 92L3   |  104 | OVL_LTO-3 |3 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,343 | 000111L3   |  159 | OVL_LTO-3 |4 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,344 | 000336L3   |   21 | OVL_LTO-3 |5 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,345 | LTP100L1   |   24 | OVL_LTO-3 |6 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,346 | 000226L3   |   80 | OVL_LTO-3 |7 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,347 | 000243L3   |   57 | OVL_LTO-3 |8 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,348 | 000343L3   |  137 | OVL_LTO-3 |9 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,349 | LTP113L1   |   97 | OVL_LTO-3 |   10 | Pool_gromel_LTO | 
LTO-3 | Full  |
|   6,350 | 000345L3   |   23 | OVL_LTO-3 |   11 | Pool_gromel_LTO | 
LTO-3 | Used  |
|   6,351 | 000274L3   |0 | OVL_LTO-3 |   12 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,352 | 000352L3   |0 | OVL_LTO-3 |   13 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,353 | 95L3   |0 | OVL_LTO-3 |   14 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,354 | 000170L3   |0 | OVL_LTO-3 |   15 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,355 | 99L3   |0 | OVL_LTO-3 |   16 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,356 | 000367L3   |0 | OVL_LTO-3 |   17 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,357 | 000240L3   |0 | OVL_LTO-3 |   18 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,358 | LTP115L1   |0 | OVL_LTO-3 |   19 | Pool_gromel_LTO | 
LTO-3 | Append|
|   6,359 | 84L3   |0 | OVL_LTO-3 |   20 | Pool_gromel_LTO | 
LTO-3 | Append|
+-++--+---+--+-+---+---+
*


*query
Choose a query (1-20): 7 (List Volumes used by selected JobId)
Enter JobId: 11885
+++
| jobid  | volumename |
+++
| 11,885 | 92L3   |
| 11,885 | 000111L3   |
| 11,885 | LTP113L1   |
| 11,885 | 000345L3   |
| 11,885 | LTP102L1   |
| 11,885 | LTP100L1   |
| 11,885 | 000343L3   |
| 11,885 | 000243L3   |
| 11,885 | 000336L3   |
| 11,885 | 000310L3   |
| 11,885 | 000226L3   |
+++



Le 19/11/2012 07:19, UserMOP a écrit :
 Thanks John,

 We've had these tapes fill up to 420GB in the past (to it's native size). I 
 have added some extra Messages to see if error becomes apparent. We have 
 multiple pools/multiple tapes (up to 50 tapes) they all are full on odd 300GB 
 now days. Tape drive configuration in bacula is unchanged from the time when 
 it used to fill up to 420GB.

 Few lines in bacula-dir config added.

  append = /var/log/bacula/messages.log = all, !skipped
  append = /var/log/bacula/errors.log = error, fatal, terminate
  append = /var/log/bacula/warnings.log = warning, security, alert

 Not sure if I will learn anything new from these, but worth a shot.

 +--
 |This was sent by goran@momento.com.au via Backup Central.
 |Forward SPAM to ab...@backupcentral.com.
 +--



 --
 Monitor your physical, virtual and cloud infrastructure from a single
 web console. Get in-depth insight into apps, servers, databases, vmware,
 SAP, cloud infrastructure, etc. Download 30-day Free Trial.
 Pricing starts from $795 for 25 servers or applications!
 http://p.sf.net/sfu/zoho_dev2dev_nov
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


-- 
Jacky CARIMALO
Université de Nantes
Direction des Systèmes d'Information
Tel : 02 53 48 49 22 (en interne : 22 49 22)
Fax : 02 53 48 49 09

Re: [Bacula-users] Bacula tapes marked FULL too early - VolBytes too low

2012-11-19 Thread Jacky Carimalo 
Le 19/11/2012 12:00, Alan Brown a écrit :
 On 19/11/12 11:04, Jacky Carimalo wrote:
 Hello,
 I have the same problem.
 Bacula stopped filling a tape after 4 errors, as described below !
 I would like to be able to tell it to continue ...
 update Volume={name} VolStatus=append


I did :

update Volume={name} VolStatus=append

but it then marked the volume Used, and not enabled for backup on it 
again, keeping its first data.

Jacky

*messages
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Start Backup 
JobId 12075, 
Job=Backup_gromel1d.univ-nantes.prive_di_LTO.2012-11-19_15.42.45_04
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Volume used 
once. Marking Volume LTP102L1 as Used.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Using Device 
OVL_LTO-3_Drive-1
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot defined 
in catalog (slot=0) for Volume Vol_gromel_6393 on OVL_LTO-3_Drive-1 
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge 
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning: 
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume 
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device 
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot defined 
in catalog (slot=0) for Volume Vol_gromel_6393 on OVL_LTO-3_Drive-1 
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge 
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning: 
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume 
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device 
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot defined 
in catalog (slot=0) for Volume Vol_gromel_6393 on OVL_LTO-3_Drive-1 
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge 
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning: 
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume 
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device 
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot defined 
in catalog (slot=0) for Volume Vol_gromel_6393 on OVL_LTO-3_Drive-1 
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge 
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning: 
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume 
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device 
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: No slot defined 
in catalog (slot=0) for Volume Vol_gromel_6393 on OVL_LTO-3_Drive-1 
(/dev/st1).
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Cartridge 
change or update slots may be required.
19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Warning: 
mount.c:217 Open device OVL_LTO-3_Drive-1 (/dev/st1) Volume 
Vol_gromel_6393 failed: ERR=dev.c:513 Unable to open device 
OVL_LTO-3_Drive-1 (/dev/st1): ERR=Aucun medium trouvé

19-nov. 15:42 bacula.u11.univ-nantes.prive- JobId 12075: Please mount 
Volume Vol_gromel_6393 or label a new one for:
 Job: Backup_gromel1d.univ-nantes.prive_di_LTO.2012-11-19_15.42.45_04
 Storage:  OVL_LTO-3_Drive-1 (/dev/st1)
 Pool: Pool_gromel_LTO
 Media type:   LTO-3


--
Monitor your physical, virtual and cloud infrastructure from a single
web console. Get in-depth insight into apps, servers, databases, vmware,
SAP, cloud infrastructure, etc. Download 30-day Free Trial.
Pricing starts from $795 for 25 servers or applications!
http://p.sf.net/sfu/zoho_dev2dev_nov
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

Re: [Bacula-users] restore : it blocks on empty directory with Current Dir Node has no children

2012-04-02 Thread Jacky Carimalo 
After modifying src/dird/ua_tree.c and recompiling bacula, it's ok now.

It needs comments in src/dird/ua_tree.c :

...
static int cdcmd(UAContext *ua, TREE_CTX *tree)
{
TREE_NODE *node;
char cwd[2000];


if (ua-argc != 2) {
   ua-error_msg(_(Too few or too many arguments. Try using double 
quotes.\n));
   return 1;
}
/*
  * Rem JCA, bug : blocks with Node has no children.
  *  if (!tree_node_has_child(tree-node)) {
  * ua-send_msg(_(Node %s has no children.\n), tree-node-fname);
  * return 1;
  *  }
  */

node = tree_cwd(ua-argk[1], tree-root, tree-node);
if (!node) {
   /* Try once more if Win32 drive -- make absolute */
   if (ua-argk[1][1] == ':') {  /* win32 drive */
  bstrncpy(cwd, /, sizeof(cwd));
  bstrncat(cwd, ua-argk[1], sizeof(cwd));
  node = tree_cwd(cwd, tree-root, tree-node);
   }
   if (!node) {
  ua-warning_msg(_(Invalid path given.\n));
   } else {
  tree-node = node;
   }
} else {
   tree-node = node;
}
return pwdcmd(ua, tree);
}
...

Jacky

Le 22/03/2012 15:29, Jacky Carimalo a écrit :
 Hi,

 I have a problem with restore, that gives :

 With bat, I choose :
 Client, List jobs of client and select a Job,
 Restore from time,
 I obtain the list of files and directories,
 But when I click on an empty directory,
 I have :

 Current Dir Node truc has no children

 and even if I click on another directory, this message stays and I can't
 see anymore the contents of others directories.

 I have the same problem when I restore with the bconsole.

 (For information, brestore works for small jobs, but I have a spinning
 circle for big jobs : it's another problem.)

 Configuration :
  Host: x86_64-linux-gnu -- debian 6.0.4
  Bacula version: Bacula 5.2.6 (21 February 2012)
  Database : PostgreSQL 9.1
  Bat : bat 5.2.6 (21 February 2012)

 Does anyone has the same problem and solution ?

 Thanks
 Jacky



 --
 This SF email is sponsosred by:
 Try Windows Azure free for 90 days Click Here
 http://p.sf.net/sfu/sfd2d-msazure
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


-- 
Jacky CARIMALO
Université de Nantes
Direction des Systèmes d'Information
Tel : 02 53 48 49 22 (en interne : 22 49 22)
Fax : 02 53 48 49 09


--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] tuning for bacula restore, database postgresql

2012-03-27 Thread Jacky Carimalo 
Hi,

I tried to tune bacula restore as described below.
I use now postgresql that is faster than mysql.
With these optimisations, it's better, duration divided by 2,  but do 
you still know how to make shorter the duration of restore ?

Our Configuration :
  Host: x86_64-linux-gnu -- debian 6.0.4 - virtual machine LXC
  Bacula version: Bacula 5.2.6 (21 February 2012)
  Database : PostgreSQL 9.1
  Bat : bat 5.2.6 (21 February 2012)

#cat /proc/sys/kernel/shmmax
12884901888
#cat /proc/sys/kernel/shmall
4194304

Without optimisation in postgresql, Building directory tree for JobId(s) 
... +++ takes about 9 minutes.

We changed values in /etc/postgresql/9.1/main/postgresql.conf :

shared_buffers = 10GB
temp_buffers = 12GB
work_mem = 12GB
maintenance_work_mem = 512MB
synchronous_commit = off# synchronization level; on, 
off, or local
checkpoint_segments = 1024  # in logfile segments, min 1, 
16MB each
checkpoint_completion_target = 0.9  # checkpoint target duration, 
0.0 - 1.0
effective_cache_size = 20GB
track_counts = on

log_destination = 'syslog'

# For Postgresql logs :
silent_mode = on#Run server silently.
log_min_duration_statement = 100 # -1 is disabled, 0 logs all statements
log_line_prefix = '%t [%p]: [%l-1] user=%u,db=%d '
track_counts = on
lc_messages = 'en_US.UTF-8'

And we chose these mounting options in fstab :
/dev/mapper/monbazillac--R2P0L249-bacula--psql--1   
/var/lib/lxc/10-bacula-64/rootfs/var/lib/postgresql xfs 
noatime,inode64,nobarrier 0 0

With these optimisations, Building directory tree for JobId(s) ... 
+++ takes about 7 minutes.

We saw in postgresql logs that a FETCH command took a long time :
bacula LOG:  duration: 276322.521 ms  statement: FETCH 100 FROM _bac_cursor

So I re-compiled bacula with different values for FETCH instead of FETCH 
100.
Now here the durations with these values :

5 000-- 5 min 18 s
25 000  -- 5 min 06 s
100 000-- 4 min 53 s
500 000-- 4 min 43 s
1 000 000 -- 4 min 25 s
1 500 000 -- 5 min 35 s
to have : Building directory tree for JobId(s) ... 
+++

I choose the value : FETCH 100 FROM _bac_cursor

The restore jobs is this one (with console or bat we have nearly the 
same values) :

*restore

Automatically selected FileSet: Set_titeuf
+---+---++-+-+-+
| jobid | level | jobfiles   | jobbytes| starttime   | 
volumename  |
+---+---++-+-+-+
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0056 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0050 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0057 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0058 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0054 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0053 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0051 |
|   127 | F | 12,822,260 | 810,390,999,893 | 2012-03-09 17:51:20 | 
Vol_Complete_0052 |
|   221 | D |546,578 |  72,324,132,233 | 2012-03-23 19:30:03 | 
Vol_Diff_0137 |
|   229 | I | 47 |   9,706,799 | 2012-03-24 19:30:02 | 
Vol_I_0155|
|   236 | I | 45 |   9,782,553 | 2012-03-25 19:30:02 | 
Vol_I_0161|
+---+---++-+-+-+
You have selected the following JobIds: 127,221,229,236

Building directory tree for JobId(s) 127,221,229,236 ... 
+++

11,178,353 files inserted into the tree.

You are now entering file selection mode where you add (mark) and
remove (unmark) files to be restored. No files are initially added, unless
you used the all keyword on the command line.
Enter done to leave this mode.

cwd is: /
$

Thanks for your answers
Jacky


--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

[Bacula-users] restore : it blocks on empty directory with Current Dir Node has no children

2012-03-22 Thread Jacky Carimalo 
Hi,

I have a problem with restore, that gives :

With bat, I choose :
Client, List jobs of client and select a Job,
Restore from time,
I obtain the list of files and directories,
But when I click on an empty directory,
I have :

Current Dir Node truc has no children

and even if I click on another directory, this message stays and I can't 
see anymore the contents of others directories.

I have the same problem when I restore with the bconsole.

(For information, brestore works for small jobs, but I have a spinning 
circle for big jobs : it's another problem.)

Configuration :
Host: x86_64-linux-gnu -- debian 6.0.4
Bacula version: Bacula 5.2.6 (21 February 2012)
Database : PostgreSQL 9.1
Bat : bat 5.2.6 (21 February 2012)

Does anyone has the same problem and solution ?

Thanks
Jacky



--
This SF email is sponsosred by:
Try Windows Azure free for 90 days Click Here 
http://p.sf.net/sfu/sfd2d-msazure
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users