[Bacula-users] Can't restore file spanning across multiple volumes

2011-08-09 Thread Bartosz Cisek
Hi!

I try to restore file from backup, but bacula fails. We backup binlog
files  every 15 minutes. There is only one file in each job. All other
files from this day/week can be restored. This one has one difference,
is placed on two Volumes (204 and 255).

I don't konw if this relevant, but our volumes are ordinary files.
Backup was made when in bacula-sd option

Hardware End of File = no

was not set. I added but didn't help. We use bacula 5.0.3. Any ideas
what went wrong?

bconsole list files jobid=8228320
+-+
| Filename|
+-+
| /var/lib/mysql/mysql-bin.015514 |
+-+

bconsole list jobmedia jobid=8228320
+---+++---+
| JobId | VolumeName | FirstIndex | LastIndex |
+---+++---+
| 8,228,320 | bacula-vtape-backup-000204 |  1 | 1 |
| 8,228,320 | bacula-vtape-backup-000255 |  1 | 1 |
+---+++---+
+---+--+-+--+---+--+--+---+
| JobId | Name | StartTime   | Type
| Level | JobFiles | JobBytes | JobStatus |
+---+--+-+--+---+--+--+---+
| 8,228,320 | job-hostname-bin-logs| 2011-08-07 06:03:48 | B
| I |1 |  113,188 | T |
+---+--+-+--+---+--+--+---+


08-sie 16:25 sd-backup-3 JobId 8246008: 3307 Issuing autochanger unload
slot 233, drive 0 command.
08-sie 16:25 sd-backup-3 JobId 8246008: 3304 Issuing autochanger load
slot 255, drive 0 command.
08-sie 16:25 sd-backup-3 JobId 8246008: 3305 Autochanger load slot 255,
drive 0, status is OK.
08-sie 16:25 sd-backup-3 JobId 8246008: Ready to read from volume
bacula-vtape-backup-000255 on device dev-vtape-backup-drive-0
(/srv/stor1/bacula-backup/vtape-backup-drive-0).
08-sie 16:25 sd-backup-3 JobId 8246008: Forward spacing Volume
bacula-vtape-backup-000255 to file:block 1:4294788096.
08-sie 16:25 sd-backup-3 JobId 8246008: End of Volume at file 1 on
device dev-vtape-backup-drive-0
(/srv/stor1/bacula-backup/vtape-backup-drive-0), Volume
bacula-vtape-backup-000255
08-sie 16:25 sd-backup-3 JobId 8246008: 3307 Issuing autochanger unload
slot 255, drive 0 command.
08-sie 16:25 sd-backup-3 JobId 8246008: 3304 Issuing autochanger load
slot 204, drive 0 command.
08-sie 16:25 sd-backup-3 JobId 8246008: 3305 Autochanger load slot 204,
drive 0, status is OK.
08-sie 16:25 sd-backup-3 JobId 8246008: Ready to read from volume
bacula-vtape-backup-000204 on device dev-vtape-backup-drive-0
(/srv/stor1/bacula-backup/vtape-backup-drive-0).
08-sie 16:25 sd-backup-3 JobId 8246008: Forward spacing Volume
bacula-vtape-backup-000204 to file:block 0:258294.
08-sie 16:25 sd-backup-3 JobId 8246008: End of Volume at file 0 on
device dev-vtape-backup-drive-0
(/srv/stor1/bacula-backup/vtape-backup-drive-0), Volume
bacula-vtape-backup-000204
08-sie 16:25 sd-backup-3 JobId 8246008: End of all volumes.
08-sie 16:25 dir-db-bacula JobId 8246008: Bacula dir-db-bacula 5.0.3
(04Aug10): 08-sie-2011 16:25:04
  Build OS:   x86_64-pc-linux-gnu debian 5.0.6
  JobId:  8246008
  Job:job-restore.2011-08-08_16.25.02_13
  Restore Client: fd-hd-mysql1
  Start time: 08-sie-2011 16:25:04
  End time:   08-sie-2011 16:25:04
  Files Expected: 1
  Files Restored: 0
  Bytes Restored: 0
  Rate:   0.0 KB/s
  FD Errors:  0
  FD termination status:  OK
  SD termination status:  OK
  Termination:Restore OK -- warning file count mismatch

08-sie 16:25 dir-db-bacula JobId 8246008: Begin pruning Jobs older than
10 years .
08-sie 16:25 dir-db-bacula JobId 8246008: No Jobs found to prune.
08-sie 16:25 dir-db-bacula JobId 8246008: Begin pruning Jobs.
08-sie 16:25 dir-db-bacula JobId 8246008: No Files found to prune.
08-sie 16:25 dir-db-bacula JobId 8246008: End auto prune.
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev

Re: [Bacula-users] Can't restore file spanning across multiple volumes

2011-08-10 Thread Bartosz Cisek
W dniu 10.08.2011 15:07, Martin Simmons pisze:

Thanks for reply :)

 It is unclear what went wrong.
 
 The llist command will give a little more information:
 
 llist jobmedia jobid=8228320

bconsole llist jobmedia jobid=8228320
Automatically selected Catalog: catalog
Using Catalog catalog
 JobMediaId: 6,721,875
  JobId: 8,228,320
MediaId: 3,348
 VolumeName: bacula-vtape-backup-000204
 FirstIndex: 1
  LastIndex: 1
  StartFile: 0
EndFile: 0
 StartBlock: 258,294
   EndBlock: 307,813

 JobMediaId: 6,721,874
  JobId: 8,228,320
MediaId: 3,399
 VolumeName: bacula-vtape-backup-000255
 FirstIndex: 1
  LastIndex: 1
  StartFile: 1
EndFile: 0
 StartBlock: 4,294,788,096
   EndBlock: 0

   JobId: 8,228,320
 Job: job-db-mails5-mysql-bin-logs.2011-08-07_06.03.02_57
Name: job-db-mails5-mysql-bin-logs
 PurgedFiles: 0
Type: B
   Level: I
ClientId: 122
Name: fd-db-mails5
   JobStatus: T
   SchedTime: 2011-08-07 06:03:02
   StartTime: 2011-08-07 06:03:48
 EndTime: 2011-08-07 06:04:15
 RealEndTime: 2011-08-07 06:04:15
JobTDate: 1,312,689,855
VolSessionId: 958,674
  VolSessionTime: 1,305,911,228
JobFiles: 1
   JobErrors: 0
 JobMissingFiles: 0
  PoolId: 11
PooLname: pool-vtape-backup-daily
  PriorJobId: 0
   FileSetId: 14
 FileSet: fs-mysql-bin-logs


 You could also try running the bacula-fd at debug level 200 and
 collect the output.

I set debug level to 200 (with setdebug command) and told bacula-fd
client to send back to director all messages, but nothing new arrived.
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
uberSVN's rich system and user administration capabilities and model 
configuration take the hassle out of deploying and managing Subversion and 
the tools developers use with it. Learn more about uberSVN and get a free 
download at:  http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can't restore file spanning across multiple volumes

2011-08-11 Thread Bartosz Cisek
=36387
fd-hd-mysql1: job.c:263-0 dird: Hello Director dir-db-bacula calling
fd-hd-mysql1: job.c:279-0 Executing Hello command.
fd-hd-mysql1: job.c:423-0 Calling Authenticate
fd-hd-mysql1: cram-md5.c:73-0 send: auth cram-md5
1933690469.1313041199@fd-hd-mysql1 ssl=0
fd-hd-mysql1: cram-md5.c:133-0 cram-get received: auth cram-md5
1448676872.1313041199@dir-db-bacula ssl=0
fd-hd-mysql1: cram-md5.c:152-0 sending resp to challenge:
0++157k0f1hAy5++M7/TVC
fd-hd-mysql1: job.c:427-0 OK Authenticate
fd-hd-mysql1: job.c:263-0 dird: JobId=0
Job=-Console-.2011-08-11_07.38.45_19 SDid=0 SDtime=0 Authorization=dummy
fd-hd-mysql1: job.c:279-0 Executing JobId= command.
fd-hd-mysql1: job.c:520-0 JobId=0 Auth=dummy
fd-hd-mysql1: fd_plugins.c:655-0 plugin list is NULL
fd-hd-mysql1: job.c:263-0 dird: setdebug=0 trace=0
fd-hd-mysql1: job.c:279-0 Executing setdebug= command.
fd-hd-mysql1: job.c:472-0 setdebug_cmd: setdebug=0 trace=0

Thanks Martin :)
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. 
http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can't restore file spanning across multiple volumes

2011-08-11 Thread Bartosz Cisek
W dniu 10.08.2011 20:00, Martin Simmons pisze:
 On Wed, 10 Aug 2011 16:40:40 +0200, Bartosz Cisek said:
 Add trace=1 to the setdebug command and look for the bacula-fd.trace file in
 the working directory.

I did some research, and found two things:

1. There are other one-file jobs that span across volumens, and they
restore without problems. So crossing volumens is not a problem here.
2. I found other (three) jobs with problems. All of them behave in the
same way as one decribed earlier. They differ from working job by having
EndBlock set to 0 (zero).

SELECT JobId FROM JobMedia WHERE StartBlock  0 AND EndBlock = 0;
+-+
| JobId   |
+-+
| 8208817 |
| 8208813 |
| 8228320 |
+-+

mysql select * from JobMedia where JobId = 8208813\G
*** 1. row ***
JobMediaId: 6704362
 JobId: 8208813
   MediaId: 3205
FirstIndex: 1
 LastIndex: 1
 StartFile: 1
   EndFile: 0
StartBlock: 4285650808
  EndBlock: 0
  VolIndex: 1
Stripe: 0
*** 2. row ***
JobMediaId: 6704363
 JobId: 8208813
   MediaId: 3289
FirstIndex: 1
 LastIndex: 1
 StartFile: 0
   EndFile: 0
StartBlock: 132125823
  EndBlock: 132146970
  VolIndex: 2
Stripe: 0
2 rows in set (0.00 sec)

mysql select * from JobMedia where JobId = 8208817\G
*** 1. row ***
JobMediaId: 6704358
 JobId: 8208817
   MediaId: 3205
FirstIndex: 1
 LastIndex: 1
 StartFile: 1
   EndFile: 0
StartBlock: 4290489208
  EndBlock: 0
  VolIndex: 1
Stripe: 0
*** 2. row ***
JobMediaId: 6704359
 JobId: 8208817
   MediaId: 3289
FirstIndex: 1
 LastIndex: 1
 StartFile: 0
   EndFile: 0
StartBlock: 131993018
  EndBlock: 131996798
  VolIndex: 2
Stripe: 0

mysql select * from JobMedia where JobId = 8228320\G
*** 1. row ***
JobMediaId: 6721875
 JobId: 8228320
   MediaId: 3348
FirstIndex: 1
 LastIndex: 1
 StartFile: 0
   EndFile: 0
StartBlock: 258294
  EndBlock: 307813
  VolIndex: 2
Stripe: 0
*** 2. row ***
JobMediaId: 6721874
 JobId: 8228320
   MediaId: 3399
FirstIndex: 1
 LastIndex: 1
 StartFile: 1
   EndFile: 0
StartBlock: 4294788096
  EndBlock: 0
  VolIndex: 1
Stripe: 0
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. 
http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can't restore file spanning across multiple volumes

2011-08-12 Thread Bartosz Cisek
W dniu 11.08.2011 20:47, Martin Simmons pisze:
 I did some research, and found two things:

 1. There are other one-file jobs that span across volumens, and they
 restore without problems. So crossing volumens is not a problem here.
 2. I found other (three) jobs with problems. All of them behave in the
 same way as one decribed earlier. They differ from working job by having
 EndBlock set to 0 (zero).
 
 Hmm, it looks like that might be the problem.  I had assumed that EndBlock=0
 was normal, but it might not be.

According to block.c [1] it looks like:
- EndBlock holds 32 less significant bits of block address
- EndFile holds 32 most significant bits of block address

In that case both fields set to 0, point to beginning of Volumen. Do I
miss something?

As a side note, variable names were completely misleading to me :/

 The trace output didn't show the filename to restore, so that suggests that
 the bacula-fd didn't see data from the first volume, hence it didn't create
 the file.
 
 What to the JobMedia entries look like for working jobs span across volumes?

mysql select * from JobMedia where JobId = 8280214\G
*** 1. row ***
JobMediaId: 6768001
 JobId: 8280214
   MediaId: 3339
FirstIndex: 1
 LastIndex: 1
 StartFile: 0
   EndFile: 0
StartBlock: 258294
  EndBlock: 6868847
  VolIndex: 2
Stripe: 0
*** 2. row ***
JobMediaId: 6767996
 JobId: 8280214
   MediaId: 3393
FirstIndex: 1
 LastIndex: 1
 StartFile: 1
   EndFile: 1
StartBlock: 4262595384
  EndBlock: 4294942311
  VolIndex: 1
Stripe: 0


[1]
http://www.bacula.org/git/cgit.cgi/bacula/tree/bacula/src/stored/block.c#n620
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. 
http://p.sf.net/sfu/wandisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Can't restore file spanning across multiple volumes

2011-08-17 Thread Bartosz Cisek
W dniu 12.08.2011 10:56, Bartosz Cisek pisze:
 Hmm, it looks like that might be the problem.  I had assumed that EndBlock=0
 was normal, but it might not be.

Unfortunatelly problem is still present. Recently (12 Aug) new  damaged
job was created.

mysql select * from JobMedia where JobId = 8295338\G
*** 1. row ***
JobMediaId: 6782485
 JobId: 8295338
   MediaId: 3236
FirstIndex: 1
 LastIndex: 1
 StartFile: 1
   EndFile: 0
StartBlock: 4290555760
  EndBlock: 0
  VolIndex: 1
Stripe: 0
*** 2. row ***
JobMediaId: 6782486
 JobId: 8295338
   MediaId: 3388
FirstIndex: 1
 LastIndex: 1
 StartFile: 0
   EndFile: 0
StartBlock: 591598
  EndBlock: 650764
  VolIndex: 2
Stripe: 0
2 rows in set (0.00 sec)
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
Get a FREE DOWNLOAD! and learn more about uberSVN rich system, 
user administration capabilities and model configuration. Take 
the hassle out of deploying and managing Subversion and the 
tools developers use with it. http://p.sf.net/sfu/wandisco-d2d-2
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula Status + Bacula 5.2.0 release

2011-10-27 Thread Bartosz Cisek
W dniu 26.10.2011 17:09, Kern Sibbald pisze:
 3. Bacula Release version 5.2.0
 
 Bacula version 5.2.0 is ready.  However, I have been holding it back 
 because the normal community testing is not happening.  The only user 
 helping us to test is DassIT (thanks very much). This means that the new 
 version has not been tested enough on FreeBSD, Mac OS, and Solaris.
 That said, I have done preliminary building and testing on Mac OS and
 a number of Linux releases (RedHat, Ubuntu, SLES).
 
 This is a major feature upgrade with quite a number of bug fixes as 
 well.  It is in the current git repo (hosted on bacula.org).
 In any case, we will be releasing it probably this weekend -- hopefully 
 by then community members will have done additional testing.

I wanted to test bacula 5.2.0 but in git there is no such tag [1]. I
finally found some code archives [2] that looks a bit old (2011-08-05).

My proposition is to create new branch (Bacula-5.2.0) in git that will
be dedicated to this release and contain latest fixes.

B.

[1] http://www.bacula.org/git/cgit.cgi/bacula/
[2] http://sourceforge.net/projects/bacula/files/bacula/5.2.0rc1/
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
The demand for IT networking professionals continues to grow, and the
demand for specialized networking skills is growing even more rapidly.
Take a complimentary Learning@Cisco Self-Assessment and learn 
about Cisco certifications, training, and career opportunities. 
http://p.sf.net/sfu/cisco-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Updating from debian package 5.0.2 to current version

2012-01-18 Thread Bartosz Cisek
W dniu 18.01.2012 08:30, Geert Stappers pisze:
 Op 20120117 om 15:08 schreef Richard Marnau:
 Hi all,

 I'm wondering which steps I actually have to do to upgrade from the
 default debian repository bacula to the current version.
 I did download the current version and compiled (make / make install)
konso the files. What are the next steps?
 Are there any database upgrades necessary?
 
 More questions:
 
 What does the Bacula Release notes say?
 Which item in the Bacula Changelog triggered you to start an upgrade?
 How went the upgrade of a Bacula client?
 Where will you publish your success story?
 Are you familiar with http://alioth.debian.org/projects/pkg-bacula ?

On github [1] I published my attempts to port 5.2.3 into stable
(squeeze) and old-stable (lenny). Old-stalbe port doesn't contain bat
and try-icon-monitor as I had no time to play with QT dependency. QT
library present in lenny is too old.

Some basic build instruction you can find on WiKi.

[1] https://github.com/naszaklasa/bacula
-- 
Bartosz Cisek
Admin

email: bartosz.ci...@nasza-klasa.pl
tel: +48 519 300 122

Nasza Klasa Sp. z o.o.,
ul. Gen. J. Bema 2, 50-265 Wrocław

Sąd Rejonowy dla Wrocławia - Fabrycznej we Wrocławiu,
VI Wydział Gospodarczy Krajowego Rejestru Sądowego,
nr KRS:289629, NIP:898-21-22-104 REGON:020586020,
Kapitał zakładowy: 67 850,00 PLN

--
Keep Your Developer Skills Current with LearnDevNow!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-d2d
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users