Re: [Bacula-users] What happen if I delete a single incremental between the full and another incremental

2010-10-18 Thread Graham Keeling
On Sat, Oct 16, 2010 at 09:33:13AM +0200, Hugo Letemplier wrote:
 Hi thanks a lot for your answers
 
 I have retried with a new test scenario its clear now and deleting an 
 incremental is really dangerous.
 But I think that a function that enable the administrator to join 2 jobs 
 would be cool.
 Imagine that one day lots of data manipulation are done on the machine that I 
 want to backup, so there is a great difference between 2 incremental. The 
 jobs are done, and deleting one job is dangerous for the jobs that follows
 In this case, that would be great to mix 2 jobs.
 Its quite complicated to explain I know.
 Take a look at this little scenario, a classical Full with his incremental 
 jobs : the client is typically a big file server
 
 1 - The full
 2 - an incremental
 3 - someone make a mistake while he was exploring the file server he made 
 lots of copy of files in the server (for example : a bad drag and drop).
 4 - a nightly scheduled incremental 
 5 - the administrator see that the last incremental got a lot of new files 
 and that job bytes got a huge value.
 5 - the user see his error and deletes the duplicates
 6 - a new incremental is ran
 7 - after checking everything, I want to reduce the size of my backups by 
 fusioning the two last incrementals. The idea is to add new files of step 4 
 to step 6 but without the files deleted at step 6
 
 In a mathematical view, it can be seen like that : Inc6.1 = Inc4 - (Files of 
 Inc4 deleted at Inc6.0) + (new files of inc6.0) +  (crush files modified 
 after Inc4 with their version of inc6.0)
 
 I hope that it can be understood more easily than the previous post !

Perhaps a VirtualFull backup is what you are looking for?

 Thanks a lot 
 
 Hugo
 
 Le 13 oct. 2010 à 17:53, Jari Fredriksson a écrit :
 
  On 13.10.2010 18:21, Hugo Letemplier wrote:
  Hi,
  I have an important question that will help me validating some specs
  about bacula 5.0.2
  Imagine the following scenario:
  1 - a full
  2 - an incremental
  3 - an incremental
  4 - another incremental
  
  if I delete the incremental of step 3, does it move the files that
  have been added during step 3 onto the incremental of step 4
  
  I have tried this scenario but my result is not clear. Can you tell me
  your experience ?
  
  In other words: can I delete one Incremental without deleting more
  recents incrementals or if I delete the full does it upgrade the first
  incremental into full ?
  
  
  I *think* Bacula uses timestamps when doing incrementals. if you delete
  one incremental, you lose the files modified/created for that day.
  
  But if you delete the full, Bacula upgrades the next incremental to
  Full, as it finds no suitable Full to do the incremental for.
  
  
  --
  Beautiful is writing same markup. Internet Explorer 9 supports
  standards for HTML5, CSS3, SVG 1.1,  ECMAScript5, and DOM L2  L3.
  Spend less time writing and  rewriting code and more time creating great
  experiences on the web. Be a part of the beta today.
  http://p.sf.net/sfu/beautyoftheweb
  ___
  Bacula-users mailing list
  Bacula-users@lists.sourceforge.net
  https://lists.sourceforge.net/lists/listinfo/bacula-users
 
 
 --
 Download new Adobe(R) Flash(R) Builder(TM) 4
 The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
 Flex(R) Builder(TM)) enable the development of rich applications that run
 across multiple browsers and platforms. Download your free trials today!
 http://p.sf.net/sfu/adobe-dev2dev
 ___
 Bacula-users mailing list
 Bacula-users@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-users


--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] get_file_record want 1 got rows=2 after migration from MySQL to PostgreSQL

2010-10-18 Thread Robert Oschwald
Hi folks,

I migrated Bacula 5.0.2 from MySQL to Bacula 5.0.3 PostgreSQL 8.1, 
and then migrated to PostgreSQL 8.2 using dump/restore.
Speed is dramatically better than with MySQL (I will post my postgresql 
settings if one is interested).

Now when I  use BAT to simulate a restore to recent, I get this messages in 
stderr when I klick on one of the files:

sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=80991 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=80796 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=307 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=2 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=80992 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=311 FilenameId=439
sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
PathId=9 FilenameId=439


This is what I got in the db (example for the first error message):
select * from file where PathId=80991 and filenameId = 439;

fileid;fileindex;jobid;pathid;filenameid;markid;lstat;md5
195262190;196703;2686;80991;439;0;P0G C EHt G A A A BAA BAA I BMdWat BLepez 
BLxIbv A A E;0
198655792;3590305;2686;80991;439;0;P0G C EHt G A A A BAA BAA I BMdY3i BLepez 
BLxIbv A A E;0
219621970;3509726;2860;80991;439;0;P0G C EHt G A A A BAA BAA I BMiAMX BLepez 
BLxIbv A A E;0
216309113;196869;2860;80991;439;0;P0G C EHt G A A A BAA BAA I BMh9us BLepez 
BLxIbv A A E;0
229856219;3519412;2941;80991;439;0;P0G C EHt G A A A BAA BAA I BMkT04 BLepez 
BLxIbv A A E;0
226533758;196951;2941;80991;439;0;P0G C EHt G A A A BAA BAA I BMkRX8 BLepez 
BLxIbv A A E;0
241079525;3535279;3036;80991;439;0;P0G C EHt G A A A BAA BAA I BMmzt1 BLepez 
BLxIbv A A E;0
237741269;197023;3036;80991;439;0;P0G C EHt G A A A BAA BAA I BMmotw BLepez 
BLxIbv A A E;0
247155517;197101;3121;80991;439;0;P0G C EHt G A A A BAA BAA I BMo4tF BLepez 
BLxIbv A A E;0
250493865;3535449;3121;80991;439;0;P0G C EHt G A A A BAA BAA I BMo7JE BLepez 
BLxIbv A A E;0
255954922;3541015;3203;80991;439;0;P0G C EHt G A A A BAA BAA I BMrOz/ BLepez 
BLxIbv A A E;0
252610691;196784;3203;80991;439;0;P0G C EHt G A A A BAA BAA I BMrMV4 BLepez 
BLxIbv A A E;0
257085143;196784;3210;80991;439;0;P0G C EHt G A A A BAA BAA I BMrMV4 BLepez 
BLxIbv A A E;0
260429374;3541015;3210;80991;439;0;P0G C EHt G A A A BAA BAA I BMrOz/ BLepez 
BLxIbv A A E;0
262984244;197169;3289;80991;439;0;P0G C EHt G A A A BAA BAA I BMtgAj BLepez 
BLxIbv A A E;0
266357999;3570924;3289;80991;439;0;P0G C EHt G A A A BAA BAA I BMtidh BLepez 
BLxIbv A A E;0
270866064;3570924;3296;80991;439;0;P0G C EHt G A A A BAA BAA I BMtidh BLepez 
BLxIbv A A E;0
267492309;197169;3296;80991;439;0;P0G C EHt G A A A BAA BAA I BMtgAj BLepez 
BLxIbv A A E;0


Migration from MySQL to PostgreSQL steps I've done:
mysqldump -t -q -n -c --compatible=postgresql --skip-quote-names --skip-opt 
--disable-keys --lock-tables -u bacula -ppassword bacula \
  | grep -v INSERT INTO Status \
  | sed -e 's/-00-00 00:00:00/1970-01-01 00:00:00/g' \
  | sed -e 's/\\0//'  /B2D/bacula_mysql_dump_in_postgresql-format.sql

install postgresql-8.1 (CentOS 5 x86_64)
install bacula-postgresql

create_postgresql_database
make_postgresql_tables
grant_postgresql_privileges

psql -Ubacula bacula  bacula_mysql_dump_in_postgresql-format.sql

Reset sequences:
SELECT SETVAL('basefiles_baseid_seq', (SELECT MAX(baseid) FROM basefiles));
SELECT SETVAL('client_clientid_seq', (SELECT MAX(clientid) FROM client));
SELECT SETVAL('file_fileid_seq', (SELECT MAX(fileid) FROM file));
SELECT SETVAL('filename_filenameid_seq', (SELECT MAX(filenameid) FROM 
filename));
SELECT SETVAL('fileset_filesetid_seq', (SELECT MAX(filesetid) FROM fileset));
SELECT SETVAL('job_jobid_seq', (SELECT MAX(jobid) FROM job));
SELECT SETVAL('jobmedia_jobmediaid_seq', (SELECT MAX(jobmediaid) FROM 
jobmedia));
SELECT SETVAL('media_mediaid_seq', (SELECT MAX(mediaid) FROM media));
SELECT SETVAL('path_pathid_seq', (SELECT MAX(pathid) FROM path));
SELECT SETVAL('basefiles_baseid_seq', (SELECT MAX(baseid) FROM basefiles));
SELECT SETVAL('client_clientid_seq', (SELECT MAX(clientid) FROM client));
SELECT SETVAL('file_fileid_seq', (SELECT MAX(fileid) FROM file));
SELECT SETVAL('filename_filenameid_seq', (SELECT MAX(filenameid) FROM 
filename));
SELECT SETVAL('fileset_filesetid_seq', (SELECT MAX(filesetid) FROM fileset));
SELECT SETVAL('job_jobid_seq', (SELECT MAX(jobid) FROM job));
SELECT SETVAL('jobmedia_jobmediaid_seq', (SELECT MAX(jobmediaid) FROM 
jobmedia));
SELECT SETVAL('media_mediaid_seq', (SELECT MAX(mediaid) FROM media));
SELECT SETVAL('path_pathid_seq', (SELECT MAX(pathid) FROM path));
SELECT SETVAL('pool_poolid_seq', (SELECT MAX(poolid) FROM pool));
SELECT SETVAL('device_deviceid_seq', (SELECT MAX(deviceid) FROM device));
SELECT 

[Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Holikar, Sachin (ext)
Hello,

We have a Bacula  Version: 2.2.7 installed on SuSE 9 Linux. The database is 
mysql  Ver 14.7.

Bacula has been running since couple of years now. We noticed that the mysql 
partition where Write Bootstrap files (*.bsr) are stored is increased alot.
Particularly bacula.sql file is grown to 6 GB now. Which is the backup of the 
catalog file.

Now,

1Is there anyway we can move this (and other .bsr) files to someother 
location having large space without affecting Bacula functionality?
2Can we somehow reduce the size of this file? Compression ?

Please let me know if you require any more information.

Thanx,
Admin

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] What happen if I delete a single incremental between the full and another incremental

2010-10-18 Thread Gavin McCullagh
On Mon, 18 Oct 2010, Graham Keeling wrote:

 On Sat, Oct 16, 2010 at 09:33:13AM +0200, Hugo Letemplier wrote:
  Hi thanks a lot for your answers
  
  I have retried with a new test scenario its clear now and deleting an 
  incremental is really dangerous.
  But I think that a function that enable the administrator to join 2 jobs 
  would be cool.
  Imagine that one day lots of data manipulation are done on the machine that 
  I want to backup, so there is a great difference between 2 incremental. The 
  jobs are done, and deleting one job is dangerous for the jobs that follows
  In this case, that would be great to mix 2 jobs.
  Its quite complicated to explain I know.
  Take a look at this little scenario, a classical Full with his incremental 
  jobs : the client is typically a big file server

  I hope that it can be understood more easily than the previous post !
 
 Perhaps a VirtualFull backup is what you are looking for?

Or a differential maybe?

Gavin



--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Damian Ge ; bicki
Holikar, Sachin (ext) wrote:
 Hello,
  
 We have a Bacula  Version: 2.2.7 installed on SuSE 9 Linux. The database 
 is mysql  Ver 14.7.
  
 Bacula has been running since couple of years now. We noticed that the 
 mysql partition where Write Bootstrap files (*.bsr) are stored is 
 increased alot.
 Particularly bacula.sql file is grown to 6 GB now. Which is the 
 *backup of the catalog file.*
 ** 
 Now,
  
 1Is there anyway we can move this (and other .bsr) files to 
 someother location having large space without affecting Bacula 
 functionality?
 2Can we somehow reduce the size of this file? Compression ?
 
 Please let me know if you require any more information.
  

.bsr
Did you look into this file?
Its looks like scheduler do only Incremental backup of Catalog database.
Just try to rename this file and new record will be write to new one 
after next CatalogDB backup.

-- 
=
Damian

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Holikar, Sachin (ext)

Hello,

I agree if I rename just the file name in bacula-dir.conf , it will start to 
write in a new file.
But the point is the file which has grown in size is bacula.sql.
So this is the actual file in question. Can we do something about this file?


Thanx,
Admin

-Original Message-
From: Damian Ge;bicki [mailto:dami...@wasko.pl] 
Sent: Montag, 18. Oktober 2010 11:26
To: Holikar, Sachin (ext)
Cc: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula mysql cleanup

Holikar, Sachin (ext) wrote:
 Hello,
  
 We have a Bacula  Version: 2.2.7 installed on SuSE 9 Linux. The database 
 is mysql  Ver 14.7.
  
 Bacula has been running since couple of years now. We noticed that the 
 mysql partition where Write Bootstrap files (*.bsr) are stored is 
 increased alot.
 Particularly bacula.sql file is grown to 6 GB now. Which is the 
 *backup of the catalog file.*
 ** 
 Now,
  
 1Is there anyway we can move this (and other .bsr) files to 
 someother location having large space without affecting Bacula 
 functionality?
 2Can we somehow reduce the size of this file? Compression ?
 
 Please let me know if you require any more information.
  

.bsr
Did you look into this file?
Its looks like scheduler do only Incremental backup of Catalog database.
Just try to rename this file and new record will be write to new one 
after next CatalogDB backup.

-- 
=
Damian

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Damian Ge ; bicki
Holikar, Sachin (ext) wrote:
  Hello,
 
  I agree if I rename just the file name in bacula-dir.conf , it will 
start to write in a new file.
  But the point is the file which has grown in size is bacula.sql.
  So this is the actual file in question. Can we do something about 
this file?
 

I understand - you ask about .bsr file

  1Is there anyway we can move this (and other .bsr) files to
  someother location having large space without affecting Bacula
  functionality?
  2Can we somehow reduce the size of this file? Compression ?


The bacula.sql, if I good remember, it's your main CatalgoDB - sqlite.

The best method is migration to Postgres or MySql.
My database size reduce from 400MB to 150MB when I've done it.
But if you don't want do it, just try to reduce your jobs retention.

There is another way - try to export import procedure.

# sqlite bacula.sql .dump  dump.sql  # dump
# sqlite new_bacula.sql  dump.sql  # restore

sometimes you can reduce db size but no guarantee






-- 
=
Damian

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Alan Brown
Damian Ge;bicki wrote:

 The bacula.sql, if I good remember, it's your main CatalgoDB - sqlite.

The original poster is using mysql, not sqlite.

bacula.sql is his database dump - it's a plain ascii text file.

It can be compressed with gzip, bzip2, etc etc and you should keep 
multiple copies around (use logrotate or a similar program to maintain it)

6Gb is a small database dump, as far as Bacula use goes. Mine is in 
excess of 40Gb.


sqlite is only included for testing purposes and should not be used in a 
production environment.



--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Bruno Friedmann
On 10/18/2010 11:06 AM, Holikar, Sachin (ext) wrote:
 Hello,
 
 We have a Bacula  Version: 2.2.7 installed on SuSE 9 Linux. The database is 
 mysql  Ver 14.7.
 
 Bacula has been running since couple of years now. We noticed that the mysql 
 partition where Write Bootstrap files (*.bsr) are stored is increased alot.
 Particularly bacula.sql file is grown to 6 GB now. Which is the backup of 
 the catalog file.
 
 Now,
 
 1Is there anyway we can move this (and other .bsr) files to someother 
 location having large space without affecting Bacula functionality?
 2Can we somehow reduce the size of this file? Compression ?
 
 Please let me know if you require any more information.
 
 Thanx,
 Admin
 

Normally the bacula.sql file is removed each night after the catalog database 
job
bacula.sql is the pure sql dump file which is pushed in the job catalog 
database.
after that the bacula.sql should/can be remove

here's a typicall catalog job that should be true for a 2.2.7 version

# Backup the catalog database (after the nightly save)
Job {
  Name = BackupCatalog
  JobDefs = DefBackupJob
  Level = Full
  Client = yoda-fd
  FileSet=FileSet_Catalog
  Pool = Pool_Catalog
  Storage = Store_FSSQL
  Schedule = Schedule_QuotidienCatalog
  # This creates an ASCII copy of the catalog
  RunBeforeJob = /usr/lib/bacula/make_catalog_backup bacula bacula bacula
  # This deletes the copy of the catalog -- SEE THAT
  RunAfterJob  = /usr/lib/bacula/delete_catalog_backup
  Write Bootstrap = /var/lib/bacula/BackupCatalog.bsr
  Priority = 20 # run after 
main backup
}

It seem you miss the RunAfterJob ...



-- 

Bruno Friedmann (irc:tigerfoot)
Ioda-Net Sàrl www.ioda-net.ch
 openSUSE Member
User www.ioda.net/r/osu
Blog www.ioda.net/r/blog
  fsfe fellowship www.fsfe.org
GPG KEY : D5C9B751C4653227
vcard : http://it.ioda-net.ch/ioda-net.vcf

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Holikar, Sachin (ext)
 
You are right Alan.
It's a database dump file. 
So you mean to say that I can compress the current file and rename it. So that 
next time 
Mysql will start writing onto new bacula.sql file?
Will it not affect the functionality of mysql and in turn bacula any way?
More importantly ,we wish to change the location of this directory itself.
Currently it is ,

Oldhome/tape/

Which we wish to change to new NFS share,

Newhome/tape

I hope that should not matter atall.

Any idea where to make appropriate changes for it to take effect?

Thanx,
Admin

-Original Message-
From: Alan Brown [mailto:a...@mssl.ucl.ac.uk] 
Sent: Montag, 18. Oktober 2010 12:55
To: Damian Ge;bicki
Cc: Holikar, Sachin (ext); bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula mysql cleanup

Damian Ge;bicki wrote:

 The bacula.sql, if I good remember, it's your main CatalgoDB - sqlite.

The original poster is using mysql, not sqlite.

bacula.sql is his database dump - it's a plain ascii text file.

It can be compressed with gzip, bzip2, etc etc and you should keep 
multiple copies around (use logrotate or a similar program to maintain it)

6Gb is a small database dump, as far as Bacula use goes. Mine is in 
excess of 40Gb.


sqlite is only included for testing purposes and should not be used in a 
production environment.



--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] get_file_record want 1 got rows=2 after migration from MySQL to PostgreSQL

2010-10-18 Thread Rory Campbell-Lange
On 18/10/10, Robert Oschwald (r...@symentis.com) wrote:
 I migrated Bacula 5.0.2 from MySQL to Bacula 5.0.3 PostgreSQL 8.1, 
 and then migrated to PostgreSQL 8.2 using dump/restore.

 Speed is dramatically better than with MySQL (I will post my
 postgresql settings if one is interested).
 
 Now when I  use BAT to simulate a restore to recent, I get this messages in 
 stderr when I klick on one of the files:
 
 sql_get.c:156-0 === Problem!  sql_get.c:155 get_file_record want 1 got rows=2 
 PathId=80991 FilenameId=439

Hi Robert

I haven't experienced this issue myself, but what is happening is that in
sql_get.c the following error is being triggered:

   if (QUERY_DB(jcr, mdb, mdb-cmd)) {
  mdb-num_rows = sql_num_rows(mdb);
  Dmsg1(050, get_file_record num_rows=%d\n, (int)mdb-num_rows); 
  if (mdb-num_rows  1) {
 Mmsg1(mdb-errmsg, _(get_file_record want 1 got rows=%d\n), --- 
error
mdb-num_rows);
  }

Bacula is getting 2 records for the database records for the specified paths 
and files.

It may be that you have inadvertently imported the data twice.

-- 
Rory Campbell-Lange
r...@campbell-lange.net

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Damian Ge ; bicki
Alan Brown wrote:
 Damian Ge;bicki wrote:

 The bacula.sql, if I good remember, it's your main CatalgoDB - sqlite.
 
 The original poster is using mysql, not sqlite.
 
 bacula.sql is his database dump - it's a plain ascii text file.
 
 It can be compressed with gzip, bzip2, etc etc and you should keep 
 multiple copies around (use logrotate or a similar program to maintain it)
 
 6Gb is a small database dump, as far as Bacula use goes. Mine is in 
 excess of 40Gb.
 
 
 sqlite is only included for testing purposes and should not be used in a 
 production environment.
 
 
Right, I forgot.
A long time ago I started use dbpipe plugin and I backup my catalog DB 
to tape directly.
I don't need disk space for dump - bacula.sql.
Maybe, this is resolution for you?

-- 
=
Damian

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Holikar, Sachin (ext)

Hi Bruno,

You hit the bullz eye!!

I read both the scripts

make_catalog_backup   delete_catalog_backup.

Found that previous admin has modified this script.

After the statement ,

mysqldump -u ${2}${MYSQLPASSWORD}${MYSQLHOST} -f --opt $1 

He is copying the bacula.sql file onto the location where it is currently has 
grown to 6 GB in size.

I am not sure why he is doing it ... Any guesses?

But I guess I can remove this step and simply delete the bacula.sql ( 6 GB) 
file. 

Please correct me if I am wrong.


Thanx,
Admin 

-Original Message-
From: Bruno Friedmann [mailto:br...@ioda-net.ch] 
Sent: Montag, 18. Oktober 2010 12:59
To: bacula-users@lists.sourceforge.net
Subject: Re: [Bacula-users] Bacula mysql cleanup

On 10/18/2010 11:06 AM, Holikar, Sachin (ext) wrote:
 Hello,
 
 We have a Bacula  Version: 2.2.7 installed on SuSE 9 Linux. The database is 
 mysql  Ver 14.7.
 
 Bacula has been running since couple of years now. We noticed that the mysql 
 partition where Write Bootstrap files (*.bsr) are stored is increased alot.
 Particularly bacula.sql file is grown to 6 GB now. Which is the backup of 
 the catalog file.
 
 Now,
 
 1Is there anyway we can move this (and other .bsr) files to someother 
 location having large space without affecting Bacula functionality?
 2Can we somehow reduce the size of this file? Compression ?
 
 Please let me know if you require any more information.
 
 Thanx,
 Admin
 

Normally the bacula.sql file is removed each night after the catalog database 
job
bacula.sql is the pure sql dump file which is pushed in the job catalog 
database.
after that the bacula.sql should/can be remove

here's a typicall catalog job that should be true for a 2.2.7 version

# Backup the catalog database (after the nightly save)
Job {
  Name = BackupCatalog
  JobDefs = DefBackupJob
  Level = Full
  Client = yoda-fd
  FileSet=FileSet_Catalog
  Pool = Pool_Catalog
  Storage = Store_FSSQL
  Schedule = Schedule_QuotidienCatalog
  # This creates an ASCII copy of the catalog
  RunBeforeJob = /usr/lib/bacula/make_catalog_backup bacula bacula bacula
  # This deletes the copy of the catalog -- SEE THAT
  RunAfterJob  = /usr/lib/bacula/delete_catalog_backup
  Write Bootstrap = /var/lib/bacula/BackupCatalog.bsr
  Priority = 20 # run after 
main backup
}

It seem you miss the RunAfterJob ...



-- 

Bruno Friedmann (irc:tigerfoot)
Ioda-Net Sàrl www.ioda-net.ch
 openSUSE Member
User www.ioda.net/r/osu
Blog www.ioda.net/r/blog
  fsfe fellowship www.fsfe.org
GPG KEY : D5C9B751C4653227
vcard : http://it.ioda-net.ch/ioda-net.vcf

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Phil Stracchino
On 10/18/10 07:21, Holikar, Sachin (ext) wrote:
 
 Hi Bruno,
 
 You hit the bullz eye!!
 
 I read both the scripts
 
 make_catalog_backup   delete_catalog_backup.
 
 Found that previous admin has modified this script.
 
 After the statement ,
 
 mysqldump -u ${2}${MYSQLPASSWORD}${MYSQLHOST} -f --opt $1 
 
 He is copying the bacula.sql file onto the location where it is currently has 
 grown to 6 GB in size.
 
 I am not sure why he is doing it ... Any guesses?
 
 But I guess I can remove this step and simply delete the bacula.sql ( 6 GB) 
 file. 
 
 Please correct me if I am wrong.

Well, without seeing the script, we're somewhat guessing. Personally, I
keep my catalog dumps around because if something crashes my database,
it's faster to just reload the last database than to do a bscan.
However, I'm currently working on moving to a snapshot-based backup
instead, in which I won't have a dump file at all, and will in fact
simply take filesystem snapshots for my incremental database backups and
keep the most recent snapshot around until the next night's backup has
been completed.


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Damian Ge ; bicki
Phil Stracchino wrote:
 On 10/18/10 07:21, Holikar, Sachin (ext) wrote:
 
 Well, without seeing the script, we're somewhat guessing. Personally, I
 keep my catalog dumps around because if something crashes my database,
 it's faster to just reload the last database than to do a bscan.
 However, I'm currently working on moving to a snapshot-based backup
 instead, in which I won't have a dump file at all, and will in fact
 simply take filesystem snapshots for my incremental database backups and
 keep the most recent snapshot around until the next night's backup has
 been completed.
 
 
Yes, but the only 100% way to recover from disaster (backup server) is 
Catalog copy on dedicated media - tape media.


-- 
=
Damian

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bcp, Bacula CoPy

2010-10-18 Thread Geert Stappers
Op 20101018 om 03:45 schreef Dan Langille:
 On 10/11/2010 4:55 AM, Geert Stappers wrote:
 
  bcp, Bacula CoPy, copies files from one bacula file daemon to
  another bacula-fd. Reading from the source computer is like making a backup
  and writting to the destination is like doing a restore.
 
  So the copy is done by a backup and a restore at the same moment
  without a storage-deamon involved.
 
 Why do you want these?  What's wrong with just using scp?

`scp` does authentication on user basis. `bcp` will use system wide
authentication on the bacula passwords. So for `scp` one has to exchange
ssh keys for each user, for `bcp` is that already done.
My intented use case for `bcp` is for synchronisation data files for several
users without the burden of ssh-key mangement for all those (system) users.

`bcp` uses the backup ethernet segment by default. `scp` tends to prefer
the production network.


Groeten
Geert Stappers

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Phil Stracchino
On 10/18/10 08:08, Damian Ge;bicki wrote:
 Phil Stracchino wrote:
 On 10/18/10 07:21, Holikar, Sachin (ext) wrote:

 Well, without seeing the script, we're somewhat guessing. Personally, I
 keep my catalog dumps around because if something crashes my database,
 it's faster to just reload the last database than to do a bscan.
 However, I'm currently working on moving to a snapshot-based backup
 instead, in which I won't have a dump file at all, and will in fact
 simply take filesystem snapshots for my incremental database backups and
 keep the most recent snapshot around until the next night's backup has
 been completed.

 Yes, but the only 100% way to recover from disaster (backup server) is 
 Catalog copy on dedicated media - tape media.

I think you misunderstand.  The snapshot replaces the dump, not the
backup.  Instead of dumping the databases and backing up the dump, the
idea is to quiesce the tables, snapshot the databases, and back up the
snapshot.  The object of the exercise is to reduce the time the tables
are locked (from minutes down to a couple of seconds).


-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bscan bug?

2010-10-18 Thread Alan Brown
5.03, 64 bit

It looks like bscan isn't referring to the changer device for a given 
tape drive in order to work out what slots to use.

# bscan -m -s  -V 
AMED0001\|AMED0002\|AMED0003\|AMED0004\|AMED0005\|AMED0006\|AMED0007 
MSL6000-0
bscan: butil.c:281 Using device: MSL6000-0 for reading.
18-Oct 14:10 bscan JobId 0: Invalid slot=0 defined in catalog for Volume 
AMED0001 on MSL6000-0 (/dev/tape/by-id/scsi-3500110a0037350e0-nst). 
Manual load may be required.
18-Oct 14:10 bscan JobId 0: 3301 Issuing autochanger loaded? drive 0 
command.
18-Oct 14:10 bscan JobId 0: 3302 Autochanger loaded? drive 0, result 
is Slot 14.


The relevant part of bacula-sd.conf:

Autochanger {
   Name = MSL6000-changer
   Device = MSL6000-0
   Device = MSL6000-1
   Changer Device = /dev/tape/by-id/scsi-200900d26394d08f0
   Changer Command = /usr/lib64/bacula/mtx-changer %c %o %S %a %d
}

Device {
   Name = MSL6000-1  #
   Drive Index = 1
   Device Type = Tape
   Media Type = LTO-2
   AutoChanger = yes;
   Changer Device = /dev/tape/by-id/scsi-200900d26394d08f0
   Archive Device = /dev/tape/by-id/scsi-350060b2b041b-nst
   AutomaticMount = yes;   # when device opened, read it
   AlwaysOpen = yes;
   LabelMedia = yes;   # lets Bacula label unlabeled media
   RemovableMedia = yes;
   RandomAccess = no;
   Volume Poll Interval = 7200
   Alert Command = sh -c 'smartctl -H -d scsi -l error 
/etc/bacula/tape0generic'
   Spool Directory = /var/bacula/spool/MSL6000-1
   Maximum Network Buffer Size = 65536
   Maximum Spool Size = 250G
   Maximum Job Spool Size = 100G
}

have I missed something or is this a genuine bug?




--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bcp, Bacula CoPy

2010-10-18 Thread Dan Langille

On Oct 18, 2010, at 8:26 AM, Geert Stappers geert.stapp...@vanadgroup.com 
wrote:

 Op 20101018 om 03:45 schreef Dan Langille:
 On 10/11/2010 4:55 AM, Geert Stappers wrote:
 
 bcp, Bacula CoPy, copies files from one bacula file daemon to
 another bacula-fd. Reading from the source computer is like making a backup
 and writting to the destination is like doing a restore.
 
 So the copy is done by a backup and a restore at the same moment
 without a storage-deamon involved.
 
 Why do you want these?  What's wrong with just using scp?
 
 `scp` does authentication on user basis. `bcp` will use system wide
 authentication on the bacula passwords. So for `scp` one has to exchange
 ssh keys for each user, for `bcp` is that already done.
 My intented use case for `bcp` is for synchronisation data files for several
 users without the burden of ssh-key mangement for all those (system) users.
 
 `bcp` uses the backup ethernet segment by default. `scp` tends to prefer
 the production network.
 
 
 Groeten
 Geert Stappers
 

Bacula does backups. 

You want rsync

-- 
Dan Langille
http://langille.org/


--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] Bacula mysql cleanup

2010-10-18 Thread Alan Brown
Holikar, Sachin (ext) wrote:
  
 You are right Alan.
 It's a database dump file. 
 So you mean to say that I can compress the current file and rename it. So 
 that next time 
 Mysql will start writing onto new bacula.sql file?

Yes, but see Bruno's post on this - which also shows you how to change 
things (also change the catalog fileset in bacula-dir.conf).

 Will it not affect the functionality of mysql and in turn bacula any way?
 More importantly ,we wish to change the location of this directory itself.

Keep the dump on local disk if at all possible. Writing out to NFS will 
probably increase the dump time by a factor of 3 as well as increasing 
the time taken to write back to tape.

If you don't need bacula.sql, then enable the runafterjob line which 
deletes the dump once it's written to tape.

See also other comments about dumping the database directly to tape 
without the intermediate database step (We keep the last 10 dumps on 
disk, so I prefer the way it's setup by default)


AB



--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] bcp, Bacula CoPy

2010-10-18 Thread Sean Clark
  On 10/18/2010 07:26 AM, Geert Stappers wrote:
 Op 20101018 om 03:45 schreef Dan Langille:
 On 10/11/2010 4:55 AM, Geert Stappers wrote:
 bcp, Bacula CoPy, copies files from one bacula file daemon to
 another bacula-fd. Reading from the source computer is like making a backup
 and writting to the destination is like doing a restore.

 So the copy is done by a backup and a restore at the same moment
 without a storage-deamon involved.
 Why do you want these?  What's wrong with just using scp?
 `scp` does authentication on user basis. `bcp` will use system wide
 authentication on the bacula passwords. So for `scp` one has to exchange
 ssh keys for each user, for `bcp` is that already done.
 My intented use case for `bcp` is for synchronisation data files for several
 users without the burden of ssh-key mangement for all those (system) users.

 `bcp` uses the backup ethernet segment by default. `scp` tends to prefer
 the production network.


 Groeten
 Geert Stappers
Also, scp doesn't work with the Windows® clients, unless one wants 
to install Cygwin and OpenSSH (or a proprietary SSH implementation) on 
all of them.

Personally, I'd love to have a few optional (when enabled in 
bacula-fd.conf on the client) utility functions like this
in bacula-fd.  A simple no-authentication-required yes, I am running 
correctly response that can be triggered with a plain-text telnet 
connection, a similarly simple authentication-optional (depending on 
setting in bacula-fd.conf) telnet-inducible bacula-fd version and 
status response, and a simple operating-environment report (free disk 
space, free RAM, CPU usage) from bacula-fd would all be handy for 
troubleshooting and monitoring.  (That first one would be a lot more 
comforting than the current well, I can connect, and it disconnects me 
when I type something, so maybe it's working method of troubleshooting.)

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] [Bacula-devel] Bscan bug?

2010-10-18 Thread Kern Sibbald
If I remember right, bscan does not support autochangers, because it has no 
idea what Volume belongs in what slot.  You must manually (e.g. by mtx 
commands) change the Volumes when it asks you.

Kern

On Monday 18 October 2010 15:20:11 Alan Brown wrote:
 5.03, 64 bit

 It looks like bscan isn't referring to the changer device for a given
 tape drive in order to work out what slots to use.

 # bscan -m -s  -V
 AMED0001\|AMED0002\|AMED0003\|AMED0004\|AMED0005\|AMED0006\|AMED0007
 MSL6000-0
 bscan: butil.c:281 Using device: MSL6000-0 for reading.
 18-Oct 14:10 bscan JobId 0: Invalid slot=0 defined in catalog for Volume
 AMED0001 on MSL6000-0 (/dev/tape/by-id/scsi-3500110a0037350e0-nst).
 Manual load may be required.
 18-Oct 14:10 bscan JobId 0: 3301 Issuing autochanger loaded? drive 0
 command.
 18-Oct 14:10 bscan JobId 0: 3302 Autochanger loaded? drive 0, result
 is Slot 14.


 The relevant part of bacula-sd.conf:

 Autochanger {
Name = MSL6000-changer
Device = MSL6000-0
Device = MSL6000-1
Changer Device = /dev/tape/by-id/scsi-200900d26394d08f0
Changer Command = /usr/lib64/bacula/mtx-changer %c %o %S %a %d
 }

 Device {
Name = MSL6000-1  #
Drive Index = 1
Device Type = Tape
Media Type = LTO-2
AutoChanger = yes;
Changer Device = /dev/tape/by-id/scsi-200900d26394d08f0
Archive Device = /dev/tape/by-id/scsi-350060b2b041b-nst
AutomaticMount = yes;   # when device opened, read it
AlwaysOpen = yes;
LabelMedia = yes;   # lets Bacula label unlabeled media
RemovableMedia = yes;
RandomAccess = no;
Volume Poll Interval = 7200
Alert Command = sh -c 'smartctl -H -d scsi -l error
 /etc/bacula/tape0generic'
Spool Directory = /var/bacula/spool/MSL6000-1
Maximum Network Buffer Size = 65536
Maximum Spool Size = 250G
Maximum Job Spool Size = 100G
 }

 have I missed something or is this a genuine bug?




 ---
--- Download new Adobe(R) Flash(R) Builder(TM) 4
 The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly
 Flex(R) Builder(TM)) enable the development of rich applications that run
 across multiple browsers and platforms. Download your free trials today!
 http://p.sf.net/sfu/adobe-dev2dev
 ___
 Bacula-devel mailing list
 bacula-de...@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/bacula-devel



--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


[Bacula-users] Bacula 5.0.3 attempting to clone to tape with inchanger=0

2010-10-18 Thread Dylan Vanderhoof
I'm running into an issue with my offsite pools that are being rotated out.

Our environment is that we have a File backup which clones to an Offsite pool 
when the main backups are complete.  We have 4 sets of Offsite tapes which are 
rotated out of an autochanger weekly.

When a volume becomes full during cloning, bacula is attempting to mount the 
oldest Appendable tape that has data on it, even though inchanger=0 and slot=0. 
 I have to manually mount a tape in order to continue the cloning.

The only post I can find about this implies this was a problem that was fixed 
back in bacula 2.X.  Am I missing a configuration option or something that is 
causing this behavior?

My Pool config looks like this:

Pool {
  Name = Default
  Pool Type = Backup
  Recycle = yes   # Bacula can automatically recycle Volumes
  AutoPrune = yes # Prune expired volumes
  Volume Retention = 60 days # two months
  Maximum Volume Bytes = 50G
  Storage = FileBackup
  Recycle Oldest Volume = yes
  LabelFormat = Vol-
  NextPool = Offsite
}


Pool {
  Name = Offsite
  Pool Type = Backup
  Recycle = yes
  AutoPrune = yes
  Volume Retention = 60 days
  Recycle Oldest Volume = yes
  Storage = TapeBackup
}



The autochanger and device config looks like this:

#
# An autochanger device with two drives
#
Autochanger {
  Name = Jezebel
  Device = Drive-1
  Changer Command = /usr/libexec/bacula/mtx-changer %c %o %S %a %d
  Changer Device = /dev/sg5
}

#
# A Linux or Solaris LTO-2 tape drive
#
Device {
  Name = Drive-1
  Media Type = LTO-2
  Archive Device = /dev/nst0
  AutomaticMount = yes;   # when device opened, read it
  AlwaysOpen = yes;
  RemovableMedia = yes;
  RandomAccess = no;
  Maximum File Size = 3GB
# Changer Command = /usr/libexec/bacula/mtx-changer %c %o %S %a %d
# Changer Device = /dev/sg0
 AutoChanger = yes
  # Enable the Alert command only if you have the mtx package loaded
# Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
# If you have smartctl, enable this, it has more info than tapeinfo
 Alert Command = sh -c 'smartctl -H -l error %c'
}

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] only incremental Backup of a growing amount of data

2010-10-18 Thread Martin Simmons
 On Sun, 17 Oct 2010 22:01:42 +0200, Sebastian Gutweiler said:
 
 Hi,
 
 I have the following situation:
 
 - A data storage server (4TB) with a growing amount of scientific data. Data
   which is already on the server will probably stay there and only
   occasionally some will be deleted. 
   A backup server with 4,5TB
 
 My problem is (if I understand the documentation right):
 
 - If I perform an incremental backup into one big volume file, the space
   occupied by files deleted on the storage server won't be freed, because
   the files will be deleted from the catalog but will stay in the volume
   file. Is this right?

Yes.  Bacula can't reuse space from a volume without discarding its old
contents.


 - If I use small volume files, the old volume files won't be deleted/reused
   because they will contain files which are still on the storage server.

Yes.  Restore using incrementals needs to access every job since the last
full.


 - I can't do 2 Full backups and then delete the elder one, because if more
   than 2,25TB space are used on the storage server there is not enough space
   for this on the backup server.

Yes.


 Am I missing something? Is there an option/setup method to avoid these 
 problems?

The usual solution is to run a Differential backup occasionally, e.g. monthly.
This will contain all files changed since the last Full backup, so you can
then recycle the volumes used for older incrementals if you don't need to get
back old deleted files.

__Martin

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] get_file_record want 1 got rows=2 after migration from MySQL to PostgreSQL

2010-10-18 Thread Martin Simmons
 On Mon, 18 Oct 2010 09:54:28 +0200, Robert Oschwald said:
 
 I migrated Bacula 5.0.2 from MySQL to Bacula 5.0.3 PostgreSQL 8.1, 
 and then migrated to PostgreSQL 8.2 using dump/restore.
 ...snip...
 Migration from PostgreSQL 8.1 to 8.2:
 pg_dumpall  pg_dump.sql
 - install postgreSQL 8.2 (CentOS-Testing)
 psql  pg_dump.sql

Did you start with an empty database when you imported the dump after
migration from PostgreSQL 8.1 to 8.2?  I suspect not, because you have
everything twice.


 
 
 Are these error messages critical?

Yes.

__Martin

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] only incremental Backup of a growing amount of data

2010-10-18 Thread Phil Stracchino
On 10/18/10 14:22, Martin Simmons wrote:
 On Sun, 17 Oct 2010 22:01:42 +0200, Sebastian Gutweiler said:
 - If I use small volume files, the old volume files won't be deleted/reused
   because they will contain files which are still on the storage server.
 
 Yes.  Restore using incrementals needs to access every job since the last
 full.

...Or the last differential and every incremental since the last
differential.




-- 
  Phil Stracchino, CDK#2 DoD#299792458 ICBM: 43.5607, -71.355
  ala...@caerllewys.net   ala...@metrocast.net   p...@co.ordinate.org
 Renaissance Man, Unix ronin, Perl hacker, Free Stater
 It's not the years, it's the mileage.

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users


Re: [Bacula-users] LTO4 positioning time.

2010-10-18 Thread Andrea Venturoli
On 10/11/10 22:20, Panagiotis Christias wrote:

 Same setup here (FreeBSD 7.3 amd64, HP LTO-4), same problem until we
 paid more attention to the notes that come with bacula-server port
 (see pkg-message.server.in in
 /usr/ports/sysutils/bacula-server/files). Our working bacula-sd.conf
 configuration currently includes the following:

Hardware End of Medium  = no;
Backward Space Record   = yes;
Backward Space File = yes;
Fast Forward Space File = yes;
BSF at EOM = yes;
TWO EOF= yes;

Thanks, this seemed to solve, so far.
I could only do a little test, but it seemed much faster.
I will ask again in case I notice further problems when I'll do the 
monthly backups.

  bye  Thanks
av.

--
Download new Adobe(R) Flash(R) Builder(TM) 4
The new Adobe(R) Flex(R) 4 and Flash(R) Builder(TM) 4 (formerly 
Flex(R) Builder(TM)) enable the development of rich applications that run
across multiple browsers and platforms. Download your free trials today!
http://p.sf.net/sfu/adobe-dev2dev
___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users