[Bacula-users] virtual backups with encrypted data
Hello. Is running VirtualFull possible with encrypted backups? I'd guess that no, since the data can only be decrypted on FD, right? If so, I guess it will be possible once data encryption is also supported on SD? -- Silver -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] virtual backups with encrypted data
yes that works.. I've done it... The system doesn't need to decrypt the data... it just needs to know which version is the latest and it can do that from the catalog. --Guy On 12 Dec 2011, at 09:55, Silver Salonen wrote: Hello. Is running VirtualFull possible with encrypted backups? I'd guess that no, since the data can only be decrypted on FD, right? If so, I guess it will be possible once data encryption is also supported on SD? -- Silver -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users smime.p7s Description: S/MIME cryptographic signature -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] virtual backups with encrypted data
OK, but how can SD merge data from encrypted volumes? I'd guess it goes smth like this for every file (all files are encrypted separately)? 1. SD finds out (queries DIR) on which volume is the latest version of the file 2. SD reads the encrypted file and just re-writes it onto the new volume Do I guess correctly? -- Silver On 12.12.2011 12:01, Guy wrote: yes that works.. I've done it... The system doesn't need to decrypt the data... it just needs to know which version is the latest and it can do that from the catalog. --Guy On 12 Dec 2011, at 09:55, Silver Salonen wrote: Hello. Is running VirtualFull possible with encrypted backups? I'd guess that no, since the data can only be decrypted on FD, right? If so, I guess it will be possible once data encryption is also supported on SD? -- Silver -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] virtual backups with encrypted data
Yes files are encrypted separately... and yes it just copies the file from SD to the new pool... it does nothing with the file/data just copies it. --Guy On 12 Dec 2011, at 10:07, Silver Salonen wrote: OK, but how can SD merge data from encrypted volumes? I'd guess it goes smth like this for every file (all files are encrypted separately)? 1. SD finds out (queries DIR) on which volume is the latest version of the file 2. SD reads the encrypted file and just re-writes it onto the new volume Do I guess correctly? -- Silver On 12.12.2011 12:01, Guy wrote: yes that works.. I've done it... The system doesn't need to decrypt the data... it just needs to know which version is the latest and it can do that from the catalog. --Guy On 12 Dec 2011, at 09:55, Silver Salonen wrote: Hello. Is running VirtualFull possible with encrypted backups? I'd guess that no, since the data can only be decrypted on FD, right? If so, I guess it will be possible once data encryption is also supported on SD? -- Silver smime.p7s Description: S/MIME cryptographic signature -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Error Unable to position to end of data on device Drive-1
Hello,
my problem is describe in the object. When i run the backup the backup go on
and end fine. But a new backup on the same tape mark it error and take another
tape.
This is the error on bacula log :
12-Dec 10:40 bak02prdost.recupitalia.it-sd JobId 35: Volume 000101L
previously written, moving to end of data.
12-Dec 10:41 bak02prdost.recupitalia.it-sd JobId 35: Error: Unable to
position to end of data on device Drive-1 (/dev/nst1): ERR=dev.c:966 ioctl
MTIOCGET error on Drive-1 (/dev/nst1). ER R=Success.
12-Dec 10:41 bak02prdost.recupitalia.it-sd JobId 35: Marking Volume
000101L in Error in Catalog.
12-Dec 10:42 bak02prdost.recupitalia.it-sd JobId 35: Please mount
Volume 000103L or label a new one for:
This is my connfiguration on server:
O.S : CentOS release 5.6
Kernel : 2.6.18-238.12.1.el5 x64
Bacula Version : 5.0.3 (from rpm).
Library : Spectralogic T50e with LTO-4 Drive FC
I try to run a btape test with good result , this is the output :
=== Forward space files test ===
This test is essential to Bacula.
I'm going to write five files then test forward spacing
btape: btape.c:578 Rewound Drive-1 (/dev/nst1)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:1905 Wrote one record of 64412 bytes.
btape: btape.c:1907 Wrote block to device.
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:608 Wrote 1 EOF to Drive-1 (/dev/nst1)
btape: btape.c:578 Rewound Drive-1 (/dev/nst1)
btape: btape.c:1632 Now forward spacing 1 file.
We should be in file 1. I am at file 1. This is correct!
btape: btape.c:1644 Now forward spacing 2 files.
We should be in file 3. I am at file 3. This is correct!
btape: btape.c:578 Rewound Drive-1 (/dev/nst1)
btape: btape.c:1657 Now forward spacing 4 files.
We should be in file 4. I am at file 4. This is correct!
btape: btape.c:1675 Now forward spacing 1 more file.
We should be in file 5. I am at file 5. This is correct!
=== End Forward space files test ===
The bacula-sd if configured with :
Autochanger {
Name = spectra
Device = Drive-1
Changer Command = /usr/lib64/bacula/mtx-changer %c %o %S %a %d
Changer Device = /dev/sg2
}
Device {
Name = Drive-1 #
Drive Index = 1
Media Type = LTO-4
Archive Device = /dev/nst1
Changer Device = /dev/sg2
TWO EOF = yes
AlwaysOpen = yes;
AutomaticMount = yes; # when device opened, read it
RemovableMedia = yes;
RandomAccess = no;
Maximum File Size = 5GB
SpoolDirectory = /opt/stage/SpoolDirectory
Maximum Spool Size = 25GB # 25 Gb of spool
Alert Command = sh -c 'tapeinfo -f %c |grep TapeAlert|cat'
}
I try to use the this on bacula-sd configuration
# Hardware End of Medium = no
But with this option i can't run the backup.
The IBM-Drive is on the lastest firmware upgrade (B711).
p.s: I have another server (the same configuration on another library T200) and
work fine with lto4.
Anyone can help me? Thank you.
--
Daniele Eccher
Gruppo Darco - ICT Sistemi
Via Ostiense 131/L Corpo B, 00154 Roma
E-mail: daniele.ecc...@sociale.it tel : +39 06 57060 500 cell : +39 346
1426128
--
Learn Windows Azure Live! Tuesday, Dec 13, 2011
Microsoft is holding a special Learn Windows Azure training event for
developers. It will provide a great way to learn Windows Azure and what it
provides. You can attend the event by watching it streamed LIVE online.
Learn more at http://p.sf.net/sfu/ms-windowsazure___
Bacula-users mailing list
Bacula-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Many projects idea, what do you think about it ?
Hello, I have some project ideas. If people like it, maybe it can be developed in next bacula versions. I am running bacula 5.0.3. My experience with bacula was long slow at the beginning. This was due to various concept that I didn't understood and also for some missing function that I developed myself via python over bconsole. Moreover, some packages didn't included some options or where including bugs I ran ./configure and the compilation from source myself and a lot of problem disappeared. Idea --- Have a COPY/MIGRATE functionality just like the RESTORE functionality = You simply select the jobs that you want to copy and the destination storage. = An estimation indicates the size of the selected jobs = That functionality can be integrated in bat. Why: = You cant manually copy many jobs from bconsole eg: run job=MyCopyJob jobid=1000here i cant specify many jobs = Copy job are, in my opinion, mostly used for Archiving on a separate device so it cant be a Fully automated process ( tape size…). In my case, an external python script loads sequentially bconsole commands to run job. This script let me choose which job I want to add to the tape. With bacula integrated options for copy such as Sql Query or Pool Uncopied , I would like to check the job list before running the job, eg: I want to limit one tape by month so my archiving should no exceed the estimated size of an LTO3 Tape (~400Go). Idea --- Disable only one occurrence of a job or pre-upgrade the next occurrence of a job. = Add an upgrade command = Add a next option to the disable command Why: = Simply imagine that your backups are growing faster than expected, you want that the next time the job run with an higher level. = You do not want to reload you configuration = There is already the run command and the Allow Duplicate Jobs = No directive but for the moment, but it conflicts with Copy jobs = You may not be able to re-enable the job just after ( eg : you want to run the job during the week end ) Idea --- The pruning algorithm between 5.0 and 5.2 versions of bacula. That would be great if it's possible to select which algorithm to use /pool or /job Idea --- Enable running virtual-full in the same pool as my full job Idea --- Ability to bextract cyphered jobs = My Disaster recovery plan is a little tricky without this functionality Idea --- Ability to dynamically use a specific encryption key on a file daemon. = eg : You are in BAT, you want to restore files from a job on a file daemon that is different from the backup client. Why: = Be able to restore on a different file daemon without deploying massively ( in clear text) the master key. Solution 1: = Add a menu in bat that upload the key on the file daemon Solution 2: = Predeploy an encrypted version of the master key on the file daemons, bat or bconsole ask the user for a passphrase in order to decrypt this key. Idea --- Disable auto in ./configure script. Why = Some bacula version implements ACL other ones do not and it's the same for lots of libraries. When you are installing bacula you are expecting ACL and many functionality but theses ones are there only if the libraries are on the system. = When I installed various builds of bacula from various repository (MacPort, Sourceforge, Apt, RPM…) on various systems ( MacOSX, Windows, CentOS, Debian) I had a lot of bug coming from some version that were build without some options. To make this right, I had to run installation from source on many systems with the same configure options. Solution: = By default, all Bacula versions should implement the same options on compression, encryption, acl, batch inserts…. If the user want it without ACL he can do it himself by deselecting with ./configure. I really think that it's better to have a defined number of options that are officially supported that should be integrated in every version. I don't think that many people can do backups without acl, encryption… Idea --- Add an option to automatically run a new full if the estimated size of the [incremental|differential] job reaches a certain ratio compared to the previous full. Why: eg: On my file server, people can add no more files during months and sometimes there is a huge activity. = It can happen that some incremental jobs are larger than the differential and some differentials larger than the full. In this case, you have better to run a new full. Solution1: = Implement directly this functionality Solution2: = Implement upgrade-level directive and post estimate runscript directive with a variable integration. Idea --- Having a programming interface that can talk like bconsole. It's not always easy to talk to another shell and bconsole uses As I understood, python integration in bacula is effective only on a bacula event. Please correct me if I am wrong. I created a library in python (via pexpect) in order to have an interface for my scripts. It's talking to bconsole and directly to the catalog (read only). I can give this
[Bacula-users] Bacula Status
Hello, I have four topics to discuss in this status report: 1. The Bacula Systems Enterprise Migration program. 2. Bacula version 5.2.2 3. Reducing/fixing bugs 4. Christmas The Bacula Systems Enterprise Migration program: This is a program to help community users migration to the Bacula Enterprise version that was announced a few weeks ago. The response has been surprisingly strong, so I can only surmise that a number of you have growing backup needs and need some professional help. If you didn't take a look at this program, please be aware that it ends on 31 December. So if you have support needs or problems, please go to: www.baculasystems.com and click on the Selective Migration Plan on the left side of the screen in the Latest news area, or go to: www.bacula.org and click on the Selective Migration Plan icon in the upper right corner of the window. Bacula version 5.2.2: As you probably know this is the latest release. There have been very few problems reported against it, though there is one seg fault regression that seems to be rather rare. If you are experiencing any seg faults in the FD, you might want to checkout Branch-5.2 in the git repo (see the website). The patch has been committed. Sometime after the end of the year we may put out a 5.2.3 release. Reducing/fixing bugs: We are beginning to work on reducing the number of bugs outstanding. Hopefully over the next month or two we will fix most of them -- before version 5.2.3 is released. Christmas: I would like to thank all of you for using Bacula and for your contributions to the project. As we are approaching Christmas time, I would like to wish you all a very happy holiday season and a prosperous and peaceful 2012. Best regards, Kern -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] 5.2.x client with 5.0.3 director/storage
Hi All, I don't see a documented item about running a 5.2.1 client with the older 5.0.3 director and 5.0.3 storage daemon. (I do see notes about doing this version straddle in the opposite direction.) It seems to work but is it a valid configuration? Is there anything I should know when running like this? Thanks -Ben -- Ben Walton Systems Programmer - CHASS University of Toronto C:416.407.5610 | W:416.978.4302 -- Learn Windows Azure Live! Tuesday, Dec 13, 2011 Microsoft is holding a special Learn Windows Azure training event for developers. It will provide a great way to learn Windows Azure and what it provides. You can attend the event by watching it streamed LIVE online. Learn more at http://p.sf.net/sfu/ms-windowsazure ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Bacula for backup/restore a huge PostgreSQL DB enviroment
Hi every: I'm thinking in use Bacula to make backup/restore of a huge enviroment with a lot of PostgreSQL DB servers configured in HA Cluster using Pgpool II. I do a research first to see if find any and just see this thread [1] but I'm not so clear in the *HOW TO* just knew that recommendation is to use PITR instead of pg_dump or LVM Snapshots. My question is: any here has this implemented and can give me some tips or step to follow? Cheers and thanks in advance [1] http://old.nabble.com/Bacula-for-backing-up-postgres-td21268085.html Ing. Reynier Pérez Mira Cel: +58 424.180.5609 / +58 416.921.7406 Correo: reynie...@gmail.com / reynie...@hotmail.com -- Systems Optimization Self Assessment Improve efficiency and utilization of IT resources. Drive out cost and improve service delivery. Take 5 minutes to use this Systems Optimization Self Assessment. http://www.accelacomm.com/jaw/sdnl/114/51450054/___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
