Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-11 Thread Holger Parplies
Hi, Jeffrey J. Kosowsky wrote on 2009-06-11 00:25:37 -0400 [Re: [BackupPC-users] backup the backuppc pool with bacula]: Holger Parplies wrote at about 04:22:03 +0200 on Thursday, June 11, 2009: Les Mikesell wrote on 2009-06-10 15:45:22 -0500 [Re: [BackupPC-users] backup the backuppc pool

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-11 Thread Jeffrey J. Kosowsky
Holger Parplies wrote at about 14:31:02 +0200 on Thursday, June 11, 2009: Hi, Jeffrey J. Kosowsky wrote on 2009-06-11 00:25:37 -0400 [Re: [BackupPC-users] backup the backuppc pool with bacula]: Holger Parplies wrote at about 04:22:03 +0200 on Thursday, June 11, 2009: Les Mikesell

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-11 Thread Les Mikesell
Jeffrey J. Kosowsky wrote: Now that doesn't mean it *couldn't* happen and it doesn't mean we shouldn't always be paranoid and test, test, test... but I just don't have any good reason to think it would fail algorithmically. Now that doesn't mean it couldn't slow down dramatically or run out

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-11 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Les Mikesell wrote: Jeffrey J. Kosowsky wrote: In fact, the POSIS/SUS specifications specifically states: Some implementations mark for update the st_ctime field of renamed files and some do not. Applications which make use of the

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-11 Thread Les Mikesell
Adam Goryachev wrote: In fact, the POSIS/SUS specifications specifically states: Some implementations mark for update the st_ctime field of renamed files and some do not. Applications which make use of the st_ctime field may behave differently with respect to renamed files unless

[BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread jhaglund
of transfer time. Lots of info requests, I know, but I really appreciate the help. My ISP and all the experts I've tapped are completely stumped on this one. Holger Parplies wrote: Hi, Rob Terhaar wrote on 2009-05-21 13:01:58 -0400 [Re: [BackupPC-users] backup the backuppc pool with bacula

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread Bowie Bailey
jhaglund wrote: I'd really like to know the specifics of the hardlink and inode problem talked about in this thread like how to find out how many I have and what the threshold is for Trouble and how the rest of the community deals with getting pools of 100+GB offsite in less than a week of

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread Les Mikesell
jhaglund wrote: There are several implied references here to likely problems with rsync and how they are all deal breakers. I've been trying to find a solution to this problem for weeks and have not found any direct documentation or evidence to support what is being said here. I'm not

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread Jon Forrest
jhaglund wrote: What does one use if not rsync? In an admittedly non-backuppc environment I've been experimenting with using 'rsync -W' (this means don't use the rsync algorithm) to see if problems similar to the ones you describe go away. I'm still not sure of the result. Using rsync with

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread Holger Parplies
Hi, Les Mikesell wrote on 2009-06-10 15:45:22 -0500 [Re: [BackupPC-users] backup the backuppc pool with bacula]: jhaglund wrote: There are several implied references here to likely problems with rsync and how they are all deal breakers. [...] I just need to understand what's going

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-10 Thread Jeffrey J. Kosowsky
Holger Parplies wrote at about 04:22:03 +0200 on Thursday, June 11, 2009: Hi, Les Mikesell wrote on 2009-06-10 15:45:22 -0500 [Re: [BackupPC-users] backup the backuppc pool with bacula]: jhaglund wrote: There are several implied references here to likely problems with rsync

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-02 Thread Tino Schwarze
On Mon, Jun 01, 2009 at 06:15:52PM -0400, Stephane Rouleau wrote: Is the blockdevel-level rsync-like solution going to be something publicly available? blockdev-level rsync smells like drbd. I'm not sure whether it support such huge amounts of unsynchronized data, but it might just be a

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-02 Thread Pieter Wuille
On Tue, Jun 02, 2009 at 11:44:11AM +0200, Tino Schwarze wrote: On Mon, Jun 01, 2009 at 06:15:52PM -0400, Stephane Rouleau wrote: Is the blockdevel-level rsync-like solution going to be something publicly available? We certainly intend to, but no guarantee it ever gets finished. Except

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-01 Thread Pieter Wuille
On Sun, May 31, 2009 at 11:22:13AM -0400, Stephane Rouleau wrote: Pieter Wuille wrote: This is how we handle backups of the backuppc pool: * the pool itself is on a LUKS-encrypted XFS filesystem, on a LVM volume, on a software RAID1 of 2 1TB disks. * twice a week following

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-06-01 Thread Stephane Rouleau
Thanks Pieter, Is the blockdevel-level rsync-like solution going to be something publicly available? Stephane Pieter Wuille wrote: On Sun, May 31, 2009 at 11:22:13AM -0400, Stephane Rouleau wrote: Pieter Wuille wrote: This is how we handle backups of the backuppc pool: * the

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-25 Thread Boniforti Flavio
I have one system where I do backups of backuppc to tape for disaster recover. Here's the system I use: - Stop backuppc to quiesce the filesystem. LVM snapshots are not sufficient for this, because the disk load gets too high, data flow rate gets too low, and the tape starts to

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-25 Thread Boniforti Flavio
How often do you want to backup the server? What about using rsync to backup the pool? I want to mirror my primary backup server to another system daily so I can switch to my backup server quickly. I was going to use rsync for this. Well, backing it up once a day would be ok for me

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-25 Thread Les Mikesell
Boniforti Flavio wrote: I have one system where I do backups of backuppc to tape for disaster recover. Here's the system I use: - Stop backuppc to quiesce the filesystem. LVM snapshots are not sufficient for this, because the disk load gets too high, data flow rate gets too low, and

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-25 Thread Les Mikesell
Boniforti Flavio wrote: How often do you want to backup the server? What about using rsync to backup the pool? I want to mirror my primary backup server to another system daily so I can switch to my backup server quickly. I was going to use rsync for this. Well, backing it up once a

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-21 Thread Dan Pritts
On Tue, May 19, 2009 at 11:35:36AM -0500, Les Mikesell wrote: Have you ever restored one of these tapes, and if so, how long did it take? As a wild guess, I'd expect a couple of days where an image copy would be an hour or two. I did this with solaris ufsdump/ufsrestore once. Making the

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-21 Thread Rob Terhaar
On Tue, May 19, 2009 at 12:27 PM, Carl Wilhelm Soderstrom chr...@real-time.com wrote: On 05/19 12:04 , Tim Cole wrote: How often do you want to backup the server?  What about using rsync to backup the pool?  I want to mirror my primary backup server to another system daily so I can switch to

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-21 Thread Holger Parplies
Hi, Rob Terhaar wrote on 2009-05-21 13:01:58 -0400 [Re: [BackupPC-users] backup the backuppc pool with bacula]: [...] Try Rsync v3, it has much lower memory requirements since it builds the file list incrementally. by all means, try it. But it's not the file list that is the specific problem

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-21 Thread Rob Terhaar
] backup the backuppc pool with bacula]: [...] Try Rsync v3, it has much lower memory requirements since it builds the file list incrementally. by all means, try it. But it's not the file list that is the specific problem of BackupPC. I used it at one company to do nightly syncs of their ~4TB

[BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Ralf Gross
Hi, there is a regular discussion on how to backup/move/copy the backuppc pool. Did anyone try to backup the pool with bacula? I need to expand the raid volume where the pool is stored (Arecac RAID controller). Doing this without backup is a bit frightening (I didn't use LVM for the filesystem).

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Boniforti Flavio
Hi, there is a regular discussion on how to backup/move/copy the backuppc pool. Did anyone try to backup the pool with bacula? Hello there... I don't know about bacula, but would like myself also to get a backup of the BackupPC server: anybody got some suggestions and practical examples?

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Tim Cole
Boniforti Flavio wrote: Hi, there is a regular discussion on how to backup/move/copy the backuppc pool. Did anyone try to backup the pool with bacula? Hello there... I don't know about bacula, but would like myself also to get a backup of the BackupPC server: anybody got some

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Les Mikesell
Boniforti Flavio wrote: Hi, there is a regular discussion on how to backup/move/copy the backuppc pool. Did anyone try to backup the pool with bacula? Hello there... I don't know about bacula, but would like myself also to get a backup of the BackupPC server: anybody got some

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Carl Wilhelm Soderstrom
On 05/19 05:51 , Boniforti Flavio wrote: I don't know about bacula, but would like myself also to get a backup of the BackupPC server: anybody got some suggestions and practical examples? I have one system where I do backups of backuppc to tape for disaster recover. Here's the system I use: -

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Carl Wilhelm Soderstrom
On 05/19 12:04 , Tim Cole wrote: How often do you want to backup the server? What about using rsync to backup the pool? I want to mirror my primary backup server to another system daily so I can switch to my backup server quickly. I was going to use rsync for this. Rsync memory

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Les Mikesell
Carl Wilhelm Soderstrom wrote: On 05/19 05:51 , Boniforti Flavio wrote: I don't know about bacula, but would like myself also to get a backup of the BackupPC server: anybody got some suggestions and practical examples? I have one system where I do backups of backuppc to tape for disaster

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Les Mikesell
Carl Wilhelm Soderstrom wrote: On 05/19 12:04 , Tim Cole wrote: How often do you want to backup the server? What about using rsync to backup the pool? I want to mirror my primary backup server to another system daily so I can switch to my backup server quickly. I was going to use rsync

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Carl Wilhelm Soderstrom
On 05/19 11:35 , Les Mikesell wrote: Have you ever restored one of these tapes, and if so, how long did it take? As a wild guess, I'd expect a couple of days where an image copy would be an hour or two. I think it's about 8 hours to create the tape (whereas when using LVM snapshots it took

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Holger Parplies
Hi, Carl Wilhelm Soderstrom wrote on 2009-05-19 11:54:16 -0500 [Re: [BackupPC-users] backup the backuppc pool with bacula]: On 05/19 11:35 , Les Mikesell wrote: Have you ever restored one of these tapes, and if so, how long did it take? As a wild guess, I'd expect a couple of days where

Re: [BackupPC-users] backup the backuppc pool with bacula

2009-05-19 Thread Holger Parplies
Hi, Les Mikesell wrote on 2009-05-19 11:12:25 -0500 [Re: [BackupPC-users] backup the backuppc pool with bacula]: [...] the newest version of rsync is supposed to handle the hardlinks more efficiently. reason suggests that this is an urban myth. The newest version of rsync handles *large file