Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-06 Thread dan
I doubt that the bzip2 compression would really change backup times all that much as they are much more I/O contrained than disk bandwidth or CPU bound. Many time you can see a backup using a small percentage of the CPU but pegging disk I/O. I'm sure it would have some effect but only a small one

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-06 Thread John Goerzen
dan wrote: I doubt that the bzip2 compression would really change backup times all that much as they are much more I/O contrained than disk bandwidth or CPU bound. Many time you can see a backup using a small percentage of the CPU but pegging disk I/O. I'm sure it would have some effect but

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-06 Thread dan
I was trying to do ZFS on freebsd to eliminate the need to have backuppc compress the files and instead have ZFS do the work. I have since moved to opensolaris 2008.11 beta as ZFS on freebsd is in alpha quality. Have you considered this approach or are you bound to your current platform for

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-06 Thread John Goerzen
On Thu, Nov 06, 2008 at 02:13:00PM -0700, dan wrote: I was trying to do ZFS on freebsd to eliminate the need to have backuppc compress the files and instead have ZFS do the work. I have since moved to opensolaris 2008.11 beta as ZFS on freebsd is in alpha quality. Have you considered this

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-06 Thread dan
Yeah, there is a fuse-zfs port but it is not anwhere near production ready and the freebsd port is not much closer. Here is an alternative for you. Nexenta. It is littlerally debian running an opensolaris kernel. I think it may actually be more ubuntu than debian but it definitely brings that

[BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread John Goerzen
Hi everyone, I installed BackupPC to try it out for backing up Linux systems, and I have a few questions about it. First, the on-disk compression format makes me nervous. It appears to use the deflate algorithm, but cannot be unpacked with either gzip or unzip. It would seem that the few bytes

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread Nils Breunese (Lemonbit)
John Goerzen wrote: First, the on-disk compression format makes me nervous. It appears to use the deflate algorithm, but cannot be unpacked with either gzip or unzip. It would seem that the few bytes that adding a gzip header means would be well worth it, since it would buy the ability to

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread John Goerzen
On Wed, Nov 05, 2008 at 10:40:35PM +0100, Nils Breunese (Lemonbit) wrote: John Goerzen wrote: First, the on-disk compression format makes me nervous. It appears to use the deflate algorithm, but cannot be unpacked with either gzip or unzip. It would seem that the few bytes that adding a

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread Chris Robertson
John Goerzen wrote: Hi everyone, I installed BackupPC to try it out for backing up Linux systems, and I have a few questions about it. First, the on-disk compression format makes me nervous. It appears to use the deflate algorithm, but cannot be unpacked with either gzip or unzip. It

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread Nils Breunese (Lemonbit)
John Goerzen wrote: On Wed, Nov 05, 2008 at 10:40:35PM +0100, Nils Breunese (Lemonbit) wrote: John Goerzen wrote: First, the on-disk compression format makes me nervous. It appears to use the deflate algorithm, but cannot be unpacked with either gzip or unzip. It would seem that

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread John Goerzen
Chris Robertson wrote: John Goerzen wrote: extract it without using specialized tools. It also makes me nervous because it isn't a completely off-the-shelf implementation, and doesn't appear to store a CRC in the file; is there integrity checking anywhere?

Re: [BackupPC-users] Questions about compression in BackupPC

2008-11-05 Thread John Goerzen
Nils Breunese (Lemonbit) wrote: Right, I'm aware of that. But that's a specialized tool. It requires CPAN libraries, libraries from BackupPC's perl library, etc. 20 bytes or so would get you something that gzip could uncompress. Are you sure? I thought it also works on its own. Haven't