Re: file compression on target side

2009-01-20 Thread Sven Hartrumpf
Mon, 19 Jan 2009 20:05:07 -0500, magawake wrote: Using Redhat 4.5; I have been researching this for weeks and all signs and wisemen (such as yourself) point to the Holy Grail -- ZFS! You could try FuseCompress: http://www.miio.net/fusecompress/ The author claims that he improved its speed

file compression on target side

2009-01-19 Thread Mag Gam
Hello All, I have been using rsync to backup several filesystems by using Mike Rubel's hard link method (http://www.mikerubel.org/computers/rsync_snapshots/). The problem is, I am backing up a lot of ASCII .log, csv, and .txt files. These files are large and can range anywhere from 1GB to 30GB.

Re: file compression on target side

2009-01-19 Thread Mag Gam
Thanks all. I figured this was the only solution available. Too bad I am using Linux and don't think my RAID controller is supported under Solaris. On Mon, Jan 19, 2009 at 10:41 AM, Kyle Lanclos lanc...@ucolick.org wrote: You wrote: The problem is, I am backing up a lot of ASCII .log, csv,

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
On Mon, Jan 19, 2009 at 12:33 PM, Ryan Malayter malay...@gmail.com wrote: You can switch to a filesystem that supports transparent encrytpion (Reiser, ZFS, NTFS, others depending on your OS). Rsync would be completely unaware of any file-system level compression in that case. Oops. I meant

Re: file compression on target side

2009-01-19 Thread Mag Gam
yep. ZFS on fuse is just too slow. I suppose I will wait for ZFS on Linux (pipe dream) or try to switch to Solaris 10 on x86 On Mon, Jan 19, 2009 at 1:34 PM, Ryan Malayter malay...@gmail.com wrote: On Mon, Jan 19, 2009 at 12:33 PM, Ryan Malayter malay...@gmail.com wrote: You can switch to a

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
You can switch to a filesystem that supports transparent encrytpion (Reiser, ZFS, NTFS, others depending on your OS). Rsync would be completely unaware of any file-system level compression in that case. Or you can use gzip with the --rsyncable option. Not all distributions of gzip support

Re: file compression on target side

2009-01-19 Thread Ryan Malayter
On Mon, Jan 19, 2009 at 2:34 PM, Mag Gam magaw...@gmail.com wrote: ZFS on fuse is just too slow. I suppose I will wait for ZFS on Linux (pipe dream) or try to switch to Solaris 10 on x86 There will never be ZFS in the Linux kernel because of license incompatibilites. The linux answer to ZFS is

Re: file compression on target side

2009-01-19 Thread Mag Gam
Using Redhat 4.5; I have been researching this for weeks and all signs and wisemen (such as yourself) point to the Holy Grail -- ZFS! On a side node, brtfs nor ext4 won't help us too much. Strange that ZFS is being ported to FreeBSD but a license dispute between GPL and CDDL? I guess GPL isn't