Re: [BackupPC-users] Compression during Xfer

2008-10-28 Thread Adam Goryachev
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

Sebastien Sans wrote:
> Hello,
> 
> The compression system of the pool in BackupPc is great, it save a lot
> of place, but I didn't found how to compress the tranfers in order to
> save my bandwidth.
> I tryed to modify the command line in "rzync" and "tar" modes to
> activate compression (i added -z options to use gz compression), the
> transfer was shorter but the result was'nt well recognized by
> BackupPc.
> I'm sure there is a simple way to compress the tranferts. If someone
> has the solution, that would be great.
> 
> Cordially,
> 
> Ps: Sorry for my bad english, I tryed to do my best...

With rsync the only way to do compression is by using ssh and getting
ssh to do the compression. (Or doing it over a VPN where the VPN
software compresses the data, or something similar).

You can't use rsync compression.

Regards,
Adam

- --
Adam Goryachev
Website Managers
Ph: +61 2 8304 [EMAIL PROTECTED]
Fax: +61 2 8304 0001www.websitemanagers.com.au
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iD8DBQFI7yghGyoxogrTyiURAjTyAJ0a8iKhsrpa+IvyNVocLfq9CW2/RgCdEXe4
paRUctyM87EQD7NQ1NT6sHk=
=zqoq
-END PGP SIGNATURE-

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-13 Thread Carl Wilhelm Soderstrom
On 10/13 02:56 , Tomasz Chmielewski wrote:
> > $Conf{RsyncClientCmd} = '$sshPath -C -o CompressionLevel=9 -c blowfish-cbc 
> > -q -x -l rsyncbakup $host $rsyncPath $argList+';
> 
> Unless you're using an obsoleted SSH protocol in version 1, setting 
> CompressionLevel does not make any sense - SSH protocol 2 has 
> compression level hardcoded to 6, and you can't change it.

ok. I might have been using CompressionLevel since SSH v1 days; or perhaps I
never experimented fully with that option. Thanks for the information.

> And unless both machines (BackupPC server and the other side) are *very* 
> loaded, changing cipher specification will not change anything, either.

In some cases they are; but thanks for the input on this.

-- 
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-13 Thread Tomasz Chmielewski
Carl Wilhelm Soderstrom schrieb:
> On 10/10 11:54 , Sebastien Sans wrote:
>> The compression system of the pool in BackupPc is great, it save a lot
>> of place, but I didn't found how to compress the tranfers in order to
>> save my bandwidth.
> 
> Use compression in your ssh transport.
> Here's an example I typically use:
> 
> $Conf{RsyncClientCmd} = '$sshPath -C -o CompressionLevel=9 -c blowfish-cbc -q 
> -x -l rsyncbakup $host $rsyncPath $argList+';

Unless you're using an obsoleted SSH protocol in version 1, setting 
CompressionLevel does not make any sense - SSH protocol 2 has 
compression level hardcoded to 6, and you can't change it.

And unless both machines (BackupPC server and the other side) are *very* 
loaded, changing cipher specification will not change anything, either.


-- 
Tomasz Chmielewski
http://wpkg.org

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-13 Thread Carl Wilhelm Soderstrom
On 10/10 11:54 , Sebastien Sans wrote:
> The compression system of the pool in BackupPc is great, it save a lot
> of place, but I didn't found how to compress the tranfers in order to
> save my bandwidth.

Use compression in your ssh transport.
Here's an example I typically use:

$Conf{RsyncClientCmd} = '$sshPath -C -o CompressionLevel=9 -c blowfish-cbc -q 
-x -l rsyncbakup $host $rsyncPath $argList+';

The blowfish-cbc cipher has sometimes been demonstrated to be more efficient
than the default. I've not done enough comparisons to be completely
confident that it's the best tho.

On a completely independent note, that example shows I'm logging in as
'rsyncbakup' rather than 'root'. (I have the ssh key set up to use sudo to
run the single allowed rsync command on the client side as root).

-- 
Carl Soderstrom
Systems Administrator
Real-Time Enterprises
www.real-time.com

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-11 Thread Les Mikesell
dan wrote:
> rsync does provide compression.  rsync -z is compressed.  just put this 
> either in your main config or in the specific hosts config for the rsync 
> command.

This won't work - backuppc's rsync implementation in perl (that supports 
working against the compressed archive file) don't support it.

-- 
   Les Mikesell
[EMAIL PROTECTED]

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-10 Thread dan
rsync does provide compression.  rsync -z is compressed.  just put this
either in your main config or in the specific hosts config for the rsync
command.

ssh can compress the ssh tunnel that you create.

you can also compress ipsec tunnels like openvpn or cisco vpn.

Backup cant recognize it.  The compression is in the transport stream, not
the backup.  You litterally wont be able to tell the difference in the
backuppc backup.

On Fri, Oct 10, 2008 at 4:06 AM, Tomasz Chmielewski <[EMAIL PROTECTED]> wrote:

> Sebastien Sans schrieb:
> > Hello,
> >
> > The compression system of the pool in BackupPc is great, it save a lot
> > of place, but I didn't found how to compress the tranfers in order to
> > save my bandwidth.
> > I tryed to modify the command line in "rzync" and "tar" modes to
> > activate compression (i added -z options to use gz compression), the
> > transfer was shorter but the result was'nt well recognized by
> > BackupPc.
> > I'm sure there is a simple way to compress the tranferts. If someone
> > has the solution, that would be great.
>
> Unfortunately, BackupPC does not support any sort of "transfer
> compression".
>
> The best you can do is:
> - do rsync transfers over SSH - SSH provides compression
> - use VPN with compression, i.e. OpenVPN
>
>
> --
> Tomasz Chmielewski
> http://wpkg.org
>
>
> -
> This SF.Net email is sponsored by the Moblin Your Move Developer's
> challenge
> Build the coolest Linux based applications with Moblin SDK & win great
> prizes
> Grand prize is a trip for two to an Open Source event anywhere in the world
> http://moblin-contest.org/redirect.php?banner_id=100&url=/
> ___
> BackupPC-users mailing list
> BackupPC-users@lists.sourceforge.net
> List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
> Wiki:http://backuppc.wiki.sourceforge.net
> Project: http://backuppc.sourceforge.net/
>
-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


Re: [BackupPC-users] Compression during Xfer

2008-10-10 Thread Tomasz Chmielewski
Sebastien Sans schrieb:
> Hello,
> 
> The compression system of the pool in BackupPc is great, it save a lot
> of place, but I didn't found how to compress the tranfers in order to
> save my bandwidth.
> I tryed to modify the command line in "rzync" and "tar" modes to
> activate compression (i added -z options to use gz compression), the
> transfer was shorter but the result was'nt well recognized by
> BackupPc.
> I'm sure there is a simple way to compress the tranferts. If someone
> has the solution, that would be great.

Unfortunately, BackupPC does not support any sort of "transfer compression".

The best you can do is:
- do rsync transfers over SSH - SSH provides compression
- use VPN with compression, i.e. OpenVPN


-- 
Tomasz Chmielewski
http://wpkg.org


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/


[BackupPC-users] Compression during Xfer

2008-10-10 Thread Sebastien Sans
Hello,

The compression system of the pool in BackupPc is great, it save a lot
of place, but I didn't found how to compress the tranfers in order to
save my bandwidth.
I tryed to modify the command line in "rzync" and "tar" modes to
activate compression (i added -z options to use gz compression), the
transfer was shorter but the result was'nt well recognized by
BackupPc.
I'm sure there is a simple way to compress the tranferts. If someone
has the solution, that would be great.

Cordially,

Ps: Sorry for my bad english, I tryed to do my best...

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK & win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100&url=/
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/