[BackupPC-users] Slow transfer via rsync?

[Christian Völker]

Hi guys,

I am using BackupPC now for years and it was always running perfectly.
Around 25 hosts; /var/lib/BackupPC is around 2TB).

Currently I am having an issue with one of my remote hosts.

I even created a new instance of BackupPC to test and see what happens-
but it is the same!


The remote host has two share to be backed up. / with around 4GB of data
and /srv with 27GB of data.

The connection is now a 5Mbit/s (uplink) leased line with fixed IP
(connected through OpenVPN to the BackuPC host).  The backup takes ages!

When calculating with a 5Mbit/s linke 27GB should be transferred within
~15hours. Here, the initial full backup is not yet done and is already
running more than 24hours!

I can see some sort of progress if I do a "lsof| grep rsync" on the
client. But it  still appears to be ways to slow! On the client "top"
tells me 99% idle CPU (and no I/O waits). The NIC and the Internet
connection has an outbound usage of around 350kb/s- far away from the
5Mbit/s the line offers.
And yes, there is no other outbound traffic going on. I just did a
Ms-RDP session and the line usage goes up to the expected 2.5Mbit/s!

Do you have a clue why it takes to transfer?

It does not seem to be linkes to a new full or incr backup- my existing
backup server was not able to back up the machine now for 120days! Even
though it tells me 24/7 "backup in progress".

So, any idea why this performs so badly?

Greetings

Christian


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Slow transfer via rsync?

[Bzzzz]

On Sun, 27 Sep 2015 22:48:43 +0200
Christian Völker  wrote:

> Hi guys,

Hi Chris,

…
> The connection is now a 5Mbit/s (uplink) leased line with fixed IP
> (connected through OpenVPN to the BackuPC host).  The backup takes
> ages!

How much is the downlink? (rsync needs a good deal of bi-dir exchanges)
 
> When calculating with a 5Mbit/s linke 27GB should be transferred within
> ~15hours. Here, the initial full backup is not yet done and is already
> running more than 24hours!

Make sure you only use one compression order in any place (either
backuppc or openvpn, NOT both).

And as you have a fixed IP address, why not simply use a regular SSH
connection instead of openvpn? (I've seen it ridiculed by a simple
remote desktop connection on w$…)

Jean-Yves

--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/

Re: [BackupPC-users] Slow transfer via rsync?

[Christian Völker]

Hi,
>> The connection is now a 5Mbit/s (uplink) leased line with fixed IP
>> (connected through OpenVPN to the BackuPC host).  The backup takes
>> ages!
> How much is the downlink? (rsync needs a good deal of bi-dir exchanges)
>  
25Mbit/s. The connection is for sure not the limiting factor. Uplinks is
used for ~350Kb/s while the downlink even uses less during the "backup".

>> When calculating with a 5Mbit/s linke 27GB should be transferred within
>> ~15hours. Here, the initial full backup is not yet done and is already
>> running more than 24hours!
> Make sure you only use one compression order in any place (either
> backuppc or openvpn, NOT both).
How should this do any harm? The router is a totally different pc.
Shouldn't the cpu usage be high at least if OpenVPN settings would
interfere here?

> And as you have a fixed IP address, why not simply use a regular SSH
> connection instead of openvpn? (I've seen it ridiculed by a simple
> remote desktop connection on w$…)
What do you mean? I do not want to use direct connections as I have to
do a port forward in this case.

Greetings

Christian


--
___
BackupPC-users mailing list
BackupPC-users@lists.sourceforge.net
List:https://lists.sourceforge.net/lists/listinfo/backuppc-users
Wiki:http://backuppc.wiki.sourceforge.net
Project: http://backuppc.sourceforge.net/