[BackupPC-users] Slow transfer via rsync?
Hi guys, I am using BackupPC now for years and it was always running perfectly. Around 25 hosts; /var/lib/BackupPC is around 2TB). Currently I am having an issue with one of my remote hosts. I even created a new instance of BackupPC to test and see what happens- but it is the same! The remote host has two share to be backed up. / with around 4GB of data and /srv with 27GB of data. The connection is now a 5Mbit/s (uplink) leased line with fixed IP (connected through OpenVPN to the BackuPC host). The backup takes ages! When calculating with a 5Mbit/s linke 27GB should be transferred within ~15hours. Here, the initial full backup is not yet done and is already running more than 24hours! I can see some sort of progress if I do a "lsof| grep rsync" on the client. But it still appears to be ways to slow! On the client "top" tells me 99% idle CPU (and no I/O waits). The NIC and the Internet connection has an outbound usage of around 350kb/s- far away from the 5Mbit/s the line offers. And yes, there is no other outbound traffic going on. I just did a Ms-RDP session and the line usage goes up to the expected 2.5Mbit/s! Do you have a clue why it takes to transfer? It does not seem to be linkes to a new full or incr backup- my existing backup server was not able to back up the machine now for 120days! Even though it tells me 24/7 "backup in progress". So, any idea why this performs so badly? Greetings Christian -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Slow transfer via rsync?
On Sun, 27 Sep 2015 22:48:43 +0200 Christian Völkerwrote: > Hi guys, Hi Chris, … > The connection is now a 5Mbit/s (uplink) leased line with fixed IP > (connected through OpenVPN to the BackuPC host). The backup takes > ages! How much is the downlink? (rsync needs a good deal of bi-dir exchanges) > When calculating with a 5Mbit/s linke 27GB should be transferred within > ~15hours. Here, the initial full backup is not yet done and is already > running more than 24hours! Make sure you only use one compression order in any place (either backuppc or openvpn, NOT both). And as you have a fixed IP address, why not simply use a regular SSH connection instead of openvpn? (I've seen it ridiculed by a simple remote desktop connection on w$…) Jean-Yves -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/
Re: [BackupPC-users] Slow transfer via rsync?
Hi, >> The connection is now a 5Mbit/s (uplink) leased line with fixed IP >> (connected through OpenVPN to the BackuPC host). The backup takes >> ages! > How much is the downlink? (rsync needs a good deal of bi-dir exchanges) > 25Mbit/s. The connection is for sure not the limiting factor. Uplinks is used for ~350Kb/s while the downlink even uses less during the "backup". >> When calculating with a 5Mbit/s linke 27GB should be transferred within >> ~15hours. Here, the initial full backup is not yet done and is already >> running more than 24hours! > Make sure you only use one compression order in any place (either > backuppc or openvpn, NOT both). How should this do any harm? The router is a totally different pc. Shouldn't the cpu usage be high at least if OpenVPN settings would interfere here? > And as you have a fixed IP address, why not simply use a regular SSH > connection instead of openvpn? (I've seen it ridiculed by a simple > remote desktop connection on w$…) What do you mean? I do not want to use direct connections as I have to do a port forward in this case. Greetings Christian -- ___ BackupPC-users mailing list BackupPC-users@lists.sourceforge.net List:https://lists.sourceforge.net/lists/listinfo/backuppc-users Wiki:http://backuppc.wiki.sourceforge.net Project: http://backuppc.sourceforge.net/