Re: [BackupPC-users] Slow transfer via rsync?

2015-09-30 Thread Christian Völker
Hi all, just as an update: As I already wrote I figured out there was still a traffic shaper active with the old limiting values of the slow DSL line. Removed this and I got an uplink rate of approx 2Mb/s. Started a backup for this host and see what happened: 2015-09-30 14:41:21 full backup sta

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-29 Thread Christian Völker
Hi folks, after digging a lot and perfoming many tests with differents host I found the issue: On the firewall there was a traffic shaper activated to optimize WAN usage. This was set to the previous values of the slow DSL line: 1024kb/s downlink and 384kb/s uplink. I removed the shaper and the up

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-29 Thread Adam Goryachev
On 29/09/15 22:48, Christian Völker wrote: > Hi, > >> Have you a simple `rsync --progress -avr host:module/ /tmp/' at a shell? >> >> If it acts the same then you've eliminated BackupPC completely from the >> problem. > Hm. > [root@bu ~]# rsync --progress -avr 192.168.1.3:/srv/share/pub/*iso

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-29 Thread Christian Völker
Hi, > Have you a simple `rsync --progress -avr host:module/ /tmp/' at a shell? > > If it acts the same then you've eliminated BackupPC completely from the > problem. Hm. [root@bu ~]# rsync --progress -avr 192.168.1.3:/srv/share/pub/*iso /tmp/ root@192.168.1.3's password: receiving increme

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Holger Parplies
Hi, Christian Völker wrote on 2015-09-28 22:02:26 +0200 [Re: [BackupPC-users] Slow transfer via rsync?]: > >> Why is it still so slow? > [...] > traceroute to 192.168.1.3 (192.168.1.3), 30 hops max, 60 byte packets > 1 10.12.0.1 (10.12.0.1) 344.955 ms 355.805 ms 355.8

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread ngharo
On Mon, Sep 28, 2015 at 10:17:13PM +0200, Christian Völker wrote: > I doubt it will help. Uptime is currently at 59days which means the > issue with the slow backup startet months before the last reboot happened. > > Anyway, nice idea ;) Have you a simple `rsync --progress -avr host:module/ /tmp/

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Christian Völker
Hi B, Most probably, an electrical glitch messed it up. So, may be a reboot could fix your problem as well. Well, I can obviously reboot. But it is a virtual machine running on a VMware ESXi server I doubt it will help. Uptime is currently at 59days which means the issue with the slow b

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Christian Völker
Hi Holger& all, >> [...] >> Why is it still so slow? > it's been mentioned before, though not explicitly. What is the RTT over the > VPN (i.e. between BackupPC server and client host)? So here are several outputs: [root@

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Holger Parplies
Hi, Christian Völker wrote on 2015-09-28 14:55:35 +0200 [Re: [BackupPC-users] Slow transfer via rsync?]: > [...] > Why is it still so slow? it's been mentioned before, though not explicitly. What is the RTT over the VPN (i.e. between BackupPC server and client host)? How many f

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Bzzzz
On Mon, 28 Sep 2015 14:55:35 +0200 Christian Völker wrote: > Hi all, Hi alone ;-p) … > Why is it still so slow? I recently ran into such a problem with an old laptop used as a HTTP svr and having a dead battery. It came from it but the problem was gone after a reboot (ssh it took several minut

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Christian Völker
Hi all, > And what about your backupPC server ? Check it for memory usage. 24GB of RAM. Nothins installed except a CentOS7 minimal Installation and added the BackupPC stuff. Swap is not active at all. 8core CPU Intel(R) Core(TM) i7 CPU 930 @ 2.80GHz is at around 10% usage max. System aver

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-28 Thread Bzzzz
On Mon, 28 Sep 2015 05:41:31 +0200 Christian Völker wrote: > >> When calculating with a 5Mbit/s linke 27GB should be transferred > >> within ~15hours. Here, the initial full backup is not yet done and > >> is already running more than 24hours! > > Make sure you only use one compression order in a

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-27 Thread Patrick Begou
And what about your backupPC server ? Check it for memory usage. I fall in such problems when adding a new host with large dataset to backup (> 100GB, all previous shares where near 10GB each) and the problem was related to the available RAM on my server. As it was a virtual backuppc server I inc

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-27 Thread Christian Völker
Hi, >> The connection is now a 5Mbit/s (uplink) leased line with fixed IP >> (connected through OpenVPN to the BackuPC host). The backup takes >> ages! > How much is the downlink? (rsync needs a good deal of bi-dir exchanges) > 25Mbit/s. The connection is for sure not the limiting factor. Uplink

Re: [BackupPC-users] Slow transfer via rsync?

2015-09-27 Thread Bzzzz
On Sun, 27 Sep 2015 22:48:43 +0200 Christian Völker wrote: > Hi guys, Hi Chris, … > The connection is now a 5Mbit/s (uplink) leased line with fixed IP > (connected through OpenVPN to the BackuPC host). The backup takes > ages! How much is the downlink? (rsync needs a good deal of bi-dir excha

[BackupPC-users] Slow transfer via rsync?

2015-09-27 Thread Christian Völker
Hi guys, I am using BackupPC now for years and it was always running perfectly. Around 25 hosts; /var/lib/BackupPC is around 2TB). Currently I am having an issue with one of my remote hosts. I even created a new instance of BackupPC to test and see what happens- but it is the same! The remote