Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Adam Goryachev
2017-09-22 17:24 GMT+02:00 Gandalf Corvotempesta : 2017-09-22 17:20 GMT+02:00 Les Mikesell : How does your overall CPU and RAM use look while this is happening? Remember, your situation is unusual in that you are competing with the ZFS compression activity. CPU almost idle, RAM used at 70%, due

Re: [BackupPC-users] Installing On Webserver

2017-09-22 Thread R Morgan
Hi Micheal, I tested this on a VM and found the the typical apt-get install does not interfere with ISPConfig 3.1 or other services on the machine. I have completed installing BackupPC on my server and I am now in the process of configuring it and testing. Thanks for the info. Randall On Fri,

Re: [BackupPC-users] Installing On Webserver

2017-09-22 Thread Michael Stowe
On 2017-09-21 13:03, R Morgan wrote: Hi All, I am looking into installing BackupPC on a Debian 8 webserver I have hosted at A2 Hosting. I have successfully installed ISPConfig3.1 and it's supporting software and migrated serveral sites to the server. My concern is that, since ISPConfig is insta

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
Just removed "--checksum" from the BackupPC arguments. Now is... FAAAST What i've backupped in about 40hours, now took 60 minutes. YES: 40 hours => 60 minutes. Is --checksum really needed ? (checksum is also missing from rsnapshot arguments, that's why rsnapsh

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
2017-09-22 17:20 GMT+02:00 Les Mikesell : > How does your overall CPU and RAM use look while this is happening? > Remember, your situation is unusual in that you are competing with the > ZFS compression activity. CPU almost idle, RAM used at 70%, due to ZFS ARC cache (50% of ram) No swap. ---

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Les Mikesell
On Fri, Sep 22, 2017 at 9:41 AM, Gandalf Corvotempesta wrote: > Running transfers with loglevel 4, i can see that most of slowdown are > caused by: > > G bpc_file_checksum() > > calls. > How does your overall CPU and RAM use look while this is happening? Remember, your situation is unusual in tha

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
Running transfers with loglevel 4, i can see that most of slowdown are caused by: G bpc_file_checksum() calls. 2017-09-22 15:31 GMT+02:00 Gandalf Corvotempesta : > Also tried with "nc". I'm able to push/pull 110-120MB/s between these > two servers. > > 2017-09-22 15:22 GMT+02:00 Gandalf Corvotem

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
Also tried with "nc". I'm able to push/pull 110-120MB/s between these two servers. 2017-09-22 15:22 GMT+02:00 Gandalf Corvotempesta : > I've made a little bit progress. > Slow select calls are always network related but my net is not > saturated and I'm able to push 1gbp/s regurally with iperf. >

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
I've made a little bit progress. Slow select calls are always network related but my net is not saturated and I'm able to push 1gbp/s regurally with iperf. Moreover, on client side, rsync is sending files very very fast. Could be a bottleneck in BackupPC network management ? 2017-09-22 15:12 GMT+

Re: [BackupPC-users] BackuPC 4 hang during transfer

2017-09-22 Thread Gandalf Corvotempesta
2017-09-21 14:37 GMT+02:00 Craig Barratt via BackupPC-users : > I recommend running strace -p PID -T on the rsync_bpc process to see what it > is up to, and how long various system calls take. I agree your backups > should run much faster. Here is an extract. Some calls are really slow, more than