Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-20 Thread Sorin Srbu
-Original Message- From: Koen Vermeer [mailto:k...@vermeer.tv] Sent: den 17 oktober 2014 21:49 To: backuppc-users@lists.sourceforge.net Subject: Re: [BackupPC-users] Using NFS to increase backup speed [root@cyndane ~]# yes | pv | ssh titan cat /dev/null 1.16GiB 0:01:29 [14.3MiB

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-20 Thread Sorin Srbu
-Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: den 17 oktober 2014 16:57 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Using NFS to increase backup speed I was worried the full backup wouldn't complete

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
-Original Message- From: Koen Vermeer [mailto:k...@vermeer.tv] Sent: den 16 oktober 2014 17:29 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Using NFS to increase backup speed What about testing the speed over the ssh tunnel? That may

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
-Original Message- From: Colin Shorts [mailto:c.sho...@intrallect.com] Sent: den 16 oktober 2014 17:58 To: backuppc-users@lists.sourceforge.net Subject: Re: [BackupPC-users] Using NFS to increase backup speed You may wish to prevent ssh from using compression when using a fast link

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
-Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: den 16 oktober 2014 18:09 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Using NFS to increase backup speed I'm seeing network speeds at about 35-45 Mbps when

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
-Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: den 16 oktober 2014 18:09 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Using NFS to increase backup speed I'm seeing network speeds at about 35-45 Mbps when

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Holger Parplies
Hi, Sorin Srbu wrote on 2014-10-16 12:25:53 + [[BackupPC-users] Using NFS to increase backup speed]: I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync over ssh. it is a frequent misconception that you *want* to see anything close to the speed the network

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Les Mikesell
On Fri, Oct 17, 2014 at 5:38 AM, Sorin Srbu sorin.s...@orgfarm.uu.se wrote: That sounds pretty good. But unless you have a lot of new files created daily, the bottleneck is usually disk speed, especially merging a lot of small changes into a big existing file. Not too many new files daily,

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Sorin Srbu
-Original Message- From: Les Mikesell [mailto:lesmikes...@gmail.com] Sent: den 17 oktober 2014 14:55 To: General list for user discussion, questions and support Subject: Re: [BackupPC-users] Using NFS to increase backup speed Not too many new files daily, the reading is done from

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Les Mikesell
On Fri, Oct 17, 2014 at 8:29 AM, Sorin Srbu sorin.s...@orgfarm.uu.se wrote: I was worried the full backup wouldn't complete in the limited time the BPC server in online. For practical reasons (well, because of the hd-space available really), the server used is off during nights in order to

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-17 Thread Koen Vermeer
On 10/17/2014 09:40 AM, Sorin Srbu wrote: What about testing the speed over the ssh tunnel? That may tell you whether ssh is slowing down your transfers or that it's due to rsync. If it is ssh, you could trade encryption strength for speed. Would the below do? [root@cyndane ~]# yes | pv |

[BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Sorin Srbu
Hi all, I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync over ssh. Running iperf below I notice the network should theoretically be capable of a bit more than that. I understand that ssh adds quite a bit of bottleneck. [root@titan ~]# iperf -c cyndane

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Koen Vermeer
What about testing the speed over the ssh tunnel? That may tell you whether ssh is slowing down your transfers or that it's due to rsync. If it is ssh, you could trade encryption strength for speed. Best, Koen On October 16, 2014 2:25:53 PM CEST, Sorin Srbu sorin.s...@orgfarm.uu.se

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Colin Shorts
You may wish to prevent ssh from using compression when using a fast link, the overhead probably isn't worth it and may give you a reasonable boost in throughput. Like Koen said, you'll want to benchmark the different scenarios. Regards, Colin On 16/10/14 16:28, Koen Vermeer wrote: What

Re: [BackupPC-users] Using NFS to increase backup speed

2014-10-16 Thread Les Mikesell
On Thu, Oct 16, 2014 at 7:25 AM, Sorin Srbu sorin.s...@orgfarm.uu.se wrote: I'm seeing network speeds at about 35-45 Mbps when using BackupPC and rsync over ssh. That sounds pretty good. But unless you have a lot of new files created daily, the bottleneck is usually disk speed, especially