Thanks Christian
Specifying the MAC you suggested makes a big jump in performance.
SSH Options: [-o Ciphers=arcfour128 -o MACs=umac...@openssh.com]
98.65026953028924143858 MB/s
94.75118186708754888342 MB/s
93.67964795503113387533 MB/s
77.35326700132979443792 MB/s
SSH Options: [-o
The previous tests were reading from striped disks 4 spindles,
writing to /dev/null
This is the best so far, with fetching 4 compressed 500MB files
on a remote ramdisk, local output going to /dev/null
All on 10GigE in the same room.
OUTDIR: [/dev/null] SSH Options: [-o Ciphers=arcfour128 -o
On Jul 19 11:58:21, David Diggles wrote:
I am looking for ways to speed up scp over 10GigE.
With parallel transfer of 4x 8GB files, I get
the following test results with various ciphers.
These tests maxed out 4 cores with encryption overhead.
SSH Options: []
42.19127261151704773780 MB/s
Hi David,
Do you see high CPU during transfer?
If you you don't see high CPU, it _could_ be related to round trip
time and window size.
HTH,
Bring order to your Private VLAN network: http://marathon-networks.com
On Thu, Jul 19, 2012 at 4:58 AM, David Diggles da...@elven.com.au wrote:
On Thu, Jul 19, 2012 at 08:08:26AM +0200, Jan Stary wrote:
have you also tried -o 'Compression no'?
I have now. No real difference;
SSH Options: [-o Ciphers=arcfour -o Compression=no]
64.68132476895114469583 MB/s
63.56096147431307883010 MB/s
61.69097005503488103824 MB/s
I am looking for ways to speed up scp over 10GigE.
With parallel transfer of 4x 8GB files, I get
the following test results with various ciphers.
is it local network? why do you encrypt at all?
The data itself is not sensitive and does not really need
to be encrypted, although security
maybe off topic but what is MAXPHYS set in compiled kernel?
every BSD flavor i've seen sets it way too low for modern drives.
2MB is smallest IMHO value that make sense on modern drives.
you may experience lots of seeking when reading 4 files from same disk
On Thu, 19 Jul 2012, David Diggles
I noticed a huge difference in SCP speeds by changing the client.
For example the client WinSCP is much slower than FileZilla.
I am uncertain if there is any significant difference between SCP and
SFTP protocols (I think SCP2 is SFTP). I know both are handled by the
SSH server.
On Thu, Jul 19,
I regularly do use rsh and rcp in my work.
and ssh/scp when needed (public network)
Do you work with a small trusted group, because many attacks come from
co-workers.
--
Why not do something good every day and install BOINC.
I regularly do use rsh and rcp in my work.
and ssh/scp when needed (public network)
Do you work with a small trusted group, because many attacks come from
co-workers.
depends on assumption. For every business i work i assume that co-workers
doesn't harm and that's agreed with the boss.
David Diggles da...@elven.com.au wrote:
I am looking for ways to speed up scp over 10GigE.
With parallel transfer of 4x 8GB files, I get
the following test results with various ciphers.
These tests maxed out 4 cores with encryption overhead.
Assuming that crypto actually is your
On Thu, 19 Jul 2012 13:47:12 +0200 (CEST)
Wojciech Puchar wrote:
depends on assumption. For every business i work i assume that co-workers
doesn't harm and that's agreed with the boss.
Believe me that will change one day. Never had a trusted employee
poached by a competitor for example?
Believe me that will change one day. Never had a trusted employee
poached by a competitor for example?
I just dare to say even greatest software will not solve it.
But believing it will make a danger
Once more i propose moving off list, and you've sent me something
privately as my logs shows
My yahoo account separates out the many list mails. I sometimes feel a
Th problem is not yahoo but all such services. Yahoo, gmail, hotmail,
@wp.pl etc... are all here to control people. nothing else.
You should avoid every large corporation touching your private data.
But... they're free :)
Ontopic: just a noob question, can you use a tcp lb or similar to spread
the load? Thinking relayd and whatever the shared interface is called. Or
are limited to one machine?
Off topic some do not have the will to setup their own mail server. And
they read or reg everything anyway...
On Jul 19,
You should avoid every large corporation touching your private data.
But... they're free :)
Great quote I forgot where from: when you don't know what the product is -- the
product is you
this is what i was talking about. But thanks for citation - it compressed
my multisentence explanation
Ontopic: just a noob question, can you use a tcp lb or similar to spread
the load? Thinking relayd and whatever the shared interface is called. Or
are limited to one machine?
from the topic it seems that network itself and tcp transport isn't a
problem here.
hmm, on Thu, Jul 19, 2012 at 02:25:18AM -0700, Fil DiNoto said that
I noticed a huge difference in SCP speeds by changing the client.
client weirdness is a topic of its own.
for example: total commander sftp plugin. on my home network:
1. start the transfer: speed around 160 KB/s
2. cancel
On Wed, Jul 18, 2012 at 10:17 PM, David Diggles da...@elven.com.au wrote:
Hmmm, ok... hpn-ssh looks like the go.
http://www.psc.edu/index.php/hpn-ssh
http://www.nren.nasa.gov/hpn_ssh.html
http://www.hpsc.csiro.au/userguides/faq/ssh.php#hpn-ssh
hpn-ssh is a very good solution
Along with
I am looking for ways to speed up scp over 10GigE.
With parallel transfer of 4x 8GB files, I get
the following test results with various ciphers.
These tests maxed out 4 cores with encryption overhead.
SSH Options: []
42.19127261151704773780 MB/s
41.32435720074992870891 MB/s
Hmmm, ok... hpn-ssh looks like the go.
http://www.psc.edu/index.php/hpn-ssh
http://www.nren.nasa.gov/hpn_ssh.html
http://www.hpsc.csiro.au/userguides/faq/ssh.php#hpn-ssh
use mosh or LFTP with pget
i.e lftp -c pget -n10 sftp://someuser@someserver:somefile
mosh is a bit weirder in that it will multiplex transfers via udp
sessions... Try lftp first IMHO it is the best swiss army knife of
filetransfer utils.
-JoelW
@aenertia
22 matches
Mail list logo
