Re: [paramiko] SCPClient slower than scp

2010-02-01 Thread james bardin
On Mon, Feb 1, 2010 at 2:52 AM, Roman Yakovenko roman.yakove...@gmail.com wrote: Hello. I am using SCPClient class from branch( http://bazaar.launchpad.net/~jbardin/paramiko/paramiko_scp/annotate/500?file_id=scp.py-20081117202350-5q0ozjv6zz9ww66y-1 ) with paramiko 1.7.6 and Python 2.6 on

Re: [paramiko] SCPClient slower than scp

2010-02-01 Thread Roman Yakovenko
On Mon, Feb 1, 2010 at 5:36 PM, james bardin jbar...@bu.edu wrote: On Mon, Feb 1, 2010 at 2:52 AM, Roman Yakovenko I am testing my code with file size 1 GB. The SCPClient upload rate starts with 10 MB/s and than drops to 5.2 MB/s. The average is 5.2 MB/s. I tried to change buffer size, but

Re: [paramiko] SCPClient slower than scp

2010-02-01 Thread james bardin
On Mon, Feb 1, 2010 at 11:49 AM, Roman Yakovenko roman.yakove...@gmail.com wrote: You would normally start by using a profiler to see where the performance bottleneck is, before you start speculating. You would have seen that most of the time is spent in paramiko.Transport manipulating data,

Re: [paramiko] SCPClient slower than scp

2010-02-01 Thread james bardin
On Mon, Feb 1, 2010 at 12:16 PM, james bardin jbar...@bu.edu wrote: Yes, the solution written entirely in c will be significantly faster. Since this is mostly python, cpu is the limiting factor. I have zero experience in ssh and encryption, but my expection was that at least in the case of

Re: [paramiko] SCPClient slower than scp

2010-02-01 Thread Roman Yakovenko
On Tue, Feb 2, 2010 at 12:26 AM, james bardin jbar...@bu.edu wrote: On Mon, Feb 1, 2010 at 12:16 PM, james bardin jbar...@bu.edu wrote: Yes, the solution written entirely in c will be significantly faster. Since this is mostly python, cpu is the limiting factor. I have zero experience in