Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Doug Hughes]

On 3/28/2017 5:24 AM, Harry Putnam wrote:
> Timothy Coalson  writes:
>
>> On Mon, Mar 27, 2017 at 9:44 PM, Harry Putnam  wrote:
>>
>>> Geoff Nordli  writes:
>>>
>>> [...]
>>>
 Just a thought here, you may want to try a different ssh cipher. Give
 arcfour a try and see if that is fast enough for you.

>>> Can that be done on ssh command line or must be done in ssh_config?
>>>
>>> You are transferring via mbuffer through a separate TCP connection, so
>> changing the ssh cipher won't change the speed.
> I think what Timothy C has in mind is dropping mbuffer/tamp and using
> ssh for the whole thing
>
>  zfs send p/fs@now | ssh RECV_HOST zfs recv p/fs
>

In my experience, while using mbuffer has some extra pitfalls in terms
of sockets and keeping up with things when there are issues (sometimes
leaving mbuffer's lying around, which was subsequently fixed in the
mbuffer code with SIGCHLD), it's a lot more efficient on the network and
faster to do the backups by 30%. If that isn't so important, ssh works
pretty well.

___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] What to do when zfs destroy -f or -R or both doesn't destroy

[Jason Matthews]

> 
 
Re busy
What about loop back mounts? 
Any shares of any type?
Anything like that?

Re failed service
The local fs error maybe because the system is trying to mount a fs on top of a 
non-empty directory or equivalently two file systems have the same mount point. 

___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Geoff Nordli]

On 2017-03-27 09:33 PM, Timothy Coalson wrote:

On Mon, Mar 27, 2017 at 9:44 PM, Harry Putnam  wrote:


Geoff Nordli  writes:

[...]


Just a thought here, you may want to try a different ssh cipher. Give
arcfour a try and see if that is fast enough for you.


Can that be done on ssh command line or must be done in ssh_config?

You are transferring via mbuffer through a separate TCP connection, so

changing the ssh cipher won't change the speed.

Tim



Hi Tim.

From my tests, arcfour produced a noticeable speed increase.  I was 
digging around trying to find the numbers, but couldn't find them.


Also Harry will need to figure out what is good enough for speed. If I 
am doing frequent replication, then mbuffer makes a lot of sense, but if 
I am backing up a couple of times a day, then most likely an SSH 
connection is good enough.


I also compress data through the SSH connection, but since Harry said he 
was on a LAN compression wouldn't make sense.


Geoff




___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Harry Putnam]

Harry Putnam  writes:

> I tried this at ~/.ssh/config on source host.  The host named
> in the config is the destination host that is running the rsync cmd.
>
>   Host g1 <= name of linux host
>  HostName g1.local.lan   <=same linux host
>  Ciphers  arcfour

Nevermind bothering to reply.  I found a way to get it
working... still trying to see if it is any faster.

Ended up add arcfour to defaults in /etc/ssh/sshd_config
On the source host.  And setting -c arcfour from cmd line on
destination host.

Thanks for the push start..


___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Harry Putnam]

Geoff Nordli  writes:

> On 2017-03-27 07:44 PM, Harry Putnam wrote:
>> Geoff Nordli  writes:
>>
>> [...]
>>
>>> Just a thought here, you may want to try a different ssh cipher. Give
>>> arcfour a try and see if that is fast enough for you.
>>>
>> Can that be done on ssh command line or must be done in ssh_config?
>>
>>
>
> command line works:
>
> -c arcfour

But apparently something has to be done on the receiver too.

Currently my two solaris hosts are very busy shifting 400GB or so
using mbuffer/tamp

So, this was just a quick test on linux with an rsync pull from
win64 10 box running cygwin.

I get an error saying there is no matching cipher

Run from destination host:

 rsync -avvz -e 'ssh -c arcfour'  harry@2x2:/cygdrive/f/vb/vm/iso /
 
  Unable to negotiate with 192.168.1.20 port 22: no matching cipher
  found. Their offer:

chacha20-poly1...@openssh.com,aes128-ctr,aes192-ctr,aes256-ctr,aes128-...@openssh.com,aes256-...@openssh.com

  rsync: connection unexpectedly closed (0 bytes received so far)
  [Receiver] rsync error: error in rsync protocol data stream (code 12)
  at io.c(226) [Receiver=3.1.2]

I'm not at all familiar with ~/.ssh/config files but tried to use this
on the source host (win 10 running cygwin)

All the examples I googled up seem to be for outgoing ssh cmds, not
incoming. It's not even clear if ~/.ssh/config can handle incoming.

So maybe it cannot be done from command line after all without some
kind of special settings on the source host.

I tried this at ~/.ssh/config on source host.  The host named
in the config is the destination host that is running the rsync cmd.

  Host g1 <= name of linux host
 HostName g1.local.lan   <=same linux host
 Ciphers  arcfour
   


___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Harry Putnam]

Harry Putnam  writes:

> I think what Timothy C has in mind is dropping mbuffer/tamp and using
> ssh for the whole thing
>
>  zfs send p/fs@now | ssh RECV_HOST zfs recv p/fs

OOps that should have read ...
  I think what Geoff N has in mind [...]


___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss

Re: [OpenIndiana-discuss] mbuffer connection refused on varius ports ... what to try

[Harry Putnam]

Timothy Coalson  writes:

> On Mon, Mar 27, 2017 at 9:44 PM, Harry Putnam  wrote:
>
>> Geoff Nordli  writes:
>>
>> [...]
>>
>> >
>> > Just a thought here, you may want to try a different ssh cipher. Give
>> > arcfour a try and see if that is fast enough for you.
>> >
>>
>> Can that be done on ssh command line or must be done in ssh_config?
>>
>> You are transferring via mbuffer through a separate TCP connection, so
> changing the ssh cipher won't change the speed.

I think what Timothy C has in mind is dropping mbuffer/tamp and using
ssh for the whole thing

 zfs send p/fs@now | ssh RECV_HOST zfs recv p/fs


___
openindiana-discuss mailing list
openindiana-discuss@openindiana.org
https://openindiana.org/mailman/listinfo/openindiana-discuss