Re: [CentOS] unison versus rsync

2010-01-17 Thread Rainer Traut
Joseph L. Casale schrieb: Another feature of rsync modules that can be useful is that each module can specify a user and group thus one can rsync user directories between systems where the user names are the same but uid and gid may differ. I have been looking at this all morning. Is there

Re: [CentOS] unison versus rsync

2010-01-17 Thread Joseph L. Casale
rsync already defaults to ssh as transport but with $ rsync -e 'ssh -i keyfile' you can use rsync with a ssh key. Yes, that was what I had been doing, but I wanted to avoid the use of ssh completely, the connection is secured over a vpn, silly to incur the overhead of encryption, twice. An rsync

Re: [CentOS] unison versus rsync

2010-01-14 Thread Bill Campbell
On Thu, Jan 14, 2010, Joseph L. Casale wrote: I didn't think unison was maintained any more - and I wouldn't expect anything to beat rsync with the -z option on a slow link. I'd just use the -P option and restart it when/if it fails. It wouldn't hurt to do subsets first since they will be

Re: [CentOS] unison versus rsync

2010-01-14 Thread Joseph L. Casale
Another feature of rsync modules that can be useful is that each module can specify a user and group thus one can rsync user directories between systems where the user names are the same but uid and gid may differ. I have been looking at this all morning. Is there any way to auth with keys or

Re: [CentOS] unison versus rsync

2010-01-14 Thread Toby Bluhm
Joseph L. Casale wrote: Another feature of rsync modules that can be useful is that each module can specify a user and group thus one can rsync user directories between systems where the user names are the same but uid and gid may differ. I have been looking at this all morning. Is there any

Re: [CentOS] unison versus rsync

2010-01-14 Thread Les Mikesell
On 1/14/2010 12:27 PM, Bill Campbell wrote: Another feature of rsync modules that can be useful is that each module can specify a user and group thus one can rsync user directories between systems where the user names are the same but uid and gid may differ. If you are running as root, rsync

Re: [CentOS] unison versus rsync

2010-01-14 Thread Joseph L. Casale
Put them here: http://rpms.linuxpowered.net/hpn-ssh/ All the usual disclaimers apply, I have these running on a few dozen systems at different data centers running file transfers 24/7 for the past year now that I think about it. Nate, That's great! I am not convinced yet that an rsync daemon

Re: [CentOS] unison versus rsync

2010-01-14 Thread nate
Joseph L. Casale wrote: For the sake of being ready Saturday, what is the most secure (not using ssh) to authenticate in a script with an rsync daemon? Looks like it only does the user:pass pairs (not really good for script) or host based wrapper style security? If the IPs are static then

Re: [CentOS] unison versus rsync

2010-01-14 Thread Bill Campbell
On Thu, Jan 14, 2010, Joseph L. Casale wrote: Another feature of rsync modules that can be useful is that each module can specify a user and group thus one can rsync user directories between systems where the user names are the same but uid and gid may differ. I have been looking at this all

[CentOS] unison versus rsync

2010-01-13 Thread Joseph L. Casale
Anyone got any actual comparisons between unison and rsync specifically related to the performance of synchronization of large data sets over slow links? I have a huge tree to start replication of Friday and know that if I sync the root paths it will take ages and with the lack of any overall

Re: [CentOS] unison versus rsync

2010-01-13 Thread Les Mikesell
On 1/13/2010 5:54 PM, Joseph L. Casale wrote: Anyone got any actual comparisons between unison and rsync specifically related to the performance of synchronization of large data sets over slow links? I have a huge tree to start replication of Friday and know that if I sync the root paths

Re: [CentOS] unison versus rsync

2010-01-13 Thread Joseph L. Casale
I didn't think unison was maintained any more - and I wouldn't expect anything to beat rsync with the -z option on a slow link. I'd just use the -P option and restart it when/if it fails. It wouldn't hurt to do subsets first since they will be quickly skipped when you repeat from the root.

Re: [CentOS] unison versus rsync

2010-01-13 Thread nate
Joseph L. Casale wrote: Looks like rf has 3.0.7, thanks for that tip. Frankly, I abhor the thought of even using rsync for this, it's over a vpn so there is absolutely no need for encryption but I don't know another tool that can transfer diffs only? Check out HPN-SSH, I use it extensively to

Re: [CentOS] unison versus rsync

2010-01-13 Thread xufengnju
: 主题: Re: [CentOS] unison versus rsync I didn't think unison was maintained any more - and I wouldn't expect anything to beat rsync with the -z option on a slow link. I'd just use the -P option and restart it when/if it fails. It wouldn't hurt to do subsets first since they will be quickly

Re: [CentOS] unison versus rsync

2010-01-13 Thread Joseph L. Casale
Check out HPN-SSH, I use it extensively to transfer files over ssh, it provides a null cipher which you can use to disable encryption of data, while still maintaining encryption of authentication credentials. http://www.psc.edu/networking/projects/hpn-ssh/ I transfer over a terrabyte of data a

Re: [CentOS] unison versus rsync

2010-01-13 Thread Les Mikesell
Joseph L. Casale wrote: I didn't think unison was maintained any more - and I wouldn't expect anything to beat rsync with the -z option on a slow link. I'd just use the -P option and restart it when/if it fails. It wouldn't hurt to do subsets first since they will be quickly skipped when

Re: [CentOS] unison versus rsync

2010-01-13 Thread nate
Joseph L. Casale wrote: That looks impressive, I would love to use that for other needs as well. How exactly do you go about installing this under CentOS? I can pretty well assume that patching the stock rpm would not work:) For me I just built it from source and patched it, then built custom

Re: [CentOS] unison versus rsync

2010-01-13 Thread Les Mikesell
nate wrote: Joseph L. Casale wrote: That looks impressive, I would love to use that for other needs as well. How exactly do you go about installing this under CentOS? I can pretty well assume that patching the stock rpm would not work:) For me I just built it from source and patched it,

Re: [CentOS] unison versus rsync

2010-01-13 Thread Joseph L. Casale
Am I missing something or does it only matter where you have a very high bandwidth connection with some latency? I would imagine, but I have a server that takes rsync/ssh connections from multiple windows boxes everyday for differential updates to copies of databases and the load on that

Re: [CentOS] unison versus rsync

2010-01-13 Thread nate
Les Mikesell wrote: Am I missing something or does it only matter where you have a very high bandwidth connection with some latency? That is why I use it, high bandwidth and some latency. I mentioned it because it also has the none cipher which disables encryption, might be more flexible then

Re: [CentOS] unison versus rsync

2010-01-13 Thread nate
Joseph L. Casale wrote: Nate, care to share those packages:) Sure I can post them somewhere tomorrow probably, nothing fancy.. nate ___ CentOS mailing list CentOS@centos.org http://lists.centos.org/mailman/listinfo/centos

Re: [CentOS] unison versus rsync

2010-01-13 Thread Les Mikesell
Joseph L. Casale wrote: Am I missing something or does it only matter where you have a very high bandwidth connection with some latency? I would imagine, but I have a server that takes rsync/ssh connections from multiple windows boxes everyday for differential updates to copies of