Re: rsync does not copy hidden directories

2001-09-13 Thread Francis Stevens

Michelene,

We use rsync (2.4.6) a lot and it copies dot-directories for us.  I 
suspect you've
got a problem with the command line you're using, the following is an 
example
of what we use:-

rsync -ae ssh -C -x --delete machine_a:/home/ /backups/machine_a/home/

all the usual dot-directories in the home directories are copied.

Francis Stevens
Digitalbrain

Michelene Chon wrote:

We are using rsync and have noticed that it fails to copy hidden
directories. I looked through the doc and it doesn't look like there's a
flag to get rsync to not skip hidden (dot) directories. Am I missing
something or is this By Design? If By Design, I think it should be changed.

Michelene Chon
Manager, SCM (Software Configuration Management)
GetThere, a Sabre company
[EMAIL PROTECTED]
Phone: (650) 752-1794
Cell: (650) 208-4172








?: 'rsync' hang with 'sshd2' (F-Secure), Digital Unix (OSF1) and HP/UX 11

2001-09-13 Thread Harala, Sauli


Hi, 

I have managed to test this same transfer reliably with the 
Linux boxes and open-ssh,  but I am in trouble with the 
OSF1 4.0 (Digital Unix)  being the server sending files from a single 
directory  to the HP/UX 11 - being the client 

The 'sshd2' (and ssh2) in both ends is installed as root (and starts 
probably from 'rc')

The 'rsync' (2.4.6)  in both end is just installed as a single  binary
in the  stadard user local directory - no '--daemon' mode has been tested
yet.

The 'OSF/1 server side already has the
http://www.clari.net/~wayne/rsync-nohang.patch
included - the client side is still missing it 
Tthe patch included in the OSF side 
did not have any affect on the trouble.

The terminal 'ssh' connection between the machines
works OK. The 'scp' works also (though a bit slowly ...)

I have tried many combinations of swithces, but e.g.the normal single 
directory sync:
./rsync -e /usr/local/bin/ssh --rsync-path=/usr/users/rem_usr/bin/rsync
rem_usr@rem_host:/usr/users/rem_usr/cpy_src/ ./cpy_target/
executed on HP/UX 11 side seems to be hanging.

It  seems that the 'rsync' transfer will start but it may hang
without any proper error messages on the client side.

It may e.g. transfer 0 to 80 of several ~4MB 
files - (most often count is 0) 
- and when it hangs it looks like the forked 
'sshd' daemon (owned by root) on the OSF/1 server 
side would stop processing after short boost 
- though it remains alive as well the 
'rsync' daemon running (well... sleeping) 
under standard end-user ID.

When the '--verbose' is used on the client side,
the result tells that it is receiving the 
directory list, and it lists
the files it has transferred (most often none 
appears)

A partially transferred file may remain in the
receiving directory with the temporary name.

The client running on HP/UX 11  does 
not receive any error information - 
so it will hang waiting for ever 
(I have not tested the --timeout yet)

Only way to restart is to
close the client side with '^C' and restart.

Reading the mail archive, it seems 
that the 'ssh' transport has caused much trouble 
with some other 'rsync' users.

I can configure  establish a verbose 
version of sshd2 proccess at the OSF1/side
with a private port(=1888) and standard user ID - and 
I am capable to connect through it with the normal 'ssh'
client from the HP/UX side - but I have not
yet been able to configure the remotely starting 'rsync' to use this 
'private running' sshd daemon - How this would be possible ?

Quite a long story, but if you know some suggestions, 
please let me know. (I am not experience 
debugging neither the 'ssh' nor 'rsync' traffic.)

I have not used any special options to compile the 'rsync' - the
'off-the-net'
source package was compiling fine with OSF/1 after configure - the
HP/UX version produced some more trouble when compiled with aCC...

I have also tried to read the mailing-list archives, 
but so far none of the hints found have hit the point.

Regards,
sh

Sauli Harala
EDS Finland Oy





Re: rsync does not copy hidden directories

2001-09-13 Thread Martin Pool

On 12 Sep 2001, Michelene Chon [EMAIL PROTECTED] wrote:
 
 We are using rsync and have noticed that it fails to copy hidden
 directories. I looked through the doc and it doesn't look like there's a
 flag to get rsync to not skip hidden (dot) directories. Am I missing
 something or is this By Design? If By Design, I think it should be changed.

What command line are you using?  That's not the normal behaviour, but
you could achieve it using exclude options.

--
Martin





rsync transfers of data from Windows to Unix

2001-09-13 Thread Phil Howard

Are there any clients and/or servers for Windows (clients only
for Win98/ME) which can use the rsync protocol, or especially
rsync over SSL (e.g. like stunnel, not ssh), which would allow
setting up some well controlled and secure bulk file exchanging
between Windows an Unix?  SMB is not going to be an option and
a VPN may not be an option, either (there are technical reasons
for that but they are outside the scope of an rsync discussion).
FTP is already used in one of the cases I'm exploring and it is
problematic, and I would prefer to go with the rsync logic to
transfer the data since it is more of a syncronization kind of
thing anyway.

--
-
| Phil Howard - KA9WGN |   Dallas   | http://linuxhomepage.com/ |
| [EMAIL PROTECTED] | Texas, USA | http://phil.ipal.org/ |
-




Re: rsync does not copy hidden directories

2001-09-13 Thread Wayne Davison

On 12 Sep 2001, Michelene Chon [EMAIL PROTECTED] wrote:
 We are using rsync and have noticed that it fails to copy hidden
 directories.

My guess is that you're using a wildcard and your shell isn't expanding
that wildcard to include dot dirs.  For instance:

rsync -av /home/user/* remote:/home/user

This would normally fail to include any dot dirs (unless you have your
local shell setup to include them).  If this guess is correct, the
solution is to just drop the '*' (but not the trailing slash) and let
rsync do its own directory reading (which will include dot dirs).

..wayne..





rsync and SSL

2001-09-13 Thread Phil Howard

I'm finding even less on rsync and SSL.  I would have imagined someone
would have done something with this already, but apparently not.  So
I guess I need to ask and see for sure: has anyone worked on issues of
using rsync via SSL, such as with stunnel?  I want to have encrypted
access, either anonymous or authenticated, but without granting any SSH
access to anyone (e.g. the rsync users won't be in the /etc/passwd
user space).

-- 
-
| Phil Howard - KA9WGN |   Dallas   | http://linuxhomepage.com/ |
| [EMAIL PROTECTED] | Texas, USA | http://phil.ipal.org/ |
-




Re: File merging

2001-09-13 Thread Andy Goth

On Thursday, September 13, 2001 10:28, you wrote:
 On Thu, 13 Sep 2001, Andy Goth wrote:
  Can rsync be made to merge files?  For instance, could I synchronize
  mboxes between multiple computers, even though they're all changing?

 Not if they are changing simultaneously.  You can't do that at all,
 without a distributed filesystem with locking.

I'll avoid simultaneous changes, then, by remembering (or automating) updates 
before switching computers.  I could probably do this pretty easily as some 
sort of an eth0-up script.

 On the other hand, if only one system changes at a time rsync works fine.

Okay, then, can rsync identify the newer version and copy it to the other 
system?
-- 
Andy Goth  |  [EMAIL PROTECTED]  |  http://null.cc.uic.edu/~andy/




Re: File merging

2001-09-13 Thread Martin Pool

On 13 Sep 2001, Andy Goth [EMAIL PROTECTED] wrote:
 I'll avoid simultaneous changes, then, by remembering (or automating) updates 
 before switching computers.  I could probably do this pretty easily as some 
 sort of an eth0-up script.
 
  On the other hand, if only one system changes at a time rsync works fine.
 
 Okay, then, can rsync identify the newer version and copy it to the other 
 system?

Yes, look at the -u option: it only replaces if newer.
--
Martin