Re: rsync does not copy hidden directories
Michelene, We use rsync (2.4.6) a lot and it copies dot-directories for us. I suspect you've got a problem with the command line you're using, the following is an example of what we use:- rsync -ae ssh -C -x --delete machine_a:/home/ /backups/machine_a/home/ all the usual dot-directories in the home directories are copied. Francis Stevens Digitalbrain Michelene Chon wrote: We are using rsync and have noticed that it fails to copy hidden directories. I looked through the doc and it doesn't look like there's a flag to get rsync to not skip hidden (dot) directories. Am I missing something or is this By Design? If By Design, I think it should be changed. Michelene Chon Manager, SCM (Software Configuration Management) GetThere, a Sabre company [EMAIL PROTECTED] Phone: (650) 752-1794 Cell: (650) 208-4172
?: 'rsync' hang with 'sshd2' (F-Secure), Digital Unix (OSF1) and HP/UX 11
Hi, I have managed to test this same transfer reliably with the Linux boxes and open-ssh, but I am in trouble with the OSF1 4.0 (Digital Unix) being the server sending files from a single directory to the HP/UX 11 - being the client The 'sshd2' (and ssh2) in both ends is installed as root (and starts probably from 'rc') The 'rsync' (2.4.6) in both end is just installed as a single binary in the stadard user local directory - no '--daemon' mode has been tested yet. The 'OSF/1 server side already has the http://www.clari.net/~wayne/rsync-nohang.patch included - the client side is still missing it Tthe patch included in the OSF side did not have any affect on the trouble. The terminal 'ssh' connection between the machines works OK. The 'scp' works also (though a bit slowly ...) I have tried many combinations of swithces, but e.g.the normal single directory sync: ./rsync -e /usr/local/bin/ssh --rsync-path=/usr/users/rem_usr/bin/rsync rem_usr@rem_host:/usr/users/rem_usr/cpy_src/ ./cpy_target/ executed on HP/UX 11 side seems to be hanging. It seems that the 'rsync' transfer will start but it may hang without any proper error messages on the client side. It may e.g. transfer 0 to 80 of several ~4MB files - (most often count is 0) - and when it hangs it looks like the forked 'sshd' daemon (owned by root) on the OSF/1 server side would stop processing after short boost - though it remains alive as well the 'rsync' daemon running (well... sleeping) under standard end-user ID. When the '--verbose' is used on the client side, the result tells that it is receiving the directory list, and it lists the files it has transferred (most often none appears) A partially transferred file may remain in the receiving directory with the temporary name. The client running on HP/UX 11 does not receive any error information - so it will hang waiting for ever (I have not tested the --timeout yet) Only way to restart is to close the client side with '^C' and restart. Reading the mail archive, it seems that the 'ssh' transport has caused much trouble with some other 'rsync' users. I can configure establish a verbose version of sshd2 proccess at the OSF1/side with a private port(=1888) and standard user ID - and I am capable to connect through it with the normal 'ssh' client from the HP/UX side - but I have not yet been able to configure the remotely starting 'rsync' to use this 'private running' sshd daemon - How this would be possible ? Quite a long story, but if you know some suggestions, please let me know. (I am not experience debugging neither the 'ssh' nor 'rsync' traffic.) I have not used any special options to compile the 'rsync' - the 'off-the-net' source package was compiling fine with OSF/1 after configure - the HP/UX version produced some more trouble when compiled with aCC... I have also tried to read the mailing-list archives, but so far none of the hints found have hit the point. Regards, sh Sauli Harala EDS Finland Oy
Re: rsync does not copy hidden directories
On 12 Sep 2001, Michelene Chon [EMAIL PROTECTED] wrote: We are using rsync and have noticed that it fails to copy hidden directories. I looked through the doc and it doesn't look like there's a flag to get rsync to not skip hidden (dot) directories. Am I missing something or is this By Design? If By Design, I think it should be changed. What command line are you using? That's not the normal behaviour, but you could achieve it using exclude options. -- Martin
rsync transfers of data from Windows to Unix
Are there any clients and/or servers for Windows (clients only for Win98/ME) which can use the rsync protocol, or especially rsync over SSL (e.g. like stunnel, not ssh), which would allow setting up some well controlled and secure bulk file exchanging between Windows an Unix? SMB is not going to be an option and a VPN may not be an option, either (there are technical reasons for that but they are outside the scope of an rsync discussion). FTP is already used in one of the cases I'm exploring and it is problematic, and I would prefer to go with the rsync logic to transfer the data since it is more of a syncronization kind of thing anyway. -- - | Phil Howard - KA9WGN | Dallas | http://linuxhomepage.com/ | | [EMAIL PROTECTED] | Texas, USA | http://phil.ipal.org/ | -
Re: rsync does not copy hidden directories
On 12 Sep 2001, Michelene Chon [EMAIL PROTECTED] wrote: We are using rsync and have noticed that it fails to copy hidden directories. My guess is that you're using a wildcard and your shell isn't expanding that wildcard to include dot dirs. For instance: rsync -av /home/user/* remote:/home/user This would normally fail to include any dot dirs (unless you have your local shell setup to include them). If this guess is correct, the solution is to just drop the '*' (but not the trailing slash) and let rsync do its own directory reading (which will include dot dirs). ..wayne..
rsync and SSL
I'm finding even less on rsync and SSL. I would have imagined someone would have done something with this already, but apparently not. So I guess I need to ask and see for sure: has anyone worked on issues of using rsync via SSL, such as with stunnel? I want to have encrypted access, either anonymous or authenticated, but without granting any SSH access to anyone (e.g. the rsync users won't be in the /etc/passwd user space). -- - | Phil Howard - KA9WGN | Dallas | http://linuxhomepage.com/ | | [EMAIL PROTECTED] | Texas, USA | http://phil.ipal.org/ | -
Re: File merging
On Thursday, September 13, 2001 10:28, you wrote: On Thu, 13 Sep 2001, Andy Goth wrote: Can rsync be made to merge files? For instance, could I synchronize mboxes between multiple computers, even though they're all changing? Not if they are changing simultaneously. You can't do that at all, without a distributed filesystem with locking. I'll avoid simultaneous changes, then, by remembering (or automating) updates before switching computers. I could probably do this pretty easily as some sort of an eth0-up script. On the other hand, if only one system changes at a time rsync works fine. Okay, then, can rsync identify the newer version and copy it to the other system? -- Andy Goth | [EMAIL PROTECTED] | http://null.cc.uic.edu/~andy/
Re: File merging
On 13 Sep 2001, Andy Goth [EMAIL PROTECTED] wrote: I'll avoid simultaneous changes, then, by remembering (or automating) updates before switching computers. I could probably do this pretty easily as some sort of an eth0-up script. On the other hand, if only one system changes at a time rsync works fine. Okay, then, can rsync identify the newer version and copy it to the other system? Yes, look at the -u option: it only replaces if newer. -- Martin