Re: cygwin rsync windows to windows ACL problem
I have rsync + robocopy working. I would use robocopy alone but I don't think it can do what I want to do with rsync: rsync -avP --delete --backup --backup-dir=blah SRC DST ...specifically the --backup and --backup-dir options which I use to make my incremental backups from the mirror, and then zip the backup dir after rsync finishes. On Monday 01 October 2007, Matt McCutchen wrote: On 10/1/07, Steve Radich [EMAIL PROTECTED] wrote: Wouldn't robocopy better serve these EXACT needs? It doesn't handle partial file transfers, but neither will rsync given that you are running it only on one end - I.e. to calculate the crc to compare the files contents it would have to read the whole file, then transfer back the changes - That would be SLOWER than just transferring the whole file (assuming symmetrical speed). Running rsync on both sides it should be dramatically faster *IF* there are several large files. If all small files and often changing then robocopy may be just about the same. Correct. Havoc, if the speed benefit of delta transfers is not a priority, I would recommend that you just use robocopy. Otherwise, you could use rsync on both sides in combination with robocopy to copy ownership, or if you want to use rsync by itself, we can try to get the ownership preservation to work. Matt -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Overly Long File Names
Is there a way to fix the skipping of overly long filenames (aside from shortening the names ;)? -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Overly Long File Names
Bah, after googling yet some more it seems like this cannot be fixed :( On Tuesday 02 October 2007, havoc wrote: Is there a way to fix the skipping of overly long filenames (aside from shortening the names ;)? -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir=blah with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. h tml ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir=blah with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. h tml ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- - havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
On Monday 01 October 2007, Matt McCutchen wrote: On 10/1/07, havoc [EMAIL PROTECTED] wrote: I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t246264 7.html ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. What incorrect ownership did rsync set on the destination? That might give me a clue what the problem is. Is the receiving rsync running as an administrator so that it has the power to set ownership arbitrarily? (Once it is, you may have to pass --super to make sure it realizes that.) Do you have entries in your Cygwin /etc/passwd and /etc/group (see http://www.cygwin.com/cygwin-ug-net/ntsec.html ) on both sides for all the owners involved? Matt The SRC is via a default network share: //netbios.name/C$ The DST is a local directory. So there is only onw instance of rsync running (no sending end). The Owners/Groups on the SRC side are: Group: COMPUTER\Administrators User: DOMAIN\SpecificUser Group: SYSTEM The Owners/Groups on the DST side end up as: User: DOMAIN\Administrator Group: DOMAIN\Domain Users Group: Everyone Prior to using an ACL enabled rsync (and rsync without -A) they were: User: DOMAIN\Administrator Group: CREATOR GROUP Group: CREATOR OWNER Group: DOMAIN\Domain Users Group: Everyone I have read http://www.cygwin.com/cygwin-ug-net/ntsec.html (many times) and /etc/passwd and /etc/group look OK, they seem to have all the SIDs in them, including one for SpecificUser. I also just tried rsync -avPA --super ... with no luck. Could the problem be related to rsync only running on a single machine with no remote side? -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir=blah with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. h tml ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- - havoc -- - havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir=blah with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA
Re: cygwin rsync windows to windows ACL problem
Ah, yes, was a terminology mismatch, I understand now. On Monday 01 October 2007, Stephen Zemlicka wrote: I don't think so. Let's get terminology out of the way first. The computer sending data is the client and the computer storing the backups is the server. Rsync needs to read the whole file stored on the server to know what data the client needs to send. Since you are only running rsync on the client, the entire file needs to be transmitted from the server to the client, then read and analyzed. Then, a partial transfer may occur. So you can do a partial transfer but before that is possible, the client needs a full transfer from the server to see what it needs to send. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: havoc [mailto:[EMAIL PROTECTED] Sent: Monday, October 01, 2007 11:54 AM To: Stephen Zemlicka Subject: Re: cygwin rsync windows to windows ACL problem So even with a mapped drive --partial will have no effect? Is this cygwin/Windows specific behavior (as it does work on linux)? On Monday 01 October 2007, Stephen Zemlicka wrote: Remember, if you don't have the rsync daemon running on the remote computer, rsync will transfer whole files anyway. I'm working at getting around this issue with mapped drives but haven't had a lot of time recently to get it ironed out and fully tested. If you are not running rsync on the system you are backing up to, rsync will run exactly like robocopy (ie. with the -W option). _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:46 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only
Re: cygwin rsync windows to windows ACL problem
Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir=blah with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf
Re: cygwin rsync windows to windows ACL problem
Well, I'll try installing cygwin and an rsync daemon on one of the XP workstations to be backed up later tonight to see if having rsync on both ends solves the ACL issue. I just can't do it now as the workstations are in use. On Monday 01 October 2007, Stephen Zemlicka wrote: I'm not sure. If you can run the daemon on the server, you should. My situation doesn't allow me to do that but if yours does, you should. If you initiate the daemon from the client, then I don't believe there's anything extra running on the server except for during backups. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:06 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy
Re: cygwin rsync windows to windows ACL problem
Heh, already found that via: http://www.gaztronics.net/rsync.php On Monday 01 October 2007, Stephen Zemlicka wrote: Check out cwRsync. Should allow you to install and use rsync without the entire cygwin installation. http://www.itefix.no/phpws/index.php?module=pagemasterPAGE_user_op=view_pa g ePAGE_id=6MMN_position=23:23 _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:42 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Well, I'll try installing cygwin and an rsync daemon on one of the XP workstations to be backed up later tonight to see if having rsync on both ends solves the ACL issue. I just can't do it now as the workstations are in use. On Monday 01 October 2007, Stephen Zemlicka wrote: I'm not sure. If you can run the daemon on the server, you should. My situation doesn't allow me to do that but if yours does, you should. If you initiate the daemon from the client, then I don't believe there's anything extra running on the server except for during backups. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:06 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you : :) : On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar
Re: cygwin rsync windows to windows ACL problem
I forgot to mention that my concern with cwrsync is whether or not it is built with ACL support. On Monday 01 October 2007, havoc wrote: Heh, already found that via: http://www.gaztronics.net/rsync.php On Monday 01 October 2007, Stephen Zemlicka wrote: Check out cwRsync. Should allow you to install and use rsync without the entire cygwin installation. http://www.itefix.no/phpws/index.php?module=pagemasterPAGE_user_op=view_ pa g ePAGE_id=6MMN_position=23:23 _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:42 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Well, I'll try installing cygwin and an rsync daemon on one of the XP workstations to be backed up later tonight to see if having rsync on both ends solves the ACL issue. I just can't do it now as the workstations are in use. On Monday 01 October 2007, Stephen Zemlicka wrote: I'm not sure. If you can run the daemon on the server, you should. My situation doesn't allow me to do that but if yours does, you should. If you initiate the daemon from the client, then I don't believe there's anything extra running on the server except for during backups. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:06 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my
Re: cygwin rsync windows to windows ACL problem
I will run it at both ends if that's what it takes. On Monday 01 October 2007, Steve Radich wrote: Someone more knowledgable in rsync correct me if I'm wrong but.. Wouldn't robocopy better serve these EXACT needs? It doesn't handle partial file transfers, but neither will rsync given that you are running it only on one end - I.e. to calculate the crc to compare the files contents it would have to read the whole file, then transfer back the changes - That would be SLOWER than just transferring the whole file (assuming symmetrical speed). Running rsync on both sides it should be dramatically faster *IF* there are several large files. If all small files and often changing then robocopy may be just about the same. Robocopy is part of the windows resource kit I believe, it's been around a long time. There's white papers on Microsoft's site about it. Steve Radich - http://www.aspdeveloper.net / http://www.virtualserverfaq.com BitShop, Inc. - Development, Training, Hosting, Troubleshooting - http://www.bitshop.com -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:46 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Yes, mapped drive, kindof, it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you : :) : On Monday 01 October 2007, Stephen Zemlicka wrote: Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM
