--link-dest behavior
Greetings All, I've been thinking about the current behavior of the --link-dest=DIR option. In the absence of --delete, ALL members of DIR should be linked to the destination (aside from those that are changed). If not, there should at least be a --no-link-dest-delete option. (This latter option might be better to avoid disrupting the behavior of current rsync commands) My rational: This would benefit a snapshot-style backup system, where the user wants to accumulate files without deleting them from the destination. With this behavior the user would not need to search through scores of snapshots to find a file that is no longer in the source. -Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5792] rsync fails to log files "sent" with options: --itemize-changes -n --log-file
https://bugzilla.samba.org/show_bug.cgi?id=5792 [EMAIL PROTECTED] changed: What|Removed |Added AssignedTo|[EMAIL PROTECTED]|[EMAIL PROTECTED] Status|REOPENED|NEW --- Comment #4 from [EMAIL PROTECTED] 2008-10-03 00:36 CST --- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5795] look into a improved tear-down processing during fatal errors
https://bugzilla.samba.org/show_bug.cgi?id=5795 --- Comment #4 from [EMAIL PROTECTED] 2008-10-03 00:35 CST --- That's what I just said. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5802] misleading error message in atomic rsync
https://bugzilla.samba.org/show_bug.cgi?id=5802 [EMAIL PROTECTED] changed: What|Removed |Added Status|REOPENED|RESOLVED Resolution||FIXED --- Comment #3 from [EMAIL PROTECTED] 2008-10-03 00:33 CST --- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: feature request: create remote directory
On Sun, 2008-09-28 at 19:55 +0200, Tim Newsome wrote: > I have a program that copies pictures to a web server using rsync. > Typically it will do something like copy IMG_1234.JPG to > server:/www/docroot/YEAR/MONTH/DAY, where the appropriate numbers are > inserted for YEAR/MONTH/DAY. Currently the only way to do this with > rsync is to locally create YEAR/MONTH/DAY and then tell rsync to copy > it. I would like a syntax which would tell rsync to create a specific > remote directory. Something like: > --remote-dir DIR > Before transferring any files, create DIR if it does not yet exist, and > then put all the files requested to be transferred in that directory. There is already an enhancement request for this: https://bugzilla.samba.org/show_bug.cgi?id=4621 Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3245] improve rsync's error messages to make them clearer
https://bugzilla.samba.org/show_bug.cgi?id=3245 --- Comment #1 from [EMAIL PROTECTED] 2008-10-02 21:09 CST --- Yes, the code 23 message was bad. It has been improved: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1040) [sender=3.0.4] Daniel, if you have other specific suggestions, please state them or attach a patch. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete
On Thu, 2008-10-02 at 21:28 -0400, Franck Yelles wrote: > On 2-Oct-08, at 21:01, Matt McCutchen <[EMAIL PROTECTED]> wrote: > > On Thu, 2008-10-02 at 20:59 -0400, Franck Y wrote: > >> Is there anyway to move the deleted files/folder to another place ? > >> I have googled a little bit but nothing comes out. > > > > It's the --backup-dir option. If you want to treat deleted files > > differently from overwritten ones, use this patch: > > > > http://rsync.samba.org/ftp/rsync/patches/backup-dir-dels.diff > > Thanks matt. > Will it create the same directory tree (structure) ? Yes. Rsync will move each deleted or overwritten destination file to the same path under the backup dir as it was at under the destination, creating ancestor directories as necessary. Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete
On 2-Oct-08, at 21:01, Matt McCutchen <[EMAIL PROTECTED]> wrote: On Thu, 2008-10-02 at 20:59 -0400, Franck Y wrote: Is there anyway to move the deleted files/folder to another place ? I have googled a little bit but nothing comes out. It's the --backup-dir option. If you want to treat deleted files differently from overwritten ones, use this patch: http://rsync.samba.org/ftp/rsync/patches/backup-dir-dels.diff Matt Thanks matt. Will it create the same directory tree (structure) ? -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Question on "Resource temporarily unavailable" error
On Tue, 2008-09-30 at 14:20 -0600, Rob Bosch wrote: > 2008/09/30 12:09:55 [12508] rsync: write failed on "/EDrive/testfile.edb" > (in Test.Backup):Resource temporarily unavailable (11) That error is coming from the destination filesystem. What happens if you copy the files to another place on the destination machine and then locally (using rsync or another tool) to the directory that is giving the errors? If the /EDrive/testfile.edb path is on a network filesystem, see if the network filesystem has logged any errors or try taking it out of the loop by rsyncing directly to the machine holding the destination files. Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5792] rsync fails to log files "sent" with options: --itemize-changes -n --log-file
https://bugzilla.samba.org/show_bug.cgi?id=5792 [EMAIL PROTECTED] changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|WONTFIX | --- Comment #3 from [EMAIL PROTECTED] 2008-10-02 20:07 CST --- What is the justification for a client log file containing all itemize lines *except* regular file transfers? If it is to be consistent with a daemon, I would expect to see no itemize lines at all on a dry run. Whatever the expected behavior is, it should be documented in the man page. The man page does say that --log-file is "similar to the logging that a daemon does". Thus, it might suffice to state in the description of "transfer logging" in rsyncd.conf(5) that nothing is logged on a dry run. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete
On Thu, 2008-10-02 at 20:59 -0400, Franck Y wrote: > Is there anyway to move the deleted files/folder to another place ? > I have googled a little bit but nothing comes out. It's the --backup-dir option. If you want to treat deleted files differently from overwritten ones, use this patch: http://rsync.samba.org/ftp/rsync/patches/backup-dir-dels.diff Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--delete
Hello Guys, Is there anyway to move the deleted files/folder to another place ? I have googled a little bit but nothing comes out. Apaarently there are not this options does anyone know how i can manage this ? Thanks -- Franck -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5802] misleading error message in atomic rsync
https://bugzilla.samba.org/show_bug.cgi?id=5802 [EMAIL PROTECTED] changed: What|Removed |Added Status|RESOLVED|REOPENED Resolution|FIXED | --- Comment #2 from [EMAIL PROTECTED] 2008-10-02 19:49 CST --- I do not see the fix in the git repository at http://gitweb.samba.org/?p=rsync.git;a=summary . -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync hangs after counting some file list
On Mon, 2008-09-29 at 10:37 +0530, Ravi Thati wrote: > I have written script to download a directory from remote machine > which contains the always the updated data. I want to download that > directory onto my local machine periodically with --link-dest option > to my old download directory. > > I have automated the script using " expect scripting" You should consider using ssh public-key authentication (see ssh-keygen(1)) rather than automating the password via expect. > When I run the script I get the following output and it hangs > indefinitely. > > ~/ravit/ravi.ex "--link-dest=/Build56/source/" > "[EMAIL PROTECTED]:/Build58/source/" "./source/" > exp_spawn rsync -avz --stats --progress --partial > --link-dest=/Build56/source/ > [EMAIL PROTECTED]:/Build58/source/ ./source/ > [EMAIL PROTECTED]'s password: > receiving file list ... > 20900 files... Does the same thing happen if you run rsync interactively without "expect"? Try raising the verbosity to -vvv to get more information on where rsync is stalling. Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5795] look into a improved tear-down processing during fatal errors
https://bugzilla.samba.org/show_bug.cgi?id=5795 --- Comment #3 from [EMAIL PROTECTED] 2008-10-02 15:47 CST --- Why not have the process generating the error delay exit until it gets an ack of the error message? A separate connection would be best so the pipelined data doesn't get in the way. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5792] rsync fails to log files "sent" with options: --itemize-changes -n --log-file
https://bugzilla.samba.org/show_bug.cgi?id=5792 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||WONTFIX --- Comment #2 from [EMAIL PROTECTED] 2008-10-02 14:07 CST --- The current code logs the same way for a --log-file as it does for a daemon log, which means that it does not log transfers that aren't really transfers. You can instead use --out-format to change what rsync outputs, and the output will be consistent in dry-run mode with the normal-mode output. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5665] need option to hard link from source tree to dest tree
https://bugzilla.samba.org/show_bug.cgi?id=5665 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||WONTFIX --- Comment #4 from [EMAIL PROTECTED] 2008-10-02 14:01 CST --- I personally don't see the need for this as a special option. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5802] misleading error message in atomic rsync
https://bugzilla.samba.org/show_bug.cgi?id=5802 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||FIXED --- Comment #1 from [EMAIL PROTECTED] 2008-10-02 13:54 CST --- I fixed this in the git repository. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 5795] look into a improved tear-down processing during fatal errors
https://bugzilla.samba.org/show_bug.cgi?id=5795 [EMAIL PROTECTED] changed: What|Removed |Added Severity|blocker |enhancement Status|NEW |ASSIGNED Summary|error in rsync protocol data|look into a improved tear- |stream (code 12) at |down processing during fatal |io.c(632) [sender=3.0.4]|errors --- Comment #2 from [EMAIL PROTECTED] 2008-10-02 13:53 CST --- Yes, the error reporting coming back from some errors can indeed be lacking. However, the pipe-lined nature of the protocol can make this hard to overcome (the error can be behind so much checksum data that it can't make it back prior to the connection getting torn down). In 3.1.0, I have a new option, --msgs2stderr, that can often be used to debug such situations (for non-daemon transfers). It would be good to investigate a reliable way to drain (and discard) the pending data to get all the relevant messages more reliably. For instance, if a new message was added "fatal exit in progress", it could be sent and circle the 3 processes before the connection is torn down. e.g. a write error on the receiver sends the error message (text) to the generator, sends the fatal message too, and then just discards file-change data until it gets the fatal message back from the sender. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 2208] cygwin version of rsync sometimes hangs
https://bugzilla.samba.org/show_bug.cgi?id=2208 [EMAIL PROTECTED] changed: What|Removed |Added CC||[EMAIL PROTECTED] --- Comment #12 from [EMAIL PROTECTED] 2008-10-02 12:46 CST --- The --bwlimit work-around did not fix the problem for me. Instead, I found this page: http://marc-abramowitz.com/archives/2007/10/14/solving-rsync-hangs-with-cygwin/ which described running rsync on the client against a TCP daemon service (rather than over ssh) which solved the problem for me. After setting up an rsyncd.conf file and installing the rsyncd daemon as a service on the remote machine: cygrunsrv --install "rsyncd" --path /usr/bin/rsync --args "--daemon --no-detach" --desc "Starts a rsync daemon for accepting incoming rsync connections" --disp "Rsync Daemon" --type auto it worked without a hitch and is no longer stalling on large files. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync is effecting in the DC switch??
Hi Ben and Chuck, thank you very much for the help, looks like finally was a problem in the switch at the datacenter. Thank you! Manuel Benjamin Schweizer wrote: Hi Manuel, at least, this is not a common problem. I'd use tcpdump to see what is really happening on your network card; if possible also run tcpdump on the receiving machines. This tells you exactly what traffic is on the network. If there are any unrequested broadcasts, check the ethernet address (mac address) of the packets. You should only receive valid broadcasts and traffic that is directed to your server. If you receive unicast traffic that is directed to other hosts than yours, it is a switching problem. I'd suggest rebooting the switch and if possible, upgrading the firmware to the latest release. I expect that you have already rebooted the centos box? Greetings On Tue, Sep 23, 2008 at 12:00:47AM -0300, Manuel Kissoyan wrote: Thanx Ben, But i have really no idea why this is happening, the backup server crashed and the DC rebuild it with centos 5 (i guess had centos4 before), after the rebuild did start this problem, could be something with the os version or distro? not sure where to start, the problem is not broadcasting...i mean, the dc tech told me the following, so the broadcasting is not something that "normal" "is broadcasting to all servers connected to that switch right now. It is not normal for it to be abusing the network and flooding other servers with unwanted traffic." so any help or idea will be aprecciated. btw, here is the command that i was running in the backup server to pull the data from the other servers, not sure if it could have any problem...but i was running the same command without problem before the backup server rebuild. /usr/bin/rsync -rplogDtzH --stats --delete-during --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /backup4/server8 Thanx in advance! Manuel Benjamin Schweizer wrote: Hi Manuel, it is unlikely that rsync is causing your trouble as it operates on top of tcp (osi layer 4); broadcasts are special ethernet packets that are transmitted on osi layer 2. I think there might be another problem with your server or with your switch (is it hubbing?). I suggest you talk to your network admin again or repost this mail into a network list. Greetings Benjamin On Sun, Sep 21, 2008 at 10:16:25PM -0300, Manuel Kissoyan wrote: hi guys, we are using rsycn without problem but today after some problems in one of the servers, the dc tech did find the rsync is effecting in the switch where they have the server connected broadcasting all the ports in the switch at the dc? This is what the dc tech said: "It appears that your server is broadcasting to every port on the switch that you are connected to" Any idea why this is happening? Thanx in advance! im using version 3.0.3 protocol version 30 and im running the command through shell in the destination server (backup server) to pull the files from the other servers: /usr/bin/rsync -rplogDtzH --stats --delete-during --timeout=500 --exclude-from=/rsyncexcludedfiles --files-from=/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /backup/server Manuel -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
