Re: Extending --log-format
On Sep 28, Wayne Davison wrote: | On Tue, Sep 28, 2004 at 11:42:54AM -0400, Christophe Kalt wrote: | i couldn't find anything in my various searches :-( | | It was surprisingly hard to google for due to him using the phrase | report options for the idea. Here are the messages to which I was | referring: | | http://lists.samba.org/archive/rsync/2003-May/006057.html | http://lists.samba.org/archive/rsync/2003-May/006058.html Ahh, thanks! This deals with a different although related problem which i had not yet decided how to address, partly because i thought the above approach may be too much for you guys. i'm quite happy to implement JW's proposal as it'd ultimately give me what i am after. After much pondering i now/also think it's then best to leave the --log-format related stuff untouched. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete and explicitly listed files
From: Wayne Davison [EMAIL PROTECTED] This is because rsync is a copy command, and you told it to copy a file that doesn't exist. Rsync does not currently have a way to specify individual files to delete, This is exactly what I am asking for... why? rsync is not just a copy command. It goes far beyond and has extended features making it a powerful synchronization tool. This is why we like it so much. 'cp' from dir to dir does not provide --delete functionality either, so an analogy with copy command is not an excuse for not having a feature I am looking for. Just keep in mind that I am not looking for changing _default_ rsync behaviour. I am asking for an extra feature, which can be turned on by --delete, or by one of the --delete flavors. My example in the beginning of this thread is a good ground for the motion. There is no much difference between CASE1 and CASE2 it it. But the result is drastically different. So, you're best off if you keep two lists of files -- a list of changed/added files, and a list of deleted files -- but it's easy to filter a single list, like this example perl script does: Perhaps, the biggest problem for us is not that files are not deleted on target host, but that rsync crashes with exit code 23, when a file on the list does not exist. To avoid this we have started to do basically what you are saying. We had to move from statically defined file lists to file lists gathered dynamically immediately before rsync call. But it does not solve the problem completely. And your Perl code is not immune to this, either. It is a live real-time system, so files can be removed between the list creation and an actual rsync invocation. And then it crashes. We experience these crashes as often as once per two or three days. It's a real headache. Otherwise I would not come to this mailing list looking for answers. This is ATT Research by the word. Thanks, Igor -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync 2.6.2 hang (was rsync 2.6.2 crash)
OK, I installed 2.6.3pre2 on both the client and server. The server is run via a ssh command option in authorized keys: command=rsync --server --daemon . The client command is: rsync -Pvvvtr --rsh=ssh -l mpdm -i ADMIN/rsa-mpdm01 pcls046147::MPDM/subdir . For this test, there were 2 client rsync processes and 1 server process at the time of the hang. Here are the 3 sets of traces, server, client, and client child: $ gdb /usr/bin/rsync 2808 GNU gdb 2003-09-20-cvs (cygwin-special) Copyright 2003 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type show copying to see the conditions. There is absolutely no warranty for GDB. Type show warranty for details. This GDB was configured as i686-pc-cygwin... Attaching to program `/usr/bin/rsync.exe', process 3288 [Switching to thread 3288.0xe40] (gdb) info threads * 4 thread 3288.0xe40 0x7c901231 in ntdll!DbgUiConnectToDbg () from /cygdrive/c/WINDOWS/system32/ntdll.dll 3 thread 3288.0xd0 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll 2 thread 3288.0xa04 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll 1 thread 3288.0xb24 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll (gdb) bt #0 0x7c901231 in ntdll!DbgUiConnectToDbg () from /cygdrive/c/WINDOWS/system32/ntdll.dll #1 0x7c9507a8 in ntdll!KiIntSystemCall () from /cygdrive/c/WINDOWS/system32/ntdll.dll #2 0x0005 in ?? () #3 0x0004 in ?? () #4 0x0001 in ?? () #5 0x00c2ffd0 in ?? () #6 0xf8dc31e8 in ?? () #7 0x in ?? () #8 0x7c90ee18 in strchr () from /cygdrive/c/WINDOWS/system32/ntdll.dll #9 0x7c9507c8 in ntdll!KiIntSystemCall () from /cygdrive/c/WINDOWS/system32/ntdll.dll (gdb) thread 3 [Switching to thread 3 (thread 3288.0xd0)]#0 0x7c90eb94 in ntdll!LdrAccessResou rce () from /cygdrive/c/WINDOWS/system32/ntdll.dll (gdb) bt #0 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll #1 0x7c90d85c in ntdll!ZwDelayExecution () from /cygdrive/c/WINDOWS/system32/ntdll.dll #2 0x7c8023ed in SleepEx () from /cygdrive/c/WINDOWS/system32/kernel32.dll (gdb) thread 2 [Switching to thread 2 (thread 3288.0xa04)]#0 0x7c90eb94 in ntdll!LdrAccessReso urce () from /cygdrive/c/WINDOWS/system32/ntdll.dll (gdb) bt #0 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll #1 0x7c90e288 in ntdll!ZwReadFile () from /cygdrive/c/WINDOWS/system32/ntdll.dll #2 0x7c801875 in ReadFile () from /cygdrive/c/WINDOWS/system32/kernel32.dll #3 0x0748 in ?? () (gdb) thread 1 [Switching to thread 1 (thread 3288.0xb24)]#0 0x7c90eb94 in ntdll!LdrAccessReso urce () from /cygdrive/c/WINDOWS/system32/ntdll.dll (gdb) bt #0 0x7c90eb94 in ntdll!LdrAccessResource () from /cygdrive/c/WINDOWS/system32/ntdll.dll #1 0x7c90e9ab in ntdll!ZwWaitForMultipleObjects () from /cygdrive/c/WINDOWS/system32/ntdll.dll #2 0x7c8094f2 in KERNEL32!CreateFileMappingA () from /cygdrive/c/WINDOWS/system32/kernel32.dll #3 0x0002 in ?? () #4 0x0022d668 in ?? () #5 0x0001 in ?? () (gdb) --- $ gdb /usr/bin/rsync 2492 GNU gdb 2003-09-20-cvs (cygwin-special) Copyright 2003 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type show copying to see the conditions. There is absolutely no warranty for GDB. Type show warranty for details. This GDB was configured as i686-pc-cygwin... Attaching to program `/usr/bin/rsync.exe', process 2496 [Switching to thread 2496.0x980] (gdb) info threads * 5 thread 2496.0x980 0x77f813b2 in ntdll!DbgUiConnectToDbg () from /cygdrive/c/WINNT/system32/NTDLL.DLL 4 thread 2496.0x9d0 0x77f82870 in ntdll!ZwWaitForSingleObject () from /cygdrive/c/WINNT/system32/NTDLL.DLL 3 thread 2496.0x8c0 0x77f8287e in ntdll!ZwWaitForMultipleObjects () from /cygdrive/c/WINNT/system32/NTDLL.DLL 2 thread 2496.0x9c4 0x77f82926 in ntdll!ZwReadFile () from /cygdrive/c/WINNT/system32/NTDLL.DLL 1 thread 2496.0x6c4 0x77f8287e in ntdll!ZwWaitForMultipleObjects () from /cygdrive/c/WINNT/system32/NTDLL.DLL (gdb) bt #0 0x77f813b2 in ntdll!DbgUiConnectToDbg () from /cygdrive/c/WINNT/system32/NTDLL.DLL #1 0x7c57180b in KERNEL32!DebugActiveProcess () from /cygdrive/c/WINNT/system32/KERNEL32.DLL #2 0x61003e84 in getprogname () from /usr/bin/cygwin1.dll #3 0x00f8f0d0 in ?? () (gdb) thread 4 [Switching to thread 4 (thread 2496.0x9d0)]#0 0x77f82870 in ntdll!ZwWaitForSingleObject () from /cygdrive/c/WINNT/system32/NTDLL.DLL (gdb) bt #0 0x77f82870 in ntdll!ZwWaitForSingleObject () from /cygdrive/c/WINNT/system32/NTDLL.DLL #1 0x74fdbcd2 in WSPSetSockOpt () from
Rsync 2.6.3 released
I have released rsync 2.6.3. This is an incremental release from 2.6.2 that adds several new features and fixes a good number of bugs. You can read all about it in the release-NEWS: http://rsync.samba.org/ftp/rsync/rsync-2.6.3-NEWS There are a variety of download instructions on the website's download page, but for the most common method, just use one of these links: http://rsync.samba.org/ftp/rsync/rsync-2.6.3.tar.gz http://rsync.samba.org/ftp/rsync/rsync-2.6.2-2.6.3.diffs.gz And verify it using one of these gpg signatures: http://rsync.samba.org/ftp/rsync/rsync-2.6.3.tar.gz.asc http://rsync.samba.org/ftp/rsync/rsync-2.6.2-2.6.3.diffs.gz.asc Note that the diffs file no longer updates the patches dir, so if you want to check out these diffs, you'll need to either download the tar file or grab the patches dir via one of the many other download options for the source. Enjoy! ..wayne.. signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [cygwin] Fwd: Updated: rsync-2.6.2-3
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Lapo Luchini wrote: This third attempt solves both the august security fix and the textmode bug that 2.6.2-2 had. Whoops, I forgot to ask if the patch could be kindly included in the original source (it follows). I don't think there is any reason not to ask for binary mode on non-Windows hosts, anyway (it's already done also in do_open(...), also). If you're using 2.6.2-1 or earlier version to avoid the textmode bug, you're now strongly advised to upgrade to 2.6.2-4 and by the way.. yes, this was a typo, no 2.6.2-4 version exists nor it will ever be, it was meant to be upgrade to 2.6.2-3 (next one will be 2.6.3-1). Here comes the patch (with many thanks to Sjoerd Mullender for having found the long standing bug, that insidiously began to show up only in last version (I still wonder why it didn't show in earlier build, really)): diff -urN -x .build -x .inst -x .sinst rsync-2.6.2-orig/syscall.c rsync-2.6.2/syscall.c - --- rsync-2.6.2-orig/syscall.c2004-02-18 23:33:21.0 +0100 +++ rsync-2.6.2/syscall.c 2004-09-28 13:05:03.187353800 +0200 @@ -164,6 +164,7 @@ errno = errno_save; return -1; } + setmode(fd, O_BINARY); return fd; } #else - -- L a p o L u c h i n i l a p o @ l a p o . i t w w w . l a p o . i t / http://www.megatokyo.it -BEGIN PGP SIGNATURE- Version: GnuPG v1.2.4 (Cygwin) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iEYEARECAAYFAkFciVsACgkQaJiCLMjyUvskHwCeMX+ftxMRRs8sm/DmfInN5K/s Z5EAoN+a5cYMUloq56ZkvM4BVROBfpL4 =1TSX -END PGP SIGNATURE- -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [cygwin] Fwd: Updated: rsync-2.6.2-3
On Fri, Oct 01, 2004 at 12:31:55AM +0200, Lapo Luchini wrote: I don't think there is any reason not to ask for binary mode on non-Windows hosts, anyway (it's already done also in do_open(...), also). It has to be configured around the presence of the setmode() function and only done if O_BINARY isn't 0 (which it is on systems that don't need it). So, I'll add it with the appropriate conditional compilation code wrapping it up. Thanks! (I still wonder why it didn't show in earlier build, really): Probably because something recently changed in the cygwin support functions. (That code-path wouldn't have been used if HAVE_FCHMOD or HAVE_SECURE_MKSTEMP was zero.) ..wayne.. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Ways of further restricting rsync.
I've done something similar to what is at http://www.jdmz.net/ssh/ but it restricts rsync to certain directories based on the key used. For example, one key has read/write access, the other has read-only access: command=rrsync logs/client ssh-rsa B3NzaC1yc2EBIwAAAIEAzGhEeNlPr... command=rrsync -ro results ssh-rsa B3NzaC1yc2EBIwAAAIEAmkHG1WCjC... http://www.inwap.com/mybin/miscunix/?rrsync -Joe -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
CVS update: rsync
Date: Thu Sep 30 09:37:38 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv2971 Modified Files: NEWS Log Message: - Mention the fix for lost output with 21. - Prepare the file for the 2.6.3 final release. Revisions: NEWS1.212 = 1.213 http://www.samba.org/cgi-bin/cvsweb/rsync/NEWS?r1=1.212r2=1.213 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Thu Sep 30 09:58:39 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv7502 Modified Files: NEWS Log Message: Refined the text of a few of the news items. Revisions: NEWS1.213 = 1.214 http://www.samba.org/cgi-bin/cvsweb/rsync/NEWS?r1=1.213r2=1.214 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync/patches
Date: Thu Sep 30 10:16:15 2004 Author: wayned Update of /data/cvs/rsync/patches In directory dp.samba.org:/tmp/cvs-serv11328 Modified Files: mkfifo.diff Log Message: Update Makefile.in so that all targets that use syscall.o now include lib/compat.o. Revisions: mkfifo.diff 1.3 = 1.4 http://www.samba.org/cgi-bin/cvsweb/rsync/patches/mkfifo.diff?r1=1.3r2=1.4 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Thu Sep 30 10:46:43 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv18202 Modified Files: NEWS Log Message: Mention the enhancement that was made (quite a while ago) to the daemon's wildcard-expansion limit (formerly 1000 items, now memory limited). Revisions: NEWS1.214 = 1.215 http://www.samba.org/cgi-bin/cvsweb/rsync/NEWS?r1=1.214r2=1.215 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Thu Sep 30 16:36:42 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv9688 Modified Files: configure configure.in rsync.1 rsync.yo rsyncd.conf.5 rsyncd.conf.yo Log Message: Preparing for release of 2.6.3 Revisions: configure 1.193 = 1.194 http://www.samba.org/cgi-bin/cvsweb/rsync/configure?r1=1.193r2=1.194 configure.in1.201 = 1.202 http://www.samba.org/cgi-bin/cvsweb/rsync/configure.in?r1=1.201r2=1.202 rsync.1 1.210 = 1.211 http://www.samba.org/cgi-bin/cvsweb/rsync/rsync.1?r1=1.210r2=1.211 rsync.yo1.194 = 1.195 http://www.samba.org/cgi-bin/cvsweb/rsync/rsync.yo?r1=1.194r2=1.195 rsyncd.conf.5 1.69 = 1.70 http://www.samba.org/cgi-bin/cvsweb/rsync/rsyncd.conf.5?r1=1.69r2=1.70 rsyncd.conf.yo 1.73 = 1.74 http://www.samba.org/cgi-bin/cvsweb/rsync/rsyncd.conf.yo?r1=1.73r2=1.74 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsyncweb
Date: Thu Sep 30 16:52:20 2004 Author: wayned Update of /data/cvs/rsyncweb In directory dp.samba.org:/tmp/cvs-serv13638 Modified Files: index.html Log Message: Changed the announcements for the prereleases to be an announcement for 2.6.3. Revisions: index.html 1.33 = 1.34 http://www.samba.org/cgi-bin/cvsweb/rsyncweb/index.html?r1=1.33r2=1.34 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Fri Oct 1 02:31:10 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv26762 Modified Files: configure configure.in Log Message: Check for the setmode() function. Revisions: configure 1.194 = 1.195 http://www.samba.org/cgi-bin/cvsweb/rsync/configure?r1=1.194r2=1.195 configure.in1.202 = 1.203 http://www.samba.org/cgi-bin/cvsweb/rsync/configure.in?r1=1.202r2=1.203 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Fri Oct 1 02:34:22 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv27093 Modified Files: syscall.c Log Message: Some systems need do_mkstemp() to use setmode() to set O_BINARY. Revisions: syscall.c 1.31 = 1.32 http://www.samba.org/cgi-bin/cvsweb/rsync/syscall.c?r1=1.31r2=1.32 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Fri Oct 1 02:35:26 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv27400 Modified Files: config.h.in Log Message: Added HAVE_SETMODE. Revisions: config.h.in 1.92 = 1.93 http://www.samba.org/cgi-bin/cvsweb/rsync/config.h.in?r1=1.92r2=1.93 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs
