rsync in cygwin as service
Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach C:\cygwin\bincygrunsrv -S RSYNC cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1062: The service has not been started. And I see in event log: The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. The following information is part of the event: RSYNC : Win32 Process Id = 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: signal 11 raised. $ rsync --version rsync version 2.5.5 protocol version 26 Any ideas? Thank you! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Hi! U can try the following way 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory 2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync c:\rsync\srvany.exe 3) this will install the service in win2k... 4) now u need to give all parameters in services in control panel...for running it in daemon. Nits. Dmitry Melekhov wrote: Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach C:\cygwin\bincygrunsrv -S RSYNC cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1062: The service has not been started. And I see in event log: The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. The following information is part of the event: RSYNC : Win32 Process Id = 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: signal 11 raised. $ rsync --version rsync version 2.5.5 protocol version 26 Any ideas? Thank you! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
You should perhaps also mention that the tools you refer to are part of the Resource Kit and are not available as such in Windows. Kind regards, Bart Coninckx Network Administrator CNE, ASE * Sita ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 62 28 22 Fax: + 32 (0) 14 62 41 47 Nitin Agarwal [EMAIL PROTECTED]To: Dmitry Melekhov [EMAIL PROTECTED] Sent by: cc: [EMAIL PROTECTED] rsync-bounces+bart.coninckx=watco.be@listsSubject: Re: rsync in cygwin as service .samba.org 11/02/2003 14:40 Please respond to nitin.agarwal Hi! U can try the following way 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory 2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync c:\rsync\srvany.exe 3) this will install the service in win2k... 4) now u need to give all parameters in services in control panel...for running it in daemon. Nits. Dmitry Melekhov wrote: Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach C:\cygwin\bincygrunsrv -S RSYNC cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1062: The service has not been started. And I see in event log: The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. The following information is part of the event: RSYNC : Win32 Process Id = 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: signal 11 raised. $ rsync --version rsync version 2.5.5 protocol version 26 Any ideas? Thank you! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Pb w/ 2GB files on AIX (4.3.3/5.1)
I have discovered that rsync 2.5.6 uses the mkstemp() routine wich do not have a 64bits version into the AIX libc. A very simple workaround to the big files writing rsync pb. is to not use this routine that create files w/ mkstemp() by modifying the syscall.c source file at line 154 as following : #if defined(HAVE_SECURE_MKSTEMP) defined(HAVE_FCHMOD) become #if defined(HAVE_SECURE_MKSTEMP) defined(HAVE_FCHMOD) ! defined(_AIX) Hope this will help poor AIX users ;-) Dean, a nostalgic Digital Unix veteran. Digital/Tru64 Unix don't care big files ! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Yap... but these can be downloaded from net... all of them are available. [EMAIL PROTECTED] wrote: You should perhaps also mention that the tools you refer to are part of the Resource Kit and are not available as such in Windows. Kind regards, Bart Coninckx Network Administrator CNE, ASE * Sita ICT Services Lilsedijk 19 B-2340 Beerse Belgium e-mail: [EMAIL PROTECTED] Tel: + 32 (0) 14 62 28 22 Fax: + 32 (0) 14 62 41 47 Nitin Agarwal [EMAIL PROTECTED]To: Dmitry Melekhov [EMAIL PROTECTED] Sent by: cc: [EMAIL PROTECTED] rsync-bounces+bart.coninckx=watco.be@listsSubject: Re: rsync in cygwin as service .samba.org 11/02/2003 14:40 Please respond to nitin.agarwal Hi! U can try the following way 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory 2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync c:\rsync\srvany.exe 3) this will install the service in win2k... 4) now u need to give all parameters in services in control panel...for running it in daemon. Nits. Dmitry Melekhov wrote: Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach C:\cygwin\bincygrunsrv -S RSYNC cygrunsrv: Error starting a service: QueryServiceStatus: Win32 error 1062: The service has not been started. And I see in event log: The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. The local computer may not have the necessary registry information or message DLL files to display messages from a remote computer. The following information is part of the event: RSYNC : Win32 Process Id = 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: signal 11 raised. $ rsync --version rsync version 2.5.5 protocol version 26 Any ideas? Thank you! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
/me dead for a short while [Was: rsync in cygwin as service]
Dmitry Melekhov wrote: Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Sorry to you and other people that waits for me to test/debug cygwin-specific problems in latest rsync, but my windows machine is actually dead (it's the same CyberOne as seen 'long time offline' from http://build.samba.org/). I guess I must change CPU and/or MB so it will take a while. Sorry. In Italy we say something that sounds like it always rains where it's already wet =( Lapo -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
duplicated file removal: call for comment
This is a call for comments, regarding what you do expect when copying multible source tree roots leading to the same directory root, using rsync. This problem may be discussed now, because in versions before rsync-2.5.6, the algorithm for removing the so called duplicated files was broken. That's why we expect nobody used it anyway in earlier versions - but who knows.. Example: Whe have treeA/ treeB/ treeC/ and treeD/, which may or may not have common files or directories in the depth. the contense of a file in treeA/etc/etctest for e.g. may differ from treeD/etc/etctest. In my example, treeA/etc/etctest contains the line treeA, and alike. Let's look what's the way of standard unix programs: $ mkdir /tmp/test $ cp -r tree*/* /tmp/test/ $ cat /tmp/test/etc/etctest treeD $ rm -rf /tmp/test/* $ scp -r tree*/* thomas@localhost:/tmp/test [..] $ cat /tmp/test/etc/etctest treeD $ Using these programs, the last reference of a file wins. Nb: this is, what a user should suspect. Note that each duplicated file has been copied / transmitted. rsync has routine which removes duplicates from given source-trees before actually transmitting the contense to the destination. Due to a bug in earlier versions, it was hardly predictable which file from which source-tree would win. Especially, if for e.g. some trees in the middle or the last referenced trees did not have such a file. Wayne Davison has done a fix for version 2.5.6. A while ago, i advised a patch to the list (http://www.mail-archive.com/rsync@lists.samba.org/msg03117.html). Our both patches do fix the problem, but with a contrary result: With my patch the last reference of a duplicated file wins (in my example, treeD's etc/etctest); with Wayne's fix the first reference succeeds (treeA's etc/etctest). When looking at the code, i assume my proposal was initially intended; then, some years ago, the code was changed and the duplicate file deletion mechanism went broken. The project where i use rsync relys on a correctly working and predictable file-deletion mechanism. Therfore, this method should not change or flip/flop in future versions. That's why i like to discuss the both approaches, leading to one final proposal. If you're interested in detail, read my discussion with Wayne, who allowed me to quote. Regards, - Thomas Osterried = My proposal for a change for rsync-2.5.6: - diff -r rsync-2.5.6/flist.c ../rsync-2.5.6-patched/flist.c 1274c1274 name, i); --- prev_name, i-1); 1281c1281 flist-files[i][0] = null_file; --- flist-files[i-1][0] = null_file; 1283c1283 free_file(flist-files[i]); --- free_file(flist-files[i-1]); = Our discussion -- My mail: Subject: rsync: duplicate name deletion - problems with rsync-2.5.6 Dear Wayne, i'd like to diskuss some problems with your fix of rsync-2.5.6: | * Fixed a crash that would occur when sending a list of files that | contains a duplicate name (if it sorts to the end of the file | list) and using --delete. (Wayne Davison) my initial proposal for a fix i posted, as suggested at the project's web site, to the rsync mailing list was: http://www.mail-archive.com/rsync@lists.samba.org/msg03117.html unfortunately, the only response to this issue was Huh? I don't care about this at all. our both fixes for clean_flist() work. but with your fix, the clearing process will delete the second and following references of duplicated files. while in my approach the last reference of a duplicated file wins. i think, that deleting all but the last reference - is the right way because it's exactly what you expect and are experienced with, for e.g. when copying with cp tree*/etc/etctest dest/etc/) - was the idea of the author of clean_flist(), because - he annonced rprintf(FINFO, removing duplicate name %s from file list %d\n, f_name(flist-files[i - 1]), i - 1); - because he startet his for() loop with i = 1, comparing the backward list-entries at i-1. the only mistake was, to free the current list entry instead of the previous. see 1). because the rsync protocol version number (26) is the same, i'm unable to detect which behaviour of rsync considering duplicates i should expect at the target site. personaly, i would much appreciate that the last reference of a duplicated file wins. we use rsync for synchronizing a pool of 174 computers at university. rsync is the heart of the conzept where we have one linux installation on a master server (the class tree), several hardware- and configuration- memberships (group trees) and machine-specific configurations. here we make intensively use of rsync's file-deletion mechanism, and rely on the perfect functionality. as an example, an rsync process
rsync ldap authentication
Hi, I'm trying to get rsync 2.5.6 to authenticate users via openldap-2.0.23. I was looking through the mailing list archives and found a patch for rsync-2.4.6 that does this for me. I was just wondering if this is still valid, or if there has been a new patch or new implementation that has superceded this patch. Any help would be great. The message I am referring to is as follows: --T4sUOijqQbZv57TR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline hello, here is a patch against rsync-2.4.6. It may be used to get rsyncd authentication data from a ldap directory. cu, Stefan -- Stefan Nehlsen | ParlaNet Administration | [EMAIL PROTECTED] | +49 431 988-1260 --T4sUOijqQbZv57TR Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename=rsyncd-ldap.txt LDAP support for rsyncd I have made a few changes to rsync 2.4.6 to add to 2 new features to rsync when running as daemon: 1. getting authentification information from an ldap server. The user has to belong to a special group (groupofuniqueusers) and must have a special attribute in his ldap entry containing the rsync password in clear text. 2. specification of a list of prefixes that will be removed from the user name given by the client. The second option was added to be compatible to our ftp server and is simple to use or ignore. Maybe there is better, more flexible way to rewrite usernames. Only the files authenticate.c and loadparm.c have been modified. How to build a rsync version with ldap support There is no autoconf support for the new features. To enable them edit the Makefile after running configure. - Add -DWITH_LDAP -DWITH_MANGLE_USER to the CFLAGS line. - On Linux add -lldap and -llber to the LIBS Flags. - On Solaris add -lldap to the LIBS Flags. New options in rsyncd.conf All ldap options will exist even when rsync isn't build ldap support. To enable anonymous access to rsyncd both auth users and ldap auth usergroup have to be empty. If both ways of authentification are enabled the local password file is checked before ldap. Most options are borrowed from samba :-) GLOBAL OPTIONS ldap server This option has to contain the hostname of the ldap server we want to ask. example:ldap server = ldap.ParlaNet.de default:none ldap port This option has to contain the tcp port where the ldap service is listening. example:ldap port = 11034 default:ldap port = 389 ldap root This option should contain the dn to bind with to the ldap server. You may leave this option and ldap root password empty to bind as anonymous but this isn't a good idea. If you use this option you should not make the configuration file world readable. example:ldap root = cn=webserver-rsyncd, o=ParlaNet, c=DE default:empty ldap root passwd This will contain the password to bind with. see also: ldap root example:ldap root passwd = sECret default:empty ldap suffix This option should contain the basedn as starting point for search operations. example:ldap suffix = o=ParlaNet, c=DE default:empty MODULE OPTIONS ldap filter This parameter specifies an LDAP search filter used to search for a user name in the LDAP database. It must contain the string %u which will be replaced with the user being searched for. example:ldap filter = ((objectclass=myperson)(uid=%u)) default:empty string ldap passwd attribute This parameter specifies the name of the attribute in the user object that contains the rsyncd password in clear text. You should use access control on this attribute and it has to be case sensitive. example:ldap passwd attribute = myRsyncdPassword default:empty string ldap auth usergroup This parameter specifies the dn of a group the user must belong to. objectclass=groupOfUniqueNames is very good idea example:ldap auth usergroup = cn=webmaster sub, o=ParlaNet, c=DE default:empty string ldap auth users attribute This parameter specifies the name of the attribute in the ldap auth usergroup object that contain the dn of a member. If objectclass is groupOfUniqueNames this always should be uniqueMember. default:ldap auth users attribute = uniqueMember mangle user This option is no ldap option. This parameter specifies a list of prefixes that will be removed from the username before it is tested against the access lists. example:mangle user = web- adm- default:empty string HOWTO use this 1. Create a new user. The
Re: Pb w/ 2GB files on AIX (4.3.3/5.1)
On Tue, Feb 11, 2003 at 03:18:00PM +0100, Dean wrote: I have discovered that rsync 2.5.6 uses the mkstemp() routine wich do not have a 64bits version into the AIX libc. mkstemp should have no need of a 64bit version. Why is this an issue? A very simple workaround to the big files writing rsync pb. is to not use this routine that create files w/ mkstemp() by modifying the syscall.c source file at line 154 as following : #if defined(HAVE_SECURE_MKSTEMP) defined(HAVE_FCHMOD) become #if defined(HAVE_SECURE_MKSTEMP) defined(HAVE_FCHMOD) ! defined(_AIX) If AIX doesn't have a secure mkstemp the logic determining that should be in configure where HAVE_SECURE_MKSTEMP is defined. It should not be grafted on here. Given that the s in mkstemp stands for secure an insecure mkstemp would be broken :) -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: --delete ignored?
--- In [EMAIL PROTECTED], jw schultz [EMAIL PROTECTED] wrote: On Mon, Feb 10, 2003 at 10:24:35PM -, va_public [EMAIL PROTECTED] wrote: If the file is getting deleted, shouldnt the --verbose option print a message to this effect? Because it isn't deleting the files. Um..It _is_ deleting the file from my target tree. Yes, it is backing it up, so it isnt really gone, but whats the harm in printing a message saying it is deleting it from the target tree, because it is doing that. All I am trying to do is find out what files are going to be deleted from my target tree using --dry-run --verbose before actually running the command. It is misleading to not print the message in --verbose but boom, the file is gone from my target tree when I take out the --dry-run. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: duplicated file removal: call for comment
On Tue, Feb 11, 2003 at 05:27:51PM +0100, Thomas Osterried wrote: This is a call for comments, regarding what you do expect when copying multible source tree roots leading to the same directory root, using rsync. This problem may be discussed now, because in versions before rsync-2.5.6, the algorithm for removing the so called duplicated files was broken. That's why we expect nobody used it anyway in earlier versions - but who knows.. Part of this is something i've idly wondered. It is, however, important. Let me see if i can succinctly describe the issues and give my opinion. To start with i want to clarify terminology. I will not use the word delete except when referring to actual deletion of files from disk. For the sake of illustration i'll assume three trees tree[123]. Each tree has a file i'll call 'overlap' which contains the name of the tree. I'll refer to the file contents by the tree name. tree1/overlap tree2/overlap tree3/overlap Whether we do rsync --from-files or rsync -r tree1/ tree2/ tree3/ dest isn't too critical to the discussion. I will assume that the --files-from list always lists the overlap file in all three trees. The first, and outermost, issue is duplicates in list or from combining multiple trees (-r) as i describe in the illustration. What contents wind up in dest/overlap? I'm inclined to think this should be the last one. In other words, tree3. This would be consistent with progressive copying. The second issue is what if one is not on disk? Say that tree3/overlap doesn't actually exist. Here i'm inclined to stick with the progressive copying model and say it should be the last one that exists. So that tree2 would take over. Kind of like runner-ups in a beauty contest. Should tree3 be unable to fulfill her obligations tree2 will assume the crown. This is then somewhat complicated by the --delete option. Should the destination be deleted if it is missing from the source tree? Which source tree? My strongest inclination here is to stick with my second issue response. The file will only be deleted if no source location is present that corresponds to the destination. In sum what i am most inclined towards here is that duplicate resolution incorporate an existence check and if the file exists (size=0 OK) each later reference will replace the earlier one. Regardless of the choice of first specified or last specified, or whether to do fall-back on non-existent files the order of specification, not lexical order needs to be used. Otherwise the user has no control over the merge process. This unfortunately does mean that a means of preserving initial sequence must be incorporated or the qsort approach to finding duplicates would have to be forgotten. This could be as simple as running qsort on an array of indices to flist-files instead of flist-files itself. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach I've found on cygwin that I need to explicitly tell it where the config file is, both on the command line and with cygrunsrv. I haven't investigated; perhaps the platform default is some other file. These commands work for me: rsync --config=/etc/rsyncd.conf --daemon and cygrunsrv -I RSYNC -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' Craig -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: --delete ignored?
On Tue, Feb 11, 2003 at 06:53:20PM -, va_public [EMAIL PROTECTED] wrote: --- In [EMAIL PROTECTED], jw schultz [EMAIL PROTECTED] wrote: On Mon, Feb 10, 2003 at 10:24:35PM -, va_public [EMAIL PROTECTED] wrote: If the file is getting deleted, shouldnt the --verbose option print a message to this effect? Because it isn't deleting the files. Um..It _is_ deleting the file from my target tree. It is just unlinking it. The same file still exists. Yes, it is backing it up, so it isnt really gone, but whats the harm in printing a message saying it is deleting it from the target tree, because it is doing that. All I am trying to do is find out what files are going to be deleted from my target tree using --dry-run --verbose before actually running the command. It is misleading to not print the message in --verbose but boom, the file is gone from my target tree when I take out the --dry-run. Use -vv and you should see a deleting in message followed by more detail. -- J.W. SchultzPegasystems Technologies email address: [EMAIL PROTECTED] Remember Cernan and Schmitt -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Filelist caching
Hi, I've noticed every time someone does an rsync-request on my ftp-site (which also provides rsync as mirror method), rsyncd creates a filelist. This is a quite IO and CPU intensive procedure, especially for things mirrors like FreeBSD with lots of little files. I was wondering... is there a way to cache that filelist? Our mirrors are updated once, or twice a day, it could speed up downloads when I create a filelist everytime we've mirrored others. Tia, Rogier van Eeten Studenten Net Twente -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: /me dead for a short while [Was: rsync in cygwin as service]
Hello! Well, now I know that _latest_ rsync does not work in daemon mode at all, i.e. when I start it with --daemon it simply exits without any error messages. But could you tell me is there rsync version which I can use in cygwin right now? Could someone mail me .exe ? Thank you! Lapo Luchini wrote: Dmitry Melekhov wrote: Hello! I want to start rsync on w2k as service. If I try to start rsync from command line it simply do nothig: $ rsync --daemon Sorry to you and other people that waits for me to test/debug cygwin-specific problems in latest rsync, but my windows machine is actually dead (it's the same CyberOne as seen 'long time offline' from http://build.samba.org/). I guess I must change CPU and/or MB so it will take a while. Sorry. In Italy we say something that sounds like it always rains where it's already wet =( Lapo -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Syncing large amounts of data
I need some suggestions. Here's my setup: 800GB of Data 14,000,000+ Files No changes just additions Files range in size from 30k - 190k The files are laid out in a tree fashion like: BASE \-Directory ( Numerical Directory name from 0 - 1023 ) \-Directory ( Numerical Directory name from 0 - 1023 ) \- Files ( Up to 1024 files each directory ) This allows for a maximum of about a billion files. I need to limit the amount of memory usage and processor / io time it takes to build the list of files to transmit. Is there a better solution that rsync? Are the patches that would help rsync in my particular situation? Any suggestions are appreciated. Adam Herbert [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Craig Barratt wrote: If I try to start rsync from command line it simply do nothig: $ rsync --daemon Administrator@dm-w2ks /usr/bin $ ps PIDPPIDPGID WINPID TTY UIDSTIME COMMAND 480 1 480480 con 500 04:15:03 /usr/bin/bash 1428 4801428 1420 con 500 05:26:46 /usr/bin/ps Administrator@dm-w2ks /usr/bin So I'm trying to set it as service: C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a --daemon --n o-detach I've found on cygwin that I need to explicitly tell it where the config file is, both on the command line and with cygrunsrv. I haven't investigated; perhaps the platform default is some other file. These commands work for me: rsync --config=/etc/rsyncd.conf --daemon and cygrunsrv -I RSYNC -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach' Craig Certanly, I tried --config Could you tell me which rsync version do you use? -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: duplicated file removal: call for comment
This problem may be discussed now, because in versions before rsync-2.5.6, the algorithm for removing the so called duplicated files was broken. That's why we expect nobody used it anyway in earlier versions - but who knows.. I agree it should be the last argument that wins, but as Wayne points out your code and 2.5.6 have unpredictable behavior since qsort() could return identical names in any order. Another concern I have about this fix in 2.5.6 is that there is risk the change is not backward compatible with earlier protocol versions. The file list is sent (unsorted and uncleaned) from the sender to the receiver, and each side then sorts and cleans the list. Since the duplicate removal changed in 2.5.6, but the protocol number didn't change, it is possible that with duplicates the file lists are no longer identical. Specifically, with three or more duplicates, 2.5.5 and earlier will remove the even ones, while 2.5.6 correctly removes all but the first. Remember that the files are referred to as an integer index into the sorted file list, and the receiver skips NULL (duplicate) files. I suspect (but haven't checked) that if a 2.5.5 receiver is talking to a 2.5.6 sender then 2.5.5 will send the index for the 3rd file, which will be null_file on 2.5.6. Craig -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Certanly, I tried --config Could you tell me which rsync version do you use? rsync 2.5.5 and rsync 2.5.6 both work fine for me. Is it possible that rsync is already running as a service? It won't show up in cygwin's ps. For example, when rsync is running via cygrunsrv, if I type: rsync --daemon it exits with no error, but ps shows no process. But rsync is indeed running, eg: tcsh 438% telnet localhost 873 Trying 127.0.0.1... Connected to . Escape character is '^]'. @RSYNCD: 26 quit @ERROR: protocol startup error Connection closed by foreign host. You can also see rsync.exe in the windows task manager. You could also try a different port number to see if there is someone else on 873: craigslt 461% ps aux | egrep rsync craigslt 462% rsync --daemon --port=1234 craigslt 463% ps aux | egrep rsync 4020 14020 4020? 1005 23:29:08 /bin/rsync Craig -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: rsync in cygwin as service
Craig Barratt wrote: You could also try a different port number to see if there is someone else on 873: craigslt 461% ps aux | egrep rsync craigslt 462% rsync --daemon --port=1234 craigslt 463% ps aux | egrep rsync 4020 14020 4020? 1005 23:29:08 /bin/rsync Unfortunately, rsync does not responds if I run it with --daemon from command line... Could you send me your rsync.exe? Thank you! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Filelist caching
I too think this would be an interesting feature. --- Rogier van Eeten [EMAIL PROTECTED] skrev: Hi, I've noticed every time someone does an rsync-request on my ftp-site (which also provides rsync as mirror method), rsyncd creates a filelist. This is a quite IO and CPU intensive procedure, especially for things mirrors like FreeBSD with lots of little files. I was wondering... is there a way to cache that filelist? Our mirrors are updated once, or twice a day, it could speed up downloads when I create a filelist everytime we've mirrored others. Tia, Rogier van Eeten Studenten Net Twente -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html _ Gratis e-mail resten av livet på www.yahoo.se/mail Busenkelt! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
CVS update: rsync
Date: Tue Feb 11 19:13:51 2003 Author: dwd Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv12419 Modified Files: log.c Log Message: Back out one of the changes in log.c revision 1.62, and always send errors to the client after multiplexing is enabled. Revisions: log.c 1.63 = 1.64 http://www.samba.org/cgi-bin/cvsweb/rsync/log.c?r1=1.63r2=1.64 ___ rsync-cvs mailing list [EMAIL PROTECTED] http://lists.samba.org/mailman/listinfo/rsync-cvs