RE: Mapped Drive
for now there is no caching - anyway - how should checksums be cached? if mtime/size is no reliable method for detecting file changes and checksum is the only method - to detect if you need to update the cache you need to ... checksum and thus a checksum cache is quite nonsense, imho. I suppose it could be cached at either storage location. if you use rsync on a mapped drive, you have no local and remote storage location from an rsync`s point of view, because rsync isn`t being executed on the remote node. so if rsync calculates a checksum it`s always transferring the whole file via mapped drive. regards roland -Ursprüngliche Nachricht- Von: Stephen Zemlicka [EMAIL PROTECTED] Gesendet: 30.09.07 07:30:04 An: 'Matt McCutchen' [EMAIL PROTECTED] CC: rsync@lists.samba.org Betreff: RE: Mapped Drive The problem is some files don't change in size. So I was hoping that the checksums could be cached. Perhaps I'm mistaken but I thought the checksum determined what actual blocks were transferred. I suppose it could be cached at either storage location. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Matt McCutchen Sent: Saturday, September 29, 2007 5:03 PM To: Stephen Zemlicka Cc: rsync@lists.samba.org Subject: Re: Mapped Drive On 9/28/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: Is there a way to have rsync cache the checksums for something like this and would that help? I'm not sure exactly what you mean. You said you were using the -c (--checksum) option, which makes rsync decide whether to update each destination file by reading the file in full and comparing its MD4/MD5 checksum with that of the source file. Do you mean you want rsync to cache the checksums of the destination files? On which machine would the cache be? Anyway, if the issue is that you don't want rsync spending the bandwidth to read the destination files for the --checksum check, just remove -c and rsync will use the default size-and-mtime quick check. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html _ In 5 Schritten zur eigenen Homepage. Jetzt Domain sichern und gestalten! Nur 3,99 EUR/Monat! http://www.maildomain.web.de/?mc=021114 -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Mapped Drive
On 9/30/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: The problem is some files don't change in size. So I was hoping that the checksums could be cached. Perhaps I'm mistaken but I thought the checksum determined what actual blocks were transferred. I suppose it could be cached at either storage location. I still do not understand what you are proposing; please be more specific! Which checksums are you talking about: (1) the whole-file checksums of destination files used by the -c option to decide whether to transfer each file, or (2) the block checksums of destination files used by the delta-transfer algorithm to match blocks, or (3) something else? At what point in the process would the cache be read, and at what point would it be updated? Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: Mapped Drive
OK, let's say this is the first sync and every file is being transferred. The checksum for each of the files is cached on the local drive. Then, the next time you sync, it checks the checksum from the cache against the file to be copied. If it matches, it skips it. If it doesn't match, it just transfers just the difference. It then replaces the checksum of that transferred file to the cache. That way one could have a remote data store and not have to run rsync on the remote system. IE, you could have a mapped drive or FTP folder or S3 storage area that would all be rsyncable. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Matt McCutchen Sent: Sunday, September 30, 2007 11:54 AM To: Stephen Zemlicka Cc: rsync@lists.samba.org Subject: Re: Mapped Drive On 9/30/07, Stephen Zemlicka [EMAIL PROTECTED] wrote: The problem is some files don't change in size. So I was hoping that the checksums could be cached. Perhaps I'm mistaken but I thought the checksum determined what actual blocks were transferred. I suppose it could be cached at either storage location. I still do not understand what you are proposing; please be more specific! Which checksums are you talking about: (1) the whole-file checksums of destination files used by the -c option to decide whether to transfer each file, or (2) the block checksums of destination files used by the delta-transfer algorithm to match blocks, or (3) something else? At what point in the process would the cache be read, and at what point would it be updated? Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3554] Second copy of same rsync daemon should notice pid file and quit
https://bugzilla.samba.org/show_bug.cgi?id=3554 [EMAIL PROTECTED] changed: What|Removed |Added Status|ASSIGNED|RESOLVED Resolution||FIXED --- Comment #2 from [EMAIL PROTECTED] 2007-09-30 21:30 CST --- This is now fixed in CVS. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 4998] [PATCH] rsync returns from fork before a valid pidfile is created
https://bugzilla.samba.org/show_bug.cgi?id=4998 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||FIXED --- Comment #2 from [EMAIL PROTECTED] 2007-09-30 21:30 CST --- The version is CVS now creates the pid-file more rapidly in the startup sequence. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
why not a gui for rsync
I'm using rsync and I'm very glad, but, in some case, i'm not so happy. Some people are backing up the data with rsync but they have a lot of files, more than 10 and 20 Gb of data. We are using batch files and the task scheduling system of windows. It is difficult to see if the backup is well done, sometimes, they are error. We try to make some gui, one in java, an other in c++ and also one in delphi. The target was to make a service who can monitor the backup made with rsync and a gui that shown the state of the backup and allow the user to easily take back one file or, even, to take back old versions of the file. We are using rsync compiled with cygwin, the rsync software is launch in a shell and we try to collect the information in the master programm who have launched rsync. This way is maybe not the best way. My questions are : Is there a way to use the rsync protocol directly in a software without using rsync, like a dll with a lot of rsync functions. Is there some works in the world trying to make a good gui for rsync and to let all people using this very good method to make a backup. If somebody is interesting to create this gui, let me know -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync vs. unison
Hey all, I'm looking into a two-way WAN mirror on two boxes running Mac OS X 10.4. It seems that both rsync (with the -u option) and unison could do this. Any suggestions on how to choose one over the other? Many thanks, noam Noam Birnbaum http://maccentricsolutions.com/ 877.luv.macs x89 Apple Certified Technical Coordinator Apple Certified Help Desk Specialist -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: why not a gui for rsync
Daniel Platteau asked: I'm using rsync and I'm very glad, but, in some case, i'm not so happy. Some people are backing up the data with rsync but they have a lot of files, more than 10 and 20 Gb of data. We are using batch files and the task scheduling system of windows. It is difficult to see if the backup is well done, sometimes, they are error. Yes, it is indeed is very important to know if the backup was successful or if there were any errors! I do not know the resolution to this important question, but would like to present how I would approach the problem, and invite comments from those who know more about rsync. We try to make some gui, one in java, an other in c++ and also one in delphi. I am not sure one needs a gui. The target was to make a service who can monitor the backup made with rsync and a gui that shown the state of the backup and allow the user to easily take back one file or, even, to take back old versions of the file. We are using rsync compiled with cygwin, the rsync software is launch in a shell and we try to collect the information in the master programm who have launched rsync. This way is maybe not the best way. Here's are features of rsync that I would attempt to exploit: a) -v option with various levels of verbosity b) --stats c) --log-file=foo d) messages rsync prints to stdout e) messages rsync prints to stderr. Even on Windows, I would attempt to have a perl script fork a child that issues the rsync command. The parent perl script would monitor items (b-e) and emit summary messages of the status of the rsync command: the mechanism for the message might just be prints to the console or a pop-up window. The script can have special triggers for conditions such as detection of errors of certain type or detection of too many errors etc. So I see the need for a document that explains the format, content and interpretation of (a-e) at a user level. My questions are : Is there a way to use the rsync protocol directly in a software without using rsync, like a dll with a lot of rsync functions. My understanding is that rsync already can provide the status information in an on-going manner -- how one collects, interprets and displays that information is the issue. Is there some works in the world trying to make a good gui for rsync and to let all people using this very good method to make a backup. If somebody is interesting to create this gui, let me know --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: why not a gui for rsync
snip Is there some works in the world trying to make a good gui for rsync and to let all people using this very good method to make a backup. If somebody is interesting to create this gui, let me know --Suresh Delta Copy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp It has a gui already. No need to reinvent the wheel. -- Fail to learn history-repeat it. Fail to learn rights-lose them. Learn both-get screwed by previous two groups. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Interpreting output from rsync
Hello, In regard to output, rsync has the following features: a) -v option with various levels of verbosity b) --stats c) --log-file=foo d) messages rsync prints to stdout e) messages rsync prints to stderr. Where can I find an explanation of the format, content and interpretation of the outputs (a-e)? Thanks, --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
CVS update: rsync
Date: Sun Sep 30 06:57:03 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv26884 Modified Files: proto.h Log Message: Regenerated. Revisions: proto.h 1.356 = 1.357 http://www.samba.org/cgi-bin/cvsweb/rsync/proto.h?r1=1.356r2=1.357 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 06:57:07 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv26902 Modified Files: clientserver.c Log Message: - Moved become_daemon() here from socket.c and made it static. - Call lp_load() before we call become_daemon(). - Output an error to stderr if we fail to open/parse the config file. - Added a create_pid_file() static function and call it earlier in the startup sequence. Revisions: clientserver.c 1.206 = 1.207 http://www.samba.org/cgi-bin/cvsweb/rsync/clientserver.c?r1=1.206r2=1.207 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 06:57:12 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv26921 Modified Files: socket.c Log Message: Moved become_daemon() into clientserver.c. Revisions: socket.c1.132 = 1.133 http://www.samba.org/cgi-bin/cvsweb/rsync/socket.c?r1=1.132r2=1.133 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 07:14:16 2007
Author: wayned
Update of /data/cvs/rsync
In directory dp.samba.org:/tmp/cvs-serv469
Modified Files:
main.c
Log Message:
Allow additional remote args to contain an identical hostname instead
of requiring it to be empty. This allows for the easy use of braces:
rsync -av host:file{1,2} /dest/
Revisions:
main.c 1.347 = 1.348
http://www.samba.org/cgi-bin/cvsweb/rsync/main.c?r1=1.347r2=1.348
___
rsync-cvs mailing list
rsync-cvs@lists.samba.org
https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 07:30:48 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv3801 Modified Files: chmod.c options.c Log Message: Got rid of some SPACE-TAB sequencs in the indentation. Revisions: chmod.c 1.10 = 1.11 http://www.samba.org/cgi-bin/cvsweb/rsync/chmod.c?r1=1.10r2=1.11 options.c 1.410 = 1.411 http://www.samba.org/cgi-bin/cvsweb/rsync/options.c?r1=1.410r2=1.411 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 07:34:33 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv5201 Modified Files: NEWS Log Message: Made list more complete. Revisions: NEWS1.459 = 1.460 http://www.samba.org/cgi-bin/cvsweb/rsync/NEWS?r1=1.459r2=1.460 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Sun Sep 30 07:46:28 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv7976 Modified Files: rsync.yo rsync.1 Log Message: Mention the latest way to specify multiple remote args. Revisions: rsync.yo1.427 = 1.428 http://www.samba.org/cgi-bin/cvsweb/rsync/rsync.yo?r1=1.427r2=1.428 rsync.1 1.441 = 1.442 http://www.samba.org/cgi-bin/cvsweb/rsync/rsync.1?r1=1.441r2=1.442 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync/patches
Date: Sun Sep 30 07:50:05 2007 Author: wayned Update of /data/cvs/rsync/patches In directory dp.samba.org:/tmp/cvs-serv8814 Modified Files: checksum-xattr.diff slp.diff Log Message: Fixed a failing hunk. Revisions: checksum-xattr.diff 1.3 = 1.4 http://www.samba.org/cgi-bin/cvsweb/rsync/patches/checksum-xattr.diff?r1=1.3r2=1.4 slp.diff1.17 = 1.18 http://www.samba.org/cgi-bin/cvsweb/rsync/patches/slp.diff?r1=1.17r2=1.18 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Mon Oct 1 02:25:54 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv14449 Modified Files: clientserver.c Log Message: - Set config_file to a default filename if it is NULL. - Changed create_pid_file() to fail if the pidfile already exists, which makes the daemon exit with an error. - Output errors about a failure to open the config file or the lock file to (a still open) stderr. - We now notice (and complain) if fork() fails. Revisions: clientserver.c 1.207 = 1.208 http://www.samba.org/cgi-bin/cvsweb/rsync/clientserver.c?r1=1.207r2=1.208 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Mon Oct 1 02:25:58 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv14471 Modified Files: loadparm.c Log Message: The lp_load() function doesn't fudge the pszFname arg anymore. Revisions: loadparm.c 1.80 = 1.81 http://www.samba.org/cgi-bin/cvsweb/rsync/loadparm.c?r1=1.80r2=1.81 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Mon Oct 1 02:32:54 2007 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv16349 Modified Files: rsyncd.conf.5 rsyncd.conf.yo Log Message: Mention that we abort if the pid file exists. Revisions: rsyncd.conf.5 1.146 = 1.147 http://www.samba.org/cgi-bin/cvsweb/rsync/rsyncd.conf.5?r1=1.146r2=1.147 rsyncd.conf.yo 1.147 = 1.148 http://www.samba.org/cgi-bin/cvsweb/rsync/rsyncd.conf.yo?r1=1.147r2=1.148 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
