Allow "--in-place" as an alternative option name for "--inplace"
Hi!
As I commonly spell --inplace as --in-place, I'd like to suggest this
simple patch:
commit 5689f99b702788044a45e13582559832cf986328
Author: Jan-Benedict Glaw
Date: Wed Jun 26 22:49:31 2019 +0200
Allow "--in-place" as an alternative option name for "--inplace".
diff --git a/options.c b/options.c
index e5b0cb68..7ff0c51d 100644
--- a/options.c
+++ b/options.c
@@ -926,6 +926,7 @@ static struct poptOption long_options[] = {
{"no-S", 0, POPT_ARG_VAL,_files, 0, 0, 0 },
{"preallocate", 0, POPT_ARG_NONE, _files, 0, 0, 0},
{"inplace", 0, POPT_ARG_VAL,, 1, 0, 0 },
+ {"in-place", 0, POPT_ARG_VAL,, 1, 0, 0 },
{"no-inplace", 0, POPT_ARG_VAL,, 0, 0, 0 },
{"append", 0, POPT_ARG_NONE, 0, OPT_APPEND, 0, 0 },
{"append-verify",0, POPT_ARG_VAL,_mode, 2, 0, 0 },
Thanks,
Jan-Benedict
--
signature.asc
Description: PGP signature
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Permission denied (13)
On Fri, 2011-04-15 12:17:22 +0200, Juan Pablo Segundo lexin...@gmail.com wrote: I've been trying to do backups with rsync. I want to do the backup into a NAS (LG Network Storage N2B1/N2R1). I start mounting the NAS in my Ubuntu Server 10.04 via cifs, and the /home from my Ubuntu's machines via nfs. This script executes in the server's crontab, with root permissions. [...] I'm having troubles with the permissions of some files. rsync: send_files failed to open /home/txerif/mnt/lexinder-fg/Escritorio/rsyncprueba/Escritorio/LGNASAppLinux: uPermission denied (13)/u ... rsync: opendir /home/txerif/mnt/lexinder-fg/Escritorio/rsyncprueba/Escritorio/rsyncprueba/Descargas failed: uPermission denied (13)/u ... rsync error: some files/attrs were not transferred (see previous errors) u(code 23)/u at main.c(1060) [sender=3.0.7] I've tried everything that I found in Google, like changing the name of the troubled files, giving them more permissions, adding/removing some rsync options... Does it have troubles with all files served via NFS? Traditionally, the No File Security^W^W^WNetwork File System's server reject access by UID=0 (= root) from a client. (It may explicitely be allowed by something oftenly called no_root_squash.) Other than that, I guess you'll have so strace and tcpdump all involved parts to see where the actual error is generated. MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of: Zensur im Internet? Nein danke! the second : signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Connection reset by peer withing a rsyncd strace log
On Wed, 2011-03-16 12:13:41 +0100, thomas veymont thomas.veym...@gmail.com wrote: 2011/3/15 Wayne Davison way...@samba.org: On Tue, Mar 15, 2011 at 9:09 AM, thomas veymont thomas.veym...@gmail.com wrote: [receiver] io timeout after 60 seconds -- exiting You should try a larger --timeout=N value, since 60 is too small for your data. Also, if the timeout is set in the rsyncd.conf file, make sure that the client uses a matching --timeout option, or it won't cooperate in the keep-alive work. ..wayne.. thanks for your answer. We tried a timeout=600 on both client and server, but the problem still pops up, this way: [...] Having timing information (-tt) in the strace output would help a bit, as well as parallel client and server straces. However, I guess that there's an underlying network problem causing this, like a firewall dropping a too old connection or something like that. Thus, I'd suggest to also do a tcpdump -i ethX -n -s0 -w rsync.pcap -C 5 port rsync This should rotate the pcap files after ~ 5MB, only the very last one (from client as well as from server) are really interesting.) MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of:http://www.chiark.greenend.org.uk/~sgtatham/bugs.html the second : signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cron issue
On Sun, 2011-03-13 16:10:12 +, Adnane RABIH rabihadn...@gmail.com wrote: I made a script to backup a folder on a remote server it works manually, I set a cron job to launch the script every 2 mins (for test), I sse in the log this line Mar 13 13:10:01 debian /USR/SBIN/CRON[6302]: (root) CMD (root /usr/bin/backup.sh) but when I sheck the remote server nothing is done, any sugestions pls Seems you forgot to attach the script you wrote. ...and when you send it, please also tell us as which user you call it and how your whole crontab looks like. (Some variables may be set there.) MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of: http://www.eyrie.org/~eagle/faqs/questions.html the second : signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: how to migrate 40T data and 180M files
On Tue, 2009-08-11 16:14:33 +0800, Ming Gao gaomin...@gmail.com wrote: I need to migrate 40T data and 180M files from one storage device to another one, both source and destination will be NFS and mounted to a local suse linux box. The first question is that if there is any risk for such a big number of files? should I divide them into groups and rsync them in parallel or in serial? If yes, how many groups is better? The second question is about memory. How much memory should I install to the linux box? The rsync FAQ(http://rsync.samba.org/FAQ.html#4) says one file will use 100 bytes to store relevant information, so 180M files will use about 18G memory. How much memory should be installed totally? And any other thing I could do to reduce the risk? There are no specific risks these days I think, but it sounds like this is a task like copy over anything, so it's merely mount both filesystems and use two `tar' instances with a pipe in between... MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of: http://perl.plover.com/Questions.html the second : signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: how to migrate 40T data and 180M files
On Tue, 2009-08-11 10:58:15 +0200, Michal Suchanek hramr...@centrum.cz wrote: 2009/8/11 Jan-Benedict Glaw jbg...@lug-owl.de: On Tue, 2009-08-11 16:14:33 +0800, Ming Gao gaomin...@gmail.com wrote: I need to migrate 40T data and 180M files from one storage device to another one, both source and destination will be NFS and mounted to a local suse linux box. There are no specific risks these days I think, but it sounds like this is a task like copy over anything, so it's merely mount both filesystems and use two `tar' instances with a pipe in between... .. except it will take forever and is not restartable. In a copy-once scenario, you can only saturate your bandwidth once. Rsync cannot really make it faster. I'm not sure that the possibility to restart the rsync run after, say, a network outage is really an advantage, though. Finding out what's already transferred and transferring the rest takes about the same time as doing a full transfer. That's indeed the question. Rsync is a really good program to synchronize files, but it's not a /better/ backup program. (Though it is as good as others.) MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of: 23:53 @jbglaw So, ich kletter' jetzt mal ins Bett. the second : 23:57 @jever2 .oO( kletter ..., hat er noch Gitter vorm Bett, wie früher meine Kinder?) 00:00 @jbglaw jever2: *patsch* 00:01 @jever2 *aua*, wofür, Gedanken sind frei! 00:02 @jbglaw Nee, freie Gedanken, die sind seit 1984 doch aus! 00:03 @jever2 1984? ich bin erst seit 1985 verheiratet! signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync between windows Opensolaris failures
On Wed, 2009-07-08 12:21:55 -0500, Harry Putnam rea...@newsguy.com wrote: Can anyone tell me what is wrong in this picture with error output: rsync -nvviirp --inplace ha...@harvey:/cygdrive/c/Documents\ And\ Settings ./docs_settings_$(dtf) opening connection using ssh harvey -l harry rsync --server --sender -vvnpr --inplace . /cygdrive/c/Documents And Settings ha...@harvey's password: protocol version mismatch -- is your shell clean? (see the rsync man page for an explanation) rsync error: protocol incompatibility (code 2) at compat.c(61) [receiver=2.6.9] = A strait ssh to rea...@harvey succeeds but has this output (once past passwd): [...] Please try: ssh rea...@harvey true | xxd There should be no output at all. If there is, your shell is not clean, as rsync said. (That is, there might be something like a greeting message in non-interactive mode.) MfG, JBG -- Jan-Benedict Glaw jbg...@lug-owl.de +49-172-7608481 Signature of: Eine Freie Meinung in einem Freien Kopf the second : für einen Freien Staat voll Freier Bürger. signature.asc Description: Digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: replicating a live directory
On Wed, 2008-04-02 19:20:09 -0400, Matt McCutchen [EMAIL PROTECTED] wrote: On Wed, 2008-04-02 at 19:15 -0400, Clark wrote: Matt McCutchen wrote: It's not clear to me how a filesystem snapshot would solve the problem. It guarantees that rsync sees an instantaneous state of the filesystem, but that state could still include files that are half-modified by other programs. I shut everything down so that it is not live, do a snapshot, then let people go again. It is not perfect, but the snapshot process takes only a second or two, then people can work for the hours it takes for rsync to run. Good point. A filesystem snapshot doesn't avoid the need to stop the services, but it greatly reduces the length of the downtime. Live replication--one day I'll play with it again. Another approach could be a shared device (think nbd) with a sync-mounted filesystem. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: They that give up essential liberty to obtain temporary safety, the second : deserve neither liberty nor safety. (Ben Franklin) signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync on windows
On Sun, 2008-03-30 09:54:26 +0300, Mark, Oren [EMAIL PROTECTED] wrote: It there a way to use rsync from windows server, so it will pull data on NFS through UNIX rsync server? Yes, there is. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Zensur im Internet? Nein danke! the second : signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: replicating a live directory
On Sun, 2008-03-30 19:39:12 +0100, Joao Miguel Ferreira [EMAIL PROTECTED] wrote: right now we use a 'greedy approach'... we stop all important services (dhcpd, squid, sendmail, etc) just to minimize the possibility of copying to the backup a file that was being written. Could we be over doing it ? Are we exagerating ? I don't think that rsync could do that, but there are chances... Some years ago, I hacked a small preload library to wrap all the usual file-changing syscalls and replicating them over the net to a different box. That box doesn't have anything running except the data-accepting daemon matching that preload lib. Unfortunately, that lib got lost (commercially written) and wasn't ever ment to be open-sourced. However, the idea is there and it wasn't all that hard to implement it. Maybe a better aproach would be to just omit the receiving daemon and use the NFS protocol instead. Maybe using FUSE these days instead of a preload lib would also be a nice imprevement... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: What we do for ourselves dies with us. What we do for the second : others and the world remains and is immortal. (Albert Pine) signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Script work fine on sheel, but no on a cron job
On Tue, 2007-10-23 15:59:29 +0200, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: I make a script which make some call of rsync to connect to a rsync daemon. When I run on a shell, the script work fine. When I run this scripts from a cron-job, the script fail with theses messages : rsync: failed to connect to remote-node: Connection refused (111) rsync error: error in socket IO (code 10) at clientserver.c(94) Care to show us the script? You'd debug this by either tcpdump'ing the network traffic or by strace'ing one (or both) instances of the rsync client/daemon. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of:Don't believe in miracles: Rely on them! the second : signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync on Mac OS X
On Tue, 2007-08-14 09:56:02 -0700, Michael Reynolds [EMAIL PROTECTED] wrote: #!/bin/bash -x Looking at the execution flow (requested by -x) you'd probably already be able to locate the problem. in=/Volumes/Pictures/Photos out=[EMAIL PROTECTED]:/Volumes/Pictures/Photos/ echo script called $0 $1 $2 cd $in for i in * do if [ $(lsof | grep -c $i) = 0 ]; Hopefully $i doesn't parse as a regex... Also, grep is locale dependand... Maybe try it once without any interpretation (lsof | LC_ALL=C grep -x ). then echo -n -- Parsing $i if [ ! -s .pending_files ]; then echo Pending: .pending_files fi; if [ $(grep -c $i .pending_files) = 0 ]; Dito. then echo $i .pending_files echo sending $i rsync -vctzER -e ssh --timeout=600 --progress $i $out if [ $? = 0 ]; then echo $i .sent_files else echo -n -- File $i transfer failed | logger grep -v $i .pending_files .pending_files_new Dito. mv .pending_files_new .pending_files fi; fi; else echo -n -- File $i is in use | logger fi; done exit 0 Bad. Here, you don't know if operation was all that successfull at all. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Fortschritt bedeutet, einen Schritt so zu machen, the second : daß man den nächsten auch noch machen kann. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync summary details...
On Sun, 2007-06-24 14:48:24 +0300, Shai [EMAIL PROTECTED] wrote: On 6/24/07, Giuliano Gavazzi [EMAIL PROTECTED] wrote: On 24 Jun 2007, at 11:25, Shai wrote: I'm trying to figure our some of these details: sent 34108 bytes received 6913101 bytes 19487.26 bytes/sec total size is 231889639875 speedup is 33378.82 1. Is the 6913101 really in bytes? 2. What is the 231889639875 measurement? Bytes? Bits? 3. What does speedup mean exactly? do the maths: 6913101 * 33378.82 = 231889639875 +/- 0.5% that seems to me quite accurately consistent. That the total size is in bites you can check by doing a du on the source, and I can confirm that it is in bytes. what is speedup? You're really bad in math, aren't you? :-) If you used cp or scp or some other non-differential copying mechanism, you would have send 33378.82 times the amount of data that rsync just sent over the wire: speedup = total size / (bytes sent + bytes received) Or in other words: The traffic used in this rsync run is (100/speedup) % of the traffic you would have needed when using a simple copy. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Eine Freie Meinung in einem Freien Kopf the second : für einen Freien Staat voll Freier Bürger. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync with non-english characters in filenames?
On Mon, 2007-06-18 12:00:00 +0200, Fredrik Karlsson [EMAIL PROTECTED] wrote: I am trying to use rsync to migrate homefolders from one server to another. For this I use: rsync --rsh=ssh -l root -vaz beaucent.ling.umu.se:/export/home/ . Which works fine until I get to some files where the user has, unfortunatelly, used a non-ascii character in the file name: --- snip -- rsync: recv_generator: mkdir /Volumes/Home_dirs/homes/students/kv04/kv04hen/inl?mningsuppgifter failed: Invalid argument (22) rsync: stat /Volumes/Home_dirs/homes/students/kv04/kv04hen/inl?mningsuppgifter failed: Invalid argument (22) rsync: recv_generator: mkdir --- /snip Is there a way to protect these filenames? Filenames are transferred as-is. The target filesystem doesn't allow for these characters. What filesystem type is it? https://bugzilla.samba.org/show_bug.cgi?id=2790 mentions a patch, http://opencoder.net/iconv.diff , to recode filenames using iconv. Just search for rsync iconv, you'll find some additional hints :) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: ...und wenn Du denkst, es geht nicht mehr, the second : kommt irgendwo ein Lichtlein her. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync with non-english characters in filenames?
On Mon, 2007-06-18 13:59:59 +0200, Fredrik Karlsson [EMAIL PROTECTED] wrote: On 6/18/07, Jan-Benedict Glaw [EMAIL PROTECTED] wrote: On Mon, 2007-06-18 12:00:00 +0200, Fredrik Karlsson [EMAIL PROTECTED] wrote: I am trying to use rsync to migrate homefolders from one server to another. For this I use: rsync --rsh=ssh -l root -vaz beaucent.ling.umu.se:/export/home/ . Which works fine until I get to some files where the user has, unfortunatelly, used a non-ascii character in the file name: --- snip -- rsync: recv_generator: mkdir /Volumes/Home_dirs/homes/students/kv04/kv04hen/inl?mningsuppgifter failed: Invalid argument (22) rsync: stat /Volumes/Home_dirs/homes/students/kv04/kv04hen/inl?mningsuppgifter failed: Invalid argument (22) rsync: recv_generator: mkdir --- /snip Is there a way to protect these filenames? Filenames are transferred as-is. The target filesystem doesn't allow for these characters. What filesystem type is it? https://bugzilla.samba.org/show_bug.cgi?id=2790 mentions a patch, http://opencoder.net/iconv.diff , to recode filenames using iconv. Just search for rsync iconv, you'll find some additional hints :) Thank you for the reply. The server on which the files are stored is a Debian Linux box. The server I am migrating to is a Mac OS X server box. I have managed to apply the iconv patch to the linux side of rsync, but it seems to be more complicated on the mac. What filesystem are you writing to? It's not a encoding problem per se, but the *filesystem* refuses to create the file/directory. Something like FAT or so? MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of:Don't believe in miracles: Rely on them! the second : signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync for hp 3000
On Wed, 2007-04-25 14:28:02 -0400, Robert Denton [EMAIL PROTECTED] wrote: Good luck getting IIRC to compile. If I recall correctly, it is nearly impossible. ;) Nah, that cannot be all that hard :) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Ich hatte in letzter Zeit ein bißchen viel Realitycheck. the second : Langsam möchte ich mal wieder weiterträumen können. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: transferred files have ,v at their end
On Sat, 2007-01-06 05:23:44 -0800, giorgio79 [EMAIL PROTECTED] wrote: When I transfer files with rsync to my server, all the files get a ,v added to the extension. Do you know why is this? No, they don't. I am using the command described on sourceforge rsync -av rsync://PROJECTNAME.cvs.sourceforge.net/cvsroot/PROJECTNAME/* . and I get files like build.xml,v You're downloading a CVS repository, not the simple files you're expecting. Use a text viewer to look into one of these files. You'll notice that there's more in them than only the plain contents you're expecting to see. If I do a search for the exact phrase with search engines, build.xml,v, I can see lot of results, but hte problem is, I cannot compile files if they have a ,v at their end. Can you please advise? You'd use cvs to connect to these repositories and check-out a working copy. Rsync'ing this stuff is reasonable for doing backups, but not to compile the project. (Of course, you'd setup a local CVS server to serve the just-downloaded *,v files, but that doesn't buy you a penny...) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: They that give up essential liberty to obtain temporary safety, the second : deserve neither liberty nor safety. (Ben Franklin) signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: 1 file of 16000 always being updated
On Fri, 2006-12-08 12:15:34 -0200, Fabiano Bonin [EMAIL PROTECTED] wrote: I'm trying rsync synchronizing some directories with about 16.000 files. After the first synchronization, the others are transfering just the changed files, as it is expected to be, except for 1 single file, that is not changed (size or time) and is being transfered in all synchronization. The file is called JSPWiki.war, and is a java war file. I checked the size and times on both servers and they are exactly the same. Please also check checksums (md5sum/sha512sum). I've at least seen things like this two times, where a HDD silently replied data from a bad sector. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of:If it doesn't work, force it. the second : If it breaks, it needed replacing anyway. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Building file list takes hours,how to improve performance?
On Wed, 2006-11-01 22:01:07 +0800, woo robbin [EMAIL PROTECTED] wrote: I've backed up some files(about 20G,with many subdirectories and files) a months ago to an USB drive,and I use rsync to check if there are changes.After the process,I checked the log file and found no update needed.But the stats said: Number of files: 61775 Number of files transferred: 0 Total file size: 24169314260 bytes Total transferred file size: 0 bytes Literal data: 0 bytes Matched data: 0 bytes File list size: 2260510 File list generation time: 8631.470 seconds File list transfer time: 0.000 seconds Well, the USB stuff tends to be slow. And untuned filesystems are that, too. If it's ext3, you'd play with the dir_index flag. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Ich hatte in letzter Zeit ein bißchen viel Realitycheck. the second : Langsam möchte ich mal wieder weiterträumen können. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Building file list takes hours,how to improve performance?
On Thu, 2006-11-02 09:21:45 +0800, woo robbin [EMAIL PROTECTED] wrote: 2006/11/1, Jan-Benedict Glaw [EMAIL PROTECTED]: On Wed, 2006-11-01 22:01:07 +0800, woo robbin [EMAIL PROTECTED] wrote: I've backed up some files(about 20G,with many subdirectories and files) a months ago to an USB drive,and I use rsync to check if there are changes.After the process,I checked the log file and found no update needed.But the stats said: File list generation time: 8631.470 seconds File list transfer time: 0.000 seconds Well, the USB stuff tends to be slow. And untuned filesystems are that, too. If it's ext3, you'd play with the dir_index flag. But the USB drive is the target,could it affect the performance of building file list process?I just plugged the USB drive to the host and copy and paste to do a full backup last time,it seems it's more effective than rsync to check updating. Well, file list generation means to read the complete list of files on both sides. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Ich hatte in letzter Zeit ein bißchen viel Realitycheck. the second : Langsam möchte ich mal wieder weiterträumen können. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: track a stolen laptop via rsync
On Thu, 2006-10-19 12:19:57 -0700, jerrytown [EMAIL PROTECTED] wrote: My wife's Windows XP laptop was stolen a couple days ago. Every night the computer automatically preforms an rsync to a Debian Linux computer (the dumb-dumbs didn't steal that). My question: if the laptop successfully connects to the Linux box can you think of anyway I can use this fact to track the computer (maybe an IP address from its location., etc.)? Sure. Get the IP address and the exact timestamps of the session. Then use whois to find out about the carrier this IP address belongs to. Then email their abuse account (usually [EMAIL PROTECTED]) and ask them for help. If they're unwilling (most probably), go to the nearest police station with your evidence. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED] +49-172-7608481 Signature of: Ich hatte in letzter Zeit ein bißchen viel Realitycheck. the second : Langsam möchte ich mal wieder weiterträumen können. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Newbie: What does -e do?
On Sat, 2006-08-05 15:36:57 -0700, Jeffrey Ellis [EMAIL PROTECTED] wrote: The first I see pretty often is e. Can someone explain what this does? rsync can be used in conjunction with several transport protocols. In one incarnation, you can tell rsync about a command (supplied with the -e command line option) that'll execute a given command (that'll be supplied on the command line) on a remote host. The usual usage is to tell rsync to use ssh so shift all the data over the internet. That way, you can strongly authenticate the remote host (so that simple IP spoofing won't give an attacker all of your backup) as well as encrypt all the traffic. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]+49-172-7608481 Signature of: Träume nicht von Dein Leben: Lebe Deinen Traum! the second : signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: shell script segment fault when executed by crontab
On Sat, 2006-06-17 09:54:07 -0400, Matt McCutchen [EMAIL PROTECTED] wrote: On Sat, 2006-06-17 at 16:27 +0800, Reddragon Wang wrote: I encounter a problem, program will segment fault when executed in a shell by crontab. [...] The abstract is a program that uses shared memory to compute the bill. This doesn't seem to have anything to do with rsync. You should ask the authors of abstract why it is crashing. However, I can think of two ways in general that you might be able to find out more about the crash: - Run abstract in a debugger, such as GDB. - Run abstract under valgrind. Since it runs when being attended, this doesn't help all that much. My initial guess was that the locale variables are wrong within/different inside the shell script (when being run from crond) and that the table(?) name is wrong. However, the format looks foolproof. Though this kind of error (script runs when called manually but fails when being called from cron) usually arises when environment variables are wrong. I'd use the `set' command (with output redirection) once on the command line and once from within the script and compare both outputs. Probably where are missing PATH entries or some other variables missing. Oh, the `ltrace' tool should visualize accesses to environment variables, so its use might be an alternative approach. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Usage of a telnet client instead of ssh or rsh
On Sat, 2006-05-13 20:27:03 +0200, Paul Slootman [EMAIL PROTECTED] wrote: On Fri 12 May 2006, Matt McCutchen wrote: Wayne beat me to it. But I was going to say, you might be able to write a wrapper script that sends the rsync command and arguments down the telnet connection for the shell to execute and discards any extra output produced by the shell while logging in (to avoid the mystifying is your shell clean? message). For instance, if you know the shell on the Don't forget also that there is actually such a thing as a telnet protocol, so a telnet session probably won't give you a real clean connection, some combination of special bytes may trigger telnet to do unexpected things instead of passing the data on transparently. Is there no way of using rsh in your kerberos-ized situation? Well, ignoring the protocol-specific extensions, I'd think of some kind of expect(1) wrapped telnet client to do the login and command-sending stuff... Though that's all a crude workaround. Why don't you just use ssh, which is nicely (via GSSAPI) kerberized? MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync backups over the internet
On Sat, 2006-05-06 21:50:58 -0400, Srinivas Kotapally [EMAIL PROTECTED] wrote: I am use rsync to backup a large filesystem over the internet. I do an incremental backup of the 2 file systems once a day to keep an offsite backup. However, this backup takes about 60 minutes. Are there some tweaks I can do to speed up the backup? Here is the command I run via cron every day: rsync --exclude-from=/home/backups/rsync/attachments-exclude.lst --delete -ave ssh [EMAIL PROTECTED]:/var/attachments/secure/ /backups/var/varattachments This size of the source directory is about 7 GB. even though I back up every 7GB? That doesn't even qualify as large :-) day, it takes about 60 minutes. There are about 10-50 MB of files that are added into the source every day. Well, you guess it: there's no way to give you some hints based on your description. I copy a dataset of 7GB with rsync. I don not know about the filesystems used to keep the data, I don't know the mount options used, I don't know how files change (in data as well as in metadata) and it takes about 60 min over a link with unknown speed and latency. Please give us some more hints. One hour over eg. a mobile phone connection with 9600 Baud (like 1kb/sec) for a dataset which changes completely would be quite well-working, while one hour with fast disks over a well-connected site (eg. gigabit internet upstream) with non-changing data would be catastrophic... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync backups over the internet
On Sun, 2006-05-07 09:53:47 -0400, Srinivas Kotapally [EMAIL PROTECTED] wrote: The filesystem that I backup is one where files keep getting added or deleted no other files are modified at all. These files are usually word/ ext2? ext3? xfs? jfs? reiserfs? ... PDF documents. These files are only added not changed. The number of files added are about 20-200 each day. I did not understand the question about Each in the 10mb range? mount options... the disks are already mounted. The issue over here is not What are the -o xx options added to the mount call? These are eg. noted in /etc/fstab (if it's a regularly mounted filesystem on a unix-like box). MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync a raw device
On Mon, 2006-03-13 17:42:18 -0500, Dan Pritts [EMAIL PROTECTED] wrote: I'd like to mirror this data store to a remote location for DR purposes. ideally the target would be a raw device as well, but a loopback mount would probably solve my problem if that's not possible. # cat /dev/sda | ssh [EMAIL PROTECTED] cat /dev/sda Of course, change the device name as needed on both sides... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Question about rsync and BIG mirror
On Fri, 2006-03-03 08:02:55 +0100, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: // I wonder if this message has been posted, so I sent it again // It was, but nobody answered yet. I'm preparing a plan for a production mode in my company: we need to mirror around 100GB of data trough a special VPN internet line 2MB symmetric. The first time, the data will be transferred by a media such as a HD. Next, each night, we will try to update clients from the master server. Does every client have 2MBit? ...or only the server's machine? It should be around 500MB to 3GB, no so much in comparison of the original size of data. I discovered rsync use a lot of CPU and RAM to run checksums on file that have to be synchronised. I need an opinion about my situation: Right. Rsync trades (especially) CPU cycles and some RAM for network bandwidth. So: each night, from 0:00am to maximum 7:00am, the server will have to check the 100Go of files and see what files have been modified, then, upload them to the clients. Each file is around 4MB to 40MB in average. Are these new files, or do the old ones change? Are that minimal changes within those files, or do they change throughoutly? I would like to know your opinion about this situation: - Should I setup a strong dual CPU computer dedicated to calculate this whole stuff? A lot of CPU power cannot hurt. - What about the memory I should install? Depends on the number of clients. Rule of thumb: RAM can only be substituted by even more RAM. - Is there any bandwidth used during the checksums computation? Mine is quite limited. Checksum calculation basically happens on the server side as well as on the client side; this part doesn't really use bandwidth. - I know the client computer will have to check files too; Disk I/O will be the most used. I think this computer will have NFS mount from a datacenter computer with a GB LAN card, I wonder it will be enough... Is it a two-computer-sync or one master machines with a hugh number of clients? However, both sides may need to touch all the file data... I'm quite scared of the amount of data to check before synchronise clients, and how long it will take. To finish shortly, what do YOU think? Any advices? That all depends on the usage pattern. So you've got one central rsync server and a number (how many?) of clients that need to synchronize. All these do have 2Mbit connectivity, right? You'd also have to define the way your files change. Do they change by name? By content? If by content, how much does change within the files? See, it's all about the details :-) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: ftp:// error
On Fri, 2005-12-02 18:25:37 +0100, Marten Lehmann [EMAIL PROTECTED] wrote: from a server where neither a rsync daemon nor ssh is running I'm trying to backup the whole data with ftp. So my idea was to call rsync like this: rsync -v -a 'ftp://1.2.3.4/' my_folder Do you really expect a program implementing the RSYNC protocol to talk to a machine which has some software running speaking the FTP protocol? This won't fly... You need to use a FTP client is a FTP server is installed. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Question and feature requests for processor bound systems
On Thu, 2005-08-18 04:45:21 -0500, Evan Harris [EMAIL PROTECTED] wrote: Is there any way to disable the checksum block search in rsync, or to somehow optimize it for systems that are processor-bound in addition to being network bound? By design, rsync trades CPU power for bandwidth. Option 4: Add an option, maybe --optimize-cpu, or --weak-checksums that would tell rsync to only use weak checksums up until the point in the file where the weak checksums first differ, and then fallback to the normal weak and strong checksums from there on. This is a hint that most likely the file is appended to, but will still catch most occurances where a file was modified. Option 4: tar over netcat. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O für einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Filename enocings
On Thu, 2005-07-28 12:35:21 +0200, David Ayers [EMAIL PROTECTED] wrote: diff -uNr ../rsync-2.6.5/fnameconv.c ./fnameconv.c --- ../rsync-2.6.5/fnameconv.c1970-01-01 01:00:00.0 +0100 +++ ./fnameconv.c 2005-07-28 11:29:59.202388904 +0200 @@ -0,0 +1,220 @@ [...] +/** + * Runs the filename converter process. Should be called before filename + * conversion begins (actually it's not necessarh, but it keeps the proress report ^^^ Typo in comment. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Buerger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync doesn't copy all files
On Mon, 2005-07-25 17:04:52 +0100, Eduardo Luis [EMAIL PROTECTED] wrote: Ok, I have something new, but I don't know if i can help. Like You said, Rsync just calls readdir() to get the names of the files Look: When I copy those files in a Windows environment to the samba share, (with windows drag-n-drop), everything gets ok. In a Windows environment, the files are well written. It appears normal, accents, cedillas When I get a shell on that linux box and i make an 'ls' on a directory with those files i get an output like this: FILE: diferen??a.xls If a type 'ls difer' then hit tab, linux will complete the file name and it appears: FILE: diferenA?a.xls That's maybe why rsync says File has vanished No. Windows actually uses two different things to represent files (or their names), and that's even based on other configuration items. Your problem is like this: one file-creating program (like a Samba server process) created a filename. This filename is supplied by the Windows box, in it's local encoding (eg. using ISO-8859-1, the German umlaut 'Ä' would be seen as 0xc4. Looking at such a filename locally on your Linux box may bring up a different letter, because 0xc4 is now used with a different codepage, where it may mean something totally different. But still, open()ing the filename returned by readdir() would work perfectly fine, even if you couldn't meaningfully display the filename on your local display. But, how can i resolve this??? How can i change my langauge settings and encoding on my FedoraCore4? There are several codepage settings in Samba which you need to get right. Unfortunately, having them wrong at some time and correcting them can lead to wrongly-displaying filenames. So once you got it right, you'd better check the filenames to see if they match your expectation... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: An idea: rsyncfs, an rsync-based real-time replicated filesystem
On Tue, 2005-04-12 23:57:37 -0400, Lester Hightower [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: I envision the VFS Change Logger as a (hopefully very thin) middle-ware that sits between the kernel's VFS interfaces and a real filesystem, like ext3, reiser, etc. The VFS Change Logger will pass VFS calls to the underlying filesystem driver, but it will make note of certain types of calls. I have these in mind so far, but there are likely others: open( ... , w), write(fd), unlink( ... ), mkdir( ... ), rmdir( ... ) I implemented such a beast in terms of a LD_PRELOAD library that intercepts these calls (as well as a whole lot others that may update time information). Unfortunately, this was proprietary and I don't have access to the sources. However, I've done that, the idea is there, it can be done again. Though, this only works if there's a limited number of applications accessing the volume. So it won't work well to replicate /home , but it would work quite well for replicating a volume that's only accessed by a FTP server or some other kind of file server. The tricky part however is to fight against glibc's internal date representation in this case. Glibc basically uses the latest and greatest data representation needed at the time of writing, and this interface changes from time to time. So you either have to closely follow glibc development, or you need to nail down one version that actually works... A different approach would be to use ptrace for sniffing at the syscall layer, but this is troublesome right after fork() IIRC. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Brger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Transferring large amount of files w/ Rsync - Initial transfer
On Sun, 2005-01-23 12:44:28 +0200, israel Gold [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: The following problem has appeared in the past but I have not seen satisfactory solution. It is common when synchronizing large amount of files over slow link. Should work, at least if your machine does have enough RAM to keep the file list in memory... I would like to synchronize 1TB of data between local and remote sites over WAN. For the initial synchronization, I would like to transfer the files from the local site to the remote site using tapes, and use Rsync only for the incremental synchronization. No problem. After copying the files from the tapes at the remote site, it would have been nice if Rsync had an option that would scan the files and generate the checksums/hash values necessary for the incremental synchronization step. (so that I would not need to use Rsync for the initial transfer). Have you searched the man page for checksum? I'm sure you didn't ... If this was an option, do I need to generate the checksums/hash values on the local site prior to incremental synchronization ? See manpage :-) Is it complicated to add to Rsync an option that would just generate checksums/hash values of files so that the solution above becomes feasible ?. No need for that... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Brger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: RSync with /really/ long file lists
On Fri, 2004-12-03 19:09:11 -0800, Brandon Knitter [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: 1) What strategies do other people employ? Some time ago, I had a similar problem; basically, a little number of application worked on some kind of master repository, that needed to be synced to other locations (so it's a strict one-way sync). Since rsync'ing was too slow for me (thus, the remote sites were possibly too long running with inconsistent data, too long times between two rsync runs, ...), I took another approach. I wrote a little lib (loaded through LD_PRELOAD=... in front of the data-generating applications) that intercepted open(), close(), read(), write(), ... and replicated it over the network to the other sites. This way, I only needed to stop the system once, replicate it, and re-start the master side. However, this only works if you've got *very* reliable hardware: a network outage etc. would block the master servers. Unfortunately, this code isn't available freely by any means, but the idea is there. Maybe I'd rewrite it at some time, since it prooved to be quite useful. As an addition, maybe file-checking could be done in advance (size, time stamps) so that stopping the whole system before accepting a remote site could be avoided... 2) Is there a better tool out there for moving large amounts of files? Not really. IFF you can actually use rsync, it's a really cool tool. I use it eg. for keeping Debian repos in sync and it just works (TM). Doing a more timely remote replication isn't rsync's task, so it isn't a good fit for this. 3) Is there a way to save the filelist to a file instead of in memory? Even if you'd press the file list to a file: you'd need to mmap() it, in parts (4GB limit on 32bit hardware, which you aren't even allowed to fully exploit...), which would complicate things, and make it possibly a lot slower. MfG, JBG PS: Thanks to all who wrote code for rsync -- I'm really a happy user! -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Brger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync retry after connection failure
On Sun, 2004-10-31 14:17:08 +0100, Joost van den Broek [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Justin Banks wrote: Seems like a pretty simple shell script, to me. I forget to mention i'm talking about win32 rsync clients. Not sure how to script that under this OS, any suggestions are welcome. Well, if you don't know how to do this with .bat files, maybe you'd start writing a wrapper in C? Though, there are numerous examples how to do error checking in batch files... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Anyone syncing database files?
On Fri, 2004-08-20 16:43:07 -0400, Loukinas, Jeremy [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Anyone syncing say 18-20gb Oracle dbf files..? No problem--as long as you don't try to backup hot database files. Shutdown Oracle first:) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: bash: /usr/local/bin/rsync: Argument list too long
On Tue, 2004-08-10 14:41:54 +0300, victor [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: I get this error when I try to copy a directory with a lot of files: bash: /usr/local/bin/rsync: Argument list too long The exact command is: /usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/* [EMAIL PROTECTED]:/mail/spool/imap/user/wex. The * you supply is expanded by the shell to a lot of filenames. Your shell uses some internal buffer (which may grow to several megabytes), but upon exec*(), the kernel cannot copy all the list to the (child's) argv[] buffer, thus rejecting to exec() at all. So this isn't actually a limitation of your shell, but of your operating system. IIRC Linux will grant you some 128 KB on systems using 4KB pages (that is, the famous PeeCee). You've got several ways to work around that: - Try to split your single rsync call into severals: rsync a* rsync b* rsync c* ... - Hack your operating system's kernel to allow a larger buffer for argv[]. (For Linux, you'll need to edit ./include/linux/binfmts.h; change MAX_ARG_PAGES to whatever you like better) - Try to use xargs, but that may be tricky... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: bash: /usr/local/bin/rsync: Argument list too long
On Tue, 2004-08-10 16:17:59 +0300, victor [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: However, can you explain me why this command works? /usr/local/bin/rsync -r --delete --perms --owner --group /mail/spool/imap/user [EMAIL PROTECTED]:/mail/spool/imap In /mail/spool/imap/user I have a lot of subdirectories with 1000 files. What I mean is that rsync can make sutch a transfer(no mather the kernel), but for some reason he does not. It's purely a matter of this question's answer: Is a veeery long list of file names supplied at the command line, or is rsync on it's own figuring out all the names (possibly recursing through subdirectories with gazillions of files)? If you supply * as a file name, rsync _never ever_ will see this little star. Instead, the shell interpreter (where you've typed your command) will substitute it with the looong list of names. If this list exceeds a certain size (IIRC 128KB on PeeCees), the shell interpreter will fail to start the rsync program (since the kernel cannot copy all the data). If you supply . as a _directory_ name containing thousands of files, it'll work just fine since . isn't expanded by the shell interpreter, but recursively read by rsync itself. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 _ O _ Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg _ _ O fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! O O O ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem in using rsync
On Thu, 2004-06-17 10:11:19 -0400, Anh Truong [EMAIL PROTECTED] wrote in message 436 04/06/17*/S=curateur/G=transfert/ORG=courriel/ADMD=gouv.qc/C=ca/@MHS: Last weekend, we replaced the 4X750MHz by 8X1200MHz CPU's and upgraded from 8 to 16 MB of RAM. Since then, we had 2 errors out of 3 backup runs. The error That's quite little RAM for 8 CPUs. SCNR, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem in using rsync
On Thu, 2004-06-17 10:11:19 -0400, Anh Truong [EMAIL PROTECTED] wrote in message 436 04/06/17*/S=curateur/G=transfert/ORG=courriel/ADMD=gouv.qc/C=ca/@MHS: is always on the same filesystem, which is not the largest one but the one that has the more files and directories (400 000 files as opposed to 600 for others). The error message we have is: --- io timeout after 600 seconds - exiting rsync error: timeout in data send/receive (code 30) at io.c(143) rsync: writefd_unbuffered failed to write 69 bytes: phase unknown: Broken pipe rsync error: error in rsync protocol data stream (code 12) at io.c(836) The command used is: OPTS=--delete --timeout=600 --exclude dbf/ --rsh=rsh /usr/bin/rsync -vRa $OPTS ORIGIN_DIRECT DESTINATION_DIRECT rsync has to build *full* file lists (for source and for destination). If this takes longer than your timeout, connection may break. If you put enough pressure on the system, maybe gathering information for some 40 files (multiply by two for source+destination) could take longer than 10min (= 600sec). Can you help me on this??? I think it's just a performance problem to gather all neded information in 10min. Try setting a higher timeout (like 7200sec = 2h) and have a testdrive. MfG, JBG PS: With 16MB, you'd probably always run into timeout because of constant swapping :) -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: protocol version mismatch
On Tue, 2004-05-25 16:35:46 +0200, Arjen van der Meer [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: rsync -a /home/ameer/midastests remotemachine:/home/ameer/midastests protocol version mismatch - is your shell clean? (see the rsync man page for an explanation) rsync error: protocol incompatibility (code 2) at compat.c(62) So it seems the scripts executed upon login (.bashrc, .profile, .bash_profile, ...) send some output (that they better didn't send). Please try: $ ssh remotemachine true this_file_should_be_empty If the file this_file_should_be_empty contains *anything*, you'd look at your scripts and comment those outputting commands. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: coder wanted
On Wed, 2004-05-05 19:00:28 -0800, Web Hosting Network [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: [snip] So you want [EMAIL PROTECTED] to rsync machine_1:/some/path to [EMAIL PROTECTED] in a path machine_2:/some/other/path ? This should be done via ssh, right? Easy, that. - On machine_2, create ~/.ssh as a directory (if it doesn't already exist) - On machine_1, do: $ mkdir ~/.ssh $ cd ~/.ssh $ ssh-keygen -f rsync-key -t rsa -C key for rsync (- NO password) $ cat rsync-key.pub | ssh [EMAIL PROTECTED] cat ~/.ssh/authorized_keys $ ssh [EMAIL PROTECTED] chmod 0640 ~/.ssh/authorized_keys (This created a ssh key and allows user_1 to log in as user_2 on machine_2 without password) Now, ssh'ing into machine_2 with user_2 should work, try it: machine_1 $ ssh -i ~/.ssh/rsync-key [EMAIL PROTECTED] That should work, now the rsync part: machine_1 $ rsync --rsh=ssh -i /home/user_1/.ssh/rsync-key -avz /path/to/your/files/ [EMAIL PROTECTED]:/path/to/backup That should work, too, so you can place that command into user_1's crontab file. rsync's options (I choose -avz here) depend on what you actually want to achieve, you didn't tell that exactly enough so I took something that basically does a backup (-a), is a bit verbose (-v) and compresses data over the link (-z). Especially -z is only wise if you've got a slow link in between and fast CPUs. Omit it if you're in LAN with not-that-fast CPUs. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync 2.6.2 --daemon Problem
On Wed, 2004-05-05 14:44:49 -0400, Gregory Symons [EMAIL PROTECTED]
wrote in message [EMAIL PROTECTED]:
On Wed, 2004-05-05 at 04:02, Paul Slootman wrote:
But in Linux, IPV6_V6ONLY socket option does not exist in kernel2.4.20
or earlier, except for USAGI kernels. Therefore, you can't do a bind(2)
of IPv4/IPv6 wildcard address to the same port. Therefore, you would
bind(2) only IPv6 wildcard address, and handle IPv4 traffic via
IPv4-mapped address with the same socket.
Right, Linux' IPv6 implementation, especially in 2.4.x, is buggy.
http://www.ipv6style.jp/en/apps/20030829/index.shtml
And I am indeed running a 2.4.20 kernel. So maybe the configure script
needs to detect whether or not this flag is actually available (which I
thought was the point of the #ifdef), rather than trusting the fact that
the macro itself is defined. Otherwise, if IPV6 _is_ available, but
Well, that depends...
IPV6_IPV6ONLY option is not, using the patch you sent would cause us to
skip any IPV6 addresses that we want to bind to.
rsync (as other programs) should ./configure to adopt it's host system's
libc API. That is, if libc offers IPV6_V6ONLY, rsync should accept that
fact and use it {properly,if needed}. So if there's a (detectable) bug,
let's complain about it, but please accept the presented API.
If really a workaround is needed, rsync should detect that error *at
runtime*, complain loudly and exit (offering some
--use-broken-linux-2.4.x-ipv6-stack) for allowing it to work properly.
Runtime check? Right. Think about distributions that offer both 2.4.x
and 2.6.x. For sure you won't like to deliver two rsync versions to your
users:) ...and because IPV6_V6ONLY exists in 2.4.21 upwards, I think
that's not a major problem. Hey, these kernels do have known root
exploits, so it's time for an update!
So if there's a but, don't hide it, but work towards fixing it.
MfG, JBG
--
Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481
Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg
fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak!
ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA));
signature.asc
Description: Digital signature
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [PATCH] time limit
On Mon, 2004-04-19 16:28:08 -0400, John Taylor [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: I have written a patch for rsync-2.6.1pre-2 which adds a --time-limit=T option. When this option is used rsync will stop after T minutes and exit. I think this option is useful when rsyncing a large amount Okay, nice thing. What about $ echo killall rsync | at midnight Of couse, you can make that a bit more flexible if you've got several concurrent rsync running (by using their PID and checking it before killing it to actually be a rsync instance)... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: How to getting clean list of transferred files
On Fri, 2004-03-26 14:38:22 +0100, Markus Marquardt [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Now rsync sometimes generates messages like file has vanished: ... on STDOUT (_not_ STDERR) which breaks this processing. Sounds at least surprising. Just prepare a patch to output this on stderr if your scripts break. Is there any way to get a clean list of the transferred files (without doing things like grep or sed on the output stream)? Well, grep -v would IMHO be the natural way to clean the output. Long-term solution is more like patching rsync to use stderr, though... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: start a batch after rsync
On Fri, 2004-01-09 11:38:20 +0100, Andreas Moroder [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: I would like to replicate one file from one machine to a second one with rsync. After the file is copied ( rsync in read mode ), if the file has changed i must start a small batch, if it has not change I must do nothing. Ask for very verbose output. Then, you'll either get the filename, or you'll get filename is uptodate. So, if you can't find is uptodate in rsync's output, start your script: $ rsync --many-options-here 21 | grep ' is uptodate$' /dev/null 21 || ./your_script.sh Of yourse, fi MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync not working with ZoneAlarm Pro
On Thu, 2004-01-01 20:39:03 +0100, Óscar Frías Barranco [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: When I try to use rsync 2.5.7 from a Windows 2000 machine with CygWin and ZoneAlarm Pro 4.5.538, I get this error: ZoneAlarm is a firewall for Win2k, right? Read from remote host myweb.com: Connection reset by peer rsync: read error: Connection reset by peer rsync error: error in rsync protocol data stream (code 12) at /home/lapo/packaging/tmp/rsync-2.5.7/io.c(177) rsync -vaz --progress --recursive -e ssh [EMAIL PROTECTED]:/home/myuser/* /cygdrive/d/BackupsWebs/myweb.com/last/ So you're using ssh for transport, which is port 22/tcp. Do you know what is the problem? Is it in rsync´s side or in ZoneAlarm´s? Neither. It's you, the user. You misconfigured your firewall, and now it's exactly doing what you told it to do. Allow 22/tcp to host myweb.com. MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: minimalist rsync on windows
On Mon, 2003-11-24 14:28:00 -0800, Brian [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Hi, I get a Local: Bad packet length 1349676916 when I try to use rsync-minimalist. I tried with the provided cygwin and with the latest cygwin. That'll happen if you try to connec to a SSH 2 server with a SSH 1 client. Use a newer ssh client (or force it to use protocol 2 if possible). DO NOT install an older ssh server (or accept SSH 1 protocol connections - SSH 1 can easily be captured (see eg. ettercap:-) MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(NEW_COPYRIGHT_LAW | DRM | TCPA)); signature.asc Description: Digital signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Does block level replication require local disk access (Blocklev el) or can it work with a network share too
On Wed, 2003-07-23 13:20:12 -0700, jw schultz [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: On Wed, Jul 23, 2003 at 10:10:22PM +0200, Jan-Benedict Glaw wrote: On Wed, 2003-07-23 14:18:41 +0100, Antony Parkin [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: It is very unlikely he has any choice in the matter. In many cases it is added by an upstream MTA. Even if it isn't some companies have a blanket policy (leave it to management) requiring the stupidity. Which doesn't forbid to look for some better email service provider. You can even get those for free[1], but whom do I tell:-? Why don't you do as the notice requested and send your complaint to [EMAIL PROTECTED] Guess what I'll do:) MfG, JBG [1]: Beer, not speech. -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur | Gegen Krieg fuer einen Freien Staat voll Freier Bürger | im Internet! | im Irak! ret = do_actions((curr | FREE_SPEECH) ~(IRAQ_WAR_2 | DRM | TCPA)); pgp0.pgp Description: PGP signature -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Live DB backups with rsync?
On Tue, 2003-01-14 15:44:26 -0400, Steve Mallett [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Is it possible to do live backups of a running DB with rsync??? I was just talking to livevault.com they (only on win boxes) say they can grab changes from a client's live DB sync them remotely. It sounded like BS to me, but I'm neither a DB guy or sync'ing expert. I think that's BS (or to name it for non-natice english speakers: bull shit:-). Even if you had somethink like LVM to take a snapshot, the database will be in some inconsistent state. There are only two (well, three) sane ways of backing up a DB: - Shutdown, then take a backup (or take a LVM snapshot and restart immediately afterwards). - Use some backup functionality the database server itself offers - Use a combination of both - some DB servers are IIRC capable of not touching some primary DB files/storage areas for some time but collecting any changes outside MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur fuer einen Freien Staat voll Freier Bürger | im Internet! Shell Script APT-Proxy: http://lug-owl.de/~jbglaw/software/ap2/ msg06069/pgp0.pgp Description: PGP signature
Re: Rsync and ssh with passwordless authentifikation
On Mon, 2002-11-18 16:13:51 +0100, Bode, Joerg [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: Is it possible to konfigure a passwordless authentifikation in kombination with ssh. Yes, use rsakeys for it. man ssh-keygen. You can go w/out a passwd there... MfG, JBG -- Jan-Benedict Glaw [EMAIL PROTECTED]. +49-172-7608481 Eine Freie Meinung in einem Freien Kopf| Gegen Zensur fuer einen Freien Staat voll Freier Bürger | im Internet! Shell Script APT-Proxy: http://lug-owl.de/~jbglaw/software/ap2/ msg05574/pgp0.pgp Description: PGP signature
Using rsync for backup trashes st_atime
Hi!
I've just tried to do a backup of a machine with rsync. While doing this
(I was reading emails:-) I noted that mbox for mbox, I had no longe new
mails, but I've never read off these mailboxes lately... This seemed to
be a st_atime problem, and indeed, I could verify that. This is what I
used for backup:
rsync --archive \
--recursive \
--stats \
--compress \
--verbose \
--delete\
--delete-excluded \
--links \
--hard-links\
--owner \
--group \
--devices \
--times \
--sparse\
--partial \
--force \
--numeric-ids \
${RSYNC_EXCLUDE}\
root@${1}:/ \
/mnt/backup/${1}
Note: $1 is a machine name, and RSYNC_RSH=ssh.
I think '--preserve-server-atime' would be a nice additional feature,
and I tend to implement it on monday or so. I haven't yet looked at the
source, so there may be already a solution to this problem. If you think
this is a nice feature, please give some response...
MfG, JBG
--
- Eine Freie Meinung in einem Freien Kopf für
- einen Freien Staat voll Freier Bürger
Gegen Zensur im Internet
Jan-Benedict Glaw . [EMAIL PROTECTED] . +49-172-7608481
-- New APT-Proxy written in shell script --
http://lug-owl.de/~jbglaw/software/ap2/
msg05294/pgp0.pgp
Description: PGP signature
Re: Using rsync for backup trashes st_atime
On Thu, 2002-10-24 04:04:14 -0700, jw schultz [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: On Thu, Oct 24, 2002 at 12:16:26PM +0200, Jan-Benedict Glaw wrote: I think '--preserve-server-atime' would be a nice additional feature, and I tend to implement it on monday or so. I haven't yet looked at the source, so there may be already a solution to this problem. If you think this is a nice feature, please give some response... .from rsync3.txt by Martin Pool | - Propagate atimes and do not modify them. This is very |ugly on Unix. It might be better to try to add |O_NOATIME to kernels, and call that. It's not yet there, and SUSv3 doesn't propose it either... It would be better to call it --reset-access-time as cpio does. Not only to make it easier to remember (for those I don't care about the feature's name. So I'll use --reset-access-time or --atime-preserve (as tar does). using other tools) but to make it clear that the access time is being reset to a value that will not reflect accesses by other activity between initial stat and the final reset. Beyond that I don't much care. All my filesystems are mounted -o noatime,nodiratime for efficiency. However, you're loosing data by this:-) You can't tell when some last access has happened... Personally, i think any MUA that depends on atime is broken by design. You're using one of them. Despite that, MUAs come to my mind which might want to use st_atime. But there might exist other applications as well. This is why I care about the issue. My st_atimes will be correct some minutes later (as I receive huge amounts of email), though. MfG, JBG -- - Eine Freie Meinung in einem Freien Kopf für - einen Freien Staat voll Freier Bürger Gegen Zensur im Internet Jan-Benedict Glaw . [EMAIL PROTECTED] . +49-172-7608481 -- New APT-Proxy written in shell script -- http://lug-owl.de/~jbglaw/software/ap2/ msg05296/pgp0.pgp Description: PGP signature
Re: Using rsync for backup trashes st_atime
On Thu, 2002-10-24 05:06:11 -0700, jw schultz [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: On Thu, Oct 24, 2002 at 01:19:40PM +0200, Jan-Benedict Glaw wrote: On Thu, 2002-10-24 04:04:14 -0700, jw schultz [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: On Thu, Oct 24, 2002 at 12:16:26PM +0200, Jan-Benedict Glaw wrote: Personally, i think any MUA that depends on atime is broken by design. You're using one of them. Despite that, MUAs come to my mind which might want to use st_atime. But there might exist other applications as well. This is why I care about the issue. My st_atimes will be correct some minutes later (as I receive huge amounts of email), though. Despite what the manpage says i've not had any problem with mutt recognising the presence of new mail or bad interactions with assorted biffs or backups. This is You can 'mailbox /home/xxx/Mail/yyy' a file to declare it as a mail-receiving mbox. By pressing 'c', 'TAB', 'TAB', you'll be shown any mail-receiving mboxes, those with possibly new mails marked as 'N'. This is IMHO a nice feature, which would requite reading/parsing the mbox to evaluate if new mail has arrived. Other than that, when pressing 'c', mutt shortcuts the first mail-receiving mbox with new mail, which is especially a very nive feature if you've got quite some mboxes... MfG, JBG -- - Eine Freie Meinung in einem Freien Kopf für - einen Freien Staat voll Freier Bürger Gegen Zensur im Internet Jan-Benedict Glaw . [EMAIL PROTECTED] . +49-172-7608481 -- New APT-Proxy written in shell script -- http://lug-owl.de/~jbglaw/software/ap2/ msg05300/pgp0.pgp Description: PGP signature
