Re: A crash when syncing xattr with rsync-3.0.6

2009-12-01 Thread Wayne Davison
On Mon, Nov 30, 2009 at 4:46 AM, Amir Rapson amir.rap...@gmail.com wrote: I have a crash running rsync-3.0.6 and using the -X flag. This has been fixed in git since mid August (with the freeing of the proper pointer, not the removal of the free() call.) See the b3.0.x branch. I'm thinking

Re: [PATCH] Don't (wrongly) retouch dir permissions with --fake-super.

2009-11-29 Thread Wayne Davison
On Sun, Nov 29, 2009 at 5:26 PM, Chris Adams cmad...@hiwaay.net wrote: Hmm, I've applied this patch on both sides, but I'm still getting the same error. The errors should go away on the next run, since rsync should have set u+rwx on the dirs during the most recent run (but it doesn't do it

Re: [PATCH] Don't (wrongly) retouch dir permissions with --fake-super.

2009-11-28 Thread Wayne Davison
On Sat, Nov 28, 2009 at 2:17 PM, Matt McCutchen m...@mattmccutchen.netwrote: diff --git a/generator.c b/generator.c Much appreciated. Applied and tested. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

Re: multiplexing overflow errors

2009-11-27 Thread Wayne Davison
On Fri, Nov 27, 2009 at 7:45 AM, Dieter Stüken d.stue...@conterra.dewrote: log/20091123_223901/dresden.log:multiplexing overflow 101:7104843 [sender] This has come up before. That number translates into the byte sequence 0x4b 0x69 0x6c 0x6c, which is Kill in ASCII. So, something is

Re: Copiying /etc/shadow with sudo and rsync

2009-11-24 Thread Wayne Davison
On Tue, Nov 24, 2009 at 1:49 AM, Gerard Mensoif mensoif_ger...@yahoo.frwrote: rsync --rsync-path='sudo rsync' --rsh='/usr/bin/ssh -x' --archive u...@localhost:/etc/shadow u...@server2:/etc/shadow One end of the transfer has to be local (even a host named localhost is not local), so one thing

Re: exit status 13 in version 3.1

2009-11-15 Thread Wayne Davison
On Thu, Nov 12, 2009 at 10:00 PM, Matt McCutchen m...@mattmccutchen.netwrote: My point is that it's a clunky way to achieve the goal, and it would be simpler for the sender to just keep reading after a write error. Yeah, that's a good idiom, and the latest code wasn't doing a good enough job

Re: Daemon tests broken when running as root

2009-11-13 Thread Wayne Davison
On Thu, Nov 12, 2009 at 9:11 PM, Matt McCutchen m...@mattmccutchen.netwrote: I'm guessing the uid = 0 and gid = 0 in the test daemon configuration were disabled so that the daemon tests could run for unprivileged users. Right. I've checked in a fix that ensures that uid gid are specified

Re: Does files-from work with --delete?

2009-11-13 Thread Wayne Davison
On Thu, Nov 12, 2009 at 6:07 PM, Matt McCutchen m...@mattmccutchen.netwrote: The best approach for now is probably to backport the --delete-missing-args changes to 3.0.6. In the future, I'd suggest starting with the head of the b3.0.x branch. That currently gets you one extra commit, an

Re: Does files-from work with --delete?

2009-11-13 Thread Wayne Davison
On Thu, Nov 12, 2009 at 3:56 PM, Philip Pokorny ppoko...@penguincomputing.com wrote: How confident are you in the current state of 3.1.0.pre and the nightly snapshots? Should I be concerned about running this on production data? Personally, I'm almost ready to start using it in production.

Re: exit status 13 in version 3.1

2009-11-12 Thread Wayne Davison
On Thu, Nov 12, 2009 at 5:47 PM, Matt McCutchen m...@mattmccutchen.netwrote: It looks like the implementation has the receiver hang around for a hard-coded 10 seconds, accepting data from the sender and discarding it. No, it sets a timeout of 10 seconds (i.e. 10 seconds of inactivity), which

Re: Yet another include/exclude question

2009-11-09 Thread Wayne Davison
On Sun, Nov 8, 2009 at 10:21 PM, Thomas Gutzler thomas.gutz...@gmail.comwrote: I thought --include=/this_dir/ --include=/this_dir/*** would do it, but it doesn't. The exclude * seems to overwrite the include matches: [sender] hiding file this_dir/foo because of pattern * Order is important.

Re: exit status 13 in version 3.1

2009-11-07 Thread Wayne Davison
On Wed, Nov 4, 2009 at 8:05 PM, Matt McCutchen m...@mattmccutchen.netwrote: With commit 84c11e85a4c4a12ecacba24afe9617222e4361e6, I get different output, but still not the desired No space left on device: Yeah, that's the long-standing issue where a fatal error on the server side can cause

Re: exit status 13 in version 3.1

2009-11-04 Thread Wayne Davison
On Tue, Nov 3, 2009 at 9:25 AM, Matt McCutchen m...@mattmccutchen.netwrote: rsync error: errors with program diagnostics (code 13) at log.c(340) [sender=3.1.0dev] This means that you didn't update recently. Sadly, it appears my reply mentioning that I fixed the problem only went to Carlos,

Re: strange log values in 3.1

2009-10-25 Thread Wayne Davison
On Sun, Oct 25, 2009 at 6:26 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: All files are new. What I find strange is that I'd expect the transfered bytes to be somewhat larger than the file sizes Yeah, there are two problems. One was that the %b modifier requires late-logging (after the

Re: bugs in version 3.1

2009-10-24 Thread Wayne Davison
On Fri, Oct 23, 2009 at 2:41 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: The first is that when running with --files-from and -ii unmodified files are not put in the log. That is not a logging issue, but rather an early-termination issue due to a protocol problem when speaking protocol

Re: PATCH: --write-devices to allow synchronising to a block device

2009-10-20 Thread Wayne Davison
On Tue, Oct 20, 2009 at 8:28 PM, Darryl Dixon - Winterhouse Consulting darryl.di...@winterhouseconsulting.com wrote: I haven't had any response to this mail over the last week - does no-one have any comments or opinion? I highly doubt my code is pristine and perfect ;) Is there a possibility

Re: Enhanced authentication and authorization in rsyncd

2009-10-20 Thread Wayne Davison
So, I've tweaked your patch, and you'll find the results in the git version of rsync and (currently) in a patch. Here are some details: 1. allow the uid and gid used to access a certain module to be determined by the authenticated user -     uid = __auth__ will use the auth_user's uid    

Re: Are there any current, in play plans, to multi-thread rsync?

2009-10-17 Thread Wayne Davison
On Fri, Oct 16, 2009 at 8:32 PM, Michael Brian - IL micha...@tusc.comwrote: I am looking for an enhancement to multi-thread or parallelize rsync. Are there any plans that would allow one to set a parameter, like 'number_of_threads' and rsync will ship multiple files at the same time? Not at

Re: retrieve files without local dir compare

2009-10-17 Thread Wayne Davison
On Wed, Oct 14, 2009 at 2:36 AM, Marc Mertes mer...@uni-bonn.de wrote: If the data is here, it is imported by a special software, after the import it will be deleted from that directory. The deleting can't be disabled. If you know what file just got processed, append its name onto an exclude

Re: Disable checksumming to improve local performance?

2009-10-17 Thread Wayne Davison
On Fri, Sep 04, 2009 at 10:26:43AM -0700, Greg Siekas wrote: Is it possible to disable checksumming? I'm using rsync with -W, whole file, so if a file has changed I don't want to just transfer the changes. There is not currently a way to do that. I whipped up the appended patch that makes

Re: Enhanced authentication and authorization in rsyncd

2009-10-17 Thread Wayne Davison
On Sun, Aug 30, 2009 at 12:06:21PM +0300, Amir Rapson wrote: A slightly better patch file (removed some warnings). Thanks! Sorry for the slow reply, but your patch looks very useful. I'm reviewing it for inclusion in 3.1.0. ..wayne.. -- Please use reply-all for most replies to avoid omitting

Re: Problem with 3.0.6 and fileflags

2009-10-17 Thread Wayne Davison
On Wed, Jul 29, 2009 at 03:24:57PM -0400, Roger Bailey wrote: I am having trouble compiling rsync 3.0.6 on Red hat Linux EL 5.3. [...] I am puzzled by the last entry, no file-flags. That file-flags support is for BSD, so configure determines that it isn't available for Linux. Linux has

Re: How could be total transferred file size more than total file size ?

2009-10-17 Thread Wayne Davison
On Wed, Jul 29, 2009 at 11:17:34AM +0530, paresh masani wrote: Could you please tell me how would it be possible that total transferred file size is more than total file size ? I believe that the only way this can happen is for a resend to occur (when rsync notices that a file doesn't match the

Re: (Recent I/O change)

2009-10-12 Thread Wayne Davison
On Mon, Oct 5, 2009 at 1:51 AM, Matt McCutchen m...@mattmccutchen.netwrote: Would you care to explain the impact of this change on the rsync I/O design in terms that I might understand? It looks like you merged two switch statements over possible message types, reducing code duplication, but

Re: Old versions of lib/addrinfo.h missing from rsync repo

2009-09-02 Thread Wayne Davison
On Wed, Sep 02, 2009 at 12:32:45AM -0400, Matt McCutchen wrote: Why were they dropped from the development history? There doesn't appear to be a copyright issue: the file bears a BSD license. It used a 3-clause BSD license, which is incompatible with the GPL. The incompatible code was

Re: content of file

2009-08-31 Thread Wayne Davison
On Sun, Aug 30, 2009 at 02:53:12PM -0400, Mag Gam wrote: Instead of copying the whole file, I rather use some sort of pipe. thats all I assume you're using an rsync daemon, otherwise you could just use ssh host tail -f file or similar. If data is always being appended, see the --append option

Re: rsyncd always compression

2009-08-31 Thread Wayne Davison
On Mon, Aug 31, 2009 at 12:55:56PM +0200, Uwe Driessen wrote: Anyone knows a trick that the server only answer if the client is use the compression? This is not currently possible. It seems like it would be nice to have a require options = --compress setting that is the opposite of the refuse

Re: Include a directory inside an excluded one?

2009-08-22 Thread Wayne Davison
On Thu, Aug 20, 2009 at 08:41:40PM +0200, Nicolas KOWALSKI wrote: My problem is that I would like to synchronize a directory located inside /Ma musique/, the one named /Ma musique/iTunes/. As you noticed, rsync will not synchronize anything whose parent dir gets excluded. To fix this, stop

Re: --xattrs requires protocol 30 or higher error

2009-08-22 Thread Wayne Davison
On Sat, Aug 22, 2009 at 11:22:40AM +0100, Kirk Maule wrote: Both rsync versions are 3.0.6 protocol version 30. You'll undoubtedly find that there is an older rsync on the $PATH on one of the machines. e.g, try this: ssh hostname rsync --version Either get rid of the old version, or specify

Re: Differenc in exclude v 2.6.9 and v 3.0.4

2009-08-22 Thread Wayne Davison
On Thu, Jul 09, 2009 at 12:42:47AM -0500, Harry Putnam wrote: Is this actually a difference that was one way in an earlier (2.6.9) version and is different in the later (3.0.4) version? That seems unlikely to me... Yes, very unlikely. The combination of the options --include=Temp/**/ and

Re: partial-dir not being used?!

2009-08-22 Thread Wayne Davison
On Fri, Jul 17, 2009 at 02:13:00AM -0300, Carlos Carvalho wrote: There can be several partials in the partial dir for the same file, resulting from more than one interruption. No, there is only one partial file. Don't confuse a partial file with a temp file, which are different things in

Re: --xattrs requires protocol 30 or higher error

2009-08-22 Thread Wayne Davison
On Sat, Aug 22, 2009 at 08:49:10PM +0100, Kirk Maule wrote: Should the rsync*.tar.gz install procedure replaced rsyncd 2.6.8 as well as rsync 2.6.8 with the 3.0.6 version? Depends on how the package was built. Rsync is just one executable, so be sure to put it in a consistent spot. For your

Re: rsyncd.conf chroot yes problem with symlink-ing

2009-08-14 Thread Wayne Davison
On Fri, Aug 14, 2009 at 01:03:35PM +0300, alex.vladule...@csteam.ro wrote: ls -l /home/webmaster/domains/csteam.ro lrwxrwxrwx 1 root root 31 2009-07-28 21:47 /home/webmaster/domains/csteam.ro - /home/csteam/domains/csteam.ro/ Right. That can't work unless you set use chroot = false since the

Re: --delete flag not working on cygwin rsync

2009-08-14 Thread Wayne Davison
On Tue, Aug 04, 2009 at 03:10:20PM -0400, Sharad K wrote: Everything works fine except the --delete flag. Does rsync output a warning about an I/O error, saying it is disabling deletes? You can use --force if you're sure you want rsync to override that. You might also try using --dry-run to

Re: rsync speedup - how ?

2009-08-14 Thread Wayne Davison
On Thu, Aug 06, 2009 at 08:15:39PM +0200, devz...@web.de wrote: i read that rsync would be not very efficient with ultra-large files (i`m syncing files with up to 80gb size) Things to try: - Be sure you're using rsync 3.x, as it has a better hash algorithm for the large numbers of checksum

Re: supporting --fake-super on opensolaris (zfs) destination

2009-08-04 Thread Wayne Davison
On Mon, Jul 27, 2009 at 07:30:48AM +, Enrico Cavalli wrote: I wrote a small patch in order to support what I think is an absolutely needed feature in order to make rsync-based backups retaining complete ownership permission when writing to an opensolaris machine using --fake-super. Thanks

Re: What happened to librsync?

2009-08-01 Thread Wayne Davison
On Tue, Jul 14, 2009 at 11:49:32PM -0600, Sam Howard wrote: It seems that librsync got left by the roadside ... is there anything similar for rsync 3.x.x? The librsync code doesn't implement the rsync protocol, but just some differential transfer routines similar to rsync's basic algorithm. It

Re: are partial files always deleted on interruption?

2009-07-04 Thread Wayne Davison
On Fri, Jul 03, 2009 at 03:32:29PM -0300, Carlos Carvalho wrote: Both processes were killed with the same command, kill pid1 pid2. A SIGTERM (the default kill signal) should be caught by rsync, allowing it to cleanup before it exits. However I've found that a file was left after interruption,

Re: what happens with .~tmp~ after an interruption?

2009-07-04 Thread Wayne Davison
On Fri, Jul 03, 2009 at 05:25:18PM -0300, Carlos Carvalho wrote: What happens if [some of] these files no longer exist in the source when the next run happens? Are they, and .~tmp~, removed or kept? The file is only removed if a matching filename is transfered in the parent directory. This is

Re: Bug? backup_dir sometimes reported on STDOUT, sometimes not.

2009-07-04 Thread Wayne Davison
On Fri, Jul 03, 2009 at 10:46:13PM +0200, Axel Essbaum wrote: In the second case the backup_dir report in the output is apparently not on STDOUT. In all versions of rsync prior to 3.1.0 (which is not yet released), the backup_dir is ... message is output very early in the transfer, so a remote

Re: rsync flags freebsd

2009-07-01 Thread Wayne Davison
On Tue, Jun 30, 2009 at 09:42:08PM -0400, alexus wrote: I dont know if that helpful, but all I'm saying is fileflags.diff isn't working for rsync-3.0.6, but it works for rsync-3.0.5 It doesn't look like you download rsync-patches-3.0.6.tar.gz -- your patch command would have been patch -p1

Re: difference between --no-implied-dir abd --keep-dirlinks ?

2009-06-30 Thread Wayne Davison
On Mon, Jun 29, 2009 at 10:33:34AM +0530, Jignesh Shah wrote: I have gone through the rsync documentation and also tested same both --no-implied-dir and --keep-dirlinks options. My question is what is the difference between these options in below scenario? Implied directories are those that

Re: [rsync] include-from with different source points

2009-06-30 Thread Wayne Davison
On Mon, Jun 29, 2009 at 09:43:02AM -0400, GravyFace wrote: sudo rsync --progress -avz --include-from=/home/gravyface/backup.list / /mnt/usbbackup/localbackup/ If you drop the '*'s from the lines in the file and switch to using --files-from, that should do what you were expecting. You still

Re: Which function in generator trigger the file transfer?

2009-06-04 Thread Wayne Davison
On Tue, Jun 02, 2009 at 03:31:02PM +0800, Daniel.Li wrote: As receiver will use read_ndx_and_attrs to read iflags to judge if it's need to be transfered? You can get a good overview of how rsync works here: http://rsync.samba.org/how-rsync-works.html After reading through that, you

Re: --remove-source-files

2009-06-04 Thread Wayne Davison
On Tue, Jun 02, 2009 at 04:08:26PM +, C?sar Tejeda Hern?ndez wrote: rsync -tai --remove-source-files --ignore-existing --no-g --no-o --no-p u...@source:operativo/almacen/{ESP05/recorte/*.tar,EU/recorte/*.tar} /media/BACKUP3_PROMES10/PROMES10km/ [...] ¿Is there any way to specify that

Re: How to emulate rdiff behaviour

2009-06-01 Thread Wayne Davison
On Mon, Jun 01, 2009 at 10:15:27AM -0300, Carlos Carvalho wrote: In this case rsync automatically uses --whole-file. Will it do the same in the case of --only-write-batch? The default is always --no-whole-file when writing a batch. ..wayne.. -- Please use reply-all for most replies to avoid

Re: Rsync maintained patches repository

2009-06-01 Thread Wayne Davison
On Thu, May 28, 2009 at 09:04:59PM -0400, Matt McCutchen wrote: How can I access the rsync maintained patches repository with the git tools? Sorry for forgetting to get that taken care of. The issue turned out to be that the samba site defaults to not allowing git: exports unless specifically

Re: How to emulate rdiff behaviour

2009-05-30 Thread Wayne Davison
On Thu, May 28, 2009 at 11:32:16AM -0400, Matt McCutchen wrote: - Each day, generate a reverse batch (by running rsync in the reverse direction with --only-write-batch) and then update the destination file. In order to avoid any inconsistency between the files when the reverse run is done and

Re: rsync-3.0.6 prints file list generation time wrong ???

2009-05-30 Thread Wayne Davison
On Fri, May 29, 2009 at 06:29:22PM +0530, Jignesh Shah wrote: Does that mean rsync traversed complete 1000k files in 0.671 seconds? Rsync uses an incremental recursion scan by default, so when that is active the time mentioned is just for the getting-started part of the scan. I've been thinking

Re: Does rsync detect file corruption?

2009-05-24 Thread Wayne Davison
On Sun, May 24, 2009 at 06:32:40PM +0200, Christian Hecht wrote: Such a tool i plan to write for Mac OS X. The first time it should store checksums and mod times for all files to verify. There are various patches in the patches dir that deal with cached checksums in different ways: -

Re: patches to enable rsync 3.0.6 compile on AIX 3.2

2009-05-14 Thread Wayne Davison
On Wed, May 13, 2009 at 11:26:32PM -0400, Ian! D. Allen wrote: These two small changes enable 3.0.6 to compile and link on AIX 3.2: #if defined(ENOTSUP) [...] #else errno = EINVAL; I think using ENOSYS would be better than EINVAL there. Does that work? BTW, using -u with diff

[rsync-announce] Rsync 3.0.6 released

2009-05-08 Thread Wayne Davison
I have released rsync 3.0.6. This is another bug-fix release. To see a full summary of the changes since 3.0.5, visit this link: http://rsync.samba.org/ftp/rsync/src/rsync-3.0.6-NEWS You can download the source tar file and its signature from here:

Rsync 3.0.6 released

2009-05-08 Thread Wayne Davison
I have released rsync 3.0.6. This is another bug-fix release. To see a full summary of the changes since 3.0.5, visit this link: http://rsync.samba.org/ftp/rsync/src/rsync-3.0.6-NEWS You can download the source tar file and its signature from here:

Re: Going to upgrad rsync V2.6.7 to V3.0.5

2009-05-08 Thread Wayne Davison
On Thu, May 07, 2009 at 04:50:40PM +0530, Jignesh Shah wrote: I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then rsync 2.6.7? Probably not, but not knowing how you rsync rsync, one can't say for sure. You can read through the various news files, looking

Re: rsync docs typo

2009-05-07 Thread Wayne Davison
On Wed, May 06, 2009 at 10:04:40AM -0400, Chris Pepper wrote: the receiving side isn't being running as the receiving side isn't being run as Thanks for pointing that out -- I've checked in a fix. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing

Re: %h %a %u string in --log-file-format doesn't work

2009-05-07 Thread Wayne Davison
On Thu, May 07, 2009 at 04:42:28PM +0530, Jignesh Shah wrote: It does't include the host name, IP address and authenticated user name and instead it keep it as %h %a %u. Could any one tell me what is wrong here? You aren't doing a daemon copy, which is the only time those values are currently

Re: [PATCH] allow to disable SLP with runtime option

2009-04-28 Thread Wayne Davison
On Tue, Apr 28, 2009 at 10:00:21AM +0200, Petr Uzel wrote: I wanted to see changes you've made, but I can't figure out how to 'git clone' the patches repository. Samba doesn't allow cloning of the patches repo at this time, but it's something I hope to get fixed before too long. To view

Re: [Code study]append_mode definitions

2009-04-27 Thread Wayne Davison
On Mon, Apr 27, 2009 at 10:33:02AM +0800, Daniel.Li wrote: Can anyone help to explain definitions of variable append_mode? There are two different type of appending (see the man page) depending on how new rsync is and how much of the file should be checksummed. The option is also disabled if a

Re: rsync: writefd_unbuffered failed to write 4 bytes on mounted share

2009-04-27 Thread Wayne Davison
On Mon, Apr 27, 2009 at 12:19:10PM +0200, Stefan-Michael Guenther wrote: rsync: close failed on /media/nas/daily.0/samba/Bereiche/Auslieferung/Software/NT2/2012/2012-69-RA-1L.0968 (XY_I)/2006-11-16/XY_app.968/Logdb/.XYlog.mdb.REP380: Input/output error (5) That's an OS error when rsync

Re: purge-empty-dirs and max-file-size confusion

2009-04-27 Thread Wayne Davison
On Fri, Apr 24, 2009 at 02:19:42PM -0400, Ian! D. Allen wrote: There is no mention of the concept of transfer rule in the rsync man page. I offer some proposed man page wording changes, below. Thanks. I have committed some manpage changes that clarify this unexpected behavior. At some point

Re: [PATCH] allow to disable SLP with runtime option

2009-04-27 Thread Wayne Davison
On Wed, Apr 22, 2009 at 04:14:23PM +0200, Petr Uzel wrote: It adds a new global boolean option, 'disable slp', which can be used to disable SLP advertisements at runtime. I've taken your patch and changed the boolean into a use slp global daemon parameter (default: enabled). I also made sure

Re: Error messages 3.0.6pre1

2009-04-25 Thread Wayne Davison
On Fri, Apr 17, 2009 at 03:03:02PM -0400, Warren Oates wrote: I compiled 3.0.6pre1, including the crtimes and fileflags patches for use on Intel OS X 10.5.6 I just compiled rsync with those patches on an Intel OS X 10.5.6 system, and didn't see any such errors. I did see an issue with make

Re: rsync and quota in Linux

2009-04-25 Thread Wayne Davison
On Thu, Apr 16, 2009 at 02:49:35PM +0100, Joao Ferreira wrote: can I expect the quotas to be updated correctly on the receiving side ? Quota is handled by your OS, so is out of rsync's hands. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe

Re: Unable to transfer between win32 (interix) and FreeBSD

2009-04-25 Thread Wayne Davison
On Thu, Apr 16, 2009 at 03:53:24PM +0100, Steven Hartland wrote: unexpected tag -96 [receiver] You don't mention what options you're using, so I'm unable to try to hint you towards option tweaks to try. e.g. if using -z, try dropping it. You could also try forcing an older protocol (e.g.

Re: Buffer Cache Thrashing

2009-04-25 Thread Wayne Davison
On Thu, Apr 16, 2009 at 10:44:29PM -0400, Josh Snyder wrote: Rsync thrashes my buffer cache when transfering large files. I see that some people worked on this problem about a year ago. Did they find a workable solution? Some Linux-only work was done, but the patches really revealed that

Re: Excluded directories at rsync (was --filter, missing in action)

2009-04-25 Thread Wayne Davison
On Thu, Apr 23, 2009 at 08:40:12PM +0300, Teodor MICU wrote: This is not desired because these parent* directories were deleted on the MASTER host but cannot be deleted with rsync on the SLAVE hosts because it contains one excluded directory named DIR. You should either anchor your excludes so

Re: looking for superlifter souce code and related information

2009-04-24 Thread Wayne Davison
On Tue, Apr 21, 2009 at 10:39:58AM +0800, Daniel.Li wrote: I just googled superlifter and found below link, but I can't get any source code. Sadly, superlifter never achieved lift-off, so there was never any source code for it. I created my own test-bed for some new-protocol experiments (which

Re: Any program flow or software spec for Rsync

2009-04-24 Thread Wayne Davison
On Tue, Apr 21, 2009 at 02:47:41PM +0800, Daniel.Li wrote: I'm trying to take a look at rsync from code-level. Is there any software spec or program flow that I can get, which might give me a basic understanding about the code? The only thing I can think of is an old how-rsync-works page:

Re: --filter, missing in action.

2009-04-24 Thread Wayne Davison
On Thu, Apr 23, 2009 at 02:02:26PM +0200, istrice wrote: --filter=':r .bar' This indicates that you want the file .bar to be read at every level of the destination hierarchy and its contents to be interpreted as filter commands. That would let you specify localized filtering. --filter=':r

Re: purge-empty-dirs and max-file-size confusion

2009-04-24 Thread Wayne Davison
On Wed, Apr 22, 2009 at 02:20:37AM -0400, Ian! D. Allen wrote: I want to use --min-size to copy just large files (and their necessary parent directories), but everything I've tried copies *all* the source directories, and creates them empty on the destination even if they don't have any big

Re: Overwrite the rsync log-file in rsync3.0.5 ??

2009-04-24 Thread Wayne Davison
On Fri, Apr 17, 2009 at 02:26:25PM +0530, Jignesh Shah wrote: Hi, Could any one please let me know if there is anyway to overwrite the log-file if it already exists. Just change your script that runs rsync to do a rm /tmp/mylogs/myfile or cp /dev/null /tmp/mylogs/myfile prior to the transfer.

Rsync 3.0.6pre1 released

2009-04-12 Thread Wayne Davison
Rsync version 3.0.6pre1 is now available for release testing. This is a bug-fix release. Please test this new release and send email to the rsync mailing list with any questions, comments, or bug reports. To see a full summary of the changes since 3.0.5, visit this link:

Re: rsync 3.0.4 ACL corruption

2009-04-10 Thread Wayne Davison
On Mon, Dec 15, 2008 at 12:20:23PM +0100, Peter Rindfuss wrote: I've just noticed that ACLs get partially corrupted on the receiving side. This is my command line, running as root: /usr/bin/rsync --quiet --links --numeric-ids --acls --perms --times --recursive --owner --group --delete-during

Re: Problem with extended ACLs in 3.0.4?

2009-04-09 Thread Wayne Davison
On Sun, Nov 02, 2008 at 07:18:39PM +, Andrew Gideon wrote: The previous copy of the file has the correct/complete ACL, and the link-dest logic sees this as different from the new copy result so a new copy of the file - with the wrong ACL - is written. Rsync was of the belief that a mask

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-08 Thread Wayne Davison
On Wed, Apr 08, 2009 at 07:41:12AM +0530, Jignesh Shah wrote: No, I also want to log files that are not transferred. You can use -vv instead of -ii to get a list of uptodate items, but no mention of attribute changes (non-transferred files are all uptodate). In rsync 3.1.0dev you can get that

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-07 Thread Wayne Davison
On Mon, Apr 06, 2009 at 10:45:42AM +0530, Jignesh Shah wrote: I have to use -ii so that it print all the statistic info about what files/dirs synched and what are not. No, -ii will include unchanged files in the logs in addition to changed files, and thus a %i field (the one with the cryptic

Re: Does rsync use md4 or md5?

2009-04-07 Thread Wayne Davison
On Mon, Apr 06, 2009 at 12:27:38PM +0200, David Depardoux wrote: I guess the man page is only a bit outdated? Yeah -- thanks for pointing that out. I've checked-in a fix to the git repository. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To

Re: --times does not transfer full modification time

2009-04-07 Thread Wayne Davison
On Mon, Apr 06, 2009 at 12:28:50PM +0200, David Depardoux wrote: Thus, the milliseconds for files on the receiving side are all set to zero. Correct. Rsync does not (yet?) support sub-second timestamps. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To

Re: itemized option (-ii) with --log-file and --log-file format

2009-04-02 Thread Wayne Davison
On Wed, Apr 01, 2009 at 10:50:13AM +0530, Jignesh Shah wrote: I noticed that the output format for this command is different from rsync V2.6.* . Is there any way I can make this output similar to rsync V2.6.*? What difference are you referring to? The use of send instead of recv for a local

Re: verbosity: list files without summary?

2009-03-31 Thread Wayne Davison
On Tue, Mar 31, 2009 at 10:43:51AM +0200, Mi wrote: Is there a way to set the verbosity so that transferred/changed files are listed, but not the summary information. See the --out-format (aka --log-format in older rsync versions) and the -i (--itemize-changes) options (since -i is an easy way

Re: Why are files synced again and again when not using -a?

2009-03-30 Thread Wayne Davison
On Mon, Mar 30, 2009 at 02:13:49PM +0200, Andr? H?nsel wrote: usually I use rsync with -a but recently I used it without this option and discovered that the same files are synced over and over again (as shown by -v). You should at least specify -t when not using -a. See the -a option in the

Re: ssh rsync equivalence?

2009-03-29 Thread Wayne Davison
On Sun, Mar 29, 2009 at 05:15:58PM +1300, Morgan Read wrote: ssh [...] sudo rsync [...] -e 'ssh -i /home/rsync/.ssh/id_dsa' [...] Those quotes won't survive the trip through that many programs, so you're undoubtedly ending up with rsync seeing just the -e ssh option, and the -i and beyond are

Re: Protocol of checksums generated with -c option?

2009-03-21 Thread Wayne Davison
On Sat, Mar 21, 2009 at 02:06:42PM +0100, Christian Hecht wrote: Now my question is, when i use rsync with the -c option, is it possible to output the filename and the generated hash to any file? Rsync 3.1.0dev supports the %C escape in log formats, which can output the sender's checksum

Re: Weird rsync or shell problem?

2009-03-21 Thread Wayne Davison
On Sat, Mar 21, 2009 at 07:23:58PM +0100, axel.we...@cbc.de wrote: SCHNITT/Render Files/#342#200#242Vorlage Bleskin_990101_NB_n-tv/Vorlage Blesk-FIN-000b The character sequence 0343 0200 0242 is E2 80 A2 in hex. Seems to be a common sequence for something (since those characters show up

Re: AARGH! I can't make rsync not copy dirs with --files-from option

2009-03-14 Thread Wayne Davison
On Sat, Mar 14, 2009 at 04:11:12PM -0500, David C. Rankin wrote: Way too much path, way way too much path. By default, all the path segments in the files-from file are a part of the transfer unless you turn off the implied --relative option, in which case no directory elements from the source

Re: rsync flags freebsd

2009-03-13 Thread Wayne Davison
On Thu, Mar 12, 2009 at 10:35:45PM -0400, Matt McCutchen wrote: The rsync 3.0.5 version of this patch is at: http://rsync.samba.org/ftp/rsync/patches/fileflags.diff I've just revised how patches are stored so that I can have patches for 3.0.x as well as 3.1.0dev. Thus, the link you cited is

Re: rsync flags freebsd

2009-03-13 Thread Wayne Davison
On Fri, Mar 13, 2009 at 06:57:15PM -0400, Matt McCutchen wrote: I would have thought it more natural to have branches patches-master and patches-3.0.x in the main repository. Is there any reason you made a separate repository? Yes, this way the branch names match and I can tag releases.

Re: comments with '#' in --files-from

2009-03-09 Thread Wayne Davison
On Mon, Mar 09, 2009 at 01:36:26AM -0400, Matt McCutchen wrote: From the code, it looks like comments (as lines beginning with '#' or ';') are supported but are buggy on remote runs (probably what you are seeing). Yeah, the code is supposed to ignore comments unless the data is coming in via

Re: proposal to speed rsync with lots of files

2009-03-06 Thread Wayne Davison
On Thu, Mar 05, 2009 at 03:27:50PM -0800, Peter Salameh wrote: My proposal is to first send a checksum of the file list for each directory. If is found to be identical to the same checksum on the remote side then the list need not be sent for that directory! My rZync source does something

Re: Problems while transferring big files

2009-03-06 Thread Wayne Davison
On Fri, Mar 06, 2009 at 08:20:43AM +0100, Boniforti Flavio wrote: I'm using rsync -rtz to transfer over an SSH tunnel and I always get 12 Error in rsync protocol data stream That is just the error code and its interpretation. What error message comes prior to that? We hypothesize that

Re: Delete files specified in --from-files-file that don't exist on the sender side

2009-03-06 Thread Wayne Davison
On Fri, Mar 06, 2009 at 04:44:56PM -0500, Matt McCutchen wrote: Two issues you may wish to correct [...] Thanks for pointing those out! I've made sure that the mode does not get tweaked by --chmod if it is 0, and changed the --list-only output to start with *missing, as you suggested. While

Re: rsync --files-from

2009-03-03 Thread Wayne Davison
On Thu, Feb 26, 2009 at 07:55:22PM -0700, Manoj Joseph wrote: Is there a way of passing a list of source _and_ destination paths?? Only for a single-file transfer. So, to do this with rsync, you'd need to transfer each file separately, possibly using the lighter daemon protocol (which could be

Re: Treat files that were modified locally and remote

2009-03-03 Thread Wayne Davison
On Sat, Feb 28, 2009 at 01:31:32PM +0100, Kurt wrote: One way to identify such files would be to do a dry-run upsync, then a dry-run downsync, find files that would have been sync'ed in both dry-runs, and then prompt the user for some action. Assuming that you mean to use the -u option, that

Re: Delete files specified in --from-files-file that don't exist on the sender side

2009-02-28 Thread Wayne Davison
On Fri, Feb 13, 2009 at 12:31:54AM +0100, intripoon wrote: Now there are files I want to have deleted on PC B. They don't exist on PC A. I hoped I could just add them to the list of files given to --from-files, but the sender just tells me failed: No such file or directory (2) and goes on. I

Re: rsync 3.0.5 - ERROR: buffer overflow in recv_file_entry [generator]

2009-02-21 Thread Wayne Davison
On Mon, Feb 16, 2009 at 02:54:36PM +0100, dr...@wp.pl wrote: overflow: xflags=0x7a l1=255 l2=779 This is the error rsync gives when the file and path exceed the MAXPATHLEN size for your system. The receiver updates all the files from the base of the transfer, so the names need to fit within the

Re: Renamed files and directories

2009-02-21 Thread Wayne Davison
On Mon, Feb 16, 2009 at 10:14:25AM +0100, N.J. van der Horn (Nico) wrote: What is the current status of both rename-patches ? Are there alternative measures ? I'm not thrilled with how the rename patches work, especially since they disable incremental recursion. As such, I'm hoping to change

Re: uid/gid settings in rsyncd.conf not respected?

2009-02-20 Thread Wayne Davison
On Sat, Feb 14, 2009 at 08:53:22PM -0500, Matt McCutchen wrote: The attached patch (also in wip/supplementary-groups of my repository) adds a daemon parameter to take on the supplementary groups. I went a little different route than this path by allowing the user to specify one or more groups

Re: --password-file

2009-02-16 Thread Wayne Davison
On Sun, Feb 15, 2009 at 05:08:36AM -0700, lewis butler wrote: This tells everyone the exact length of each password The docs should actually say that everything after the first line of the file is ignored. So, feel free to add any text you like after that. I'll improve the man page to get this

Re: Should posters be required to join the list? (was: Bad habits)

2009-02-16 Thread Wayne Davison
On Sat, Feb 14, 2009 at 09:29:11AM -0800, Wayne Davison wrote: I have decided that we'll try running the list that way and see how we like it Sadly, the rejection mails are way too cryptic to be useful. I will ask the samba folks if they will consider upgrading to a newer version of mailman

Re: --human-readable and --out-format %l

2009-02-16 Thread Wayne Davison
On Mon, Feb 16, 2009 at 09:29:38PM -0600, Kent Vander Velden wrote: Is there an alternative format type that lists the file length in a human readable format, perhaps optionally if --human-readable is specified? No, nothing like that currently exists. The master branch in git (that will

<    1   2   3   4   5   6   7   8   9   10   >