Skip source files that differ from existing destination files with a warning?

2020-09-17 Thread Matt McCutchen via rsync
Hi again, rsync list! I was heavily involved in rsync development and support back in 2005-2010. I've largely lost interest in that now and my knowledge of rsync is beginning to become stale, but I'm still a big fan and user of rsync, so I'm back with a user question. :) I did search the web

Re: --compress data-duplication bug?

2011-11-28 Thread Matt McCutchen
On Tue, 2011-11-29 at 15:51 +1100, Chris Dunlop wrote: I just noticed this commit for 3.1: --- commit cbdff74b44b25ce713739b9c1fb4db67610c675e Author: Wayne Davison way...@samba.org Date: Mon Nov 21 09:13:11 2011 -0800 Fix --compress data-duplication bug. --- Is there some

Re: multiple sources and excludes

2011-10-20 Thread Matt McCutchen
On Thu, 2011-10-20 at 11:30 -0700, Wayne Davison wrote: On Tue, Oct 18, 2011 at 1:21 PM, neilsort-rs...@yahoo.com neilsort-rs...@yahoo.com wrote: However, it seems as if these rule files are merged together into one, instead of being treated separately for each

Re: Rsync subscription is including samba-bugs

2011-08-07 Thread Matt McCutchen
On Mon, 2011-08-08 at 14:04 +1000, Michael Lynch wrote: I am subscribed to rsync, and would like to remain subscribed. But for some reason I am also receiving samb-bugs I have check my 'List other subscriptions, and only rsync is listed. Any ideas why I am receiving samba-bugs? This is

Re: does rsync not preserve directory mtimes?

2011-06-26 Thread Matt McCutchen
On Mon, 2011-06-27 at 03:01 +0530, Faheem Mitha wrote: I'm running the following command as a local copy command. faheem@bulldog:/mnt/data$ sudo rsync -abvz --super /data/ . Origin directory faheem@bulldog:/data$ ls -la total 28 drwxr-xr-x 7 root root 4096 Jun 26 08:34 .

Re: Rsync 3.0.9pre1 released

2011-06-25 Thread Matt McCutchen
On Wed, 2011-06-22 at 09:11 -0700, Wayne Davison wrote: Rsync version 3.0.9pre1 is now available for release testing. This is a bug-fix release. Please remember to tag it in the source repository... -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To

Re: Unconditionally transfer files

2011-06-18 Thread Matt McCutchen
On Sat, 2011-06-18 at 14:31 +0200, Andre Majorel wrote: Is there a way to make rsync unconditionally transfer files, i.e. create them anew even if the target already exists and is identical to the source ? rsync -I looks closer but still avoids transferring the files. Maybe rsync -I

Re: Unconditionally transfer files

2011-06-18 Thread Matt McCutchen
On Sat, 2011-06-18 at 16:26 -0400, Brian K. White wrote: What I don't understand is why people say they don't know why you'd want to do that without knowing any of your context. The statement is true, is it not? Claiming that no one would ever want to do it would be different. -- Matt --

RFE blues (Re: [Bug 8188] Mechanism for taking an rsync server down for maintenance)

2011-06-02 Thread Matt McCutchen
On Wed, 2011-06-01 at 17:08 -0400, Brian K. White wrote: On 6/1/2011 3:26 PM, Matt McCutchen wrote: On Wed, 2011-06-01 at 14:57 -0400, Brian K. White wrote: I like the built-in idea as I don't happen to use rsync via inetd/xinetd or any other on-demand starter. It's not an actual

Selective propagation of deletions

2011-06-02 Thread Matt McCutchen
On Wed, 2011-06-01 at 17:08 -0400, Brian K. White wrote: There are other problems too, relating to the difference between This directory was deleted from the source and so you DO want to delete it in your mirror., vs This directory was removed only because the entire tree was removed

Re: rsync is coring

2011-06-02 Thread Matt McCutchen
On Thu, 2011-06-02 at 09:27 -0700, vincent.soo...@daimler.com wrote: We are running an rsync process every hour and it is producing a core file. We thought initially there was a corrupt file but that is gone and the core file is still being produced. Would appreciate any help in analysing

Re: Selective propagation of deletions, + rsync scope

2011-06-02 Thread Matt McCutchen
On Thu, 2011-06-02 at 17:43 -0400, Brian K. White wrote: Perhaps the server side could specify all the deleted files and directories as being excluded before they are actually removed from the server. Then the client could use --delete but not --delete-excluded and get essentially the

Re: [Bug 8188] Mechanism for taking an rsync server down for maintenance

2011-06-01 Thread Matt McCutchen
On Wed, 2011-06-01 at 14:57 -0400, Brian K. White wrote: I like the built-in idea as I don't happen to use rsync via inetd/xinetd or any other on-demand starter. It's not an actual problem for me, today, but that's no excuse to avoid doing the right thing once you recognize it. And the

Re: Multi-Threading?

2011-05-17 Thread Matt McCutchen
On Tue, 2011-05-17 at 08:45 -0700, cac...@quantum-sci.com wrote: The connexion is Gb enet end-to-end, and is running at only 40Mb/s. It has far more capacity than that. The only limiting factor I can see is on the backup server one core of the CPU is running 100% rsync. Clearly rsync is not

Re: Multi-Threading?

2011-05-17 Thread Matt McCutchen
On Tue, 2011-05-17 at 10:54 -0700, Chuck Wolber wrote: On Tue, 17 May 2011, cac...@quantum-sci.com wrote: In researching this I find that a change to multi-threaded goodness would require a massive rewrite, and would only be considered for an rsync replacement. Abstracting the core

Re: default destination of files with no :/ path on the server

2011-05-13 Thread Matt McCutchen
On Sat, 2011-05-14 at 10:24 +1000, Adrian Levi wrote: I have accidentally uploaded some files to a VPS server using rsync through an ssh transport mechanism. I used the following command to upload the files: rsync -avzh --progress /srv/source-path root@server [...] That destination is a

Re: Rsync 3.0.8 released

2011-04-01 Thread Matt McCutchen
On Sat, 2011-03-26 at 15:11 -0700, Wayne Davison wrote: I have released rsync 3.0.8. The tag is missing from the source repository. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

RE: weird result when using --link-dest

2011-03-29 Thread Matt McCutchen
On Tue, 2011-03-29 at 05:22 -0700, Janne H wrote: Here are the results that you asked for du -s /tmp/full_20110329_122743 /tmp/20110329_125251 18272 /tmp/full_20110329_122743 532 /tmp/20110329_125251 du -s /tmp/20110329_125251 /tmp/full_20110329_122743 18272 /tmp/20110329_125251

Re: rsync: on remote machine: --drop-cache: unknown option

2011-03-13 Thread Matt McCutchen
On Sun, 2011-03-13 at 17:52 -0500, will trillich wrote: Okay, are we CERTAIN there's no --drop-cache option in 3.0.7? Yes. By the way: sender-machine$ *rsync --version* rsync version 3.0.7 protocol version 30 Copyright (C) 1996-2009 by Andrew Tridgell, Wayne Davison, and others. Web

Re: rsync backup problems

2011-02-13 Thread Matt McCutchen
On Mon, 2011-02-14 at 13:27 +1100, Daryl Sayers wrote: rsync -x --delete -azHv myremote:/ myremote:/usr myremote:/usr/local /machines/myremote/ This worked EXCEPT the /usr/local/ was put into /machines/myremote/local/ and not /machines/myremote/usr/local/. You want --relative . -- Matt

Re: Hidden files

2011-02-07 Thread Matt McCutchen
On Mon, 2011-02-07 at 21:04 -0500, Y z wrote: Wondering why rsync isn't copying hidden files. I thought (google told me so) that rsync doesn't treat dot files specially. command: # rsync -azPv * 10.1.1.1:/u2/ubuntu/ Rsync doesn't treat them specially, but your shell wildcard does. Consider

Re: [PATCH] One more -x to not traverse cyclic bind-mounts

2011-01-19 Thread Matt McCutchen
On Wed, 2011-01-19 at 12:40 -0700, Jeff Hansen wrote: The way rsync determines if the directory is a mount point looks very portable to me (with the FLAG_TOP_DIR bit), and with this patch, it has worked on every Linux system I've tried so far (not sure if FLAG_TOP_DIR works on BSDs, but I'm

Re: Implicit --itemize

2011-01-18 Thread Matt McCutchen
On Tue, 2011-01-18 at 09:32 +0100, Fabian Cenedese wrote: From reading the man pages I couldn't find such a hint, but is there a way that --itemize is implicitely activated e.g. with using another parameter? I used these params in a script with rsync 3.0.3pre1 on a NAS. MYRSYNC_ARGS=-rptgo

Re: [PATCH] One more -x to not traverse cyclic bind-mounts

2011-01-13 Thread Matt McCutchen
On Thu, 2011-01-13 at 11:24 -0700, Jeff Hansen wrote: This patch allows one to repeat the '-x' option a third time to stop rsync from traversing potentially cyclic bind mounts that are on the same filesystem. Your patch does not do anything about bind mounts, it simply excludes subdirectories

Re: How to sync an exact list of files, Including deletes!?

2010-11-23 Thread Matt McCutchen
On Tue, 2010-11-23 at 23:35 +0100, Axel Kittenberger wrote: You want the --delete-missing-args option of the current development rsync. Yes, I suppose I want that! :-) I hope this works with --force as well if there is a dir in --files-from? Yes. I got another question tough running

Re: Two problems: -u together with -c and and a symlink problem

2010-11-21 Thread Matt McCutchen
On Mon, 2010-11-15 at 18:33 +0100, Helmut Jarausch wrote: I have two problems with rsync 1st) if I give both commandline options -u and -c it looks as if a file which is more recent but different on the destination is not updated, i.e. -u overrules -c Is that true? Yes,

Re: How to sync an exact list of files, Including deletes!?

2010-11-20 Thread Matt McCutchen
On Sat, 2010-11-20 at 22:56 +0100, Axel Kittenberger wrote: While running, Lsyncd knows exactly which files need transfer and rsync's --files-from (with =- to get the filelist from stdin-pipe) sounds like an ideal solution for this, also to reduce the number of times rsync gets spawned. Coded

Re: Save Log File

2010-11-18 Thread Matt McCutchen
On Thu, 2010-11-18 at 10:56 -0800, rlinsurf wrote: Looks like I have some more information. The task is send an email to my user which contains this: X-Cron-Env: SHELL=/bin/sh X-Cron-Env: PATH=/usr/bin:/bin X-Cron-Env: LOGNAME=jeffrey X-Cron-Env: USER=jeffrey X-Cron-Env:

Re: How to delete a whole destination tree (inclusive the destination its-self) with rsync (daemon)?

2010-10-31 Thread Matt McCutchen
On Sun, 2010-10-31 at 17:39 +0200, Edvinas Valatka wrote: On Sun, 31 Oct 2010 03:15:37 +0100 Vahsen Beheer beh...@vahsen.nl wrote: I am backing up (using --link-dest, hard links) to a NAS which has an 'rsync' daemon running. I do not have ssh access to this Storage-device. Part of my

Re: rename(2) errno processing

2010-10-14 Thread Matt McCutchen
On Sat, 2010-09-25 at 22:52 -0400, Matt McCutchen wrote: I have filed a request to clarify the meaning of ENOTDIR for all syscalls: http://austingroupbugs.net/view.php?id=324 The interpretation of ENOTDIR as referring only to existing non-directory files has been accepted, so the UWIN

Re: Excluding most and including some problems continue.

2010-10-01 Thread Matt McCutchen
On Fri, 2010-10-01 at 16:28 -0400, Benjamin R. Haskell wrote: I think I sent a variant of the attached Perl script last time someone was asking something similar. What Wayne suggested is better right now (that is: while your patterns are very simple -- just a few root-level directories,

Re: recent discussion regarding 'checksums'

2010-09-28 Thread Matt McCutchen
On Mon, 2010-09-27 at 22:33 -0400, Benjamin R. Haskell wrote: But the flip side is that rsync is not a security tool. MD5 is fine for rsync for the same reason SHA-1 (which, as with all hashes, will eventually be broken) is fine for git: This gets a little off topic, but I /do/ want git to

Re: writefd_unbuffered failed to write 4092 bytes to socket

2010-09-26 Thread Matt McCutchen
On Sat, 2010-09-25 at 07:33 -0700, Joseph Maxwell wrote: I'm attempting to maintain a mirror of a remote database, ~ 66Gb on a FreeBSD platform. I do not have direct access to the database except by rsync, anon. ftp etc. I'm running rsync nightly from crontab, with the cmd

Re: recent discussion regarding 'checksums'

2010-09-26 Thread Matt McCutchen
On Fri, 2010-09-24 at 00:31 -0400, grarpamp wrote: [rsync -c fails to copy a file with an MD5 collision] Yes, right now rsync -c is not good if an attacker has had the opportunity to plant files on the destination and you want to make sure the files get updated properly, but that's an uncommon

Re: rename(2) errno processing

2010-09-25 Thread Matt McCutchen
On Sat, 2010-09-25 at 09:09 -0700, Wayne Davison wrote: I believe that ENOTDIR should only be returned if some component in the path exists but is not a directory. If the path is not fully there, it should instead return ENOENT. POSIX is unclear about whether walking a path where a non-final

Re: can't create a local mirror

2010-09-25 Thread Matt McCutchen
On Sat, 2010-09-25 at 13:16 -0700, Tim Hanson wrote: I either have a problem with rsync or it is not intended to do what I am asking it to do. I am trying to mirror a copy of /home/foo to a local usb drive. The copy is made, but the destination does not appear to be deleting files I have

Re: can't create a local mirror

2010-09-25 Thread Matt McCutchen
On Sat, 2010-09-25 at 13:37 -0700, Tim Hanson wrote: On Saturday, September 25, 2010 01:22:29 pm you wrote: On Sat, 2010-09-25 at 13:16 -0700, Tim Hanson wrote: I either have a problem with rsync or it is not intended to do what I am asking it to do. I am trying to mirror a copy of

Re: can't create a local mirror

2010-09-25 Thread Matt McCutchen
On Sat, 2010-09-25 at 13:53 -0700, Tim Hanson wrote: Also, I tried to --exclude it, but got the same error. You may have written the exclusion incorrectly. If the source is /home/timh/ , the exclusion should be --exclude=/.gvfs . See the ANCHORING INCLUDE/EXCLUDE PATTERNS section of the man

Re: rename(2) errno processing

2010-09-25 Thread Matt McCutchen
On Sat, 2010-09-25 at 11:46 -0700, Wayne Davison wrote: On Sat, Sep 25, 2010 at 9:38 AM, Matt McCutchen m...@mattmccutchen.netwrote: POSIX is unclear about whether walking a path where a non-final component is missing is allowed to return ENOTDIR. Yes, posix may be unclear, but I don't

RE: Old FreeBSD4.11 build.

2010-09-24 Thread Matt McCutchen
On Tue, 2010-09-21 at 16:45 -0400, Jonathan Call wrote: -Original Message- From: rsync-boun...@lists.samba.org [mailto:rsync- boun...@lists.samba.org] On Behalf Of Paul Slootman Sent: Tuesday, September 21, 2010 2:01 PM To: rsync@lists.samba.org Subject: Re: Old FreeBSD4.11

ENOTDIR for nonexistent path components

2010-09-23 Thread Matt McCutchen
On Thu, 2010-09-23 at 09:20 -0400, Jeff Fellin wrote: I've been porting rsync-3.0.7 to run on UWIN, an ATT Labs open source project, supporting a Unix environment on Windows. The code configured easily and compiled without any modifications or ifdef's added to the code. The backup test was

Re: is support for non-ASCII filenames in rsync complete?

2010-09-19 Thread Matt McCutchen
On Mon, 2010-09-20 at 08:55 +1200, Jason Haar wrote: Over the years there's been many people saying how files with non-ASCII charsets got their filenames corrupted moving between different systems. So I'm wondering what the current state is with rsync-3.06+? ie I want to use rsync-3.06+ to

Re: is support for non-ASCII filenames in rsync complete?

2010-09-19 Thread Matt McCutchen
On Mon, 2010-09-20 at 10:32 +1200, Jason Haar wrote: OK - so for example you mean if someone rsync's data from one OS to another, and then exports it back via Samba - that might cause issues. Yes, there may be issues depending on the Samba configuration. But if they export it back via rsync,

Re: Minimize log file: get rid of .d...p..... send

2010-09-03 Thread Matt McCutchen
On Fri, 2010-09-03 at 17:05 +0200, Hans Troost wrote: and indeed - although I specified rsync -vvv (most verbose output) - rsync silently ignores chmod(2) calls with emphasis on silently: 2010/09/03 16:45:49 [7882] send_files(15, /home/hans/rsync-files/rsync-test/New Folder) 2010/09/03

Re: Minimize log file: get rid of .d...p..... send

2010-09-03 Thread Matt McCutchen
On Fri, 2010-09-03 at 18:18 +0200, Hans Troost wrote: Took a while to get out that I didn't have strace, installed and learned it a bit. !!! Even with strace I do not get a chmod call shown. !!! strace -o /home/hans/strace.log -s 80 rsync [...] That is just tracing the first rsync

Re: Getting the 'hidden' .htaccess file.

2010-09-03 Thread Matt McCutchen
On Fri, 2010-09-03 at 10:57 -0700, Ian Skinner wrote: dprweb /usr/local/bin/rsync -v -v -v -v -i -i -i --progress --stats --compress .htaccess appprod::test .f .htaccess Rsync is claiming that .htaccess is up to date on the destination. How did you determine that it doesn't exist?

Re: Minimize log file: get rid of .d...p..... send

2010-09-03 Thread Matt McCutchen
On Fri, 2010-09-03 at 20:49 +0200, Hans Troost wrote: Indeed, strace -f option helps: the chmod status unfinished shows up several times now. no real warnings or errors, but nevertheless: information about what's going wrong. Unfinished does not indicate that anything is wrong. It just

Re: Minimize log file: get rid of .d...p..... send

2010-09-02 Thread Matt McCutchen
On Thu, 2010-09-02 at 11:38 +0200, hans.tro...@telfort.nl wrote: I'm just starting with rsync, googled and experienced a lot, but get stuck with minimizing the log-file: I only want to see the real changes: new, updated and deleted files/directories in the log-file. The LOG-file always

Re: compare a directory with itself -- differences found

2010-09-02 Thread Matt McCutchen
On Thu, 2010-09-02 at 16:22 -0700, Pen Helm wrote: What kind of differences are reported. here's a small sample:[I said something like rsync ~ ~] cd+ /Users/ cd+ /Users/pen/ f+ /Users/pen/A f+ /Users/pen/B f+ /Users/pen/Desktop DB f+

Re: Check/compare modtime before deleting?

2010-08-19 Thread Matt McCutchen
On Thu, 2010-08-19 at 11:31 -0700, Chris wrote: I need to keep two identical copies of files on my desktop and laptop, so I want to use the -delete option. But I don't want to delete files that are created after last sync. Is there a way to keep files with modtime later than a file of a

Re: Performance and simultaneous connections over SSH

2010-08-15 Thread Matt McCutchen
On Sun, 2010-08-15 at 10:50 -0600, Francois Begin wrote: I just started to notice some 'sync sputtering': Sometime, all 4 server's latest access log will have the same timestamp e.g. 09:30, while at other times I would see something like this: It is 09:35 and I have 2 servers at 09:20 and 2 at

Re: rsync is not deleting subdirectories

2010-08-14 Thread Matt McCutchen
On Fri, 2010-08-13 at 14:04 -0400, mike mitchell wrote: Hi. I'm having a problem with rsync not deleting subdirectories that exist at the destination but which have been removed/renamed on the source. I'm running 64-bit Arch, rsync 3.0.7, and am trying to back up /home to an external USB

Re: Compression error? -- Inflate (token) returned -5

2010-08-14 Thread Matt McCutchen
On Fri, 2010-08-13 at 11:26 -0400, Brian K. White wrote: I have sample data that exposes this repeatably: http://lists.samba.org/archive/rsync/2008-October/021889.html Thanks, but we figured out the problem several months ago and it should be fixed in rsync 3.0.7:

Re: rsync --noperms?

2010-08-14 Thread Matt McCutchen
On Fri, 2010-08-13 at 15:45 -0400, Vallon, Justin wrote: It seems that even if -p (or -a, etc) are not used, permissions are still propagated from client to server, though not updated. Correct. This is a historical behavior inherited from cp that is hardly ever what you want. See the man page

Re: rsync is not deleting subdirectories

2010-08-14 Thread Matt McCutchen
On Sat, 2010-08-14 at 06:16 -0400, mike mitchell wrote: I wasn't able to reproduce the problem from any other source or destination, even in nested subdirectories within a directory in my home. It was only when using /home/mike as the source, so I guessed there must be something wrong in

Re: feature request: remote user is root, make remote owner is foo

2010-08-14 Thread Matt McCutchen
On Wed, 2010-08-11 at 10:18 -0700, travis+ml-rs...@subspacefield.org wrote: I often push files from my user account over SSH to my web server, and want them owned by www-user, which may not have a login shell, should never accept remote logins, and who may not have a ~/.ssh directory (and if

Re: IO error causing file deletion failure?

2010-08-08 Thread Matt McCutchen
On Sat, 2010-08-07 at 19:54 +1200, Morgan Read wrote: I've been running this command, with the accompanying error: [r...@mythtv ~]# ssh -t rs...@192.168.1.40 sudo rsync -avzAXH --delete-after -e /home/rsync/bin/rsync_ssh /home/ building file list ... rsync: readlink_stat(/home/morgan/.gvfs)

Re: rsync Time Zones

2010-07-31 Thread Matt McCutchen
On Fri, 2010-07-30 at 15:04 -0700, Frank Jaccarino wrote: As I continue to understand the nuances of using rsync for our business I am now coming across some time zone questions I could use some guidance on. My test environment is on a Windows 7 box using Cygwin for rsync. The production

Re: Add bwlimit to SSH Single Use Deamon

2010-07-30 Thread Matt McCutchen
On Fri, 2010-07-30 at 09:39 +0200, Mark Eisenblaetter wrote: i can't use ForceCommand, they want be able to login again. If the customer has shell access, they will be able to circumvent any bandwidth limitation you might try to apply at the rsync level. Consider using tc or the analogous tool

Re: rsync mirror solution: how to prevent accidental mirror deletion

2010-07-29 Thread Matt McCutchen
On Thu, 2010-07-29 at 19:41 -0500, Rahul Nabar wrote: I used to maintain mirror backups of the /home dir on our production_server using rsync to a backup_server. The primary server had a rsyncd daemon running and the backup_server had this line in the crontab: 10 01 * * * rsync -av

Re: Add bwlimit to SSH Single Use Deamon

2010-07-29 Thread Matt McCutchen
On Thu, 2010-07-29 at 13:00 +0200, Mark Eisenblaetter wrote: is there any way to add an bwlimit to an SSH Singel USe Deamon? My cutomer want to use ssh and i want to set an Bandwith limit. As long that bwlimit is not an rsyncd.conf option i see no way to add ist for ssh connections. I am

Re: --ignore-exisiting criteria?

2010-07-28 Thread Matt McCutchen
On Wed, 2010-07-28 at 10:16 -0700, fjaccarino wrote: I've been hunting on the web but I can't seem to find what the definition that is used when using the --ignore-existing option of RSYNC. Would anyone happen to know what exactly is the criteria used to ignore files? Is it name only? Size?

Re: --ignore-exisiting criteria?

2010-07-28 Thread Matt McCutchen
, 2010 at 9:32 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Wed, 2010-07-28 at 10:16 -0700, fjaccarino wrote: I've been hunting on the web but I can't seem to find what the definition that is used when using the --ignore-existing option of RSYNC. Would anyone happen to know what

Re: Behavioral differences between versions.

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 12:42 -0600, Jeff Cleverley wrote: Am I correct in my assumption that Redhat does not tweak the rsync it ships with its distribution? The way to find out is to ask Red Hat or look in their SRPMs. Choose either client or server (they seem to be the same in this case--are

Re: Problem backing up read-only files

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 19:57 -0700, Gary Johnson wrote: On 2010-07-23, Alex Ferrara wrote: Hi Gary, It looks like the problem occurs after rsync has transferred the file and is renaming the temporary file to the actual name. I am guessing that the HP media vault has Samba running on it,

Re: Behavioral differences between versions.

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 21:50 -0600, Jeff Cleverley wrote: I've found Red Hat often slow and difficult to get an answer from. That's not our problem. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options:

Re: Cannot delete non-empty directory/Operation not permitted with file-creation on target-server

2010-07-14 Thread Matt McCutchen
On Wed, 2010-07-14 at 09:35 +0200, Carsten Deibert wrote: I was searching for an answer myself for quite some time without success, so I hope somebody can clarify...I use rsync to sync webcontent from one server to another. Apache-details: * Apache runs as nobody:nogroup. *

Re: How to skip deletion of files which are newer on the receiver?

2010-06-29 Thread Matt McCutchen
On Tue, 2010-06-29 at 11:04 +0200, Mike Reiche wrote: I try to create a duplex sync between client/server via two rsync calls. Don't do that. Use unison (http://www.cis.upenn.edu/~bcpierce/unison/) instead. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing

Re: RERR_PARTIAL exit status

2010-06-18 Thread Matt McCutchen
On Thu, 2010-06-17 at 13:46 -0600, Keith Hellman wrote: I recently changed my backup script to invoke with rsync w/ -v -v and store the output to (yet another) log file. After a nightly backup I looked at the results, and: 1. removed all the lines ending in ' is uptodoate$' 2.

Re: Complex include/excludes with rsync?

2010-06-11 Thread Matt McCutchen
On Thu, 2010-06-10 at 19:16 -0400, Brian Mathis wrote: I'm trying to use rsync filters to achieve the following result: Include / Exclude /home Include /home/user1 I've been doing a lot of experimentation and at this point I'm just staring at the man page. Rsync filters seem to be

Re: rsync via restricted ssh command=

2010-06-03 Thread Matt McCutchen
On Thu, 2010-06-03 at 20:18 +1000, Mark Constable wrote: I've read a few tutorials about how to use rsync via ssh using the command= functionality to restrict where the user can sync to. I've got this on the on the destination side in it's ~/.ssh/authorized_keys... command=rsync --server

Re: rsync failure quoting incorrect directory

2010-05-21 Thread Matt McCutchen
On Fri, 2010-05-21 at 13:31 +0100, e-letter wrote: Command terminal output: $ rsync -rv * -e ssh u...@pathtoremotemachine sending incremental file list rsync: mkdir /localmachine/path/to/home/u...@pathtoremotemachine failed: No such file or directory (2) rsync error: error in file IO (code

Re: Device not configured (explanation)

2010-04-29 Thread Matt McCutchen
On Fri, 2010-04-30 at 13:32 +1200, Henri Shustak wrote: rsync: read /Volumes/Drobo_HD/lbackups/theserver.Homes/Section.0/Faculty/andrewmac/.DS_Store: Device not configured (6) I am curious to know if anyone else has seen this error on Mac OS X. In addition, is any one able to shed some

Re: Count of files to be transferred

2010-04-29 Thread Matt McCutchen
On Fri, 2010-04-30 at 12:13 +0700, Ryan Joseph wrote: I'm making a GUI for rsync and having some problems getting a reliable indication of the files that will be transferred (so I can make a progress bar from the results). I didn't see rysnc offered this so my plan has been to get a list of

Source directory without a trailing slash

2010-04-28 Thread Matt McCutchen
On Wed, 2010-04-28 at 22:24 +1000, David Schoen wrote: Also when I use rsync I like to put slashes on the end of all paths as it works closer to the way you're thinking, e.g.: rsync -av /path/to/source/directory/ /path/to/destination/directory/ other wise you will probably end up with two

Re: Rsync on a single server

2010-04-27 Thread Matt McCutchen
On Tue, 2010-04-27 at 19:48 -0700, Legionnaire1 wrote: I can only assume everything new/changed was copied as I now need the mysql database copied from one domain to the other. Is it possible to copy the mysql database using rsync on the /mysql/mydomain to /mysql/myotherdomain or do I have to

Re: rsync with forced-command ssh and variable files

2010-04-26 Thread Matt McCutchen
On Mon, 2010-04-26 at 17:36 -0400, Alex wrote: I had asked a variation on this some time ago, but am trying to do something a bit different this time. I'd like to sync a file with a remote host using ssh and a command= ssh key, like this in ~/.ssh/authorized_keys: command=/usr/bin/rsync

Re: rsync with forced-command ssh and variable files

2010-04-26 Thread Matt McCutchen
On Mon, 2010-04-26 at 22:33 -0400, Alex wrote: My answer is the same as last time: don't override the rsync server command, instead use an rsync daemon. Thanks for the follow-up :-) There is a firewall involved, and it's over an unsecured network, so I'm not sure using just the rsync

Re: on remote machine: --remove-source-files: unknown option

2010-04-22 Thread Matt McCutchen
On Thu, 2010-04-22 at 12:53 -0400, N. Yaakov Ziskind wrote: I'm trying to sync from 3.0.5 to 2.5.5 (SCO, *sigh*) The source machine errors out b/c the --remove-source-files (or --remove-sent-files) options don't exist on 2.5.5. But, since these option are only acted on by the sending

Re: rsync with --link-dest=DIR

2010-04-18 Thread Matt McCutchen
On Sun, 2010-04-18 at 16:57 +0200, Martin wrote: When using --link-dest=DIR with DIR on the startup volume everything works fine. If DIR is a volume on an external drive many files are copied instead of creating hard links. hardlinks are create e.g. fom .jpg files and from .rtf files but not

Re: rsync over ssh - possible attack vectors

2010-04-16 Thread Matt McCutchen
On Fri, 2010-04-16 at 02:16 +0200, George Sullivan wrote: us...@localserver:$ rsync -rtcve ssh us...@remoteserver:/.../ /local/.../ But what I'm interested in is what happens if remoteserver is compromised? Could attacker X on remoteserver alter the rsync binary in such a way so it can

Re: Risk of corrupting open sources files

2010-04-16 Thread Matt McCutchen
On Thu, 2010-04-15 at 17:41 -0700, Mohammed AlQuraishi wrote: I have a situation where the files I'm backing up are written to every fifteen minutes or so. There's a good possibility that rsync will try to copy a file while it is being written into, and I'm wondering if there's any risk that

Re: rsync over ssh - possible attack vectors

2010-04-16 Thread Matt McCutchen
On Sat, 2010-04-17 at 02:17 +0200, g. sullivan wrote: On 4/16/2010 4:30 PM, Matt McCutchen wrote: On Fri, 2010-04-16 at 02:16 +0200, George Sullivan wrote: us...@localserver:$ rsync -rtcve ssh us...@remoteserver:/.../ /local/.../ The remote server can change arbitrary files on the local

Re: Mac OS X rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)

2010-04-14 Thread Matt McCutchen
On Thu, 2010-04-15 at 00:21 +0100, Stuart Ramdeen (Toucan) wrote: I have also noticed this error. In my particular scenario ACL preservation is not essential, but what concerns me is that rsync appears to skip an entire folder that has an invalid ACL. Therefore none of the actual data is

Re: Mac OS X rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)

2010-04-14 Thread Matt McCutchen
On Fri, 2010-04-09 at 11:12 +1200, Henri Shustak wrote: An LBackup user recently posted a question to the mailing list asking about the following error. rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0) Is it possible to place a feature request to have the error reported by

Re: osx 10.6 strange rsync errors

2010-04-05 Thread Matt McCutchen
On Sat, 2010-04-03 at 18:12 -0400, Robert DuToit wrote: I have been getting reports from users of backuplist+, my wrapper application for rsync (currently with build of 3.0.6), about odd behavior after updating to OS 10.6 Snow Leopard. Basically: the problem occurs backing up a directory to

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 13:57 -0500, Randall Cotton wrote: This works as expected (a hard link is made) rsync -a --link-dest=../a.1 a/ b/a This does not (a copy is made instead of a hard link) rsync -a --link-dest=a.1 a b Not a bug. The --link-dest argument needs to be given relative to the

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 16:38 -0500, Randall Cotton wrote: - Original Message - From: Matt McCutchen m...@mattmccutchen.net To: Randall Cotton recot...@earthlink.net Cc: rsync@lists.samba.org Sent: Monday, April 05, 2010 4:16 PM Subject: Re: This is a bug, right? (--link-dest

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 21:19 -0500, Randall Cotton wrote: - Original Message - From: Matt McCutchen m...@mattmccutchen.net To: Randall Cotton recot...@earthlink.net Cc: rsync@lists.samba.org Sent: Monday, April 05, 2010 4:47 PM Subject: Re: This is a bug, right? (--link-dest

Re: rsync give option mkdir -p

2010-03-31 Thread Matt McCutchen
On Fri, 2010-03-26 at 02:12 +0300, Alex wrote: how i can use rsync whith mkdir -p for nackup dirs ? when i use rsync / /backup/month/day i need automatic creation month and day dirs. mkdir -p can do that, but rsync can't https://bugzilla.samba.org/show_bug.cgi?id=4621 -- Matt --

Re: --delete question.

2010-03-24 Thread Matt McCutchen
On Wed, 2010-03-24 at 12:10 +0530, Satish Shukla wrote: Please advise on rsync usage. --delete doesn’t work without recursion(--recursion). The recursion is causing huge overheads for me. My directory trees are huge. Any suggestions through which I can cut overheads. It used to work well in

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 15:05 -0700, Bruce Korb wrote: Please forgive my digging up a two year old thread, but I've got the same problem, but the pointers there give no help. This is using versions 3.0.6 (server) and 3.0.7 (client). Unfortunately, I have to type the client stuff in by hand.

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 15:50 -0700, Bruce Korb wrote: Without the -e ssh I was getting no response at all. tcpdump wasn't showing any port 873 packets, but port 22 was getting through the vyatta virtual switch. So, -e ssh, though I'd actually like to get the daemon working correctly through

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:15 -0700, Bruce Korb wrote: On Tue, Mar 23, 2010 at 3:57 PM, Matt McCutchen m...@mattmccutchen.net wrote: $ ls -l ... -rw-r--r-- 1 root root 2451 2010-03-23 15:30 log.txt Oops. Fixed. Still root owned, but mode is now 0666. Ah. You have

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:18 -0700, Bruce Korb wrote: does the -e ssh invocation of rsync actually load up rsyncd.conf ? The double-colon source or destination path indicates the use of an rsync daemon (which uses an rsyncd.conf file). The explicit -e ssh tells the client to invoke the daemon

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:54 -0700, Bruce Korb wrote: I now have an strace output file. It opens rsyncd.conf correctly and reads in all the data in one gulp. I've trimmed the strace to start from there. Notice that it tries to open the log file and fails because it isn't found. That

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 17:05 -0700, Bruce Korb wrote: On Tue, Mar 23, 2010 at 4:59 PM, Matt McCutchen m...@mattmccutchen.net wrote: On Tue, 2010-03-23 at 16:54 -0700, Bruce Korb wrote: I now have an strace output file. It opens rsyncd.conf correctly and reads in all the data in one gulp

Re: Incremental recursion not working

2010-03-23 Thread Matt McCutchen
On Mon, 2010-03-22 at 14:40 +0100, Gerald Holl wrote: I'm using rsync 3.0.3 over ssh to sync data between two hosts. I can't get the incremental recursion working: rsync -vLogtprz --progress --delete --delete-during --partial -e ssh -p 1234 --numeric-ids u...@host /local/dir/ The

Re: rsync maximum size limit

2010-03-23 Thread Matt McCutchen
On Wed, 2010-03-17 at 14:30 -0500, Ramesh Basukala wrote: Is there any way in rsync that allows me to trasfer certain amount of files? For Example: My total directory/folder (/var/tmp/testFolder ) size is 800MB and I want to sync only 200MB of files at other server, whichever file will

Re: cwrsync and link-dest option

2010-03-23 Thread Matt McCutchen
On Wed, 2010-03-17 at 20:46 +0100, Stefan Agner wrote: Is there a way to get permissions working correctly? Does it work when I have the users from Windows in my passwd? I must admit that the backup pc is not (yet) connected to the Active Directory (e.g. using samba to authenticate at

  1   2   3   4   5   6   7   8   9   10   >