Re: Restoring Backup user files with preserving UID/GID

2009-11-21 Thread Matt McCutchen
On Fri, 2009-11-20 at 19:51 -0700, LuKreme wrote: > Now I want to transfer all these files to the new machine, but preserving the > UID/GID combinations. > > I am assuming that I need to (temporarily) set the rsync daemon on the new > machine to run as root. Is that as simple as setting the rsyn

Re: Stability of rsync 3.1.0dev (Re: Does files-from work with --delete?)

2009-11-21 Thread Matt McCutchen
On Fri, 2009-11-13 at 13:17 -0500, Matt McCutchen wrote: > On Fri, 2009-11-13 at 08:38 -0800, Wayne Davison wrote: > > On Thu, Nov 12, 2009 at 3:56 PM, Philip Pokorny > > wrote: > > How confident are you in the current state of 3.1.0.pre and > > the nigh

Re: --fuzzy search over to-be-deleted files to catch moved files and directories

2009-11-21 Thread Matt McCutchen
On Fri, 2009-11-13 at 18:58 +0100, H. Langos wrote: > Ahh, ok, so here size+mtime or checksum select the base file. > > And if that selection fails then "--fuzzy" search is applied but looks > only in the /dst directory for a suitable candidate. > > (Or is the temporal order reversed?) Yes, th

Re: something about filter rules of rsync

2009-11-25 Thread Matt McCutchen
On Wed, 2009-11-25 at 21:20 +0800, 夏凯 wrote: > i want rsync to include all the *.dat files(and the *.dat files in the > subdirectory), and exclude all other files. how can i write the filter > rules? i have read the man rsync, but i still got no idea to do it. > for example, the result of find -pri

Re: Rsync deletion issue on failure

2009-11-25 Thread Matt McCutchen
On Wed, 2009-11-25 at 23:03 -0700, Adam Gordon wrote: > I didn't see this in the man page or after a cursory Google search. > > I'm rsync-ing a file from computer A to computer B and the file does > not exist yet on computer B. My problem is that on a shoddy Internet > connection, if rsync fails

Re: multiplexing overflow errors

2009-11-27 Thread Matt McCutchen
On Fri, 2009-11-27 at 10:56 -0800, Wayne Davison wrote: > On Fri, Nov 27, 2009 at 7:45 AM, Dieter Stüken > wrote: > > log/20091123_223901/dresden.log:multiplexing overflow > 101:7104843 [sender] > > This has come up before. That number translates into the byte > sequence

Re: Possibility so that --max-size AFFECTS --delete ?

2009-11-27 Thread Matt McCutchen
On Sat, 2009-11-28 at 00:06 +0100, Stefan Nowak wrote: > Is there a possibility, so that --max-size AFFECTS --delete actually? > > Situation where it makes sense: Imagine that I had the rule --max- > size=1M and my backup-storage is satisfying. But one day it ain't > enough anymore, and I decid

Re: Possibility so that --max-size AFFECTS --delete ?

2009-11-27 Thread Matt McCutchen
On Sat, 2009-11-28 at 05:15 +0100, Stefan Nowak wrote: > On 2009-11-28 at 03:43 +0100 Matt McCutchen wrote: > > On Sat, 2009-11-28 at 00:06 +0100, Stefan Nowak wrote: > >> The content of this newsgroup post, makes me think, that in earlier > >> versions --max-size may

Re: Does --archive include an --update behaviour?

2009-11-27 Thread Matt McCutchen
On Sat, 2009-11-28 at 05:30 +0100, Stefan Nowak wrote: > Manpage of rsync 3.0.6 about option --update: [...] This forces rsync > to skip any files which exist on the destination and have a modified > time that is newer than the source file. [...] > > Here the manpage is very clear to me! > But

RE: rsync of STDIN to a file.

2009-11-27 Thread Matt McCutchen
On Wed, 2009-11-25 at 12:09 +, Mark Young wrote: > I believe the rdiff man page is still not correct, even with your > submitted changes. It states "In every case where a filename must be > specified, - may be used instead to mean either standard input or > standard output as appropriate.". >

Re: Problem with permissions

2009-11-28 Thread Matt McCutchen
On Fri, 2009-11-27 at 11:38 -0600, Chris Adams wrote: > rsync --stats -v -axH --inplace --delete --rsync-path="rsync --fake-super" / > u...@remote:/backup/root/ > My problem is that there is a local directory that has permissions 0111 > ("d--x--x--x"), and rsync throws an error trying to set the

[PATCH] Don't (wrongly) retouch dir permissions with --fake-super.

2009-11-28 Thread Matt McCutchen
--- generator.c |7 +-- 1 files changed, 5 insertions(+), 2 deletions(-) diff --git a/generator.c b/generator.c index 8038feb..4abe6a0 100644 --- a/generator.c +++ b/generator.c @@ -1892,6 +1892,7 @@ static void touch_up_dirs(struct file_list *flist, int ndx) static int counter =

Re: Any way to predict the amount of data to be copied when re-copying a file?

2009-11-29 Thread Matt McCutchen
On Sun, 2009-11-29 at 16:07 +, Andrew Gideon wrote: > Is > there some way to run rsync in some type of "dry run" mode but where an > actual determination of what pages should be copied is performed? > > The current --dry-run doesn't go down to this level of detail as far as I > can see. It

Re: --fuzzy search over to-be-deleted files to catch moved files and directories

2009-12-04 Thread Matt McCutchen
On Tue, 2009-11-24 at 12:33 +0100, H. Langos wrote: > Ok, I see. Does "--fuzzy" check if the filezize is in the same order of > magnitude (or at most one order up/down)? > Expensive fuzzy string matching on filenames can probably safely be skipped > if abs(round(log10(ssize))-round(log10(dsize))

Re: Data loss (corruption with rsync)

2009-12-04 Thread Matt McCutchen
On Fri, 2009-12-04 at 18:21 +0200, kordex - wrote: > I just rsync'd my 1TB partitions formated with jfs filesystem > containing ~720GB data. I saw -3G difference between source and > destination which made me suspect possible dataloss. Also I had > experienced loss of integrity on my previous copie

Re: Data loss (corruption with rsync)

2009-12-04 Thread Matt McCutchen
On Sat, 2009-12-05 at 00:19 +0200, kordex - wrote: > Discussion in enlightened irc channel (OFTC/#ck) gave possible clue > for solving this, although it's just a quess: > > 0006 @ con || KordeX >4GB file? > 0007 + KordeX || not all of those are > 0007 + KordeX || i mean most of them are <

RE: rsync of STDIN to a file.

2009-12-04 Thread Matt McCutchen
On Sat, 2009-11-28 at 23:50 +, Mark Young wrote: > > The next sentence of the man page says, "Be aware that if you do > this, > > you’ll need to terminate your options with -- or rdiff will think > you > > are passing it an empty option." > I'm sure you are right, but there are still older ver

Re: multiplexing overflow errors

2009-12-04 Thread Matt McCutchen
On Fri, 2009-11-27 at 15:00 -0500, Matt McCutchen wrote: > On Fri, 2009-11-27 at 10:56 -0800, Wayne Davison wrote: > > On Fri, Nov 27, 2009 at 7:45 AM, Dieter Stüken > > wrote: > > > > log/20091123_223901/dresden.log:multiplexing overflow >

Inotify-driven rsync (Re: Will rsync support btrfs file system?)

2009-12-07 Thread Matt McCutchen
On Sun, 2009-12-06 at 15:30 -0500, Benjamin R. Haskell wrote: > Huh. Cool. This might not be all that difficult. I downloaded > inotify-tools from inotify-tools.sf.net and the following test (monitor > all changes to my home directory) seems to be producing interesting > results: > > find /h

Re: --link-dest not working?

2009-12-07 Thread Matt McCutchen
On Mon, 2009-12-07 at 19:21 -0800, Parke Bostrom wrote: > Why is rsync with --link-dest not working as I expect it to in the > following example? > rsync -a --link-dest=a a/ b/ >From the man page: --link-dest=DIR [...] If DIR is a relative path, it is relative to the destination directory. So y

Re: multiuser rsync environment

2009-12-10 Thread Matt McCutchen
On Thu, 2009-12-10 at 11:54 +0100, Angel Spassov wrote: > We are two users managing our homepage through subversion > in order to synchronize each others work. > We upload everything to the server via the following command in rsync: > > > rsync -avzt --exclude ".svn" --exclude "*~" -e ssh . >

Re: multiuser rsync environment

2009-12-10 Thread Matt McCutchen
On Thu, 2009-12-10 at 12:33 +0100, Matthias Schniedermeyer wrote: > The mtime of the files are NOT kept in sync by subversion and differ > between the 2 different working copies you use. [...] > Or, (most "risky") just ignore mtimes '--ignore-times'. I think you mean --size-only. --ignore-times

Re: Can rsync use UDP?

2009-12-10 Thread Matt McCutchen
On Thu, 2009-12-10 at 17:55 -0500, Neal B wrote: > Does rsync support using udp instead of tcp? No, rsync does not support UDP. As currently designed, it requires a stream protocol. (Though I suppose a stream could be emulated over UDP if that were somehow desirable.) -- Matt -- Please use r

Re: about --link-dest

2009-12-10 Thread Matt McCutchen
On Fri, 2009-12-11 at 01:25 +0100, Noel David Torres Taño wrote: > I don't know what I'm doing bad, but --link-dest does not work for me: > $ rsync -av --link-dest=$PWD/copy1 origin/ copy2 > Now I expect to see that the inode number of the kk file in copy2 is the same > than the inode number of

Re: about --link-dest

2009-12-11 Thread Matt McCutchen
On Fri, 2009-12-11 at 11:04 +0100, Noel David Torres Taño wrote: > On Friday 11 December 2009 03:43:30 you wrote: > > On Fri, 2009-12-11 at 01:25 +0100, Noel David Torres Taño wrote: > > > I don't know what I'm doing bad, but --link-dest does not work for me: > [...] > > > > Pass -i to find out why

Compression error (Re: rsync hangs during transfer)

2009-12-13 Thread Matt McCutchen
On Fri, 2009-12-11 at 08:58 +0100, Dimitar Dimitrov wrote: > I am running the following rsync command to synchronize directories > between two servers: > rsync -axvz --delete-after -e ssh /SRCDIR/ bla...@dest:/DESTDIR > > The transfer starts and after a short while it appears to hang after > some

Re: rsync speed on slow wireless links

2009-12-13 Thread Matt McCutchen
On Thu, 2009-12-10 at 13:08 +0700, Max Arnold wrote: > I've noticed that rsync performs significantly worse than wget on slow > congested wireless > links (GPRS in my case). I don't have large statistics, but in my tests > rsync often stalls > for 3-5 minutes, while wget stalls only for several

Re: rsync speed on slow wireless links

2009-12-21 Thread Matt McCutchen
On Mon, 2009-12-21 at 10:04 -0800, Wayne Davison wrote: > Have you verified that rsync is actually stalled, and not simply > sending incremental file-list information in between files? (e.g. > strace rsync and see what it's doing.) You could try using > --no-inc-recursive to see if doing all the

Re: rsync hangs during transfer

2009-12-21 Thread Matt McCutchen
On Mon, 2009-12-21 at 10:00 -0800, Wayne Davison wrote: > Since the reason for things falling apart is that there was an error > in the compress code, you should be able to avoid the hang (for now) > by avoiding the -z option. The compression error has been explained: http://lists.samba.org/archi

Re: CVS update: rsyncweb

2009-12-21 Thread Matt McCutchen
On Mon, 2009-12-21 at 11:56 -0700, Rsync CVS commit messages wrote: > Modified Files: > FAQ.html > Log Message: > Mention the inflate issue that was recently fixed. It's a little confusing to recommend people to upgrade to an rsync version (3.0.7) that hasn't been released yet. -- Matt -

Re: Reverse function how to

2010-02-01 Thread Matt McCutchen
On Mon, 2010-02-01 at 15:03 +0100, Leslie Jensen wrote: > I'm using a script that does this: > > /usr/local/bin/rsync -tpv --files-from=/home/admin/bin/list_of_files / > /home/admin/configuration/ > > I can't get the permissions on the files to stick, when the files are > written they get root

Re: rsync --link-dest, --delete and hard-link count

2010-02-07 Thread Matt McCutchen
On Fri, 2010-02-05 at 22:51 -0500, grarpamp wrote: > Files that are present in the previous datedir/hier/run but will > not be present in the currently to be made datedir/hier/run, > [because they are no longer present in the source hier], > DO NOT show up in the output of rsync -i as deletions. >

Re: Updating rsync version installed to new release

2010-02-07 Thread Matt McCutchen
On Fri, 2010-02-05 at 11:44 -0800, Andrei_r20 wrote: > Hi, I have rsync 3.0.1 installed on Fedora 9 distribution. > I want to update rsync to it's new release which is 3.0.7. > > I am not exactly sure how to proceed... > > I saw some source code tar files on rsync home page, but I am not too sure

Re: Error 11: can not backup /var/lib/zope2.9

2010-02-07 Thread Matt McCutchen
On Fri, 2010-02-05 at 19:31 +0100, Michael Renner wrote: > I wrote a small backup script that use rsync: r5backup > (http://sourceforge.net/projects/r5backup/). It backup dozen of unix machines > for many people. > But when I try to backup /var/lib/zope2.9 I get an error 11. It does not > matter

Re: rsync --link-dest, --delete and hard-link count

2010-02-08 Thread Matt McCutchen
On Mon, 2010-02-08 at 09:30 -0500, grarpamp wrote: > > cp -al, rsync > > Various source changes would likely change some metadata in the old > sets. Yep. See my request for a --no-tweak-hlinked option to avoid such attribute tweaking issues: https://bugzilla.samba.org/show_bug.cgi?id=4561 > An

Re: files-from and delete option?

2010-02-08 Thread Matt McCutchen
On Mon, 2010-02-08 at 20:19 +0200, Emil Genchev wrote: > is there a way to have a absolute file paths in a file - and use > --files-from together with --delete option? > what i mean is - lets say i have a daily generated file a.txt from an > external script which contains something like this: > /le

Re: retransfer fail of large files with inplace and broken pipe

2010-02-09 Thread Matt McCutchen
On Sun, 2009-12-13 at 07:21 +, tom raschel wrote: > i have to tranfer large files each 5-100 GB (mo-fri) over dsl line. > unfortunately dsl lines are often not very stable and i got a broken pipe > error. > (dsl lines are getting a new ip if they are broken or at least after a > reconnect ev

Re: Common memory usage questions

2010-02-09 Thread Matt McCutchen
On Tue, 2010-02-09 at 21:46 -0500, W. Michael Petullo wrote: > I have started investigating the memory usage of the rsync algorithm since > installing OpenWRT on a Linksys WRT160NL router with only 32MB of RAM. Wow, that's pretty tight. > Rsync consumes all of the memory on my router even when I

Re: Same hang with 3.0.7

2010-02-11 Thread Matt McCutchen
On Thu, 2010-02-11 at 20:38 -0500, Whit Blauvelt wrote: > I've had 2.6.9 running to sync a directory tree between two Ubuntu 8.04 LTS > systems for well over a year, every hour, without trouble until today. > Today, it runs through the whole tree, deletes, moves files over, then hangs > at the ver

Re: rsync'ing a directory with nothing but symlinks

2010-02-17 Thread Matt McCutchen
On Wed, 2010-02-17 at 16:37 -0300, Gerardo Herzig wrote: > Hi all. This looks like a common question. I want to backup a dir, in > which i put some symlinks, so it looks like > > machinegun:/tmp/daily_backup # ls -la > total 8 > drwxr-xr-x 2 root root 4096 2010-02-17 17:41 . > drwxrwxrwt 19 root

Re: Odd failure ... (Windows ACLs)

2010-02-17 Thread Matt McCutchen
On Mon, 2010-02-15 at 14:18 -0700, Ashley M. Kirchner wrote: > I'm trying to manually run the following rsync command on Win7 and > it's failing ... not sure why. > > > C:\"Program Files (x86)\cwRsync\bin\rsync.exe" -arupAv --progress > --partial --filter=". /cygdrive/c/Users/KirAsh/Desktop/fil

Re: old files not getting deleted

2010-02-17 Thread Matt McCutchen
On Sat, 2010-02-13 at 18:56 -0500, Charles Sprickman wrote: > I've been having a bear of a time tracking this down. I'm currently using > rsync to back a bunch of servers up to a ZFS pool on a server. I recently > noticed my deltas between ZFS snapshots seemed a bit large, so I started > looki

Re: rsync'ing a directory with nothing but symlinks

2010-02-17 Thread Matt McCutchen
On Wed, 2010-02-17 at 18:14 -0300, Gerardo Herzig wrote: > Matt McCutchen wrote: > > By default, the daemon chroots into the root directory of the module, > > which is causing the symlinks to be interpreted differently than you > > intend. Try setting "use chroot = no

Re: some file are not there

2010-02-20 Thread Matt McCutchen
On Sat, 2010-02-20 at 21:19 -0500, Marc Collin wrote: > rsync -a -r -v --delete --prune-empty-dirs --exclude-from=$EXCLUDES --include- > from=$INCLUDES $BDIR $DEST > > the file in the include.txt is not there > > any idea? The answer is the same as last time: http://lists.samba.org/archive/rsyn

Re: Rsync copies all files, not just changed files

2010-03-01 Thread Matt McCutchen
On Mon, 2010-03-01 at 15:35 -0800, Khalid J Hosein wrote: > I have a strange problem where rsync is copying over all files instead > of just the ones that have changed. http://rsync.samba.org/FAQ.html#2 Pass -i and see what shows up in the output. -- Matt -- Please use reply-all for most repl

Re: --progress (without file names)

2010-03-02 Thread Matt McCutchen
On Fri, 2010-02-26 at 15:00 +1300, Henri Shustak wrote: > I am wondering if there is an option which is similar to --progress > that will not display the file names. A percentage indicator would be > fine. See https://bugzilla.samba.org/show_bug.cgi?id=3784 . -- Matt -- Please use reply-all fo

Re: Common memory usage questions

2010-03-02 Thread Matt McCutchen
On Wed, 2010-02-10 at 11:34 +0100, Paul Slootman wrote: > On Tue 09 Feb 2010, Matt McCutchen wrote: > > > > The number of files that rsync tries to maintain in the active file > > lists at one time is controlled by {MIN,MAX}_FILECNT_LOOKAHEAD in > > rsync.h. I did

Re: copying differences to different directory

2010-03-02 Thread Matt McCutchen
On Tue, 2010-03-02 at 08:47 -0800, js_spamfree-rs...@yahoo.com wrote: > sorry for the confusing subject line. i couldn't think of a better way > to say it. > > i'm wondering if rsync can perform the following action: > > Compare contents of Directory A (master) to Directory B and copy any > diff

Re: --prune-empty-dirs option not doing the job

2010-03-03 Thread Matt McCutchen
On Wed, 2010-03-03 at 17:29 -0800, js_spamfree-rs...@yahoo.com wrote: > test command: > rsync -avm --del --prune-empty-dirs > --compare-dest=/Users/generic/Desktop/B /Users/generic/Desktop/A/ > /Users/generic/Desktop/C > > produces a large number of directories and nested directories on the > des

Re: --prune-empty-dirs option not doing the job

2010-03-03 Thread Matt McCutchen
On Wed, 2010-03-03 at 20:41 -0500, Matt McCutchen wrote: > On Wed, 2010-03-03 at 17:29 -0800, js_spamfree-rs...@yahoo.com wrote: > > test command: > > rsync -avm --del --prune-empty-dirs > > --compare-dest=/Users/generic/Desktop/B /Users/generic/Desktop/A/ > &g

Re: rsync 3.0.7 - error deleting directory

2010-03-06 Thread Matt McCutchen
[Going through old email.] On Fri, 2010-02-05 at 08:24 +0100, Philipp Herz - allied internet ag wrote: > based on a nightly cronjob we use "rsync --delete" to delete partitial > directory structure from a backup folder. Sometimes rsync is unable to > delete structure as told. > > rsync: unlink

Re: Excluding/Hiding a local, absolute path in 3.0.7

2010-03-06 Thread Matt McCutchen
[Going through old email. I wanted to confirm whether there was an rsync bug here.] On Wed, 2010-02-03 at 18:16 -0500, Ryan Flannery wrote: > The command I'm using is this: >rsync -avz --delete --delete-excluded --exclude-from=foo.txt /etc/ > $dest:path > > Where foo.txt contains either: >

Re: Force destination files to specific owner/group

2010-03-07 Thread Matt McCutchen
On Mon, 2010-03-01 at 14:01 -0800, Kyle Lanclos wrote: > The one thing I'm missing is the trivial ability to force the group > owernship of the destination files to a specific group. A read through > the manpage and various searches on the web do not turn up any helpful > hints in this regard. > >

Re: cwrsync and link-dest option

2010-03-16 Thread Matt McCutchen
On Mon, 2010-03-15 at 13:35 +0100, Stefan Agner wrote: > In a small environment I have to backup two servers, an Ubuntu 9.10 > and a Windows Server 2008 machine. My Backuphost is a Ubuntu 9.10 > machine as well. I installed rsync on both Ubuntu hosts from > repository (3.0.6) and cwrsync from

Re: mkstemp error (only a problem with newer rsync versions)

2010-03-16 Thread Matt McCutchen
On Mon, 2010-03-08 at 09:45 +1300, Henri Shustak wrote: > The setup... > > Transport is via SSH. > BoxA : Ubuntu 8.10 > BoxB : Mac OS X 10.4.11 > > If I use rsync v2 to transfer data from BoxA to BoxB everything works > fine. However, if I use rsync v3 to t

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 15:05 -0700, Bruce Korb wrote: > Please forgive my digging up a two year old thread, but I've got the > same problem, but the pointers there give no help. This is using > versions 3.0.6 (server) and 3.0.7 (client). > > Unfortunately, I have to type the client stuff in by han

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 15:50 -0700, Bruce Korb wrote: > Without the "-e ssh" I was getting no response at all. tcpdump wasn't showing > any port 873 packets, but port 22 was getting through the vyatta virtual > switch. > So, "-e ssh", though I'd actually like to get the daemon working > correctly

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:15 -0700, Bruce Korb wrote: > On Tue, Mar 23, 2010 at 3:57 PM, Matt McCutchen > wrote: > >> $ ls -l > ... > >> -rw-r--r-- 1 root root 2451 2010-03-23 15:30 log.txt > > Oops. Fixed. Still root owned, but mode is no

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:18 -0700, Bruce Korb wrote: > does the "-e ssh" invocation of rsync actually load up rsyncd.conf ? The double-colon source or destination path indicates the use of an rsync daemon (which uses an rsyncd.conf file). The explicit "-e ssh" tells the client to invoke the daemo

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 16:54 -0700, Bruce Korb wrote: > I now have an strace output file. It opens rsyncd.conf correctly > and reads in all the data in one gulp. I've trimmed the strace to start from > there. Notice that it tries to open the log file and fails because it > isn't found. That fail

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 17:05 -0700, Bruce Korb wrote: > On Tue, Mar 23, 2010 at 4:59 PM, Matt McCutchen > wrote: > > On Tue, 2010-03-23 at 16:54 -0700, Bruce Korb wrote: > >> I now have an strace output file. It opens rsyncd.conf correctly > >> and reads in a

Re: rsync: connection unexpectedly closed (0 bytes received so far)

2010-03-23 Thread Matt McCutchen
On Tue, 2010-03-23 at 17:12 -0700, Bruce Korb wrote: > Fixing a spelling error for the log file name gets me the log text, > but not anything I understand: > > Unknown filter rule: `/gdoc/***' > > OK, I am trying to ensure that files pushed to the "doc" module all start > with the prefix "/gdoc/

Re: Incremental recursion not working

2010-03-23 Thread Matt McCutchen
On Mon, 2010-03-22 at 14:40 +0100, Gerald Holl wrote: > I'm using rsync 3.0.3 over ssh to sync data between two hosts. I can't > get the incremental recursion working: > rsync -vLogtprz --progress --delete --delete-during --partial -e "ssh -p > 1234" --numeric-ids u...@host /local/dir/ > > The d

Re: rsync maximum size limit

2010-03-23 Thread Matt McCutchen
On Wed, 2010-03-17 at 14:30 -0500, Ramesh Basukala wrote: > Is there any way in rsync that allows me to trasfer certain amount of > files? > > For Example: > > My total directory/folder (/var/tmp/testFolder ) size is 800MB and I > want to sync only 200MB of files at other server, whichever file w

Re: cwrsync and link-dest option

2010-03-23 Thread Matt McCutchen
On Wed, 2010-03-17 at 20:46 +0100, Stefan Agner wrote: > Is there a way to get permissions working correctly? Does it work when > I have the users from Windows in my passwd? I must admit that the > backup pc is not (yet) connected to the Active Directory (e.g. using > samba to authenticate at

Re: writefd_unbuffered failed - Broken pipe on local rsync

2010-03-23 Thread Matt McCutchen
On Wed, 2010-03-10 at 11:58 +, Dave Howorth wrote: > I'm seeing an error that says there is a broken pipe, but the rsync > command is local to one machine: > > /usr/bin/rsync -rltH --stats -D --delete --numeric-ids --whole-file > /data/dir /backup/suse1/suse1-data-dir/ >/tmp/rsync-out 2>&1 >

Re: Specify Includes Only

2010-03-23 Thread Matt McCutchen
On Sun, 2010-03-14 at 14:23 +, Paul wrote: > On Sat, Mar 13, 2010 at 08:03:05PM -0800, Steven Monai wrote: > >$ cat >dirs.txt < >sourcedir/GroupA > >sourcedir/GroupC > >EOF > > > >$ rsync -r --include-from=filt.txt --prune-empty-dirs `cat dirs.txt` destdir > I can't quite get that to work when

Re: --delete question.

2010-03-24 Thread Matt McCutchen
On Wed, 2010-03-24 at 12:10 +0530, Satish Shukla wrote: > Please advise on rsync usage. --delete doesn’t work without > recursion(--recursion). The recursion is causing huge overheads for > me. My directory trees are huge. Any suggestions through which I can > cut overheads. It used to work well

Re: rsync give option mkdir -p

2010-03-31 Thread Matt McCutchen
On Fri, 2010-03-26 at 02:12 +0300, Alex wrote: > how i can use rsync whith mkdir -p for nackup dirs ? > > when i use rsync / /backup/month/day > > i need automatic creation month and day dirs. > > mkdir -p can do that, but rsync can't https://bugzilla.samba.org/show_bug.cgi?id=4621 -- Mat

Re: osx 10.6 strange rsync errors

2010-04-05 Thread Matt McCutchen
On Sat, 2010-04-03 at 18:12 -0400, Robert DuToit wrote: > I have been getting reports from users of backuplist+, my wrapper > application for rsync (currently with build of 3.0.6), about odd > behavior after updating to OS 10.6 Snow Leopard. > > Basically: the problem occurs backing up a directory

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 13:57 -0500, Randall Cotton wrote: > This works as expected (a hard link is made) > rsync -a --link-dest=../a.1 a/ b/a > This does not (a copy is made instead of a hard link) > rsync -a --link-dest=a.1 a b Not a bug. The --link-dest argument needs to be given relative to

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 16:38 -0500, Randall Cotton wrote: > - Original Message - > From: "Matt McCutchen" > To: "Randall Cotton" > Cc: > Sent: Monday, April 05, 2010 4:16 PM > Subject: Re: This is a bug, right? (--link-dest) > > > : On

Re: This is a bug, right? (--link-dest)

2010-04-05 Thread Matt McCutchen
On Mon, 2010-04-05 at 21:19 -0500, Randall Cotton wrote: > - Original Message - > From: "Matt McCutchen" > To: "Randall Cotton" > Cc: > Sent: Monday, April 05, 2010 4:47 PM > Subject: Re: This is a bug, right? (--link-dest) > > > : On

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-14 Thread Matt McCutchen
On Thu, 2010-04-15 at 00:21 +0100, Stuart Ramdeen (Toucan) wrote: > I have also noticed this error. In my particular scenario ACL > preservation is not essential, but what concerns me is that rsync > appears to skip an entire folder that has an invalid ACL. Therefore > none of the actual data is ba

Re: Mac OS X "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)"

2010-04-14 Thread Matt McCutchen
On Fri, 2010-04-09 at 11:12 +1200, Henri Shustak wrote: > An LBackup user recently posted a question to the mailing list asking about > the following error. > > > "rsync: unpack_smb_acl: sys_acl_get_info(): Unknown error: 0 (0)" > Is it possible to place a feature request to have the error repor

Re: rsync over ssh - possible attack vectors

2010-04-16 Thread Matt McCutchen
On Fri, 2010-04-16 at 02:16 +0200, George Sullivan wrote: > us...@localserver:$ rsync -rtcve ssh us...@remoteserver:/.../ /local/.../ > But what I'm interested in is what happens if remoteserver > is compromised? > Could attacker X on > remoteserver alter the rsync binary in such a way so it can

Re: Risk of corrupting open sources files

2010-04-16 Thread Matt McCutchen
On Thu, 2010-04-15 at 17:41 -0700, Mohammed AlQuraishi wrote: > I have a situation where the files I'm backing up are written to every > fifteen minutes or so. There's a good possibility that rsync will try > to copy a file while it is being written into, and I'm wondering if > there's any risk tha

Re: rsync over ssh - possible attack vectors

2010-04-16 Thread Matt McCutchen
On Sat, 2010-04-17 at 02:17 +0200, g. sullivan wrote: > On 4/16/2010 4:30 PM, Matt McCutchen wrote: > > On Fri, 2010-04-16 at 02:16 +0200, George Sullivan wrote: > >> us...@localserver:$ rsync -rtcve ssh us...@remoteserver:/.../ /local/.../ > > > The remote server ca

Re: rsync with --link-dest=DIR

2010-04-18 Thread Matt McCutchen
On Sun, 2010-04-18 at 16:57 +0200, Martin wrote: > When using --link-dest=DIR with DIR on the startup volume everything > works fine. > If DIR is a volume on an external drive many files are copied instead > of creating hard links. > hardlinks are create e.g. fom .jpg files and from .rtf files but

Re: on remote machine: --remove-source-files: unknown option

2010-04-22 Thread Matt McCutchen
On Thu, 2010-04-22 at 12:53 -0400, N. Yaakov Ziskind wrote: > I'm trying to sync from 3.0.5 to 2.5.5 (SCO, *sigh*) The source > machine errors out b/c the --remove-source-files (or > --remove-sent-files) options don't exist on 2.5.5. > > But, since these option are only acted on by the sending ma

Re: rsync with forced-command ssh and variable files

2010-04-26 Thread Matt McCutchen
On Mon, 2010-04-26 at 17:36 -0400, Alex wrote: > I had asked a variation on this some time ago, but am trying to do > something a bit different this time. I'd like to sync a file with a > remote host using ssh and a command= ssh key, like this in > ~/.ssh/authorized_keys: > > command="/usr/bin/rsy

Re: rsync with forced-command ssh and variable files

2010-04-26 Thread Matt McCutchen
On Mon, 2010-04-26 at 22:33 -0400, Alex wrote: > > My answer is the same as last time: don't override the rsync server > > command, instead use an rsync daemon. > > Thanks for the follow-up :-) > > There is a firewall involved, and it's over an unsecured network, so > I'm not sure using just the

Re: Rsync on a single server

2010-04-27 Thread Matt McCutchen
On Tue, 2010-04-27 at 19:48 -0700, Legionnaire1 wrote: > I can only assume everything new/changed was copied as I now need the mysql > database copied from one domain to the other. Is it possible to copy the > mysql database using rsync on the /mysql/mydomain to /mysql/myotherdomain or > do I have

Source directory without a trailing slash

2010-04-28 Thread Matt McCutchen
On Wed, 2010-04-28 at 22:24 +1000, David Schoen wrote: > Also when I use rsync I like to put slashes on the end of all paths as > it works closer to the way you're thinking, e.g.: > rsync -av /path/to/source/directory/ /path/to/destination/directory/ > > other wise you will probably end up with tw

Re: Device not configured (explanation)

2010-04-29 Thread Matt McCutchen
On Fri, 2010-04-30 at 13:32 +1200, Henri Shustak wrote: > > rsync: read > > "/Volumes/Drobo_HD/lbackups/theserver.Homes/Section.0/Faculty/andrewmac/.DS_Store": > > Device not configured (6) > > I am curious to know if anyone else has seen this error on Mac OS X. > In addition, is any one able to

Re: Count of files to be transferred

2010-04-29 Thread Matt McCutchen
On Fri, 2010-04-30 at 12:13 +0700, Ryan Joseph wrote: > I'm making a GUI for rsync and having some problems getting a reliable > indication of the files that will be transferred (so I can make a > progress bar from the results). I didn't see rysnc offered this so my > plan has been to get a list of

Re: Count of files to be transferred

2010-04-30 Thread Matt McCutchen
On Fri, 2010-04-30 at 14:21 +0700, Ryan Joseph wrote: > On Apr 30, 2010, at 12:54 PM, Matt McCutchen wrote: > > Rsync determines which of the files in the file list need a data > > transfer as it goes, so the only way to get the count in advance is to > > do a separate dry

Re: rsync failure quoting incorrect directory

2010-05-21 Thread Matt McCutchen
On Fri, 2010-05-21 at 13:31 +0100, e-letter wrote: > Command terminal output: > > $ rsync -rv * -e ssh u...@pathtoremotemachine > sending incremental file list > rsync: mkdir "/localmachine/path/to/home/u...@pathtoremotemachine" > failed: No such file or directory (2) > rsync error: error in file

Re: rsync via restricted ssh command=

2010-06-03 Thread Matt McCutchen
On Thu, 2010-06-03 at 20:18 +1000, Mark Constable wrote: > I've read a few tutorials about how to use rsync via ssh using the > command= functionality to restrict where the user can sync to. I've > got this on the on the destination side in it's ~/.ssh/authorized_keys... > > command="rsync --serve

Re: Complex include/excludes with rsync?

2010-06-11 Thread Matt McCutchen
On Thu, 2010-06-10 at 19:16 -0400, Brian Mathis wrote: > I'm trying to use rsync filters to achieve the following result: > > Include / > Exclude /home > Include /home/user1 > > I've been doing a lot of experimentation and at this point I'm just > staring at the man page. Rsync filters seem to b

Re: RERR_PARTIAL exit status

2010-06-18 Thread Matt McCutchen
On Thu, 2010-06-17 at 13:46 -0600, Keith Hellman wrote: > I recently changed my backup script to invoke with rsync w/ -v -v and store > the output to (yet another) log file. After a nightly backup I looked > at the results, and: > > 1. removed all the lines ending in ' is uptodoate$' > 2.

Re: few questions on rsync

2010-06-22 Thread Matt McCutchen
On Tue, 2010-06-22 at 13:59 +0200, Igor Lautar wrote: > Different filesystems: > Lets say I want to keep all extended attributes and everything else, > so I use -A, -X, --perms etc., together with --fake-super. > Now, lets say source FS supports some attributes not supported on > target FS (for exa

Re: where is backup-dir rooted?

2010-06-22 Thread Matt McCutchen
On Tue, 2010-06-22 at 18:12 +0100, Alan Chandler wrote: > if I have > > rsync -a --delete --backup --backup-dir=/some/backup/path > /path/to/my/files/ another-machine::module/my/backup/ > > where is /some/backup/path rooted? if is was instead some/backup/parth > (without the leading slash) wher

Re: How to skip deletion of files which are newer on the receiver?

2010-06-29 Thread Matt McCutchen
On Tue, 2010-06-29 at 11:04 +0200, Mike Reiche wrote: > I try to create a duplex sync between client/server via two rsync calls. Don't do that. Use unison (http://www.cis.upenn.edu/~bcpierce/unison/) instead. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing lis

Re: "Cannot delete non-empty directory"/"Operation not permitted" with file-creation on target-server

2010-07-14 Thread Matt McCutchen
On Wed, 2010-07-14 at 09:35 +0200, Carsten Deibert wrote: > I was searching for an answer myself for quite some time without success, so > I hope somebody can clarify...I use rsync to sync webcontent from one server > to another. > > Apache-details: > > * Apache runs as nobody:nogroup. > * Sour

Re: Behavioral differences between versions.

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 12:42 -0600, Jeff Cleverley wrote: > Am I correct in my assumption that Redhat does not tweak the rsync it > ships with its distribution? The way to find out is to ask Red Hat or look in their SRPMs. Choose either client or server (they seem to be the same in this case--are

Re: Problem backing up read-only files

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 19:57 -0700, Gary Johnson wrote: > On 2010-07-23, Alex Ferrara wrote: > > Hi Gary, > > > > It looks like the problem occurs after rsync has transferred the > > file and is renaming the temporary file to the actual name. I am > > guessing that the HP media vault has Samba runn

Re: Behavioral differences between versions.

2010-07-22 Thread Matt McCutchen
On Thu, 2010-07-22 at 21:50 -0600, Jeff Cleverley wrote: > I've found Red Hat often slow and difficult to get an answer from. That's not our problem. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/m

Re: --ignore-exisiting criteria?

2010-07-28 Thread Matt McCutchen
On Wed, 2010-07-28 at 10:16 -0700, fjaccarino wrote: > I've been hunting on the web but I can't seem to find what the definition > that is used when using the "--ignore-existing" option of RSYNC. Would > anyone happen to know what exactly is the criteria used to ignore files? Is > it name only?

Re: --ignore-exisiting criteria?

2010-07-28 Thread Matt McCutchen
d, Jul 28, 2010 at 9:32 PM, Matt McCutchen wrote: > > > On Wed, 2010-07-28 at 10:16 -0700, fjaccarino wrote: > > > I've been hunting on the web but I can't seem to find what the definition > > > that is used when using the "--ignore-existing" opt

<    1   2   3   4   5   6   7   8   9   10   >