Re: Strangely fast run without error

2014-01-06 Thread John Van Essen
On Jan 06, 2014, at 04:14, Fabian Cenedese wrote: > sent 63 bytes received 2425 bytes ,')* bytes/sec A! Squinty Blackbeard approves of this transfer speed, mateys! John -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: htt

Re: --delete not working

2012-03-12 Thread John Van Essen
Aren't you missing something in your rsync command? (Hint: subject line) John On Mar 12, 2012, at 14:00, Salatiel Filho wrote: > Hi guys , i need some help. I am trying to make a full sync of two of > my servers. But i noticed a very odd thing. > If i create a directory , for example > /u

Re: bwlimit on rsync locally

2008-03-30 Thread John Van Essen
On Fri, 28 Mar 2008, Reeve Yang <[EMAIL PROTECTED]> wrote: > Is there anyway to make rsync use direct I/O bypassing FS buffer? I'm not an expert on that by any means, but AFAIK, rsync supports that only via this patch: http://rsync.samba.org/ftp/rsync/patches/drop-cache.diff (You'll have to co

Re: bwlimit on rsync locally

2008-03-27 Thread John Van Essen
On Thu, 27 Mar 2008, Reeve Yang <[EMAIL PROTECTED]> wrote: > Does "bwlimit" option really work on rsync locally? Yes, it does. > rsync without --bwlimit: >> iostat; rsync -a -r --stats swapfile swapfile.rsync; iostat > sent 2147745923 bytes received 42 bytes 23472633.50 bytes/sec > ry

Re: rsync: Please add an option to ignore vanished files

2008-03-10 Thread John Van Essen
ot; messages actually help pinpoint directories whose contents should be excluded, in this case via --exclude=/drbd/var/www/tmp/* Also, if you want, you can also check the exit code within a script and treat value 24 the same as a 0 (e.g. no extra warnings about failure). John Van Essen -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: moderation?

2007-09-09 Thread John Van Essen
On Wed, 5 Sep 2007, Matt McCutchen <[EMAIL PROTECTED]> wrote: > On 9/5/07, Martin Schr�der <[EMAIL PROTECTED]> wrote: >> That didn't stop the asian spam... :-( > > I guess the sender of that spam subscribed to the list first? > Requiring a captcha for subscription may stop it from happening again.

Messages from Bugzilla not appearing on rsync list

2007-03-25 Thread John Van Essen
I posted a comment to bug 4402 a few days ago and it never appeared on the rsync mailing list. In the past, bugzilla posts automatically got emailed to the rsync list. The mailing list archive shows that the last message from bugzilla was received by the mailing list on Feb 25. Since then, these

Re: copy symbolic links as real file during syncing files.

2006-11-12 Thread John Van Essen
On Mon, 13 Nov 2006, <[EMAIL PROTECTED]> wrote: > > I want to sync one big directory from one host to a remote host. > And there are several symbolic links which linked to some files > and directories that outside the certain directory. I want to > copy the symbolic links as real file or directory

Re: strange error when run from cron

2006-10-30 Thread John Van Essen
On Tue, 31 Oct 2006, Jason Cox <[EMAIL PROTECTED]> wrote: > Hi all, > I have the following in a cron job > /usr/bin/rsync -ub --suffix=~$(date +%F) /Data/Jobs/ /Data/Backups/Jobs/ > -razv --no-whole-file --ignore-errors partial > > Problem is that when the command is run on th

Re: $RSYNC EXIT STATUS

2006-10-13 Thread John Van Essen
On Thu, 12 Oct 2006, Grignon Mickaël <[EMAIL PROTECTED]> wrote: > Hi, > > I would like to know if there is a list of the different values > for the $rsync_exit_status. See the "EXIT VALUES" section toward the end of the man page, which is also online in HTML form at: http://rsync.samba.org/ft

Re: rsync option for continuing event i/o errors occured on remove server

2006-05-18 Thread John Van Essen
On Wed, 17 May 2006, Gabriel CORRE <[EMAIL PROTECTED]> wrote: > > Recently I had a corrupted file on the files-server and rysnc crash, > and don't continue to backup the rest of files. > write failed on user/path/to/corrupted/file.html : Success > rsync version 2.5.6cvs protocol versio

Re: Rsync 4TB datafiles...?

2006-05-18 Thread John Van Essen
On Wed, 17 May 2006, lsk <[EMAIL PROTECTED]> wrote: > > So this shows that RSYNC performs faster when there is no datafile is > present. For Oracle datafiles the diff algorithm doesn't work even with the > patch. Literally it should have taken less than 12 min to just compare and > update the head

Re: how to tell what files changed?

2006-04-06 Thread John Van Essen
On Wed, 5 Apr 2006, Erik Neumann <[EMAIL PROTECTED]> wrote: > Seems that many of the files I just transferred from Windows to > Mac OS X came across with ***blank creation dates***. Egad - rsyncing between different OSes and neither OS is *nix. That's pretty rare. Although Mac OS X is technicall

Re: how to tell what files changed?

2006-04-04 Thread John Van Essen
On Tue, 4 Apr 2006, Erik Neumann <[EMAIL PROTECTED]> wrote: > I'm new to using rsync, so far it is working well. But I want to > know what files rsync decided to transfer. Using the -v option lists > every sub-folder of my directory and lots of files. It sounds like you are not preserving t

Re: error in protocol stream

2006-03-23 Thread John Van Essen
On Wed, 22 Mar 2006, David Bear <[EMAIL PROTECTED]> wrote: > I am trying to use the syntax: > > rsync -av -e "ssh -l ssh-user" [EMAIL PROTECTED]::module /dest > > found at http://rsync.samba.org/ftp/rsync/rsync.html > There is an rsync daemon running on rhost.asu.edu and that has a > module n

Re: Using rsync to syncronize two unmounted disk partitions

2006-03-20 Thread John Van Essen
On Fri, 17 Mar 2006, Antonio Arauzo Azofra <[EMAIL PROTECTED]> wrote: > > Thanks to your message I did a new test, and it seems > rsyncs allows this: > > rsync /dev/hda9 > > I have hanged the device testing to overflow it, but it seems it works. > (I haven't tested much yet) Just because r

Re: Problem with --partial and rsync algorithm

2006-03-12 Thread John Van Essen
On Sun, 12 Mar 2006, Matias Surdi <[EMAIL PROTECTED]> wrote: > I'm running the following command for a remote host backup: > > /usr/local/bin/rsync -a --delete --delete-excluded -v --timeout=120 -z > --no-whole-file -partial --partial-dir .rsync-partial --exclude=/sys/* [ snip ] BTW, you are usin

Re: Malformed Address and Private IP issue

2006-03-08 Thread John Van Essen
On Thu, 9 Mar 2006, <[EMAIL PROTECTED]> wrote: > Date: Wed, 8 Mar 2006 17:15:36 -0800 > From: Wayne Davison <[EMAIL PROTECTED]> > > On Wed, Mar 08, 2006 at 01:48:37PM -0800, Jonathan Chen wrote: > > 2006/03/08 11:25:12 [16976] malformed address localhost.localdomain > > That c

RE: Malformed Address and Private IP issue

2006-03-07 Thread John Van Essen
On Mon, 6 Mar 2006, Jonathan Chen <[EMAIL PROTECTED]> wrote: > After further investigation, I've found eth1(private ip) uses the same > gateway as eth0(INET ip). The gateway ip is an INET ip which might > explain why I am getting malformed address??? In the OLDNEWS file: NEWS for rsync 2.6.0 (

Re: Dynamic hash table size (with static has load)

2006-02-27 Thread John Van Essen
On Sun, 26 Feb 2006, Wayne Davison <[EMAIL PROTECTED]> wrote: > > This would be such an improvement for really large files that I'm > considering putting this into 2.6.7pre3. However, I want to be sure > that it is in rock-solid shape first. If anyone wants to help with the > testing and/or the

Re: How to hide the file name listings, but still see the stats?

2006-02-07 Thread John Van Essen
On Tue, 7 Feb 2006, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Tue, Feb 07, 2006 at 02:32:22PM -0500, Daniel Rawson wrote: >> I am indeed using --dry-run (well, -n, but ...). That must be it! > > I'm changing this for 2.6.7, as I want the output of -n to be closer > to what rsync would output

Re: high cpu usage of rsync process - sometimes (extremely wired)

2006-02-07 Thread John Van Essen
On Tue, 7 Feb 2006, Sebastian Schwerdhoefer <[EMAIL PROTECTED]> wrote: > Hello, > > i have two clients (c1 and c2) with 100% same hard- and software and > also two servers (s1 and s2) with 100% same hard- and software. The > servers run "rsync --daemon", the clients start rsync periodically to > s

Re: rsync error help required

2006-01-05 Thread John Van Essen
On Thu, 5 Jan 2006, gg gg234 <[EMAIL PROTECTED]> wrote: > Hi John, > > Thanks for your reply > > I have check that and i try to run ssh 172.29.5.130 /bin/true > out.dat > and i got the out.dat file with only text inside is Rejected If rsync is seeing that "Rejected" that explains the error. T

Re: rsync error help required

2006-01-05 Thread John Van Essen
On Thu, 5 Jan 2006, gg gg234 <[EMAIL PROTECTED]> wrote: > > protocol version mismatch -- is your shell clean? > (see the rsync man page for an explanation) So... Did you look at the man page? Searching for "clean" brings you to the DIAGNOSTICS section, which explains what the problem is and ho

Re: Illustration showing the rsync SRC and DEST args

2005-12-29 Thread John Van Essen
On Thu, 29 Dec 2005, John Van Essen <[EMAIL PROTECTED]> wrote: > > 1. You cannot list files other than via a daemon module, so the >4x4 grid's bottom row rightmost two squares should be empty. Oops. You cannot list a local directory is all. Remote non-daemon listings a

Re: Illustration showing the rsync SRC and DEST args

2005-12-29 Thread John Van Essen
On Wed, 28 Dec 2005, David Tonhofer <[EMAIL PROTECTED]> wrote: > > I was somewhat confused by the rsync options, so I have > decided to do a little illustration showing the possible > SRC and DEST args. Feel free to use the diagram as you like. > (This includes critizing): > > http://rei1.m-plify

Re: rsync to a SOHO NAS copies files everytime

2005-12-29 Thread John Van Essen
On Thu, 29 Dec 2005, Savage, Elijah <[EMAIL PROTECTED]> wrote: > > I am trying to use a SOHO NAS to rsync my music dir to. Every time I run > the command it copies the entire dir and files each time. ... > I am using FreeBSD 5.4 with the latest port build and I run the command > below to try and

Re: [Fwd: Apache as a Rsync HTTP proxy]

2005-12-27 Thread John Van Essen
Vincent, I don't see any problems with what you have. I have no experience with using a proxy like this, and I can find no description of how all this works together, either. So I have to punt. Sorry. Hopefully, someone else on the rsync mailing list can help you with further suggections.

Re: Very large memory block.

2005-12-27 Thread John Van Essen
On Wed, 21 Dec 2005, Dave Mielke <[EMAIL PROTECTED]> wrote: > Using rsync-2.6.6, I'm getting: > >unable to alloc 417794083 bytes > > Under what circumstances would rsync allocate a block that large? Must it be > able to allocate a block as large as the largest file or something? Is there a >

Re: [Fwd: Apache as a Rsync HTTP proxy]

2005-12-20 Thread John Van Essen
Vincent, Thanks for the additional info. "the problem is always happening" is different from "sometimes" that you used in your original email. The idle rsync processes implies that Apache is closing the channel on its own. So... What is the command that you use to run the rsync client? What e

Re: rsync deleting symbolic link unexpectedly

2005-12-20 Thread John Van Essen
Eric, --keep-dirlnks was added in version 2.6.3, so it's available in 2.6.6 (but both ends have to be 2.6.3 or later). Here's an online version of the current man page: http://rsync.samba.org/ftp/rsync/rsync.html --keep-dirlinks (-K) is definitely what you need... John On Tue, 20 Dec 2

Re: [Fwd: Apache as a Rsync HTTP proxy]

2005-12-20 Thread John Van Essen
> Subject: Apache as a Rsync HTTP proxy > From:"Vincent Blondel" <[EMAIL PROTECTED]> > Date:Mon, December 19, 2005 18:46 > To: users@httpd.apache.org > > Hi all, > > Recently I had to set-up our external http proxy (apache 1.3.x) > in such a way that it accepts rsync traffic coming f

Re: rsync exit 0 before transfer complete

2005-12-20 Thread John Van Essen
On Sat, 17 Dec 2005, Donna Livingstone <[EMAIL PROTECTED]> wrote: > > See below a snippet of the code I am using : > >if [ ! -s $file ] > then ># File does not exist or is non-zero >echo "file $file does not exit or is 0 size" >> $LOGFILE > fi >

Re: rsync server does not read /etc/rsync.conf

2005-12-18 Thread John Van Essen
David, I hope you read Wayne's reply (included below). Your command shows that you are using remote-shell syntax (single colon). Therefore the /etc/rsyncd.conf file will not be read since that is read only by an rsync daemon. Daemon-mode syntax uses a double-colon. Since rsync uses ssh (rsh pri

Re: Human readable output

2005-11-14 Thread John Van Essen
On Sat, 12 Nov 2005 12:12:28 -0800, Wayne Davison <[EMAIL PROTECTED]> wrote: > > The CVS version now has the options --human-readable (-m) and --si to > implement more human-reable output in the --stats and the end-of-run > summary. Anyone wanting to be able to use -h instead of -m (to make the >

Re: why each time I do a file sync, it showed me that a file trasnfers is occured

2005-10-24 Thread John Van Essen
On Mon, 24 Oct 2005, Adrian Mak <[EMAIL PROTECTED]> wrote: > > rsync --progress --verbose --stats --recursive > [EMAIL PROTECTED]::test /home/test2 --stats > > but each time it showed me files are being transfer but actually the > files is not changed or updated any. Since you are using --recurs

Re: rsync newbie

2005-09-13 Thread John Van Essen
On Tue, 13 Sep 2005, Scott Miller <[EMAIL PROTECTED]> wrote: > My problem: I keep getting the following error and can't find much > info on it, or how to fix it: > > rsync: read error: connection reset by peer > rsync error: error in rsync protocol data stream (code 12) at io.c(177) > > I've

Re: Problem with exclusion pattern

2005-08-06 Thread John Van Essen
On Sat, 06 Aug 2005, ptitoliv <[EMAIL PROTECTED]> wrote: > Hello everybody, > > I have a little problem using patterns with exclude instruction. I want > to rsync all my /home excluding all subdirectories "logs" ans "stats". > So I used the instruction --exclude */logs/* --exclude */stats/* to > i

Re: Problem preserving user/group names on AIX, rsync 2.6.2

2005-08-06 Thread John Van Essen
On Sat, 6 Aug 2005, Aaron Morris <[EMAIL PROTECTED]> wrote: > On 8/5/05, Bob Hutchinson <[EMAIL PROTECTED]> wrote: >> On Friday 05 Aug 2005 07:09, Aaron Morris wrote: >> > I am having a bit of a problem with rsync 2.6.2 on AIX and I was >> > wondering if this might just be the expected behavior. >>

Re: problem syncing files on RAM in embedded device

2005-06-13 Thread John Van Essen
On Fri, 10 Jun 2005, Vijay Ram.C <[EMAIL PROTECTED]> wrote: > > i am working on an networking product which has a 32 MB flash memory > and a 64MB RAM. > i need to sync a file named appl.gz which is of size 3.1MB from a unit > with ip 192.168.10.1 to a unit with ip 192.168.10.2. > the rsync is cal

Re: Cannot Allocate Memory

2005-06-12 Thread John Van Essen
On Tue, 7 Jun 2005, Max Kipness <[EMAIL PROTECTED]> wrote: > > I've just upgraded to 2.6.5. > > On a new set of servers I'm trying to sync I seem to be running into a log > of memory allocation errors. > > With some of the servers, I start the rsync session, and it counts so many > files and the

Re: source side

2005-06-11 Thread John Van Essen
t;ro" to your mount options and see if that makes the problem go away. Other than that, I have no further help for you. Sorry. Maybe someone with smbfs/NetApp experience can offer more advice. John > John Van Essen wrote: >> In your original "timestamps" thread back

Re: source side

2005-06-11 Thread John Van Essen
In your original "timestamps" thread back on May 25: http://www.mail-archive.com/rsync@lists.samba.org/msg13496.html you said the source is a "windows share from a NetApp filer" that is mounted on a RHEL3 box via: mount -t smbfs -o username=user,password=pwd //server/share /backup/sync Your

Re: @ERROR: auth failed on module

2005-06-07 Thread John Van Essen
On Tue, 7 Jun 2005, <[EMAIL PROTECTED]> wrote: Thanks for the detail in your report. Error messages, log messages, config files all in one email. :) > /var/log/rsyncd.log on ServerB > > 2005/06/07 11:29:24 [22075] rsyncd version 2.6.0 starting, listening on port > 873 > 2005/06/07 11:29:35 [2

Re: How to --exclude /usr/ but --include /usr/local/ ?

2005-06-06 Thread John Van Essen
On Mon, 6 Jun 2005, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Sun, Jun 05, 2005 at 11:28:08PM -0500, Larry Alkoff wrote: >> In looking at man rsync, it does not appear to both >> --exclude /usr/ and --include /usr/local/ > > Correct, you can't exclude /usr and still get to /usr/local. What yo

Re: Log Summary

2005-05-28 Thread John Van Essen
On Sat, 28 May 2005, dan tran <[EMAIL PROTECTED]> wrote: > > Hello every one, I would like to understand the summary of my sync log (below) > > > sent 2268 bytes received 1674253 bytes 372560.22 bytes/sec > total size is 301413395 speedup is 179.79' > > > Does mean my received rate is ~ 37

Symlink options (was Mysterious (bogus?) rsync(d) errors ...)

2005-05-20 Thread John Van Essen
On Thu, 19 May 2005, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Thu, May 19, 2005 at 09:15:01AM -0700, Josh Berkus wrote: >> John, Wayne, > > :-) Howdy, pardner... Heh heh heh. :-D > Previously rsync was skipping the symlinks because you didn't specify > --links, so --safe-links had no effe

Re: Mysterious (bogus?) rsync(d) errors -- (code 23) at main.c(1045)

2005-05-18 Thread John Van Essen
On Wed, 18 May 2005, Josh Berkus wrote: > >> Which version of rsync are you using (on source and target)? > > rsync version 2.5.7 protocol version 26 > Copyright (C) 1996-2002 by Andrew Tridgell and others > > Capabilities: 64-bit files, socketpairs, hard links, symli

Re: Mysterious (bogus?) rsync(d) errors -- (code 23) at main.c(1045)

2005-05-18 Thread John Van Essen
would help. Which version of rsync are you using (on source and target)? What is the output of "ls -ld /pgdata" on both machines? I suspect that on the target it was created with non-postgres userid. What is the output of "ls -l" for the two "non-regular" files? --

Re: problem to exclude

2005-05-18 Thread John Van Essen
NetBSD.org/NetBSD/ ${LL}netbsd-ftp/ > - - - - - - - - - - You have a typo there that explains why the excludes aren't working. Insert an echo $CMD to see what command you are actually executing. -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or

Re: rsync: mkstemp failed: No such file or directory (2)

2005-05-14 Thread John Van Essen
t removing the --delete-after from your restore rsync since there shouldn't be anything to delete on a new partition. You should try to discover why mkstemp is using /tmp to solve it once and for all. -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or c

Re: [Bug 2583] New: rsync fails with "authentication failure"

2005-04-10 Thread John Van Essen
On Sat, 9 Apr 2005, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Sat, Apr 09, 2005 at 06:08:32AM -0500, John Van Essen wrote: >> So there's yet another case of an upgrade to FC 3 causing an auth problem. > > Another? Did I miss something? Or are you referring to

Re: [Bug 2583] New: rsync fails with "authentication failure"

2005-04-09 Thread John Van Essen
g12745.html "Re: rsync crashing under centos 4" http://www.mail-archive.com/rsync@lists.samba.org/msg12815.html "Re: Anonymous rsync + chroot + LDAP" http://www.mail-archive.com/rsync@lists.samba.org/msg12709.html Hope that helps. Maybe this issue needs to be added to the

Web page link to latest changes in CVS (NEWS file)

2005-04-07 Thread John Van Essen
acked/rsync/NEWS People who are reporting a problem with 2.6.4 can then immediately see if their problem has already been addressed. -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Bef

Re: mkstemp fails but data still transferred

2005-03-22 Thread John Van Essen
o way to tell the sender to stop sending file content when there is a problem, and must accept and discard the remainder of the file (which is what you are seeing). Subsequent file transfers might be successful, so it can't abort, yet. Hope that helps. -- John Van Essen Univ of Minn.

Re: exclude problem

2005-03-21 Thread John Van Essen
etc --exclude=/* --exclude-from=sys_dont_replicate.list -e ssh [EMAIL PROTECTED]:/ / Then just remove the extra --include and --exclude when you are ready to test the whole hierarchy. -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: h

Re: CLUE:Fairly mysterious rsync problem.

2005-03-14 Thread John Van Essen
l fails, then please include: - Current listing of rsyncd.conf (you're obviously no longer using /tmp if you've been futzing with its permissions...) - output of ls -la for the receiving directory -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]>

Re: rsync crashing under centos 4

2005-03-11 Thread John Van Essen
these supposed to be resolved when the program is initially loaded at run-time? This has not been a problem in the past, AFAIK. Perhaps some newer library is trying to be too clever for its own good. As a workaround, maybe rsync could do a call to getpwuid() and getgrgid() before doing the ch

Re: Fwd: Re: rsync + ssh -o -p -g -l

2005-03-05 Thread John Van Essen
hem to see what's going on. > How can see with rsync more details of the transfers , > > y try to use rsync -avvz but is the = rsync -avz, i > want see more details, how can i do? They shouldn't be the same... Using more v's is the right thing to do.

Re: What's wrong with my exclude rules?

2005-02-23 Thread John Van Essen
*). That way, there's no wildcard expansion because no filenames will match that combined pattern. Maybe all man page examples should use the '=' format? -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: What's wrong with my exclude rules?

2005-02-23 Thread John Van Essen
y is the default initial rule. I've never seen anyone using this... Have you tried the rsync without it? The "/" could be interpreted in two ways - as the explicit top-level root directory, or as a trailing slash on a null directory, which rsync might treat the same as a "

Re: rsyncd / firewall

2005-02-15 Thread John Van Essen
/archive/trouble I believe). What does the backtrace output from gdb show? I'm mystified why this error does not happen on your other rsync that transfers an empty directory... What does an strace for that show that is different from this one, I wonder? -- John Van Essen Univ of

Re: rsyncd / firewall

2005-02-15 Thread John Van Essen
namic one. Just a guess... The first rsync to delete the directory is successful because since it does no file transfers, no compression is needed. -- John Van Essen Univ of Minn. Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: When to expect 2.6.4?

2005-02-07 Thread John Van Essen
live? It requires the generator to occasionally send a NOP to the sender so that the sender resets its timeout timer. There's a bugzilla item on this: https://bugzilla.samba.org/show_bug.cgi?id=1889 I think this should be enabled by default, with a --no-keep-alive option to disable it if s

Re: help troubleshooting inconsistencies in back up sizes

2005-02-03 Thread John Van Essen
ne.) If the machines use different timezones, put TZ=GMT before the find: TZ=GMT find /mailhome -ls | sort +10 >/tmp/serverN.txt so all the timestamps will be the same. Then use rsync to gather them on one machine and do diffs between them. -- John Van Essen Univ of Minn. Alum

Re: BIG delete list makes for BIGGER RAM requirements

2005-01-31 Thread John Van Essen
e your out-of-memory problem. Use with --dry-run, first, to see how things go. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync clobbering links?

2005-01-27 Thread John Van Essen
ting to a directory, it will be treated as matching a directory from the sender. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, re

Re: Potential new option: --delete-during

2005-01-24 Thread John Van Essen
vior (when it's not a security fix) can be upsetting to those who depend upon it. But if nobody on this list sees any problem with that, then go for it. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/lis

Re: Rsync cross-compilation problem

2005-01-23 Thread John Van Essen
On Thu, 20 Jan 2005, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Thu, Jan 20, 2005 at 01:54:20AM -0600, John Van Essen wrote: >> (Note to Wayne - isn't it dangerous to assume that off_t is 64 bits? > > Yeah, it probably is -- that code was always a kluge that doe

Re: rsync compilation

2005-01-23 Thread John Van Essen
t seems to be the case here. Try this. In config.h, replace: /* #undef HAVE_LONGLONG */ with #define HAVE_LONGLONG 1 and try compiling again. If your cross-compiler doesn't have this feature and you get compilation errors and you can't fix them, then put them in a reply here and we&#x

Re: Specifying No Recursion Explicitly

2005-01-22 Thread John Van Essen
the same name in the working directory, append a " .": rsync -tv rsync.dsbl.org::dsbl/rbldns-fresh-list.dsbl.org . Hope that helps. Worked for me. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/m

Re: Rsync cross-compilation problem

2005-01-19 Thread John Van Essen
g.log for long long to see why the test for it failed. Does your cross compiler really not have it? -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync Minimalist: --include only does "add_exclude"

2005-01-19 Thread John Van Essen
sing a root directory for a target can be very dangerous if you later add --delete and don't get things quite right. I strongly suggest always using --dry-run (or -n) to test things out. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsyncd.conf: "timeout=" crazyness

2005-01-13 Thread John Van Essen
receiver is still alive and the sender should reset its timeout timer. I run into this problem quite often when trying to sync large archives with sparse updates to a very busy, disk I/O intensive server (exactly the conditions you described). -- John Van Essen Univ of MN Alumnus <[EMAI

Re: connection unexpectedly closed...

2005-01-13 Thread John Van Essen
ess via ssh? Some configs disable that. Lastly - what version of rsync are you using (always important to know). -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Using rsync daemon over ssh (was How to use rsync)

2005-01-06 Thread John Van Essen
ectory of the login user and define paths for the above files that are writable by that user. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: trouble with chmod on certain symlinks

2005-01-02 Thread John Van Essen
Wayne, > diff -u -r1.1.1.6 rsync.c > --- rsync.c 3 Jan 2004 11:22:00 - 1.1.1.6 > +++ rsync.c 21 Dec 2004 12:04:56 - > @@ -260,7 +260,7 @@ > change to groups that the user is a member of */ > change_gid = is_in_group(file->gid); >

Re: preserving symlinks

2004-12-28 Thread John Van Essen
to make them relative. Suggestion to Wayne - this security functionality could be described in its own "Security Issues" or "Daemon vs. non-daemon operation" section on the manpage rather than buried within an option description. -- John Van Essen Univ of MN Alumnu

Re: outcome of big rsync. Puzzling

2004-12-20 Thread John Van Essen
On Sun, 19 Dec 2004, <[EMAIL PROTECTED]> wrote: > source vs destination in bytes > - > a) 20480 vs  34922496 > b) 28672 vs    24576 > c) 61718528 vs 61714432 > d) 157790208 vs 157786112 > > each directory consists of subdirectories of medical images in dicom format. > Most inte

Re: rsync works fine when I'm root on the client, but not as a non-root user

2004-12-08 Thread John Van Essen
On Wed, 8 Dec 2004, Grant Carmichael <[EMAIL PROTECTED]> wrote: > > With a non root user, ssh will authenticate them, but then the rsync > process dies. ... > My config file looks like: > > uid = nobody > gid = nobody > use chroot = no > max connections = 5 > syslog facility = local5

Re: rsync creating 0-length files?

2004-11-30 Thread John Van Essen
On Tue, 30 Nov 2004, Dan Stromberg <[EMAIL PROTECTED]> wrote: > > We were doing a roughly 1 terabyte transfer, and upon running a python > script to verify the integrity of the transfer, we discovered a small > number of files that were 0 length, that shouldn't have been, all in the > same user's

Re: Keep Alive packets

2004-10-07 Thread John Van Essen
d at least 60 seconds have elapsed since the last keep-alive? Also - as an optimization, if a --timeout value has been given then use 1/2 of that value for the keep-alive interval (instead of 60). -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change

Re: rsync 2.6.2 crash

2004-09-24 Thread John Van Essen
file that is included in the file list has been removed by the time the file metadata compare operation is performed. You are going to have to diagnose the other two problems by looking at the two paths in question. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]>

Re: not always making hard links?

2004-09-10 Thread John Van Essen
llowing command line: > > rsync -avz --bwlimit=5000 /extra/pub/ 192.168.1.73::pub To preserve hardlinks, you need to include the -H option (it's not implied in the -a option). -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change op

Determining your subscriber email address

2004-09-07 Thread John Van Essen
) The email address in <...> is the one used to send the email to you. Then you can use the mailman webpage for rsync (see the footer of this email) to get a password reminder emailed to you using that address. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To

--keep-dirlinks in combination with --one-file-system

2004-09-07 Thread John Van Essen
hould have been deleted will now be deleted. So the documentation for --keep-dirlinks should warn that also using -x (--one-file-system) has a side effect where symlinked directories followed by --keep-dirlinks that reside on another file system will not be processed for deletions. -- John

Re: HP-UX 11i and largefiles on rsync 2.6.2

2004-07-28 Thread John Van Essen
full_fname(fname), strerror(errno)); exit_cleanup(RERR_FILEIO); } Wayne - why is the "write failed" message not being displayed? It should have contained the EFBIG File Too Large error message. That would helped figure out the original problem (whi

Re: multiple daemon sources

2004-07-26 Thread John Van Essen
at this was possible. It seems this also works for non-daemon mode as long as you specify the full paths, I believe (or use paths relative to the remote user's home directory). Can you please add examples of this to the man page Usage section? -- John Van Essen Univ of MN Alumnus <

Re: Reliability and robustness problems

2004-06-17 Thread John Van Essen
d to Z. 3. If A (and B and Z) change and remain hardlinked, the new content will be transferred, A and B will be hardlinked, and the hardlink with Z is now lost because rsync doesn't know anything about it. Z on the target now contains old content and becomes independent. -- J

Re: Reliability and robustness problems

2004-06-07 Thread John Van Essen
var/local/backups/latest 192.168.0.1:/var/local/backups/latest/ Unchanged content won't be disturbed. Changed or new content will get transferred. When that completes successfully, then do the second rsync, but do *not* use --delete-excluded. The second rsync should include latest a

Re: rsync-2.6.2: NFS clients confused after an rsync

2004-05-11 Thread John Van Essen
backup. I think Brian's very simple patch (refined version posted 5/11) using an extra set_modtime() arg and testing for make_backup is the right fix. That fix could be refined even further by also checking for any specified backup-dir. If one was given, then it will be OK to always restore m

Re: rsync-2.6.2: NFS clients confused after an rsync

2004-05-11 Thread John Van Essen
problem that is as obscure as this one is... :) -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: measuring 2.6.1 improvements

2004-04-29 Thread John Van Essen
y be related to this bullet item in the NEWS file: * Changed hardlink info and file_struct + strings to use allocation pools. This reduces memory use for large file- sets and permits freeing memory to the OS. (J.W. Schultz) Wayne? JW? Any thoughts? -- John Van Esse

No error messages in rsyncd log in 2.6.1pre-1

2004-04-27 Thread John Van Essen
here than just adding back a "!am_daemon" test? Also - I'd sure like to see a message in the rsyncd log when the file list transfer has been completed. That would help determine at what stage things are failing (and how long it took for the file transfer to complete, in case th

Re: Rsync Log Error

2004-04-23 Thread John Van Essen
g our heads about... So ignoring all the 04/20 errors, brings us to the 04/21 errors. The ones at 04:30 looks like a minor shutdown problem that didn't affect the transfer. The one at 08:00 is from the kill. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

--hard-link option now uses the first existing file - Excellent!

2004-04-02 Thread John Van Essen
(avoiding Copy on Write) after the client forks the generator, thus using less memory in systems that support CoW. I think this (perhaps reworded :D) is worth noting in the INTERNAL section. -- John Van Essen Univ of MN Alumnus <[EMAIL PROTECTED]> -- To unsubscribe or chan

Re: exclude confusion: what does it match against?

2004-03-30 Thread John Van Essen
r root, not the filesystem root or partition root. The source transfer root is the source path with any trailing node removed up to the last slash. If the source path *ends* with a slash, then nothing is removed and the source path *is* the transfer root. -- John Van Essen Univ of MN Alumnus

Re: File that "vanish"es between readdir and stat is not IO error

2004-03-30 Thread John Van Essen
On Tue, 30 Mar 2004, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Mon, Jan 19, 2004 at 03:21:16AM -0600, John Van Essen wrote: >> In make_file(), when readlink_stat() fails, if error is NOENT >> then perhaps do the same that that send_files() now does and >>

Re: --include vs. --exclude

2004-03-28 Thread John Van Essen
a --dry-run first to determine the names of the pdf files. Grep the -v output of rsync for '\.pdf$', store that list in a file, then do a real run with the files-from option. I didn't try this - so I haven't verified that this will work. -- John Van Essen Univ of MN

Re: exclude confusion: what does it match against?

2004-03-26 Thread John Van Essen
pattern: /foo/bar (note missing 'me') Source file: /home/me/foo/bar Target file: /dest/foo/bar (note missing 'me') Example cmd: rsync -a --relative /home/me /dest Source root: /home Target root: /dest I/E pattern: /home/me/foo/bar (note full path)

  1   2   >