Re: How to make big MySQL database more diffable/rsyncable? (aka rsyncing big files)

2009-08-26 Thread JW
ke a lot of people request this option. JW -- -- System Administrator - Cedar Creek Software http://www.cedarcreeksoftware.com -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailm

Re: WARNING: . . . .failed verification -- update discarded (will try again).

2009-06-04 Thread JW
On Thursday 04 June 2009 10:28:00 you wrote: > JW (j...@mailsw.com) wrote on 3 June 2009 11:58: > >A nightly scripted rsync backup job is giving me this error > > > >WARNING: vm/escDebLenny14G-flat.vmdk failed verification -- update > > discarded (will try again).

WARNING: . . . .failed verification -- update discarded (will try again).

2009-06-03 Thread JW
t seen any explanations for the "will try again" part. Does it try again immediately? If so, does a lack of further errors mean that it succeeded on the retry? Thanks, JW -- -- System Administrator - Cedar Creek Software http://www.cedarcreeksoftware.com -- Plea

Re: remote files not being deleted

2004-02-26 Thread jw schultz
On Thu, Feb 26, 2004 at 08:05:30AM -0600, Trey Nolen wrote: > > > > It may be that you are running out of memory. --delete > > causes the a second file list (about 100bytes/file) to be > > created contianing all the files existing on the receiver. > > Combined with --delete-after this happens at t

Re: remote files not being deleted

2004-02-25 Thread jw schultz
On Wed, Feb 25, 2004 at 08:36:26PM -0600, Trey Nolen wrote: > I've got an issue with remote files being deleted after the local file has > been deleted. For some reason, this isn't happening. I'm running rsync > 2.5.6 protocol 26 (yes, I know there are newer versions, but logistics > dictates that

Re: rsync & rotated logs

2004-02-25 Thread jw schultz
On Wed, Feb 25, 2004 at 11:14:47PM +0100, Andrzej Filip wrote: > What is the best way to keeps rsynced copy of rotate log files ? > > x.log -> x.log.1 -> x.log.2.gz -> ... > > Can rsync "notice" changes of file name and avoid needless synchronization ? Change how you rotate log files so that onc

Re: Deleted files

2004-02-23 Thread jw schultz
On Mon, Feb 23, 2004 at 05:04:00PM -0700, Walls Rob W Contr 75 CS/SCBS wrote: > Thought my troubles were fixed, but files disappeared again and reappeared > after a few dozen rsync cycles. > I am mapping a Win2K directory to Linux with Samba. That mounted directory > is then Rsynced to another Linu

Re: open files

2004-02-19 Thread jw schultz
On Thu, Feb 19, 2004 at 07:40:14PM -0800, Tarun Karra wrote: > hi guyz, > > One simple question. What does rsync do when it encounters open files. > Do we have to use open file manager(like st bernard) to back up open files or is > there any open source open file manager or can rsync backup open

Re: Log formatting: quoting format option flags in Perl

2004-02-19 Thread jw schultz
On Thu, Feb 19, 2004 at 07:19:52PM -0800, Shifra Raffel wrote: > Hello, > I'm having trouble with setting desired punctuation and spaces with log > formatting in a perl script. > > The log-format options I am using are --log-format=%h%a%l%o%f%t%u%c. Full > rsync command at end of this message.

Re: Rsync and rdist-like specials

2004-02-18 Thread jw schultz
On Wed, Feb 18, 2004 at 09:54:01PM -0500, Joseph McDonald wrote: > Greetings, > > We manage a large farm of systems and push changes, patches, > new software, etc. out to our clients using kerberized rdist. It's > clunky and slow but it's got the magic of specials. Using a special > one can tell

Re: Feature Request - Load Throttling

2004-02-17 Thread jw schultz
On Tue, Feb 17, 2004 at 07:34:06PM -0800, Marc Perkel wrote: > > > jw schultz wrote: > > >On Tue, Feb 17, 2004 at 06:47:19PM -0800, Marc Perkel wrote: > > > > > >>Actually - the problem is disk IO. And the disk IO is what makes the > >>load

Re: Feature Request - Load Throttling

2004-02-17 Thread jw schultz
e some nice C code that can do that for ALL the platforms without misreading? This is what process and i/o schedulers are for. Maybe you should contact the people responsible for whatever kernel it is you are running. > jw schultz wrote: > > >On Tue, Feb 17, 2004 at 03:16:32PM -0800,

Re: Feature Request - Load Throttling

2004-02-17 Thread jw schultz
On Tue, Feb 17, 2004 at 03:16:32PM -0800, Marc Perkel wrote: > If you aleady are doing this - then thanks. But here's a feature I'd > like to see. > > Rsync often puts a lot of load on the system because of high disk > access. I'd like to see rsync become "load aware" and to slow itself > down

Re: Feature request: case insensitivity

2004-02-17 Thread jw schultz
On Tue, Feb 17, 2004 at 12:58:25AM -0500, Ethan Tira-Thompson wrote: > I sync files to a memory stick fairly frequently. The memory stick > uses a basic FAT format, which kills case. What's more, on some > platforms (Windows), the drivers make all filenames uppercase, whereas > on others (linu

Re: possible bug?

2004-02-13 Thread jw schultz
On Fri, Feb 13, 2004 at 03:04:21PM -0700, David S. Ahern wrote: > A google search on this problem did not show any matches, so I'll take > the chance that someone on this list might consider it an rsync problem. > > In a nutshell, if rsync forks a child process to handle the transport > (rsh in

Re: Tru64 sockets bug?

2004-02-13 Thread jw schultz
On Fri, Feb 13, 2004 at 01:47:00PM -0500, Jonathan Burelbach wrote: > > We are using rsync to maintain a warm mirror of our boot disks. I just > updated to rsync 2.6.0 and noticed that the rsync runs are now getting > errors when copying sockets. The system is running Tru64 5.1A pk 4 on > an Al

Re: error in rsync protocol data stream

2004-02-12 Thread jw schultz
On Thu, Feb 12, 2004 at 10:28:31PM -0500, Ray Lischner wrote: > On Thursday 12 February 2004 06:38 pm, jw schultz wrote: > > > You have run out of memory. > > According to the FAQ-o-matic, rsync needs about 100 bytes/file. I am > copying about 1,000,000 files, so that comes

Re: error in rsync protocol data stream

2004-02-12 Thread jw schultz
On Thu, Feb 12, 2004 at 02:14:12PM -0500, Ray Lischner wrote: > On Thursday 12 February 2004 12:44 pm, Ray Lischner wrote: > > > I am trying to backup an entire disk to a USB-mounted disk, for backup > > purposes. Many files are copied, but eventually rsync dies: > > I tried it again, and this ti

Re: Please help : Strange 'file has vanished' behaviour with rsync on windows.

2004-02-11 Thread jw schultz
Your question has diddly-squat to do with the thread or subject line. And no, rsync does not support both ends being remote. You need to make it so one end or the other is "local" to rsync. If mypc2 and mypc1 have no way to connect one to the other regardless of initiator ther are books and howt

Re: checksum_seed

2004-02-10 Thread jw schultz
On Tue, Feb 10, 2004 at 09:56:00PM -0800, Craig Barratt wrote: > On Mon, Feb 09, 2004 at 09:14:06AM -0500, Jason M. Felice wrote: > > > I got the go-ahead from the client on my --link-by-hash proposal, and > > the seed is making the hash unstable. I can't figure out why the seed > > is there so I

Re: rsync 2.6.1cvs dumps core when preserve_hard_links and backup

2004-02-10 Thread jw schultz
On Tue, Feb 10, 2004 at 04:21:26PM -0800, Wayne Davison wrote: > On Tue, Feb 10, 2004 at 03:26:15PM -0800, jw schultz wrote: > > CVS has a simplified test now that should avoid the segfault. > > It is just for a verbose message. > > I don't see how the message is us

Re: rsync 2.6.1cvs dumps core when preserve_hard_links and backup

2004-02-10 Thread jw schultz
On Tue, Feb 10, 2004 at 01:40:48PM +0900, Shinichi Maruyama wrote: > I tried rsync 2.6.1cvs on my FreeBSD 4.X boxes. > It dumps core when preserve_hard_links and backup. > And SUPPORT_HARD_LINKS is true. > > rsync -avH --delete --backup --backup-dir=/some/backup/dir \ >

Re: rsync 2.6.1cvs dumps core when preserve_hard_links and backup

2004-02-09 Thread jw schultz
On Tue, Feb 10, 2004 at 01:40:48PM +0900, Shinichi Maruyama wrote: > I tried rsync 2.6.1cvs on my FreeBSD 4.X boxes. > It dumps core when preserve_hard_links and backup. > And SUPPORT_HARD_LINKS is true. > > rsync -avH --delete --backup --backup-dir=/some/backup/dir \ >

Re: memory reduction

2004-02-09 Thread jw schultz
On Thu, Feb 05, 2004 at 09:27:51PM -0800, jw schultz wrote: > As those of you who watch CVS will be aware Wayne has been > making progress in reducing memory requirements of rsync. > Much of what he has done has been the product of discussions > between he and myself that started a mo

Re: rsync_failed

2004-02-06 Thread jw schultz
On Mon, Feb 02, 2004 at 02:27:29PM +, [EMAIL PROTECTED] wrote: > > Hello > > I came about the following phenomeon when > the server ( dell poweredge 2650 ) is rsyncing to > the same and remote server. > the connection was close and copying the file didn't finish > yet. > > Network Topology:

Re: Rsync doesn't appear to handle large files

2004-02-06 Thread jw schultz
On Fri, Feb 06, 2004 at 02:04:45PM -0800, Buwalda, Mark W wrote: > I just started using rsync version 2.5.6 on sun solaris 8. > In trying to mirror a large ufs filesystem, I've noticed that > Rsync does not copy large files, specifically any file greater > Than 2 GB. > All other files in the fil

Re: memory reduction

2004-02-06 Thread jw schultz
On Thu, Feb 05, 2004 at 09:27:51PM -0800, jw schultz wrote: > As those of you who watch CVS will be aware Wayne has been > making progress in reducing memory requirements of rsync. > Much of what he has done has been the product of discussions > between he and myself that started a mo

Re: Full backup

2004-02-06 Thread jw schultz
On Fri, Feb 06, 2004 at 09:49:16AM +0100, Thorsten Schacht wrote: > Hey guys, > > I'd like to take a full backup of our email server. > Is it possible to clone the current server (postfix, spamassassin, > qpopper...) to another clean system to have it ready if the current one > fails? Yes it is p

memory reduction

2004-02-05 Thread jw schultz
As those of you who watch CVS will be aware Wayne has been making progress in reducing memory requirements of rsync. Much of what he has done has been the product of discussions between he and myself that started a month ago with John Van Essen. Most recently Wayne has changed how the file_struct

Re: rsync is not copying upper case files

2004-02-05 Thread jw schultz
On Thu, Feb 05, 2004 at 02:10:39PM +0100, [EMAIL PROTECTED] wrote: > > > >> I am running rsync on MacOS 10.3 and I want to transfer files to a > >> linux > >> machine, which has linux partitions and fat32 partitions. > >> > >> Transfering the files to the linux partition works without problems

Re: excludes

2004-02-04 Thread jw schultz
On Wed, Feb 04, 2004 at 04:33:20PM -0800, tim wrote: > > > Kevin Moschallski wrote: > >Hi i tried to use rsync to backup my remote server.I want to exclude > >folder like /var /proc ... .I use --exlude-from=/etc/rsync/excludes > >the file looks like this: > > > >- */var/* > >- */proc/* > > > >etc

Re: ACL and Quota

2004-02-04 Thread jw schultz
On Wed, Feb 04, 2004 at 09:32:58AM -0800, Norman Zhang wrote: > Hi, > > I have been grabbing mirrors using -aupg switches. Is there a way rsync > to copy the ACLs and quota restrictions for particular folders too? At this time rsync does not support ACLs or Extended Attributes. To copy them you

Re: rsync is not copying upper case files

2004-02-03 Thread jw schultz
On Tue, Feb 03, 2004 at 02:59:02PM +0100, [EMAIL PROTECTED] wrote: > Hi, > > I am running rsync on MacOS 10.3 and I want to transfer files to a linux > machine, which has linux partitions and fat32 partitions. > > Transfering the files to the linux partition works without problems, > but if I tr

Re: HELP!!!

2004-02-03 Thread jw schultz
On Tue, Feb 03, 2004 at 12:51:32AM -0800, preetha thomas wrote: > Hello and Greetings!! >I am Preetha Thomas.I am a student and trying > to use RSYNC for the download of the PDB FTP > archives.I have been successful.I posted a question > last wekk about updating my pdb archive.But i never >

Re: rsync 2.6.0 causing incredible load on Linux 2.4.x?

2004-02-02 Thread jw schultz
On Mon, Feb 02, 2004 at 05:35:17PM -0800, Clint Byrum wrote: > On Mon, 2004-02-02 at 14:51, jw schultz wrote: > > On Mon, Feb 02, 2004 at 02:01:15PM -0800, Clint Byrum wrote: > > > Hi everyone. Has anyone experienced rsync 2.6.0 causing huge amounts of > > > system lo

Re: rsync 2.6.0 causing incredible load on Linux 2.4.x?

2004-02-02 Thread jw schultz
g. > > The size you cite for 2.6.0 is very near to the size of an unstripped > rsync on my system, so I'd be sure to double-check that. And roughly double my sizes for near 2.6.0 (CVS head 28-dec) rsync: -rwxr-xr-x1 jw jw 180964 Feb 2 15:08 rsync.s

Re: rsync 2.6.0 causing incredible load on Linux 2.4.x?

2004-02-02 Thread jw schultz
On Mon, Feb 02, 2004 at 02:01:15PM -0800, Clint Byrum wrote: > Hi everyone. Has anyone experienced rsync 2.6.0 causing huge amounts of > system load? Especially on Linux 2.4? > > We recently upgraded our "push" machine to rsync 2.6.0 and the next push > that went out (rsyncing about 3GB of data to

Re: --daemon for clients

2004-02-01 Thread jw schultz
On Thu, Jan 29, 2004 at 04:58:45PM +0100, Stefan Hoefer wrote: > Hello > > I have the following situation: one perl script opens a TCP connection to > a remote server running another perl script. The file descriptors on both > sides are mapped to STDIN and STDOUT file descriptors. After some > "ta

Re: [PATCH] --links-depth for rsync

2004-02-01 Thread jw schultz
On Sat, Jan 24, 2004 at 11:09:46PM +0200, Antti Tapaninen wrote: > > Hello, > > about a year ago I ran into situation where there's a "metadirectory" > containing directories and symlinks to files. There was a need to mirror > the contents of files and directories gathered via symlinks to this >

Re: innetgr revised netgroup patch against 2.6.0

2004-02-01 Thread jw schultz
On Sun, Feb 01, 2004 at 11:25:22PM +1100, Travis Freeland wrote: > > innetgr.. much easier.. Much cleaner. But the code could be tightened further. I've provided an example. Note also formatting changes. Also, we use tabs, not spaces for indent. If that is your mailer either fix the config or

Re: netgroups patch for rsync 2.6.0

2004-01-31 Thread jw schultz
On Sat, Jan 31, 2004 at 11:39:11PM +1100, Travis Freeland wrote: > > G'day, > > I figured some others might benefit from this patch. It allows you to use > the samba style @netgroup names in hosts allow and hosts deny. > > I've tested it on solaris and linux with no apparent problems.. > > I'l

Re: Can't Figure out why rsync job stops

2004-01-30 Thread jw schultz
On Thu, Jan 29, 2004 at 03:36:51PM -0600, Bryan Sauser wrote: > I connecting to two offsite over servers, that are connected over dedicated > T1 lines. I'm using the same script on both servers. One runs fine, but the > other starts, gets the file list and processes a few folders. Then it will > ha

Re: rsync 2.5.6, No buffer space available error...

2004-01-30 Thread jw schultz
On Fri, Jan 30, 2004 at 11:31:42AM +0100, Kate Ward wrote: > >On Wed, Sep 03, 2003 at 03:49:12PM -0400, Matt Miller wrote: > >>I have seen this error in many postings, but the solutions seem not to > >>apply in this case. This error happens during a small file transfer > >>(gif image) and after

Re: different behavior for --backup-dir relative/path vs --backup-dir /full/path

2004-01-30 Thread jw schultz
On Thu, Jan 29, 2004 at 11:40:50AM -0800, [EMAIL PROTECTED] wrote: > Why does using --delete -b --backup-dir relative/path > puts the deleted files in the target folder, > while using the full path works as expected? What you describe is exactly as expected. Like --link-dest and --compare-dest,

Re: File rename detection?

2004-01-29 Thread jw schultz
On Thu, Jan 29, 2004 at 10:56:30AM +0100, Paul Slootman wrote: > On Wed 28 Jan 2004, jw schultz wrote: > > > > Situations where blah.0 gets renamed to blah.1 seldom > > benefit from rename detection anyway because the cascading > > renames just make room for new

Re: File rename detection?

2004-01-28 Thread jw schultz
On Wed, Jan 28, 2004 at 05:12:04PM -0800, jw schultz wrote: > On Thu, Jan 29, 2004 at 11:42:12AM +1100, Donovan Baarda wrote: > > On Thu, 2004-01-29 at 06:27, jw schultz wrote: > > > On Wed, Jan 28, 2004 at 09:06:52PM +0300, ??? wrote: > > > > Hello! &

Re: File rename detection?

2004-01-28 Thread jw schultz
On Thu, Jan 29, 2004 at 11:42:12AM +1100, Donovan Baarda wrote: > On Thu, 2004-01-29 at 06:27, jw schultz wrote: > > On Wed, Jan 28, 2004 at 09:06:52PM +0300, ??? wrote: > > > Hello! > > > > > > As I was found rsync do not detect file renaming.

Re: Server crashed using rsync

2004-01-28 Thread jw schultz
On Wed, Jan 28, 2004 at 02:12:02PM -0500, Eugen Luca wrote: > I'm trying to make a backup using this command > > rsync -auvH /home/ /bak --delete --bwlimit=1000 --status > > server load has been increased so much and the server crashed, as well > has gone out of memory > My Server is a Du

Re: File rename detection?

2004-01-28 Thread jw schultz
On Wed, Jan 28, 2004 at 09:06:52PM +0300, ??? wrote: > Hello! > > As I was found rsync do not detect file renaming. If I just copy my > backup.0.tgz (many Mbytes in size having it's md5) to backup.1.tgz > (which will be equial in size and md5) it will be the same file > in fact... >

Re: Change in reporting for --dry-run in 2.6.x

2004-01-28 Thread jw schultz
On Wed, Jan 28, 2004 at 12:38:11PM -0500, Alberto Accomazzi wrote: > I just noticed that there is an extra blank line in the output generated > by rsync when the --dry-run (-n) flag is used. This seems to have > started with 2.6.0. Is this desired? The reason why I'm asking is > because I use

Re: rsync error using ssh : @ERROR: access denied toserver.domain.com from unknown (0.0.0.0) {Scanned By MailScanner}

2004-01-27 Thread jw schultz
On Tue, Jan 27, 2004 at 09:55:41PM -0500, [EMAIL PROTECTED] wrote: > I've encountered a similar situation, and tracked it down. It seems that > if the shell for your user is set to bash2 versions 2.0 -> 2.05.0, it > causes your IP to appear as 0.0.0.0 . However, this has been fixed in > 2.05b.0,

Re: rsync error using ssh : @ERROR: access denied to server.domain.com from unknown (0.0.0.0) {Scanned By MailScanner}

2004-01-27 Thread jw schultz
On Tue, Jan 27, 2004 at 04:31:53PM -0800, AI Connex wrote: > I use rsync to mirror several servers. > > I run RH7.3 > > My rsyncd.conf file is: > > motd file = /etc/rsync.d/rsync.motd > log file = /var/log/rsyncd.log > pid file = /var/run/rsyncd.pid > lock file = /var/run/rsync.lock > hosts allo

Re: Differentiating debug messages from both sides

2004-01-27 Thread jw schultz
On Tue, Jan 27, 2004 at 12:31:05AM -0800, Wayne Davison wrote: > Some of the debug messages that rsync outputs (when verbose >= 2) can > occur on both sides of the connection. This makes it hard to know which > program is saying what. Some debug messages deal with this by > outputting a "[PID]" s

Re: --link-dest not working with rsync daemon?

2004-01-26 Thread jw schultz
On Mon, Jan 26, 2004 at 10:27:16PM -0800, [EMAIL PROTECTED] wrote: > jw schultz writes: > > > Soon, i hope. 2.6.1 is looking like a performance release. > > Can we get the craigb-perf patch in (sorry I haven't looked in CVS - maybe > it is there)? Thanks to Wayne for

Re: --link-dest not working with rsync daemon?

2004-01-26 Thread jw schultz
On Mon, Jan 26, 2004 at 09:57:32PM -0500, Alberto Accomazzi wrote: > > Let me take this opportunity to thank you personally for taking on the > task of pushing out the latest rsync release and for your and jw's > continuing work on this. I know a lot of people have contributed > patches and id

Re: Problems with --exclude

2004-01-26 Thread jw schultz
On Mon, Jan 26, 2004 at 09:21:39PM -0600, Brian Camp wrote: > I'm trying to get rsync to exclude the directory > "/home/www/users/ftp/pub/" from being copied in the command line below > and have not been successful. I've tried many combinations, such as > dropping the /'s and adding *'s, witho

Re: patch for linux capabilities

2004-01-26 Thread jw schultz
On Mon, Jan 26, 2004 at 01:36:23PM -0600, Michael Glasgow wrote: > I was wondering if it might be possible for an rsync developer to > look over the attached patch (tested on Linux 2.4.24 against the > rsync-2.6.0 release), and offer suggestions on how I could improve it. > > Basically I want to u

Re: is there a bug with one-file-system?

2004-01-25 Thread jw schultz
On Sun, Jan 25, 2004 at 02:58:54PM -0600, Thomas Stivers wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > I am trying to use rsync to backup a filesystem to another computer on a > local network, but when I use > rsync -arx / some.host:backup > rsync still tries to copy everything fr

Re: scan for first existing hard-link file

2004-01-25 Thread jw schultz
On Sun, Jan 25, 2004 at 02:05:21AM -0800, Wayne Davison wrote: > Here's a patch that makes rsync try to find an existing file in a group > of hard-linked files so that it doesn't create the first one in the > group from scratch if a later file could be used instead. > > Details: I decided to avoi

Re: Group Permissions?

2004-01-23 Thread jw schultz
On Fri, Jan 23, 2004 at 09:09:44AM -0800, Wayne Davison wrote: > On Fri, Jan 23, 2004 at 11:49:56AM -0500, [EMAIL PROTECTED] wrote: > > Does this mean that rsync requires that the destination directory be > > owned by the user calling rsync and that it is not sufficient for the > > user to have wri

Re: [jerry.seutter@pason.com: Is rsync supposed to resume?]

2004-01-23 Thread jw schultz
On Fri, Jan 23, 2004 at 10:23:57AM -0700, Jerry Seutter wrote: > Retrying with the _correct_ address this time. *blush* > > - Forwarded message from Jerry Seutter <[EMAIL PROTECTED]> - > > Date: Fri, 23 Jan 2004 10:01:47 -0700 > From: Jerry Seutter <[EMAIL PROTECTED]> > To: [EMAIL PROTECT

Re: rsync.yo doc patch

2004-01-23 Thread jw schultz
On Fri, Jan 23, 2004 at 12:21:13PM -0500, Aaron S. Hawley wrote: > > On Fri, 23 Jan 2004, jw schultz scribbled: > > > On Thu, Jan 22, 2004 at 07:00:17PM -0500, Aaron S. Hawley wrote: > > > Patch includes fixes to man page including: > > > - Typos/Spelling

Re: rsync.yo doc patch

2004-01-23 Thread jw schultz
On Fri, Jan 23, 2004 at 01:43:41AM -0800, Wayne Davison wrote: > On Thu, Jan 22, 2004 at 06:50:35PM -0800, jw schultz wrote: > > I'd leave it as is except to replace the paranthetic with > > the text regarding --numeric-ids in the --owner section > > Unfortunately the t

Re: rsync.yo doc patch

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 06:27:49PM -0800, Wayne Davison wrote: > On Thu, Jan 22, 2004 at 06:02:35PM -0800, jw schultz wrote: > > it might be a good idea to change IO to I/O to reduce the doubletake. > > Yes, I prefer I/O for input/output as well. > > > > dit(bf(-g, -

Re: rsync.yo doc patch

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 05:56:12PM -0800, Wayne Davison wrote: > On Thu, Jan 22, 2004 at 05:13:33PM -0800, jw schultz wrote: > > Let's keep the examples in the example, description order. > > Unfortunately, the indentation does make that order a little confusing, > and

Re: rsync.yo doc patch

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 05:41:12PM -0800, Wayne Davison wrote: > I've attempted to snag the least controversial changes out of the patch > and checked them in. I also changed "file system" into filesystem in > one place, made your suggested allow->support change, and changed "id" > to "ID" (since

Re: rsync.yo doc patch

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 07:00:17PM -0500, Aaron S. Hawley wrote: > Patch includes fixes to man page including: > - Typos/Spelling > - Clarity > - Special characters. > - Moved around text explaining example. > > Make sure I didn't confuse the exclude list/file paragraph (line ~961 > after appl

Re: Rsync's Speed

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 01:36:05PM -0700, Steve Sills wrote: > Well, it is running under SSH, that could slow it down i guess Very easy to tell. If ssh is burning user-mode cpu time the encryption is a factor. It is very unlikely the encryption is having any affect on throughput. Unless you

Re: Equivalent between rsync -aHr and cp -al

2004-01-22 Thread jw schultz
On Thu, Jan 22, 2004 at 06:19:06PM +0900, Charles Nadeau wrote: > Hi, > > Just a quick question. I am looking for a replacement for the command "cp > -al" which has problems dealing with a massive amount of files > (http://mail.gnu.org/archive/html/bug-coreutils/2003-12/msg00028.html). > > Could

Re: Moving from one server to another with rsync?

2004-01-21 Thread jw schultz
On Wed, Jan 21, 2004 at 10:58:03PM +0100, Spear wrote: > Hi, > > I am currently in the process of migrating from RH 7.3 to RHEL ES 3.0 on my > system. Of course there is a lot of iles that will need to change server > (new server is ready). My question is of course what is the best way to do > thi

Re: rsync 2.6.0 - suspected memory leak bug

2004-01-21 Thread jw schultz
On Wed, Jan 21, 2004 at 03:35:37PM +, Kelly Garrett wrote: > Wayne Davison samba.org> writes: > > > > > On Tue, Jan 20, 2004 at 06:16:34PM -0800, jw schultz wrote: > > > As far as i can tell Under inetd each connection should get > > > independant rs

FIXED: rsync hangs on cygwin

2004-01-21 Thread jw schultz
On Wed, Jan 21, 2004 at 05:24:19AM -0600, John Van Essen wrote: > On Wed, 21 Jan 2004, Dmitry Melekhov <[EMAIL PROTECTED]> wrote: > > Jeremy Lin wrote: > > > >>rsync hangs under Cygwin have been a longstanding issue. There was a > >>message earlier today about upgrading to the 1.5.6-1 cygwin dll,

Re: help!!

2004-01-21 Thread jw schultz
On Wed, Jan 21, 2004 at 02:35:38AM -0800, preetha thomas wrote: > Greetings!! >I am a college student doing my Masters Of Computer Applications.Towards > the completion of my project I have undertaken a project in BIOINFORMATICS in the > School of BIOTECHNOLOGY.Madurai Kamaraj Univers

Re: how about auth users without a password?

2004-01-21 Thread jw schultz
On Wed, Jan 21, 2004 at 07:26:50AM -0800, Larry Brasfield wrote: > Jim Salter wrote: > > Wouldn't this (accomplishing security restrictions without need to enter > > a password, or to enter a password more than once) be a lot more easily > > accomplished by simply using SSH transport and public/p

Re: rsync 2.6.0 - suspected memory leak bug

2004-01-20 Thread jw schultz
On Tue, Jan 20, 2004 at 06:09:09PM -0800, Wayne Davison wrote: > On Tue, Jan 20, 2004 at 02:45:47PM -0700, Garrett, Kelly wrote: > > After every rsync transfer there is a large amount of memory that is > > not freed up. > > Your report sounds like you're not talking about process size, but a > fre

Re: How to avoid rsyncing incomplete uploads? (best practice on fileservers?)

2004-01-20 Thread jw schultz
On Tue, Jan 20, 2004 at 03:37:38PM +0100, Peter wrote: > Hi, > > some big files are regularily updated on server A. > > Rsync should sync that with Server B. > > If rsync starts in the middle of an upload process, will it copy that > incomplete file to Server B? > > First tests showed it will

Re: Improving name-truncation detection

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 07:09:29PM -0800, Wayne Davison wrote: > On Mon, Jan 19, 2004 at 06:46:48PM -0800, jw schultz wrote: > > If you're going to do the strlen(src) and whatnot you might > > as well just snag the strlcpy source and tweak it so you > > only have to

Re: Improving name-truncation detection

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 06:00:32PM -0800, Wayne Davison wrote: > On Mon, Jan 19, 2004 at 05:44:20PM -0800, Wayne Davison wrote: > > I'll append my util.c patch to this email. > > Or perhaps to this one... If you're going to do the strlen(src) and whatnot you might as well just snag the strlcpy so

Re: Improving name-truncation detection

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 05:44:20PM -0800, Wayne Davison wrote: > On Mon, Jan 19, 2004 at 02:39:56PM -0800, jw schultz wrote: > > If we are going to vet the path name for overflow (a good idea) lets > > do it once, explicitly, as we receive it instead of having tests > > sca

Re: Rsync and Tar

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 03:56:40PM -0700, Steve Sills wrote: > Hello, > > I am trying to setup a backup system. What I would like to do is > have rsync create a tar file as it downloads (to save space) and just have > it update that tar file. Can rsync create a archive on the fly,

Re: Improving name-truncation detection

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 10:17:30AM -0800, Wayne Davison wrote: > I've got a patch that changes f_name_to() to return an unsigned int > (like sme_tonprintf() and strlcpy() do) and adds checking to ensure that we > didn't overflow the name before we try to use it: > > http://www.blorf.net/name-o

Re: Improving name-truncation detection

2004-01-19 Thread jw schultz
On Mon, Jan 19, 2004 at 12:21:48PM -0800, Wayne Davison wrote: > On Mon, Jan 19, 2004 at 12:05:16PM -0800, jw schultz wrote: > > How about posting it? > > To the mailing list? I think that most of the subscribers aren't going > to be interested in random patches,

Re: Buffer Overflow?

2004-01-17 Thread jw schultz
On Sat, Jan 17, 2004 at 10:31:54PM -0800, Chuck Wolber wrote: > > Just got this from our nightly backup rsync: > > > > overflow: flags=0x6e l1=99 l2=1952984691 > lastname=var/www/manual/mod/mod_php4/de/function.get-exte > ERROR: buffer overflow in receive_file_entry > rsync error: error alloca

Re: --delete-sent-files (AKA --move-files)

2004-01-17 Thread jw schultz
On Sat, Jan 17, 2004 at 09:02:27AM -0800, Wayne Davison wrote: > On Fri, Jan 16, 2004 at 10:24:02PM -0800, jw schultz wrote: > > Long term this would give us the ability to log at the right point, > > after it is actually been completed but done on the local end. Right > >

Re: --delete-sent-files (AKA --move-files)

2004-01-16 Thread jw schultz
On Fri, Jan 16, 2004 at 09:30:57PM -0800, Wayne Davison wrote: > Yes, it's time once again to return to the subject of moving files. > With the recent changes to the communications code between the receiver > and the generator, there is now a non-clogging channel that we can use > to signal the sen

Re: Any (known) scaling issues?

2004-01-16 Thread jw schultz
On Fri, Jan 16, 2004 at 03:55:42PM -0800, Bret Foreman wrote: > I'm considering using rsync in our data center but I'm worried about whether > it will scale to the numbers and sizes we deal with. We would be moving up > to a terabyte in a typical sync, consisting of about a million files. Our > dat

Re: Resolving problems in the generator->receiver pipes

2004-01-15 Thread jw schultz
On Thu, Jan 15, 2004 at 12:11:39PM -0800, Wayne Davison wrote: > When I was working on the the hard-link change, I noticed that many > of the hard-link verbose messages were getting lost. These messages > get output very near the end of the transfer, and it turns out that > the reason for the loss

Re: 2.6.0 backwards compatibility

2004-01-15 Thread jw schultz
On Thu, Jan 15, 2004 at 01:08:34PM -0500, Piela, Ben wrote: > Hello all, > > I saw on the Release notes that 2.6.0 is using protocol version 27 which is > different than 2.5.7 and 2.5.6. I did a quick peak through the rest of the > release notes and quickly browsed the archives on the list and I

Re: Unexpected timeout in rsync

2004-01-13 Thread jw schultz
On Tue, Jan 13, 2004 at 06:50:28PM +, John Hunt wrote: > Hi > > I am having trouble with intermittent timeouts when backing up a largish set > of files from /usr using rsync. Approx 125,000 files, 2GB. Backup is to same > machine, from a partition on hda to one on hdb. I am using ribs 2.1

Re: Progress reporting: N more to check

2004-01-13 Thread jw schultz
On Tue, Jan 13, 2004 at 01:59:18AM -0800, Wayne Davison wrote: > On Mon, Jan 12, 2004 at 11:46:05PM -0800, jw schultz wrote: > > How about "(%d of %d files)\n", cur_index, flist->count; > > I tried that, but I didn't like it. The first number in my patch > tel

Re: Progress reporting: N more to check

2004-01-13 Thread jw schultz
> If you wanted to have something more complicated i'd go with > using bytecounts of transferred plus skipped as a percentage > of total so when complete it would be 100% Skip this part. Short of some ugly code only the generator process can knows the bytecounts of skipped data but it is the send

Re: Progress reporting: N more to check

2004-01-13 Thread jw schultz
On Mon, Jan 12, 2004 at 10:37:40PM -0800, Wayne Davison wrote: > A recent posting here got me thinking about having the --progress > output tell the user about how many files were left to go in the > transfer. I submit the attached patch which outputs an extra suffix > onto the progress line at th

Re: chroot and pwd.db file not found ...

2004-01-12 Thread jw schultz
On Thu, Jan 08, 2004 at 01:11:43PM -0500, Bill Moran wrote: > This has been asked before, but my question is somewhat different. > > On FreeBSD, the message: > rsyncd[520]: /etc/pwd.db: No such file or directory > > is obviously caused by a chrooted rsyncd being unable to access /etc/pwd.db > to

Re: Performance problem

2004-01-12 Thread jw schultz
On Mon, Jan 12, 2004 at 06:22:04PM -0500, Andrew Boyce-Lewis wrote: > Hi, I am running rsync version 2.5.7 (stock distro on redhat linux, ES > and 9) to rsync a directory with ~300k files in it from a machine on a > 10Mbit internet tap to a machine with a 100Mbit internet tap. The > problem is that

Re: Problems with rsync with dirctories with spaces in the name

2004-01-09 Thread jw schultz
On Fri, Jan 09, 2004 at 10:55:38PM +0800, Nunuz Yourbiz wrote: > Hi guys > > I have read read the why's and whyfores and howto's and whento's about > posting for help, but I'm not sure whether this has already been addressed > - plenty other Win/spaces-in-dir-names issues have been. > > I was r

Re: start a batch after rsync

2004-01-09 Thread jw schultz
On Fri, Jan 09, 2004 at 11:38:20AM +0100, Andreas Moroder wrote: > Hello, > > I would like to replicate one file from one machine to a second one with > rsync. After the file is copied ( rsync in read mode ), if the file > has changed i must start a small batch, if it has not change I must do

Re: rsync performance question

2004-01-08 Thread jw schultz
On Thu, Jan 08, 2004 at 01:05:25PM -0500, Rick Frerichs wrote: > Hello, > > I seem to be having a performance problem with rsync. > I have done some testing of rsync and ftp. If I do > a transfer (either way) with ftp, I get about 500 Kbytes/sec. > Using rsync to do the same transfer (either way)

Re: [patch] making rsync less verbose

2004-01-08 Thread jw schultz
On Tue, Jan 06, 2004 at 06:51:41PM +0100, Dick Streefland wrote: > Unless you suppress all output with the -q option, rsync will always > print an initial "building/receiving file list ... done" line. In my > opinion, this is a bit superfluous. When I want to see a progress > indication, I can use

Re: TODO hardlink performance optimizations

2004-01-07 Thread jw schultz
On Wed, Jan 07, 2004 at 03:25:39PM -0800, Wayne Davison wrote: > On Wed, Jan 07, 2004 at 01:30:19AM -0800, jw schultz wrote: > > On Wed, Jan 07, 2004 at 02:45:46AM -0600, John Van Essen wrote: > > > The point of this exercise was to find a way to avoid unnecessary > >

Re: Copying hard-linked tree structure

2004-01-07 Thread jw schultz
On Wed, Jan 07, 2004 at 03:18:40PM -0600, Max Kipness wrote: > > > > I have a tree structure on one server similar to the following: > > > > > > > > /Current > > > > /01-04-2003 > > > > /01-03-2003 > > > > > > > > etc... > > > > > > > > /Current holds the most recent rsynced data, and the dat

  1   2   3   4   5   6   7   8   9   10   >