Problem with rsync --inplace very slow/hung on large files

2005-03-15 Thread Evan Harris
I'm trying to rsync a very large (62gig) file from one machine to another as part of a nightly backup. If the file does not exist at the destination, it takes about 2.5 hours to copy in my environment. But, if the file does exist and --inplace is specified, and the file contents differ, rsync

Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris
I was wondering if others might find it useful to have a parameter in the rsync daemon config that would allow running a command on the server at session start or at successful rsync completion. For instance, this would allow a webpage to be automatically maintained (by a script called by this

Re: Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris
On Tue, 19 Jul 2005, Andrew Burgess wrote: On Tue, 19 Jul 2005 12:10:18 -0700, Evan Harris [EMAIL PROTECTED] wrote: I was wondering if others might find it useful to have a parameter in the rsync daemon config that would allow running a command on the server at session start

Re: Feature request for rsync for running scripts

2005-07-19 Thread Evan Harris
I've just upgraded it to add more environment variables (such as module name, module path, host name, host IP, user name, exit status). I also changed where the post-rsync exec happens so that both the pre- and post-xfer are both now run by the user that runs the daemon (not the module's

Verbosity of log messages in daemon mode

2005-07-19 Thread Evan Harris
When running rsync in daemon mode, is there a way to suppress server-excluded messages in the logfile? I've tried setting both of max verbosity = 0 transfer logging = no but they are still showing up. Rsync 2.6.5. Unfortunately, I'm using rsync to get a whole tree every half hour, but there

Re: Verbosity of log messages in daemon mode

2005-07-19 Thread Evan Harris
a good approximation of the total bytes to be transferred to display in a higher level UI. I can include code to try to ignore the additional messages, but that seems kludgy and will break if the messages ever change. Evan On Tue, 19 Jul 2005, Evan Harris wrote: When running rsync in daemon mode

Re: Feature request for rsync for running scripts

2005-07-20 Thread Evan Harris
On Tue, 19 Jul 2005, Wayne Davison wrote: On Tue, Jul 19, 2005 at 06:27:56PM -0500, Evan Harris wrote: Is it possible that this patch might be added to the mainstream release anytime soon? I was originally against the idea, but have softened my opposition after I saw how self-contained

Question and feature requests for processor bound systems

2005-08-18 Thread Evan Harris
Is there any way to disable the checksum block search in rsync, or to somehow optimize it for systems that are processor-bound in addition to being network bound? I'm using rsync on very low power embedded systems to rsync files that are sometimes comparatively large (sometimes a few hundred

Re: Question and feature requests for processor bound systems

2005-08-18 Thread Evan Harris
On Thu, 18 Aug 2005, Jan-Benedict Glaw wrote: By design, rsync trades CPU power for bandwidth. True. But just because that is it's main focus doesn't mean we can't also provide a facility for hinting the types of files being transferred to lessen the impact of that tradeoff for systems that

Re: Question and feature requests for processor bound systems

2005-08-18 Thread Evan Harris
On Thu, 18 Aug 2005, Wayne Davison wrote: The --whole-file option (-W) disables the rsync algorithm entirely, but not the full-file checksum to verify that the file was transferred correctly. Unfortunately, for these huge files, I don't want to retransfer the part that has already been

Questions and comments regarding --remove-sent-files (Was: New delete option?)

2006-09-12 Thread Evan Harris
I've looked back through my mailing list archives, and seen a few messages touching on the same things I wanted to mention, but I figured it might be better to recap, since most of them were sent more than a year ago. I have recently started using the --remove-sent-files option, and have

Re: Extremely poor rsync performance on very large files (near 100GB and larger)

2007-01-08 Thread Evan Harris
On Mon, 8 Jan 2007, Wayne Davison wrote: On Mon, Jan 08, 2007 at 01:37:45AM -0600, Evan Harris wrote: I've been playing with rsync and very large files approaching and surpassing 100GB, and have found that rsync has excessively very poor performance on these very large files