Re: how to reduce rsync system usage

[Ray Van Dolson]

I would suggest that your script that calls the various rsync commands creates
a lockfile and whatever script that is spawning off the additional rsync
processes waits until this lockfile is gone before doing anything.

Ray

On Thu, May 26, 2005 at 10:52:41AM +1000, dtra wrote:
 dtra wrote:
 
 hi all
 
 we're using rsync to backup our web server at the moment using it in a 
 cron job
 the server we are using to receive all the sync files is a live but 
 not heavily used linux machine
 but rsync still takes up more resources than we want it to
 it takes up to 95% (fluctuating) cpu load and a fair bit of memory too
 
 the cron job uses nice -19 rsync
 but that doesn't seem to do anything, is there anyway to make it use 
 like 5% cpu or something?
 
 thanks
 dave
 
 sorry, one more thing, on the server we are getting the files from, max 
 connections is set to 1
 but when i go to top on the backup server, i can see several instances 
 of rsync running
 eg. every twenty minutes a new rsync starts running
 that's not how it's meant to work, does anyone know how i can make it so 
 that
 if one rsync instance is still going, then the next one shouldn't start up?
 
 -- 
 To unsubscribe or change options: 
 https://lists.samba.org/mailman/listinfo/rsync
 Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
 

-- 
Ray Van Dolson
Linux/Unix Systems Administrator
Digital Path, Inc.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: pauses sync'ing between tmpfs and disk on Linux 2.4.x

[Ray Van Dolson]

Thanks for the response, Tim.. I think I identified my bottleneck.  Should
have been pretty obvious.  There are quite a few processes writing to /
creating the files I'm rsync'ing.  If I disable the daemon that handles this
before rsync'ing, the speed of the rsync is quite fast.  Must be some locking
issue with files open for write while rsync tries to read them.

D'oh!

Thanks again.

Ray

On Sat, Mar 26, 2005 at 09:32:05AM -0800, Tim Moore wrote:
 
 I use rsync similarly.  In addition to he standard /tmp traffic, junkbuster 
 has a 4MB  jarfile and 18MB log, ccache has 16 directories and 8000 files 
 of which 3000 are  10k.  Both are heavily used.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html