--relative clobbers --delete

2011-08-02 Thread Chuck Wolber
Hi, We back up a lot of machines with varying version of rsync installed on them. The oldest machine (hopefully soon to be retired) is running rsync version 2.5.7 (protocol version 26). We back this machine up from / onwards with a few excludes in there. I noticed today that whenever we use

Re: --relative clobbers --delete

2011-08-02 Thread Chuck Wolber
On Tue, 2 Aug 2011, Kevin Korb wrote: 1. Update rsync. You are MANY years out of date. Updating rsync is not going to break whatever obsolete other stuff you are running. Not an option in this case, but thank you for the suggestion anyway :) 2. If you are rsyncing from / --relative

Re: Multi-Threading?

2011-05-17 Thread Chuck Wolber
On Tue, 17 May 2011, cac...@quantum-sci.com wrote: In researching this I find that a change to multi-threaded goodness would require a massive rewrite, and would only be considered for an rsync replacement. Abstracting the core functionality into a librsync.so would be really spiffy too...

Re: Multi-Threading?

2011-05-17 Thread Chuck Wolber
On Tue, 17 May 2011, Matt McCutchen wrote: On Tue, 2011-05-17 at 10:54 -0700, Chuck Wolber wrote: Abstracting the core functionality into a librsync.so would be really spiffy too... All easy to say, harder to do (and maintain). I'm thankful that rsync meets my needs right now

Re: compression of source and target files

2007-09-21 Thread Chuck Wolber
On Fri, 21 Sep 2007, Kenneth Simpson wrote: Hi - there's a flag for rsync to compress the files in transit - is it possible to compress one side (target) with gzip and have rsync still work correctly? It'll still work correctly, but compressing a compressed file can actually make it

Access Database

2007-08-16 Thread Chuck Wolber
One of our servers is a CentOS 4 Linux/Samba filesharing server that serves an access database (via a mapped drive) to a client application running on Windows 98. Ever since we started rsync'ing it to back it up every night, it required samba to be restarted after the backup or the clients

Re: Compression error?

2007-07-19 Thread Chuck Wolber
On Thu, 19 Jul 2007, WCSL wrote: Seems to work fine without compression -z flag omitted. Is this going through a Watchguard firewall at any point? ..Chuck.. -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology The measure of the

Re: Rysnc Schedule

2007-07-18 Thread Chuck Wolber
On Wed, 18 Jul 2007, sparty2809 wrote: What I want to do is use rsync to back up a folder to an external drive. I would like to keep 30 days worth. For example: I have backups of June 1 - June 30. Once July 1 comes along, I want to keep June 2 - July 1 and delete June 1, and so forth.

Re: Rysnc Schedule

2007-07-18 Thread Chuck Wolber
On Wed, 18 Jul 2007, sparty2809 wrote: I understand how to do the rsync part, but how would I delete the files? In linux, you delete files with the rm command... In windows you'd probably want to use deltree... Or, you could get really fancy and use directed charges of thermite, although that

--hard-links performance

2007-06-05 Thread Chuck Wolber
Have the hard-links optimizations that were described here been implemented? http://lists.samba.org/archive/rsync/2004-January/008137.html In any case, what's the general consensus behind using the --hard-links option on large (100GB and above) images? Does it still use a ton of memory? Or

Re: --hard-links performance

2007-06-05 Thread Chuck Wolber
On Tue, 5 Jun 2007, Paul Slootman wrote: In any case, what's the general consensus behind using the --hard-links option on large (100GB and above) images? Does it still use a ton of memory? Or has that situation been alleviated? The size of the filesystem isn't relevant, the number of

Re: overflow error

2007-05-04 Thread Chuck Wolber
On Fri, 4 May 2007, Wayne Davison wrote: On Tue, Apr 03, 2007 at 02:22:46PM -0500, David Harfst wrote: overflow: flags=0x69 l1=110 12=1633837871 lastname= ERROR: buffer overflow in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(147) That's

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: we did some research and we would like to try to write a Tcl/Tk wrapper around rsync. Any chance you'd be willing to consider doing it in Java? There's already at least one, now unmaintained, Java class wrapper to rsync that I know of (not to be

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: Any chance you'd be willing to consider doing it in Java? There's already at least one, now unmaintained, Java class wrapper to rsync that I know of (not to be confused with the Java implementation of rsync, also currently unmaintained).

Re: tcl/tk rsync wrapper planned

2006-10-17 Thread Chuck Wolber
On Tue, 17 Oct 2006, [EMAIL PROTECTED] wrote: Chuck Wolber wrote: I've always wanted to have an api like that, but I've always been wary of chasing protocol changes. A wrapper is the simplest way, but it's still a bad approach IMHO. librsync is sort of a good idea too, but the idea

Re: backup system files (and permissions) over ssh

2006-10-12 Thread Chuck Wolber
On Thu, 12 Oct 2006, [EMAIL PROTECTED] wrote: Quote: Without root: Use a non-root account and use passwordless sudo in the script. sounds interesting, can you explain how am i suppose to do that ? who runs the script ? when ? Check the man page for the sudoers file: man 5 sudoers.

RE: Cygwin rsync to RH rsync server

2006-06-23 Thread Chuck Wolber
On Fri, 23 Jun 2006, Jason Staudenmayer wrote: So you have it working with cygwin(svr) to cygwin(cli) transfers but not linux(svr) to cygwin(cli) No, we have it working where we have to set up a tunnel (via ssh) to the cygwin machine and then set up rsync as a daemon with paths pre-specified

RE: Cygwin rsync to RH rsync server

2006-06-20 Thread Chuck Wolber
On Tue, 20 Jun 2006, Jason Staudenmayer wrote: Ok, so it's a Cygwin issue. Might I ask if anyone on the list has a working cygwin/rsync combo they might be able to share. I've tried downloading some old cygwin versions but so far nothing has been working. We've gotten it to work, but only

Re: Data Encryption

2006-06-12 Thread Chuck Wolber
On Mon, 12 Jun 2006, Brad Farrell wrote: Is there a way with rsync to encrypt data at the source before transmitting? Not talking about the actually transmission, but the data itself. I've got a few department heads that want their data secured before it leaves their computer so that no

Deleted Data

2006-04-17 Thread Chuck Wolber
Greetings, When using the --delete argument, is there any way to get rsync to tell me how much data it deleted after a run? ..Chuck.. -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology The measure of the restoration lies in the

Re: proposed new parameter: --time-limit 5:30

2005-06-15 Thread Chuck Wolber
On Wed, 15 Jun 2005, ches wrote: I find that rsync is an excellent tool for backing up my large partitions, often over slower links on the Internet. I run a cron job every night to update backup mirrors. But occasionally I make large changes to the source disk, and the rsync update

--one-file-system problem

2005-03-01 Thread Chuck Wolber
rsync commandline: /usr/bin/rsync -e /usr/bin/ssh --archive --compress --sparse --verbose --stats --delete --numeric-ids --partial --relative --one-file-system target.host:/ /destination/path/ target rsync version: 2.6.3 destination rsync version: 2.6.2 The server we're trying to

Re: Inflate Error?

2004-12-15 Thread Chuck Wolber
On Tue, 7 Dec 2004, Wayne Davison wrote: On Mon, Dec 06, 2004 at 09:38:14AM -0800, Chuck Wolber wrote: inflate (token) returned -5 You should be able to avoid this error by turning off the --compress option. Yup, that solved it. To figure out why it is occurring would require someone

Re: rsync seems to hang when --delete option is used.

2004-12-09 Thread Chuck Wolber
On Thu, 9 Dec 2004, Tony Shum wrote: When I use --delete option, it seems to hang for over 8 hours on 4.5Gb of total data. But when I remove the --delete option, I can see it starts rsyncing. Has anyone encounter this problem before? What type of filesystem is your data on (ext3, xfs,

Inflate Error?

2004-12-06 Thread Chuck Wolber
I've been getting this error message for a few days from a customer's server and we can't seem to decipher it. I googled for it and only found references to it with respect to much older versions of rsync. We're running the Debian packaged version of rsync version 2.6.2-3. The customer side

Dynamic bwlimit

2004-11-05 Thread Chuck Wolber
It would be useful to be able to send a signal to an active rsync process to get it to throttle (up or down) the bwlimit parameter. Is this a pandora's box, or is it useful for an interested party to put some effort into this? -Chuck -- http://www.quantumlinux.com Quantum Linux

Re: Re: rsync 2.6.2 hang (was rsync 2.6.2 crash)

2004-09-28 Thread Chuck Wolber
On Tue, 28 Sep 2004, jim wrote: Hey, that's pretty funny. Actually, I would much prefer a Linux environment, but I don't always get what I want. We are primarily a Windows and HP-UX shop, so it's not so easy get the powers that be to buy into a Linux box. Bummer, I feel your pain. As for

Re: Anyone syncing database files?

2004-08-24 Thread Chuck Wolber
On Fri, 20 Aug 2004, Loukinas, Jeremy wrote: Anyone syncing say 18-20gb Oracle dbf files..? We're syncing well over 185 GB of sleepycat BDB files. I'm not sure how well they relate to Oracle files. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING

Re: Help: rsync queries

2004-07-17 Thread Chuck Wolber
On Fri, 16 Jul 2004, Swapnil wrote: 1. I want to know whether rsync server and client are available for * Novell servers * Windows 2003 * Windows 2000 server * Windows NT * Windows XP * Xservers * Mac OS X * Mac OS 9 I am unaware about

Re: Help: rsync queries

2004-07-17 Thread Chuck Wolber
On Fri, 16 Jul 2004, Chuck Wolber wrote: 5. I want to know If rsync Server is receiving the data of around 1 GB every day what is harware configuration recommended for the better performance. We maintain just under 1TB per server with 20 or 30 backup targets and don't see the load

Berkley DB

2004-07-17 Thread Chuck Wolber
We are rsync'ing large (hundreds of GB) and constantly changing Berkley DB (aka Sleepycat) datasets (the RPM database uses the same thing, but its dataset is extremely small). When a change occurs (insert, update, delete, etc) in a BDB it has a tendency to propagate through the binary database

Re: Backup script

2004-07-08 Thread Chuck Wolber
On Thu, 8 Jul 2004, spivkid wrote: I guess I need a full copy of the data that is need to be backup from the remote box on my local box so rsync can compare the file different each date? Not really. Having no data on the remote box means that there's more to transfer across from the source

Re: Realtime rsyncing

2004-07-05 Thread Chuck Wolber
On Mon, 5 Jul 2004, Henry van der Beek wrote: Hi, I am trying to synchronise two directories on separate machines across a network using rsync, but I want to apply rsync whenever the contents of the directories are altered, rather than using a cron job. Does anyone have any ideas? We are

Re: faq-o-matic gone

2004-05-28 Thread Chuck Wolber
On Thu, 27 May 2004, John Taylor wrote: If someone were to start maintaining a FAQ, I might be interested in helping out. Also, I really hate faq-o-matic. I like the plain ole flat file FAQ in html. Amen! -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC.

New Error

2004-05-17 Thread Chuck Wolber
I've never seen this one before. I'm using rsync 2.6.2 on both ends. Server (Athlon, 768MB RAM) checks out just fine. The only anomoly appears to be that this process has been running for 248268.43 seconds (this is not unexpected with this particular host we're backing up). Commandline:

Re: Would this patch be useful...

2004-05-14 Thread Chuck Wolber
On Fri, 14 May 2004, Wayne Davison wrote: On Tue, May 11, 2004 at 11:41:02AM -0400, John Taylor wrote: I am considering a patch that would exclude compressing a given list of file extensions when the -z option is used. Well, since the daemon code has this, it makes sense to at least

Re: rsync and Perl programming

2004-05-05 Thread Chuck Wolber
On Wed, 5 May 2004, Jim Salter wrote: Hi everybody - I'm trying to write a Perl wrapper for some rsync tasks that need doing. Problem is, there's some sort of odd interaction going on between Perl and the daemon mode communication for the rsync client, and I'm at my wit's end in trying

Feature Request

2004-04-27 Thread Chuck Wolber
Just built 2.6.1 and started testing it. Nice job guys. I especially love the --progress and hardlink tweaks. Quite often, while I have systems backing up out of cron, I'd love to be able to see the --progress. Unfortunately, it's just not practical to crank up the verbosity like that on a

Re: [PATCH] time limit

2004-04-21 Thread Chuck Wolber
On Tue, 20 Apr 2004, Daemian Mack wrote: That's more or less the ugly hack referred to previously. It does work as expected, but personally, I'd rather there were a native rsync method of achieving this. Less kludgy. What might be even better is if there were a cleaner API that rsync

Re: [PATCH] time limit

2004-04-19 Thread Chuck Wolber
On Mon, 19 Apr 2004, Wayne Davison wrote: On Mon, Apr 19, 2004 at 04:28:08PM -0400, John Taylor wrote: I have written a patch for rsync-2.6.1pre-2 which adds a --time-limit=T option. Thanks -- I've added it to the patches dir for now. If folks think it is useful, it will eventually get

link-dest

2004-03-08 Thread Chuck Wolber
System is current Debian stable with rsync version: * rsync version 2.6.0 protocol version 27 * Capabilities: 64-bit files, socketpairs, hard links, symlinks, * batchfiles, IPv6, 64-bit system inums, 64-bit internal inums * * Modified for Debian to have --bwlimit-mod, a variation on the

Re: Full backup

2004-02-06 Thread Chuck Wolber
On Fri, 6 Feb 2004, Thorsten Schacht wrote: Hey guys, I'd like to take a full backup of our email server. Is it possible to clone the current server (postfix, spamassassin, qpopper...) to another clean system to have it ready if the current one fails? Yes. In fact we offer that to our

Re: AW: Full backup

2004-02-06 Thread Chuck Wolber
On Fri, 6 Feb 2004, Thorsten Schacht wrote: Sounds goot but I do not need 'one' backup folder. Not an iso. What I actually mean is that there is a identical clone of the current mail server. The backups are made into a folder, but then you chroot into that folder and run the environment as

Re: Rsync's Speed

2004-01-22 Thread Chuck Wolber
During my initial download for my home directory backup, it took rsync over 6 hours to do the initial backup, but I can FTP the stuff in about 30 Mins. Is Rsync usualy this slow? I have compression turned on, and its across a 100 MB/S network, Anyone had this problem before? In this case,

Re: Buffer Overflow?

2004-01-18 Thread Chuck Wolber
Maybe it is time to upgrade. Yes, that's the plan. I just figured the list was interested in the message. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology The measure of the restoration lies in the extent to which we

Buffer Overflow?

2004-01-17 Thread Chuck Wolber
Just got this from our nightly backup rsync: overflow: flags=0x6e l1=99 l2=1952984691 lastname=var/www/manual/mod/mod_php4/de/function.get-exte ERROR: buffer overflow in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(238) Command exited with non-zero

Re: rsync backup

2004-01-15 Thread Chuck Wolber
I've setup SSH for auto login. It seems I can just do rsync -e ssh -aupg 10.10.10.24:/home/MYDOMAIN /home fine Do I still need /etc/rsyncd.conf on the server? Nope. I do the same thing, and I've never needed it. -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC.

Re: Shorten long lines in man page options summary

2003-12-29 Thread Chuck Wolber
One thing that's bugged me is that some of the man page lines in the options summary are longer than 79 chars and wrap onto the next line. % SNIP $ SNIP Comments? Suggestions? I second your point. It's a real pain in the butt to be in a noisy datacenter at 4am with nothing but a console

Re: Permissions Problems

2003-12-22 Thread Chuck Wolber
Here's my command copied from a shell script:\ rsync --verbose --progress --stats --compress --rsh=/usr/bin/ssh --recursive --times --perms --links \ /home/* [EMAIL PROTECTED]:/remotebackups/ It looks like you don't have the --delete in there (which you should have to keep identical

Re: partial transfer

2003-12-18 Thread Chuck Wolber
I am attempting to use rsync to backup a Win98 laptop to a FreeBSD 4.8 backup server. I have experienced the same problem at roughly the same point in the process on two occations. The laptop contains ~2.7Gb of data. On the first attempt we received this error at 2.3Gb and on the second at