Odd behavior

2010-04-22 Thread Erich Weiler
Hi Y'all, I'm seeing some interesting behavior that I was hoping someone could shed some light on. Basically I'm trying to rsync a lot of files, in a series of about 60 rsyncs, from one server to another. There are about 160 million files. I'm running 3 rsyncs concurrently to increase the

Re: Odd behavior

2010-04-22 Thread Erich Weiler
Well, I solved this problem myself, it seems. It was not an rsync problem, per se, but it's interesting anyway on big filesystems like this so I'll outline what went down: Because my rsyncs were mostly just statting millions of files very quickly, RAM filled up with inode cache. At a

Re: Odd behavior

2010-04-22 Thread Eberhard Moenkeberg
Hi, On Thu, 22 Apr 2010, Erich Weiler wrote: Well, I solved this problem myself, it seems. It was not an rsync problem, per se, but it's interesting anyway on big filesystems like this so I'll outline what went down: Because my rsyncs were mostly just statting millions of files very

Re: Odd behavior in an exclude-file

2009-01-04 Thread Roy F. Cabaniss
On Monday 22 December 2008 03:38:20 pm Matt McCutchen wrote: On Fri, 2008-12-19 at 10:01 -0600, Roy F. Cabaniss wrote: rsync -avl --stats --progress --timeout=300 --exclude-from /home/foo/bin/exclude.txt /home /mnt/sdc2 Since there are, as with any backups, files I don't want to bother

Re: Odd behavior in an exclude-file

2008-12-22 Thread henri
Try putting some additional line breaks at the end of your file. I am not sure if this will solve your issues. Give it a go and report back if this resolves the issue. Hope this helps I decided the most secure way to deal with backup/firewall issues between my work and home was to encrypt

Re: Odd behavior in an exclude-file

2008-12-22 Thread Matt McCutchen
On Fri, 2008-12-19 at 10:01 -0600, Roy F. Cabaniss wrote: rsync -avl --stats --progress --timeout=300 --exclude-from /home/foo/bin/exclude.txt /home /mnt/sdc2 Since there are, as with any backups, files I don't want to bother backing up I created an exclude file and stored it in my bin.

Odd behavior in an exclude-file

2008-12-19 Thread Roy F. Cabaniss
I decided the most secure way to deal with backup/firewall issues between my work and home was to encrypt a portable hard drive and make it my backup. Lug it back and forth and sync as appropriate. So I wrote myself a little rsync script which grabs all the files I think of as taking work to

odd behavior on remote

2008-05-08 Thread George Georgalis
I've been using rsync for some time (years) to generate many hardlink snapshots per day; but I'm seeing an odd new problem today. the remote/destination host gets a file list from the source machine via ssh, and begins to write files until it hangs. On this run only one file was transferred; on

Re: odd behavior on remote

2008-05-08 Thread George Georgalis
On Thu 08 May 2008 at 11:52:08 AM -0400, George Georgalis wrote: I've been using rsync for some time (years) to generate many hardlink snapshots per day; but I'm seeing an odd new problem today. OOOh, nevermind... FilesystemSize Used Avail Capacity iusedifree %iused Mounted

Re: Odd behavior with --detect-renamed

2007-12-29 Thread Matt McCutchen
On Fri, 2007-12-28 at 17:31 +0100, Erik Pettersson wrote: I'm trying out the 'detect-renamed'-patch, and I've encountered some odd behavior. Basicly, what I've noticed is that if I move a file into a newly created directory (which is what happens if I rename a directory, for example

Odd behavior with --detect-renamed

2007-12-28 Thread Erik Pettersson
Hello, I'm totally new to this list, so I hope I don't break all the rules. :) I've looked through the archives (and google), and I really can't find the answer to my question. I'm trying out the 'detect-renamed'-patch, and I've encountered some odd behavior. I've applied the patch to both rsync

Odd behavior with rsync/ssh/--delete

2004-03-21 Thread Peter Wargo
I've just about googled my brains out over this one, and banged heads with several other SA buddies. I have a nightly rsync of a DMZ system (Solaris 8 SPARC[1]) to an internal system (RedHat ES 3.0 [2]). The internal system runs a cron job and pulls changes off of the DMZ system via ssh. (To