RE: Mirroring OS X folders with Rsync

2003-07-30 Thread Adam Behn
I am using HFS but the files are being zipped up using stuff-it(MAC winzip/tar.gz) So forks aren't a problem since I don't need the metadata from the forked file when it is from a stuffed/zipped file. Unfortunatly the server in question is already online. It works most the time, but we do have to k

Re: Large files and symlinks

2003-07-30 Thread jw schultz
On Thu, Jul 31, 2003 at 11:21:48AM +1000, Donovan Baarda wrote: > On Thu, 2003-07-31 at 10:01, jw schultz wrote: > > On Thu, Jul 31, 2003 at 09:22:51AM +1000, Donovan Baarda wrote: > > > On Thu, 2003-07-31 at 06:53, jw schultz wrote: > The simplest solution is to write the partial download over the

Re: Large files and symlinks

2003-07-30 Thread Donovan Baarda
On Thu, 2003-07-31 at 10:01, jw schultz wrote: > On Thu, Jul 31, 2003 at 09:22:51AM +1000, Donovan Baarda wrote: > > On Thu, 2003-07-31 at 06:53, jw schultz wrote: > > [...] > > > In many cases invoking --partial is worse than not. If you > > > are rsyncing a 4GB file and transfer is interrupted a

Re: Large files and symlinks

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 05:01:26PM -0700, jw schultz wrote: > On Thu, Jul 31, 2003 at 09:22:51AM +1000, Donovan Baarda wrote: > > On Thu, 2003-07-31 at 06:53, jw schultz wrote: > > [...] > > > In many cases invoking --partial is worse than not. If you > > > are rsyncing a 4GB file and transfer is

Re: Large files and symlinks

2003-07-30 Thread jw schultz
On Thu, Jul 31, 2003 at 09:22:51AM +1000, Donovan Baarda wrote: > On Thu, 2003-07-31 at 06:53, jw schultz wrote: > [...] > > In many cases invoking --partial is worse than not. If you > > are rsyncing a 4GB file and transfer is interrupted after > > 500MB has been synced you get a 500MB file which

Re: Mirroring OS X folders with Rsync

2003-07-30 Thread Martin Langhoff
What filesystem are you using? If you are using HFS or HFS+ I suggest you give UFS a try because it all the filesystem semantics are what unix tools expect. While I haven't seen your specific problem, I am sure there are quite a few situations where rsync and other unix tools will be confused o

Re: Large files and symlinks

2003-07-30 Thread Donovan Baarda
On Thu, 2003-07-31 at 06:53, jw schultz wrote: [...] > In many cases invoking --partial is worse than not. If you > are rsyncing a 4GB file and transfer is interrupted after > 500MB has been synced you get a 500MB file which now has > less in common with the source than the 4GB file did. A more

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 11:39:06PM +0100, Alan Burlison wrote: > Wayne Davison wrote: > > >The best way to do this is to use a starting dir, the --recursive > >option, and then exclude all subdirs: > > > >rsync -av exclude='*/' host::module/path/ . > > That works (thanks), but isn't exactly intui

Re: rsync 2.5.6 timeout bug

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 11:23:17PM +0100, Alan Burlison wrote: > I've been getting frequent io errors trying to synchronise a local CPAN > mirror with the master on ftp.funet.fi, the symptoms being the dreaded > > rsync: connection unexpectedly closed (0 bytes read so far) > rsync error: error in

RE: Rsync configuration

2003-07-30 Thread Michael Fairchild
Please reply to the list, not to me. On Wed, 2003-07-30 at 15:35, Bhattacharyya, Somraj wrote: > Thanks for the reply. I will do it tomorrow morning in lab. Just a small > clarification, > > rsync -ae ssh /home/httpd/htdocs/ replica:/home/httpd/htdocs/ in this > command I hope "replica:" stands f

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread Alan Burlison
Wayne Davison wrote: The best way to do this is to use a starting dir, the --recursive option, and then exclude all subdirs: rsync -av exclude='*/' host::module/path/ . That works (thanks), but isn't exactly intuitive ;-) Since the arg-list created for file globbing is allocated memory extra to t

rsync 2.5.6 timeout bug

2003-07-30 Thread Alan Burlison
I've been getting frequent io errors trying to synchronise a local CPAN mirror with the master on ftp.funet.fi, the symptoms being the dreaded rsync: connection unexpectedly closed (0 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(165) message at the client

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread Wayne Davison
On Wed, Jul 30, 2003 at 11:06:03PM +0100, Alan Burlison wrote: > What I'm trying to do is just mirror a given directory *without* > recursively descending into subdirs. The best way to do this is to use a starting dir, the --recursive option, and then exclude all subdirs: rsync -av exclude='*/' h

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 11:06:03PM +0100, Alan Burlison wrote: > jw schultz wrote: > > >On Wed, Jul 30, 2003 at 10:44:37PM +0100, Alan Burlison wrote: > > > >>$ rsync -auv \ > >>ftp.funet.fi::CPAN/modules/by-category/05_Networking_Devices_IPC/Net/* . \ > >>| grep -v MOTD: > > > >Cockpit error. > >

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread Alan Burlison
jw schultz wrote: On Wed, Jul 30, 2003 at 10:44:37PM +0100, Alan Burlison wrote: $ rsync -auv \ ftp.funet.fi::CPAN/modules/by-category/05_Networking_Devices_IPC/Net/* . \ | grep -v MOTD: Cockpit error. This isn't DOS. Don't use * when you want the all directory contents. rsync -auv ftp.funet.fi

Re: rsync 2.5.6 globbing bug

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 10:44:37PM +0100, Alan Burlison wrote: > $ rsync -auv \ > ftp.funet.fi::CPAN/modules/by-category/05_Networking_Devices_IPC/Net/* . \ > | grep -v MOTD: Cockpit error. This isn't DOS. Don't use * when you want the all directory contents. rsync -auv ftp.funet.fi::CPA

rsync 2.5.6 globbing bug

2003-07-30 Thread Alan Burlison
$ rsync -auv \ ftp.funet.fi::CPAN/modules/by-category/05_Networking_Devices_IPC/Net/* . \ | grep -v MOTD: rsync: connection unexpectedly closed (1598 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(165) This is because the array used to hold the expanded filena

Re: Mirroring OS X folders with Rsync

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 11:22:58AM -0500, Adam Behn wrote: > I'm just looking for some advice on a project I am currently working on. > > I have two OS X servers and I am looking to use rsync to mirror data between > the two. I just love the fact that rsync only moves the data incrementally. > It

Re: Slow rsync Performance

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 12:10:49PM -0400, Jose Binoj wrote: > Hi all, > I know this subject is extensively discussed on the mail list but I did not > get the solution yet.. > > I have a server running RedHat Linux 7.2 (2 CPU, 4 Gb RAM) and 6 client > machines running RedHat linux 7.1 ( 1 cpu(2Gh

Re: Large files and symlinks

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 01:48:09PM +0100, Tim Shaw wrote: > Hi, > > I'm mirroring a single server to multiple clients. Currently I'm using > scp, but I (think I) want to use rsync. > > The files I'm mirroring are large - c.4GB (video data) > > Each client has a different set of these files. >

Re: EOF error at io.c line 165

2003-07-30 Thread Thomas Cort
> Are you using the -z flag for compression? If so, are you using > the latest CVS version? There was a bug in token.c that was recently I've tried it with and without compression and I get the same error. I think it may be a problem with the server I'm connecting to. My box is part of a mirror s

Mirroring OS X folders with Rsync

2003-07-30 Thread Adam Behn
I'm just looking for some advice on a project I am currently working on. I have two OS X servers and I am looking to use rsync to mirror data between the two. I just love the fact that rsync only moves the data incrementally. It is very efficient and since I'm more of a Linux user and I feel comfo

Slow rsync Performance

2003-07-30 Thread Jose Binoj
Hi all, I know this subject is extensively discussed on the mail list but I did not get the solution yet.. I have a server running RedHat Linux 7.2 (2 CPU, 4 Gb RAM) and 6 client machines running RedHat linux 7.1 ( 1 cpu(2Ghz),512 Mb RAM ). I am backing up the client machine every 15 minutes si

RE: Rsync configuration

2003-07-30 Thread fairchild
> Very important I am just stucked at this point. > > Hi > > I started working on rsync and RH8 linux recently. I have loaded the > rsync-2.5.5-1.i386.rpm. The list of rsync help paramets are coming on > screen,when I am typing rsync -h. > > But I coulnot find any rsync.conf file in my linux box. C

Re: EOF error at io.c line 165

2003-07-30 Thread Andrew J. Schorr
Hi Thomas, On Wed, Jul 30, 2003 at 12:33:45AM -0400, Thomas Cort wrote: > I keep getting rsync: connection unexpectedly closed (1074142 bytes read so far) > rsync error: error in rsync protocol data stream (code 12) at io.c(165). Does > anyone have any idea of what could cause this? I've gotten th

Re: Please advise (web page replication in Linux)

2003-07-30 Thread lackluster lackluster
Yeah, rsync is capable. But you should also look at wget and see what one you want/need to fit your situation. Read the man pages for both. Original Message Follows From: "Bhattacharyya, Somraj" <[EMAIL PROTECTED]> To: "'[EMAIL PROTECTED]'" <[EMAIL PROTECTED]> Subject: Please advise (web

RE: Rsync configuration

2003-07-30 Thread Bhattacharyya, Somraj
Very important I am just stucked at this point. Hi I started working on rsync and RH8 linux recently. I have loaded the rsync-2.5.5-1.i386.rpm. The list of rsync help paramets are coming on screen,when I am typing rsync -h. But I coulnot find any rsync.conf file in my linux box. Could anyone pl

Rsync configuration

2003-07-30 Thread Bhattacharyya, Somraj
Hi I started working on rsync and RH8 linux recently. I have loaded the rsync-2.5.5-1.i386.rpm. The list of rsync help paramets when I am typing rsync -h. But I coulnot find any rsync.conf file in my linux box. Could anyone please tell me how to confgure and launch rsync for the following purpos

Please advise (web page replication in Linux)

2003-07-30 Thread Bhattacharyya, Somraj
Hi I am working on a project of replication and need to know about few options related to web page replication in Red Hat linux/Apache enviornment. I am new in Linux. The scenario: I have two apache servers running on RH Linux-8 boxes. One of my web server is the master server(146.176.165.2) and

Large files and symlinks

2003-07-30 Thread Tim Shaw
Hi, I'm mirroring a single server to multiple clients. Currently I'm using scp, but I (think I) want to use rsync. The files I'm mirroring are large - c.4GB (video data) Each client has a different set of these files. The transfer is done over the internet, and may fail (regularly!). I set up

Re: EOF error at io.c line 165

2003-07-30 Thread John Van Essen
On Tue, 29 Jul 2003, jw schultz <[EMAIL PROTECTED]> wrote: >On Wed, Jul 30, 2003 at 12:33:45AM -0400, Thomas Cort wrote: >> Hello All, >> I keep getting rsync: connection unexpectedly closed (1074142 bytes read so far) >> rsync error: error in rsync protocol data stream (code 12) at io.c(165). Does

Re: Usage of --exclude and --include-from options

2003-07-30 Thread jw schultz
Please buy a carriage return key before posting again. On Wed, Jul 30, 2003 at 03:41:53AM -0500, Stanisa Amidzic wrote: > rsync -a --force --delete --delete-after -P --exclude=/ > --include-from=/etc/rsync_inc [EMAIL PROTECTED]::module-name/ / > > Here is a small section of /etc/rsync_inc > /tmp/

Usage of --exclude and --include-from options

2003-07-30 Thread Stanisa Amidzic
I am using rsync 2.5.6 on the client side and 2.5.4 on the server side. I am trying to syncronise files and dirs on the client with the files on the server, but only a subset of files are located on the server, and I wish to leave all other files on the client machine untouched. This would be ea

Re: Logging problem

2003-07-30 Thread jw schultz
On Wed, Jul 30, 2003 at 09:45:53AM +0200, René van der Kroft wrote: > At 02:42 29-7-2003 -0700, you wrote: > >On Tue, Jul 29, 2003 at 10:55:56AM +0200, René van der Kroft wrote: > >> > >> All the files are transferred successfully but logging doesn't work OK. > >> When I add a file into the /home d

Re: Logging problem

2003-07-30 Thread René van der Kroft
At 02:42 29-7-2003 -0700, you wrote: On Tue, Jul 29, 2003 at 10:55:56AM +0200, René van der Kroft wrote: > > All the files are transferred successfully but logging doesn't work OK. > When I add a file into the /home directory rsync picks him up and transfers > him to the server, but when I look in