Re: FW: Problem with large include files

2001-05-16 Thread Dave Dykstra
On Wed, May 16, 2001 at 05:25:03PM +1200, Wilson, Mark - MST wrote: How do I go about registering this bug with the include file. I don't think there's any point registering it until you have better confirmed that that is indeed the problem. Also, if developers have no way of reproducing the

Re: FW: Problem with large include files

2001-05-16 Thread Eric Whiting
! - Eagles [EMAIL PROTECTED]@[EMAIL PROTECTED] on 05/15/2001 10:36:47 Sent by:[EMAIL PROTECTED] To: [EMAIL PROTECTED]@SMTP cc: [EMAIL PROTECTED]@SMTP Subject:RE: FW: Problem with large include files Classification: How do I go about registering this bug

Re: FW: Problem with large include files

2001-05-15 Thread Dave Dykstra
On Tue, May 15, 2001 at 03:31:23PM +1200, Wilson, Mark - MST wrote: ... Do you have any idea what the maximum number of files you can have in an include file is (for the current version)? No, I don't. It probably depends on a lot of variables. How do you want your test on 2.3.2 done? ie LAN

RE: FW: Problem with large include files

2001-05-15 Thread Wilson, Mark - MST
- From: Dave Dykstra [mailto:[EMAIL PROTECTED]] Sent: Wednesday, 16 May 2001 01:24 To: Wilson, Mark - MST Cc: RSync List (E-mail) Subject: Re: FW: Problem with large include files On Tue, May 15, 2001 at 03:31:23PM +1200, Wilson, Mark - MST wrote: ... Do you have any idea what the maximum number

RE: FW: Problem with large include files

2001-05-15 Thread tim . renwick
PROTECTED]@[EMAIL PROTECTED] on 05/15/2001 10:36:47 Sent by:[EMAIL PROTECTED] To: [EMAIL PROTECTED]@SMTP cc: [EMAIL PROTECTED]@SMTP Subject:RE: FW: Problem with large include files Classification: How do I go about registering this bug with the include file. It would

RE: Problem with large include files

2001-05-14 Thread Safi, Sam (S.M.)
* mailto:[EMAIL PROTECTED] Data Management Security * 313-39-01744 -Original Message- From: Wilson, Mark - MST [mailto:[EMAIL PROTECTED]] Sent: Sunday, May 13, 2001 11:12 PM To: 'Dave Dykstra' Cc: RSync List (E-mail) Subject: RE: Problem with large include files Dave

Re: Problem with large include files

2001-05-14 Thread Dave Dykstra
On Mon, May 14, 2001 at 03:12:27PM +1200, Wilson, Mark - MST wrote: Dave A couple of points: 1. I think you are telling me that if I go back to 2.3.2 my problems should go away. Is this correct? Hopefully, assuming you trigger the optimization (no wildcards in the includes followed by an

Re: Problem with large include files

2001-05-14 Thread Dave Dykstra
On Mon, May 14, 2001 at 11:13:40AM -0500, Dave Dykstra wrote: ... As a thought, have you or any of the other developers thought of getting rsync to operate over a number of streams or to use sliding windows to overcome latency effects? I don't recall that that subject has been discussed

Re: Problem with large include files

2001-05-14 Thread Wayne Davison
On Fri, 11 May 2001, Dave Dykstra wrote: The optimization bypassed the normal recursive traversal of all the files and directly opened the included files and sent the list over. There's an alternative to this optimization: if we could read the source files from a file (or stdin), we could use

Re: Problem with large include files

2001-05-14 Thread Dave Dykstra
On Mon, May 14, 2001 at 01:32:01PM -0700, Wayne Davison wrote: On Fri, 11 May 2001, Dave Dykstra wrote: The optimization bypassed the normal recursive traversal of all the files and directly opened the included files and sent the list over. There's an alternative to this optimization: if

FW: Problem with large include files

2001-05-14 Thread Wilson, Mark - MST
Try rsync 2.3.2 on both ends and see what the result is. What transport method are you using (rsh, ssh, or rsync --daemon mode)? --daemon mode. Some tests a colleague did showed a performance advantage. Come to think of it, I know from experience that rsync is able to keep the TCP

RE: Problem with large include files

2001-05-13 Thread Wilson, Mark - MST
[mailto:[EMAIL PROTECTED]] Sent: Saturday, 12 May 2001 01:43 To: Wilson, Mark - MST Cc: RSync List (E-mail) Subject: Re: Problem with large include files On Fri, May 11, 2001 at 11:41:41AM +1200, Wilson, Mark - MST wrote: Hi there I recently tried to do a transfer of a directory tree with about

Re: Problem with large include files

2001-05-11 Thread Dave Dykstra
On Fri, May 11, 2001 at 11:41:41AM +1200, Wilson, Mark - MST wrote: Hi there I recently tried to do a transfer of a directory tree with about 120,000 files. I needed to select various files and used the --include-from option to select the files I needed to transfer. The include file had

Problem with large include files

2001-05-10 Thread Wilson, Mark - MST
Hi there I recently tried to do a transfer of a directory tree with about 120,000 files. I needed to select various files and used the --include-from option to select the files I needed to transfer. The include file had 103,555 filenames in it. The problem I have is that the transfer quit after