y, 11 May 2001 11:42
To: RSync List (E-mail)
Subject: Problem with large include files
Hi there
I recently tried to do a transfer of a directory tree with about 120,000
files. I needed to select various files and used the --include-from option
to select the files I needed to transfer. The i
e
> San Jose, CA 95131 SERI trenwick@usvlsjs1 | limit one more time!
> - Eagles
>
> [EMAIL PROTECTED]@[EMAIL PROTECTED] on 05/15/2001 10:36:47
> Sent by:[EMAIL PROTECTED]
> To: [EMAIL PROTECTED]@SMTP
> cc: [EMAIL PROTECTED]@SMTP
> S
On Wed, May 16, 2001 at 05:25:03PM +1200, Wilson, Mark - MST wrote:
> How do I go about "registering" this bug with the include file.
I don't think there's any point registering it until you have better
confirmed that that is indeed the problem. Also, if developers have no way
of reproducing th
EMAIL PROTECTED]@[EMAIL PROTECTED] on 05/15/2001 10:36:47
Sent by:[EMAIL PROTECTED]
To: [EMAIL PROTECTED]@SMTP
cc: [EMAIL PROTECTED]@SMTP
Subject:RE: FW: Problem with large include files
Classification:
How do I go about "registering" this bug with the include
al Message-
From: Dave Dykstra [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, 16 May 2001 01:24
To: Wilson, Mark - MST
Cc: RSync List (E-mail)
Subject: Re: FW: Problem with large include files
On Tue, May 15, 2001 at 03:31:23PM +1200, Wilson, Mark - MST wrote:
...
> Do you have any idea what the maxi
On Tue, May 15, 2001 at 03:31:23PM +1200, Wilson, Mark - MST wrote:
...
> Do you have any idea what the maximum number of files you can have in an
> include file is (for the current version)?
No, I don't. It probably depends on a lot of variables.
> How do you want your test on 2.3.2 done? ie L
-Original Message-
From: Wilson, Mark - MST
Sent: Tuesday, 15 May 2001 15:31
To: 'Dave Dykstra'
Subject: RE: Problem with large include files
> No, rsync can't run over UDP. Perhaps there are some TCP parameters you
> can tweak. I wouldn't be surprised
On Tue, May 15, 2001 at 08:54:08AM +1200, Wilson, Mark - MST wrote:
>
> > Try rsync 2.3.2 on both ends and see what the result is.
>
> > What transport method are you using (rsh, ssh, or rsync --daemon mode)?
>
> --daemon mode. Some tests a colleague did showed a performance advantage.
>
>
> Try rsync 2.3.2 on both ends and see what the result is.
> What transport method are you using (rsh, ssh, or rsync --daemon mode)?
--daemon mode. Some tests a colleague did showed a performance advantage.
> Come to think of it, I know from experience that rsync is able to keep the
> TCP q
On Mon, May 14, 2001 at 01:32:01PM -0700, Wayne Davison wrote:
> On Fri, 11 May 2001, Dave Dykstra wrote:
> > The optimization bypassed the normal recursive traversal of all the
> > files and directly opened the included files and sent the list over.
>
> There's an alternative to this optimizatio
On Fri, 11 May 2001, Dave Dykstra wrote:
> The optimization bypassed the normal recursive traversal of all the
> files and directly opened the included files and sent the list over.
There's an alternative to this optimization: if we could read the
source files from a file (or stdin), we could us
On Mon, May 14, 2001 at 11:13:40AM -0500, Dave Dykstra wrote:
...
> > As a thought, have you or any of the other developers thought of getting
> > rsync to operate over a number of streams or to use "sliding windows" to
> > overcome latency effects?
>
> I don't recall that that subject has been d
On Mon, May 14, 2001 at 03:12:27PM +1200, Wilson, Mark - MST wrote:
> Dave
>
> A couple of points:
>
> 1. I think you are telling me that if I go back to 2.3.2 my problems should
> go away. Is this correct?
Hopefully, assuming you trigger the optimization (no wildcards in the
includes followed
tion * <mailto:[EMAIL PROTECTED]>
Data Management & Security * 313-39-01744
-Original Message-
From: Wilson, Mark - MST [mailto:[EMAIL PROTECTED]]
Sent: Sunday, May 13, 2001 11:12 PM
To: 'Dave Dykstra'
Cc: RSync List (E-mail)
Subject: RE: Problem with large
ly.
Cheers
Mark
-Original Message-
From: Dave Dykstra [mailto:[EMAIL PROTECTED]]
Sent: Saturday, 12 May 2001 01:43
To: Wilson, Mark - MST
Cc: RSync List (E-mail)
Subject: Re: Problem with large include files
On Fri, May 11, 2001 at 11:41:41AM +1200, Wilson, Mark - MST wrote:
> Hi there
&
On Fri, May 11, 2001 at 11:41:41AM +1200, Wilson, Mark - MST wrote:
> Hi there
>
> I recently tried to do a transfer of a directory tree with about 120,000
> files. I needed to select various files and used the --include-from option
> to select the files I needed to transfer. The include file ha
Hi,
My experience on Solaris was very similar. It took about 4 tries before
all of the files were transferred and I had to kill the remote daemon each
time. However, after all the files were transferred the first time, rsync
has flawlessly kept everything in sync. I'm guessing it's a bug.
Bob
Hi there
I recently tried to do a transfer of a directory tree with about 120,000
files. I needed to select various files and used the --include-from option
to select the files I needed to transfer. The include file had 103,555
filenames in it. The problem I have is that the transfer quit after
18 matches
Mail list logo
