On Wed, Oct 25, 2000 at 04:47:27PM +0200, Eckebrecht von Pappenheim wrote:
Dave Dykstra wrote:
Were using rsh, ssh, or daemon mode?
I used ssh 1.2.27 on both machines. Again, with 2.3.1 we didn't have any
hangs at all...
Eckebrecht
Has it been compiled without the USE_PIPES
, but the above numbers indicate that either the Linux or FreeBSD
operating systems are at fault for not transmitting the send Q from Linux
to FreeBSD.
- Dave Dykstra
2) Assume that the internet link is down inbetween, how can i setup rsync, so
that it will automatically resume once the link is up.
Run it periodically from cron, or run it in a while loop while it returns
an error code.
- Dave Dykstra
when i tried to sync files between 2 machines in a
internet link.
What is the problem? Is there any options to avoid these errors?
You're probably running too old of a version of rsync. Some older versions
in the 2.4.* series had that problem.
- Dave Dykstra
On Tue, Nov 21, 2000 at 10:57:33PM +0100, Rolf Grossmann wrote:
Hi,
on Tue, 21 Nov 2000 15:11:22 -0600 Dave Dykstra wrote
concerning "Re: --exclude not used in all cases?" something like this:
Looks like the include "/*" from the server side is overriding
not. You also don't mention what
operating system(s) you are using.
- Dave Dykstra
local/bin/rsync"
or
--rsync-path "strace -o /tmp/rsync.strace /usr/local/bin/rsync"
You can also turn on ssh debugging with
-e "ssh -v"
Hm. I am running rsync 2.4.6, with OpenSSH 2.3.0p1. Both boxes have this
config, and are running linux:
- Dave Dykstra
cause the semantics of "**" is such
that including it anywhere in a pattern means that all asterisks can cross
slash boundaries. Thus, it will match baz/foo/oof/bar.c. As I said back
then, the rsync include/exclude semantics implementation needs to be
completely redone.
- Dave Dykstra
specification removes the base
name of the source from the destination filename. Use just
rsync -e ssh -aq tables data eros:
- Dave Dykstra
? If I recall correctly, rsync printed that
message whenever it had some kind of I/O error, but I believe it was always
after having printed another more descriptive message that pointed to the
real problem.
- Dave Dykstra
failing (looping or being flooded), service
terminated for 10 min
I could see no way to configure Linux inetd to avoid that, so I ended up
starting rsync as an independent daemon out of /etc/rc.d/rc3.d.
- Dave Dykstra
raight rcp on a particular file (noticed first in rsync,
reproducible with rcp). I will report more to this mailing list once I
find out a Sun patch number. There's a lot of TCP bugs out there, folks.
- Dave Dykstra
On Fri, Jan 05, 2001 at 10:19:34AM -0500, Rick Otten wrote:
Yes, the error message is coming because ssh is terminating early but I
don't think that the advice that Jason goes on to give (using extra keys,
expect, etc) is correct. There is no reason why rsync can't handle a
double
99-October/001466.html
and other messages in that thread.
- Dave Dykstra
You can add the "-L" option. Unfortunately, that will follow all symlinks
on the source too, not just that one.
- Dave Dykstra
On Wed, Jan 17, 2001 at 03:39:29PM -0500, Scott Gribben wrote:
We have been running rsync for a while and it works great! But, we just ran
into a situat
to handle
sparse files efficiently.
- Dave Dykstra
. Often people
break up their transfers into smaller pieces by copying each top level
directory separately.
- Dave Dykstra
hm is optimized for minimizing network traffic between its two
halves at the expense of extra local access and in your case the "network"
is between processes on the same machine and the "local" is over a
network.
- Dave Dykstra
?
- Dave Dykstra
.
- Dave Dykstra
pond to my challenge of giving performance
comparisons (http://lists.samba.org/pipermail/rsync/2001-January/003395.html).
- Dave Dykstra
ping directory /home/cable/src/ITG/Test_4.1.5
wrote 17 bytes read 16 bytes 66.00 bytes/sec
total size is 0 speedup is 0.00
[cable@galadriel]{1354}%
Right, I wouldn't expect it to do anything without -a.
- Dave Dykstra
/remsh on my Solaris 2.7 machine. If you have rsh but not remsh, a
workaround would be for you to use '-e rsh' or to give a complete path to
the -e.
- Dave Dykstra
for and get across the network, but not 100,000
files.
No, that behavior should be identical with the --include-from/exclude '*'
approach; I don't believe rsync uses any memory for excluded files.
- Dave Dykstra
doesn't make much sense as a destination because
in general URLs are for sources, not destinations; that's why it isn't
supported on that end.
- Dave Dykstra
--include-from /dev/fd/0 --exclude '*'
You will also need to include all parent directories of the files you
want.
I'm still waiting for somebody to do a performance test before implementing
--files-from ...
- Dave Dykstra
Yes, and by the way /etc/rsyncd.secrets isn't for rsh either, it is only
for the rsync daemon mode.
- Dave Dykstra
On Thu, Feb 01, 2001 at 02:08:21PM -0900, Britton wrote:
Copy you .ssh/identity.pub into .ssh/authorized_keys in your account on
the remote machine. If I am correct
es. Start by checking the
queues in the output of netstat on each side, and if they show something
queued to send you may need to go to tcpdump. If they don't, you may need
to go to strace to see where things are hanging.
- Dave Dykstra
On Mon, Feb 05, 2001 at 09:57:44AM -0600, Dave Dykstra wrote:
...
I think that openssh (that's what you're using, right?) already has the
modification to use socketpairs instead of pipes.
...
Oh, I just found another relevant message from Tridge:
On Fri, Oct 27, 2000 at 01:36:39PM +1000
to be the owner of a file to change the group.
Were the files already there owned by somebody else?
- Dave Dykstra
this type of functionality?
Yes, it has been thought about, and I think it is a good idea, but nobody
has done anything about it. I found an archive of a discussion from two
years ago in the rsync bugs tracker. See
http://rsync.samba.org/cgi-bin/rsync/todo?id=1592;user=guest;selectid=1592
- Dave Dykstra
t" is false, for security reasons
symlinks may only be relative paths pointing to other files
within the root path, and leading slashes are removed from
absolute paths.
- Dave Dykstra
name sent to a rsync
server.
Are there known issues with authentication in client-server mode which is
causing this to fail, or did I just do something stupid??
- Dave Dykstra
, it
seems to me that using '-e ssh' would be the best way for you to go instead
of an rsync daemon. Is there a reason why that's not an option for you?
- Dave Dykstra
in 2.4.6 (and that's why I couldn't reproduce it). I
wasn't aware of the problem or I would have encouraged you to upgrade. See
Revision 1.6 at
http://pserver.samba.org/cgi-bin/cvsweb/rsync/backup.c
- Dave Dykstra
cates they are not. Very
misleading and confusing.
The -n output has several inconsistencies compared to a real run. It needs
to be cleaned up. A couple years ago somebody promised to do it but it
never happened.
- Dave Dykstra
. Is there another way or
syntax to do this? I'd like to use such a statement in a perl script.
O. Wyss
Most modern operating systems allow you to specify /dev/fd/N where N is
the number of an open file descriptor. Stdin would be /dev/fd/0.
- Dave Dykstra
'wrote' and
'write')?
Yes, that's the way it works. -n doesn't go through enough of the process
to determine how many bytes will be written read without it.
How can I estimate how many data would really transferred before
rsyncing?
Currently there isn't a way that I know of.
- Dave Dykstra
ake a look?
I was just referring to things like rsh and ssh. Basically, anything that
provides a data pipe for rsync to work with.
- Dave Dykstra
On Wed, Feb 21, 2001 at 10:32:15AM -0500, Spleen wrote (in private email):
Thnaks for the reply! Answers to your questions are inline:
- Original Message -
From: "Dave Dykstra" [EMAIL PROTECTED]
To: "Spleen" [EMAIL PROTECTED]
Sent: Wednesday, February 21, 2001
/$DATE
No, --compare-dest has to be local.
- Dave Dykstra
at a loss.
Cheers.
Does the module have "read only = no"? The default is "yes".
- Dave Dykstra
to your full backup directory on your backup server.
3. rsync --delete from your source directory to your full backup; the
only thing that should happen then is deletes since you already
moved over changed files in step #2.
- Dave Dykstra
and we should just delete it. I'll go ahead and do that.
I would also like to know if you would have the same problem if you
compiled rsync 2.4.6 natively on solaris8. There may be some problem with
upward source incompatibility.
- Dave Dykstra
to limit what
it can do that can be done through the authorized_keys file as well.
- Dave Dykstra
: Dave Dykstra [EMAIL PROTECTED]
To: "David S. Miller" [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED], [EMAIL PROTECTED]
Subject: Re: Linux 2.2.16 through 2.2.18preX TCP hang bug triggered by rsync
David,
Regarding the patch you sent us (below) to try to help solve the problem of
Solar
de anytime the server side goes
away prematurely. You probably aren't yet stressing TCP because I don't
think much bidirectional traffic is exchanged so early, unless your first
file is very large.
- Dave Dykstra
On Wed, Feb 28, 2001 at 11:04:56AM +1100, Martin Pool wrote:
Dave Dykstra wrote:
How does everybody (especially Martin and Tridge) feel about the idea of
rsync defaulting to "-e ssh" if it is invoked under the name ssync? Around
here everybody is being told they should st
rsh
style security problems.
Right, but in particular the network commands that rsync is perceived
to be among. I assume the "r" in rsync was derived from the "r" in rsh
and probably many other people do too.
On Thu, Mar 01, 2001 at 01:16:29PM +1100, Martin Pool wrote:
On 28
*
But this will only allow processing of file and directories that start
with u. What I want is for everything below the ublahblah directory to
be copied. How to achieve this... simply?
Many thanks to those that help.
Use --include '/u*/' --exclude '/*/' (in that order).
- Dave Dykstra
Proposed patch to implement ssync follows. I decided to go ahead with
the shell script idea. Unless I hear objections, I'll figure on submitting
this to rsync CVS in a day or two.
- Dave Dykstra
*** configure.in.O Fri Mar 2 15:42:18 2001
--- configure.inFri Mar 2 16:27:53 2001
close attention to do a good job.
The most recently something related was discussed was last October but I
see it was done in private email so I will attach it here for the record.
Follow the references to previous discussions in January 1999.
- Dave Dykstra
On Wed, Oct 11, 2000 at 11:04:15AM
On Wed, Mar 07, 2001 at 11:01:00AM -0600, Dave Dykstra wrote:
I just did a measurement on a
copy between two nfs-mounted ~5MB files with and without -W and found it
took over 3 times longer without the -W.
I forgot to mention that the two files were nearly identical accept for
a little bit
things so that all files that
are hardlinked together are always in the same run. Alternatively, after
a file is transferred perhaps you create the hardlinks into the next
destination directory with your own script before letting rsync loose on it.
- Dave Dykstra
code base there would have to be corresponding configure and man page
changes before that could happen.
- Dave Dykstra
(former rsync maintainer)
a complicated authentication
mechanism, you should be using ssh or rsh or some other data-pipe-providing
external tool for rsync to run over rather than building it all into rsync
itself.
- Dave Dykstra
if not root is if it is giving up
setuid-bit functionality (chmod 4755), and rsync is not designed to support
that so I don't see the point.
- Dave Dykstra
On Mon, Mar 05, 2001 at 11:31:36AM -0600, Dave Dykstra wrote:
On Tue, Mar 06, 2001 at 02:10:18AM +1100, Martin Pool wrote:
...
By all means put the script into the FAQ, or a doc/examples/
directory, but my preference is that it not be in the main system.
If it's not in the standard
ng the end of a path, as
is documented if the exclude patterns don't start with a slash.
The fix for you is probably to just put a slash at the end of your source
directory.
- Dave Dykstra
there were no wildcards) to show
what the performance impact would be.
- Dave Dykstra
On Tue, Mar 20, 2001 at 05:33:46PM -0500, Alberto Accomazzi wrote:
...
Dave,
I see you've now mentioned a few times what the performance impact of
this proposed patch would be, and I can't quite understand what you're
getting at. My suggestion of --files-from came from the obvious (at
complicated
so it needs proper justification.
And the new option is there to make the program more user-friendly
rather than increasing performance.
Different people expressed an interest in it for both reasons.
- Dave Dykstra
xactly. I for one am quite opposed
to the idea. I think using an external ssh is easy enough.
- Dave Dykstra
Dell PowerEdge 2450 (identical)
Operating system(s)
Red Hat Linux 6.2, kernel 2.2.16
rsync version(s)
2.4.1 protocol v. 24
That's your problem. SSH hangs were a known problem in rsync 2.4.1.
Upgrade to 2.4.6.
- Dave Dykstra
rsyncd.conf, but by default it sets 'gid = nobody' and
perhaps you don't have such a group. See the rsyncd.conf.5 man page.
- Dave Dykstra
n operating system that didn't have the glob()
function. See glob_expand_one() in util.c.
- Dave Dykstra
eces of the separate tool into rsync.
- Dave Dykstra
tree as regular files.
- Dave Dykstra
in /tmp? Using /tmp/* in
outfilelist should work for that.
- Dave Dykstra
lways show. Anybody disagree?
- Dave Dykstra
ess --stat --delete --exclude \"lost+found\" /src/
/target/
Can somebody tell me if he has met difficulties like that with "-v".
Thank you all.
-Remi
Yes, that's a known problem, apparently somewhat improved in the latest
sources checked in to CVS.
- Dave Dykstra
involve
thousands of files.
Unfortunately you've run into a long known bug. Here's a message I posted
4 months ago today for somebody who wanted to exclude any path ending in
"foo/*.c":
On Tue, Dec 05, 2000 at 12:09:45PM -0600, Dave Dykstra wrote:
...
You understand correctly, this is a
On Mon, Apr 02, 2001 at 06:40:01PM -0400, Magdalena Hewryk wrote:
You have to include a parent directory in order to include a
file. Is it just that you want to exclude all the other files in /tmp?
Using /tmp/* in outfilelist should work for that.
- Dave Dykstra
Dave,
When
st, it can be
discovered.
The vulnerability on the second host can be limited only by what the
compromised host is permitted to do on the second host, such as some of the
schemes that have been discussed here with the ssh authorized_keys.
- Dave Dykstra
file to rsync along with --exclude '*' to exclude everything else.
Currently you also need to explicitly include all parent directories of
files you want copied.
- Dave Dykstra
/
luzifer.webseek.de:/** /backup/luzifer/current/
thx, axel.
There's nothing that looks obviously wrong to me. If you could construct a
complete simple test case that you could explain to someone so we could
reproduce the problem that would probably help a lot.
- Dave Dykstra
On Fri, Apr 13, 2001 at 08:44:52PM +0200, Peter T. Breuer wrote:
"A month of sundays ago Dave Dykstra wrote:"
This has been asked for before, but the main problem is that rsync builds a
temporary file and then moves it into place when finished. If you're
Thanks for the reply.
, but maybe it would seem
trivial to him.
- Dave Dykstra
: No such file or directory
created directory /tmp/sync_Retail.1229
Rsync thinks you've got 3 directories there because $logfile looks like
a third parameter. You probably mean to end that by "$logfile 21".
- Dave Dykstra
on --compare-dest says.
- Dave Dykstra
.
- Dave Dykstra
the target
name to stdout:
rsync source remote_machine:'`rm file;echo targetdir`'
- Dave Dykstra
On Wed, Apr 25, 2001 at 03:20:58PM -0400, Scott Adkins wrote:
--On Wednesday, April 25, 2001 3:06 PM -0400 David N. Blank-Edelman
[EMAIL PROTECTED] wrote:
Dave Dykstra [EMAIL PROTECTED] writes:
What are the advantages of that over rsyncd.conf's hosts allow and
hosts deny
before. Ah yes, see
http://lists.samba.org/pipermail/rsync/2000-July/002503.html
which says it defaults to 2 on Windows. It would be good if the man page
said it should be 2 when dealing with a FAT filesystem.
- Dave Dykstra
On Thu, May 03, 2001 at 01:56:16PM -0600, Jeff Ross wrote:
No, it was a remote transfer, from one computer on my lan to another.
I wonder if the second -e option, the real -e ssh overrides the first,
mistaken -e xclude option?
Ah yes, that's it.
- Dave Dykstra
and dele,
but since I am already using it to sync file )
No, there isn't. Rsync does not support that directly. When rsync is
going over rsh or ssh you can get it to do arbitrary shell commands before
the transfer over the same connection, but not after.
- Dave Dykstra
On Thu, May 03, 2001 at 11:17:45PM -0400, CLIFFORD ILKAY wrote:
Hi,
I need to synchronize /home on ProductionServer with /home on BackupServer
periodically. ProductionServer has Samba and netatalk running on it and
share files with a network of Windows and Mac OS users. The idea behind
are
not reported to the client (mostly for security reasons, although some of
them may not actually be a security risk).
- Dave Dykstra
, otherwise the --exclude '*' will prevent
rsync from ever looking down into the subdirectories.
- Dave Dykstra
shorter list until it works without the optimization to do a fair comparison.
- Dave Dykstra
sliding windows to
overcome latency effects?
I don't recall that that subject has been discussed much on the mailing list
since I've been participating. It was my understanding that rsync already
pipelines pretty well in both directions.
- Dave Dykstra
On Mon, May 14, 2001 at 11:13:40AM -0500, Dave Dykstra wrote:
...
As a thought, have you or any of the other developers thought of getting
rsync to operate over a number of streams or to use sliding windows to
overcome latency effects?
I don't recall that that subject has been discussed
On Mon, May 14, 2001 at 01:32:01PM -0700, Wayne Davison wrote:
On Fri, 11 May 2001, Dave Dykstra wrote:
The optimization bypassed the normal recursive traversal of all the
files and directly opened the included files and sent the list over.
There's an alternative to this optimization
- time the whole run with the time command, CPU time and elapsed time
- I don't know about daemon vs rsh, but the daemon leaves the most
under rsync's control so that may be preferable
- Dave Dykstra
limiting.
It's faster? Why do you say that? I don't recall any changes in the 2.4.x
series explicitly related to performance.
Will let you know the results of the testing.
- Dave Dykstra
On Thu, May 17, 2001 at 04:43:50PM -0400, Jim Ogilvie wrote:
Hi,
I know rsync creates temp files in the destination directory and
then at some point renames them to the original file name. Therefore
the destination directories need to be larger than the source directories.
I'm trying
that, because I can
imagine some scenarios where a permissions error could cause a delete
disaster.
- Dave Dykstra
the exact number of bytes or on which side though.
- Dave Dykstra
On Fri, May 25, 2001 at 04:33:28PM -0500, Phil Howard wrote:
Dave Dykstra wrote:
One possibility here is that I do have /var/run symlinked to /ram/run
which is on a ramdisk. So the lock file is there. The file is there
but it is empty. Should it have data in it? BTW
(either syslog or use the 'log file' option). I note that you need to be
extra careful regarding security when writing to a daemon, and that you need
to use the read only = false option.
- Dave Dykstra
1 - 100 of 544 matches
Mail list logo
