Re: URGENT: Tricky rsync problem

[tim . conway]

I would recommend doing both moves in the same script, to keep them 
sequential.
rsync the server to the local staging directory, then rsync the local 
staging directory to the local destination.
Have the script save its pid in a file when it starts.
Before it writes its pid into that file, it reads the file (if it exists), 
and does a ps on that pid to see if the earlier run is still going, in 
which case it just exits, and will be tried again at the next 2-minute 
mark.
#!/bin/sh

ps -p`cat pidfile` |grep `basename $0` && exit 0

echo $$ >pidfile
rsync -avz server::module localstage
rsync -av localstage localdestination

Tim Conway
[EMAIL PROTECTED]
303.682.4917
Philips Semiconductor - Longmont TC
1880 Industrial Circle, Suite D
Longmont, CO 80501
Available via SameTime Connect within Philips, n9hmg on AIM
perl -e 'print pack(, 
19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970), 
".\n" '
"There are some who call me Tim?"




"Craig A. Sharp" <[EMAIL PROTECTED]>
Sent by: [EMAIL PROTECTED]
03/25/2002 11:48 AM

 
To: <[EMAIL PROTECTED]>
cc: (bcc: Tim Conway/LMT/SC/PHILIPS)
Subject:URGENT:  Tricky rsync problem
Classification: 



Hi all,
 
Here is the problem that I need to solve:
 
I have an ftp server that I wish to rsync the files from a directory on 
the remote server to a local server and then when the files are complete, 
move them to a public directory on the local server.
 
To move the files from the remote server, I successfully tried using the 
following command:
 
rsync -avz ftp.servername.com::roush/inbound/* /localserver/directory
 
I am running this command from the local server.  The command is correctly 
moving the files from the remote to the local server.  I am not sure I am 
using the correct switches but it is working. 
 
Here are the problems that I need to solve:
 
1. The rsync command must update the local files based on a cron entry 
every two minutes.  I can do this.  I need to be sure though, that rsync 
is updating the files with new data. 
 
In other words, if the file is still coming into the ftp server, I need 
rsync to move the additional data across to the local server until the 
file is complete.
 
2. Once the files exist on the local server, the files need to be moved 
into a public directory for local access, again via cron (the local rsync 
directory is separate from the public directory).  I envision running 
rsync again with new parameters for the local move. 
 
Here is the issue at this point.  I do not want to move the files to the 
public directory unless they are complete.  The end user (public 
directory) must never see an incomplete file.
 
I am a beginner at rsync and would appreciate any help with this problem.
 
Thanks,
 
Craig A. Sharp
Unix Systems Administrator
Roush Industries, Inc.
 



-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

Re: Anonymous rsync server on LAN

[Martin Pool]

On 22 Mar 2002, Berend Tober <[EMAIL PROTECTED]> wrote:

> I noticed some mention somewhere about "reverse dns lookups" with 
> respect to anonymous rsync, so what I did and got it to work, is add 
> an entry to the /etc/hosts file on the server (192.168.123.4 in my 
> example) for the back-up server "client" (192.168.123.3 in my 
> example). Then she lit right up fine.

That's probably a bug; it ought to work without resolution.  So for
now you're fine, but somebody should check this.

-- 
Martin 

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

Re: Should these errors matter?

[Martin Pool]

On 13 Mar 2002, Jos Backus <[EMAIL PROTECTED]> wrote:
> On Thu, Mar 14, 2002 at 05:00:35PM +1100, Jie Gao wrote:
> > This is from Solaris 7's manual for if:
> > 
> >  The -L option is a migration aid for users of  other  shells
> >  which  have  similar  options  and  may  not be supported in
> >  future releases.
> > 
> > and indeed it does not support this option in this very release!
> 
> -L doesn't appear to work in Solaris 8 either. However, the latest relevant
> standard, ``The Open Group Base Specifications Issue 6, IEEE Std 1003.1-2001''
> lists both -h and -L and says (at the end):

I forget if I sent this through to the list or not: it turns out that
on Solaris, /bin/test and sh's builtin test support different options!
I changed the test to try both of them.

-- 
Martin 

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

Re: moving from 1 server to another

[Martin Pool]

On 25 Mar 2002, Gary Peltola <[EMAIL PROTECTED]> wrote:
> I got a crappy server, the 2nd server is online with a basic RH 7.2 install (server1 
>is idential...7.2) with ssh installed
> 
> can someone give me some instructions on what i do from this point
> on, bascially i need to copy all of the contents of server1 to
> server2 via ssh

Well, very basically, you just need to decide which directories you
need to mirror, and then

  server1# rsync -avP /home root@server2:/

Be careful that there is no trailing slash on the first path, or the
contents of /home will be dumped in the other machine's root
directory.

It's simpler not to copy the system directories (/usr, /sbin, /var,
...) if the second machine is already installed.

If you want to exclude e.g. backup files, then

  server1# rsync -avP --exclude '*~' /home root@server2:/
  
Beyond that, read the fine manual.

-- 
Martin 

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

moving from 1 server to another

[Gary Peltola]

I got a crappy server, the 2nd server is online with a basic RH 7.2 install (server1 
is idential...7.2) with ssh installed

can someone give me some instructions on what i do from this point on, bascially i 
need to copy all of the contents of server1 to
server2 via ssh





-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

RSync crashing

[Jurrie Overgoor]

Hello,

I have downloaded and correctly compiled RSync version 2.4.6. I downloaded
this version because I use it on a not-so-vanilla RedHat 5.2, and the glibc
package is broken. Any version higher than 2.4.6 doesn't work, or I'll first
have to upgrade glibc (and that's a pain, because I'll also have to upgrade
gcc and gmake).

When I use RSync to backup my companies Windows shares (witch are a *lot* of
files, about 30.000 per directory), RSync has a problem... :) It will start
ok, and gradualy swallows all the i/o of my console. And when I cannot type
anything anymore, RSync drops in a continuous loop (the hd will go like mad,
but I waited for 2 days for about 3 Gig on a 10mbit lan connection...). I
think it is a known problem that RSync can't handle large amounts of files
(is it?).

Is there a quick and painless way of getting rid of this problem, besides
upgrading RSync (witch IS painfull in my situation)?

Thanks for any reply's,

   Greetz -- Jurrie
   [EMAIL PROTECTED]


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

ssh connection from W2K to Solaris 2.5.1

[Dave Goodrich]

I have
W2K server running,
Cygwin version 2.125.2.10 ssh & rsync installed.

Solaris SparkStation 20 running,
Solaris 2.5.1
openssh-2.5.1p1
openssl-0.9.6
rsync-2.3.1

Currently SSH from the W2K box works perfectly, I can connect to the 
Solaris box just fine, rsync works from both boxes, I can connect to the 
anonymous rsync at samba.org just fine.

I am trying to create a quick way to back up files from the Solaris box 
onto the W2K box with a scheduled task. I have run ssh-keygen on the W2K 
box (no pass phrase) and installed the indentity.pub file as 
~/.ssh/known_hosts/authorized_keys on the Solaris box. I should be able 
to task to connect and execute rsync on the Solaris box, copying files 
back to the W2K box. I've done this many times with FBSD and Linux and 
it works beautifully.

My problem, and maybe I'm just thick headed, I cannot get the W2K box to 
connect without requiring a password! I cannot get Cygwin to run rsync 
as anything other than the user that installed Cygwin, and I cannot have 
Administrator as a user in Solaris (too many characters).

So rsync over ssh isn't working, in fact ssh -l root 
mail4.totallogic.com from the W2K box require a password even though 
I've installed the identity.pub file.


Are any other admins with Cygwin/ssh/rsync running a sucessful setup? 
and would you share?

Thanks

DAve








-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

Block of unwanted zeros in a dest file

[Eric Whiting]

I'm syncing from a linux box (NAS disk) to a sun (NAS disk).

I just found a file on the destination sun with zeros from bytes 8192 to
32767. (the source file had lots of 'good' random bytes). The rest of
the file compares properly. Repeatedly running rsync to send the file
didn't fix it. I ran a -c transfer (checksum) and it fixed the file.

I'm using 2.5.3 on both sides with the -z turned off. (I thought that
was somewhat 'safe')

Is this a know issue? I'll upgrade to 2.5.4 (with the fixed zlib) and
see if it acts the same.

eric

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

URGENT: Tricky rsync problem

[Craig A. Sharp]

Hi all,
 
Here is the problem that I need to 
solve:
 
I have an ftp server that I wish to rsync the files 
from a directory on the remote server to a local server and then when the files 
are complete, move them to a public directory on the local server.
 
To move the files from the remote 
server, I successfully tried using the following 
command:
 
rsync -avz ftp.servername.com::roush/inbound/* 
/localserver/directory
 
I am running this command from the local 
server.  The command is correctly moving the files from the remote to the 
local server.  I am not sure I am using the correct switches but it is 
working.  
 
Here are the problems that I need to 
solve:
 
1. The rsync command must update the local files 
based on a cron entry every two minutes.  I can do this.  I need to be 
sure though, that rsync is updating the files with new data.  
 
In other words, if the file is still 
coming into the ftp server, I need rsync to move the additional data across to 
the local server until the file is complete.
 
2. Once the files exist on the local server, the 
files need to be moved into a public directory for local access, again via 
cron (the local rsync directory is separate from the public directory).  I 
envision running rsync again with new parameters for the local move.  

 
Here is the issue at this point.  I 
do not want to move the files to the public directory unless they are 
complete.  The end user (public directory) must never see an incomplete 
file.
 
I am a beginner at rsync and would appreciate any 
help with this problem.
 
Thanks,
 
Craig A. Sharp
Unix Systems Administrator
Roush Industries, Inc.
 

Re: RSYNC 2.5.4 and FreeBSD RELENG_4 Problems [HELP]

[tim . conway]

Need more information.  There are many circumstances that will give that 
message, most of them user errors.  Show the exact commandline used.

Tim Conway
[EMAIL PROTECTED]
303.682.4917
Philips Semiconductor - Longmont TC
1880 Industrial Circle, Suite D
Longmont, CO 80501
Available via SameTime Connect within Philips, n9hmg on AIM
perl -e 'print pack(, 
19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970), 
".\n" '
"There are some who call me Tim?"




Christophe Prevotaux <[EMAIL PROTECTED]>
Sent by: [EMAIL PROTECTED]
03/23/2002 03:30 AM

 
To: [EMAIL PROTECTED]
cc: (bcc: Tim Conway/LMT/SC/PHILIPS)
Subject:RSYNC 2.5.4 and FreeBSD RELENG_4 Problems [HELP]
Classification: 



I use FreeBSD RELENG_4 

with 

rsync  version 2.5.4  protocol version 26
Copyright (C) 1996-2002 by Andrew Tridgell and others

Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, 
IPv6,
  32-bit system inums, 64-bit internal inums

and when I try to transfer file I get 


rsync: connection unexpectedly closed (5994 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(151)

Could anyone tell me why and how to fix this ? 


-- 
--
===
Christophe PrevotauxEmail: [EMAIL PROTECTED]
HEXANET SARLURL: http://www.hexanet.fr/
Z.A.C Les CharmillesTel: +33 (0)3 26 79 30 05 
3 Allée Thierry Sabine  Direct: +33 (0)3 26 79 08 02 
BP202   Fax: +33 (0)3 26 79 30 06
51686 Reims Cedex 2 
FRANCE   HEXANET Network Operation Center 
===

-- 
To unsubscribe or change options: 
http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html




--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html