rsync in cygwin as service

2003-02-11 Thread Dmitry Melekhov
Hello!

I want to start  rsync on w2k as service.

If I try to  start rsync from command line it simply do nothig:

$ rsync --daemon

Administrator@dm-w2ks /usr/bin

$ ps
  PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
  480   1 480480  con  500 04:15:03 /usr/bin/bash
 1428 4801428   1420  con  500 05:26:46 /usr/bin/ps

Administrator@dm-w2ks /usr/bin


So I'm trying to set it as service:

C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a 
--daemon --n
o-detach

C:\cygwin\bincygrunsrv -S RSYNC
cygrunsrv: Error starting a service: QueryServiceStatus:  Win32 error 1062:
The service has not been started.

And I see in event log:


The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found. 
The local computer may not have the necessary registry information or 
message DLL files to display messages from a remote computer. The 
following information is part of the event: RSYNC : Win32 Process Id = 
0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed: 
signal 11 raised.

$ rsync --version
rsync  version 2.5.5  protocol version 26

Any ideas?

Thank you!


--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html


Re: rsync in cygwin as service

2003-02-11 Thread Nitin Agarwal
Hi!
U can try the following way

1) Make a directory called RSYNC and copy rsync.exe, supporting dll files
(cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory
2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync
c:\rsync\srvany.exe
3) this will install the service in win2k...
4) now u need to give all parameters in services in control panel...for running it
in daemon.

Nits.


Dmitry Melekhov wrote:

 Hello!

 I want to start  rsync on w2k as service.

 If I try to  start rsync from command line it simply do nothig:

 $ rsync --daemon

 Administrator@dm-w2ks /usr/bin

 $ ps
PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
480   1 480480  con  500 04:15:03 /usr/bin/bash
   1428 4801428   1420  con  500 05:26:46 /usr/bin/ps

 Administrator@dm-w2ks /usr/bin

 So I'm trying to set it as service:

 C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a
 --daemon --n
 o-detach

 C:\cygwin\bincygrunsrv -S RSYNC
 cygrunsrv: Error starting a service: QueryServiceStatus:  Win32 error 1062:
 The service has not been started.

 And I see in event log:

 The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found.
 The local computer may not have the necessary registry information or
 message DLL files to display messages from a remote computer. The
 following information is part of the event: RSYNC : Win32 Process Id =
 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed:
 signal 11 raised.

 $ rsync --version
 rsync  version 2.5.5  protocol version 26

 Any ideas?

 Thank you!

 --
 To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
 Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread bart . coninckx

You should perhaps also mention that the tools you refer to are part of the
Resource Kit and are not available as such in Windows.



Kind regards,

Bart Coninckx
Network Administrator
CNE, ASE
*
Sita ICT Services
Lilsedijk 19
B-2340 Beerse
Belgium

e-mail: [EMAIL PROTECTED]
Tel: + 32 (0) 14 62 28 22
Fax: + 32 (0) 14 62 41 47







   
 
Nitin Agarwal  
 
[EMAIL PROTECTED]To: Dmitry 
Melekhov [EMAIL PROTECTED]   
Sent by:  cc: 
[EMAIL PROTECTED] 
rsync-bounces+bart.coninckx=watco.be@listsSubject: Re: 
rsync in cygwin as service   
.samba.org 
 
   
 
   
 
11/02/2003 14:40   
 
Please respond to nitin.agarwal
 
   
 
   
 




Hi!
U can try the following way

1) Make a directory called RSYNC and copy rsync.exe, supporting dll files
(cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory
2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync
c:\rsync\srvany.exe
3) this will install the service in win2k...
4) now u need to give all parameters in services in control panel...for
running it
in daemon.

Nits.


Dmitry Melekhov wrote:

 Hello!

 I want to start  rsync on w2k as service.

 If I try to  start rsync from command line it simply do nothig:

 $ rsync --daemon

 Administrator@dm-w2ks /usr/bin

 $ ps
PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
480   1 480480  con  500 04:15:03 /usr/bin/bash
   1428 4801428   1420  con  500 05:26:46 /usr/bin/ps

 Administrator@dm-w2ks /usr/bin

 So I'm trying to set it as service:

 C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a
 --daemon --n
 o-detach

 C:\cygwin\bincygrunsrv -S RSYNC
 cygrunsrv: Error starting a service: QueryServiceStatus:  Win32 error
1062:
 The service has not been started.

 And I see in event log:

 The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found.
 The local computer may not have the necessary registry information or
 message DLL files to display messages from a remote computer. The
 following information is part of the event: RSYNC : Win32 Process Id =
 0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed:
 signal 11 raised.

 $ rsync --version
 rsync  version 2.5.5  protocol version 26

 Any ideas?

 Thank you!

 --
 To unsubscribe or change options:
http://lists.samba.org/mailman/listinfo/rsync
 Before posting, read:
http://www.tuxedo.org/~esr/faqs/smart-questions.html

--
To unsubscribe or change options:
http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html




-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Pb w/ 2GB files on AIX (4.3.3/5.1)

2003-02-11 Thread Dean



I have discovered that rsync 2.5.6 uses the mkstemp() routine wich do
not have a 64bits version into the AIX libc.

A very simple workaround to the big files writing rsync pb. is to not
use this routine that create files w/ mkstemp() by modifying the
syscall.c source file at line 154 as following :

#if defined(HAVE_SECURE_MKSTEMP)  defined(HAVE_FCHMOD)
become
#if defined(HAVE_SECURE_MKSTEMP)  defined(HAVE_FCHMOD)  !
defined(_AIX)


Hope this will help poor AIX users ;-)


Dean, 
a nostalgic Digital Unix veteran.
Digital/Tru64 Unix don't care big files !

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread Nitin Agarwal
Yap... but these can be downloaded from net... all of them are available.

[EMAIL PROTECTED] wrote:

 You should perhaps also mention that the tools you refer to are part of the
 Resource Kit and are not available as such in Windows.

 Kind regards,

 Bart Coninckx
 Network Administrator
 CNE, ASE
 *
 Sita ICT Services
 Lilsedijk 19
 B-2340 Beerse
 Belgium

 e-mail: [EMAIL PROTECTED]
 Tel: + 32 (0) 14 62 28 22
 Fax: + 32 (0) 14 62 41 47


 Nitin Agarwal
 [EMAIL PROTECTED]To: Dmitry 
Melekhov [EMAIL PROTECTED]
 Sent by:  cc: 
[EMAIL PROTECTED]
 rsync-bounces+bart.coninckx=watco.be@listsSubject: 
Re: rsync in cygwin as service
 .samba.org


 11/02/2003 14:40
 Please respond to nitin.agarwal



 Hi!
 U can try the following way

 1) Make a directory called RSYNC and copy rsync.exe, supporting dll files
 (cryptogrph-0.dll, cygwin1.dll), srvany.exe in this directory
 2) now go to dos prompt .. (c:\rsync) and give command instsrv Rsync
 c:\rsync\srvany.exe
 3) this will install the service in win2k...
 4) now u need to give all parameters in services in control panel...for
 running it
 in daemon.

 Nits.

 Dmitry Melekhov wrote:

  Hello!
 
  I want to start  rsync on w2k as service.
 
  If I try to  start rsync from command line it simply do nothig:
 
  $ rsync --daemon
 
  Administrator@dm-w2ks /usr/bin
 
  $ ps
 PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
 480   1 480480  con  500 04:15:03 /usr/bin/bash
1428 4801428   1420  con  500 05:26:46 /usr/bin/ps
 
  Administrator@dm-w2ks /usr/bin
 
  So I'm trying to set it as service:
 
  C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a
  --daemon --n
  o-detach
 
  C:\cygwin\bincygrunsrv -S RSYNC
  cygrunsrv: Error starting a service: QueryServiceStatus:  Win32 error
 1062:
  The service has not been started.
 
  And I see in event log:
 
  The description for Event ID ( 0 ) in Source ( RSYNC ) cannot be found.
  The local computer may not have the necessary registry information or
  message DLL files to display messages from a remote computer. The
  following information is part of the event: RSYNC : Win32 Process Id =
  0x148 : Cygwin Process Id = 0x148 : starting service `RSYNC' failed:
  signal 11 raised.
 
  $ rsync --version
  rsync  version 2.5.5  protocol version 26
 
  Any ideas?
 
  Thank you!
 
  --
  To unsubscribe or change options:
 http://lists.samba.org/mailman/listinfo/rsync
  Before posting, read:
 http://www.tuxedo.org/~esr/faqs/smart-questions.html

 --
 To unsubscribe or change options:
 http://lists.samba.org/mailman/listinfo/rsync
 Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

 --
 To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
 Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



/me dead for a short while [Was: rsync in cygwin as service]

2003-02-11 Thread Lapo Luchini
Dmitry Melekhov wrote:


Hello!

I want to start rsync on w2k as service.

If I try to start rsync from command line it simply do nothig:

$ rsync --daemon


Sorry to you and other people that waits for me to test/debug 
cygwin-specific problems in latest rsync, but my windows machine is 
actually dead (it's the same CyberOne as seen 'long time offline' from 
http://build.samba.org/).
I guess I must change CPU and/or MB so it will take a while.

Sorry.

In Italy we say something that sounds like it always rains where it's 
already wet =(

Lapo

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



duplicated file removal: call for comment

2003-02-11 Thread Thomas Osterried
This is a call for comments, regarding what you do expect when copying
multible source tree roots leading to the same directory root, using
rsync.

This problem may be discussed now, because in versions before
rsync-2.5.6, the algorithm for removing the so called duplicated files
was broken.
That's why we expect nobody used it anyway in earlier versions - but who
knows..


Example:


Whe have treeA/ treeB/ treeC/ and treeD/, which may or may not have
common files or directories in the depth. the contense of a file in
treeA/etc/etctest for e.g. may differ from treeD/etc/etctest. In my
example, treeA/etc/etctest contains the line treeA, and alike.

Let's look what's the way of standard unix programs:

$ mkdir /tmp/test
$ cp -r tree*/* /tmp/test/
$ cat /tmp/test/etc/etctest 
treeD
$ rm -rf /tmp/test/*
$ scp -r tree*/* thomas@localhost:/tmp/test
[..]
$ cat /tmp/test/etc/etctest 
treeD
$ 

Using these programs, the last reference of a file wins.
Nb: this is, what a user should suspect.
Note that each duplicated file has been copied / transmitted.


rsync has routine which removes duplicates from given source-trees
before actually transmitting the contense to the destination.

Due to a bug in earlier versions, it was hardly predictable which file
from which source-tree would win. Especially, if for e.g. some trees
in the middle or the last referenced trees did not have such a file.


Wayne Davison has done a fix for version 2.5.6.
A while ago, i advised a patch to the list
(http://www.mail-archive.com/rsync@lists.samba.org/msg03117.html).

Our both patches do fix the problem, but with a contrary result: With
my patch the last reference of a duplicated file wins (in my example,
treeD's etc/etctest); with Wayne's fix the first reference succeeds
(treeA's etc/etctest).


When looking at the code, i assume my proposal was initially intended;
then, some years ago, the code was changed and the duplicate file
deletion mechanism went broken.


The project where i use rsync relys on a correctly working and
predictable file-deletion mechanism.
Therfore, this method should not change or flip/flop in future versions.

That's why i like to discuss the both approaches, leading to one final
proposal.


If you're interested in detail, read my discussion with Wayne, who
allowed me to quote.


Regards,

- Thomas Osterried

=

My proposal for a change for rsync-2.5.6:
-

diff -r rsync-2.5.6/flist.c ../rsync-2.5.6-patched/flist.c
1274c1274
   name, i);
---
   prev_name, i-1);
1281c1281
   flist-files[i][0] = null_file;
---
   flist-files[i-1][0] = null_file;
1283c1283
   free_file(flist-files[i]);
---
   free_file(flist-files[i-1]);


=

Our discussion
--

My mail:
Subject: rsync: duplicate name deletion - problems with rsync-2.5.6

Dear Wayne,

i'd like to diskuss some problems with your fix of rsync-2.5.6:
|   * Fixed a crash that would occur when sending a list of files that
| contains a duplicate name (if it sorts to the end of the file
| list) and using --delete.  (Wayne Davison)

my initial proposal for a fix i posted, as suggested at the project's web site,
to the rsync mailing list was:
  http://www.mail-archive.com/rsync@lists.samba.org/msg03117.html
unfortunately, the only response to this issue was Huh? I don't care
about this at all.

our both fixes for clean_flist() work. but with your fix, the clearing
process will delete the second and following references of duplicated
files.
while in my approach the last reference of a duplicated file wins.

i think, that deleting all but the last reference
- is the right way because it's exactly what you expect and are experienced
  with, for e.g. when copying with cp tree*/etc/etctest dest/etc/)
- was the idea of the author of clean_flist(), because
- he annonced
  rprintf(FINFO, removing duplicate name %s from file list %d\n, 
f_name(flist-files[i - 1]), i - 1);
- because he startet his for() loop with i = 1, comparing the backward
  list-entries at i-1.
  the only mistake was, to free the current list entry instead of the previous.
  see 1).


because the rsync protocol version number (26) is the same, i'm unable
to detect which behaviour of rsync considering duplicates i should expect
at the target site.

personaly, i would much appreciate that the last reference of a
duplicated file wins.
we use rsync for synchronizing a pool of 174 computers at university. rsync
is the heart of the conzept where we have one linux installation on a master
server (the class tree), several hardware- and configuration- memberships
(group trees) and machine-specific configurations.
here we make intensively use of rsync's file-deletion mechanism, and
rely on the perfect functionality. as an example, an rsync process 

rsync ldap authentication

2003-02-11 Thread Darren Jung
Hi,

I'm trying to get rsync 2.5.6 to authenticate users via openldap-2.0.23.  I was 
looking through the mailing list archives and found a patch for rsync-2.4.6 that does 
this for me.  I was just wondering if this is still valid, or if there has been a new 
patch or new implementation that has superceded this patch.  Any help would be great.  
The message I am referring to is as follows:



--T4sUOijqQbZv57TR
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

hello,

here is a patch against rsync-2.4.6. It may be used to get rsyncd
authentication data from a ldap directory.

cu, Stefan
--
Stefan Nehlsen | ParlaNet Administration | [EMAIL PROTECTED] | +49 431 988-1260

--T4sUOijqQbZv57TR
Content-Type: text/plain; charset=us-ascii
Content-Disposition: attachment; filename=rsyncd-ldap.txt

LDAP support for rsyncd

I have made a few changes to rsync 2.4.6 to add to 2 new features to rsync
when running as daemon:

1. getting authentification information from an ldap server. The user has to
   belong to a special group (groupofuniqueusers) and must have a special
   attribute in his ldap entry containing the rsync password in clear text.

2. specification of a list of prefixes that will be removed from the user name
   given by the client.

The second option was added to be compatible to our ftp server and is simple
to use or ignore. Maybe there is better, more flexible way to rewrite usernames.

Only the files authenticate.c and loadparm.c have been modified.


How to build a rsync version with ldap support

There is no autoconf support for the new features. To enable them edit the
Makefile after running configure.

 - Add -DWITH_LDAP -DWITH_MANGLE_USER to the CFLAGS line.

 - On Linux add -lldap and -llber to the LIBS Flags.

 - On Solaris add -lldap to the LIBS Flags.


New options in rsyncd.conf

All ldap options will exist even when rsync isn't build ldap support.

To enable anonymous access to rsyncd both auth users and
ldap auth usergroup have to be empty.

If both ways of authentification are enabled the local password file is checked
before ldap.

Most options are borrowed from samba :-)

GLOBAL OPTIONS

ldap server

This option has to contain the hostname of the ldap server we want to
ask.

example:ldap server = ldap.ParlaNet.de

default:none


ldap port

This option has to contain the tcp port where the ldap service is
listening.

example:ldap port = 11034

default:ldap port = 389


ldap root

This option should contain the dn to bind with to the ldap server.

You may leave this option and ldap root password empty to bind
as anonymous but this isn't a good idea.

If you use this option you should not make the configuration file
world readable.

example:ldap root = cn=webserver-rsyncd, o=ParlaNet, c=DE

default:empty


ldap root passwd

This will contain the password to bind with.

see also:   ldap root

example:ldap root passwd = sECret

default:empty


ldap suffix

This option should contain the basedn as starting point for search
operations.

example:ldap suffix = o=ParlaNet, c=DE

default:empty


MODULE OPTIONS

ldap filter

This parameter specifies an LDAP search filter used
to  search for a user name in the LDAP database. It
must contain the string %u which will  be  replaced
with the user being searched for.

example:ldap filter = ((objectclass=myperson)(uid=%u))

default:empty string


ldap passwd attribute

This parameter specifies the name of the attribute in the user
object that contains the rsyncd password in clear text.

You should use access control on this attribute and it has to be case
sensitive.

example:ldap passwd attribute = myRsyncdPassword

default:empty string


ldap auth usergroup

This parameter specifies the dn of a group the user must belong to.

objectclass=groupOfUniqueNames is very good idea

example:ldap auth usergroup = cn=webmaster sub, o=ParlaNet, c=DE

default:empty string


ldap auth users attribute

This parameter specifies the name of the attribute in the
ldap auth usergroup object that contain the dn of a member.

If objectclass is groupOfUniqueNames this always should be uniqueMember.

default:ldap auth users attribute = uniqueMember


mangle user

This option is no ldap option.

This parameter specifies a list of prefixes that will be removed
from the username before it is tested against the access lists.

example:mangle user = web- adm-

default:empty string


HOWTO use this

1. Create a new user. The 

Re: Pb w/ 2GB files on AIX (4.3.3/5.1)

2003-02-11 Thread jw schultz
On Tue, Feb 11, 2003 at 03:18:00PM +0100, Dean wrote:
 
 
 
 I have discovered that rsync 2.5.6 uses the mkstemp() routine wich do
 not have a 64bits version into the AIX libc.

mkstemp should have no need of a 64bit version.  Why is this
an issue?

 A very simple workaround to the big files writing rsync pb. is to not
 use this routine that create files w/ mkstemp() by modifying the
 syscall.c source file at line 154 as following :
 
 #if defined(HAVE_SECURE_MKSTEMP)  defined(HAVE_FCHMOD)
 become
 #if defined(HAVE_SECURE_MKSTEMP)  defined(HAVE_FCHMOD)  !
 defined(_AIX)

If AIX doesn't have a secure mkstemp the logic determining
that should be in configure where HAVE_SECURE_MKSTEMP is
defined.  It should not be grafted on here.  Given that the
s in mkstemp stands for secure an insecure mkstemp would
be broken :)


-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: --delete ignored?

2003-02-11 Thread va_public [EMAIL PROTECTED]
--- In [EMAIL PROTECTED], jw schultz [EMAIL PROTECTED] wrote:
 On Mon, Feb 10, 2003 at 10:24:35PM -, va_public 
[EMAIL PROTECTED] wrote:
  
  If the file is getting deleted, shouldnt the --verbose option 
print a 
  message to this effect?
 
 Because it isn't deleting the files.

Um..It _is_ deleting the file from my target tree.

Yes, it is backing it up, so it isnt really gone, but whats the harm 
in printing a message saying it is deleting it from the target tree, 
because it is doing that.

All I am trying to do is find out what files are going to be deleted 
from my target tree using --dry-run --verbose before actually running 
the command. 

It is misleading to not print the message in --verbose but boom, the 
file is gone from my target tree when I take out the --dry-run.


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: duplicated file removal: call for comment

2003-02-11 Thread jw schultz
On Tue, Feb 11, 2003 at 05:27:51PM +0100, Thomas Osterried wrote:
 This is a call for comments, regarding what you do expect when copying
 multible source tree roots leading to the same directory root, using
 rsync.
 
 This problem may be discussed now, because in versions before
 rsync-2.5.6, the algorithm for removing the so called duplicated files
 was broken.
 That's why we expect nobody used it anyway in earlier versions - but who
 knows..

Part of this is something i've idly wondered.  It is,
however, important.  Let me see if i can succinctly describe
the issues and give my opinion.

To start with i want to clarify terminology.  I will not use
the word delete except when referring to actual deletion of
files from disk.

For the sake of illustration i'll assume three trees
tree[123].  Each tree has a file i'll call 'overlap' which
contains the name of the tree.  I'll refer to the file
contents by the tree name.

tree1/overlap
tree2/overlap
tree3/overlap

Whether we do rsync --from-files
or rsync -r tree1/ tree2/ tree3/ dest 
isn't too critical to the discussion.
I will assume that the --files-from list always lists the
overlap file in all three trees.

The first, and outermost, issue is duplicates in list or
from combining multiple trees (-r) as i describe in the
illustration.  What contents wind up in dest/overlap?  I'm
inclined to think this should be the last one.  In other
words, tree3.  This would be consistent with progressive
copying.

The second issue is what if one is not on disk?  Say that
tree3/overlap doesn't actually exist.  Here i'm inclined to
stick with the progressive copying model and say it should
be the last one that exists.  So that tree2 would take over.
Kind of like runner-ups in a beauty contest.  Should tree3
be unable to fulfill her obligations tree2 will assume the
crown.

This is then somewhat complicated by the --delete option.
Should the destination be deleted if it is missing from the
source tree?  Which source tree?  My strongest inclination
here is to stick with my second issue response.  The file
will only be deleted if no source location is present that
corresponds to the destination.

In sum what i am most inclined towards here is that
duplicate resolution incorporate an existence check and if
the file exists (size=0 OK) each later reference will
replace the earlier one.

Regardless of the choice of first specified or last
specified, or whether to do fall-back on non-existent files
the order of specification, not lexical order needs to be
used.  Otherwise the user has no control over the merge
process.

This unfortunately does mean that a means of preserving
initial sequence must be incorporated or the qsort approach
to finding duplicates would have to be forgotten.
This could be as simple as running qsort on an array of
indices to flist-files instead of flist-files itself.


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread Craig Barratt
 If I try to  start rsync from command line it simply do nothig:
 
 $ rsync --daemon
 
 Administrator@dm-w2ks /usr/bin
 
 $ ps
PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
480   1 480480  con  500 04:15:03 /usr/bin/bash
   1428 4801428   1420  con  500 05:26:46 /usr/bin/ps
 
 Administrator@dm-w2ks /usr/bin
 
 So I'm trying to set it as service:
 
 C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a 
 --daemon --n o-detach

I've found on cygwin that I need to explicitly tell it where the
config file is, both on the command line and with cygrunsrv.  I
haven't investigated; perhaps the platform default is some other
file.

These commands work for me:

rsync --config=/etc/rsyncd.conf --daemon

and

cygrunsrv -I RSYNC -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon 
--no-detach'

Craig
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: --delete ignored?

2003-02-11 Thread jw schultz
On Tue, Feb 11, 2003 at 06:53:20PM -, va_public [EMAIL PROTECTED] 
wrote:
 --- In [EMAIL PROTECTED], jw schultz [EMAIL PROTECTED] wrote:
  On Mon, Feb 10, 2003 at 10:24:35PM -, va_public 
 [EMAIL PROTECTED] wrote:
   
   If the file is getting deleted, shouldnt the --verbose option 
 print a 
   message to this effect?
  
  Because it isn't deleting the files.
 
 Um..It _is_ deleting the file from my target tree.

It is just unlinking it.  The same file still exists.

 Yes, it is backing it up, so it isnt really gone, but whats the harm 
 in printing a message saying it is deleting it from the target tree, 
 because it is doing that.
 
 All I am trying to do is find out what files are going to be deleted 
 from my target tree using --dry-run --verbose before actually running 
 the command. 
 
 It is misleading to not print the message in --verbose but boom, the 
 file is gone from my target tree when I take out the --dry-run.

Use -vv and you should see a deleting in message followed by
more detail.


-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Filelist caching

2003-02-11 Thread Rogier van Eeten
Hi,

I've noticed every time someone does an rsync-request on my ftp-site
(which also provides rsync as mirror method), rsyncd creates a filelist.
This is a quite IO and CPU intensive procedure, especially for things
mirrors like FreeBSD with lots of little files. 

I was wondering... is there a way to cache that filelist? Our mirrors
are updated once, or twice a day, it could speed up downloads when I
create a filelist everytime we've mirrored others. 


Tia,
Rogier van Eeten
Studenten Net Twente
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: /me dead for a short while [Was: rsync in cygwin as service]

2003-02-11 Thread Dmitry Melekhov
Hello!

Well, now I know that _latest_ rsync does not work in daemon mode at all,
i.e. when I start it with --daemon it simply exits without any error 
messages.
But could you tell me is there rsync version which I can use in cygwin 
right now?
Could someone mail me .exe ?

Thank you!


Lapo Luchini wrote:
Dmitry Melekhov wrote:


Hello!

I want to start rsync on w2k as service.

If I try to start rsync from command line it simply do nothig:

$ rsync --daemon



Sorry to you and other people that waits for me to test/debug 
cygwin-specific problems in latest rsync, but my windows machine is 
actually dead (it's the same CyberOne as seen 'long time offline' from 
http://build.samba.org/).
I guess I must change CPU and/or MB so it will take a while.

Sorry.

In Italy we say something that sounds like it always rains where it's 
already wet =(

Lapo



--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Syncing large amounts of data

2003-02-11 Thread Adam Herbert
I need some suggestions. Here's my setup:

800GB of Data
14,000,000+ Files
  No changes just additions
  Files range in size from 30k - 190k

The files are laid out in a tree fashion like:

BASE
   \-Directory ( Numerical Directory name from 0 - 1023 )
 \-Directory ( Numerical Directory name from 0 - 1023 )
   \- Files ( Up to 1024 files each directory )


This allows for a maximum of about a billion files. I need to limit the
amount of memory usage and processor / io time it takes to build the
list of files to transmit. Is there a better solution that rsync? Are
the patches that would help rsync in my particular situation?

Any suggestions are appreciated.

Adam Herbert
[EMAIL PROTECTED]

--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread Dmitry Melekhov
Craig Barratt wrote:

If I try to  start rsync from command line it simply do nothig:

$ rsync --daemon

Administrator@dm-w2ks /usr/bin

$ ps
  PIDPPIDPGID WINPID  TTY  UIDSTIME COMMAND
  480   1 480480  con  500 04:15:03 /usr/bin/bash
 1428 4801428   1420  con  500 05:26:46 /usr/bin/ps

Administrator@dm-w2ks /usr/bin

So I'm trying to set it as service:

C:\cygwin\bincygrunsrv -I RSYNC -d Rsync -p /bin/rsync.exe -a 
--daemon --n o-detach


I've found on cygwin that I need to explicitly tell it where the
config file is, both on the command line and with cygrunsrv.  I
haven't investigated; perhaps the platform default is some other
file.

These commands work for me:

rsync --config=/etc/rsyncd.conf --daemon

and

cygrunsrv -I RSYNC -p /bin/rsync.exe -a '--config=/etc/rsyncd.conf --daemon --no-detach'

Craig


Certanly, I tried --config
Could you tell me which rsync version do you use?


--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: duplicated file removal: call for comment

2003-02-11 Thread Craig Barratt
 This problem may be discussed now, because in versions before
 rsync-2.5.6, the algorithm for removing the so called duplicated files
 was broken.
 That's why we expect nobody used it anyway in earlier versions - but who
 knows..

I agree it should be the last argument that wins, but as Wayne points
out your code and 2.5.6 have unpredictable behavior since qsort() could
return identical names in any order.

Another concern I have about this fix in 2.5.6 is that there is risk
the change is not backward compatible with earlier protocol versions.
The file list is sent (unsorted and uncleaned) from the sender to the
receiver, and each side then sorts and cleans the list.  Since the
duplicate removal changed in 2.5.6, but the protocol number didn't
change, it is possible that with duplicates the file lists are no
longer identical.  Specifically, with three or more duplicates, 2.5.5
and earlier will remove the even ones, while 2.5.6 correctly removes
all but the first.  Remember that the files are referred to as an
integer index into the sorted file list, and the receiver skips
NULL (duplicate) files.

I suspect (but haven't checked) that if a 2.5.5 receiver is talking to
a 2.5.6 sender then 2.5.5 will send the index for the 3rd file, which
will be null_file on 2.5.6.

Craig
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread Craig Barratt
 Certanly, I tried --config
 Could you tell me which rsync version do you use?

rsync 2.5.5 and rsync 2.5.6 both work fine for me.

Is it possible that rsync is already running as a service?
It won't show up in cygwin's ps.  For example, when rsync
is running via cygrunsrv, if I type:

rsync --daemon

it exits with no error, but ps shows no process.  But rsync is
indeed running, eg:

tcsh 438% telnet localhost 873
Trying 127.0.0.1...
Connected to .
Escape character is '^]'.
@RSYNCD: 26
quit
@ERROR: protocol startup error
Connection closed by foreign host.

You can also see rsync.exe in the windows task manager.

You could also try a different port number to see if there is
someone else on 873:

craigslt 461% ps aux | egrep rsync
craigslt 462% rsync --daemon --port=1234
craigslt 463% ps aux | egrep rsync
 4020   14020   4020? 1005 23:29:08 /bin/rsync

Craig
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



Re: rsync in cygwin as service

2003-02-11 Thread Dmitry Melekhov
Craig Barratt wrote:



You could also try a different port number to see if there is
someone else on 873:

craigslt 461% ps aux | egrep rsync
craigslt 462% rsync --daemon --port=1234
craigslt 463% ps aux | egrep rsync
 4020   14020   4020? 1005 23:29:08 /bin/rsync



Unfortunately, rsync does not responds if I run it  with --daemon from 
command line...

Could you send me your rsync.exe?
Thank you!


--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html


Re: Filelist caching

2003-02-11 Thread Greger Cronquist
I too think this would be an interesting feature.

 --- Rogier van Eeten [EMAIL PROTECTED] skrev: 
Hi,
 
 I've noticed every time someone does an
 rsync-request on my ftp-site
 (which also provides rsync as mirror method), rsyncd
 creates a filelist.
 This is a quite IO and CPU intensive procedure,
 especially for things
 mirrors like FreeBSD with lots of little files. 
 
 I was wondering... is there a way to cache that
 filelist? Our mirrors
 are updated once, or twice a day, it could speed up
 downloads when I
 create a filelist everytime we've mirrored others. 
 
 
 Tia,
 Rogier van Eeten
 Studenten Net Twente
 -- 
 To unsubscribe or change options:
 http://lists.samba.org/mailman/listinfo/rsync
 Before posting, read:
http://www.tuxedo.org/~esr/faqs/smart-questions.html 

_
Gratis e-mail resten av livet på www.yahoo.se/mail
Busenkelt!
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html



CVS update: rsync

2003-02-11 Thread dwd

Date:   Tue Feb 11 19:13:51 2003
Author: dwd

Update of /data/cvs/rsync
In directory dp.samba.org:/tmp/cvs-serv12419

Modified Files:
log.c 
Log Message:
Back out one of the changes in log.c revision 1.62, and always send errors
to the client after multiplexing is enabled.


Revisions:
log.c   1.63 = 1.64
http://www.samba.org/cgi-bin/cvsweb/rsync/log.c?r1=1.63r2=1.64
___
rsync-cvs mailing list
[EMAIL PROTECTED]
http://lists.samba.org/mailman/listinfo/rsync-cvs