AW: PAssword-file in rsync

[Rainer Stengele]

Hi,

this does it:

\bin>\bash rsync.sh

where rsync.sh is a UNIX shell script which looks like:

...
export RSYNC_PASSWORD=password
rsync ...
...


Rainer

-Ursprüngliche Nachricht-
Von: [EMAIL PROTECTED]
[mailto:[EMAIL PROTECTED] Auftrag von
sumithra
Gesendet: Donnerstag, 23. Oktober 2003 05:26
An: [EMAIL PROTECTED]
Betreff: PAssword-file in rsync


Hi ,


 I have installed cygwin in windows 2000 prof.The cygwin works
properly  I have setup RSYNC server in SUSE Linux machine ,i want to
make my windows 2000 prof as my rsync client .I tried useing
--password-file option , but that doesn't work for me .I scheduled the
task in windows 2000 prof with the option --password-file but doesn't
work and prompts for password in the specified time 

Kindly somebody help me out from this 

Regards
Sumithra


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync on OpenVMS

[jw schultz]

On Wed, Oct 22, 2003 at 11:59:48PM -0400, John E. Malmberg wrote:
> jw schultz wrote:
> >On Tue, Oct 21, 2003 at 11:28:11PM -0400, John E. Malmberg wrote:
> >
> >>
> >>There are approximately 235 global and static variables in rsync, and
> >>of those 105 are obviously never modified after the fork() takes place. 
> >>That may be the case for several of the others, like the 10 in batch.c
> >>
> >>As the use of the remaining ones are identified, that issue is easily 
> >>fixed.  What I need to do is map the routines called by the receive 
> >>process/thread to see what static/global variables that they modify.
> >>
> >
> >If you put the ones that get modified post-fork into a
> >thread-local structure there is a reasonable chance of that
> >getting into mainline.
> 
> Now what would be more acceptable:
> 
> Adding a context parameter to all the routines that reference the 
> global/static variables that are currently shared?
> 
> or
> 
> Having each routine that uses those type of variables to go through the 
> work of determining which thread that they are in?
> 
> 
> It seems to me that adding the context parameter would make it easier to 
> maintain, and have a lower overhead.  It also saves having thread lookup 
> calls added to the routines.
> 
> In some other cases, it looks like the sharing should not hurt, but 
> their should be some synchronization.

Long term thread support would be to use a pointer in thread
local storage or to pass it to any functions that use it.

For now just define the structure and treat it as global in
mainline.

> Since there are only two processes or threads that need to be tracked, 
> while the parameter could be a pointer to global structure, it can be 
> disruptive to put all the local thread specific static values in that 
> structure.  Mainly because a lot of them have the same symbol names, 
> just different scope.
> 
> So there could be a global variable that is  void * recv_context, and a 
> void * send_context for the sender for completeness.

That sounds like it might be OK to me but will require much
more thought and discussion.

> A routine that needs separate local static variables would check the 
> context parameter passed to it against one of those pointers, and then 
> use the appropriate set of local variables.

That sort of indirection just complicates things.  If you
are going to pass a context parameter just pass the pointer
to the structure itself.

> With this, the static variables would become an array, and the context 
> parameter would determine if index 0 or 1 was used.

There are up to three processes.

Local has sender, generator and receiver.
Daemon has the daemon and either the sender, or the generator
and receiver.
Client has either sender or generator and receiver.

Getting it threadable will have to be done by inches.

The structure is a single step that should help to reduce
the size of your patches while enhancing the documentation
of some of the globals.


-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Filesystem panic

[Martin Pool]

On 22 Oct 2003, Morten <[EMAIL PROTECTED]> wrote:
> 
> Hi,
> 
> I'm running RH9, 2.4.20-18.9. Each night, the server mounts
> an external FAT32 disk using firewire, and performs backups
> to it using rsync.
> 
> Twice within the past 3 months, the backup process has resulted
> in machine crash (complete hang, hardware reboot needed).
> 
> From /var/log/messages:
> 
> Oct 22 04:02:20 yoda kernel: Filesystem panic (dev 08:21).
> Oct 22 04:02:20 yoda kernel:   fat_free: deleting beyond EOF
> Oct 22 04:02:20 yoda kernel:   File system has been set read-only

You probably need to report this to the vfat fs maintainer

VFAT FILESYSTEM:
P:  Gordon Chaffee
M:  [EMAIL PROTECTED]
L:  [EMAIL PROTECTED]
W:  http://bmrc.berkeley.edu/people/chaffee
S:  Maintained

> From the rsync error log, I can see that the filesystem becomes
> read-only, and that it begins to fail the synchronization task with
> 
> mkstemp 
> SAGER_igangvaerende/2003_07_Fremtidens_Uni/Fase_4/Diagrammer/Celletyper/
> .Delecelle.psd.Rz49bM failed: Read-only file system
> 


> Which is understandable. After doing this for a while, the error
> message changes to "Too many open files". And I suspect that this is
> what causes the machine to hang. 

Can you please try to reproduce the problem, and then do

  lsof -p PID_OF_RSYNC

for each rsync process sometime before it starts complaining about too
many open files.  Then kill rsync to avoid the problem.

> Is there any way to configure rsync to abort execution once the
> first error occurs?

Not at the moment.

-- 
Martin 
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: The rsync daemon as a gateway service?

[Martin Pool]

That's an interesting idea.

As a temporary measure you might different tcp ports rather than
module names to distinguish different services, and then use tcp
redirectors.

-- 
Martin 
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync on OpenVMS

[John E. Malmberg]

jw schultz wrote:
On Tue, Oct 21, 2003 at 11:28:11PM -0400, John E. Malmberg wrote:

There are approximately 235 global and static variables in rsync, and
of those 105 are obviously never modified after the fork() takes place. 
That may be the case for several of the others, like the 10 in batch.c

As the use of the remaining ones are identified, that issue is easily 
fixed.  What I need to do is map the routines called by the receive 
process/thread to see what static/global variables that they modify.

If you put the ones that get modified post-fork into a
thread-local structure there is a reasonable chance of that
getting into mainline.
Now what would be more acceptable:

Adding a context parameter to all the routines that reference the 
global/static variables that are currently shared?

or

Having each routine that uses those type of variables to go through the 
work of determining which thread that they are in?

It seems to me that adding the context parameter would make it easier to 
maintain, and have a lower overhead.  It also saves having thread lookup 
calls added to the routines.

In some other cases, it looks like the sharing should not hurt, but 
their should be some synchronization.

Since there are only two processes or threads that need to be tracked, 
while the parameter could be a pointer to global structure, it can be 
disruptive to put all the local thread specific static values in that 
structure.  Mainly because a lot of them have the same symbol names, 
just different scope.

So there could be a global variable that is  void * recv_context, and a 
void * send_context for the sender for completeness.

A routine that needs separate local static variables would check the 
context parameter passed to it against one of those pointers, and then 
use the appropriate set of local variables.

With this, the static variables would become an array, and the context 
parameter would determine if index 0 or 1 was used.

-John
[EMAIL PROTECTED]
Personal Opinion Only
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

PAssword-file in rsync

[sumithra]

Hi ,


 I have installed cygwin in windows 2000 prof.The cygwin works
properly  I have setup RSYNC server in SUSE Linux machine ,i want to
make my windows 2000 prof as my rsync client .I tried useing
--password-file option , but that doesn't work for me .I scheduled the
task in windows 2000 prof with the option --password-file but doesn't
work and prompts for password in the specified time 

Kindly somebody help me out from this 

Regards
Sumithra


-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Synching text files.

[Donovan Baarda]

On Thu, 2003-10-23 at 05:39, Kurt Roeckx wrote:
> On Wed, Oct 22, 2003 at 11:46:22AM -0700, jw schultz wrote:
> > On Wed, Oct 22, 2003 at 08:31:12PM +0200, Kurt Roeckx wrote:
> > > Hi,
> > > 
> > > I'm trying to sync text files where lines get inserted and
> > > deleted.  From what I understand, rsync uses blocks to compare
> > > and so can't find much data that matches.
> > > 
> > > Would it be possible to make it work so it finds blocks that get
> > > inserted or deleted?
> > 
> > It already does.
> 
> Does it only do it on block basis?  Or will it try to find an
> offset inside the block?

It will find matching blocks at arbitrary byte offsets.

Think of the original file as a sequence of fixed sized blocks.
Inserting or deleting a single byte "breaks" that block so it no longer
matches, but rsync will match all the blocks before and after that
non-matching block.

Note that one think that can break rsync for text files is MSDOS CR/LF
vs Unix LF line termination. This effectively makes a change every line,
and unless you have lines longer than the block size you are using,
rsync will not be able to find a single match.

-- 
Donovan Baarda <[EMAIL PROTECTED]>
http://minkirri.apana.org.au/~abo/

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

RSYNC_PROXY

[Max Clark]

Hi all,

I am interested at using a web proxy to help speed a transfer across a WAN. Are there 
any examples of syntax for the RSYNC_PROXY command available?

Thanks,
Max

--
Max Clark 
My Blog http://www.clarksys.com

>> spamtrap: [EMAIL PROTECTED] - do NOT ever send email to this address <<
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Synching text files.

[Kurt Roeckx]

On Wed, Oct 22, 2003 at 11:46:22AM -0700, jw schultz wrote:
> On Wed, Oct 22, 2003 at 08:31:12PM +0200, Kurt Roeckx wrote:
> > Hi,
> > 
> > I'm trying to sync text files where lines get inserted and
> > deleted.  From what I understand, rsync uses blocks to compare
> > and so can't find much data that matches.
> > 
> > Would it be possible to make it work so it finds blocks that get
> > inserted or deleted?
> 
> It already does.

Does it only do it on block basis?  Or will it try to find an
offset inside the block?


Kurt

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Synching text files.

[jw schultz]

On Wed, Oct 22, 2003 at 08:31:12PM +0200, Kurt Roeckx wrote:
> Hi,
> 
> I'm trying to sync text files where lines get inserted and
> deleted.  From what I understand, rsync uses blocks to compare
> and so can't find much data that matches.
> 
> Would it be possible to make it work so it finds blocks that get
> inserted or deleted?

It already does.

-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: The rsync daemon as a gateway service?

[jw schultz]

On Wed, Oct 22, 2003 at 08:43:38AM -0500, K S Braunsdorf wrote:
> 
> In rsyncd.conf I'd like to be able to specify something like:
>   [module1]
>   gateway 10.168.172.9
> 
> or (I think we have to change the protocol a little for this one):
>   [module2]
>   redirect datasource.my.domain
> 
> I've run into this need a few times, and I think it might be useful
> enough to add (both of these) to the daemon configuration.  I'm asking
> the list to see if either of these might be useful to someone else.
> 
> 
> I want to serve a large number of "content modules" to a client
> population.  These content modules might be very large and volatile,
> and are (by their nature) hosted on many separate servers.  I can
> put an rsync daemon on each server, but I can't create a single
> host with all the modules on it (too large, and too quickly out of
> date).
> 
> Presently clients find the content I want via something like:
>   each client rsync's down an index
>   each client looks up the host with the [module] needed
>   each client connects to that data source
> which works fine.
> 
> That has a few bugs for me, I must
>   1) open firewall rules from {all clients} -> {all servers}
>   2) build the index files (by polling all the data sources)
>   3) [my problem] the network routes from {all server} -> {some clients}
>  are wrong.
> 
> I have the rsync daemons up on all the unique servers, I want a "gateway"
> rsyncd that dispatches the connections through to the right [module] owner.
> 
> When I have all my servers on a non-routable network (or behind a firewall)
> I want to be able to tell the "gateway rsyncd" to "pump the connection"
> for the client:
>   [module1]
>   gateway 10.168.172.9
> 
> When I have peer rsyncd's I want to be able to redirect clients to
> the one with the data, for example on "vulcan" I'd install:
>   [vulcan]
>   
>   [terran]
>   redirect earth.federation.org
> 
> On "earth" I might install:
>   [vulcan]
>   redirect vulcan.federation.org
>   [terran]
>   
> 
> 
> To provide a "read only" service to the Internet I could open a
> firewall rule to "rsync.federation.org" and configure:
>   [vulcan]
>   read only
>   gateway vulcan.federation.org
>   [terran]
>   read only
>   gateway earth.federation.org
> 
> Adding an optional "port number" on the gateway might be a good idea, and
> maybe adding a mapping for the module name (in case they are different).
> 
> 
> As a derivative step we could have:
>   proxy rsync.founders.org
> as a way to poll the "rsync.founders.org" service for a module name,
> when we don't have it.  If it has the the module we'll gateway it,
> and:
>   refer rsync.borg.org
> to do that same thing, but redirect to the rsync::site/module if we find it.
> 
> 
> I think this allows rsync servers to cluster in a way ftp can't.  I
> also think it would be easy to implement.  We would have to check
> (in the client) for infinite redirection loops.

Very nice idea.  It just doesn't belong in rsync itself.
What you want is an rsync proxy daemon.  The redirect is
beyond what the protocol would support but proxying
can be done.


-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Synching text files.

[Kurt Roeckx]

Hi,

I'm trying to sync text files where lines get inserted and
deleted.  From what I understand, rsync uses blocks to compare
and so can't find much data that matches.

Would it be possible to make it work so it finds blocks that get
inserted or deleted?


Kurt

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Feature Request - Recursive Rsync Parameter - Example Script

[Andrew J. Schorr]

On Tue, Oct 21, 2003 at 06:46:16PM -0700, jw schultz wrote:
> 
> Limiting the depth of recursion is already supported just
> not intuitive.
> 
>   rsync -r --exclude='/*/*/*/'
> 
> Your idea for a shell script to automate picking up the
> lower levels is good and could compose the --exclude
> pattern.  The next step would be to set the job partition
> level based on path count as in "find $subtree -print|wc -l".
> 

I have used this technique myself to limit the number of files
processed in a single rsync invocation.  If you use find to locate
the files that you need to process, you can then use the --files-from
option to process a certain number of those files at a time.  This
works like a charm.

-Andy
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

The rsync daemon as a gateway service?

[K S Braunsdorf]

In rsyncd.conf I'd like to be able to specify something like:
[module1]
gateway 10.168.172.9

or (I think we have to change the protocol a little for this one):
[module2]
redirect datasource.my.domain

I've run into this need a few times, and I think it might be useful
enough to add (both of these) to the daemon configuration.  I'm asking
the list to see if either of these might be useful to someone else.


I want to serve a large number of "content modules" to a client
population.  These content modules might be very large and volatile,
and are (by their nature) hosted on many separate servers.  I can
put an rsync daemon on each server, but I can't create a single
host with all the modules on it (too large, and too quickly out of
date).

Presently clients find the content I want via something like:
each client rsync's down an index
each client looks up the host with the [module] needed
each client connects to that data source
which works fine.

That has a few bugs for me, I must
1) open firewall rules from {all clients} -> {all servers}
2) build the index files (by polling all the data sources)
3) [my problem] the network routes from {all server} -> {some clients}
   are wrong.

I have the rsync daemons up on all the unique servers, I want a "gateway"
rsyncd that dispatches the connections through to the right [module] owner.

When I have all my servers on a non-routable network (or behind a firewall)
I want to be able to tell the "gateway rsyncd" to "pump the connection"
for the client:
[module1]
gateway 10.168.172.9

When I have peer rsyncd's I want to be able to redirect clients to
the one with the data, for example on "vulcan" I'd install:
[vulcan]

[terran]
redirect earth.federation.org

On "earth" I might install:
[vulcan]
redirect vulcan.federation.org
[terran]



To provide a "read only" service to the Internet I could open a
firewall rule to "rsync.federation.org" and configure:
[vulcan]
read only
gateway vulcan.federation.org
[terran]
read only
gateway earth.federation.org

Adding an optional "port number" on the gateway might be a good idea, and
maybe adding a mapping for the module name (in case they are different).


As a derivative step we could have:
proxy rsync.founders.org
as a way to poll the "rsync.founders.org" service for a module name,
when we don't have it.  If it has the the module we'll gateway it,
and:
refer rsync.borg.org
to do that same thing, but redirect to the rsync::site/module if we find it.


I think this allows rsync servers to cluster in a way ftp can't.  I
also think it would be easy to implement.  We would have to check
(in the client) for infinite redirection loops.

--
Thanks for your time,
[EMAIL PROTECTED] (KS Braunsdorf)

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

issue with large number of files

[Sven Geisler]

Hi,

I use rsync to syncronize two systems.
There are 2 million + files.

My problem is
1. rsync is very slow (it needs more than 48 hours)
2. rsync needs too much RAM (ca. 750 MByte on each server)

The backup software needs 14 hours including file transfer to the backup
server for full backup.

My configuration:
1. Server Dual-XEON with 2 GB RAM.
2. Server Dual-PIII with 2 GB RAM.

The partition has 160 GB in use with approx.2 million files and a very
large number of directories.

I saw in the TO-DO file that this is problem has been recognised.
Is there a solution?
Is the solution for this issue already scheduled for the next version?

Or what can I do to get it done in the next version?

Regards,
Sven.


-- 
Sven Geisler <[EMAIL PROTECTED]>
AEC/communications GmbH

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync user@host:src user@host:dest ?

[pod]

> "OK" == Olivier Kaloudoff <[EMAIL PROTECTED]> writes:

OK> Hi, I'm using rsync with ssh, and would like to know if you have a
OK> solution to rsync from one server to another, in the following
OK> scheme:

OK> A --- B --- C

OK> I'm on B, and want to rsync from C to A. I have no rights
OK> to copy from C to A directly, and no rights to play on ports.

OK> Every server is installed with ssh, which I can customise.



OK> Any ideas ?

To copy from C to A via B use (some variation of)

[EMAIL PROTECTED] rsync --rsh ssh --rsync-path 'ssh [EMAIL PROTECTED] rsync' 
sourcefile [EMAIL PROTECTED]:destfile

So from B you just need to lauch something similar on C via ssh
(presumably).
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

rsync user@host:src user@host:dest ?

[Olivier Kaloudoff]

Hi,

I'm using rsync with ssh,
and would like to know if you have
a solution to rsync from one server
to another, in the following scheme:

A --- B --- C

I'm on B, and want to
rsync from C to A. I have no rights
to copy from C to A directly, and
no rights to play on ports.

Every server is installed
with ssh, which I can customise.



Any ideas ?


Olivier

-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Filesystem panic

[Morten]

Hi,

I'm running RH9, 2.4.20-18.9. Each night, the server mounts
an external FAT32 disk using firewire, and performs backups
to it using rsync.
Twice within the past 3 months, the backup process has resulted
in machine crash (complete hang, hardware reboot needed).
From /var/log/messages:

Oct 22 04:02:20 yoda kernel: Filesystem panic (dev 08:21).
Oct 22 04:02:20 yoda kernel:   fat_free: deleting beyond EOF
Oct 22 04:02:20 yoda kernel:   File system has been set read-only
From the rsync error log, I can see that the filesystem becomes
read-only, and that it begins to fail the synchronization task with
mkstemp 
SAGER_igangvaerende/2003_07_Fremtidens_Uni/Fase_4/Diagrammer/Celletyper/
.Delecelle.psd.Rz49bM failed: Read-only file system

Which is understandable. After doing this for a while, the error
message changes to "Too many open files". And I suspect that this is
what causes the machine to hang. Is there any way to configure rsync
to abort execution once the first error occurs?
Thanks in advance,

Morten



--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync --dry-run --link-dest problem

[jw schultz]

On Wed, Oct 22, 2003 at 12:16:04AM -0700, Russell Senior wrote:
> > "jw" == jw schultz <[EMAIL PROTECTED]> writes:
> 
> jw> On Tue, Oct 21, 2003 at 11:29:04PM -0700, Russell Senior wrote:
> >>  I am trying to use rsync for making snapshots, sharing hardlinks
> >> at the destination using the --link-dest option.  In conjunction
> >> with this, I would like for --dry-run to report some reliable-ish
> >> number for how much space it is going to consume at the destination
> >> so that I can arrange to free such space prior the launching rsync
> >> "for effect".  Right now, that isn't working:
> >> 
> >> # uname -a Linux  2.4.22 #2 Wed Oct 8 20:17:18 PDT 2003
> >> i686 GNU/Linux
> >> 
> >> # rsync --version rsync version 2.5.6 protocol version 26 Copyright
> >> (C) 1996-2002 by Andrew Tridgell and others
> >>  Capabilities: 64-bit files, socketpairs,
> >> hard links, symlinks, batchfiles, IPv6, 64-bit system inums, 64-bit
> >> internal inums
> >> 
> >> # rsync -v -a -H --dry-run --exclude=/proc --exclude=/mnt --delete
> >> --link-dest=../2003-10-21/ / 2003-10-21c/ building file list
> >> ... done created directory 2003-10-21c/ rsync: push_dir
> >> 2003-10-21c/: No such file or directory rsync error: errors
> >> selecting input/output files, dirs (code 3) at main.c(328) rsync:
> >> connection unexpectedly closed (8 bytes read so far) rsync error:
> >> error in rsync protocol data stream (code 12) at io.c(165)
> >> 
> >> The destination is mounted under /mnt (which explains that
> >> exclusion).
> 
> jw> When you do a --dry-run it won't create directories.  This means
> jw> that --dry-run won't work if the destination directory doesn't
> jw> exist.  I'm sure you control whether or not the destination
> jw> directory exists.
> 
> jw> If the real destination is empty or non-existant doing a --dry-run
> jw> with the eventual link-dest directory as the destination will
> jw> yield the list of what has changed.
> 
> Ah.  Clever.  But that isn't going to tell me how much space is going
> to get consumed for directories, which in a deep tree might not be
> trivial.

If you are that tight on space the filesystem will be badly
fragmented.  You can run find -type d on the local space
(doing exclusions) to get the directory list.  If you want
info of that degree of detail you can expect to have to work
for it.

-- 

J.W. SchultzPegasystems Technologies
email address:  [EMAIL PROTECTED]

Remember Cernan and Schmitt
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync --dry-run --link-dest problem

[Russell Senior]

> "jw" == jw schultz <[EMAIL PROTECTED]> writes:

jw> On Tue, Oct 21, 2003 at 11:29:04PM -0700, Russell Senior wrote:
>>  I am trying to use rsync for making snapshots, sharing hardlinks
>> at the destination using the --link-dest option.  In conjunction
>> with this, I would like for --dry-run to report some reliable-ish
>> number for how much space it is going to consume at the destination
>> so that I can arrange to free such space prior the launching rsync
>> "for effect".  Right now, that isn't working:
>> 
>> # uname -a Linux  2.4.22 #2 Wed Oct 8 20:17:18 PDT 2003
>> i686 GNU/Linux
>> 
>> # rsync --version rsync version 2.5.6 protocol version 26 Copyright
>> (C) 1996-2002 by Andrew Tridgell and others
>>  Capabilities: 64-bit files, socketpairs,
>> hard links, symlinks, batchfiles, IPv6, 64-bit system inums, 64-bit
>> internal inums
>> 
>> # rsync -v -a -H --dry-run --exclude=/proc --exclude=/mnt --delete
>> --link-dest=../2003-10-21/ / 2003-10-21c/ building file list
>> ... done created directory 2003-10-21c/ rsync: push_dir
>> 2003-10-21c/: No such file or directory rsync error: errors
>> selecting input/output files, dirs (code 3) at main.c(328) rsync:
>> connection unexpectedly closed (8 bytes read so far) rsync error:
>> error in rsync protocol data stream (code 12) at io.c(165)
>> 
>> The destination is mounted under /mnt (which explains that
>> exclusion).

jw> When you do a --dry-run it won't create directories.  This means
jw> that --dry-run won't work if the destination directory doesn't
jw> exist.  I'm sure you control whether or not the destination
jw> directory exists.

jw> If the real destination is empty or non-existant doing a --dry-run
jw> with the eventual link-dest directory as the destination will
jw> yield the list of what has changed.

Ah.  Clever.  But that isn't going to tell me how much space is going
to get consumed for directories, which in a deep tree might not be
trivial.

-- 
Russell Senior ``shtal latta wos ba padre u prett tu nashtonfi
[EMAIL PROTECTED]  mrlosh''  -- Bashgali Kafir for ``If you have
 had diarrhoea many days you will surely die.''
-- 
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html