DO NOT REPLY [Bug 7663] New: --compare-dest hangs

2010-09-05 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7663

   Summary: --compare-dest hangs
   Product: rsync
   Version: 3.0.7
  Platform: Other
OS/Version: Linux
Status: NEW
  Severity: major
  Priority: P3
 Component: core
AssignedTo: way...@samba.org
ReportedBy: franc...@synways.com
 QAContact: rsync...@samba.org


hi !

First of all cangratulation for rsync, which I use as our main backup tool in
our banking company (ACM).

I am trying to also use rsync to deduplicate files.

example:

cd /
cp -a /bin /bin3
rm -v /bin3/z* /bin/bas*

#now we will use rsync to build a folder with all files from /bin that are
missing or different in /bin3, using --compare-dest

rm -r /bin.tmp -r; rsync --recursive --links --group --owner --devices
--numeric-ids --delete --delete-excluded --one-file-system
--compare-dest=../bin3 --hard-links --perms --times --size-only /bin/.
/bin.tmp -vv --stats | less

#this hangs!


1) on version 2.6.9 it worked more or less: missing files in bin3 were copied
from bin to bin.tmp except 'zcat' because it was a hardlink to 'gunzip', which
is not missing in bin3.

on version 3.0.3 and 3.0.7 it just hangs

2) secondly and unfortunately, removing the --hard-links option is also making
trouble in 3.0.3 and 3.0.7: it does not hang anymore but it sadly copy all
symlinks, even those that are present in bin3.
on 2.6.9, removing --hard-links option was working correctly and copying ONLY
the missing symlinks.

Thank you for your time.



Francois Scheurer
franc...@ac-markets.com
Head of Infratructure
Advanced Currency Markets SA


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 7663] --compare-dest hangs

2010-09-05 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7663


franc...@synways.com changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||INVALID




--- Comment #2 from franc...@synways.com  2010-09-05 08:45 CST ---
i made errors in typing in my example: (bin3 instead of bin)


cd /
cp -a /bin /bin3
rm -v /bin3/z* /bin3/bas*

Because I cannot edit the bug I will mark it as INVALID and retry


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 7664] New: --compare-dest hangs

2010-09-05 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=7664

   Summary: --compare-dest hangs
   Product: rsync
   Version: 3.0.7
  Platform: Other
OS/Version: Windows NT
Status: NEW
  Severity: normal
  Priority: P3
 Component: core
AssignedTo: way...@samba.org
ReportedBy: franc...@synways.com
 QAContact: rsync...@samba.org


hi !

First of all congratulation for rsync, which I use as our main backup tool in
our banking company (ACM).

I am trying to also use rsync to deduplicate files.

example:

cd /
cp -a /bin /bin3
rm -v /bin3/z* /bin3/bas*

#now we will use rsync to build a folder with all files from /bin that are
missing or different in /bin3, using --compare-dest

rm -r /bin.tmp -r; rsync --recursive --links --group --owner --devices
--numeric-ids --delete --delete-excluded --one-file-system
--compare-dest=../bin3 --hard-links --perms --times --size-only /bin/.
/bin.tmp -vv --stats | less

#this hangs!


1) on version 2.6.9 it worked more or less: missing files in bin3 were copied
from bin to bin.tmp except 'zcat' because it was a hardlink to 'gunzip', which
is not missing in bin3.

on version 3.0.3 and 3.0.7 it just hangs

2) secondly and unfortunately, removing the --hard-links option is also making
trouble in 3.0.3 and 3.0.7: it does not hang anymore but it sadly copy all
symlinks, even those that are present in bin3.
on 2.6.9, removing --hard-links option was working correctly and copying ONLY
the missing symlinks.

Thank you for your time.



Francois Scheurer
franc...@ac-markets.com
Head of Infratructure
Advanced Currency Markets SA


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Options to copy modified files

2010-09-05 Thread Henri Shustak

 We use rsync to copy files and directories from one server to the other. What 
 options should I give to rsync so that it only copies the modified files? For 
 example server1 may contain a dir which contains just one file that has been 
 modified, how do I get rsync to copy just that one file over? I would like 
 rsync to copy over the files which have been modified on the server1 to 
 server2.
 
 This is the command I have been using from server2:
 
 /usr/local/bin/rsync -a -A -h -u -p --progress --rsh=/usr/bin/rsh 
 --rsync-path=/usr/local/bin/rsync --exclude=/bin --exclude=/dev 
 --exclude=/etc --exclude=/export --ex
 
 clude=/home --exclude=/lib --exclude=/mnt --exclude=/net --exclude=/opt 
 --exclude=/platform --exclude=/proc --exclude=/sbin --exclude=/system 
 --exclude=/tmp --exclude=
 
 /usr --exclude=/var --exclude=/kernel --exclude=/devices --exclude=patches 
 --exclude=/cdrom r...@191.1.1.85:/ .

By default rsync will copy only the new / modified files. I am guessing that 
you are trying to copy the entire root directory of one server to another, to 
keep these servers in sync. If this is what you are trying to achieve, then you 
must specify the source and destination as arguments to rsync. 

Below are some possible examples (excluding rsync options) : 

# Copy the remote root directory into the current working directory
  $/path/to/rsync r...@191.1.1.85:/ ./

# Copy the current working directory to the remote servers root directory
  $/path/to/rsync ./ r...@191.1.1.85:/

 I would like rsync to copy over the files which have been modified on the 
 server1 to server2.


To achieve this, probably you will want something like the following (again the 
exmple listed below excludes rsync options) :

# Copy the remote root directory to the local root directory.
  $/path/to/rsync r...@191.1.1.85:/ /

If the idea is to have a server ready to swap into place in the event of a 
hardware failure you may wish to look at lsync : 
http://www.lucidsystems.org/tools/lsync

LSync uses rsync to keep servers file systems in sync. The URL above contains a 
diagram explaining how lsync may be used to protect servers in the event of a 
server failure situation.

Setup instructions for a possible server backup are available form : 
http://www.oriontransfer.co.nz/software/lsync/documentation/server-backup/index

Also, you may find that rather than excluding a number of directories and 
files, less setup time is required to simply include the directories you wish 
to keep in sync between the servers.

If you outline in further detail what you are trying to achieve (beyond just 
keeping the servers in sync) then I am hopeful that that others on this list 
will be able to provide further advice which is relevant to what you wish to 
achieve.

I hope this helps. 


-
This email is protected by LBackup, an open source backup solution.
http://www.lbackup.org

The Lucid central Christchurch data center in New Zealand was affected
by a recent earthquake. LBackup allowed services (including the 
LBackup website) to be quickly be restored to new hardware. 


-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html