Re: keeping folders in sync *sparingly*

2013-09-03 Thread Justin T Pryzby
Try --fuzzy: -y, --fuzzy This option tells rsync that it should look for a basis file for any destination file that is missing. The current algorithm looks in the same directory as the destination file for either a file that has an identical size and modified-time, or a simi‐ larly-named

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 08:44:08PM +0530, Sherin A wrote: On Tuesday 13 August 2013 05:50 PM, Paul Slootman wrote: On Tue 13 Aug 2013, Matthias Schniedermeyer wrote: BUT there is no direct vulnerability in that, only processes after that (like backup/rsync) can make a vulnerability out of it.

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 09:43:06PM +0530, Sherin A wrote: If linux user foo , with home /home/foo , what ownership we need to give the files under his home folder , it must be foo and not root. Why? The user created the hardlink themselves, and it had root ownership, why should the

Re: Fwd: Re: need help with an rsync patch

2013-08-13 Thread Justin T Pryzby
On Tue, Aug 13, 2013 at 10:10:04PM +0530, Sherin A wrote: I am doing rsync from root@10.0.0.10/home/foo to storageuser@10.0.0.20/home/storageuser/dailybackup/foo over ssh (no role for -H) Why not rsync from root to root? Or use the rsync protocol (not over ssh). Note that you can use -H

Re: [Bug 9915] New: File stopped synchronizing during transmission

2013-06-10 Thread Justin T Pryzby
On Wed, May 29, 2013 at 04:39:55AM +, samba-b...@samba.org wrote: https://bugzilla.samba.org/show_bug.cgi?id=9915 We have currently trying to transmit data from one server to another using RYSNC by synchronizing 2 folders. Occasionally, we noticed that the file stop when in the middle of

Re: Fwd: rsync 3.0.9 partial file left after CTRL-C WITHOUT using --partial

2013-04-05 Thread Justin T Pryzby
Is it a new tmp file every time ?? Or is the tmpfile leftover from some (probably not reproducible) run? Are you sure there are no stuck rsync processes running? To be sure, you might run sudo lsof on that tmpfile. Justin On Fri, Apr 05, 2013 at 12:45:39PM +0200, Paul Lopez wrote: Hi folks,

Re: Help: Make 2 Dirs Identical

2013-02-10 Thread Justin T Pryzby
If you really want to exclude /vault/test1/ccc, and for /vault/test2 to end up at /store/test2, then I would suggest: rsync -avz --exclude /test1/ccc src:/vault/ dest:/store rsync -avz src:/vault/test2 dest:/store that runs rsync over ssh. Note that the trailing slash on the src argument in the

Re: vanilla rsync 3.0.9 hangs after transferring ~2000 files

2012-11-08 Thread Justin T Pryzby
On Thu, Nov 08, 2012 at 11:54:52PM +0100, Christian Iversen wrote: On 2012-11-02 19:32, Justin T Pryzby wrote: On Fri, Nov 02, 2012 at 02:33:13PM +0100, Christian Iversen wrote: However, 1 server is giving me a lot of trouble. It has a directory with (currently) 734088 files in it, and every

Re: vanilla rsync 3.0.9 hangs after transferring ~2000 files

2012-11-02 Thread Justin T Pryzby
On Fri, Nov 02, 2012 at 02:33:13PM +0100, Christian Iversen wrote: However, 1 server is giving me a lot of trouble. It has a directory with (currently) 734088 files in it, and every time I try to backup this dir, rsync hangs after transferring roughly 2000 files. Sometimes it's around 1800,

Re: Problem rsyncing 450GB file to my NAS: 'connection unexpectedly closed'

2012-10-12 Thread Justin T Pryzby
Not sure, but some ideas: -P means to retain partial files, and doesn't have anything to do with /tmp; I wonder if you mean --inplace (not sure)? It sounds like a daemon may be timing out; is there a timeout specified in rsyncd.conf? Is there a remote logfile with any useful content? Justin

Re: Problem rsyncing 450GB file to my NAS: 'connection unexpectedly closed'

2012-10-12 Thread Justin T Pryzby
On 12.10.2012 20:06, Justin T Pryzby - just...@norchemlab.com wrote: Not sure, but some ideas: -P means to retain partial files, and doesn't have anything to do with /tmp; I wonder if you mean --inplace (not sure)? It sounds like a daemon may be timing out; is there a timeout specified in rsyncd.conf

Re: collecting the differences between a local host and remote archive to third local location (a usb device)

2012-10-11 Thread Justin T Pryzby
You can use rsync --write-batch (and write-batch-only). Justin On Thu, Oct 11, 2012 at 02:33:22PM -0700, Dan Stromberg wrote: I wonder if rdiff would do this nicely...? http://librsync.sourcefrog.net/doc/rdiff.html On Thu, Sep 27, 2012 at 12:33 AM, Benjamin Ward b...@forward.net.au wrote:

Re: local - local file copy question

2012-08-19 Thread Justin T Pryzby
Note that --whole-file is the default when both the source and destination are specified as local paths, and implies that the file is copied without the delta transfer algorithm. Justin On Sat, Aug 18, 2012 at 11:05:47PM -0700, Linda Walsh wrote: In looking at source, I started at fileio and

Re: How to specify the dest directory?

2012-07-11 Thread Justin T Pryzby
Yes, if you run rsync -az A/ B Be careful to specify the thing you intend. Justin On Wed, Jul 11, 2012 at 04:52:43PM -0500, Peng Yu wrote: When I use the following command, A (a directory) will be created in B. But I actually want to cp the content of A to B. rsync -az A B Is

Re: rsync pauses

2011-08-31 Thread Justin T Pryzby
I assume it's doing I/O, you can start a strace on the process to see for sure. Note that the rsync client usually forks a few times, so you may want to strace all of them (strace -p X -p Y -p Z), or launch the command under strace (strace -f CMD ARGS). Justin On Wed, Aug 31, 2011 at

rsync batch file list output?

2011-06-15 Thread Justin T Pryzby
Is there any way to output some stat/ls/diffstat/index-type output from a batch file? I'd like to see what's taking the most space, so the important bits would be the file name and some metric for the changed file size. Total size of the data in the batch file for that file would be fine, even