Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-29 Thread raf via rsync
or something > other than rsync is doing things in the same dir. > > On 10/29/19 9:00 PM, raf via rsync wrote: > > Hi, > > > > debian-9, rsync-3.1.2 (both ends) > > > > I have a task that rsyncs files from a list of > > candidate files (--files-from=). I

Re: Speed up rsync with many of excluded files

2019-11-12 Thread raf via rsync
raf via rsync wrote: > Georg Limbach via rsync wrote: > > > Hello, > > > > I have a problem while rsyncing a directory with perhaps 1.000.000 > > files. Before this I generate some files locally and add them to temp > > files. So this files should be excl

Re: Speed up rsync with many of excluded files

2019-11-12 Thread raf via rsync
Georg Limbach via rsync wrote: > Hello, > > I have a problem while rsyncing a directory with perhaps 1.000.000 > files. Before this I generate some files locally and add them to temp > files. So this files should be excluded from syncing. > > My rsync call looks like this: > > rsync

Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
I don't expect rsync to ever do the wrong thing. :-) > Have you tried using inotify to monitor for changes at the fs level? You > should see a "read" on the sender and a "read" + "write" on the receiver. No, but that's a good idea. I'll investigate tha

Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
s, raf Paul Slootman via rsync wrote: > On Wed 30 Oct 2019, raf via rsync wrote: > > > > I have a task that rsyncs files from a list of > > candidate files (--files-from=). It's verbose (-v) and > > It would be helpful to show the complete rsync command line. &g

Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
me that ends in a > carriage return (not a newline). It's probably smart enough to handle > it, but if it isn't, the current log line might be overwritten by the > next one. > > Joe > > On 10/30/19 1:24 AM, raf via rsync wrote: > > Thanks. I'll try that. But I agree that it'

Seemingly impossible bug: -v not always listing every copied file

2019-10-29 Thread raf via rsync
Hi, debian-9, rsync-3.1.2 (both ends) I have a task that rsyncs files from a list of candidate files (--files-from=). It's verbose (-v) and its stdout is captured to a file which is then sent to the receiving host. The captured verbose output is examined on the receiving host to know which files

Re: Removing folder at destination

2019-11-24 Thread raf via rsync
Fabian Cenedese via rsync wrote: > >Why not exclude 2_ASSETS from the first run, and then do a second run to > >rsync the _contents_ of 2_ASSETS to the target 01_us_eng directory? > > > >Add /01_us_eng/2_ASSETS/ to the exclude.txt file. > > > >rsync -rvz --exclude-from=exclude.txt source

Re: [draft PATCH] whitelist support for refuse options

2020-02-10 Thread raf via rsync
Hi Nick, Just in case you aren't already aware of it, there is a tool that limits rsync to particular directories: rrsync - Restricts rsync to subdirectory declared in .ssh/authorized_keys https://www.samba.org/ftp/unpacked/rsync/support/rrsync There is also a generic tool (I wrote this

Re: Stale pid file problem, and a proposed solution

2020-01-20 Thread raf via rsync
Joseph C. Sible via rsync wrote: > Today, rsyncd manages its pid file by open()ing it with O_CREAT|O_EXCL > at startup, and then unlink()ing it at shutdown. If the open() fails > at startup because the file already exists, then rsyncd will assume > another instance of itself is already running

Re: Rsyncing via LAN deadly slow

2020-04-09 Thread raf via rsync
f27ae.9000...@free.fr> Stephane Ascoet via rsync wrote: > Hi, I'm backing up contents of my >

Re: Rsyncing via LAN deadly slow

2020-04-12 Thread raf via rsync
Stephane Ascoet via rsync wrote: > > Is there iowait? If so, that might be the problem. Also, > > Where can I see this information? in the header section of top: top - 12:25:13 up 43 days, 22:31, 4 users, load average: 0.18, 0.18, 0.12 Tasks: 366 total, 1 running, 365 sleeping, 0

Re: Rsync to Network Share works from cmd but fails from Scheduled Task

2020-04-02 Thread raf via rsync
; to work. I figured out another solution, but thank you very much for your > help. > > Best, > Leon > > On Sun, Mar 29, 2020 at 9:23 PM raf via rsync wrote: > > > Leon Vanderploeg via rsync wrote: > > > > > Greetings, > > > >

Re: osx permission issue

2020-03-29 Thread raf via rsync
Hi, I don't think it's about file flags. macOS has SIP (System Integrity Protection) which, among other things, restricts the ability of processes to access certain parts of the file system. Usually people ask about how to override this locally which can be done by disabling SIP altogether, or

Re: Rsync to Network Share works from cmd but fails from Scheduled Task

2020-03-29 Thread raf via rsync
Leon Vanderploeg via rsync wrote: > Greetings, > > I have written a C program that runs on Windows servers and does overhead > and reporting for backup administration. The program calls rsync for the > actual data copy function. It copies data from a remote system to a local > drive and that

Re: osx permission issue

2020-05-13 Thread raf via rsync
Henri Shustak via rsync wrote: > If you are talking about SIP, then at present SSH will have full disk access > (as much as it can) by default. > > Take a look at this LBackup page which discusses this in more detail : > http://www.lbackup.org/developer/dealing_with_sip > > Hope that helps.

Re: Question/comment about -n (dry run) flag of rsync

2020-03-10 Thread raf via rsync
T. Shandelman via rsync wrote: > Rsync is a remarkably handy tool that I use virtually every day. > > But there is one thing about rsync that drives me totally crazy. > > Under the -n (dry run) flag, rsync seems to produce exactly the same output > as without that flag. > > I cannot tell you

Re: Question/comment about -n (dry run) flag of rsync

2020-03-10 Thread raf via rsync
raf via rsync wrote: > T. Shandelman via rsync wrote: > > > Rsync is a remarkably handy tool that I use virtually every day. > > > > But there is one thing about rsync that drives me totally crazy. > > > > Under the -n (dry run) flag, rsync seem

Re: Copying TBs -> error -> work around

2020-09-13 Thread raf via rsync
On Fri, Sep 11, 2020 at 10:53:14AM +1000, Philip Rhoades via rsync wrote: > Roland, > > > On 2020-09-10 21:27, Roland wrote: > > > with rsync hanging - after breakout on /home for writing I then get: > > > "Read-only file system" > > > > if your filesystem switches to read-only, you have a

Re: "-f ._filterlist" syntax

2020-09-27 Thread raf via rsync
On Sun, Sep 27, 2020 at 03:19:17PM -0700, Will McGinnis via rsync wrote: > Hello, A GUI program uses rsync for network transfers. It is able to > load filters from a file by putting a dot and underscore before it. > Example:mkdir 1 2; touch 1/a .empty; rsync -f ._empty 1/ 2/ > > Is the dot

Re: Is there a default for 'pid file' for rsync in daemon mode?

2021-01-01 Thread raf via rsync
On Fri, Jan 01, 2021 at 11:31:11AM +, Chris Green via rsync wrote: > Francis.Montagnac--- via rsync wrote: > > > > Hi. > > > > On Fri, 01 Jan 2021 09:57:38 + Chris Green via rsync wrote: > > > > > My backup system crashed a couple of nights ago due to a power cut > > > (can't really

Re: Is there a default for 'pid file' for rsync in daemon mode?

2021-01-02 Thread raf via rsync
On Sat, Jan 02, 2021 at 11:41:52AM -0800, Wayne Davison wrote: > On Fri, Jan 1, 2021 at 2:13 PM raf wrote: > > > maybe the pidfile should be locked > > > > https://download.samba.org/pub/rsync/NEWS#3.2.0 > > ..wayne.. lovely. it must have been an old version. cheers, raf -- Please use

Re: How to manage root<-->root rsync keeping permissions?

2021-08-07 Thread raf via rsync
On Sat, Aug 07, 2021 at 11:44:34AM +0100, Chris Green via rsync wrote: > L A Walsh via rsync wrote: > > On 2021/08/03 07:09, Chris Green via rsync wrote: > > > I already have an rsync daemon server running elsewhere, I can add > > > this requirement to that I think. Thank you. > > > > >

Re: How to manage root<-->root rsync keeping permissions?

2021-08-03 Thread raf via rsync
On Tue, Aug 03, 2021 at 10:51:34AM +, Andy Smith via rsync wrote: > Hi Chris, > > On Tue, Aug 03, 2021 at 09:48:37AM +0100, Chris Green via rsync wrote: > > But how do you handle the other end to restore the root ownership etc.? > > The script has to do something like:- > > > > rsync

Re: Trying to elevate rsync privileges when connecting over ssh without using NOPASSWD in sudoers

2022-03-12 Thread raf via rsync
On Fri, Mar 11, 2022 at 10:36:49PM -0800, Bri Hatch via rsync wrote: > On Fri, Mar 11, 2022 at 10:22 PM Kevin Korb via rsync > wrote: > > > Rsync includes a script named rrsync that handles this perfectly. > > And authprogs provides similar functionality, though you use yaml to define > what