Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
Unfortunately, I can't replicate the problem at will. But I'll investigate using iwatch/inotify to log everything from the file system's point of view. That should shed some light on what's happening. The file names don't contain any control characters (but good thinking!). thanks, raf Joe via

Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
The complete rsync command at the client end is approximately: rsync --files-from=/tmp/rptaudit.list.4958 -zltv --compress-level=9 \ -e 'ssh' --rsync-path 'umask 002; rsync' --chmod=D2770,F640 --exclude=archive \ ./ user@host:/var/thing/report >> /var/log/rpt2web/rpt2web.trace cheers, raf

Re: Seemingly impossible bug: -v not always listing every copied file

2019-11-03 Thread raf via rsync
Kyle Bassett via rsync wrote: > Hi raf, > > Curious issue you have. A few things: > > What distro(s) are you using? debian-9 > Same rsync version on both ends? Yes, rsync-3.1.2 > Hash of files look correct before and after the rsync? I didn't check but I expect so. I don't expect rsync to

Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-30 Thread Joe via rsync
If you are doing a small test run that duplicates the problem, you could use inotifywait or tail -f to watch the log in real time on another terminal. Maybe you'd see something like a line being overwritten, etc. I don't know what rsync would do with a file name that ends in a carriage return

Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-30 Thread Paul Slootman via rsync
On Wed 30 Oct 2019, raf via rsync wrote: > > I have a task that rsyncs files from a list of > candidate files (--files-from=). It's verbose (-v) and It would be helpful to show the complete rsync command line. Paul -- Please use reply-all for most replies to avoid omitting the mailing list.

Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-30 Thread Kyle Bassett via rsync
Hi raf, Curious issue you have. A few things: What distro(s) are you using? Same rsync version on both ends? Hash of files look correct before and after the rsync? Have you tried using inotify to monitor for changes at the fs level? You should see a "read" on the sender and a "read" +

Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-29 Thread raf via rsync
Thanks. I'll try that. But I agree that it'll be something else. It's unlikely that whole trace files are being overwritten, because there's locking in place to prevent that sort of thing, but it's more likely than anything else. I'll check that the locking is working properly. Although, when I

Re: Seemingly impossible bug: -v not always listing every copied file

2019-10-29 Thread Kevin Korb via rsync
It does seem impossible. I would suggest adding --itemize-changes (-v isn't really all that useful without it anyway). If entries are still missing then I would suspect that either log files are missing (maybe duplicate file names replacing the occasional log file?) or something other than rsync