[Bug 13913] sync a folder with large amount of files
https://bugzilla.samba.org/show_bug.cgi?id=13913 --- Comment #2 from jief --- (In reply to jief from comment #1) My mistake. Previous comment is wrong. Didn't see the --delay-updates option in my final test. Bug still remains and it's not a permission problem. The bug doesn't happen when using a rsync server (using the same binary version 3.1.2) instead of ssh. -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 13913] sync a folder with large amount of files
https://bugzilla.samba.org/show_bug.cgi?id=13913 jief changed: What|Removed |Added Resolution|WORKSFORME |--- Status|RESOLVED|REOPENED -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 13913] sync a folder with large amount of files
https://bugzilla.samba.org/show_bug.cgi?id=13913 jief changed: What|Removed |Added Resolution|--- |WORKSFORME Status|NEW |RESOLVED --- Comment #1 from jief --- I found it. I had the idea to try a rsync server instead of ssh. For some reason, I had access to the destination folder when I'm logged in through ssh but launched process under my uid hadn't. I guess it's a Synology trick with extended permissions. And because there was no error message, I didn't think of that. So in short, there is no functional bug. There is an annoying silent fail. Sorry about that. -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 13913] New: sync a folder with large amount of files
https://bugzilla.samba.org/show_bug.cgi?id=13913 Bug ID: 13913 Summary: sync a folder with large amount of files Product: rsync Version: 3.1.3 Hardware: All OS: All Status: NEW Severity: normal Priority: P5 Component: core Assignee: wa...@opencoder.net Reporter: bugzilla.samba@jfa.knudsen.ovh QA Contact: rsync...@samba.org I tried to rsync a folder with 323,187 files in it. I sync from osx to linux (NAS Synology). Both side is rsync v3.1.2 compiled by myself. On the NAS, original rsync is 3.0.9. Rsync 3.1.2 hangs at around 295,000 files. If I use exclusion to go under that number, it works. If I add --protocol=30, it doesn't work. If I add --delay-updates, it works. If I use the original Synology rsync (not using rsync-path), it works (without --delay-updates). If I increase ulimit on linux (sudo sysctl -w fs.file-max=25000), it doesn't work. NOTE : when I say it hangs after 295,000 files, I mean : I executed rsync with -v -v -v and then I got approx 295,000 lines of : [sender] make_file(bands/8725,*,2) [sender] make_file(bands/8726,*,2) [sender] make_file(bands/8727,*,2) [sender] make_file(bands/8728,*,2) If I exclude files starting with 8, I got the same number of files. It just stops at : [sender] make_file(bands/9729,*,2) [sender] make_file(bands/972a,*,2) [sender] make_file(bands/972b,*,2) [sender] make_file(bands/972c,*,2) What really puzzles me is that it works with Synology rsync 3.0.9. Did I miss something when I compiled rsync on my linux ? -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete-missing-args doesn't delete
Hi. On Tue, 23 Apr 2019 16:35:15 +0200 MI via rsync wrote: > If someone has a good suggestion on how to rsync a list of files and > delete from the destination any file that is not listed in --files-from, > that would be welcome. Assuming you are talking about files in a same source directory, you can do: - generate a file (KEEP_FILE) with the list of files you want - call: rsync ... --include-from KEEP_FILE \ --delete --delete-excluded \ SOURCE_DIR/ DESTINATION_DIR KEEP_FILE should have the format: + /keep1/*** + /keep2/*** ... - * leading / to match only at the first level /*** to match any level of sub-directory (if keep1 ... are directories) -- Francis -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 13912] New: Fix a few typos in rsync.yo
https://bugzilla.samba.org/show_bug.cgi?id=13912 Bug ID: 13912 Summary: Fix a few typos in rsync.yo Product: rsync Version: 3.1.3 Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 Component: core Assignee: wa...@opencoder.net Reporter: cpitclau...@gmail.com QA Contact: rsync...@samba.org Created attachment 15095 --> https://bugzilla.samba.org/attachment.cgi?id=15095=edit Documentation patch Hi, I sent the following patch to the mailing list on March 12, but I did not receive an answer about it. Here is the patch again with comments: > - it() you must not specify the bf(--rsh) (bf(-e)) option. This is about the daemon, but the manual explains letter that you can in fact pass --rsh, in section `USING RSYNC-DAEMON FEATURES VIA A REMOTE-SHELL CONNECTION`. > - rsync -av rsync:://targethost2/module/src/ /dest/ ) > + rsync -av rsync://targethost2/module/src/ /dest/ ) This seems to have an extra ':' in the URL? > option when they need to continue a backup run that got interrupted. Since > a bf(--link-dest) run is copied into a new directory hierarchy (when it is > -used properly), using bf(--ignore existing) will ensure that the > +used properly), using bf(--ignore-existing) will ensure that the This seems to include an extraneous space. -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
