Re: Speed up rsync with many of excluded files

2019-11-13 Thread Georg Limbach via rsync
Hello raf, thank you for your advice. I try it this way now: # get all files remote $SSH "cd /srv/$PROJECT/shared/uploads/; find -type f ! -path './tmp/*' ! -name '*pdf_before_qpdf'" > "$ALL_REMOTE_FILES" # remove exclude entries comm -23 "$ALL_REMOTE_FILES" "$EXCLUDE_FILE1" >

Re: Speed up rsync with many of excluded files

2019-11-12 Thread raf via rsync
raf via rsync wrote: > Georg Limbach via rsync wrote: > > > Hello, > > > > I have a problem while rsyncing a directory with perhaps 1.000.000 > > files. Before this I generate some files locally and add them to temp > > files. So this files should be excluded from syncing. > > > > My rsync

Re: Speed up rsync with many of excluded files

2019-11-12 Thread raf via rsync
Georg Limbach via rsync wrote: > Hello, > > I have a problem while rsyncing a directory with perhaps 1.000.000 > files. Before this I generate some files locally and add them to temp > files. So this files should be excluded from syncing. > > My rsync call looks like this: > > rsync