Re: Passing result of shuf to rsync

2021-09-17 Thread Kevin Korb via rsync
Quoting from the man page SORTED TRANSFER ORDER Rsync always sorts the specified filenames into its internal transfer list. This handles the merging together of the contents of identi‐ cally named directories, makes it easy to remove duplicate filenames, and may confuse someone

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
I am trying to pass filename results that have been shuffled, then pass the file to rsync. Not quite sure whether to use --files-from=- or some other way. shuf -n "$nf" -e ${dpath}/${incl} | rsync -av --update --files-from=- . "$dst"-- Please use reply-all for most replies to avoid omitting the

Re: Passing result of shuf to rsync

2021-09-17 Thread Kevin Korb via rsync
Not really sure what you are trying to accomplish here. Seems like it should work the way you have it. Note that many wonky rsync kludges are due to people not realizing that rsync can have multiple source arguments. Instead of the source simply being . it can be a list of stuff. Also, note

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐ On Saturday, September 18, 2021 12:29 AM, Kevin Korb wrote: > Well, what you have should function. But rsync is going to sort the list. I want rsync to use the list as given to it by shuf. > On 9/17/21 8:26 PM, hancooper wrote: > > > ‐‐‐ Original Message

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐ On Saturday, September 18, 2021 12:06 AM, Kevin Korb via rsync wrote: > Not really sure what you are trying to accomplish here. Seems like it > should work the way you have it. Note that many wonky rsync kludges are > due to people not realizing that rsync can

Passing result of shuf to rsync

2021-09-17 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐ On Saturday, September 18, 2021 12:58 AM, Kevin Korb wrote: > Quoting from the man page > > SORTED TRANSFER ORDER > Rsync always sorts the specified filenames into its internal > transfer list. This handles the merging together of the contents of identi‐ >

Adding timestamp before printing file name

2021-09-17 Thread hancooper via rsync
I am using rsync in the following manner rsync -av --inplace --update --log-file=/medhd/a3-swbase/05-nonfsw.log /medhc/a3-swbase/05-nonfsw /medhd/a3-swbase/ Normally the file name is outputted. Would it be possible to also add the time before the name?-- Please use reply-all for most replies

Re: Passing result of shuf to rsync

2021-09-17 Thread Kevin Korb via rsync
Well, what you have should function. But rsync is going to sort the list. On 9/17/21 8:26 PM, hancooper wrote: > ‐‐‐ Original Message ‐‐‐ > On Saturday, September 18, 2021 12:06 AM, Kevin Korb via rsync > wrote: > >> Not really sure what you are trying to accomplish here. Seems like

Skip file transfer on detecton of error code

2021-09-17 Thread hancooper via rsync
Occasionally rsync issues errors, which result in slowing a system during a transfer. Would it be possible to skip the transfer of the file rather than having rsync continue to insist, trying the transfer many times? rsync: read errors mapping