Re: Removing folder at destination
>Why not exclude 2_ASSETS from the first run, and then do a second run to >rsync the _contents_ of 2_ASSETS to the target 01_us_eng directory? > >Add /01_us_eng/2_ASSETS/ to the exclude.txt file. > >rsync -rvz --exclude-from=exclude.txt source destination >rsync -rvz source/01_us_eng/2_ASSETS/ destination/01_us_eng/ > >(perhaps add some variation of the exclude.txt file if you're excluding >stuff under the 2_ASSETS directory) > >> My humble question to samba.org is this, can I add an rsync command to move >> folders 3 and 4 into 01... and delete the 2_ASSETS folder so I dont have to >> manually do this 200 times each day? > >You can't use rsync to perform remote rename operations, which is what >you're essentially asking for. You can execute remote commands using ssh/rsh. If the names stay the same then you can add the rename commands to a script file being executed after the rsync run. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync many processes and slow backup
At 10:56 12.07.2019, Hannes Hutmacher via rsync wrote: >Hi all! :-) > >I have a small rsync script to sync my data to a usb-disk. It works fine, when >I start it in console. I get 3 rsync processes (look in top) and the backup >takes ~25 min. But, when I add the script in cron to start it at 1am at night >it takes 7 - 9 hours and I see up to 180 processes. When I look in top I see a >hight load of 60 - 80 and 40 - 60 waits. Why? Can someone explain why it takes >so long when it starts with cron? > >This is my rsync command: rsync -azc --delete "$QUELLORDNER" "$ZIELORDNER" >This is the entry in cron (crontab -e): * 2 * * * /root/backupscript/backup.sh I'd say this starts rsync on every minute between 2:00 and 3:00. You should change that to e.g. 0 2 ... >Data to sync: 18 Gb, 185.000 files. > >When I look in the log files I see errors like this: > >rsync: rename "/media/usb/sicherung/var/lib/fail2ban/.fail2ban.sqlite3.JCzY1c" >-> "var/lib/fail2ban/fail2ban.sqlite3": No such file or directory (2) That's probably because several rsync instances are stomping on each other's feet. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Exclude and delete or not delete
>You need to switch to filters where you have the additional options >hide, show, risk, and protect. See the filter rules section of man rsync. Thanks for the hint. Though I've been using rsync for years this part has somehow escaped me. I've read up on the filters and they do what I need. The docs could use a few samples but I did get it to work. Thanks bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Exclude and delete or not delete
>> I'm looking for a way to exclude and delete some items but not delete >> other items. Use case: >> >> I'm on Windows where there are folders like recycle.bin and system >> volume information on every drive. I can exclude them while backing >> up my data drive. But I now also have other data that is excluded >> and that I want to delete from my existing backup. However if I use >> --delete-excluded then rsync tries to delete the (write protected) >> system volume information from the destination disk. >> >> Is there a way to get around this with only rsync parameters? >> Do I have to move the destination into a directory to get rid of >> the interfering drive root folders in the sync process? > >Perhaps use read only attributes on the items that you don't want to >allow to be deleted? > >Also maybe user .rsync-filter ? The destination system folders are already write protected, that's not the problem. But if rsync fails to delete those folders then it will also skip deleting other data that I'd like to get rid of. I don't think that filters will help me as they are just another way of writing --include and --exclude but not what will happen with the excluded items. Thanks bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Exclude and delete or not delete
Hello I'm looking for a way to exclude and delete some items but not delete other items. Use case: I'm on Windows where there are folders like recycle.bin and system volume information on every drive. I can exclude them while backing up my data drive. But I now also have other data that is excluded and that I want to delete from my existing backup. However if I use --delete-excluded then rsync tries to delete the (write protected) system volume information from the destination disk. Is there a way to get around this with only rsync parameters? Do I have to move the destination into a directory to get rid of the interfering drive root folders in the sync process? Thanks bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync of big image files from virtual hosts takes lot of time
>This is the output with --stats for a 50GB image. >Appended also the output from time. >You see it's horrible slow. Please give also the source and destination parameters from your rsync command. These define whether it's a local sync or not (for rsync), the hardware setup doesn't really matter. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Invalid argument with version 3.1.3
At 23:39 29.09.2018, Daniel Feenberg via rsync wrote:
>Content-Transfer-Encoding: 7bit
>
>
>We reently upgraded our rsync client from Freebsd 10.2 to 11.2 which upgraded
>our rsync from 3.0.6 protocol version 30 to 3.1.3 protocol version 31. The
>server remains Freebsd 11.1 with rsync 3.1.2 protocol version 31. Now we get
>numerous messages like this:
>
> rsync: readlink_stat("/disk/homedirs/nber/bstevens/public_html/old/test/press
> reaction/Foreign
> Language/Los_empleados_no_se_casan,_s\#363lo_se_divorcian.PDF")
> failed: Invalid argument (22)
>
>Apparently the filename includes a non-ASCII character , such as windows might
>do (via samba). My understanding is that Unix filenames can contain any
>sequence of bytes except for the null byte, so why should this cause a
>problem? Is there an rsync option to allow these files to transfer? Should I
>go back to rsync 3.0.6?
>
>Rsync commands are (aproximately):
>
> rsync --server -logDtprze.iLsfxC --delete . /disk/
>
>and
>
> rsync -a -z -t --delete -e ssh -l root host:/disk/
Two options that might help you:
--iconv=CONVERT_SPECrequest charset conversion of filenames
and if that doesn't help
--protocol=NUM force an older protocol version to be used
bye Fabi
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync to my external eSATA HD is crashing/freezing my system...
>Since the move to fc26, this command has caused the complete freeze/crash of >the system. I tried it under multi-user non-graphic mode in case it was >something to do with new graphics systems (don't know why). The output of the >above always stops at: >sending incremental file list >.d..t.. Music/FLACs/Various_Artists/Temple_Sampler/ >>f+ >>Music/FLACs/Various_Artists/Temple_Sampler/13-brian_mcneill-the_butterfly_chain.flac > >(total 183 bytes file size, always) > >By complete freeze/crash I mean: >* hard-drive light indicates spinning, but no noise (activity) >* unable to ssh in >* unable to ping >* in multi-user text, I'm first able to switch to another login console, but >then unable to progress past the login password; after switching to other >consoles, the original login screen attempt has gone blank other than a >blinking cursor top left >* in graphic mode, there's no (inter)activity whatsoever possible - though >screen has desktop on it >* the only apparent solution is a hard reset > >The external drive is a WD 750GB hard-drive in a StarTech.com external >hard-drive caddy connected via eSATA cable to an old Dell Vostro 3500. Did you check the drive for SMART info/errors? Sounds to me like a hardware problem. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync time machine backup permissions
At 11:22 19.03.2018, Andre Althoff via rsync wrote: >Dear rsync users, > >I'm trying to copy my Time Machine Backup from my old USB hard drive to a new >one. I got error messages, because rsync don't create group and other >permissions. > >Did I use the correct parameters? Who has an idea, what mistake? > >rsync: failed to set times on "/Volumes/G-DRIVE Thunderbolt >3/Backups.backupdb/iMac/Latest": Operation not permitted (1) Looks to me more like you have not enough rights to set times etc. So you'd need to run the script as root. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Bug: rsync erroneously changes modification time
At 08:11 12.06.2017, max.power--- via rsync wrote: >Content-Transfer-Encoding: 7bit >Content-Disposition: inline > >How exactly does rsync determine that the copy has the incorrect >timestamp and not the source file? >Does it assume that the copy must be incorrect or are there other >criteria that have to be considered? rsync is only synching one way, it's always going from source to dest. Therefore source is always 'correct' whereas dest will be adjusted to match source. If you want a two way synching you'd need to call rsync twice with different parameters (and switched source/dest) or use a different tool. bye Fabi -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
