Re: Possible not expected behaviour with "delete" option
It doesn't seem like the trailing / on the target should matter. It only means something special on the source. However, if there is any error then rsync will abort the deletions for safety. On 4/3/19 2:10 PM, lugarci1 via rsync wrote: > Hi, I was trying to make a mirror backup of a folder in my machine with > the followin|g command:| > |rsync -avh --delete /source/ /destination| > | > | > |But the extra files that where on "destination" didn't got deleted. > Where as doing:| > ||rsync -avh --delete /source/ /destination/|| > ||worked as expected.|| > || > || > ||I wonder if this is correct, or it shouldn't be like that.|| > -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: https://sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., signature.asc Description: OpenPGP digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Possible not expected behaviour with "delete" option
Hi, I was trying to make a mirror backup of a folder in my machine with the following command: rsync -avh --delete /source/ /destination But the extra files that where on "destination" didn't got deleted. Where as doing: rsync -avh --delete /source/ /destination/ worked as expected. I wonder if this is correct, or it shouldn't be like that. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync with delete option creates and deletes dot files
--delete means delete from the target what isn't on the source (except what is excluded). Those look like temp files. Possibly from another rsync that is running at the same time. On 05/01/2017 12:36 AM, Chandana De Silva via rsync wrote: > All, > I have an rsync based backup process which uses rsyncd on the source, > to backup to a directory on the client. > > I have rsync version 3.1.2 on the client and 2.6.8 on the source host > (daemon). > > The rysnc command I use is; > > /usr/bin/rsync -aHzS --partial --numeric-ids --delete --timeout=3600 \ > --contimeout=180 \ > --exclude-from=/path/to/excludelist \ > --log-file=/path/to/logfile \ >::host_backup /path/to/dest_dir > > The rsync log on the client shows the following; > > > 2017/05/01 04:19:41 [90534] receiving file list > 2017/05/01 04:20:03 [90534] *deleting bin/.zcat.19441 > 2017/05/01 04:20:03 [90534] *deleting bin/.gzip.19441 > ... > > > Is this normal, or is there some configuration I am missing ? > > Thanks > -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., signature.asc Description: OpenPGP digital signature -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync with delete option creates and deletes dot files
All, I have an rsync based backup process which uses rsyncd on the source, to backup to a directory on the client. I have rsync version 3.1.2 on the client and 2.6.8 on the source host (daemon). The rysnc command I use is; /usr/bin/rsync -aHzS --partial --numeric-ids --delete --timeout=3600 \ --contimeout=180 \ --exclude-from=/path/to/excludelist \ --log-file=/path/to/logfile \ ::host_backup /path/to/dest_dir The rsync log on the client shows the following; 2017/05/01 04:19:41 [90534] receiving file list 2017/05/01 04:20:03 [90534] *deleting bin/.zcat.19441 2017/05/01 04:20:03 [90534] *deleting bin/.gzip.19441 ... Is this normal, or is there some configuration I am missing ? Thanks -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--delete option
Hi all, I was wondering if it's possible to make the --delete option to not delete files that have been newly created on the destination site but which do not yet exist on the source side. However it should still delete files that did exist on the source side but were subsequently deleted. Many Thanks, Saman -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Unfortunately rsync has no concept of newly created. On 08/24/11 15:38, Saman Ghannadzadeh wrote: Hi all, I was wondering if it's possible to make the --delete option to not delete files that have been newly created on the destination site but which do not yet exist on the source side. However it should still delete files that did exist on the source side but were subsequently deleted. Many Thanks, Saman - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk5VU8QACgkQVKC1jlbQAQcaRACg1lo4WTxHeG007KPQD7+nfqoR dFYAnjgIPo6B84cM8JzVTRtzLF7hqAjL =bvY+ -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option
Hi, On Wed, 24 Aug 2011, Kevin Korb wrote: Unfortunately rsync has no concept of newly created. --updateskip files that are newer on the receiver doesn't prevent deleting for files not existing on source side? On 08/24/11 15:38, Saman Ghannadzadeh wrote: Hi all, I was wondering if it's possible to make the --delete option to not delete files that have been newly created on the destination site but which do not yet exist on the source side. However it should still delete files that did exist on the source side but were subsequently deleted. Many Thanks, Saman - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk5VU8QACgkQVKC1jlbQAQcaRACg1lo4WTxHeG007KPQD7+nfqoR dFYAnjgIPo6B84cM8JzVTRtzLF7hqAjL =bvY+ -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551 - Gesellschaft fuer wissenschaftliche Datenverarbeitung mbH Goettingen (GWDG) Am Fassberg 11, 37077 Goettingen URL:http://www.gwdg.de E-Mail: g...@gwdg.de Tel.: +49 (0)551 201-1510Fax:+49 (0)551 201-2150 Geschaeftsfuehrer: Prof. Dr. Oswald Haan und Dr. Paul Suren Aufsichtsratsvorsitzender: Prof. Dr. Christian Griesinger Sitz der Gesellschaft: Goettingen Registergericht: Goettingen Handelsregister-Nr. B 598 - -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 - --update skips files that are newer on the target than the source. If the file does not exist on the source then there is no concept of newer. - --delete deletes things that are on the target but not the source (and not excluded). It can't be associated with --newer because there is no source file to compare it to. On 08/24/11 17:52, Eberhard Moenkeberg wrote: Hi, On Wed, 24 Aug 2011, Kevin Korb wrote: Unfortunately rsync has no concept of newly created. --updateskip files that are newer on the receiver doesn't prevent deleting for files not existing on source side? On 08/24/11 15:38, Saman Ghannadzadeh wrote: Hi all, I was wondering if it's possible to make the --delete option to not delete files that have been newly created on the destination site but which do not yet exist on the source side. However it should still delete files that did exist on the source side but were subsequently deleted. Many Thanks, Saman - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin KorbPhone:(407) 252-6853 Systems AdministratorInternet: FutureQuest, Inc.ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page:http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk5VU8QACgkQVKC1jlbQAQcaRACg1lo4WTxHeG007KPQD7+nfqoR dFYAnjgIPo6B84cM8JzVTRtzLF7hqAjL =bvY+ -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk5VeQYACgkQVKC1jlbQAQcBrQCg/eI56yDCBtCUOctQ7nJPJATe 3T0AnAiCAgXgAAdZd8bTqqfDNPcRURf5 =r4j5 -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
The --max-delete option and also question about depth first deletions
Hello, I'm trying to build a bullet-proof rsync deployment, using rsync version 3.0.8 protocol version 30, and I'll be using the --delete option. As a way of limiting any catastrophic losses I'm thinking about using --max-delete. I have a couple of questions: - If the maximum number of deletions occurs, will rsync keep chugging away, copying over files to my destination, but just not delete any further? In that way, perfectly legitimate rync commands will work to completion, only they will just stop deleting excess files. - Does the deletion occur in a depth-first fashion? So if we have top level folders top/a/ top/b/ top/c/ and we have a runaway deletion, begining at top/, will it first delete everything in top/a, then top/b. etc. until it hits the max-delete number? I have other measures in place to make sure none of this happens. I just wanted to understand the worst-case scenario. -- Speech, not just for humans http://www.google.com/profiles/egilchri about.me/ted.gilchrist -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Being VERY careful while using the --delete option
On Tue, May 10, 2011 at 7:51 AM, Ted Gilchrist egilc...@gmail.com wrote: However, I wake up in a cold sweat worrying about supplying the empty string for source_dir, and thus removing souce_dir, and all it's siblings on target_machine. Your best bet is to error-check your args in your script prior to calling rsync. Compare for dangerous things, like an empty string (or /), etc. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Being VERY careful while using the --delete option
On UNIX, I am executing an rsync command, from within a script. The command goes something like this: /usr/bin/rsync --verbose --progress --stats --compress --recursive --times --perms --links --safe-links source_dir/ user@target_machine:/parent_path/source_dir In other words, I am replicating source_dir on a remote machine. It ends up next to a lot of sibling, directories, like this: On target_machine /parent_path/source_dir /parent_path/source_dir2 /parrent_path/source_dirn Here's my issue. I'd like to use the --delete option in the command above. However, I wake up in a cold sweat worrying about supplying the empty string for source_dir, and thus removing souce_dir, and all it's siblings on target_machine. Now I realize, I can just be extra careful that the variable pointing to source_string is never empty, but I would like to have other fail safe mechanisms in place. I hope I have been sufficiently specific to elicit some suggestions. I guess I am looking for the software equivalent of lots of padlocks on the apartment door. You may wish to consider the use of the -n option. The --dry-run option performs a trial run with no changes made. Using this option will allow you to check what will happen prior to actually moving ahead. Just a possibility? - This email is protected by LBackup, an open source backup solution. http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Being VERY careful while using the --delete option
On UNIX, I am executing an rsync command, from within a script. The command goes something like this: /usr/bin/rsync --verbose --progress --stats --compress --recursive --times --perms --links --safe-links source_dir/ user@target_machine:/parent_path/source_dir In other words, I am replicating source_dir on a remote machine. It ends up next to a lot of sibling, directories, like this: On target_machine /parent_path/source_dir /parent_path/source_dir2 /parrent_path/source_dirn Here's my issue. I'd like to use the --delete option in the command above. However, I wake up in a cold sweat worrying about supplying the empty string for source_dir, and thus removing souce_dir, and all it's siblings on target_machine. Now I realize, I can just be extra careful that the variable pointing to source_string is never empty, but I would like to have other fail safe mechanisms in place. I hope I have been sufficiently specific to elicit some suggestions. I guess I am looking for the software equivalent of lots of padlocks on the apartment door. Thanks, Ted Gilchrist -- Speech, not just for humans http://www.google.com/profiles/egilchri about.me/ted.gilchrist -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
files-from and delete option?
Hi Guys, is there a way to have a absolute file paths in a file - and use --files-from together with --delete option? what i mean is - lets say i have a daily generated file a.txt from an external script which contains something like this: /level1/level2/level/.../.../leveln/file.txt can i ask rsync to copy all files from that kind - /level1/level2/level/.../.../leveln/file.txt which my file a.txt contains and --delete all others which are not in the file but were copied on destination in past? or should i go for one more bash script and call a cleaner CMD after every rsync run? Thanks in advance for your help!!! Best regards Emil -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: files-from and delete option?
On Mon, 2010-02-08 at 20:19 +0200, Emil Genchev wrote: is there a way to have a absolute file paths in a file - and use --files-from together with --delete option? what i mean is - lets say i have a daily generated file a.txt from an external script which contains something like this: /level1/level2/level/.../.../leveln/file.txt can i ask rsync to copy all files from that kind - /level1/level2/level/.../.../leveln/file.txt which my file a.txt contains and --delete all others which are not in the file but were copied on destination in past? Please see: https://bugzilla.samba.org/show_bug.cgi?id=3465 -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
-acv option, what will be the default delete option?
Dear List, If I use -acv for rsync options, what will I choose as default delete option? --deletedelete extraneous files from destination dirs --delete-before receiver deletes before transfer, not during --delete-during receiver deletes during transfer (default) --delete-delay find deletions during, delete after --delete-after receiver deletes after transfer, not during --delete-excluded also delete excluded files from destination dirs Thanks in advance! -- Daniel Li -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
files deleted without --delete option
Hello all, I want to copy all files on the SRC side to the DST side without deleteing any from the DST side. However, whenever I run rsync the files on the DST side are deleted if they were deleted from the SRC side. What am I doing wrong? I am running the following command: rsync -avz --progress --force --delete-excluded --exclude-from=exclude.txt [EMAIL PROTECTED]:/mnt/array1/ /mnt/harddisk3/ This is what is in my exclude file: debian:/home/jchaven/scripts# cat exclude.txt thumbs.db Thumbs.db Temp/ debian:/home/jchaven/scripts# Here is the result with a new file to synch on the SRC side: debian:/home/jchaven/scripts# rsync -avz --progress --force --delete-excluded --exclude-from=exclude.txt [EMAIL PROTECTED]:/mnt/array1/ /mnt/harddisk3/ [EMAIL PROTECTED]'s password: receiving file list ... 76280 files to consider IT/Projects to Archive/ IT/Projects to Archive/New Text Document.txt 0 100%0.00kB/s0:00:00 (1, 42.0% of 76280) sent 71 bytes received 1555447 bytes 58698.79 bytes/sec total size is 22762378976 speedup is 14633.31 debian:/home/jchaven/scripts# Here is the result with the new file deleted on the SRC side. I do not want it deleted on the DST side - but it is: debian:/home/jchaven/scripts# rsync -avz --progress --force --delete-excluded --exclude-from=exclude.txt [EMAIL PROTECTED]:/mnt/array1/ /mnt/harddisk3/ [EMAIL PROTECTED]'s password: receiving file list ... 76279 files to consider deleting IT/Projects to Archive/New Text Document.txt IT/Projects to Archive/ sent 51 bytes received 1555357 bytes 66187.57 bytes/sec total size is 22762378976 speedup is 14634.35 debian:/home/jchaven/scripts# rSync version used an Debian etch (debian 2.4.27-2-386): debian:/home/jchaven/scripts# rsync -help rsync version 2.6.4 protocol version 29 Copyright (C) 1996-2005 by Andrew Tridgell and others http://rsync.samba.org/ Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, inplace, IPv6, 64-bit system inums, 64-bit internal inums Thanks, Charles Haven Note: This email does not contain any attachments. If an attachment is present you are advised to not open it. Pink Floyd rules! DISCLAIMER: The information in this message is confidential and may be legally privileged. It is intended solely for the addressee. Access to this message by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, or distribution of the message, or any action or omission taken by you in reliance on it, is prohibited and may be unlawful. Please immediately contact the sender if you have received this message in error. Thank you. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: files deleted without --delete option
On Fri 18 May 2007, Charles Haven wrote: I want to copy all files on the SRC side to the DST side without deleteing any from the DST side. However, whenever I run rsync the files on the DST side are deleted if they were deleted from the SRC side. What am I doing wrong? I am running the following command: rsync -avz --progress --force --delete-excluded --exclude-from=exclude.txt [EMAIL PROTECTED]:/mnt/array1/ /mnt/harddisk3/ --delete-excluded In addition to deleting the files on the receiving side that are not on the sending side, this tells rsync to also delete any files on the receiving side that are excluded (see --exclude). See the FILTER RULES section for a way to make individual exclu- sions behave this way on the receiver, and for a way to protect files from --delete-excluded. See --delete (which is implied) for more details on file-deletion. Note the --delete (which is implied) text... Paul Slootman -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: files deleted without --delete option
On Fri 18 May 2007, Charles Haven wrote: Thank you! That's what I thought. Where did you pull that text? I have gone through the man page and several It's in the manpage... Paul Slootman -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
Just wondering if this bug will be corrected. Thank you! - Original Message - From: Manuel Kissoyan [EMAIL PROTECTED] To: Wayne Davison [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Saturday, January 27, 2007 2:32 PM Subject: Re: problem with the delete option ok, this going more complicated In the sending side do not exists a directory called piusfont, in the receving side yes... there are no entries with this directory name, no delete_in_dir(DIRECTORY) or make_file(), what next? btw, dunno if this have something to do but im running the rsync through the backup server so the backup server is the receiving side and the other server is the sending side, so basically the backup server is running rsync to pull the data. I also did find something with another user account that it is in the backup server but not anymore in the other server: delete_in_dir(home/iccdom/public_html/administrator) This was in the logs in example but rsync havent deleted it from the backup server. Thank you! - Original Message - From: Wayne Davison [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Friday, January 26, 2007 12:36 PM Subject: Re: problem with the delete option On Mon, Jan 22, 2007 at 08:18:52PM -0300, Manuel Kissoyan wrote: ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: You need a third -v to see mentions of where rsync is deleting. It will say delete_in_dir(DIRECTORY) for every directory whose contents is being transferred. You should also look for the make_file() calls from the generator, which is the directory reading on the sending side that is used for deletions. If you see a message about a file being protected, that indicates that your exclude options have ensured that that particular file cannot be deleted. so basicaly rsync is not deleting the files that are not there in the sending side. If you weren't using --files-from, I would have said that you were being bitten by this bug: - Fixed a recent bug where --delete was not working when transferring from the root (/) of the filesystem with --relative enabled. With the --files-from option, I can't duplicate your problem, so it is probably a case of you expecting rsync to delete in a directory that it is not sending or your not expecting an exclude to protect a file from deletion. If not, please let us know what you discover. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
Hi Wayne, any idea what more i could do to know what is going on? Thanx in advance! - Original Message - From: Manuel Kissoyan [EMAIL PROTECTED] To: Wayne Davison [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Saturday, January 27, 2007 2:32 PM Subject: Re: problem with the delete option ok, this going more complicated In the sending side do not exists a directory called piusfont, in the receving side yes... there are no entries with this directory name, no delete_in_dir(DIRECTORY) or make_file(), what next? btw, dunno if this have something to do but im running the rsync through the backup server so the backup server is the receiving side and the other server is the sending side, so basically the backup server is running rsync to pull the data. I also did find something with another user account that it is in the backup server but not anymore in the other server: delete_in_dir(home/iccdom/public_html/administrator) This was in the logs in example but rsync havent deleted it from the backup server. Thank you! - Original Message - From: Wayne Davison [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Friday, January 26, 2007 12:36 PM Subject: Re: problem with the delete option On Mon, Jan 22, 2007 at 08:18:52PM -0300, Manuel Kissoyan wrote: ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: You need a third -v to see mentions of where rsync is deleting. It will say delete_in_dir(DIRECTORY) for every directory whose contents is being transferred. You should also look for the make_file() calls from the generator, which is the directory reading on the sending side that is used for deletions. If you see a message about a file being protected, that indicates that your exclude options have ensured that that particular file cannot be deleted. so basicaly rsync is not deleting the files that are not there in the sending side. If you weren't using --files-from, I would have said that you were being bitten by this bug: - Fixed a recent bug where --delete was not working when transferring from the root (/) of the filesystem with --relative enabled. With the --files-from option, I can't duplicate your problem, so it is probably a case of you expecting rsync to delete in a directory that it is not sending or your not expecting an exclude to protect a file from deletion. If not, please let us know what you discover. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
ok, this going more complicated In the sending side do not exists a directory called piusfont, in the receving side yes... there are no entries with this directory name, no delete_in_dir(DIRECTORY) or make_file(), what next? btw, dunno if this have something to do but im running the rsync through the backup server so the backup server is the receiving side and the other server is the sending side, so basically the backup server is running rsync to pull the data. I also did find something with another user account that it is in the backup server but not anymore in the other server: delete_in_dir(home/iccdom/public_html/administrator) This was in the logs in example but rsync havent deleted it from the backup server. Thank you! - Original Message - From: Wayne Davison [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Friday, January 26, 2007 12:36 PM Subject: Re: problem with the delete option On Mon, Jan 22, 2007 at 08:18:52PM -0300, Manuel Kissoyan wrote: ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: You need a third -v to see mentions of where rsync is deleting. It will say delete_in_dir(DIRECTORY) for every directory whose contents is being transferred. You should also look for the make_file() calls from the generator, which is the directory reading on the sending side that is used for deletions. If you see a message about a file being protected, that indicates that your exclude options have ensured that that particular file cannot be deleted. so basicaly rsync is not deleting the files that are not there in the sending side. If you weren't using --files-from, I would have said that you were being bitten by this bug: - Fixed a recent bug where --delete was not working when transferring from the root (/) of the filesystem with --relative enabled. With the --files-from option, I can't duplicate your problem, so it is probably a case of you expecting rsync to delete in a directory that it is not sending or your not expecting an exclude to protect a file from deletion. If not, please let us know what you discover. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
On Mon, Jan 22, 2007 at 08:18:52PM -0300, Manuel Kissoyan wrote: ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: You need a third -v to see mentions of where rsync is deleting. It will say delete_in_dir(DIRECTORY) for every directory whose contents is being transferred. You should also look for the make_file() calls from the generator, which is the directory reading on the sending side that is used for deletions. If you see a message about a file being protected, that indicates that your exclude options have ensured that that particular file cannot be deleted. so basicaly rsync is not deleting the files that are not there in the sending side. If you weren't using --files-from, I would have said that you were being bitten by this bug: - Fixed a recent bug where --delete was not working when transferring from the root (/) of the filesystem with --relative enabled. With the --files-from option, I can't duplicate your problem, so it is probably a case of you expecting rsync to delete in a directory that it is not sending or your not expecting an exclude to protect a file from deletion. If not, please let us know what you discover. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
Dont wanna bother you guys but someone have any logic explanation for this? Thank you in advance! - Original Message - From: Manuel Kissoyan [EMAIL PROTECTED] To: Matt McCutchen [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Monday, January 22, 2007 8:18 PM Subject: Re: problem with the delete option Thanx Matt, ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: removing duplicate name usr/local/cpanel/3rdparty/mailman/Mailman/Bouncer.py from file list (93869) so basicaly rsync is not deleting the files that are not there in the sending side. any idea? - Original Message - From: Matt McCutchen [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Saturday, January 20, 2007 9:33 PM Subject: Re: problem with the delete option On 1/20/07, Manuel Kissoyan [EMAIL PROTECTED] wrote: im trying to backup a cpanel server and made a list in the file with the directories and files to be backed up and also another file with the excluded dir/file list. For some reason when an account is deleted from the server then when rsync is backing it up is not removing this account directory and files. Any idea what could be the problem? Im using version 2.6.8 protocol version 29 /usr/local/bin/rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /home/server1 /var/log/server1.log 21 my included lis: --- /home [...] --- Your setup looks correct: since you listed /home and used -r, rsync should delete subdirectories of /home from the backup when they are deleted from the server. Try running rsync in double-verbose mode (-vv) to get more information about why it isn't deleting the directory from the backup. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
Thanx Matt, ok, i did add the -vv and it simply not running any delete command, the only thing close to that is lines like this: removing duplicate name usr/local/cpanel/3rdparty/mailman/Mailman/Bouncer.py from file list (93869) so basicaly rsync is not deleting the files that are not there in the sending side. any idea? - Original Message - From: Matt McCutchen [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Saturday, January 20, 2007 9:33 PM Subject: Re: problem with the delete option On 1/20/07, Manuel Kissoyan [EMAIL PROTECTED] wrote: im trying to backup a cpanel server and made a list in the file with the directories and files to be backed up and also another file with the excluded dir/file list. For some reason when an account is deleted from the server then when rsync is backing it up is not removing this account directory and files. Any idea what could be the problem? Im using version 2.6.8 protocol version 29 /usr/local/bin/rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /home/server1 /var/log/server1.log 21 my included lis: --- /home [...] --- Your setup looks correct: since you listed /home and used -r, rsync should delete subdirectories of /home from the backup when they are deleted from the server. Try running rsync in double-verbose mode (-vv) to get more information about why it isn't deleting the directory from the backup. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
problem with the delete option
hi guys, im trying to backup a cpanel server and made a list in the file with the directories and files to be backed up and also another file with the excluded dir/file list. For some reason when an account is deleted from the server then when rsync is backing it up is not removing this account directory and files. Any idea what could be the problem? Im using version 2.6.8 protocol version 29 /usr/local/bin/rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /home/server1 /var/log/server1.log 21 my included lis: --- /home /home2 /usr/local/apache/conf /var/named /usr/local/cpanel /var/lib/mysql /var/lib/pgsql /var/cpanel /usr/share/ssl /var/ssl /usr/local/cpanel/3rdparty/mailman /var/log/bandwidth /usr/local/frontpage /var/spool/cron /root/.my.cnf /etc/httpd/conf/httpd.conf /etc/sysconfig/network /etc/userdomains /etc/remotedomains /etc/localdomains /etc/trueuserdomains /etc/trueuserowners /var/cpanel/users /etc/secondarymx /etc/domainalias /etc/valiases /etc/vfilters /etc/exim /etc/exim.conf /etc/exim.conf.buildtest /etc/exim.conf.dist /etc/exim.conf.local /etc/exim.conf.localopts /etc/exim.conf.mailman2.dist /etc/exim.conf.mailman2.exiscan.dist /etc/exim.crt /etc/exim.key /etc/eximmailtrap /etc/exim.pl /etc/exim.pl.local /etc/eximrejects /etc/eximrejects.rpmorig /etc/exim_surbl.pl /etc/proftpd /etc/proftpd.conf /etc/proftpd.conf.bytes /etc/proftpd.conf.rpmnew /etc/proftpd.conf.rpmsave /etc/proftpd.conf.tmpeditlib /etc/proftpd.conf,v /etc/pure-ftpd /etc/pure-ftpd.conf /etc/pure-ftpd.conf.rpmsave /etc/passwd /etc/passwd- /etc/passwd.OLD /etc/passwd,v /etc/group /etc/group- /etc/named.conf /etc/named.conf.fixrndc /etc/named.conf.prefixrndc /etc/named.conf.rpmsave /etc/named.conf,v /etc/wwwacct.conf /etc/cpupdate.conf /etc/quota.conf /etc/shadow /etc/shadow- /etc/shadow,v /etc/ips /etc/ips.dnsmaster /etc/ips.remotedns /etc/ipaddrpool /etc/ipaddrpool- /etc/nameserverips /etc/ssl /etc/hosts --- my excluded list: --- /home/virtfs /home2/virtfs /home/cpzendinstall /home/cprestore /home/cpphpbuild /home/cpapachebuild --- -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
On 1/20/07, Manuel Kissoyan [EMAIL PROTECTED] wrote: im trying to backup a cpanel server and made a list in the file with the directories and files to be backed up and also another file with the excluded dir/file list. For some reason when an account is deleted from the server then when rsync is backing it up is not removing this account directory and files. Any idea what could be the problem? Im using version 2.6.8 protocol version 29 /usr/local/bin/rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /home/server1 /var/log/server1.log 21 my included lis: --- /home [...] --- Your setup looks correct: since you listed /home and used -r, rsync should delete subdirectories of /home from the backup when they are deleted from the server. Try running rsync in double-verbose mode (-vv) to get more information about why it isn't deleting the directory from the backup. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: problem with the delete option
Thanx Matt, i did, in fact i did -vvv but there are nothing useful is why is driving me crazy, i was trying to find the problem from a month or so now, any other idea? Thank you! - Original Message - From: Matt McCutchen [EMAIL PROTECTED] To: Manuel Kissoyan [EMAIL PROTECTED] Cc: rsync list rsync@lists.samba.org Sent: Saturday, January 20, 2007 9:33 PM Subject: Re: problem with the delete option On 1/20/07, Manuel Kissoyan [EMAIL PROTECTED] wrote: im trying to backup a cpanel server and made a list in the file with the directories and files to be backed up and also another file with the excluded dir/file list. For some reason when an account is deleted from the server then when rsync is backing it up is not removing this account directory and files. Any idea what could be the problem? Im using version 2.6.8 protocol version 29 /usr/local/bin/rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /home/server1 /var/log/server1.log 21 my included lis: --- /home [...] --- Your setup looks correct: since you listed /home and used -r, rsync should delete subdirectories of /home from the backup when they are deleted from the server. Try running rsync in double-verbose mode (-vv) to get more information about why it isn't deleting the directory from the backup. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
delete option?
Hi, I have a problem with the --delete option. In our backup-process we run: rsync -v --delete --times /var/subversion/ myhost.de:backup/subversion/ The backup works fine - but file which are deleted from the source *aren't* deleted from the destination as I expected. I tried a lot of variations - but I have no clues. Has anyone an idea what I am missing? Tino P.S: I am using rsync 2.6.6 -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option?
On 1/13/07, Tino Schöllhorn [EMAIL PROTECTED] wrote: rsync -v --delete --times /var/subversion/ myhost.de:backup/subversion/ The backup works fine - but file which are deleted from the source *aren't* deleted from the destination as I expected. You need the -r option (--recursive) to make rsync go inside the source and destination directories in the first place so that it can delete files from the destination. You say the backup works fine: did rsync copy files from the source directory to the destination directory, even without -r? If so, that would be a big bug. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option?
Hi, thanks. Now it works. Of course you are right: Synching worked without -r als long as I specified the files explicitly. It would really help if the documentation would be updated and point out that --delete works only with the -r option. As I can see there are a lot of people out there who have problems with that option. Again thanks. Tino Matt McCutchen wrote: On 1/13/07, Tino Schöllhorn [EMAIL PROTECTED] wrote: rsync -v --delete --times /var/subversion/ myhost.de:backup/subversion/ The backup works fine - but file which are deleted from the source *aren't* deleted from the destination as I expected. You need the -r option (--recursive) to make rsync go inside the source and destination directories in the first place so that it can delete files from the destination. You say the backup works fine: did rsync copy files from the source directory to the destination directory, even without -r? If so, that would be a big bug. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option?
On 1/13/07, Tino Schöllhorn [EMAIL PROTECTED] wrote: It would really help if the documentation would be updated and point out that --delete works only with the -r option. As I can see there are a lot of people out there who have problems with that option. Version 2.6.7 and later of the man page does mention this. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option
On Sat, Nov 25, 2006 at 02:14:39PM -0300, Manuel Kissoyan wrote: if in the sender side server i delete a directory with files and directories into it after run rsync is not removing that directory/files on the receiver side. I can only guess here since you don't supply any details of your run, but this is usually caused by someone using a wildcard (for example, rsync -av --del /src/* host:/dest), which does not send the src directory, and therefore no deletions can occur inside it. Just drop the wildcard (leaving the trailing slash) if that is the case. btw: all the delete options is only to delete the receiver side? i mean using them will not delete the sender side? That's right. The --remove-* options affect the sending side, and the --delete-* options the receiving side. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option
Sorry...i forgot the detailshere is the info... im running: rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles.. and the includedfiles list have some wildecards but the files that has not been deleted wasnt in the wildcard path... /etc/*named* /home i mean, i have a directory with files into the /home so there isnt a wildecard and rsync havent deleted it. Thanx! - Original Message - On Sat, Nov 25, 2006 at 02:14:39PM -0300, Manuel Kissoyan wrote: if in the sender side server i delete a directory with files and directories into it after run rsync is not removing that directory/files on the receiver side. I can only guess here since you don't supply any details of your run, but this is usually caused by someone using a wildcard (for example, rsync -av --del /src/* host:/dest), which does not send the src directory, and therefore no deletions can occur inside it. Just drop the wildcard (leaving the trailing slash) if that is the case. btw: all the delete options is only to delete the receiver side? i mean using them will not delete the sender side? That's right. The --remove-* options affect the sending side, and the --delete-* options the receiving side. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: delete option
Manuel Kissoyan wrote: rsync -vrplogDtzH --stats --delete-during --partial --timeout=500 --exclude-from=/root/rsyncexcludedfiles --files-from=/root/rsyncincludedfiles.. and the includedfiles list have some wildecards but the files that has not been deleted wasnt in the wildcard path... /etc/*named* /home i mean, i have a directory with files into the /home so there isnt a wildecard and rsync havent deleted it. Does your exclude file list the files you deleted from the sender? If so, the receiver won't delete its copies because exclude rules also prevent deletion; you might want to use --delete-excluded. If not, I recommend running rsync in double-verbose mode (-vv) to get more information about why the receiver isn't deleting the files. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
delete option
Hi Wayne, im using version 2.6.8 protocol version 29 and looks like the --delete-during parameter is not working correctly, if in the sender side server i delete a directory with files and directories into it after run rsync is not removing that directory/files on the receiver side. Any idea? btw: all the delete options is only to delete the receiver side? i mean using them will not delete the sender side? Thank you in advance! -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Questions and comments regarding --remove-sent-files (Was: New delete option?)
On Tue, Sep 12, 2006 at 02:05:10PM -0500, Evan Harris wrote: So, I agree with the parent message that either --remove-sent-files should delete the files immediately after they are successfully sent, or a new option should be added (--move maybe?) that does it that way. It can never do it immediately, because it must wait for the receiver to indicate that the file was updated correctly (otherwise the sender could remove a file that never made it to the receiver). Recent rsyncs (2.6.7 and beyond) have a heuristic that prevents the generator from running too far ahead of the sender, which has the result of making the file- removals happen much sooner than they did in earlier versions. The CVS version also has a new option, --remove-source-files, and works in a better way than the (now deprecated) --remove-sent-files option. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Questions and comments regarding --remove-sent-files (Was: New delete option?)
I've looked back through my mailing list archives, and seen a few messages touching on the same things I wanted to mention, but I figured it might be better to recap, since most of them were sent more than a year ago. I have recently started using the --remove-sent-files option, and have noticed a couple of warts. I'm using it to transfer (move really) gigabyte and larger sized files over a fairly slow connection (--bwlimit=10) and with keeping of partial files (--partial) to minimize transfer time in the event of connection problems. Because the individual files may take a day or more each to transfer, rsync interruptions are not uncommon, and I've had several instances where the first run of a transfer aborted in the middle of the non-first file. Although rsync had successfully sent one or more files before losing the connection or being aborted, it doesn't appear to delete the files until a successful end of the whole rsync. A later restart of the rsync sees that some of the files already exist on the destination and need no update, and those files get left on the sending side when they shouldn't. So, I agree with the parent message that either --remove-sent-files should delete the files immediately after they are successfully sent, or a new option should be added (--move maybe?) that does it that way. I saw a followup mailing list message from Wayne that suggested adding the -I option to cause the desired behavior, and that looks like it would be a good workaround. Maybe all that is needed is to make a new --move option be an alias for --remove-sent-files and --ignore-times. Would this be a fairly simple enhancement? The other issue I wanted to touch on was also mentioned on the mailing list, and was how to guard against the possibility that files on the sending side might have been modified during the transfer (which for me sometimes takes a day or more), and for rsync to realize this and avoid deleting the file and losing those changes. I know this one is a more difficult problem, but I just wanted to see if there might be an easy solution. Wayne, thanks for all your work! Evan On Fri, 22 Apr 2005, Wayne Davison wrote: [It appears I missed this message back in February -- ouch.] On Sat, Feb 19, 2005 at 08:53:32PM -0500, Andrew Gideon wrote: FWIW: In the manner I can envision using this, it makes more sense to delete the source as long as the destination file is valid, whether that file moved during this execution or not. This provides a mv function that's safe against a failure. That is an interesting point. The current option allows you to have identical files that didn't get transferred, and thus don't get removed, but that does mean that if the transfer gets interrupted it might do the wrong thing with a file. I'll contemplate what to do going forward since the --remove-sent-files option was already released. Perhaps a --remove-source-files option should be added that works as you suggested. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option does not always work
Hi, Wayne Davison [EMAIL PROTECTED] wrote: OK, I had a free moment to work up a fix, and here it is. It was pretty simple. I'm sorry to wake this up again, but it seems not to be so simple to fix at all :) I've stumbled over this while noticing that the rsnapshot backup of my root-filesystem simply never gets anything removed at all. So I made some tests: [EMAIL PROTECTED]:~# rsync --version | head -1 rsync version 2.6.8 protocol version 29 [EMAIL PROTECTED]:~# rsync -HSaxvn --delete --relative / /mnt/rsnapshot/daily.0/darkside/root | grep -c ^deleting 0 [EMAIL PROTECTED]:~# rsync -HSaxvn --delete / /mnt/rsnapshot/daily.0/darkside/root | grep -c ^deleting 264 [EMAIL PROTECTED]:~# cd / [EMAIL PROTECTED]:/# rsync -HSaxvn --delete --relative . /mnt/rsnapshot/daily.0/darkside/root | grep -c ^deleting 264 [EMAIL PROTECTED]:~# rsync -HSaxvn --delete --relative /. /mnt/rsnapshot/daily.0/darkside/root | grep -c ^deleting 0 As you can see, the only workaround that seems to work is cd / and using . then. However, this is not always possible, i.e. when rsyncing some.host:/ Of course, it would be simple to just avoid the --relative in this special case. But this is also not always possible, i.e. when using rsnapshot (:)) or - more serious - when rsyncing multiple sources at once like rsync -HSaxvn --delete --relative / /home /target Perhaps, a possible solution could be to temporarily disable --relative in the rsync code directly as long as it works on a / Though, I'm not absolutely sure about the side-effects of this (i.e. with include/exclude lists). I'm using Debians rsync 2.6.8-2 which should have Waynes patch included. At least Lennys test-case in the beginning of this thread is not reproducible with this version. regards Mario -- As a rule, the more bizarre a thing is, the less mysterious it proves to be. -- Sherlock Holmes by Arthur Conan Doyle -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option does not always work
On Sat, Sep 09, 2006 at 12:22:57PM -0700, Wayne Davison wrote: This is a different bug that was recently fixed: using --relative with a root (/) filesystem and --delete was also failing to delete. The latest CVS source and recent nightly tar files have this fixed. Here's the bug (which has an attached patch): https://bugzilla.samba.org/show_bug.cgi?id=3929 Oh, thank you very much. Mario -- Evidently men are more intelligent than women. Every woman on earth believes that men should be able to read minds. Every man knows this is impossible. Ergo, we are more intelligent. signature.asc Description: Digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Help with --delete option
On Sat, Dec 17, 2005 at 03:55:27PM -0600, scott wrote: rsync --archive -e '/usr/bin/ssh -p 22' --verbose \ --include-from=/root/my-backupfilter --recursive \ --delete --existing / [EMAIL PROTECTED]:/home/backupdir which is close, but still updates files You need to also add --ignore-existing. Combined with --existing (which should really be named --ignore-non-existing), no files will be transferred at all, so only deletions will happen. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Help with --delete option
On Sat, Dec 17, 2005 at 03:55:27PM -0600, scott wrote: rsync --archive -e '/usr/bin/ssh -p 22' --verbose \ --include-from=/root/my-backupfilter --recursive \ --delete --existing / [EMAIL PROTECTED]:/home/backupdir which is close, but still updates files You need to also add --ignore-existing. Combined with --existing (which should really be named --ignore-non-existing), no files will be transferred at all, so only deletions will happen. Thanks wayne. I had tried that but my original test didn't work. I just did it again and it is working as desired, not sure what I did wrong before, oh well. Thanks again very much. Best, Scott -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--delete option does not always work
I know that there are a million messages from newbies who cannot get --delete to work. This message is special. :) --delete works fine for me EXCEPT when the following two conditions are present: 1) I am using the --relative option, and 2) the deleted file is in a subdirectory of the SRC directory. Here is a demonstration of how to recreate this bug: [EMAIL PROTECTED]:/tmp$ rsync --version rsync version 2.6.4 protocol version 29 Copyright (C) 1996-2005 by Andrew Tridgell and others http://rsync.samba.org/ Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, inplace, IPv6, 64-bit system inums, 64-bit internal inums rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions. See the GNU General Public Licence for details. [EMAIL PROTECTED]:/tmp$ mkdir -p src/1 [EMAIL PROTECTED]:/tmp$ cd src/1 [EMAIL PROTECTED]:/tmp/src/1$ touch a b c [EMAIL PROTECTED]:/tmp/src/1$ cd /tmp [EMAIL PROTECTED]:/tmp$ /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded -v src/ dest/ building file list ... done created directory dest src/ src/1/ src/1/a src/1/b src/1/c sent 235 bytes received 98 bytes 666.00 bytes/sec total size is 0 speedup is 0.00 [EMAIL PROTECTED]:/tmp$ rm src/1/c [EMAIL PROTECTED]:/tmp$ /usr/bin/rsync -a --delete --numeric-ids --relative --delete-excluded -v src/ dest/ building file list ... done src/1/ sent 99 bytes received 26 bytes 250.00 bytes/sec total size is 0 speedup is 0.00 Now at this point we would expect there to be only files 'a' and 'b' to be present in /tmp/dest/src/1. However you can see that all three files are in that directory: [EMAIL PROTECTED]:/tmp$ ls -lR dest dest: total 1 drwxr-xr-x 3 lenny lenny 1024 Apr 27 12:37 src dest/src: total 1 drwxr-xr-x 2 lenny lenny 1024 Apr 27 12:38 1 dest/src/1: total 0 -rw-r--r-- 1 lenny lenny 0 Apr 27 12:37 a -rw-r--r-- 1 lenny lenny 0 Apr 27 12:37 b -rw-r--r-- 1 lenny lenny 0 Apr 27 12:37 c Just so you know, if you attempt to do this by placing files 'a','b', and 'c' just under the 'src' directory (without the '1' subdirectory), the --delete option will work correctly. Any thoughts? Thanks, Lenny -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option does not always work
On Wed, Apr 27, 2005 at 12:57:51PM -0400, Lenny wrote: rsync -a --delete --numeric-ids --relative --delete-excluded -v src/ dest/ The problem is caused by the source dir being src/ instead of src when --relative is specified (this causes a problem internally because the starting directory is transferred as src/., so the receiver's heuristic to separate implied dirs in the file list from real dirs is not properly marking those subdirs as a part of the transferred hierarchy). You can work around the problem for now by dropping the trailing slash (while I work up a fix). Thanks for the report, ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option does not always work
OK, I had a free moment to work up a fix, and here it is. It was
pretty simple.
..wayne..
--- flist.c 30 Mar 2005 17:31:35 - 1.291
+++ flist.c 27 Apr 2005 19:14:17 -
@@ -655,6 +655,9 @@ static struct file_struct *receive_file_
if (flags XMIT_TOP_DIR) {
in_del_hier = 1;
del_hier_name_len = file-dir.depth == 0 ? 0 : l1 + l2;
+ if (relative_paths del_hier_name_len 2
+basename_len == 1+1 *basename == '.')
+ del_hier_name_len -= 2;
file-flags |= FLAG_TOP_DIR | FLAG_DEL_HERE;
} else if (in_del_hier) {
if (!relative_paths || !del_hier_name_len
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New delete option?
[It appears I missed this message back in February -- ouch.] On Sat, Feb 19, 2005 at 08:53:32PM -0500, Andrew Gideon wrote: FWIW: In the manner I can envision using this, it makes more sense to delete the source as long as the destination file is valid, whether that file moved during this execution or not. This provides a mv function that's safe against a failure. That is an interesting point. The current option allows you to have identical files that didn't get transferred, and thus don't get removed, but that does mean that if the transfer gets interrupted it might do the wrong thing with a file. I'll contemplate what to do going forward since the --remove-sent-files option was already released. Perhaps a --remove-source-files option should be added that works as you suggested. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New delete option?
Wayne Davison wrote: There is a patch in the patches dir called delete-sent-files.diff that probably does what you want. It deletes any files that got successfully transferred, but does not delete files that were already up-to-date, nor does it delete things like directories, symlinks, or devices. [...] What do you think about how the patch works? FWIW: In the manner I can envision using this, it makes more sense to delete the source as long as the destination file is valid, whether that file moved during this execution or not. This provides a mv function that's safe against a failure. That is, if something breaks between the copy and delete operations of an execution, the next execution will perform the delete. - Andrew -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New delete option?
I have not yet tried your patch but: 1) The patch you describe sounds ideal to me 2) I hope you will include it in the next main release 3) How will it work with the '-n' option? Thanks Wayne Davison wrote: On Mon, Feb 14, 2005 at 02:03:56PM +0100, ?yvin S?mme wrote: I would like an option that deletes the source file(s) *if* successfully transferred (i.e. delete source upon completion). Maybe an option like '--delete-source'. There is a patch in the patches dir called delete-sent-files.diff that probably does what you want. It deletes any files that got successfully transferred, but does not delete files that were already up-to-date, nor does it delete things like directories, symlinks, or devices. Sounds dangerous? It certainly could be. An older version of the patch could have allowed the option to be used on a read-only daemon server, for instance. That bug has been plugged two different ways in the current source: both by setting a global read-only flag that doesn't allow anything to change on a read-only server, and by refusing --delete-sent-files if the server is marked as read-only. If you're not concerned about the daemon bug, you can use the patch that came with 2.6.3 (in the patches dir of the tar file) to patch 2.6.3. If you want a version that is more secure, snag the CVS source (you can use the latest nightly tar file from the web site, if you like). I've considered including the patch in the main rsync distribution before, and am doing so again. What do you think about how the patch works? Is the deleting of only the sent files the right idiom for what you need? ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New delete option?
On Tue, Feb 15, 2005 at 10:20:56AM +0100, ?yvin S?mme wrote: 3) How will it work with the '-n' option? With -n, rsync will tell you about the files that it would transfer (as normal) and no files would be deleted. It would also skip the sender removed X messages that are output for -vv when the actual transfer is successful. And yes, the sender does only remove the file if the receiver indicated that the file's transfer was successful. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
New delete option?
Hi. I've been a proud user of rsync in 9 years! I have always found an option with rsync that offers exactly the functionality I want. But today my search was negative: I would like an option that deletes the source file(s) *if* successfully transferred (i.e. delete source upon completion). Maybe an option like '--delete-source'. What do you guys think about this? Sounds dangerous? Thanks. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New delete option?
On Mon, Feb 14, 2005 at 02:03:56PM +0100, ?yvin S?mme wrote: I would like an option that deletes the source file(s) *if* successfully transferred (i.e. delete source upon completion). Maybe an option like '--delete-source'. There is a patch in the patches dir called delete-sent-files.diff that probably does what you want. It deletes any files that got successfully transferred, but does not delete files that were already up-to-date, nor does it delete things like directories, symlinks, or devices. Sounds dangerous? It certainly could be. An older version of the patch could have allowed the option to be used on a read-only daemon server, for instance. That bug has been plugged two different ways in the current source: both by setting a global read-only flag that doesn't allow anything to change on a read-only server, and by refusing --delete-sent-files if the server is marked as read-only. If you're not concerned about the daemon bug, you can use the patch that came with 2.6.3 (in the patches dir of the tar file) to patch 2.6.3. If you want a version that is more secure, snag the CVS source (you can use the latest nightly tar file from the web site, if you like). I've considered including the patch in the main rsync distribution before, and am doing so again. What do you think about how the patch works? Is the deleting of only the sent files the right idiom for what you need? ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync seems to hang when --delete option is used.
On Thu, Dec 09, 2004 at 04:02:05PM -0500, Tony Shum wrote: When I use --delete option, it seems to hang for over 8 hours on 4.5Gb of total data. The --delete option causes rsync to read the local hierarchy, and construct a list of files to compare with the remote file list. If it is hanging, I'd imagine that there is some kind of a read problem on the local system -- perhaps an NFS mount is down or something. I can also imagine that a recursive mount of a file system (e.g. a bind type of mount) could cause rsync to loop back on itself creating the local file list, but that would cause rsync to bloat until it ran out of memory. Some suggestions for you: attach to the hung rsync with a debugger and see where it is hung -- you should be able to see what file/directory it is working on reading, and that should help you to narrow down the problem. Alternately, run run rsync using a system-call tracer to see what it was doing prior to the hang (see the issues page on the rsync web site for how to get a remote rsync to run under the strace/truss program). ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync seems to hang when --delete option is used.
Actually, I get similar on our system(s) for very large directory structures ... I've changed my scripts so that it times out after 15 minutes and re-tries up to 5 times before considering it a failure, which appears to have 'gotten around' the problem ... When it hangs, i've tried setting truss -p again both the server side, and receiver, and nothing seems to be happening on the server, and periodic 'select()'s happen on the receiver ... On Wed, 15 Dec 2004, Wayne Davison wrote: On Thu, Dec 09, 2004 at 04:02:05PM -0500, Tony Shum wrote: When I use --delete option, it seems to hang for over 8 hours on 4.5Gb of total data. The --delete option causes rsync to read the local hierarchy, and construct a list of files to compare with the remote file list. If it is hanging, I'd imagine that there is some kind of a read problem on the local system -- perhaps an NFS mount is down or something. I can also imagine that a recursive mount of a file system (e.g. a bind type of mount) could cause rsync to loop back on itself creating the local file list, but that would cause rsync to bloat until it ran out of memory. Some suggestions for you: attach to the hung rsync with a debugger and see where it is hung -- you should be able to see what file/directory it is working on reading, and that should help you to narrow down the problem. Alternately, run run rsync using a system-call tracer to see what it was doing prior to the hang (see the issues page on the rsync web site for how to get a remote rsync to run under the strace/truss program). ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html Marc G. Fournier Hub.Org Networking Services (http://www.hub.org) Email: [EMAIL PROTECTED] Yahoo!: yscrappy ICQ: 7615664 -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync seems to hang when --delete option is used.
Hi, When I use --delete option, it seems to hang for over 8 hours on 4.5Gb of total data. But when I remove the --delete option, I can see it starts rsyncing. Has anyone encounter this problem before? --Tony Shum -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync seems to hang when --delete option is used.
On Thu, 9 Dec 2004, Tony Shum wrote: When I use --delete option, it seems to hang for over 8 hours on 4.5Gb of total data. But when I remove the --delete option, I can see it starts rsyncing. Has anyone encounter this problem before? What type of filesystem is your data on (ext3, xfs, etc)? Is it on an NFS mount or is it local? Regardless of where it is, is the storage medium a single disk or a disk cluster (RAID)? -Chuck -- http://www.quantumlinux.com Quantum Linux Laboratories, LLC. ACCELERATING Business with Open Technology The measure of the restoration lies in the extent to which we apply social values more noble than mere monetary profit. - FDR -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option
On Fri 29 Oct 2004, [EMAIL PROTECTED] wrote: I'm a bit paranoid, but had to ask-- How safe is it to use the --delete option? ie, when using it locally (or via a mounted network volume), will I *ever* have to worry about my actual source files being delete mistakenly (instead of dest. files)? Source files will never be deleted. Of course, if you screw up the parameters to rsync sufficiently, you might end up passing the source dir as the destination, but there's nothing any software can do about that sort of error... When in doubt, use the --dry-run option to show what rsync is going to do without actually doing anything. Paul Slootman -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete option
thanks, that's what I wanted to hear (: On Sat, 30 Oct 2004 12:22:16 +0200, Paul Slootman [EMAIL PROTECTED] wrote: On Fri 29 Oct 2004, [EMAIL PROTECTED] wrote: I'm a bit paranoid, but had to ask-- How safe is it to use the --delete option? ie, when using it locally (or via a mounted network volume), will I *ever* have to worry about my actual source files being delete mistakenly (instead of dest. files)? Source files will never be deleted. Of course, if you screw up the parameters to rsync sufficiently, you might end up passing the source dir as the destination, but there's nothing any software can do about that sort of error... When in doubt, use the --dry-run option to show what rsync is going to do without actually doing anything. Paul Slootman -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--delete option
I'm a bit paranoid, but had to ask-- How safe is it to use the --delete option? ie, when using it locally (or via a mounted network volume), will I *ever* have to worry about my actual source files being delete mistakenly (instead of dest. files)? thanks! -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Strange behaviour with --max-delete option
On Mon, Oct 18, 2004 at 01:13:56PM -0700, Laurens wrote: It deletes 2 files while --max-delete=1 was specified. I think it has something to do with deletion_count in delete_files (receiver.c). Yes, the should really be = (a simple off-by-one error). The line should look like this when fixed: if (max_delete deletion_count = max_delete) Thanks for the report! ..wayne.. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Problem on XP with --delete option
Hi, I'm experiencing a problem on rsync with the --delete option. Situation: Server = Mandrake Linux 9.2 running rsync daemon Client = Windows XP workstation running cygwin + rsync2.5.1 combined with ssh. All this implemented conform the website of Robert Scholten (http://optics.ph.unimelb.edu.au/help/rsync/) Every thing seems to work fine exept for the --delete option. The rsync says: IO error encountered - skipping file deletion The transfer of files works fine, no I/O errors at all. Do you guys have any suggestion for me ? Thanks in advance. Kind regards _ Marcel Hergaarden -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem on XP with --delete option
Hi, Run rsync from a batch file where you set env.variable CYGWIN=notnsec. Further instructions and an example can be found at http://itefix.no/cwrsync Check who owns your files. You have to make sure that the account that starts rsync also owns directories you want to sync. Rgrds Tev - Original Message - From: Hergaarden, Marcel [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, December 19, 2003 11:39 AM Subject: Problem on XP with --delete option Hi, I'm experiencing a problem on rsync with the --delete option. Situation: Server = Mandrake Linux 9.2 running rsync daemon Client = Windows XP workstation running cygwin + rsync2.5.1 combined with ssh. All this implemented conform the website of Robert Scholten (http://optics.ph.unimelb.edu.au/help/rsync/) Every thing seems to work fine exept for the --delete option. The rsync says: IO error encountered - skipping file deletion The transfer of files works fine, no I/O errors at all. Do you guys have any suggestion for me ? Thanks in advance. Kind regards _ Marcel Hergaarden -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem on XP with --delete option
Sorry for the mistake. Should be CYGWIN=nontsec. - Original Message - From: Tevfik Karagülle [EMAIL PROTECTED] To: Hergaarden, Marcel [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Friday, December 19, 2003 11:48 AM Subject: Re: Problem on XP with --delete option Hi, Run rsync from a batch file where you set env.variable CYGWIN=notnsec. Further instructions and an example can be found at http://itefix.no/cwrsync Check who owns your files. You have to make sure that the account that starts rsync also owns directories you want to sync. Rgrds Tev - Original Message - From: Hergaarden, Marcel [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Friday, December 19, 2003 11:39 AM Subject: Problem on XP with --delete option Hi, I'm experiencing a problem on rsync with the --delete option. Situation: Server = Mandrake Linux 9.2 running rsync daemon Client = Windows XP workstation running cygwin + rsync2.5.1 combined with ssh. All this implemented conform the website of Robert Scholten (http://optics.ph.unimelb.edu.au/help/rsync/) Every thing seems to work fine exept for the --delete option. The rsync says: IO error encountered - skipping file deletion The transfer of files works fine, no I/O errors at all. Do you guys have any suggestion for me ? Thanks in advance. Kind regards _ Marcel Hergaarden -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: AW: trying to figure out how the --delete option works.
This was the problem. There were some IO errors reading some files from the /proc/ directory, and then rsync won't delete any files at all. From the man: --delete If the sending side detects any IO errors then the deletion of any files at the destination will be automatically disabled. This is to prevent temporary filesystem failures (such as NFS errors) on the sending side causing a massive deletion of files on the destination. You can override this with the ignore errors option. Thank you anyway for helping me to keep trying. /Pedro Add this: --delete-excluded See the manual. Rainer -Ursprngliche Nachricht- Von: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Auftrag von Mandrake Pe Gesendet: Mittwoch, 29. Oktober 2003 13:33 An: [EMAIL PROTECTED] Betreff: trying to figure out how the --delete option works. I use this comand to back up my entirely drive to a second drive. Because the second drive is smaller I have excluded my movies directory. I also excluded the /mnt/ diectory, becous I dont want to back up the backup. This part works just fine. It's the --delete option I cant get to work. I want rsync to delete files on the backup(destination) drive, that I have deleted or moved on the souce drive. Therefore I added the --delete option, but it doesent work for me. the files and directories tht I deleted still exists on the backup, and the files and directories that I moved are duplicaded on the backup. Is there anyone who can help me out. Here is the comand I use: rsync -av --exclude /**/movies/ --exclude /mnt/ --delete / /mnt/backup/backup /Pedro -- Ls om frfljelsen av Falun Gong- utvare i Kina: http://www.falungonginfo.net Read about the persecution of Falun Gong- practitioners in China: http://www.faluninfo.net -- Ls om frfljelsen av Falun Gong- utvare i Kina: http://www.falungonginfo.net Read about the persecution of Falun Gong- practitioners in China: http://www.faluninfo.net -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync server and --delete option
Ok it worked out that way, but as a matter of fact neither the --dry-run option nor the effective action did output that it will delete those files... I even tried to see what it would output with -vvv option and nothing. So finally, it's working out for me, but it would be neat if it would output something. Thanks Xavier p.s. I join my test on a seperate text file. -- Original Message --- From: Wayne Davison [EMAIL PROTECTED] To: Xavier [EMAIL PROTECTED] Sent: Thu, 3 Jul 2003 10:11:33 -0700 Subject: Re: rsync server and --delete option On Thu, Jul 03, 2003 at 03:23:08PM +0100, Xavier wrote: rsync -nPru --delete /temp/* serverA::wwwroot/temp/ the delete option is not working That's because you used a wildcard. The --delete option only affects directories, and you send a list of files. The above is equivalent to the following because the shell expands the wildcard: rsync -nPru --delete /temp/foo /temp/bar /temp/baz serverA::wwwroot/temp/ So, certainly no files in wwwroot/temp are going to be deleted. Use this instead: rsync -nPru --delete /temp/ serverA::wwwroot/temp/ ..wayne.. --- End of Original Message --- Here I list the content of the remote server (RSYNC server) user:/temp$rsync serverB::wwwroot/temp/ drwxr-xr-x512 2003/07/04 09:43:08 . -rw-r--r--1008438 2003/07/04 09:43:07 aom_screen11.jpg -rw-r--r--523 2003/07/04 09:43:07 civility.htm -rw-r--r-- 3854 2003/07/04 09:43:07 count_down.htm -rw-r--r-- 1314 2003/07/04 09:43:07 index.htm -rw-r--r-- 0 2003/07/04 09:43:07 lolo -rw-r--r--390 2003/07/04 09:43:08 repeat.htm -rw-r--r-- 1318 2003/07/04 09:43:08 test.htm -rw-r--r--518 2003/07/04 09:43:08 test.htm.bak -rw-r--r-- 0 2003/07/04 09:43:08 toto Here is the list of the local folder I want to synchronize user:/temp$ls -g total 2022 -rw-rw-rw- 1 other1008438 Jul 3 15:08 aom_screen11.jpg -rw-rw-rw- 1 other523 Jul 3 15:08 civility.htm -rw-rw-rw- 1 other 3854 Jul 3 15:08 count_down.htm -rw-rw-rw- 1 other 1314 Jul 3 15:08 index.htm -rw-r--r-- 1 other 0 Jul 3 15:11 lolo -rw-rw-rw- 1 other390 Jul 3 15:08 repeat.htm -rw-rw-rw- 1 other 1318 Jul 3 15:08 test.htm -rw-rw-rw- 1 other518 Jul 3 15:08 test.htm.bak -rw-r--r-- 1 other 0 Jul 3 15:11 toto I create 2 files on the serverB (ohyeah.txt, blabla.txt), then I list the content of the folder on serverB user:/temp$rsync serverB::wwwroot/temp/ drwxr-xr-x512 2003/07/04 09:50:51 . -rw-r--r--1008438 2003/07/04 09:43:07 aom_screen11.jpg -rw-r--r-- 0 2003/07/04 09:50:43 blabla.txt -rw-r--r--523 2003/07/04 09:43:07 civility.htm -rw-r--r-- 3854 2003/07/04 09:43:07 count_down.htm -rw-r--r-- 1314 2003/07/04 09:43:07 index.htm -rw-r--r-- 0 2003/07/04 09:43:07 lolo -rw-r--r-- 0 2003/07/04 09:50:51 ohyeah.txt -rw-r--r--390 2003/07/04 09:43:08 repeat.htm -rw-r--r-- 1318 2003/07/04 09:43:08 test.htm -rw-r--r--518 2003/07/04 09:43:08 test.htm.bak -rw-r--r-- 0 2003/07/04 09:43:08 toto I try a --dry-run to check what will happend user:/temp$rsync -nPur --delete /temp/ serverB::wwwroot/temp/ building file list ... 10 files to consider wrote 266 bytes read 40 bytes 612.00 bytes/sec total size is 1016355 speedup is 3321.42 I run rsync and get no output at all user:/temp$rsync -Pur --delete /temp/ serverB::wwwroot/temp/ I list again the directory and the files are gone user:/temp$rsync serverB::wwwroot/temp/ drwxr-xr-x512 2003/07/04 09:51:23 . -rw-r--r--1008438 2003/07/04 09:43:07 aom_screen11.jpg -rw-r--r--523 2003/07/04 09:43:07 civility.htm -rw-r--r-- 3854 2003/07/04 09:43:07 count_down.htm -rw-r--r-- 1314 2003/07/04 09:43:07 index.htm -rw-r--r-- 0 2003/07/04 09:43:07 lolo -rw-r--r--390 2003/07/04 09:43:08 repeat.htm -rw-r--r-- 1318 2003/07/04 09:43:08 test.htm -rw-r--r--518 2003/07/04 09:43:08 test.htm.bak -rw-r--r-- 0 2003/07/04 09:43:08 toto I recreated the files again on serverB and ran the rsync with -vvv option user:/temp$rsync -Purvvv --delete /temp/ serverB::wwwroot/temp/ opening tcp connection to serverB port 873 building file list ... make_file(4,.) expand file_list to 4000 bytes, did move make_file(4,aom_screen11.jpg) make_file(4,civility.htm) make_file(4,test.htm) make_file(4,repeat.htm) make_file(4,index.htm) make_file(4,test.htm.bak) make_file(4,count_down.htm) make_file(4,toto) make_file(4,lolo) 10 files to consider send_file_list done send_files starting send_files phase=1 send files
rsync server and --delete option
Hello, Here is my problem: A rsync daemon is started on serverA with the root user. Now if I try to sync serverA to serverB : rsync -nPru --delete serverA::test/temp/ /temp/ the behavior is just perfect and everything goes well. Now if I try to switch the server : rsync -nPru --delete /temp/* serverA::wwwroot/temp/ the delete option is not working (the files that are not on the sending server are not deleted) and I get no error messages, even with -vvv or when I set --ignore-errors --force options... Is this supposed to work at all ? Is it may be a permission problem ? Thanks, Xavier -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync server and --delete option
On Thu, Jul 03, 2003 at 03:23:08PM +0100, Xavier wrote: rsync -nPru --delete /temp/* serverA::wwwroot/temp/ the delete option is not working That's because you used a wildcard. The --delete option only affects directories, and you send a list of files. The above is equivalent to the following because the shell expands the wildcard: rsync -nPru --delete /temp/foo /temp/bar /temp/baz serverA::wwwroot/temp/ So, certainly no files in wwwroot/temp are going to be deleted. Use this instead: rsync -nPru --delete /temp/ serverA::wwwroot/temp/ ..wayne.. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
excluding patterns from the --delete option?
Please could someone tell me if it is possible to specify in a single rsync command that the --delete option should apply to all files except those matching a certain pattern? I want to do a -a archive, except that a few directories should not have --delete applied. Do I need to use two rsync commands to achieve this? Thanks in advance for any help! ___ Mason Lee Berkeley, CA -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Help on rsync delete option
I had a similar problem once. Try this instead:
rsync -avz --delete ${SOURCE_HOST}:/mlinkfam/extract/sccs/pa/.
/mlinkfam/extract/sccs/pa
The only change was * to ..
On Fri, 01 Nov 2002 11:36:56 -0500 Chaturvedi.Rajesh [EMAIL PROTECTED]
wrote:
Hello,
Any help on the following issue will be appreciated.
How do I delete files or directories in my first level of directory that
is
specified as host. Here is an example :
rsync -avz --delete ${SOURCE_HOST}:/mlinkfam/extract/sccs/pa/*
/mlinkfam/extract/sccs/pa
Giving above command I find redundant files or directory not getting
deleted
from the first level of target directory /mlinkfam/extract/sccs/pa.
However,
files or directories do get deleted from subdirectories
/mlinkfam/extract/sccs/pa/qa or /mlinkfam/extract/sccs/pa/field.
Thanx,
Raj
--
To unsubscribe or change options:
http://lists.samba.org/mailman/listinfo/rsync
Before posting, read:
http://www.tuxedo.org/~esr/faqs/smart-questions.html
Dan Ramaley
Digital Media Library Specialist
(515) 271-1934
Cowles Library 140, Drake University
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Help on rsync delete option
On Fri, Nov 01, 2002 at 11:36:56AM -0500, Chaturvedi.Rajesh wrote:
Hello,
Any help on the following issue will be appreciated.
How do I delete files or directories in my first level of directory that is
specified as host. Here is an example :
rsync -avz --delete ${SOURCE_HOST}:/mlinkfam/extract/sccs/pa/*
/mlinkfam/extract/sccs/pa
Giving above command I find redundant files or directory not getting deleted
from the first level of target directory /mlinkfam/extract/sccs/pa. However,
files or directories do get deleted from subdirectories
/mlinkfam/extract/sccs/pa/qa or /mlinkfam/extract/sccs/pa/field.
This isn't windows. Your shell is responsible for globbing.
To spell that out lets assume this the source host looks
something like so (i'm shortening the paths for readabilty) :
/sccs/pa
/sccs/pa/qa
/sccs/pa/qa/file1
.
. lots of other files and subdirs in pa/qa
.
/sccs/pa/field
.
. lots of other files and subdirs in pa/field
.
/sccs/pa/configdoodle
and the destination host has a file pa/oldanddeleted
/sccs/pa/oldanddeleted
in addition to the other stuff.
When you execute
rsync -avz --delete /sccs/pa/* ${DEST_HOST}:/sccs/pa
The shell will glob to produce
rsync -avz --delete /sccs/pa/qa /sccs/pa/field /sccs/pa/configdoodle
${DEST_HOST}:/sccs/pa
Which is the equivalent of
rsync -avz --delete /sccs/pa/qa ${DEST_HOST}:/sccs/pa
rsync -avz --delete /sccs/pa/field ${DEST_HOST}:/sccs/pa
rsync -avz --delete /sccs/pa/configdoodle ${DEST_HOST}:/sccs/pa
In order to make this more readable i changed this to a push
the behavior and shell stuff will still apply. The glob of
a remote source will be done by a shell on the remote host.
You haven't instructed rsync to operate on sccs/pa or on the
contents of sccs/pa but on a list of files and directories
that happen to be in sccs/pa. Also of note, no dot files in
sccs/pa will be synced because * doesn't match any filename
starting with dot.
rsync -avz --delete ${SOURCE_HOST}:/sccs/pa/ /sccs/pa
Will do what i think you want. All the contents of sccs/pa
will be synced.
--
J.W. SchultzPegasystems Technologies
email address: [EMAIL PROTECTED]
Remember Cernan and Schmitt
--
To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
doc bug: --delete option differs between host:/ and host://
Package: rsync Version: all Severity: wishlist Tags: +upstream +patch thanks Hello I want to notice you of a very annoying behavour regarding the --delete option. Although people are aware of the difference between writing host:/directory and host:/directory/ It is not clearly documented in the manpage how host:/ is handled. Doing rsync --archive --relative ... --delete host:/ my_backup_dir/ works fine, as long as you only copy files, so the syntax seems to be correct. But somewhen you will realize that your dir is growing steadily as rsync does simply skip any deletions! The workaround is writing: rsync --archive --relative ... --delete host:// my_backup_dir/ Please include maybe the following passage to the manpage: --- rsync.1.old Tue May 14 13:49:37 2002 +++ rsync.1 Tue May 14 13:51:33 2002 -557,6 +557,10 prevent temporary filesystem failures (such as NFS errors) on the sending side causing a massive deletion of files on the destination\. You can override this with the --ignore-errors option\. +.IP +Be aware that you have to write host1:// host2:/target/ if you want to use +this option recursively starting on the root directory. +host1:/ host2:/target/ does not delete any files. .IP .IP \fB--delete-excluded\fP In addition to deleting the files on the thanks, -christian- -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Queston on using the delete option
You brought up a very good point which described what rsync can and can not do. Because of the robustness of this application, we are trying to find a way to use rsync and replacing our current primitive system which uses tar and send the data over a small pipe. Since my last posting, I have thought about not using the --deleteoption and instead, gather a list of files to be deleted from our internal publishing/staging system and remove them separately. Once again, thank you much for you comments and suggestions. Rsync is the best replicating application I have seen so far. It's much better than rdist and even some of the commercial applications. A Big thanks to the rsync development community. Regards, Andy Lam [EMAIL PROTECTED] Xilinx Inc. [EMAIL PROTECTED] [EMAIL PROTECTED] Mon, 11 Mar 2002 16:50:24 -0700 Previous message: Compiling on a Cobalt RaQ1 Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] Through what method might rsync determine whether a file on the destination is from the source and since deleted, or created on the destination, when even you have no way of knowing. You would need a complete history of both filesystems, every create, rename, move, insert, delete, append, and unlink, in the correct order, in order to know which side a file came from, and in the case of duplicate filenames being created on each end, which one is the correct one. Actually, in that case, you'd also need to know the intentions of the users creating the files. This is not information that can be gathered by examining the state of the two filesystems, which is all rsync can do.Your application appears to call more for a shared filesystem scheme. Surely you're not mirroring or backing up to a location being locally changed in ways even you don't know. It can do only what you tell it to do. Tim Conway [EMAIL PROTECTED] 303.682.4917 Philips Semiconductor - Longmont TC 1880 Industrial Circle, Suite D Longmont, CO 80501 Available via SameTime Connect within Philips, n9hmg on AIM perl -e 'print pack(, 19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970), .\n ' There are some who call me Tim? Andy Lam [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 03/11/2002 10:43 AM To: [EMAIL PROTECTED] cc: (bcc: Tim Conway/LMT/SC/PHILIPS) Subject:Question on using rsync delete option Classification: Greeting. I'm so sorry that I launched the previous email by mistake and before I had a chance to complete it. Here is the summary of my previous question. We would like to use rsync to mirror the contents from our internal staging server ( A) to the external website (B) at our ISP without delete some existing files on B. On server B, we have applications that creates temporary lock files and customer upload files which I have no ideas what to exclude.The --exclude option would be my last resort, but I just want to know if there are better alternatives. If I use the --delete option in rsync, all the temporary files at the destination B will be deleted. In contrast, if I don't use the --delete option, the destination's temporary files will be intact, but any files removed from the source, A will not be deleted at the destionation B. It seems to me that the --delete option is either all or none with the --exclude option as exception. Maintainning a static list of exclude files would be very difficult and cumbersome for future maintainance. I have gone through the FAQ as far back as 2000, but couldn't find any similar question. Would appreciate very much if someone could please give me some pointers. Attached is the rsync command line that I use: rsync --verbose --update --progress --stats --compress --ignore-existing --delete --delete-after --recursive --times --perms --links --dry-run --rsh=/usr/local/bin/ssh --rsync-path /var/tmp/rsync /export/volx/documents/ destination_login@hostB:/export/volx (notice I left dry-run there for testing) Thank you in advance for your help . Andy Lam [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Question on the using of --delete option with rsync
Greetings, I have searched through most of the rsync FAQ and can't find any similar cases. I'm hoping someone in this mailing list may have done it in the past and can shred lights on me. First of all, I am not new to rsync and we have been using it to move/mirror data across our internal network of servers. ( a wonderful program.) Currently, I'm planning to use rsync to mirror the web contents from our internal staging server to the external website at one of the ISP. The requirement is: Mirror the contents from A --To --B , but do not delete any temporary files created by the applications on B. It would be easier if I could use the --exclude option to exclude those filename from the destination B., but I have no way idea what those filenames are. The application server creates temporary lock files and customer's data, etc. To accomodate the above requirement, I took out the --delete option, but the problem was, if a file was to be removed from the contents on A, it doesn't remove from B as well. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Question on using rsync delete option
Greeting. I'm so sorry that I launched the previous email by mistake and before I had a chance to complete it. Here is the summary of my previous question. We would like to use rsync to mirror the contents from our internal staging server ( A) to the external website (B) at our ISP without delete some existing files on B. On server B, we have applications that creates temporary lock files and customer upload files which I have no ideas what to exclude.The --exclude option would be my last resort, but I just want to know if there are better alternatives. If I use the --delete option in rsync, all the temporary files at the destination B will be deleted. In contrast, if I don't use the --delete option, the destination's temporary files will be intact, but any files removed from the source, A will not be deleted at the destionation B. It seems to me that the --delete option is either all or none with the --exclude option as exception. Maintainning a static list of exclude files would be very difficult and cumbersome for future maintainance. I have gone through the FAQ as far back as 2000, but couldn't find any similar question. Would appreciate very much if someone could please give me some pointers. Attached is the rsync command line that I use: rsync --verbose --update --progress --stats --compress --ignore-existing --delete --delete-after --recursive --times --perms --links --dry-run --rsh=/usr/local/bin/ssh --rsync-path /var/tmp/rsync /export/volx/documents/ destination_login@hostB:/export/volx (notice I left dry-run there for testing) Thank you in advance for your help . Andy Lam [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: Question on using rsync delete option
Through what method might rsync determine whether a file on the destination is from the source and since deleted, or created on the destination, when even you have no way of knowing. You would need a complete history of both filesystems, every create, rename, move, insert, delete, append, and unlink, in the correct order, in order to know which side a file came from, and in the case of duplicate filenames being created on each end, which one is the correct one. Actually, in that case, you'd also need to know the intentions of the users creating the files. This is not information that can be gathered by examining the state of the two filesystems, which is all rsync can do.Your application appears to call more for a shared filesystem scheme. Surely you're not mirroring or backing up to a location being locally changed in ways even you don't know. It can do only what you tell it to do. Tim Conway [EMAIL PROTECTED] 303.682.4917 Philips Semiconductor - Longmont TC 1880 Industrial Circle, Suite D Longmont, CO 80501 Available via SameTime Connect within Philips, n9hmg on AIM perl -e 'print pack(, 19061,29556,8289,28271,29800,25970,8304,25970,27680,26721,25451,25970), .\n ' There are some who call me Tim? Andy Lam [EMAIL PROTECTED] Sent by: [EMAIL PROTECTED] 03/11/2002 10:43 AM To: [EMAIL PROTECTED] cc: (bcc: Tim Conway/LMT/SC/PHILIPS) Subject:Question on using rsync delete option Classification: Greeting. I'm so sorry that I launched the previous email by mistake and before I had a chance to complete it. Here is the summary of my previous question. We would like to use rsync to mirror the contents from our internal staging server ( A) to the external website (B) at our ISP without delete some existing files on B. On server B, we have applications that creates temporary lock files and customer upload files which I have no ideas what to exclude.The --exclude option would be my last resort, but I just want to know if there are better alternatives. If I use the --delete option in rsync, all the temporary files at the destination B will be deleted. In contrast, if I don't use the --delete option, the destination's temporary files will be intact, but any files removed from the source, A will not be deleted at the destionation B. It seems to me that the --delete option is either all or none with the --exclude option as exception. Maintainning a static list of exclude files would be very difficult and cumbersome for future maintainance. I have gone through the FAQ as far back as 2000, but couldn't find any similar question. Would appreciate very much if someone could please give me some pointers. Attached is the rsync command line that I use: rsync --verbose --update --progress --stats --compress --ignore-existing --delete --delete-after --recursive --times --perms --links --dry-run --rsh=/usr/local/bin/ssh --rsync-path /var/tmp/rsync /export/volx/documents/ destination_login@hostB:/export/volx (notice I left dry-run there for testing) Thank you in advance for your help . Andy Lam [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Using --delete option with rsync
hello I am receiving the following error when I attempt delete directories from the server that I am syncing to. IO error encountered - skipping file deletion I am using the following command to delete the appropriate directories. rsync -azv --stats -e ssh -v --delete /Dir1/ user@manchine2:/Dir2 This is my first attempt at using the delete option, Can anyone give me some examples of how to properly use the --delete option with the rsync command.
