--timeout option doesn't work when copying between directories
It appears that the --timeout only works when using the rsync protocol, but not when copying between two directories. So if the destination is on a network filesystem and the network link is disconnected, rsync will only abort the operation once the underlying system finally reports that the destination is no longer reachable, which can take quite a while. Is this the intended behavior? If so, should the documentation/manpage spell this out explicitly? -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Prevent --max-delete from deleting any files?
Haven't heard anything...any thoughts on this? Marco On Jun 2, 2010, at 1:30 PM, Marco Moreno wrote: Is there a way to prevent rsync from deleting any files if --max-delete is exceeded? I want to avoid having my hourly cron job inadvertently destroy my backup a chunk at a time. By morning, the damage would already be done. Ideally, it should just stop and not sync or delete anything since something is horribly wrong. The only way I could see to do it is by running rsync twice - something like: rsync --dry-run -a --delete --max-delete=1000 /foo /bar rsync -a --delete --max-delete=1000 /foo /bar I found bug 2408 (https://bugzilla.samba.org/show_bug.cgi?id=2408) that described my concerns: If you specify the --max-delete option to rsync and there are more files to be deleted than the specified number, all the deletes upto that number are normally performed and other files that would otherwise be deleted are now silently ignored. Also, if more files are scheduled for removal, no error code is returned. The --max-delete option is especially usefull if by some misconfiguration a great number of files would be deleted. If it is a job that runs daily, all the files would be silently deleted after a few days rather than all at once more or less defeating the purpose. What I would like to see would be a test that would exit rsync with an error code if too many deletes would take without actually deleting any files. Returning an error code is the least that should be done IMHO. The response was: --- Comment #4 From Wayne Davison 2005-03-06 00:02:57 CST [reply] --- I have updated the source in CVS so that it complains at the end of the run and returns a new status code (25) when the max-delete value is exceeded. It also mentions how many deletions were skipped. This will let you run rsync with --dry-run --max-delete=1 to see a count of the number of deleted files minus one. I don't have any plans to make rsync check the delete count automatically before starting the deletions. While adding the return code was a big improvement, is there any possibility of revisiting this issue to prevent deletions altogether if something is wrong? Perhaps a new option such as --max-safe-delete or something? While I understand that it is inefficient to count up all the files in advance before doing the deletions, it cannot be as inefficient as having to run rsync twice. Thoughts? Regards, Marco Moreno -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Prevent --max-delete from deleting any files?
Is there a way to prevent rsync from deleting any files if --max-delete is exceeded? I want to avoid having my hourly cron job inadvertently destroy my backup a chunk at a time. By morning, the damage would already be done. Ideally, it should just stop and not sync or delete anything since something is horribly wrong. The only way I could see to do it is by running rsync twice - something like: rsync --dry-run -a --delete --max-delete=1000 /foo /bar rsync -a --delete --max-delete=1000 /foo /bar I found bug 2408 (https://bugzilla.samba.org/show_bug.cgi?id=2408) that described my concerns: If you specify the --max-delete option to rsync and there are more files to be deleted than the specified number, all the deletes upto that number are normally performed and other files that would otherwise be deleted are now silently ignored. Also, if more files are scheduled for removal, no error code is returned. The --max-delete option is especially usefull if by some misconfiguration a great number of files would be deleted. If it is a job that runs daily, all the files would be silently deleted after a few days rather than all at once more or less defeating the purpose. What I would like to see would be a test that would exit rsync with an error code if too many deletes would take without actually deleting any files. Returning an error code is the least that should be done IMHO. The response was: --- Comment #4 From Wayne Davison 2005-03-06 00:02:57 CST [reply] --- I have updated the source in CVS so that it complains at the end of the run and returns a new status code (25) when the max-delete value is exceeded. It also mentions how many deletions were skipped. This will let you run rsync with --dry-run --max-delete=1 to see a count of the number of deleted files minus one. I don't have any plans to make rsync check the delete count automatically before starting the deletions. While adding the return code was a big improvement, is there any possibility of revisiting this issue to prevent deletions altogether if something is wrong? Perhaps a new option such as --max-safe-delete or something? While I understand that it is inefficient to count up all the files in advance before doing the deletions, it cannot be as inefficient as having to run rsync twice. Thoughts? Regards, Marco Moreno -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Lower-case filenames on receiver side
On 9 Apr, 2008, at 03:20 , Matt McCutchen wrote: I would suggest tinkering with the shortname mount option of the FAT partition and using the --ignore-case rsync option added by this patch: http://rsync.samba.org/ftp/rsync/patches/ignore-case.diff I tried to patch but that alone does not seem to do it. I should try the shortname mount option but at the moment i'd rather not play with that machine's mounts... OS X does not seem to offer that option so i can't try with my external drive (FAT32 too). Is the --ignore-case option going to be included at some point in the future? Thanks a lot for the help Marco -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Lower-case filenames on receiver side
Thanks for your answer, i just learned case-preserving and case- sensitive are two different things... The source partition on my mac is case sensitive the problem is probably the target FAT partition on linux. Now that i think of it, my other backup that goes to an ext3 partition on the same machine does not have this problem. It's still strange that for all other files in the same sync it works fine... Thanks for your answers Marco On 8 Apr, 2008, at 16:33 , Kyle Lanclos wrote: You are going from a case-insensitive filesystem (HFS or HFS+) to a case-sensitive one on the Linux host. If the Mac is inconsistent about how it reports the filename, I can see how you might have problems like what you describe. I am not intimately familiar with problems of this type, as I stay away from case-insensitive filesystems as much as possible. While the inconsistent behavior is strange, I wouldn't be surprised if the root cause is buried somewhere in Apple's filesystem code. --Kyle On 8 Apr, 2008, at 16:34 , Wayne Davison wrote: On Tue, Apr 08, 2008 at 10:16:05AM +0200, Marco Bridge wrote: I mean, rsync seems to be arbitrarily changing filenames No, rsync doesn't change filesnames at all. You should be looking for external reasons for the inconsistencies, such as inconsistent case in the source filename arguments (when combined with a case-ignoring filesystem), the copying from a case-honoring filesystem to a case-ignoring filesystem with overlapping directory names, and/or behind-the-scenes filesystem re-mapping of names. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Lower-case filenames on receiver side
Hi everybody, i've been using rsync for quite some time to sync files between my laptop and my desktop for example i use the following to backup the music library (from Mac to Linux) rsync -rvzu --exclude=.DS_Store --delete --exclude 'Podcasts/*' $LOCAL_MUSI $REMOTE_MUSIC $LOGFILE An odd thing i always noticed is that some files were always copied, even running the above command 2 times consecutively. This was happening only for about 30 files in a library of 3000+ songs and with some pdf documents, so it seemed just some weirdness in the files. However i just noticed something interesting from today's log, there seems to be something wrong with the capitalization of some filenames deleting acdc/Back In Black/Back In Black.mp3 deleting acdc/Back In Black/ deleting Pink Floyd/The division Bell/Cluster one.mp3 deleting Pink Floyd/The division bell/Keep tolking.mp3 deleting Pink Floyd/The division bell/A great day for freedom.mp3 ... ACDC/Back In Black/ ACDC/Back In Black/Back In Black.mp3 Pink Floyd/The division Bell/A great day for freedom.mp3 Pink Floyd/The division Bell/Keep tolking.mp3 Pink Floyd/The division bell/Cluster one.mp3 The folder 'ACDC/' is copied to the other computer as 'acdc/' for this reason the next time it will be deleted and re-sent. in the Pink Floyd case, look at how the 'B' in 'Bell' changes In this case the folder name seems to be ok on the receiver side, but rsync deletes the entire folder anyway. Notice that there are many other file in my library with mixed upper and lower-case names (also full upper/lower-case) and they're not affected. What could be causing that? Best regards Marco More info *Source Filesystem: Mac OS Extended Macintosh, OSX 10.5 Leopard rsync version 2.6.3 protocol version 28 Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, inplace, IPv6, 32-bit system inums, 64-bit internal inums *Destination Ubuntu Linux 7.10 Filesystem: vfat (fat32) rsync version 2.6.9 protocol version 29 Capabilities: 64-bit files, socketpairs, hard links, symlinks, batchfiles, inplace, IPv6, ACLs, 64-bit system inums, 64-bit internal inums -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
logical volumes alignment
Hi all! I'd like to use rsync to keep aligned physical volumes between linux servers. I know that there are other tools but I really need to use rsync. I would like to do something as rsync /dev/VG/SourceLogicalVolume [EMAIL PROTECTED]:/dev/VG/DestinationLogicalVolume Do you think could it be possible? Thanks Marco -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync as daemon doesnt use secrets file but sshd
Hi all!
I have a problem configuring rsync as daemon:
This is my rsync.conf:
log file = /var/log/rsync.log
list = yes
uid = nobody
gid = nobody
secrets file = /etc/rsyncd.secrets
[section]
comment = Great stuff from remote.acme.com
path = /home/repos
auth users = marco
hosts allow = *
hosts deny = *
This is my /etc/rsyncd.secrets
marco:marco
This is the secrets file permission:
[EMAIL PROTECTED] marco]# ls -l /etc/rsyncd.secrets
-rw--- 1 root root 12 Nov 12 17:01 /etc/rsyncd.secrets
This is /etc/xinetd.d/rsync
service rsync
{
disable = no
socket_type = stream
wait= no
user= root
server = /usr/bin/rsync
server_args = --daemon
log_on_failure += USERID
}
The problem is that I can not rsync from a client: it seems rsync is using
pam and system users for logging. I've tried to enable the user marco as
system user and I can login!!! So I think rsync can not authenticate using
the secret file.
[EMAIL PROTECTED]:~$ rsync -vv [EMAIL PROTECTED]::section
opening connection using ssh -l marco server rsync --server --sender -vv .
FxS
[EMAIL PROTECTED]'s password:
Permission denied, please try again.
Into /var/log/messages I have
Nov 12 17:10:46 server sshd(pam_unix)[16221]: check pass; user unknown
Nov 12 17:10:46 server sshd(pam_unix)[16221]: authentication failure;
logname= uid=0 euid=0 tty=ssh ruser= rhost=10.0.0.34
What should I check?
Thanks
Marco
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--copy-links and multi-process
Hi, I'm a user of rsync, rsync is VERY cool! I noticed that when I rsync somethings with option:--copy-links, system will create two process that with the same name(different PR value). Is that normal? Thank you!! -- LinuX Power -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Divulgação cadastramento em sites de busca: http://www.gueb.de/divulgueseusite
Tudo para divulgação de sites e homepages. Cadastramento em mecanismos de busca, email marketing, publicidade online, campanhas online, cadastro de sites, sites de busca, torne seu site um sucesso: http://www.gueb.de/divulgueseusite Tudo para divulgar seu site: Cadastramento em ferramentas de busca nacionais e internacionais. Cadastro em buscadores e diretórios. Torne seu site um sucesso de visitação e vendas: http://www.gueb.de/divulgueseusite Dicas de como divulgar seu site. Email marketing e outros recursos. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync deletes too much?
Yes, that was it. I'd forgotten that /usr was a separately mounted FS. Thank you. -- Marco John Van Essen ([EMAIL PROTECTED]) wrote: On Sun, 12 Oct 2003, Marco Nicosia [EMAIL PROTECTED] wrote: Hello. I'm having a problem using rsync to copy my root partition to a new disk. This disk has a previous copy on it, and rsync seems determined to (unnecessarily) delete files from it. Worse, despite the fact that the files DO exist on the source, it does not update the destination, leaving me with less than I had before?! Here's my usage: ] server# /usr/local/bin/rsync -naxv --delete --progress --stats --exclude '/dev/' --exclude '/tmp/' --exclude '/usr/var/tmp/' --exclude '/usr/var/run/' / /tmp/bkup/ | grep -c deleting ] 105668 You are using -x, which will not include the contents of any mounted partitions. 105,668 deletes and no update of the destination makes me think that /usr on the source is a mounted partition, which would explain both symptoms. -- John Van Essen Univ of MN Alumnus [EMAIL PROTECTED] ___ Marco E. Nicosia | http://www.escape.org/~marco/ | [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
problem with option -n and empty directories
I have a problem using option -n (to test if a sync operation will be done) and I add empty directory in the source tree. If I make: # mkdir source/empty # rsync -n -v -a ... source/ dest rsync does not notes empty dir, but if I remove -n option it synchronize correctly also the empty dir. Why ? I think this is important because, as I do, a command like `rsync -n' could be inserted in crontab, for example hourly, to check if the source tree has to be updated. Please answer directly to me at [EMAIL PROTECTED] Thank you very much. Marco. -- % dott. Marco Broglia % Nsa srl, viale Regina Margherita 81, I-20050 Macherio (MI) % email: [EMAIL PROTECTED] -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Re: include-exclude patterns
Le Mon, 9 Dec 2002 21:22:48 -0800 jw schultz [EMAIL PROTECTED] écrivait : You forgot to include /var/ and /var/lib/ so it never even sees /var/lib/zope/ I even tried this but it include the whole /var/ folder ! I just want /var/lib/zope. -- marco -- Clé PGP publique : https://iftbqp.mine.nu/marco.asc msg05731/pgp0.pgp Description: PGP signature
Re: include-exclude patterns
Le Mon, 9 Dec 2002 21:22:48 -0800 jw schultz [EMAIL PROTECTED] écrivait : I found this on the FAQ-O-Matic from the rsync webite http://rsync.samba.org/fom-serve/cache/164.html I'm so agree... Is it possible to make it true ? thanks -- marco -- Clé PGP publique : https://iftbqp.mine.nu/marco.asc msg05732/pgp0.pgp Description: PGP signature
include-exclude patterns
Hi, I just subscribe to ask you a question about patterns in exclude-include files. I just want some folders to be rsynced to a remote machine. What I tried is : IncludeFile - /etc/ /var/lib/zope/ - /* --- result of $$ rsync -avvrn --delete --delete-excluded --include-from=/backup-include -e ssh / /backup is expand file_list to 4000 bytes, did move including directory etc because of pattern /etc/ excluding directory usr because of pattern /* excluding directory bin because of pattern /* excluding directory var because of pattern /* excluding directory boot because of pattern /* excluding directory dev because of pattern /* excluding directory home because of pattern /* excluding directory lib because of pattern /* excluding directory mnt because of pattern /* excluding directory proc because of pattern /* excluding directory root because of pattern /* excluding directory sbin because of pattern /* excluding directory tmp because of pattern /* excluding directory floppy because of pattern /* excluding directory cdrom because of pattern /* excluding directory initrd because of pattern /* done What about /var/lib/zope/ ? I lost my afternoon on this Could you explain me what I am missing ? thanks -- marco -- Clé PGP publique : https://iftbqp.mine.nu/marco.asc -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
Rsync error: partial transfer (code 23) at main.c(926)
I don't use rsync on my server because all time what i use this message appears: zopedocs/GuideToDTML/roman-number.gif is uptodate wrote 60 bytes read 2552145 bytes 6603.38 bytes/sec total size is 2211107296 speedup is 866.35 rsync error: partial transfer (code 23) at main.c(926) I user this command: rsync --progress -prtvv servertoconnect::tagonrsyncd.conf . (The rsyncd.conf it's allow hosts only my backup server) Rsync 2.4.6-5 (compiled on machine) Redhat 7.2 All software on server and backup server it's the same. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.tuxedo.org/~esr/faqs/smart-questions.html
