mtime not updating on remote directory
Hello, I'm using rsync as part of a centralised config management for several servers. I'm trying to monitor the mtime of a particular directory and confirm that the remote copies are approximately as new as the the local master. However, mtime on that directory is not being synced. Here's my rsync command: cd $confdir rsync -avpzR --checksum -I -e ssh --exclude='old/' ./* user@remotehost:/ My impression is that this should sync mtime to the remote dir, if that mtime has changed locally. However that's not happening. It doesn't seem to me that any of my options implies --omit-dir-times, but maybe I'm missing something - Any clues? Thanks in advance! tom -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: mtime not updating on remote directory
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Seems to work when I tried it. Is the directory listed when you run it? What does --itemize-changes say? My first guess is that it would be an interaction between --checksum and --ignore-times which are fairly opposite functions and --checksum is usually the wrong thing to use. Also btw, you don't need -p -R or -e ssh. Also, use ./ instead of ./* This wouldn't affect your current command but it would if you were using --delete so I consider it a bad habit. On 05/18/2015 08:36 AM, tomr wrote: Hello, I'm using rsync as part of a centralised config management for several servers. I'm trying to monitor the mtime of a particular directory and confirm that the remote copies are approximately as new as the the local master. However, mtime on that directory is not being synced. Here's my rsync command: cd $confdir rsync -avpzR --checksum -I -e ssh --exclude='old/' ./* user@remotehost:/ My impression is that this should sync mtime to the remote dir, if that mtime has changed locally. However that's not happening. It doesn't seem to me that any of my options implies --omit-dir-times, but maybe I'm missing something - Any clues? Thanks in advance! tom - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2 iEYEARECAAYFAlVaFykACgkQVKC1jlbQAQe/HQCgxtmlmXUSIlBV2j+VSM6aJ32B JFAAn3Gx6TBTCHSMEBVKXsSjiG+S5gtG =/2aK -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync - Management of UIDs and GIDs when reserved on a Remote system
Hi Wayne et al, I've been using Linux for a little over a year now. I'm making improvements to the English phrasing used by luckyBackup which uses rsync. English is my first language and I'm doing this so that I can, then, more accurately make translations for the Spanish language. I would like to know how rsync would manage the situation where the UID and GID(s), of a file being copied to a Remote system, have been reserved on the Remote system. Does rsync search for and allocate the next available IDs? If so, how would a Restore operation function? Can rsync create a log, during a Backup, to record the newly allocated IDs, on the Remote system, so that they can be mapped back to the Source system? Thanks, Michael. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync - Management of UIDs and GIDs when reserved on a Remote system
Michael cuscotravelservi...@gmail.com wrote: I would like to know how rsync would manage the situation where the UID and GID(s), of a file being copied to a Remote system, have been reserved on the Remote system. Does rsync search for and allocate the next available IDs? AFAIK, if you don't specify the numeric-ids option, then it will match by user/group name - ie it'll do a numeric to name conversion at the source, lookup the name at the destination, get the numeric value for the destination, and convert. So if user fred is UID 1000 on the source and 1010 on the destination, files owned by 1000 on the source will end up as UID 1010 on the destination. If there sin't a matching name then AFAIK it'll do no conversion - you may end up with files owned by either a different user or no user at all. With the above, if user fred doesn't exist on the destination, then files will end up owned by UID 1010. What is fun is copying files on a filesystem from a different system (mounting the virtual disks for a VM on the host) and copying them elsewhere while forgetting the numeric-ids option. You end up with some interesting file ownerships ! -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync - Management of UIDs and GIDs when reserved on a Remote system
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Rsync has 4 options for this... 1) Write all files as the owner and group that rsync is running as. This is the default and the only possibility when not running as root since only root can create files as a different UID. 2) Copy the user name and group name. This is what you get when you are running as root and use --owner --group or --archive. This means if the 2 systems have the same user name but with different UIDs rsync will translate so that the files come out with the same user name and group name on both systems if possible. If the user name or group name doesn't exist on the target system then the file/dir is created with whatever UID or GID number regardless of whether it is in use by another user or not. 3) --numeric-ids copies both as the number. This is what you normally want for backups. This way you have the exact UID and GID stored on the backups regardless of what those numbers mean to the backup system. Just remember to use --numeric-ids when you restore. This is especially important if you have to restore from a live environment that has completely different UIDs and GIDs than your normal system. That environment would have no idea how to translate names from option #2 during a restore. 4) --fake-super. This writes files like option #1 but also stores what the owner and group name or numeric IDs should be in a user xattr. The same info about --numeric-ids applies. Root access not needed except during restore. On 05/18/2015 02:52 PM, Michael wrote: Hi Wayne et al, I've been using Linux for a little over a year now. I'm making improvements to the English phrasing used by luckyBackup which uses rsync. English is my first language and I'm doing this so that I can, then, more accurately make translations for the Spanish language. I would like to know how rsync would manage the situation where the UID and GID(s), of a file being copied to a Remote system, have been reserved on the Remote system. Does rsync search for and allocate the next available IDs? If so, how would a Restore operation function? Can rsync create a log, during a Backup, to record the newly allocated IDs, on the Remote system, so that they can be mapped back to the Source system? Thanks, Michael. - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2 iEYEARECAAYFAlVaQ30ACgkQVKC1jlbQAQc58wCcDoGUwb6kotWfPYIL0UTeFhyV BWsAoNPE2ghqQX4xqE8wDlWilYPsShLe =nZpc -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync - Management of UIDs and GIDs when reserved on a Remote system
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 No, rsync would store the files with the numeric UID and GID as is on the source without regard to the existence or non-existence of a matching account. This could mean that ls would show numbers in those columns, or incorrect names in those columns, or (perhaps by coincidence) show the correct names in those columns. The important thing is that if you backup and restore with --numeric-ids you will get back what you started with regardless of what the backup system thinks about the data. On 05/18/2015 09:16 PM, Michael wrote: Kevin Korb kmk at sanitarium.net writes: 3) --numeric-ids copies both as the number. This is what you normally want for backups. This way you have the exact UID and GID stored on the backups regardless of what those numbers mean to the backup system. Just remember to use --numeric-ids when you restore. This is especially important if you have to restore from a live environment that has completely different UIDs and GIDs than your normal system. That environment would have no idea how to translate names from option #2 during a restore. Hi Kevin, Regarding the option --numeric-ids, how would rsync manage the situation where the UID and GID(s), of a file being copied to a Remote system, have been reserved on the Remote system. Does rsync search for and allocate the next available IDs? Thanks, Michael. - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2 iEYEARECAAYFAlVakU4ACgkQVKC1jlbQAQe6AACcDo7ecpCTUgDJkxBlx05OJ57D pf8AniaeelYUKcJDl+Zl/xjGcYkcmjOW =nRGQ -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync - Management of UIDs and GIDs when reserved on a Remote system
Kevin Korb kmk at sanitarium.net writes: 3) --numeric-ids copies both as the number. This is what you normally want for backups. This way you have the exact UID and GID stored on the backups regardless of what those numbers mean to the backup system. Just remember to use --numeric-ids when you restore. This is especially important if you have to restore from a live environment that has completely different UIDs and GIDs than your normal system. That environment would have no idea how to translate names from option #2 during a restore. Hi Kevin, Regarding the option --numeric-ids, how would rsync manage the situation where the UID and GID(s), of a file being copied to a Remote system, have been reserved on the Remote system. Does rsync search for and allocate the next available IDs? Thanks, Michael. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Two questions
Hello, Rsync. rsync version 3.0.9 protocol version 30: 1) Why test.log changes not only on the parameter --log-file-format and the parameter --out-format? rsync -a --delete -vv --log-file-format=%i|%o|%B|%U|%G|%M|%f --log-file=/home/test.log /home/124/ /home/1/ 2015/05/18 12:40:43 [21148] building file list 2015/05/18 12:40:43 [21148] delta-transmission disabled for local transfer or --whole-file 2015/05/18 12:40:43 [21148] .d..t..|send|rwxr-xr-x|0|0|0-4096|2015/05/18-12:40:43|home/124/. 2015/05/18 12:40:43 [21148] *deleting |del.|-|0|0|0-0|1970/01/01-03:00:00|d.log 2015/05/18 12:40:43 [21148] e.log is uptodate 2015/05/18 12:40:43 [21148] f.log is uptodate 2015/05/18 12:40:43 [21148] g.log is uptodate 2015/05/18 12:40:43 [21148] i.log is uptodate 2015/05/18 12:40:43 [21148] k.log is uptodate 2015/05/18 12:40:43 [21148] l.log is uptodate 2015/05/18 12:40:43 [21148] m.log is uptodate 2015/05/18 12:40:43 [21148] n.log is uptodate 2015/05/18 12:40:43 [21148] o.log is uptodate 2015/05/18 12:40:43 [21148] p.log is uptodate 2015/05/18 12:40:43 [21148] r.log is uptodate 2015/05/18 12:40:43 [21148] s.log is uptodate 2015/05/18 12:40:43 [21148] t.log is uptodate 2015/05/18 12:40:43 [21148] u.log is uptodate 2015/05/18 12:40:43 [21148] u1.log is uptodate 2015/05/18 12:40:43 [21148] u2.log is uptodate 2015/05/18 12:40:43 [21148] u3.log is uptodate 2015/05/18 12:40:43 [21148] u4.log is uptodate 2015/05/18 12:40:43 [21148] u5.log is uptodate 2015/05/18 12:40:43 [21148] u6.log is uptodate 2015/05/18 12:40:43 [21148] f.st..|send|rw-r--r--|0|0|2247-2204|2015/05/18-12:40:25|home/124/u8.log 2015/05/18 12:40:43 [21148] f+|send|rw-r--r--|0|0|1486-47|2015/05/18-12:40:43|home/124/u9.log 2015/05/18 12:40:43 [21148] 004 is uptodate 2015/05/18 12:40:43 [21148] aquota.group is uptodate 2015/05/18 12:40:43 [21148] aquota.user is uptodate 2015/05/18 12:40:43 [21148] backupland.com.log is uptodate 2015/05/18 12:40:43 [21148] listfiles_backup.txt is uptodate 2015/05/18 12:40:43 [21148] listfiles_full.txt is uptodate 2015/05/18 12:40:43 [21148] listfiles_viruses.txt is uptodate 2015/05/18 12:40:43 [21148] log-format.sh is uptodate 2015/05/18 12:40:43 [21148] test.1.log is uptodate 2015/05/18 12:40:43 [21148] total: matches=0 hash_hits=0 false_alarms=0 data=3647 2015/05/18 12:40:43 [21148] sent 4455 bytes received 140 bytes 9190.00 bytes/sec 2015/05/18 12:40:43 [21148] total size is 422643231 speedup is 91978.94 rsync -a --delete -vv --log-file-format=%i|%o|%B|%U|%G|%M|%f --out-format=|%a |%b |%B |%c |%C |%f |%G |%h |%i |%l |%L |%m |%M |%n |%o |%p |%P |%t |%u |%U --log-file=/home/test.log /home/124/ /home/1/ 2015/05/18 12:32:55 [16058] building file list 2015/05/18 12:32:55 [16058] delta-transmission disabled for local transfer or --whole-file 2015/05/18 12:32:55 [16058] .d..t..|send|rwxr-xr-x|0|0|0-4096|2015/05/18-12:32:55|home/124/. 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-6519|2015/05/18-11:44:24|home/124/d.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3443|2015/05/18-11:44:56|home/124/e.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-1687|2015/05/18-11:45:28|home/124/f.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-1881|2015/05/18-11:47:56|home/124/g.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-1888|2015/05/18-11:51:59|home/124/i.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-2292|2015/05/18-11:57:25|home/124/k.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-4826|2015/05/18-12:00:04|home/124/l.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-2536|2015/05/18-12:00:12|home/124/m.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-5494|2015/05/18-12:04:56|home/124/n.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-2842|2015/05/18-12:06:05|home/124/o.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-2863|2015/05/18-12:06:32|home/124/p.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-2976|2015/05/18-12:07:11|home/124/r.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3036|2015/05/18-12:13:58|home/124/s.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3140|2015/05/18-12:14:20|home/124/t.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3240|2015/05/18-12:18:25|home/124/u.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3345|2015/05/18-12:19:00|home/124/u1.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3449|2015/05/18-12:19:46|home/124/u2.log 2015/05/18 12:32:55 [16058] .f |send|rw-r--r--|0|0|0-3545|2015/05/18-12:22:15|home/124/u3.log 2015/05/18 12:32:55 [16058] .f
