Re: Time rsYnc Machine (tym)

2012-08-10 Thread Paul Slootman
On Thu 09 Aug 2012, Linda Walsh wrote: Anyway, thanks for the history update. I have a feeling rsync is afraid to use memory -- and really, it should try to use alot of memory to optimize transfers, I have had rsync fail after using up 8GB memory + 4GB swap, so I'm very happy it does

Re: Rsyncing huge file, timeout on rsyncd

2012-08-02 Thread Paul Slootman
On Thu 02 Aug 2012, Libor Klepáč wrote: Ok, i'l try setting timeout, but according to documentation, default is timeout=0 which means no timeout. IIRC setting the timeout explicitly on both ends (if you're using an rsync daemon) to the same value will cause some sort of heartbeat activity.

Re: change UID+GID on target system?

2012-06-19 Thread Paul Slootman
On Mon 18 Jun 2012, Uwe Brauer wrote: On Mon, 18 Jun 2012 15:33:09 +0200, Paul Slootman wrote: This makes no sense. There is no UID option for mounting a jfs filesystem; that's only appropriate for e.g. VFAT where there is no concept of UID. After mounting a jfs

Re: change UID+GID on target system?

2012-06-18 Thread Paul Slootman
On Mon 18 Jun 2012, Uwe Brauer wrote: Situation: On laptop 1, I am user oub (uid=1000) and in the sudo list. I connect an USB drive (jfs file system), its get automatically mounted with the correct uid. This makes no sense. There is no UID option for mounting a jfs filesystem; that's only

Re: --link-dest isn't linking

2012-04-23 Thread Paul Slootman
On Sun 22 Apr 2012, dar...@chaosreigns.com wrote: rsync -Ha --link-dest=/media/4tb/bak/panic-2012-01-01 /media/2tb/bak/panic-2012-02-01 /media/4tb/bak/ root@dancer:/media/4tb/bak# ls -l panic*/home/darxus/_latest.jpg -rw--- 15 darxus darxus 100772 1999-09-14 21:19

Re: --link-dest isn't linking

2012-04-23 Thread Paul Slootman
On Mon 23 Apr 2012, dar...@chaosreigns.com wrote: On 04/23, Paul Slootman wrote: On Sun 22 Apr 2012, dar...@chaosreigns.com wrote: rsync -Ha --link-dest=/media/4tb/bak/panic-2012-01-01 /media/2tb/bak/panic-2012-02-01 /media/4tb/bak/ root@dancer:/media/4tb/bak# ls -l panic*/home

Re: Bug#624826: rsync: Bad interaction between -u and --partial

2012-04-17 Thread Paul Slootman
[resending, I made a typo in the list address] [ Please Cc: 624826-forwar...@bugs.debian.org on any replies ] Please see the bug report below. In short, when using --partial together with --update, an interrupted file will get the current timestamp, and hence when redoing the transfer the file

Re: Bug#666024: rsync --link-dest can incorrectly hardlink together destination files

2012-04-15 Thread Paul Slootman
[please Cc: 666024-forwar...@bugs.debian.org on any replies, thanks] Please see the attached Debian bug report, which includes a helpful bug-reproducing shell script; I've confirmed this still happens with 3.0.9. Paul Slootman On Tue 27 Mar 2012, Ian Jackson wrote: Package: rsync Version

Re: failed: File name too long

2012-03-30 Thread Paul Slootman
On Thu 29 Mar 2012, Kip Warner wrote: Some file names are very long and rsync unfortunately cannot transfer them, issuing the following error message: failed: File name too long (78) I'm assuming the 78 is drawn from a system header that it was compiled against and probably not

Re: Help debugging an issue with --fuzzy --fuzzy and --link-dest

2012-03-22 Thread Paul Slootman
On Thu 22 Mar 2012, Andrew Gideon wrote: Note that the source ads_live_error.log.9.gz would not match the destination HOLD.ads_live_error.log.9.gz. Instead, it should have matched the destination ads_live_error.log.10.gz. I mention this in case that plays a role in this failure.

Re: killing rsync seems to wipe-out the --partial .hidden files

2012-03-20 Thread Paul Slootman
On Tue 20 Mar 2012, Frank Hamersley wrote: Thinking quickly (as I have to go to a Mindari) the approach I would take for --partial is to ... Perhaps you need to examine the manpage bit more thoroughly, you could e.g. use --partial-dir. Paul -- Please use reply-all for most replies to avoid

Re: killing rsync seems to wipe-out the --partial .hidden files

2012-03-19 Thread Paul Slootman
On Mon 19 Mar 2012, Frank Hamersley wrote: I am running an overnight (off-peak) replication using rsync --partial which is suspended at 08h30 each morning to allow for day time use of the internet link. However it seems the kill -TERM on the various rsync (and ssh) processes is too

Re: Check to see if there are changes using rsync

2012-03-01 Thread Paul Slootman
On Thu 01 Mar 2012, Daniel Bolgheroni wrote: I'm willing to use -anv (-n for --dry-run) and parse the output. But maybe there is an easier way? Maybe some status returned given a specific set of parameters? I'd use -i (itemize changes) instead of -v as that's probably easier to parse in

Re: Hlink node data for 570645 already has path ...

2011-12-06 Thread Paul Slootman
On Thu 01 Dec 2011, Kevin Korb wrote: Right, I was assuming they were linked in the source because you were using rsync --link-dest to do your incremental backups. Hmm, was I? The command being run is: rsync -aH --timeout=12345 --whole-file --numeric-ids --inplace --omit-dir-times

Hlink node data for 570645 already has path ...

2011-12-01 Thread Paul Slootman
When syncing one backup system (running dirvish, but that's not really relevant) to a second long-term backup system which uses btrfs snapshots, I get the following output: rsync: link

Re: Hlink node data for 570645 already has path ...

2011-12-01 Thread Paul Slootman
On Thu 01 Dec 2011, Kevin Korb wrote: If you are switching to btrfs subvolume snapshots then you don't want to do all the rsync hard linking. You want to copy each backup onto a separate subvolume. Something like this (psuedo code): If you look carefully at the output, these are files that

Re: Hlink node data for 570645 already has path ...

2011-12-01 Thread Paul Slootman
On Thu 01 Dec 2011, Kevin Korb wrote: Right, I was assuming they were linked in the source because you were using rsync --link-dest to do your incremental backups. Good point, that's probably a remnant from an older version of the script :-) I'll remove that. Thanks. Paul -- Please use

Re: delete files

2011-11-22 Thread Paul Slootman
On Mon 21 Nov 2011, Brian K. White wrote: On 11/19/2011 9:04 AM, francis.montag...@inria.fr wrote: On Tue, 15 Nov 2011 23:49:18 +0100 Brian K. White wrote: nj2:/opt/x # rsync -avvvn --force --delete --include=/tmp --include=floof/ --exclude='*' /tmp/. co4::root/tmp/. Detail: /tmp being

Re: Not all files copied

2011-11-14 Thread Paul Slootman
On Mon 14 Nov 2011, Mike Brown wrote: For the most part, all of the directories are being copied, but there are files that it refuses to copy. For example: -rw--- 1 brown146 Jul 31 20:58 .TTauthority Any file that is 600 it will leave behind and list it as permission

Re: Rsync 3.0.9pre2 released

2011-09-13 Thread Paul Slootman
On Sat 10 Sep 2011, Wayne Davison wrote: Rsync version 3.0.9pre2 is now available for release testing. This is a bug-fix release. I've uploaded rsync_3.0.9~pre2-1 to debian/experimental, for those who want to give it a try. Note the Debian bug report http://bugs.debian.org/640869 ; quoting

Re: Rsync 3.0.9pre2 released

2011-09-13 Thread Paul Slootman
On Tue 13 Sep 2011, Paul Slootman wrote: I've uploaded rsync_3.0.9~pre2-1 to debian/experimental, for those who rsync_3.0.9~pre2-2 actually, -1 had a minor packaging bug. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options

Re: Why doesn't rsync update this file?

2011-07-25 Thread Paul Slootman
On Mon 25 Jul 2011, Jeremy Sanders wrote: [root@localsys tmp]# stat coolingfit.pro~ Modify: 2010-08-02 15:37:04.0 +0100 remote:~/tmp:# stat coolingfit.pro~ Modify: 2010-08-02 15:37:04.780737333 +0100 As far as I can see --modify-window should be zero for default for an exact

Re: keep 2 dirs in sync

2011-07-01 Thread Paul Slootman
On Fri 01 Jul 2011, Michael Makuch wrote: I have two hosts (my portable and my desktop). I work on both hosts at different times and so I keep a few dirs sync'd between the two. I have a docs dir where I may be modifying files, adding files, renaming files and deleting files on *either* host.

Re: rsync and many files

2011-06-06 Thread Paul Slootman
On Mon 06 Jun 2011, Cliff Simon wrote: Now my problem is, that the backup needs about 14 hours - the most time is to generate the filelist and check whether the files are new/changed or not. Are you using a recent version of rsync? One that does incremental recursion? Paul -- Please use

Re: rsync and many files

2011-06-06 Thread Paul Slootman
On Mon 06 Jun 2011, Cliff Simon wrote: Hm...I´m using 3.0.3 at the Dest-Server, but now I saw that the Source-Server has 2.6.9 Do I have to enable incremental recursion and from which version is incremental supported? Both ends have to be at least 3.0.0 to enable the incremental

Re: IO error encountered, skipping file deletion - WTF?

2011-04-06 Thread Paul Slootman
On Tue 05 Apr 2011, travis+ml-rs...@subspacefield.org wrote: Anyone know what this is supposed to mean? 366305 files to consider IO error encountered -- skipping file deletion I keep getting this, and so it refuses to delete any files from a mirror. But what is the supposed I/O error?

Re: maybe a Unicode problem? was Re: two bugs in rsync 3.0.6 - ampersands in filenames, double quoting required

2011-03-12 Thread Paul Slootman
Have you tried --protect-args ? Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: The problems with rsync continues. (code 255)

2011-02-25 Thread Paul Slootman
On Fri 25 Feb 2011, Xabi Vazquez wrote: - 8 --- 8 [Fri Feb 25 05:21:05 CET 2011] /usr/bin/rsync -az --delete --numeric-ids --relative --delete-excluded --rsh=/usr/bin/ssh root@server1:/opt/apache/conf

Re: Trying to preserve UID and GID when backing up with rsync

2011-02-14 Thread Paul Slootman
On Mon 14 Feb 2011, Robert Crida wrote: I am in early prototyping phase now and have the following rsyncd.conf file: max connections = 4 [school1] path = /backup/school/./1 read only = false use chroot = true I ran the following command (on the same

Re: Issue with bwlimit after resuming a partial transfer due to a communication break

2011-01-21 Thread Paul Slootman
On Fri 21 Jan 2011, Alistair Dsouza wrote: I have set the bwlimit to 10 i.e. 10 KBps. When I try to sync files the bwlimit is as what is set. I have enabled storage of partial files. When a communication break causes rsync to time out during a transfer the partial file is stored in the

Re: rsync as a deliberately slow copy?

2010-09-30 Thread Paul Slootman
On Thu 30 Sep 2010, Henri Shustak wrote: Yes SSH (depending upon the system) may be resource intensive. As such, the suggestion of using nice is a really good suggestion! Also, if running on linux, investigate ionice. This, given CFQ disk scheduling (the default in recent kernels, I believe)

Re: How to mirror only specified directories

2010-09-28 Thread Paul Slootman
On Tue 28 Sep 2010, Ian Skinner wrote: I am trying to mirror only select directories from one server to another with rsync through its daemon mode. Server A /export /home /A-do /A-not /A-copy /das /htdocs /docs /em

Re: recent discussion regarding 'checksums'

2010-09-27 Thread Paul Slootman
On Mon 27 Sep 2010, grarpamp wrote: Yes, right now rsync -c is not good if an attacker has had the opportunity to plant files on the destination and you want to make sure the files get updated properly, but that's an uncommon use case Or whitehat people backing up cracked boxes. If I

Re: Old FreeBSD4.11 build.

2010-09-21 Thread Paul Slootman
On Tue 21 Sep 2010, Jonathan Call wrote: I'm trying to get an old FreeBSD 4.11 server to talk to a newer FreeBSD 7 server that is running rsync 3.0.4 but I am running into an error with extended file attributes: Ran the following configure line: ./configure --with-included-popt

Re: Intermittent rsync Issues

2010-09-16 Thread Paul Slootman
On Thu 16 Sep 2010, Mac User FR wrote: I read somewhere that the ssh connection was stronger than rsync one in unstable networks. And effectively, if I run rsync via ssh ( -e option), the transfer happen without errors, on the same computer using the same networking setup. I wouldn't be

Re: Getting the 'hidden' .htaccess file.

2010-09-03 Thread Paul Slootman
On Fri 03 Sep 2010, Ian Skinner wrote: When I run the following command, it will get the other 19258 files, but it will ignore the three .htaccess files in our site. I have searched the internet and can see that it is apparently somewhat tricky to get rsync to capture dot hidden files.

Re: Getting the 'hidden' .htaccess file.

2010-09-03 Thread Paul Slootman
On Fri 03 Sep 2010, Ian Skinner wrote: They are not including them in my first tests? While I have run several rsync copies between these two systems, everything is being copied, according to a post copy comparison, except the three .htaccess files! Could there be some permission issue

Re: Minimize log file: get rid of .d...p..... send

2010-09-03 Thread Paul Slootman
On Fri 03 Sep 2010, Hans Troost wrote: !!! Even with strace I do not get a chmod call shown. !!! strace -o /home/hans/strace.log -s 80 rsync -axhhX --no-p --stats --delete If you're doing --no-p you wonder why it's not setting permissions? Paul -- Please use reply-all for most replies to

Re: Getting the 'hidden' .htaccess file.

2010-09-03 Thread Paul Slootman
On Fri 03 Sep 2010, Ian Skinner wrote: I believe I have now tried to do that. This was the results reported by rsync as well as that the file still does not exist on the receiving server. dprweb /usr/local/bin/rsync --verbose --progress --stats --compress .htaccess appprod::test I'm

Re: Getting rsync to store timing information in its logs

2010-07-28 Thread Paul Slootman
On Tue 27 Jul 2010, Rahul Nabar wrote: The only timing info,. I see is this at the end: sent 3067328 bytes received 7853035429 bytes 1187888.83 bytes/sec Also, the bytes/sec figure has me confused. It seems to convert to about 1.13 GB/sec. But I know that my ethernet connection is only

Re: Behavioral differences between versions.

2010-07-22 Thread Paul Slootman
On Wed 21 Jul 2010, Jeff Cleverley wrote: 1. When using the -z option, does rsync actually use /usr/bin/compress or does it use gzip? The man pages say it compresses data but doesn't specify what it compresses with. It uses the gzip algorithm but implements it internally; it doesn't call

Re: Rsync sequence

2010-07-20 Thread Paul Slootman
On Mon 19 Jul 2010, dschuett wrote: allow for a more efficient backup. I know I could just run them at different times in the same night, but I don't want to chance one not completing before the other starts. Can I just list them one after the other like so in crontab -e: # m h dom mon

Re: Rsync backup issues using relative paths and LVM snapshots

2010-07-16 Thread Paul Slootman
On Fri 16 Jul 2010, Alex Ferrara wrote: I did think about remotely executing a mkdir before the backup, but one blocker is that I will be using Thecus NAS boxes as some off-site locations and I don't have shell access. You could mkdir the directory locally somewhere (anywhere), and rsync

Re: deep vs. shallow directory structure

2010-07-05 Thread Paul Slootman
On Sat 03 Jul 2010, Shai Ayal wrote: My question (finally): how to optimize rsync's speed? - how deep should the directory structure be? What would be faster to rsync - 1 directory with 2M files, or 16 directories with 125K files each, or 256 directories with 8K files each, Smaller

Re: link-dest question revisted

2010-07-05 Thread Paul Slootman
On Thu 01 Jul 2010, d...@safeport.com wrote: In checking inodes I can find many files that did not change on the server. E.g.: artemis:/mnt# diff 201003/newharbor/home/allvid/allvid.tgz 201007/newharbor/home/home/allvid/allvid.tgz artemis:/mnt# ls -il

Re: / as share name don't work

2010-07-05 Thread Paul Slootman
On Mon 05 Jul 2010, Matthias Meyer wrote: Howto specify / as share name? Don't. e.g: [/] Use something like [root] Quoting from the rsyncd.conf manpage: The module name cannot contain a slash or a closing square bracket. Paul -- Please use reply-all for most replies to avoid omitting

Re: deep vs. shallow directory structure

2010-07-05 Thread Paul Slootman
On Mon 05 Jul 2010, Shai Ayal wrote: More directories probably won't help much. Thanks. Will more directories make the performance worse? Not necessarily, it depends on things like how fast scanning the directories is in relation to how many files actually need to be transferred, for

Re: Risk of corrupting open sources files

2010-04-16 Thread Paul Slootman
On Fri 16 Apr 2010, Matt McCutchen wrote: Additionally, would the writing program be blocked from writing to the file if rsync is reading the file? Not on unix-like systems. OTOH, I believe Windows enforces read/write locking, so rsync could not have the file open for reading at the same

Re: Random Timeouts?

2010-04-16 Thread Paul Slootman
On Fri 16 Apr 2010, Erich Weiler wrote: As you can see, both sender and receiver are version 3.0.5. I read the docs and it seems to indicate that by default there is no timeout...? So the error messages are confusing I've found that it can help to actually configure a timeout; use the

Re: include/exclude problems

2010-03-25 Thread Paul Slootman
On Thu 25 Mar 2010, Vitaly V. Ganusov wrote: from excluded-utk.txt file: + .mozilla-thunderbird/ + .mozilla-thunderbird/afc5fv2p.default/ + .mozilla-thunderbird/afc5fv2p.default/abook.mab + .mozilla-thunderbird/afc5fv2p.default/storage.sdb - .mozilla-thunderbird/afc5fv2p.default/ImapMail

Re: Incremental recursion not working

2010-03-24 Thread Paul Slootman
On Wed 24 Mar 2010, Gerald Holl wrote: Maybe it's because of too many files? The file list consists of approx. 450.000 items. Incremental recursion works per directory. If all those 450.000 files are in one directory, then incremental recursion won't help. The number of items isn't the

Re: Rsync behaviour on harddisc crash

2010-03-18 Thread Paul Slootman
On Thu 18 Mar 2010, Mac User FR wrote: Wouldn't it be better to use conditional expressions from sh with a smaller footprint than rsync --list to check if the directory exists? I think on something like: -d file True if file exists and is a directory. That won't work to check a

Re: rsync daemon performance

2010-03-09 Thread Paul Slootman
On Sat 06 Mar 2010, Wayne Davison wrote: On Thu, Feb 25, 2010 at 5:20 PM, Tom Dickson tdick...@finarta.net wrote: Is it possible to get a pool of waiting daemons, similar to how apache runs? No, there is no support for that in rsync at the moment. I don't think it would be simple to

Re: directory synchronization

2010-02-23 Thread Paul Slootman
On Tue 23 Feb 2010, Vahid Moghaddasi wrote: I can’t seem to get this working. I need synchronize the files from a remote directory to a local, and then delete the files on the remote after getting them to local. This is what I did that does not delete anything on any of the servers:

Re: rsync: stat /path/to/dest/file failed: No such file or directory (2)

2010-02-18 Thread Paul Slootman
Are you really using paths such as /path/to/original, or are you trying to simplify things, thereby perhaps removing important details? Please show the real commands as executed, not after editing. Only change / remove really confidential things (but make clear exactly what). Don't change

Re: Common memory usage questions

2010-02-10 Thread Paul Slootman
On Tue 09 Feb 2010, Matt McCutchen wrote: The number of files that rsync tries to maintain in the active file lists at one time is controlled by {MIN,MAX}_FILECNT_LOOKAHEAD in rsync.h. I did some tests with ulimit -v, and reducing those values helped significantly. That still may not be

Re: rsync --link-dest, --delete and hard-link count

2010-02-06 Thread Paul Slootman
On Fri 05 Feb 2010, grarpamp wrote: Beware when using rsync --link-dest, --delete -Haxi !!! Files that are present in the previous datedir/hier/run but will not be present in the currently to be made datedir/hier/run, [because they are no longer present in the source hier], DO NOT show up

Re: rsync --link-dest, --delete and hard-link count

2010-02-05 Thread Paul Slootman
On Fri 05 Feb 2010, Andrei_r20 wrote: So what I am thinking of doing now is: The fist backup is done to an empty destination. Than, each following backup will be done to a freshly created empty dir with current date as name but with --link-dest option pointing at the previous (latest)

Re: Rsync in daemon mode

2010-01-26 Thread Paul Slootman
On Tue 26 Jan 2010, Piyush Pande wrote: Is it possible to run rysnc in daemon mode on system B(client) as well such that rsync will auto detect modifications and sync all the files with system A in real-time? You will of course never attain real-time updating over systems. Using cron

Re: option 'auth users' in rsyncd.conf

2010-01-22 Thread Paul Slootman
On Thu 21 Jan 2010, Alexander Dahl wrote: If I omit or outcomment the 'auth users' line, everyone is allowed to connect and this is also how I understood the manpage. Now if I use the following line, also everyone is allowed to connect: auth users = So if I don't put any username

Re: syncing ext3 to fat32

2010-01-15 Thread Paul Slootman
On Fri 15 Jan 2010, Mag Gam wrote: I am trying to rsync some files from ext3 to fat32 pen drive. What is the correct way to do this? I am currently using, --progress -av --no-o --no-g --exclude '*iso' /ext3 /fat32 Are there any other options I should consider? --modify-window=2 may

Re: rsync taking a while on really large files

2010-01-15 Thread Paul Slootman
On Fri 15 Jan 2010, David Trammell wrote: I saw the -W option, but I wasn't sure about how it behaves as the man pages don't have many details, and I thought there might be other options I missed. For -W the man page just says copy files whole (w/o delta-xfer algorithm) Take a moment to

Re: cannot backup to external disk with rsync, create hard links of add w permissions

2010-01-13 Thread Paul Slootman
On Wed 13 Jan 2010, Thomas Evangelidis wrote: I want to backup my Documents directory and instead of copying everything to my external disk I tried to use this command line to create an incremental backup with rsync on my external disk: You _did_ format the external disk with a filesystem

Re: link-dest question

2010-01-05 Thread Paul Slootman
On Mon 04 Jan 2010, d...@safeport.com wrote: The command works but copies all files, i.e. no hard links created. rsync -vaxH --numeric-ids --delete --exclude=/home/apache/logs \ --link-dest=/mnt/200912/newharbor/home -e ssh newharbor.safeport.com:/home \ 201001/newharbor/home/

Re: Rsync 3.0.7pre1 released

2009-12-22 Thread Paul Slootman
On Tue 22 Dec 2009, David Allie wrote: I get an error message when trying to decompress rsync-3.0.7pre1.tar.gz: [ ~/Desktop ]$ tar -xzvf rsync-3.0.7pre1.tar.gz tar: Unrecognized archive format: Inappropriate file type or format tar: Error exit delayed from previous errors. I have no

Re: How do I make rsync ignore unreadable files (damaged sectors)?

2009-12-22 Thread Paul Slootman
On Tue 22 Dec 2009, Tomas Gustavsson wrote: So I took a CD (which I scratched with a needle) and mounted it to the file system. There after I started the backup job which went on forever and never got completed. It seems that rsync refused to understand that the file it tried to copy was

Re: How do I make rsync ignore unreadable files (damaged sectors)?

2009-12-22 Thread Paul Slootman
On Tue 22 Dec 2009, Stefan Nowak wrote: How can one voluntarily smash only a particular sector of a hard disk drive? Even if you had a test HD for smashing, you don't know See (under linux) the manpage for hdparm: --make-bad-sector Deliberately create a bad sector (aka. media error) on

Re: rsync err. an other Broken pipe (32)

2009-12-21 Thread Paul Slootman
On Mon 21 Dec 2009, Aubert Thibaud wrote: Since our server migration from OES1 (rsync-3.0.2-2.1) to OES2 (rsync-3.0.6-3.1), rsync backup do not work anymore. rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6] _exit_cleanup(code=12, file=io.c, line=600):

Re: Rsync shortcutting output?

2009-12-18 Thread Paul Slootman
On Thu 17 Dec 2009, Joel Peabody wrote: The meaning of my question is twofold. First, if this is a known issue and what I'm seeing is, in fact, what's intended to happen on systems of this size. Second, is there any feature, flag, or setting that is either being overlooked in my rsync

Re: Rsync shortcutting output?

2009-12-17 Thread Paul Slootman
On Thu 17 Dec 2009, Joel Peabody wrote: PS, this is between two Redhat machines using rsync 2.6.8 on both ends. Upgrading rsync is not an option in this case. What I always wonder when reading such messages, is what type of response is expected, if a problem with the tool is suspected but

Re: anchoring of patterns for per-directory merge files

2009-11-11 Thread Paul Slootman
On Wed 11 Nov 2009, Andy Smith wrote: On the sender, I have in the file /data/home/andy/.rsync-filter: - /tmp/ The documentation leads me to believe that this should exclude a directory called tmp/ located only in the same directory as the merge file. What happens is, nothing gets

Re: hard links on samba shares

2009-10-23 Thread Paul Slootman
On Fri 23 Oct 2009, Matt McCutchen wrote: On Fri, 2009-10-23 at 09:15 +0200, Riccardo Iaconelli wrote: [r...@popper linksys]# rsync -avz --hard-links test/ test2/ sending incremental file list ./ file1 file2 Is this a bug or just samba being not reliable for hard links? :-)

Re: Enhanced authentication and authorization in rsyncd

2009-10-21 Thread Paul Slootman
On Tue 20 Oct 2009, Wayne Davison wrote: . I changed your ro, rw, and deny settings to be specified via suffixes. For example: auth user = joe:deny admin:rw @rsync:ro susan Nice! Potential backward incompatibility: usernames used to be able to start with a @ and (surprisingly,

Re: retrieve files without local dir compare

2009-10-14 Thread Paul Slootman
On Wed 14 Oct 2009, Marc Mertes wrote: Why I need that: We receive meteorological data from a remote server to a local directory (every 5 min). If the data is here, it is imported by a special software, after the import it will be deleted from that directory. The deleting can't be

Re: rsync exclude files based on filesize

2009-09-30 Thread Paul Slootman
On Tue 29 Sep 2009, Rahul Nabar wrote: Is there a way to set rsync excludes by filesize? I already do Did you look in the manpage? man rsync, search for size and the 5th hit describes it. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or

Re: LVM snapshots vs. --link-dest

2009-09-28 Thread Paul Slootman
On Mon 28 Sep 2009, Andrew Gideon wrote: The --update option is also useful in this regard? What would happen if --inplace were used but --update were not? --update only influences what files are considered for transfer, not how that transfer is performed; hence it is completely irrelevant

Re: Limit rsync running time

2009-09-17 Thread Paul Slootman
On Thu 17 Sep 2009, Fabian Cenedese wrote: Has anybody already written a bash script that would do something like that? Are there other ways? I don't want to kill all rsync processes as there might be other syncs going on. There is for example a timeout package available in Debian: Package:

Re: rsync 3.0.4 under cygwin: problems with --exclude

2009-08-18 Thread Paul Slootman
On Tue 18 Aug 2009, Alessandro Toso wrote: rsync -auv --progress --delete --delete-excluded --log-file=$LOGDIR/`date +%Y%m%d`.log --exclude from='/cygdrive/f/.bak_exclude' $SRCDIR/ $BCKDIR If this is your exact command, then you're excluding the file from='/cygdrive/f/.bak_exclude' You

Re: ssh failure due to local error

2009-08-17 Thread Paul Slootman
On Mon 17 Aug 2009, e-letter wrote: I have tried the following command: rsync -t *.txt ssh u...@remote.machine: and receive the following error: rsync: link_stat local/machinepath/ssh failed: No such file or directory (2) Does: ssh u...@remote.machine actually work to give you a

Re: exit_cleanup(code=12, file=io.c, line=609)

2009-08-17 Thread Paul Slootman
On Mon 17 Aug 2009, dhtmldude wrote: Folks, maybe one of you can help me. I've installed Rsync 3.1.0 on both the client and the server. Im using ssh, my command line follows: rsync -avc --delete -e ssh.exe -i C:\cms\PageGenerator\nasadmin_prod_rsa -vvv

Re: exit_cleanup(code=12, file=io.c, line=609)

2009-08-17 Thread Paul Slootman
On Mon 17 Aug 2009, dhtmldude wrote: I got my SSH working, turns out another process was using port 22 and VanDyke Vshell was not started. Now Its synchronized a folder but not its contents. Im not sure what to do next other than put more files in the source and see if they make it over.

Re: ssh failure due to local error

2009-08-17 Thread Paul Slootman
On Mon 17 Aug 2009, Paul Slootman wrote: I have tried the following command: rsync -t *.txt ssh u...@remote.machine: Ah, I now see a spurious ssh there. That tells rsync that you also want to transfer a file ssh, in addition to the *.txt files. Do you have a file ssh in that directory

Re: rsyncd.conf chroot yes problem with symlink-ing

2009-08-14 Thread Paul Slootman
On Fri 14 Aug 2009, alex.vladule...@csteam.ro wrote: Ok, so far the googlein' got me this : http://lists.samba.org/archive/rsync/2009-July/023532.html but it does't helps me, because the issue was that he didn't use in the config use chroot = yes, which is not my case as you can see, and i

Re: rsyncd.conf chroot yes problem with symlink-ing

2009-08-14 Thread Paul Slootman
On Fri 14 Aug 2009, alex.vladule...@csteam.ro wrote: r...@ph:~# rsync -vrulLpHEtzhi4og --copy-unsafe-links --del rsync://r...@10.99.1.1:/home/ /home receiving incremental file list symlink has no referent: /webmaster/domains/csteam.ro (in home) So what does that symlink look like on the

Re: rsync command exclude option

2009-07-24 Thread Paul Slootman
On Fri 24 Jul 2009, Kaushal Shriyan wrote: I have a question about rsync. under /etc/ha.d/ there is a directory called resource.d I want to exclude it i have /etc/ha.d/resource.d in exclude.txt when i run rsync -av /etc/ha.d 172.20.0.3:/root/ttt/ --exclude-from=exclude.txt I still see

Re: Files with / in their name....

2009-07-23 Thread Paul Slootman
On Thu 23 Jul 2009, monkeymoped wrote: Hi there - I am trying to do a site to site nightly rsync between two boxes using ssh - all of the setup steps work and everything can talk nicely etc. However, the users unfortunately have lots of files with / in the filename (eg 21/08/08.ppt etc.) -

Re: EOL (MBOX file)

2009-07-21 Thread Paul Slootman
On Tue 21 Jul 2009, Manuel Canseco Garcia wrote: Rsync removes EOL mark the end of the mbox files? I encounter this problem when copying ... No, rsync will never change anything in de files itself, they should be bit-for-bit exact copies of the original. I suspect that perhaps you're

Re: please help me using rsync efficiently

2009-07-17 Thread Paul Slootman
On Thu 16 Jul 2009, Matt McCutchen wrote: On Thu, 2009-07-16 at 15:10 +0200, Paul Slootman wrote: Once two files are hard-linked, there is The log shows symlinks (-), not hard links (=). Of course, your point stands. I wish people would be more specific when talking about links

Re: Server Reboots in Mid-Rsync

2009-07-17 Thread Paul Slootman
On Fri 17 Jul 2009, Jon Watson wrote: I know this is a long shot, but I thought I would ask. I think that if anything causes a kernel reboot, then that's more interesting for the kernel people than for the people concerned with whatever causes the reboot... Paul -- Please use reply-all for

Re: sync performance falls off a cliff

2009-07-16 Thread Paul Slootman
On Wed 15 Jul 2009, Mike Connell wrote: I'm up to 404,000 files and the total sync time doesn't seem to be falling off a cliff (yet). In my case, only about .1% of my files change, so I'm sure it isn't a rsync memory How do you come to that conclusion? Only the number of total files

Re: please help me using rsync efficiently

2009-07-16 Thread Paul Slootman
On Thu 16 Jul 2009, vven...@gmail.com wrote: The contents of the list file (passed to rsync for synchronisation) are /folder1/folder2/rep/01234018329/FSG2_PULL.txt#79GA91205KAE --- actual file /folder1/folder2/users/01234002360/my/FSG2_PULL#79GA91205KAE link

Re: --delete not working (minimal example)

2009-07-14 Thread Paul Slootman
On Tue 14 Jul 2009, Nobuko Three wrote: --delete option is not working for me. The following is a minimal example. $ mkdir box1 box2 $ touch box1/letter box2/extra $ rsync -a -vv box1/ box2/ $ rsync -a -vvv box1/ box2/ $ rsync -a - box1/ box2/ How do you expect

Re: rsync between windows Opensolaris failures

2009-07-09 Thread Paul Slootman
On Wed 08 Jul 2009, Harry Putnam wrote: But there is also a `last login' message that apparently doesn't cause any problems... since rsync works now. I see the `last login' message if I do a straight ssh ha...@harvey Do you see it with Jan-Benedict's suggestion of ssh ha...@harvey true?

Re: [rsync] include-from with different source points

2009-06-29 Thread Paul Slootman
On Mon 29 Jun 2009, GravyFace wrote: I then tried the following, thinking / would be a common denominator in the paths in my include list: sudo rsync --progress -avz --include-from=/home/gravyface/backup.list / /mnt/usbbackup/localbackup/ ...which then starts backing up the root

Re: how to keep user/group information when rsyncing to windows for restoring back to linux later?

2009-06-26 Thread Paul Slootman
On Fri 26 Jun 2009, Wei, Xiaohai wrote: I want to backup the who linux system to a windows system. The backup will not be used in windows and will only be used to restore to linux system later. So I want to know is it possible to use rsync to keep the user/group and other permission

Re: --compare-dest= dir list ?

2009-06-12 Thread Paul Slootman
On Fri 12 Jun 2009, Pierre-Vincent Ledoux wrote: for i in $LIST; do COMPAREDIR=$COMPAREDIR/mnt/bckhd01/ns200176.ovh.net/$i done OPTS=--verbose --progress --archive --hard-links --ignore-errors --delete-excluded --exclude-from=$EXCLUDES --delete --force --backup-dir=$BACKUPDIR

[adej...@debian.org: Bug#531639: rsync can end up deleting unrelated files when a directory is replaced by a symlink]

2009-06-04 Thread Paul Slootman
Please see the included debian bug report, where during a local transfer rsync (3.0.3) follows a symlink in the destination to delete a file in the source tree. At least 3.0.5 works correctly in this regard; however I can't find a changelog entry that's directly related to this. Would it be

Re: remove-source-files checking for open files?

2009-06-03 Thread Paul Slootman
in a corrupt file. I solved this with a I would solve this not using rsync, but by writing the active file in a separate directory, or by first writing to a special filename and renaming when done (like firefox adds .part to the filename while it is still downloading it). Paul Slootman -- Please use reply

Re: remove-source-files checking for open files?

2009-06-03 Thread Paul Slootman
On Wed 03 Jun 2009, Roy Sigurd Karlsbakk wrote: I would solve this not using rsync, but by writing the active file in a separate directory, or by first writing to a special filename and renaming when done (like firefox adds .part to the filename while it is still downloading it). Why not

Re: remove-source-files checking for open files?

2009-06-03 Thread Paul Slootman
On Wed 03 Jun 2009, Roy Sigurd Karlsbakk wrote: On 3. juni. 2009, at 18.16, Paul Slootman wrote: Because checking whether a process has a file open can be very costly in system resources. Not really. I'm writing some code doing this now. It will be Linux Well, it's not something to do

<    1   2   3   4   5   6   7   >