Re: --delete option

2011-08-24 Thread Eberhard Moenkeberg
: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-15 Thread Eberhard Moenkeberg
Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551 - Gesellschaft fuer wissenschaftliche Datenverarbeitung mbH Goettingen (GWDG) Am

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-12 Thread Eberhard Moenkeberg
. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551 - Gesellschaft fuer wissenschaftliche

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-11 Thread Eberhard Moenkeberg
. In my experience, re-checking the already received partial blocks takes about 3 minutes for a 4 GB partial file. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551

Re: Feature request, or HowTo? State-full resume rsync transfer

2011-07-11 Thread Eberhard Moenkeberg
Hi once more, On Mon, 11 Jul 2011, Eberhard Moenkeberg wrote: On Mon, 11 Jul 2011, Donald Pearson wrote: I am looking to do state-full resume of rsync transfers. My network environment is is an unreliable and slow satellite infrastructure, and the files I need to send are approaching 10

Re: rsync sleep

2010-06-06 Thread Eberhard Moenkeberg
if there was anything native in rsync for this type of operation. If you are concerned about giving the rest of the system some time to breathe then just nice the rsync process. nice -n 19 rsync ... etc This would not help, regarding i/o. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e

Re: rsync sleep

2010-06-06 Thread Eberhard Moenkeberg
Hi, On Mon, 7 Jun 2010, Mark Constable wrote: On 2010-06-07, Eberhard Moenkeberg wrote: Is it possible to sleep 1 second after each file is rsynced? If you are concerned about giving the rest of the system some time to breathe then just nice the rsync process. nice -n 19 rsync ... etc

Re: Odd behavior

2010-04-22 Thread Eberhard Moenkeberg
HUGE numbers of files under linux. ;) As a side note, Solaris does not seem to have this problem, presumably because the kernel handles inode/dentry caching in a different way. Thanks for your report. Really a mail to keep for future. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e

Re: Rsync / ssh high cpu load

2010-02-17 Thread Eberhard Moenkeberg
. This would not help if the high CPU load is a result of i/o wait. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel.: +49 (0)551 201-1551

Re: limiting the number of connections per client

2010-02-03 Thread Eberhard Moenkeberg
Hi, please avoid top posting. It needs reconstruction to see the history. On Wed, 3 Feb 2010, Ali, Saqib wrote: On Wed, Feb 3, 2010 at 1:40 PM, Eberhard Moenkeberg emoe...@gwdg.de wrote: On Wed, 3 Feb 2010, Ali, Saqib wrote: We have a very high utilization rsync server. We can handle large

Re: rsync email notification on success and failure + Log

2009-12-29 Thread Eberhard Moenkeberg
if [ ${MAILIT} = yes ]; then V1=is uptodate V2=is a hard link V3=^backed up V4=^deleting grep -v ${V1}\|${V2}\|${V3}\|${V4} ${PROT} | \ mail -s${SUBJ} (RC=${RC}) ${MAILTO} #else # mail -s${SUBJ} (RC=${RC}) __nomail__ ${MAILTO} ${PROT} fi Viele Gruesse Eberhard Moenkeberg (emoe

Re: Rsync with spaces in source or destination path

2009-07-04 Thread Eberhard Moenkeberg
/masanip/ACH/test\\\ file /tmp/mydir/ rsync: link_stat /tmp/test\ file failed: No such file or directory (2) Don't you see it: one / too much. Viele Gruesse Eberhard Moenkeberg (emoe...@gwdg.de, e...@kki.org) -- Eberhard Moenkeberg Arbeitsgruppe IT-Infrastruktur E-Mail: emoe...@gwdg.de Tel

Re: Conflicting timestamps in rsyncd.log

2009-03-01 Thread Eberhard Moenkeberg
Hi, On Sun, 1 Mar 2009, Matt McCutchen wrote: On Sun, 2009-03-01 at 17:21 -0800, Bill Landry wrote: I just setup my first rsyncd server and all is working well as far as file syncing goes. However, I am a bit baffled by the fact that some of the log entries in the rsyncd.log file are

Re: rsycing very small files

2009-02-28 Thread Eberhard Moenkeberg
Hi, On Sat, 28 Feb 2009, lewis butler wrote: On 27-Feb-2009, at 21:16, Daniel.Li wrote: On Fri, 2009-02-27 at 08:20 -0500, Mag Gam wrote: it works. But takes hours to do it. Was wondering if there was a faster way How much speed do u get to backup these files? Average? I would thing

Re: Rsync 3

2008-09-25 Thread Eberhard Moenkeberg
Hi, On Thu, 25 Sep 2008, Madhavan Chari wrote: We want to use the rsync 3 for incremental file transfer of our File system from one box to another, however there are about a million files to be copied, so just wanted to know by any one of your's previous experience with rsync 3, will these

Re: rsyncd performance when handling multiple clients in parallel

2008-01-25 Thread Eberhard Moenkeberg
Hi, On Fri, 25 Jan 2008, chuang liu wrote: I use rsync to transfer multiple files from several clients to a server in parallel. I am wondering how many concurrent connections the server should handle to maximize the throughput (number of bytes written to server). In an extreme case, if only

Re: rsync more than 131072 files on linux

2008-01-25 Thread Eberhard Moenkeberg
Hi, On Fri, 25 Jan 2008, Mike Frysinger wrote: On Friday 25 January 2008, Eberhard Moenkeberg wrote: On Fri, 25 Jan 2008, Sylvain Gargasson wrote: Thanks for my RAM problem, it's OK now, Dell share me 32GB of RAM. But now when I try on my showroom with a lot of files in one directory

Re: rsync more than 131072 files on linux

2008-01-25 Thread Eberhard Moenkeberg
Hi, On Fri, 25 Jan 2008, Matt McCutchen wrote: On Sat, 2008-01-26 at 05:36 +0100, Eberhard Moenkeberg wrote: On Fri, 25 Jan 2008, Mike Frysinger wrote: On Friday 25 January 2008, Eberhard Moenkeberg wrote: On Fri, 25 Jan 2008, Sylvain Gargasson wrote: sho-lnx-001:~ # rsync -av

Re: rsync more than 131072 files on linux

2008-01-25 Thread Eberhard Moenkeberg
Hi, On Fri, 25 Jan 2008, Sylvain Gargasson wrote: Thanks for my RAM problem, it's OK now, Dell share me 32GB of RAM. But now when I try on my showroom with a lot of files in one directory I have this error: sho-lnx-001:~ # rsync -av --progress --stats /mnt/source/* /mnt/destination/

Re: vanished files

2007-08-10 Thread Eberhard Moenkeberg
Hi, On Sat, 11 Aug 2007, Samuel Vogel wrote: The vanished files problem is really REALLY annoying... It renders rsync unusable for me: sent 22972933 bytes received 2399590976 bytes 310684.69 bytes/sec total size is 98068497125 speedup is 40.48 client_run2 waiting on 18377

Re: Feature request: External deletion command

2007-06-07 Thread Eberhard Moenkeberg
Hi, On Thu, 7 Jun 2007, Melmi wrote: Eberhard wrote: Filenames will stay original. rsync creates the true original directory structure (as far as needed) below the backup-dir, so no need to change filenames. I know. We misunderstood each other, I guess. Example:

Re: Feature request: External deletion command

2007-06-06 Thread Eberhard Moenkeberg
Hi, On Wed, 6 Jun 2007, Melmi wrote: it would be nice if rsync could call an external command to delete files. Than one could call a secure deletion tool like wipe, which overwrites files a few times before deleting them. Right now Im wiping personal data which I dont need anymore, but

Re: Feature request: External deletion command

2007-06-06 Thread Eberhard Moenkeberg
HI, On Wed, 6 Jun 2007, Melmi wrote: rsync will mv the files to the backup-dir (not cp). Good idea. However, wipe has some mechanism to prevent recovering of the old filename. I dont know wether it does anything else than a bunch of moves with mv. Using you solution, the filename

Re: passing rsyncd password in a script (no ssh) - how?

2007-01-10 Thread Eberhard Moenkeberg
system, a process's environment variables are only readable by its owner. However, I prefer to use a password file anyway. Environment variables are shell internals. If you do not 'export' them, not even subshells can see them. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL

Re: rsync to completely mirror an entire machine

2006-02-04 Thread Eberhard Moenkeberg
a more detailed rsync script excluding certain areas? /proc and /sys need to be excluded. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs

Re: problem with rsyncing web site

2006-01-20 Thread Eberhard Moenkeberg
added the --chmod=TWEAKS option that will allow you to specify something like this: rsync -av --chmod=Da+x,a+r src/ dest That makes sure that all dirs get +x and everything gets +r. Thanks Wayne. A long awaited improvement for mirror servers. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED

Re: Human readable output

2005-11-05 Thread Eberhard Moenkeberg
of --help. I guess some spaces in the output number would be sufficient and best. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED])-- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart

Re: Rsync over NFS mount sending whole files

2005-10-27 Thread Eberhard Moenkeberg
of your local only rsync instances has to read the entire file in order to find out that only 200 bytes are to transfer. ;-)) Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting

Re: Vanished Files issue/enhancement

2005-10-12 Thread Eberhard Moenkeberg
. This is not a race condition. rsync will continue till the end, and then just give exit code 24. It is the same with 23. So consider these exit codes as fulfilled. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org

Re: @ERROR: access denied

2005-07-13 Thread Eberhard Moenkeberg
-- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync over an NFS mount (Scanned @ Decoma)

2005-04-01 Thread Eberhard Moenkeberg
before invoking rsync. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Rsync over an NFS mount (Scanned @ Decoma)

2005-04-01 Thread Eberhard Moenkeberg
: NFS_MNT=/mnt/plantx mount | grep $NFS_MNT /dev/null if [ ! $? = 0 ]; then echo source not mounted, nothing done, exit 99 fi Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read

Re: Skipping unreadable files

2005-03-28 Thread Eberhard Moenkeberg
understand that --ignore-errors isnt what i need. I tried it anyway. You have to do it on the server side, with ignore nonreadable = true in /etc/rsyncd.conf. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman

Re: rsync -auIn not doing what I expect (rsync 2.6.3)

2005-02-04 Thread Eberhard Moenkeberg
-corrupt files) and do the checksums to determine which files need to be transferred. Why do you want to say ignore timestamps if just the corrected files have newer than the corrupt ones? Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options

Re: rsyncd.conf: timeout=minimal crazyness

2005-01-13 Thread Eberhard Moenkeberg
Hi, On Thu, 13 Jan 2005, Wayne Davison wrote: On Thu, Jan 13, 2005 at 03:47:52AM +0100, Eberhard Moenkeberg wrote: this local rsync phase may need a long long (currently very long long here) time Are you running with the --delete option? If so, switch to using the --delete-after option (which I

Timezone error with chrooted rsync version 2.6.3pre1

2005-01-12 Thread Eberhard Moenkeberg
Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

rsyncd.conf: timeout=minimal crazyness

2005-01-12 Thread Eberhard Moenkeberg
= 15000 ftp:3 03:47:16 ~ # Cheeers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Transferring Large Files w/ Rsync - Initial Xfer

2005-01-03 Thread Eberhard Moenkeberg
least should be ) -vv statistics. Look at the time parameters. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: suggestion: user delete

2005-01-01 Thread Eberhard Moenkeberg
it; or copy it somewhere to /tmp/; or whatever.) this may be easy to implement---a command-line option ---use-rm= and a system call instead of an unlink call. possible? Necessary? We already have --backup-dir= which indeed can preserve all the to be deleted files. Cheers -e -- Eberhard

Re: Mirroring directories at once

2004-12-31 Thread Eberhard Moenkeberg
the directory above and exclude what you do not want. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Mirroring directories at once

2004-12-31 Thread Eberhard Moenkeberg
Hi, On Fri, 31 Dec 2004, Paul Smith wrote: On Fri, 31 Dec 2004 23:49:28 +0100 (CET), Eberhard Moenkeberg [EMAIL PROTECTED] wrote: I would like to use the command rsync to have a perfect copy of each one of five directories and their contents. How can I do that at once? I know that I

Re: rsync to retry if copy failed - possible?

2004-12-11 Thread Eberhard Moenkeberg
behaviour? rsync has a very differentiated set of return codes. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync to retry if copy failed - possible?

2004-12-11 Thread Eberhard Moenkeberg
Hi, On Sat, 11 Dec 2004, Tomasz Chmielewski wrote: Eberhard Moenkeberg wrote: On Sat, 11 Dec 2004, Tomasz Chmielewski wrote: I want to be 100% sure that rsync copies something from one location to another. However, I did not see an option which would make rsync retry an operation

Re: SUGGESTION: rsyncing gziped source with non gziped destination

2004-12-03 Thread Eberhard Moenkeberg
quality consequences for rsyncd, and about the efforts for your special case (=none, even contrary). Add more RAM to your server and/or improve your I/O throughput. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org

Re: Database file rsync - any way to tell it to rsync against the last file?

2004-11-12 Thread Eberhard Moenkeberg
compression. Compression is a transfer option. No influence on file comparision. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart

parallelizing the two initial phases?

2004-09-07 Thread Eberhard Moenkeberg
it be possible to start bulding both databases in parallel, or shortly after each other? Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs

Re: parallelizing the two initial phases?

2004-09-07 Thread Eberhard Moenkeberg
Hi, On Tue, 7 Sep 2004, Wayne Davison wrote: On Wed, Sep 08, 2004 at 12:27:55AM +0200, Eberhard Moenkeberg wrote: Later, there are two separate threads anyways. They are separate processes that don't share memory, and sharing memory would be required to compare the two files lists after

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread Eberhard Moenkeberg
) fordblks: 142712 (bytes free) keepcost: 135048 (bytes in releasable chunk) end RC=0 040810.0100 040810.0822 Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org/mailman

Re: [Fwd: multiple rsync simlataneously]

2004-07-27 Thread Eberhard Moenkeberg
responsiveness again if you would add about 100 disk heads. If you do not like to maintain so many non-solid-state parts, you can try to add RAM to the server first. Cheers -e -- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org

Re: trigger command on successful upload?

2004-06-15 Thread Eberhard Moenkeberg
} ${SRC} ${DST} ${PROT} 21 RC=$? if test ${RC} = 0 -o ${RC} = 23; then echo normal termination. elif test ${RC} = 10; then echo no connection. elif test ${RC} = 24; then echo OK, but some file(s) vanished. fi and distinguish many more cases. Cheers -e -- Eberhard Moenkeberg

Re: [Kde-mirrors] rsync errors from rsync.kde.org

2004-06-08 Thread Eberhard Moenkeberg
-- Eberhard Moenkeberg ([EMAIL PROTECTED], [EMAIL PROTECTED]) -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html