Re: Is there a better way to transfer data that doesn't use so much cache?

2022-08-03 Thread Dan Stromberg via rsync
On Wed, Aug 3, 2022 at 5:41 PM Robin Lee Powell via rsync < rsync@lists.samba.org> wrote: > On Wed, Aug 03, 2022 at 02:04:22PM -0400, Rob Campbell via rsync wrote: > > The problem isn't that there are many syncs because the problem happens > on > > the first one that runs. > > You didn't actually

Re: Merging three slightly different directories

2022-06-07 Thread Dan Stromberg via rsync
I suspect you want a duplicate finder more than a file transfer tool. EG: https://stromberg.dnsalias.org/~strombrg/equivalence-classes.html On Tue, Jun 7, 2022 at 5:36 PM hput via rsync wrote: > I want to merge 3 slightly different directories of mostly images. > > Not just mostly but the vast

Re: Trying to elevate rsync privileges when connecting over ssh without using NOPASSWD in sudoers

2022-03-12 Thread Dan Stromberg via rsync
On Sat, Mar 12, 2022 at 12:23 PM Dr. Mark Asbach via rsync < rsync@lists.samba.org> wrote: > Hi there, hi past me, > > > My (non-working) attempt: > > […] > > So it seems the "-l" is dropped into the void letting ssh assume USER > was the target host? I don’t actually get what I can do. > > Turns

Re: Trying to elevate rsync privileges when connecting over ssh without using NOPASSWD in sudoers

2022-03-11 Thread Dan Stromberg via rsync
Why not rsync directly as root? Then you can use a passwordless, passphraseless RSA (or similar) keypair. On Fri, Mar 11, 2022 at 4:58 AM Dr. Mark Asbach via rsync < rsync@lists.samba.org> wrote: > Hi there, > > We are using ansible to deploy system configuration and web application > source cod

Re: Confused as to why rsync thinks time, owner and group of many files differ

2022-02-03 Thread Dan Stromberg via rsync
On Thu, Feb 3, 2022 at 3:50 PM Andy Smith via rsync wrote: > I am tempted to blow away the btrfs filesystem and just do xfs to > xfs, to rule out weird issues there. It would be a shame though as > I was hoping to use btrfs's compression here. > You might be able to do a partial transfer to a sm

Windows backups?

2021-12-27 Thread Dan Stromberg via rsync
Can rsync back up an NTFS using a Windows 10 kernel? So far I've had good luck backing up NTFS filesystems on a dual boot system when booted into Linux, but not when booted into Windows. I've been bitten in the past by /usr/bin/find (for EG) having problems with Windows junctions over sshfs. The

Re: BackUp with "inverse" increments

2021-10-07 Thread Dan Stromberg via rsync
rsync --link-dest is fast and simple, good stuff. I recommend using it with some sort of wrapper script for rotations, like Backup.rsync: https://stromberg.dnsalias.org/~strombrg/Backup.remote.html On Wed, Oct 6, 2021 at 7:29 AM Kevin Korb via rsync wrote: > See --link-dest. That is what makes

Re: Question about rsync -uav dir1/. dir2/.: possib to link?

2021-09-04 Thread Dan Stromberg via rsync
I was thinking --link-dest too. Sometimes this can be done with cpio too; check out the -pdlv options. On Sat, Sep 4, 2021 at 4:57 PM Kevin Korb via rsync wrote: > Rsync does almost everything cp does but since it is designed to network > it never got that feature. I was thinking maybe --link-

Re: Which method (rsync-based) is better for backing up Linux servers to Synology NAS?

2021-08-09 Thread Dan Stromberg via rsync
I suppose I may as well mention: https://stromberg.dnsalias.org/~dstromberg/Backup.remote It just does rsync snapshotting with --link-dest, and keeps the last n snapshots. It's smart enough to resume a previously interrupted snapshot. It's pretty simple - both to set up and to use. I used to us

Re: Utility of --backup

2021-07-19 Thread Dan Stromberg via rsync
In Backup.rsync, which of course is a wrapper around rsync that can be used for backups, I do not use --backup, but I do use --link-dest: https://stromberg.dnsalias.org/~strombrg/Backup.remote.html On Sun, Jul 18, 2021 at 11:13 PM Lisa via rsync wrote: > I would like some feedback about the --ba

Re: Syntax Question on 'rsyncd.conf' on Windows

2021-04-09 Thread Dan Stromberg via rsync
This is probably more of a Cygwin question than an rsync question. On Cygwin, E: should show up automatically as /cygdrive/e You can test that by opening a Cygwin terminal and cd'ing to /cygdrive/e On Tue, Apr 6, 2021 at 1:32 PM Tim Evans via rsync wrote: > Cygwin distribution of rsync for Win

Re: '--address' option on client side.

2021-03-26 Thread Dan Stromberg via rsync
ile it > handles multicat, it doesn't seem to be able to handle multiple interfaces, > if I read the docs correctly. > Am I wrong? > harry > > On Fri, Mar 26, 2021 at 12:29 PM Dan Stromberg > wrote: > >> >> Hi Harry. Are you the person I worked with at UCI a bi

Re: '--address' option on client side.

2021-03-26 Thread Dan Stromberg via rsync
Hi Harry. Are you the person I worked with at UCI a bit? Anyway, you might consider trying mrsync; it's intended to do rsync over multicast. HTH. On Fri, Mar 26, 2021 at 12:22 PM Harry Mangalam via rsync < rsync@lists.samba.org> wrote: > Spent an hour trying to find the answer to this on the v

Re: Rsync checksum issue

2020-12-15 Thread Dan Stromberg via rsync
On Tue, Dec 15, 2020 at 3:25 AM Laurent B via rsync wrote: > Dear all, > > I'm encountering a problem with one of my backup. For some files, the > checksum calculation is failing leading to the following error : > It sounds a little like a bug, but perhaps if you share the command you're using fo

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-13 Thread Dan Stromberg via rsync
On Sun, Dec 13, 2020 at 11:59 AM Wayne Davison via rsync < rsync@lists.samba.org> wrote: > I should also mention that there are totally valid reasons why the dir > might be huge on day4. For instance, if someone changed the mode on the > files from 664 to 644 then the files cannot be hard-linked t

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-10 Thread Dan Stromberg via rsync
Hi. Is it possible that, if day4 is consuming too much space, that day3 was an incomplete backup? The rsync wrapper I wrote goes to a little trouble to make sure that incomplete backups aren't allowed. It's called Backup.rsync, and can be found at: https://stromberg.dnsalias.org/~strombrg/Backup

--dry-run won't say where the files are going to go

2018-12-30 Thread 積丹尼 Dan Jacobson via rsync
Try as we may (--dry-run), it still won't tell us where it intends to put the files, $ rsync --dry-run --remove-source-files --relative --verbose --itemize-changes -Cavz Maildir/new /tmp/ sending incremental file list delta-transmission disabled for local transfer or --whole-file cd+ Mai

Re: link-dest and batch-file

2018-06-26 Thread Dan Stromberg via rsync
On Tue, Jun 26, 2018 at 12:02 PM, Дугин Сергей via rsync < rsync@lists.samba.org> wrote: > I am launching a cron bash script that does the following: > > Day 1 > /usr/bin/rsync -aH --link-dest /home/backuper/.BACKUP/009/2018-06-25 > root@192.168.1.103:/home/ /home/backuper/.BACKUP/009/2018

GPL-compatible library implementing the rsync-over-ssh protocol?

2018-06-20 Thread Dan Stromberg via rsync
Is there such a thing? I saw librsync, which appears to be the right algorithm, but not the protocol. And I saw the acrosync-library, which appears to be the protocol, but it's not GPL-compatible. Are there others? Thanks! -- Please use reply-all for most replies to avoid omitting the mailing

Re: Rsync between 2 datacenters not working

2018-03-28 Thread Dan Stromberg via rsync
18 at 12:59 AM, Marc Roos via rsync wrote: > > Kevin, Dan, Thanks for the pointers to work arounds, at the moment I am > testing with lower mtu size that seems to be working. Otherwise I need > to fall back on mounting the fs maybe even as nfs. > > > > -Original Messag

Re: Rsync between 2 datacenters not working

2018-03-25 Thread Dan Stromberg via rsync
You could try using an automounter, like autofs, in combination with sshfs. It'll be slower, possibly a lot slower, but it should be more reliable over an unreliable connection. I've been using: remote -fstype=fuse,allow_other,nodev,noatime,reconnect,ServerAliveInterval=15,ServerAliveCountMax=40

Re: [Bug 13317] rsync returns success when target filesystem is full

2018-03-05 Thread Dan Stromberg via rsync
On Mon, Mar 5, 2018 at 3:09 PM, just subscribed for rsync-qa from bugzilla via rsync wrote: > https://bugzilla.samba.org/show_bug.cgi?id=13317 > > --- Comment #6 from Rui DeSousa --- > (In reply to Rui DeSousa from comment #5) > > It looks like no error is returned and result is a sparse file. I

Re: [Bug 8512] rsync is slower than cp -- Reduce overhead to cp for transfer of large files

2014-09-09 Thread Dan Stromberg
Why not enable Jumbo Frames? http://stromberg.dnsalias.org/~strombrg/jumbo.html For NFS, you can use http://stromberg.dnsalias.org/~strombrg/nfs-test.html to get some fast settings. The script could be modified to do CIFS I suppose. HTH -- Please use reply-all for most replies to avoid omittin

Re: [Bug 10785] New: [PATCH] Add a flag to use numeric sort

2014-08-26 Thread Dan Stromberg
On Tue, Aug 26, 2014 at 10:01 AM, wrote: > https://bugzilla.samba.org/show_bug.cgi?id=10785 > >Summary: [PATCH] Add a flag to use numeric sort >Product: rsync >Version: 3.1.1 > Platform: All > OS/Version: All > Status: NEW >

Re: Concern: rsync failing to find some attributes in a file transfer?

2014-07-26 Thread Dan Stromberg
On Fri, Jul 25, 2014 at 11:35 PM, Kevin Korb wrote: >> I just moved my home partition to a new harddisk w/more space. > > Home Partition? Are we in 1995? Why would you have a partition > mounted anywhere other than /boot ? That's a bit harsh, particularly considering that having a /home partiti

Re: increasing the write block size for high latency

2014-07-26 Thread Dan Stromberg
On Tue, Jul 8, 2014 at 8:07 AM, Adam Edgar wrote: > It seems the issue is indeed in the ssh layer. scp has the same issue and > some work has been done in “fixing” that: > > http://www.psc.edu/index.php/hpn-ssh > > From the papers abstract: > > SCP and the underlying SSH2 protocol impleme

Re: Changing permissions on existing backup source

2014-01-02 Thread Dan Stromberg
First off, thanks much for your suggestions. On Thu, Jan 2, 2014 at 6:19 PM, Kevin Korb wrote: > First, a new column for the old cp -al then rsync on top of it method > that --link-dest mostly replaced. It is slower since all the hard > links get made and then some get replaced or deleted but it

Re: Changing permissions on existing backup source

2014-01-02 Thread Dan Stromberg
On Wed, Jan 1, 2014 at 10:09 AM, Charles Marcus wrote: > If I change the permissions on the source maildirs, will this cause > everything to be transferred again? Meaning, will rsync see everything as > 'modified', thus creating a new copy of the entire mail store on the backup > target? > > Or wi

Re: rsync seems to overwhelm a failing hard disk

2013-11-26 Thread Dan Stromberg
On Mon, Nov 25, 2013 at 1:41 PM, Chris Dennis wrote: > Hello rsync people > > Today I was recovering data from a beginning-to-fail external USB hard > disk. > > I started with my usual 'rsync -av --ignore-errors ', and > that was fine until it got to the first I/O errors. It paused but > continu

Re: Rsync hanging, even with timeout and contimeout specified

2013-11-12 Thread Dan McGee
On Sat, Nov 9, 2013 at 12:58 PM, Wayne Davison wrote: > > On Fri, Nov 8, 2013 at 6:47 AM, Dan McGee wrote: > >> $ strace -f rsync --contimeout=10 --timeout=10 rsync:// >> mirror.aarnet.edu.au/archlinux/lastsync /tmp/hanging-lastsync >> [...] >> >> write

Rsync hanging, even with timeout and contimeout specified

2013-11-08 Thread Dan McGee
Here's the details and some debugging I did for starters, but I have no idea where to proceed from here. Help please? Command to reproduce should be in the strace output below. -Dan P.S. Sorry for sending this a few times; I think only one will make it through to the list since I w

Announce: Tool for replicating filesystem changes

2013-06-03 Thread Dan Shearer
vement would be to extract the data to be shipped by using 'zfs snapshot ...' commands, or 'btrfs send ...' to the extent that btrfs works today. But that brings us back to filesystem and operating system dependencies again. This could be an interesting extension, and

Re: collecting the differences between a local host and remote archive to third local location (a usb device)

2012-10-11 Thread Dan Stromberg
I wonder if rdiff would do this nicely...? http://librsync.sourcefrog.net/doc/rdiff.html On Thu, Sep 27, 2012 at 12:33 AM, Benjamin Ward wrote: > > Hi everyone, > > I'm trying to archive to a remote host but the size of the data to copy is > prohibitively large to consider doing the sync over th

Re: Time rsYnc Machine (tym)

2012-08-09 Thread Dan Stromberg
list that aren't really hardlinks - the goal is chiefly to dramatically cut down on the storage requirements, and avoid a large sort() or O(file_count) hash table. That's where the "filter" part of the name comes from - it's filtering the count of the objects of interest down to a mo

Re: Time rsYnc Machine (tym)

2012-07-28 Thread Dan Stromberg
Ah. Not being interactive is important for running in cron; I believe stdin will probably immediately EOF. But redirecting stdout and stderr is unnecessary - the output just goes to a cron e-mail with most cron's. Sometimes it's better to redirect to a file, but that's more of a user preferen

Re: Time rsYnc Machine (tym)

2012-07-28 Thread Dan Stromberg
On Sat, Jul 28, 2012 at 3:48 AM, M. Carrasco wrote: > 3. Cron > It can run properly run from cron as it is demonized. > What's this about? I've never had problems running run of the mill scripts from cron, once the environment is adequately replicated. > "--hard-links" is not used and there is

Re: rsync hanging after working reliably for years on one of my shares

2012-07-13 Thread Dan Stromberg
On Fri, Jul 13, 2012 at 1:21 PM, Rob J. Caskey wrote: > Howdy all, > > ** ** > > I’m using rsync in conjunction with backuppc and have been backing up this > share without incident for almost 3 years and it has decided to go and hang > on me. Other shares on the same machine sync fine with id

Re: rsync based on checksum only

2012-07-07 Thread Dan Stromberg
On Sat, Jul 7, 2012 at 4:15 PM, Henri Shustak wrote: > > > Wow! Thanks for making it so easy. I will try that asap. > > If you do not have any luck with the patched version of rsync there are > various projects which spring to mind which offer this kind of > functionality. > For backups, not re

Re: Rsync takes long time to finish

2012-04-12 Thread Dan Stromberg
I've heard lots of good suggestions already - another thing that I've not seen mentioned is, upgrading your kernel may help. Somewhere shortly before kernel 3.0, pathname lookups got noticeably faster. You could also try an alternative filesystem like xfs. It's supposed to be pretty good at larg

Re: incremental backup to nas server

2011-12-29 Thread Dan Stromberg
This is perhaps more a matter of which rsync wrapper you choose, than rsync itself. rsync provides just enough functionality to enable this kind of behavior, if your wrapper feeds it the right directories to work on. I used to use my Backup.rsync wrapper to get good resumption of interrupted back

Re: Use rsync's checksums to deduplicate across backups

2011-11-20 Thread Dan Stromberg
On Sun, Nov 6, 2011 at 2:29 PM, Dan Stromberg wrote: > > http://stromberg.dnsalias.org/~strombrg/backshift/documentation/comparison/index.html > I've updated the above URL to include a comparison against Lessfs and git wrappers. The table has also become easier to navigate re

Re: Use rsync's checksums to deduplicate across backups

2011-11-19 Thread Dan Stromberg
On Sat, Nov 19, 2011 at 5:43 AM, Andrea Gelmini wrote: > 2011/11/3 Alex Waite : > >Recently I learned that rsync does a checksum of every file > > transferred. I thought it might be interesting to record the path and > > checksum of each file in a table. On future backups, the checksum of >

Re: Use rsync's checksums to deduplicate across backups

2011-11-06 Thread Dan Stromberg
On Thu, Nov 3, 2011 at 7:22 AM, Alex Waite wrote: > > > > Check out http://backuppc.sourceforge.net/, it's perl-based backup tool, > > using rsync and doing exactly what you ask for. > > > I have looked at BackupPC before (and it is a nice piece of > software), and it does hardlink across all

Re: Rsync with direct I/O

2011-09-04 Thread Dan Stromberg
Direct I/O (assuming you mean O_DIRECT on open) can be a bit fiddly, but I doubt it's out of reach. The main difficulty is allocating a buffer with appropriate alignment. I put together a library to facilitate O_DIRECT I/O a while back: http://stromberg.dnsalias.org/~dstromberg/odirect/ odirect

Graphical rsync --link-dest frontends?

2011-08-16 Thread Dan Stromberg
What are people's favorite rsync --link-dest frontends? Why? I personally want something based on GTK+ and/or HTML, with scheduling, but I don't necessarily want to limit the discussion to frontends with these attributes. Here's a list of some of them, but I doubt it's very complete: http://www.

synchronization for many notebooks

2008-11-20 Thread Dan Letkeman
books, but syncing the files according to date. Also, is there a way for the notebook to "monitor" the local directory so when they save a file on there notebook that it gets sent immediately to the mapped drive on the server? Thanks, Dan. -- Please use reply-all for most replies to avo

Forcing a transfer to be one-way from the daemon side?

2008-05-07 Thread Dan Mahoney, System Admin
ax or command switch that says "let them transfer anything down, but not up?" I didn't find anything in the man pages, and the filters didn't seem to be for this kind of thing. -Dan -- Christ almighty... my EYES! They're melting! -Zaren, Efnet #macintosh, in response

Re: transfer stats wrong?

2008-04-12 Thread Dan Letkeman
Matt, Those commands didn't seem to make any changes. Any other ideas? Dan. On Sun, Mar 30, 2008 at 11:12 PM, Matt McCutchen <[EMAIL PROTECTED]> wrote: > > On Sun, 2008-03-30 at 22:34 -0500, Dan Letkeman wrote: > > I have a set of files on my laptop running xp. I'

web site suggestion

2008-04-10 Thread Dan Pritts
ld be cool. thanks! danno -- Dan Pritts, Sr. Systems Engineer Internet2 office: +1-734-352-4953 | mobile: +1-734-834-7224 Be part of the future! 2008 Internet2 Strategic Planning http://www.internet2.edu/strategicplanning -- To unsubscribe or change options: https://lists.samba.org/mailman/list

transfer stats wrong?

2008-03-30 Thread Dan Letkeman
ent 839730 bytes received 1094786 bytes 19639.76 bytes/sec total size is 350713189 speedup is 181.29 And when I run it a second time without changing any files it says exactly the same thing. Why is it still transferring 2119 files and why does it say that it received 1094786 bytes? Thanks, D

Re: CVE-2007-4091

2007-09-04 Thread Dan Pritts
for the record, in case anyone else is looking, Redhat claims that their systems are not vulnerable. https://bugzilla.redhat.com/show_bug.cgi?id=CVE-2007-4091#c1 On Thu, Aug 30, 2007 at 11:12:08AM +0200, Paul Slootman wrote: > On Thu 30 Aug 2007, [EMAIL PROTECTED] wrote: > > Thu, 30 Aug 2007 01

CVE-2007-4091

2007-08-29 Thread Dan Pritts
http://nvd.nist.gov/nvd.cfm?cvename=CVE-2007-4091 thanks as always to wayne & the other contributors for great software. danno -- Dan Pritts, System Administrator Internet2 office: +1-734-352-4953 | mobile: +1-734-834-7224 Internet2 R&E Network Members Community, connected. http://www

O_DIRECT

2006-07-23 Thread Dan Stromberg
It'd be pretty cool if rsync supported use of O_DIRECT on platforms that support it, with or without my odirect package: http://dcs.nac.uci.edu/~strombrg/odirect/ I say this because rsync is sometimes used to move a mountain of data, just once. So there's little point in rsync toasting one's bu

Re: rsync shows poor throughput vs. scp

2006-05-30 Thread Dan Pritts
t the -z. If it *is* trying to compress that could easily explain the slow speed of your transfers. danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting,

Re: rsync a raw device

2006-03-14 Thread Dan Pritts
On Tue, Mar 14, 2006 at 11:22:32AM +0100, Jan-Benedict Glaw wrote: > On Mon, 2006-03-13 17:42:18 -0500, Dan Pritts <[EMAIL PROTECTED]> wrote: > > I'd like to mirror this data store to a remote location for DR purposes. > > ideally the target would be a raw device as

rsync a raw device

2006-03-13 Thread Dan Pritts
problem if that's not possible. Obviously, the filesystems would need to be unmounted while doing the sync. thanks danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mailman

Re: ssh protocol 2

2006-01-04 Thread Dan Pritts
imelb.edu.au/help/rsync/binaries/ but these do not > support protocol 2. Thanks, > > Ken Senior > > -- > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html dan

Re: Mutual rsync and version control

2005-12-13 Thread Dan Pritts
, > rsync will automatically merge 2 versions like cvs does. pretty sure not. danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync IPC error

2005-12-13 Thread Dan Pritts
k like the old version. There's probably a compile time option for this too. danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

list files to delete, rather than deleting them with --delete?

2005-11-16 Thread Dan Crosta
I'm trying to design a daily backup system based on rsync that will keep deleted files for N days after they went missing, and am wondering if there's a way I can coax rsync to give me a list of files that are missing on the source relative to the destination, so that they can be later deleted (ie

Re: request: add TCP buffer options to rsync CLI?

2005-11-07 Thread Dan Pritts
hat larger TCP buffers use more kernel memory, so there's possibility of DoS due to that. danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before

Re: whether rsync supports resource fork or any alternative

2005-10-10 Thread Dan Pritts
; https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: https://lists.samba.org/mail

Re: how to rsync automaticly after changing a file

2005-08-16 Thread Dan Pritts
On Mon, Aug 15, 2005 at 10:21:02AM +0200, Arne Lipfert wrote: > > hey all, ich want to use rsync, to synchronise my both computers. but is it > possible to run the daemon, that it always looks at my specified folder and > when i'm changing a file, it will automaticly rsync that file?? or do i >

Re: meta data stored in separate file?

2005-08-09 Thread Dan Pritts
gt; code. > > -- > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224

Re: Copy all local filesystems, but ignore NFS mounts?

2005-08-03 Thread Dan Stromberg
On Wed, 03 Aug 2005 15:53:06 -0700, Wayne Davison wrote: > On Wed, Aug 03, 2005 at 03:27:13PM -0700, Dan Stromberg wrote: >> skipping directory /. > > You didn't specify -r, so it's skipping all directories. See also -a. Doh! I know better than that. Dumb mista

Re: Copy all local filesystems, but ignore NFS mounts?

2005-08-03 Thread Dan Stromberg
On Wed, 03 Aug 2005 16:30:28 -0400, Keith Warno wrote: > * <[EMAIL PROTECTED]> [03/08/2005 1531EDT]: >> On Wed, 03 Aug 2005 14:15:36 -0400, Keith Warno wrote: >> >> > * <[EMAIL PROTECTED]> [02/08/2005 2008EDT]: >> >> >> >> What's the easiest way, with rsync, to back up all local filesystems to >

Re: Copy all local filesystems, but ignore NFS mounts?

2005-08-03 Thread Dan Stromberg
On Wed, 03 Aug 2005 14:15:36 -0400, Keith Warno wrote: > * <[EMAIL PROTECTED]> [02/08/2005 2008EDT]: >> >> What's the easiest way, with rsync, to back up all local filesystems to >> another host, ignoring anything on an NFS volume. >> >> For example, is there a way of giving a list of mount poin

Copy all local filesystems, but ignore NFS mounts?

2005-08-02 Thread Dan Stromberg
What's the easiest way, with rsync, to back up all local filesystems to another host, ignoring anything on an NFS volume. For example, is there a way of giving a list of mount points but still have --one-file-system work? Thanks! -- To unsubscribe or change options: https://lists.samba.org/ma

Re: Confusion regarding rsync vs. rsyncx

2005-06-01 Thread Dan Pritts
ly likely in my current environment)? > > Thanks for any insight into this... > > Andrew > > -- > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html danno

Log Summary

2005-05-28 Thread dan tran
Hello every one, I would like to understand the summary of my sync log (below) sent 2268 bytes received 1674253 bytes 372560.22 bytes/sec total size is 301413395 speedup is 179.79' Does mean my received rate is ~ 372K/sec? Total local mirror size is ~300M? What is speedup? Thanks -- To

Re: Possible bug not deleting files [SOLVED]

2005-05-28 Thread dan tran
hanks -Dan -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

data recovery and rsync, among other things

2005-05-27 Thread Dan Stromberg
I've been trying to extract some of my clients' data from a flakey lustre filesystem, and as a result, took some time to write up a page about pulling data out of a semi-crashy filesystem. The page includes a variety of ways of doing so, those ways including but not being limited to rsync and a p

the second time rsyncing a readonly file

2005-04-24 Thread Dan Jacobson
Like nifteaux (nifto) man, all I did was change the sleep time and I get different results: $ touch u; sleep 0;touch v; chmod 0 v; rsync u v; ls -og u v; /bin/rm -f u v -rw-r--r-- 1 0 2005-04-25 00:05 u -- 1 0 2005-04-25 00:05 v $ touch u; sleep 1;touch v; chmod 0 v; rsync u v; ls -og u

I already used --recursive

2005-04-23 Thread Dan Jacobson
In /usr/share/doc/rsync/README.gz: BUG REPORTS --- If you have web access then please look at... Well what if you don't have web access? You don't mention what to do then. "Send bugs to rsync@lists.samba.org" probably. OK. Will do. Here's one now: $ rsync -avz debian.linux.org.t

http://samba.anu.edu.au/ftp/rsync/rsync-2.6.4.tar.gz corrupted ?? [EOM]

2005-04-22 Thread dan tran
my winzip rejects it -D -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync - missing one or more directories?

2005-03-17 Thread Dan Stromberg
On Thu, 17 Mar 2005 13:04:03 -0800, Dan Stromberg wrote: > > I am running: > > + cd /oas > + rsync -a --rsh=/usr/bin/ssh --rsync-path=/dcs/packages/gnu/bin/rsync > --progress [EMAIL PROTECTED]:/oas . > > ...and I can see that it sometimes transfers some files, how

rsync - missing one or more directories?

2005-03-17 Thread Dan Stromberg
I am running: + cd /oas + rsync -a --rsh=/usr/bin/ssh --rsync-path=/dcs/packages/gnu/bin/rsync --progress [EMAIL PROTECTED]:/oas . ...and I can see that it sometimes transfers some files, however, it appears to be consistently missing this directory: /oas/projects/pers/oct2004 What might cause

Re: rsync creating 0-length files?

2004-12-01 Thread Dan Stromberg
On Wed, 2004-12-01 at 01:04 -0600, John Van Essen wrote: > On Tue, 30 Nov 2004, Dan Stromberg <[EMAIL PROTECTED]> wrote: > > > > We were doing a roughly 1 terabyte transfer, and upon running a python > > script to verify the integrity of the transfer, we discovered

Re: rsync creating 0-length files?

2004-11-30 Thread Dan Stromberg
On Tue, 2004-11-30 at 12:45 -0800, Wayne Davison wrote: > On Tue, Nov 30, 2004 at 12:10:05PM -0800, Dan Stromberg wrote: > > Is there any precedent for rsync creating 0 length files that should've > > had content in them? > > Are you using 2.6.3? Older rsync versions d

rsync creating 0-length files?

2004-11-30 Thread Dan Stromberg
Is there any precedent for rsync creating 0 length files that should've had content in them? IE, has anyone ever seen this before? We were doing a roughly 1 terabyte transfer, and upon running a python script to verify the integrity of the transfer, we discovered a small number of files that wer

man page: -u: mention when the dates are the same

2004-11-29 Thread Dan Jacobson
On the man page it says -u, --update This forces rsync to skip any files for which the destination file already exists and has a date later than the source file. Mention the case when the dates are the same. Paste error: --size-only Normal

Re: Copying from one networked filesystem to another

2004-11-23 Thread Dan Stromberg
On Tue, 2004-11-23 at 15:00 -0800, Dan Stromberg wrote: > What sorts of options might I give to rsync, to optimize transferring > data from one networked filesystem to another? > > Transferring directly between the fileservers is not an option in this > case, for technical rea

Copying from one networked filesystem to another

2004-11-23 Thread Dan Stromberg
What sorts of options might I give to rsync, to optimize transferring data from one networked filesystem to another? Transferring directly between the fileservers is not an option in this case, for technical reasons. What sorts of options (or system modifications) might I use to help rsync get t

Re: Excluding old files

2004-11-15 Thread Dan Pritts
exclude.list.$$ rsync --exclude-from=/tmp/exclude.list.$$ danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~es

Re: rsync being remotely nice?

2004-11-15 Thread Dan Pritts
tried using --rsync-path='nice rsync' and it worked fine for me. Of course, the real problem with your db server's load might be disk I/O - in which case nicing rsync won't help at all. danno -- dan pritts - systems administrator - internet2 734/352-4953 office7

Re: Copying Oracle data files

2004-11-12 Thread Dan Pritts
a day's worth of changes in a couple minutes over a 33.6 modem connection. danno -- dan pritts - systems administrator - internet2 734/352-4953 office734/834-7224 mobile -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync through high latency connection

2004-11-12 Thread Dan Pritts
into sub-directories and > run separate rsync jobs on those at the same time. You might find (all > depends on your latency) that if you have a 1.5Mbs pipe, then you get a > max of 0.3Mbs for a single rsync job. But if you run 4 rsync jobs > simultaneously, you get 1.2Mbs. YMMV >

What does this mean: "ERROR: The remote path must start with a module name"

2004-11-02 Thread Dan Livney
/panpci/oracle/.ssh/id_dsa' [EMAIL PROTECTED]::/panpci/arch /sanpci/arch/PANPCI ERROR: The remote path must start with a module name What does this error mean, what am I doing wrong?? Thanks, Dan Livney Mi-Services Group -- To unsubscribe or change options: http://lists.samba.org/mailman/l

8 bit filenames?

2004-10-27 Thread Dan Stromberg
Are there any characters that can occur in filenames that will choke rsync? We're transferring lots of data, and some of our users' filenames appear to have their high bit set. I don't expect it to cope with filenames having a \0 or / in them (sometimes created over appletalk shares - strange bu

Re: rsync recopying files it shouldn't?

2004-10-26 Thread Dan Stromberg
On Tue, 2004-10-26 at 16:15, Wayne Davison wrote: > On Sun, Oct 24, 2004 at 10:46:01AM -0700, Dan Stromberg wrote: > > We're copying from 3 NFS mounts of 3 GFS volumes, into 1 NFS mount of > > 1 Lustre volume. > > Since you're merging 3 sources into one destinati

rsync recopying files it shouldn't?

2004-10-24 Thread Dan Stromberg
errors, but on the recopying of what should be immutable files)? Or could it mean that our source or destination filesystem(s) have data integrity problems? Thanks! -- Dan Stromberg DCS/NACS/UCI <[EMAIL PROTECTED]> -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/

Re: Progress bar

2004-10-04 Thread Dan Pritts
baz.c 65% |* | 13849 KB00:01 With all three lines updating frequently. danno -- dan pritts systems administrator internet2 -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: Progress bar

2004-09-27 Thread Dan Stromberg
an estimate of how much work will need to be done > (perhaps based on file-size differences as a crude estimate). Such a > pre-pass would slow down rsync, so it's not something that would be > universally useful (probably only for smallish sets of files over a slow > net connec

Re: Rsync diff mode (again)?

2004-09-17 Thread Dan Bolser
One thing I liked about rsync was that I could use it right away with only the rsync --help option. I will try to get unison going, or get going with unison. I wonder why I hate learning new things these days. Cheers, Dan. On Thu, 16 Sep 2004, Wayne Davison wrote: >On Tue, Sep 14, 2004 at

Rsync diff mode (again)?

2004-09-14 Thread Dan Bolser
ready been answered, but doing the following... http://www.google.com/search?q=site%3Ahttp%3A%2F%2Flists.samba.org+rsync+diff Turns up around 1600 hits. Thanks very much for any information you can give, All the best, Dan. -- To unsubscribe or change options: http://lists.samba.org/mailman/list

large blocksize for transferring files from one filesystem to another on the same disk?

2004-09-07 Thread Dan Stromberg
I see over double the throughput on an AIX system (1M vs 64K). Thanks. -- Dan Stromberg DCS/NACS/UCI <[EMAIL PROTECTED]> signature.asc Description: This is a digitally signed message part -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before pos

Re: Compile error on cygwin

2004-09-02 Thread Dan Bolser
On Thu, 2 Sep 2004, Greger Cronquist wrote: > > >Dan Bolser wrote: > >>$ uname -a >>CYGWIN_NT-5.1 GENUS 1.3.15(0.63/3/2) 2002-11-06 22:41 i686 unknown >> >> >> > >You are using an *ancient* version of cygwin, do consider to update it >(www.cyg

Compile error on cygwin

2004-09-02 Thread Dan Bolser
, so any help you could offer a novice would be greatly appreciated. $ uname -a CYGWIN_NT-5.1 GENUS 1.3.15(0.63/3/2) 2002-11-06 22:41 i686 unknown Thanks, Dan. -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

test

2004-09-02 Thread Dan Bolser
hello? -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync and tunneling via ssh

2004-08-26 Thread Dan Pritts
On Thu, Aug 26, 2004 at 05:48:42PM +0200, Jean-Gabriel Duquesnoy wrote: > Hi Dan, > > thanks for your hint, i am now one step further, I get the following error now: > > Received disconnect from xxx.xxx.xxx.xxx: 2: fork failed: Resource temporarily > unavailable Have you verif

  1   2   >