Re: rsync takes way too long to perform this....

listing into memory first, so could that be related to your problem instead? i.e. if scp can copy the files fine, then it can't be a ext2/reiserfs problem... -- Cheers Jason Haar Information Security Manager Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417

Re: rsync 2.5.0 released [BROKEN RPM]

spec file. Just copy "rpm -ba rsync.spec" to build. Thanks for the 2.5.0 work guys! -- Cheers Jason Haar Information Security Manager Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 Summary: Program for efficient remote updates of files. Name: rsync Version: 2

Prefs for rsync of ssh or stunnel?

7;s just a "pure" SSL transport layer with nothing else to worry about, whereas sshd implies accounts with password/access management,etc,etc. -- Cheers Jason Haar Information Security Manager Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417

Re: rsync default handling of permissions

used by the client, the server controls the permissions; explicitly ensuring the permissions are always set to that value (setting the umask before starting rsync doesn't do the same thing, as this should be settable at the module level). At the moment doesn't there seem to be a bit too much

Re: Keep one BIG file in sync

flushed to disk? [If you're talking M$ Windows - this just won't be possible BTW - ever hear of locking? ;-)] -- Cheers Jason Haar Information Security Manager Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 -- To unsubscribe or change options: http://lists.samba.or

Re: Keep one BIG file in sync

l that happens, all I/O is local... BTW: if this is an Exchange server being talked about, NEVER, EVER, TOUCH AN EXCHANGE DATABASE WHEN IT'S RUNNING. You *will* crash it. I know: I did :-) [Apparently it's a feature...] -- Cheers Jason Haar Information Security Manager Trimble Naviga

Feature Request: --update-whole-if-changed?

nd carry on in whole-file mode for the rest of that file. It could really save on CPU and network cycles if you have a lot of compressed files to sync... Just a thought... -- Cheers Jason Haar Information Security Manager Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 -- To

Here's a Redhat .spec file for 2.5.4

The rsync.spec file within the rsync tar package is still broken, so here's a working rsync.spec file. Simply (as root) copy rsync-2.5.4.tar.gz into /usr/src/redhat/SOURCES then run "rpm -ba rsync.spec" to produce rsync-2.5.4-1.i386.rpm -- Cheers Jason Haar Information S

Re: Future RSYNC enhancement/improvement suggestions

; rsync generates subtree checksums (no network traffic) [quick] 5> rsync transmits files ...etc That would send a little bit more network traffic, but will it take up less total dialup time? I don't know... [guess it's time for a DJB saying: "don't speculate - evaluate!"

Re: Largest file system being synced

sing the likes of RAID'ed-NBD, CODA or Intermezzo for a similar effect? The NBD (network block device) looks interesting, it allows you to mount a remote raw partition - so you can effectively RAID over the network. Supports transaction logs too (which would be necessary in a rsync-style role)

Re: Replace local linux OS with rsynced linux OS?

db* partitions. Then when booted under dev, you can mount the production partition under "/mnt" and rsync the live system onto it, etc. ...should work :-) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2

rsync for windows doesn't like "--rsh"?

old Unix guy out on Windows? :-) Thanks -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Please use reply-all for most replies to avoid omitting the mailing list.

Re: rsync for windows doesn't like "--rsh"?

t the same thing doesn't work under Windows. (BTW it's "openssl s_client" - which acts as a I/O pipe. I have also tried socat - same problem) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E 0407 C9A6 CAF

Re: Smoother bandwidth limiting

27;d say leave it be. If anyone has issues with it, then THEY can do network rate-limiting :-) Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- To unsubscribe

Re: Feature request: case insensitivity

t; > platforms (Windows), the drivers make all filenames uppercase, whereas > > on others (linux, mac) all the filenames are lowercase. What's wrong with using "check=relaxed" when mounting the fat partition? Doesn't that help (see "man mount") -- Cheers J

Re: open files

ses locks to the SMB client... -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- To unsubscribe or change options: http://lists.samba.org/mailman/listinfo/rsync

Re: open files

col defintely passes any locking issues onto the SMB client (Linux in your case) - so if it's locked under Windows, then it's locked under Linux... -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E

Re: Win32 and Backing up open files

databases as files - even when they are in use. Whether that's a good idea I leave for others to discover the hard way... ;-) Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C06

How do you properly use "--partial"?

us... I would have thought "--partial" could have been written so that any partially transmitted file could be kept in a dir separate from the real data, and when the transfer successfully finishes, renamed/copied into the live area... Am I missing something obvious here? -- Cheers

Re: trigger command on successful upload?

src_dir remote:dst_share ssh remote "/usr/local/bin/cleanup" what's the difference? -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- To unsubscri

Re: rsycnc copies all files

l data transfers over the (much slower) WAN. Does the "reading" of files in "rsync -a" mode really have that massive an impact for rsync-over-WAN? BTW: what would be the best way of running rsync for such an environment? We currently just do "rsync -az src_dir/ remote::xx

Re: Rsync Performance

and ssh to move-on-completely - but that is definitely a kludge and assumes you have (or want!) ssh access onto the rsync server. -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C

Re: Rsync Performance

On Thu, Jul 22, 2004 at 07:33:21PM -0700, Wayne Davison wrote: > On Fri, Jul 23, 2004 at 02:15:04PM +1200, Jason Haar wrote: > > is there any intention of a "new improved" "--partial" option whereby > > any failed uploads are kept as temp files > > I had

Slightly OT: how to best rsync smbmount'ed Win2K data

(Ads/11676 1?6 Ag ad 7.99): No such file or directory (2) Has anyone figured out how to fix this? I've tried smbmount options like "unicode" and "codepage=utf8" - but they don't fix anything. I have tried this under Redhat7 through Fedora Core 2... Thanks! -- Cheers

Re: rsync through high latency connection

Wayne Davison wrote: On Fri, Oct 29, 2004 at 07:03:43PM -0700, Rudy Moore wrote: I noticed in the feature list that rsync pipelines file transfers to minimize latency - does this only affect transfer of large numbers of files? It should be true of any transfer, but I'd estimate that the rou

Re: Copying Oracle data files

Tauya Mhangami wrote: Can I copy an Oracle database by just copying that Oracle Database datafiles and moving them to another server with oracle? If possible can one back up a database using this same method. Why don't you try it and see? I don't think it'll work reliably. As you are running Ora

is support for non-ASCII filenames in rsync complete?

issues? eg I shouldn't have to use the "--iconv" option (all this language-specific stuff gives me a headache ;-) Thanks -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8

Re: is support for non-ASCII filenames in rsync complete?

are what you want. I didn't mention I have already done that for some random filenames I created and it's fine. But I certainly didn't do it for every language combination. There just seems to be enough historical noise around this issue that it was worth asking. -- Cheers Jason Haar I

Re: recent discussion regarding 'checksums'

6 and ignore the problem for another 10 years ;-) [sometimes more options isn't a good idea...] -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Pleas

Re: rsync as a deliberately slow copy?

ot;--bwlimit". Also, you could try "nice" to lower the priority rsync runs at -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Please

Re: rsync and encryption

role separation: it allows our security group to use the server group infrastructure for backups/storage, without giving them access to the data... Jason -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E

Re: sync prob with big files

x27;s a problem with one of the CIFS mounts? Jason -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Please use reply-all for most replies to avoid omitt

Re: Low performance

did you try scp (although that could be CPU-bound due to crypto), ftp or wget - ie see how other TCP apps do the same job? If they all show the same speed - it's not an rsync problem -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax:

Re: How does rsync file verification work?

but it will ensure you have confirmed the copy is precisely what it says it is (I am ignoring filesystem/hardware caching of course) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F

Re: Cache file list in daemon mode?

st update those against the gluster service? -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubs

Re: Is the --sparse option suitable for .dbf files

but will a sparse file copied somewhere by rsync NOT using the "--sparse" option be 100% equivalent to the original? -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Ple

Re: rsyncssl

backing up laptops over the Internet: an enterprise competitor to all those cloudy services such as Dropbox/etc. :-) [well, probably need that VSS patch for rsync-win32 too ;-)] -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E

Re: Announce: Tool for replicating filesystem changes

Hi there That looks very interesting, but can I make suggestion? Don't call it "should". That simply means no-one will ever be able to find it using a search engine. :-) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerp

Re: Native Parallelization in rsync

ite in another country, and can never get more than (say) 5Mbs. Parallelizing the data transfer could easily push that up to 20-30Mbs ...and there is a "competitor" to rsync that does this - bbcp. Mirror a directory from hostA to hostB using 'N' tcp streams. Runs like the clappe

Re: Native Parallelization in rsync

should - typically there's other traffic that also needs to co-exist and such a hammering would have consequences - things have to be thought through. It would be nice to have the ability, but that doesn't mean everyone would use it all the time -- Cheers Jason Haar Information Security

Re: [Bug 5124] Parallelize the rsync run using multiple threads and/or connections

actually got 80-90Mbs byt itself for all I know) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +1 408 481 8171 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- Please use reply-all for most replies to avoid omitting the mailing list. To un

Re: rsync replacement

he throughput of single streamed transactions? If so, how would you manhandle rsync (a TCP app) to be able to use them? Any such thing as a TCP-to-SCTP proxy? -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9

Re: Which rsync version?

that the initial "file listing" command is "nearly" compressed and so doesn't need it. However, in my totally unscientific test I just sniffed a transfer, extracted the file listing data, and compressed it with gzip. Knocked 66% off the size...) -- Cheers Jason Haar Infor

Re: PST Rsync Issues

d rsync won't see linear changes in them like it can in text files/etc. (hope there's nothing too incorrect in the above. I'm sure someone will shout at me if I'm wrong ;-) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 F

Re: crypting remote data

We NFS mount a share that is backed up, "encfs" over that mountpoint, and then backup onto the encfs. The end NFS share ends up with fully encrypted filenames and data. It's no good to anyone without the key... -- Cheers Jason Haar Information Security Manager, Trimble Navigati

increasing throughput over slow-but-fat WAN links?

c -nv" first and sorting the output, then splitting into "X" separate jobs? Even a rough guess at it could make a difference. -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B

Re: mirror combined with 7 day incremental backup

There's also rsnapshot. Defaults to hourly and 7-day rolling backups, using hard-links to save diskspace (i.e. if files haven't changed from one run to the next). Saves a tonne of diskspace :-) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 96

Re: request: add TCP buffer options to rsync CLI?

Lawrence D. Dunn wrote: > > Renater was using rsync to pull large amounts of data from FermiLab > across a fast, > long link, and was getting poor throughput (~20mbits/sec). Man - I wish I had your problem ;-) -- Cheers Jason Haar Information Security Manager, Trimble Na

Re: request: add TCP buffer options to rsync CLI?

use that might help in our high speed, high latency environment? Thanks! -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- To unsubscribe or c

sctp support for rsync?

is due to that. We have fat pipes and yet a single rsync session cannot saturate it due to the latency. I'm wondering if SCTP could help? (I'm guessing it would as running multiple copies of rsync in parallel also "fixes" our problem) -- Cheers Jason Haar Information Secur

Re: sctp support for rsync?

gregated bandwidth available to single sessions - because that means users and apps (such as rsync) would experience better throughput. -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C

"rsync -z" not working as expected under 2.6.8 and 2.6.9?

" section... Looking at the packets, I see no evidence of the rsyncd server telling the client anything regarding the filenames. So is there some smoke-n-mirrors going on in there? Why did the client compress data.gz - even though it was mentioned on the server as "dont compress"? En

Re: "rsync -z" not working as expected under 2.6.8 and 2.6.9?

Wayne Davison wrote: > On Fri, Oct 13, 2006 at 01:08:54PM +1300, Jason Haar wrote: > >> Looks like rsync "decided" to compress data.gz even though >> /etc/rsyncd.conf had "*.gz" in it's "dont compress" section... >> > > That

"text file busy" on cifs-mounted dir *doesn't* cause rsync error!

as .file.doc.3s1d3w - but the final rename on top of the original file failed. Rsync didn't return an error. It should? Help? Is this a bug with rsync, or with Samba (perhaps it returned OK on the rename when it shouldn't have?) -- Cheers Jason Haar Information Security Manager, Trim

Re: "text file busy" on cifs-mounted dir *doesn't* cause rsync error!

Wayne Davison wrote: > On Thu, Oct 19, 2006 at 03:28:56PM +1300, Jason Haar wrote: > >> bash$ rsync /tmp/other.txt file.doc >> bash$ echo $? >> 0 >> > > Re-run the same command under strace: > > strace rsync -av /tmp/other.txt file.doc > >

"text file busy" on cifs-mounted dir *doesn't* cause rsync error!

#x27;t return an error. It should? Help? Is this a bug with rsync, or with Samba (perhaps it returned OK on the rename when it shouldn't have?) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9

Re: rsync not updating files even with checksum flag

d, and even lets the Windows users know the files have been picked up (as they disappear) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- To unsubscribe or c

cannot get fuse-ssh to operate from a batch script - but does from cmd line

around it by getting the rsync xfre script to throw the sshfs mount command out as an "at now" script. That works fine - it's only when called directly that it fails... -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635

Re: Reproducable failure with rsync, iptables and RHEL4

uot;hanging" rsync does is right back in the beginning - which doesn't match your symptoms) -- Cheers Jason Haar Information Security Manager, Trimble Navigation Ltd. Phone: +64 3 9635 377 Fax: +64 3 9635 417 PGP Fingerprint: 7A2E 0407 C9A6 CAF6 2B9F 8422 C063 5EBB FE1D 66D1 -- T

issues with NT port?

roblem doesn't occur. It looks to me like some IP-stack issue, but other than that I'm stumped - can't really do much debugging on the NT side, so I don't know much more. This has been seen with rsync from 2.1 - 2.4... -- Cheers Jason Haar Unix/Network Specialist, Trimble

Re: issues with NT port?

bviously other NT network apps work fine over this link - maybe I should say "NT-specific rsync bug" :-)] -- Cheers Jason Haar Unix/Network Specialist, Trimble NZ Phone: +64 3 9635 377 Fax: +64 3 9635 417

Can rsync do this?

f AV files are out-of-whack and calls it corruption... Can rsync copy the files over to a temp dir, and then move them live as one move? I know I could do this with ssh directly, but the "--compare-dest" and "--partial" options make me wonder if rsync can do this itself... Is

Re: rsync problems with .iso files

would definitely be a download-from-scratch repair... -- Cheers Jason Haar Unix/Special Projects, Trimble NZ Phone: +64 3 9635 377 Fax: +64 3 9635 417