Re: Speeding Up Rsync for Large File Sets

2012-11-30 Thread Kyle Lanclos
Tim Gustafson wrote: Because zfs send/receive doesn't work well if the target file system ever gets changed, even for something like an atime.** Basically, the file system can't be touched on the remote end, and you can't even set the read-only property, because that would be a

Re: Problem syncing to Netapp (rsync: failed to set times on...)

2012-04-09 Thread Kyle Lanclos
Bill Dorrian wrote: These are photos - I wonder what the odds are of a modified file having the same size as the original? If someone modifies the EXIF metadata (say, to correct a 'picture taken on' timestamp for a camera that wasn't properly synchronized), the file size would likely remain the

Re: recent discussion regarding 'checksums'

2010-09-29 Thread Kyle Lanclos
Jason Haar wrote: Besides all this, what is the performance impact of -c? If it's moved from MD5 to X - will that impact performance? The major impact of using checksums is that both the client and the server now need to read out every file inspected by the rsync session, where before they

Re: feature request: lzma compresion (7zip)

2010-06-17 Thread Kyle Lanclos
lzma is default comrpession in very good compression SW 7-zip, which is faster and have higher compression ratio then bzip2 or rar. From what I've seen, lzma/xz compression is slower than bzip2, but generally provides higher compression ratios. Both are remarkably slower than gzip, but again,

Re: OSX and HFS+ filesystem compression

2010-05-18 Thread Kyle Lanclos
Robert DuToit wrote: I have been reading about the HFS+ filesystem compression on Snow Leopard and how copying or cloning over system files with rsync and other tools results in them being expanded on destination. I was wondering if there was any thoughts on updating rsync to accommodate this?

Re: The source and destination cannot both be remote :-(

2010-05-07 Thread Kyle Lanclos
Christian Huldt wrote: That I have no idea about, but I believe it would double the bandwith requirements or half the speed compared to ssh r...@client rsync /var/tmp/in tom...@fileserver:/opt/ It would likely increase the latency, but it should not significantly impact the required

Re: from solaris to linux: /usr/local/bin/rsync: No such file or directory

2010-04-19 Thread Kyle Lanclos
You want to use the --rsync-path option. --Kyle -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Force destination files to specific owner/group

2010-03-01 Thread Kyle Lanclos
Folks-- I'm working with an old system I set up to copy files from one local directory to another. I was using rdist for this, but I would prefer to shift it over to rsync. The one thing I'm missing is the trivial ability to force the group owernship of the destination files to a specific group.

Re: how to migrate 40T data and 180M files

2009-08-11 Thread Kyle Lanclos
Ming Gao wrote: The first question is that if there is any risk for such a big number of files? should I divide them into groups and rsync them in parallel or in serial? If yes, how many groups is better? For that amount of data, you ought to use something simple and recursive, like cp -rp. A

Re: proposal to speed rsync with lots of files

2009-03-05 Thread Kyle Lanclos
Peter Salameh wrote: One of the speed-limiting issues with rsync is having to send huge file lists when mirroring large file systems, even for incremental updates where only a small part of the file system might have changed. Personally, I find that the sending of the file list, whether

Re: Configuring Rsync to run without any user input or Cron job.

2008-11-19 Thread Kyle Lanclos
Etienne wrote: I would like to know if it's possible for Rsync to automatically mirror a folder and it's content from one deamon to another. (or one client to a deamon) Basically I want users to drag and drop files in a folder and Rsync to mirror these files as soon as it sees them. A cron or

Re: how to start rsync daemon on fedora

2008-10-09 Thread Kyle Lanclos
Wayne wrote: Fedora supplies an /etc/xinetd.d/rsync file that defaults to off. Using your b command should turn it on and sighup xinetd. If you go the xinetd route, that means that there won't be a dedicated rsync daemon running. You could elect to leave the xinetd config file disabled and

Re: File Locking

2008-08-18 Thread Kyle Lanclos
A different Kyle wrote: I have a situation that requires the files that rsync is uploading/downloading to be locked. The reason is because it is possible to have more than one copy of rsync running and without file locking, the additional copies simply retry to upload/download a file that a

Re: File Locking

2008-08-18 Thread Kyle Lanclos
Another Kyle wrote: However, I want to schedule the script to run, say every 15 minutes. That way if a file is put on the source side, the cript will pick it up and begin copying it. However, if the file is a few hundred MB, it might take longer than 15 minutes to copy it. In other words,

Re: Forcing a transfer to be one-way from the daemon side?

2008-05-07 Thread Kyle Lanclos
[EMAIL PROTECTED] wrote: I'm trying to set up a secure way to back up a system as root, with rsync (assume we don't want to kill the bandwidth and want a snapshot system for developers in a way that makes dump, tar, etc impractical. We've got an ssh key relationship set up and we can force