Re: Question on folder sync with "directory name translation"

2015-06-09 Thread Charles Marcus
Hello, I've been tasked with migrating a smallish (@90 mailboxes) company from a linux/dovecot mail server to Office 365, and after experiencing a ton of issues with Microsoft's native Imap syncing tool, I decided to use Imapsync, and it is working perfectly. It has the ability to add a simple re

Re: LVM snapshots vs. --link-dest

2009-10-05 Thread Charles Marcus
On 10/5/2009, Ed W (li...@wildgooses.com) wrote: > If you resist using a fileformat which has some kind of implicit > "chunking" capability (eg maildir isn't perfect, but kind of goes in > the opposite direction and chunks your mail into lots of smaller > files - perhaps too many in the opinion of

Re: LVM snapshots vs. --link-dest

2009-10-05 Thread Charles Marcus
On 10/5/2009, Ed W (li...@wildgooses.com) wrote: > Ideally I would like to see a kind of half and half maildir/mbox > format emerge for email (perhaps dbox from dovecot will get there?) Guess I should have read your entire email before replying... ;) Its slated for 2.0 now, so will be a bit longe

Re: Will rsync support btrfs file system?

2009-12-06 Thread Charles Marcus
On 12/6/2009, Louise Hoffman (louise.hoff...@gmail.com) wrote: > The way I read that, it's not something rsync-specific. It sounds > like btrfs would allow the generation of a list of files, which rsync > (or tar, or zip, or whatever) could accept. (Rsync obviously being > the best choice, :-) ) S

Re: RFE: ignore case of files

2010-01-21 Thread Charles Marcus
On 2010-01-17 12:29 PM, Linda A. Walsh wrote: > It would be 'nice' if there was an option for rsync to ignore case -- > Windows is real lax about what case files are, and often files will > end up with different cases depending on what util installed a font > last. When you transfer to linux, you

Re: Newbie question Third try...

2010-09-09 Thread Charles Marcus
On 2010-09-09 5:07 PM, Blaine Miller wrote: > I give up... this is one of the least intuitive lists I've ever tried to > subscribe to... What are you talking about? Your messages are coming through. You don't need to ask permission to ask a question, just ask your question... -- Best regards

Re: Data Pull Vs Push

2012-01-16 Thread Charles Marcus
On 2012-01-16 3:03 PM, Kevin Korb wrote: On 01/16/12 09:55, L. V. Lammert wrote: On Mon, 16 Jan 2012, Satish Shukla wrote: b) pulling the data from source to destination ( i.e. running rsync from destination machine) The main reason to pull is with hard linking of the saved files, e

Re: Data Pull Vs Push

2012-01-16 Thread Charles Marcus
On 2012-01-16 4:06 PM, Kevin Korb wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 - From http://rsnapshot.org/faq.html: Q: Can I set the snapshot_root to a remote SSH path? The OP didn't specify over SSH (... I'm doing this to an NFS mount) - that came into the picture later from other

Re: Data Pull Vs Push

2012-01-17 Thread Charles Marcus
On 2012-01-16 4:37 PM, Kevin Korb wrote: As far as rsync is concerned an NFS mount is neither push or pull. Oh baloney... it is pushing a backup from a local system to a remote system. -- Best regards, Charles -- Please use reply-all for most replies to avoid omitting the mailing list. To u

Re: [Bug 8512] rsync is slower than cp -- Reduce overhead to cp for transfer of large files

2013-11-17 Thread Charles Marcus
On 2013-11-17 4:02 AM, samba-b...@samba.org wrote: I'm using gigabit ethernet, obviously, with mtu set to 1500 and no TCP options other than the following in smb.conf: socket options = TCP_NODELAY SO_RCVBUF=131072 SO_SNDBUF=131072 First, remove these... These options have been deprecate

Moving/merging a filesystem back into /

2013-12-02 Thread Charles Marcus
Hello, I'm going to be moving a filesystem around, and was planning on using rsync to do it, so like to get some advice from those more experienced than I (both using rsync, and moving filesystems)... I currently have a system that has a separate /usr on an LVM partition. I want to merge thi

Re: Moving/merging a filesystem back into /

2013-12-02 Thread Charles Marcus
On 2013-12-02 4:49 PM, Kevin Korb wrote: A little Gentoo specific info here... On 12/02/13 16:24, Leen Besselink wrote: On Mon, Dec 02, 2013 at 02:31:23PM -0500, Charles Marcus wrote: Hello, I'm going to be moving a filesystem around, and was planning on using rsync to do it, so like t

Re: Moving/merging a filesystem back into /

2013-12-03 Thread Charles Marcus
On 2013-12-02 5:55 PM, Kevin Korb wrote: mount/dev/sda3 /mnt/gentoo/ You might have to specify more options here. Check what they are before you shut down. Ok, thinking about this more... since booting off a liveCD means I'm not using the systems fstab, so I have to specify the filesystem to

Re: Moving/merging a filesystem back into /

2013-12-03 Thread Charles Marcus
On 2013-12-03 9:37 AM, Kevin Korb wrote: Or do I need to specify the filesystem type? mount -t ext3 -o noatime /dev/sda3 /mnt/gentoo/ ? I would expect to do this. Also, you should be converting to ext4 not ext3. In fact, your kernel probably doesn't even have ext3 in it anymore. Standard ke

Re: Moving/merging a filesystem back into /

2013-12-04 Thread Charles Marcus
On 2013-12-04 3:43 AM, Linda Walsh wrote: For that matter, is there a reason not to give "cp" a try" mkdir /usr.tmp && cp -ax /usr/. /usr.tmp/. I guarantee it will be faster than rsync. That or star -- if you want to know options, I'd have to reread the manpage, way too much to remember. T

Re: Moving/merging a filesystem back into /

2013-12-07 Thread Charles Marcus
On 2013-12-05 12:03 AM, Linda Walsh wrote: For a one time copy... 'cp' should work fine... Except that someone on the gentoo list claims that cp will silently copy corrupted files, but rsync will not... which is a pretty good reason to use rsync over cp (I was looking for specific reasons wh

Re: Moving/merging a filesystem back into /

2013-12-07 Thread Charles Marcus
On 2013-12-07 10:16 AM, Kevin Korb wrote: The only way cp is going to corrupt files is if you have bad RAM in the system and in that case rsync probably will too. I said that this person said that cp will silently copy CORRUPTED files, not that it will silently CORRUPT files during the copy p

Re: Moving/merging a filesystem back into /

2013-12-08 Thread Charles Marcus
On 2013-12-07 10:14 AM, Charles Marcus wrote: Anyway, I'm thinking now that the 'best of both worlds' might be to do the cp first on the live system, then boot into single user mode (is it safe to change the /usr mount point/location when in single user mode?), then do a qui

Re: Moving/merging a filesystem back into /

2013-12-08 Thread Charles Marcus
On 2013-12-04 3:43 AM, Linda Walsh wrote: I'd do it with the system *up*, and, as someone else suggested, copy /usr to /usr.tmp (assuming you are moving from /usr to the root fs. For that matter, is there a reason not to give "cp" a try" mkdir /usr.tmp && cp -ax /usr/. /usr.tmp/. Ok, so, af

Re: Moving/merging a filesystem back into /

2013-12-08 Thread Charles Marcus
On 2013-12-08 11:38 AM, Charles Marcus wrote: 3. Copy current /usr to temp directory rsync -avHP --numeric-ids /usr//tmp-usr/ Decided to use rsync, and have a question... Why, after rsync'ing /usr to /tmp-usr, do the sizes differ? # du -h --max-depth=0 /usr 3.5G/usr and #

SOLVED - Re: Moving/merging a filesystem back into /

2013-12-08 Thread Charles Marcus
On 2013-12-08 2:11 PM, Charles Marcus wrote: Why, after rsync'ing /usr to /tmp-usr, do the sizes differ? # du -h --max-depth=0 /usr 3.5G/usr and # du -h --max-depth=0 /tmp-usr 3.7G/tmp-usr Is that because of the different filesystems (ext4 on / and reiserfs on /usr) maybe?

How to set different permissions on target

2013-12-21 Thread Charles Marcus
Hi all, Ok, I'm attempting to rsync a large datastore (email), and want to change the ownership of the target directories and files. I saw the --chmod option in man rsync, but didn't see a --chown option... What I'd like to do is something like: rsync -avHP --chown vmail:vmail /mnt/old-mail/

Re: How to set different permissions on target

2013-12-21 Thread Charles Marcus
On 2013-12-21 2:18 PM, Kevin Korb wrote: The current version of rsync does have a --chown option. So, by current you mean... 3.1.x? I have 3.0.9 (3.1 isn't stable in gentoo yet), but --chown isn't in the man page for it... -- Best regards, */Charles/* -- Please use reply-all for most re

Re: How to set different permissions on target

2013-12-21 Thread Charles Marcus
Ok, thanks... On 2013-12-21 3:38 PM, Kevin Korb wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Correct. It is a 3.1 feature. On 12/21/2013 03:31 PM, Charles Marcus wrote: On 2013-12-21 2:18 PM, Kevin Korb wrote: The current version of rsync does have a --chown option. So, by

Ignoring permission differences...

2013-12-22 Thread Charles Marcus
Hi all, Ok, since 3.1 still isn't in stable, I'm curious if I can just find the equivalent of: rsync -avHP --delete --exclude-from '/home/user/excludes.txt' /mnt/example.com/ /var/vmail/example.com/ But that will ignore differences in permissions - ie, won't recopy everything, just because

Re: Ignoring permission differences...

2013-12-22 Thread Charles Marcus
Which is what the command at the bottom is... I was just asking for confirmation that I was thinking right about it... On 2013-12-22 3:01 PM, Kevin Korb wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 That would be -a except for the -p part. On 12/22/2013 02:58 PM, Charles Marcus wrote

Re: Ignoring permission differences...

2013-12-22 Thread Charles Marcus
On 2013-12-22 2:58 PM, Charles Marcus wrote: rsync -rltgovDHP --delete --exclude-from '/home/user/excludes.txt' /mnt/example.com/ /var/vmail/example.com/ Also... being the paranoid schizophrenic that I am, adding the --delete option makes me nervous. There is no way that the abo

Question about rsyncing to a slightly different folder structure on target

2013-12-31 Thread Charles Marcus
Hi all, Ok, if this isn't possible with some kind of wildcard, I can adjust the target manually, but if I can just modify the command to allow for the different folder structure on the target, I'd rather do that. I'm incrementally rsync'ing my mailstore from the old server to the new server,

Changing permissions on existing backup source

2014-01-01 Thread Charles Marcus
Hello, I have a system that currently uses rsync (via rsnapshot) with --link-dest enabled to backup our mail store... If I change the permissions on the source maildirs, will this cause everything to be transferred again? Meaning, will rsync see everything as 'modified', thus creating a new

Re: Changing permissions on existing backup source

2014-01-02 Thread Charles Marcus
On 2014-01-01 1:12 PM, Kevin Korb wrote: The files will not be transferred but they will be stored separately as new versions of the file even if the content is the same. Ok, so, 'stored separately' = take up additional space? which is what I want to avoid. Permissions are per inode not di

Re: Question about rsyncing to a slightly different folder structure on target

2014-01-02 Thread Charles Marcus
On 2014-01-01 2:02 PM, Wayne Davison wrote: On Tue, Dec 31, 2013 at 3:59 AM, Charles Marcus mailto:cmar...@media-brokers.com>> wrote: On the old server, dovecot is configured to just use .../example.com/user <http://example.com/user> for the maildirs. On the target se

Changing path in old backups - WAS: Re: Changing permissions on existing backup source

2014-01-04 Thread Charles Marcus
On 2014-01-01 1:12 PM, Kevin Korb wrote: The easiest solution is to just do the same chmod on the most recent backup before running the next backup. Hi Kevin, This worked perfectly, and my shiny new server is now live, so thanks very much. I have a related question though... I want to con

Status of --ignorcase option in main tree/build?

2007-05-02 Thread Charles Marcus
Hi, I'm very interested in learning the status of the --ignorecase patch being included in the main tree... is there a reason it still isn't in there? For anyone who is forced to dealing with backing up windows boxes, this is a big problem, and I can't believe that it isn't affecting a lot o

Re: Status of --ignorcase option in main tree/build?

2007-05-04 Thread Charles Marcus
Wayne Davison wrote: On Wed, May 02, 2007 at 01:01:20PM -0400, Charles Marcus wrote: I'm very interested in learning the status of the --ignorecase patch being included in the main tree... My currently plan is to include that functionality in 3.0.0. I've been improving the patch

Re: Status of --ignorcase option in main tree/build?

2007-05-04 Thread Charles Marcus
That said - you said '3.0', and 'fairly soon'... does that mean that 3.0 will be the next major release? To clarify... will the next version be 2.7, or 3.0? Thanks again! -- Best regards, Charles -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posti

Re: rsync fails to sync files

2007-05-08 Thread Charles Marcus
You need to supply the --checksum option if you want to make sure that the contents are indeed identical. This is normally not done as that would cause a massive IO load; cases that size and timestamp are identical but not the contents don't usually happen... The manual is indeed not very clear

Re: rsync replacement

2007-07-17 Thread Charles Marcus
Matt McCutchen, on 7/17/2007 2:50 PM, said the following: On 7/17/07, Jamie Lokier <[EMAIL PROTECTED]> wrote: I am in fact working towards such a program, though not with proprietary congestion control. :-) It's currently in the form of a distributed database of 650 devices, which I aim to scal

Re: Rysnc Schedule

2007-07-18 Thread Charles Marcus
On 7/18/2007, Chuck Wolber ([EMAIL PROTECTED]) wrote: In linux, you delete files with the "rm" command... OT follow-up... Is there an alternate way to remove an entire directory *without* traversing the directory itself? -- Best regards, Charles -- To unsubscribe or change options: https:

Re: Status of --ignorcase option in main tree/build?

2007-07-20 Thread Charles Marcus
Wayne Davison, on 5/4/2007 12:11 PM, said the following: On Wed, May 02, 2007 at 01:01:20PM -0400, Charles Marcus wrote: I'm very interested in learning the status of the --ignorecase patch being included in the main tree... My currently plan is to include that functionality in 3.0.0.

Re: Status of --ignorcase option in main tree/build?

2007-07-22 Thread Charles Marcus
Hi Wayne, Just checking to see if this is in the official tree yet? It isn't. Wayne, perhaps you have a further comment about when it will be. Thanks Matt - we'll see what Wayne says... -- Best regards, Charles -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo

Re: Status of --ignorcase option in main tree/build?

2007-07-30 Thread Charles Marcus
Matt McCutchen, on 7/20/2007 10:28 AM, said the following: On 7/20/07, Charles Marcus <[EMAIL PROTECTED]> wrote: Hi Wayne, Just checking to see if this is in the official tree yet? It isn't. Wayne, perhaps you have a further comment about when it will be. Wayne? Thanks

Re: Which rsync version?

2007-08-02 Thread Charles Marcus
If those files don't have hardlinks (or you're not interested in preserving hardlinks), you can greatly improve performance by trying the 3.0.0 cvs snapshot. Which suggests that the current CVS version won't preserve hardlinks? -- Best regards, Charles -- To unsubscribe or change options: htt

Re: Which rsync version?

2007-08-02 Thread Charles Marcus
The issue is that asking to preserve hardlinks turns off incremental recursion mode, which was what gives the performance benefit. Ahh... ok, sorry... -- Best regards, Charles -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.

Re: Status of --ignorcase option in main tree/build?

2007-08-03 Thread Charles Marcus
Rather than waiting for the ignore case patch to be added to the standard rsync, One big reason I pinged the list (and you and Wayne) is to be the 'squeaky wheel' - I'm hoping this doesn't fall through the cracks and actually does make it into the 3.0 release... otherwise, I'll have to keep b

Re: moderation?

2007-08-28 Thread Charles Marcus
I get the feeling it's time to turn this list into a moderated one ... I'm surprised - does this list not incorporate some kind of captcha /confirmation system for registering members? Its been so long since I signed up, I don't remember... -- Best regards, Charles -- To unsubscribe or cha

Re: moderation?

2007-08-28 Thread Charles Marcus
On 8/28/2007, Paul Slootman ([EMAIL PROTECTED]) wrote: The list is open to non-members, to make help with rsync more accessible. Unfortunately some idiots feel the need to abuse this (what the point of the last set of subscriptions to some webshop's mailing list is, is beyond me). In this day a

Re: moderation?

2007-08-28 Thread Charles Marcus
Matt McCutchen, on 8/28/2007 9:59 AM, said the following: On 8/28/07, Charles Marcus <[EMAIL PROTECTED]> wrote: In this day and age, that is a most unwise policy. For one, it opens up *MY* email address to spammers. Please, rsync list maintainers - join the 21st century, respect *MY* p

Re: (no subject)

2007-10-05 Thread Charles Marcus
Frank Thomas, on 10/4/2007 3:57 PM, said the following: it would be nice to have rsync to be intelligent enough to recognize a name change but not an inode change on the source. Seems to me the best way to accomplish this is to be sure that the parent directory is not a directory that someone

Re: Pushing hard-linked backups

2007-12-27 Thread Charles Marcus
On 12/25/2007, Eric S. Johansson ([EMAIL PROTECTED]) wrote: [[ related thought. if rsync had a plugin architecture allowing per file transformation (pre and post transfer) one could build encryption in as an addon]] the idea of the encryption extension is that when a file is ready for block

rsync+compression

2008-01-01 Thread Charles Marcus
Hi, A recent thread here reminded me to ask a question I've been wondering about... Is there a way to use rsync with large COMPRESSED files? Specifically, I have a large Quickbooks Data file (>600MB) that compresses down to about 100MB - so obviously I'd rather rsync the smaller file (this i

Re: PST Rsync Issues

2008-03-03 Thread Charles Marcus
On 3/3/2008, Jason Haar ([EMAIL PROTECTED]) wrote: Basically PST (and OST) files don't play nicely with differential copy tools. They also get very unstable the closer to 2GB in size you get... I'd never let a PST file get over about 500MB - had too many problems when I did (don't use it any

Hard Links on Windows?

2008-03-28 Thread Charles Marcus
Anyone ever heard of or used something called DataSafe Backup? http://sofgem.selfip.com/ Claims to take advantage of 'hard links' on windows to windows backups... Interesting... I'll be giving it a try on one of my clients networks just for fun... -- Best regards, Charles -- To unsubscribe

Re: Status of --ignorcase option in main tree/build?

2008-05-16 Thread Charles Marcus
On 5/15/2008 7:18 PM, Wayne Davison wrote: > On Thu, May 15, 2008 at 06:39:03PM -0400, Matt McCutchen wrote: >> Wayne, do you have a comment about the inclusion of --ignore-case? > I don't particularly like the option, so my current inclination is to > just keep it available in the patches directo

Re: Status of --ignorcase option in main tree/build?

2008-05-16 Thread Charles Marcus
On 5/16/2008, Matt McCutchen ([EMAIL PROTECTED]) wrote: > To some degree I can see Wayne's rationale for not including > --ignore-case in the main version of rsync. Officially, rsync targets > only Unix-like systems, not Windows, though OS-specific compatibility > changes/features are fair game fo

Re: Rsync "roadmap" and version numbering (3.1.0 vs 3.0.4)

2008-07-06 Thread Charles Marcus
On 7/4/2008, Wayne Davison ([EMAIL PROTECTED]) wrote: Other things in the patches dir, suggestions made here, and enhancement requests from bugzilla will all be reviewed for possible inclusion. I'd still like to see the --ignore-case patch to be made part of the official rsync source... --

Re: some files could not be transferred (code 23) at main.c (1506)

2008-07-11 Thread Charles Marcus
On 7/11/2008, Jeff MacDonald ([EMAIL PROTECTED]) wrote: I'm trying to rsync a fairly large chunk of data [around 350 gigs, mostly 1 gig files] between 2 hosts in separate colo facilities. Link is plenty fast, I can pull 10 megs easily. Everytime, it seems to die with something like this, whether

Re: some files could not be transferred (code 23) at main.c (1506)

2008-07-11 Thread Charles Marcus
On 7/11/2008 3:11 PM, Jeff MacDonald wrote: I'm trying to rsync a fairly large chunk of data [around 350 gigs, mostly 1 gig files] between 2 hosts in separate colo facilities. Link is plenty fast, I can pull 10 megs easily. Everytime, it seems to die with something like this, whether I try rsync

Re: Win32 GUI Client

2008-12-04 Thread Charles Marcus
On 12/3/2008 9:41 PM, Ansar Mohammed wrote: > Can anyone recommend a good win32 GUI rsync client? The rsync.net guys recently released one... it is not hidden on their website, and there are no restrictions from downloading it, or in the license when you install it, so I'm guessing you can use it

Re: Win32 GUI Client

2008-12-07 Thread Charles Marcus
On 12/5/2008 11:31 AM, Ansar Mohammed wrote: > I downloaded the client and it wont allow you to enter something that does > not have the "rsync.net" as a substring. Hmmm... maybe you could get around that by a little local DNS magic... I may try that sometime in the next few weeks... -- Best re

Re: How to speed up rsync when haveing lots of files

2009-03-03 Thread Charles Marcus
On 3/3/2009 8:52 AM, m...@bortal.de wrote: >>> unfortunatelly rsync is beeing REALLY slow and produces a high load when >>> we try to sync lots of files (>250 000 small files). >> What version of rsync are you using? > # rsync --version > rsync version 2.6.9 protocol version 29 Upgrade to 3.0.

Re: How to speed up rsync when haveing lots of files

2009-03-04 Thread Charles Marcus
On 3/4/2009, Daniel.Li (daniel...@usish.com) wrote: > So I wanna know how to maximize the performance both of large file > (1GB patter file) and small file (MP3, about 2~5MB per file) > > Maybe MP3 shouldn't be considered small files, right? > > Do u guys have any suggestions? > Any hint or adv

Re: How to speed up rsync when haveing lots of files

2009-03-04 Thread Charles Marcus
On 3/4/2009, Boniforti Flavio (fla...@piramide.ch) wrote: > Why has upgrading to 3.0.5 to be done *on both sides*? Any explanation?! It is quite simple... support for the new options requires 3.0.x on both sides... > As I'm running Debian Lenny (which has 3.0.3), do I have to switch to > Debian S