Re: Question on folder sync with directory name translation

2015-06-09 Thread Charles Marcus
Hello, I've been tasked with migrating a smallish (@90 mailboxes) company from a linux/dovecot mail server to Office 365, and after experiencing a ton of issues with Microsoft's native Imap syncing tool, I decided to use Imapsync, and it is working perfectly. It has the ability to add a simple

Changing path in old backups - WAS: Re: Changing permissions on existing backup source

2014-01-04 Thread Charles Marcus
On 2014-01-01 1:12 PM, Kevin Korb k...@sanitarium.net wrote: The easiest solution is to just do the same chmod on the most recent backup before running the next backup. Hi Kevin, This worked perfectly, and my shiny new server is now live, so thanks very much. I have a related question

Re: Changing permissions on existing backup source

2014-01-02 Thread Charles Marcus
On 2014-01-01 1:12 PM, Kevin Korb k...@sanitarium.net wrote: The files will not be transferred but they will be stored separately as new versions of the file even if the content is the same. Ok, so, 'stored separately' = take up additional space? which is what I want to avoid. Permissions

Re: Question about rsyncing to a slightly different folder structure on target

2014-01-02 Thread Charles Marcus
On 2014-01-01 2:02 PM, Wayne Davison way...@samba.org wrote: On Tue, Dec 31, 2013 at 3:59 AM, Charles Marcus cmar...@media-brokers.com mailto:cmar...@media-brokers.com wrote: On the old server, dovecot is configured to just use .../example.com/user http://example.com/user

Changing permissions on existing backup source

2014-01-01 Thread Charles Marcus
Hello, I have a system that currently uses rsync (via rsnapshot) with --link-dest enabled to backup our mail store... If I change the permissions on the source maildirs, will this cause everything to be transferred again? Meaning, will rsync see everything as 'modified', thus creating a new

Question about rsyncing to a slightly different folder structure on target

2013-12-31 Thread Charles Marcus
Hi all, Ok, if this isn't possible with some kind of wildcard, I can adjust the target manually, but if I can just modify the command to allow for the different folder structure on the target, I'd rather do that. I'm incrementally rsync'ing my mailstore from the old server to the new

Ignoring permission differences...

2013-12-22 Thread Charles Marcus
Hi all, Ok, since 3.1 still isn't in stable, I'm curious if I can just find the equivalent of: rsync -avHP --delete --exclude-from '/home/user/excludes.txt' /mnt/example.com/ /var/vmail/example.com/ But that will ignore differences in permissions - ie, won't recopy everything, just

Re: Ignoring permission differences...

2013-12-22 Thread Charles Marcus
, Charles Marcus wrote: Hi all, Ok, since 3.1 still isn't in stable, I'm curious if I can just find the equivalent of: rsync -avHP --delete --exclude-from '/home/user/excludes.txt' /mnt/example.com/ /var/vmail/example.com/ But that will ignore differences in permissions - ie, won't recopy

Re: Ignoring permission differences...

2013-12-22 Thread Charles Marcus
On 2013-12-22 2:58 PM, Charles Marcus cmar...@media-brokers.com wrote: rsync -rltgovDHP --delete --exclude-from '/home/user/excludes.txt' /mnt/example.com/ /var/vmail/example.com/ Also... being the paranoid schizophrenic that I am, adding the --delete option makes me nervous

How to set different permissions on target

2013-12-21 Thread Charles Marcus
Hi all, Ok, I'm attempting to rsync a large datastore (email), and want to change the ownership of the target directories and files. I saw the --chmod option in man rsync, but didn't see a --chown option... What I'd like to do is something like: rsync -avHP --chown vmail:vmail

Re: How to set different permissions on target

2013-12-21 Thread Charles Marcus
On 2013-12-21 2:18 PM, Kevin Korb k...@sanitarium.net wrote: The current version of rsync does have a --chown option. So, by current you mean... 3.1.x? I have 3.0.9 (3.1 isn't stable in gentoo yet), but --chown isn't in the man page for it... -- Best regards, */Charles/* -- Please use

Re: How to set different permissions on target

2013-12-21 Thread Charles Marcus
Ok, thanks... On 2013-12-21 3:38 PM, Kevin Korb k...@sanitarium.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Correct. It is a 3.1 feature. On 12/21/2013 03:31 PM, Charles Marcus wrote: On 2013-12-21 2:18 PM, Kevin Korb k...@sanitarium.net wrote: The current version of rsync

SOLVED - Re: Moving/merging a filesystem back into /

2013-12-08 Thread Charles Marcus
On 2013-12-08 2:11 PM, Charles Marcus cmar...@media-brokers.com wrote: Why, after rsync'ing /usr to /tmp-usr, do the sizes differ? # du -h --max-depth=0 /usr 3.5G/usr and # du -h --max-depth=0 /tmp-usr 3.7G/tmp-usr Is that because of the different filesystems (ext4

Re: Moving/merging a filesystem back into /

2013-12-07 Thread Charles Marcus
On 2013-12-05 12:03 AM, Linda Walsh rs...@tlinx.org wrote: For a one time copy... 'cp' should work fine... Except that someone on the gentoo list claims that cp will silently copy corrupted files, but rsync will not... which is a pretty good reason to use rsync over cp (I was looking for

Re: Moving/merging a filesystem back into /

2013-12-07 Thread Charles Marcus
On 2013-12-07 10:16 AM, Kevin Korb k...@sanitarium.net wrote: The only way cp is going to corrupt files is if you have bad RAM in the system and in that case rsync probably will too. I said that this person said that cp will silently copy CORRUPTED files, not that it will silently CORRUPT

Re: Moving/merging a filesystem back into /

2013-12-04 Thread Charles Marcus
On 2013-12-04 3:43 AM, Linda Walsh rs...@tlinx.org wrote: For that matter, is there a reason not to give cp a try mkdir /usr.tmp cp -ax /usr/. /usr.tmp/. I guarantee it will be faster than rsync. That or star -- if you want to know options, I'd have to reread the manpage, way too much to

Re: Moving/merging a filesystem back into /

2013-12-03 Thread Charles Marcus
On 2013-12-02 5:55 PM, Kevin Korb k...@sanitarium.net wrote: mount/dev/sda3 /mnt/gentoo/ You might have to specify more options here. Check what they are before you shut down. Ok, thinking about this more... since booting off a liveCD means I'm not using the systems fstab, so I have to

Re: Moving/merging a filesystem back into /

2013-12-03 Thread Charles Marcus
On 2013-12-03 9:37 AM, Kevin Korb k...@sanitarium.net wrote: Or do I need to specify the filesystem type? mount -t ext3 -o noatime /dev/sda3 /mnt/gentoo/ ? I would expect to do this. Also, you should be converting to ext4 not ext3. In fact, your kernel probably doesn't even have ext3 in it

Moving/merging a filesystem back into /

2013-12-02 Thread Charles Marcus
Hello, I'm going to be moving a filesystem around, and was planning on using rsync to do it, so like to get some advice from those more experienced than I (both using rsync, and moving filesystems)... I currently have a system that has a separate /usr on an LVM partition. I want to merge

Re: Moving/merging a filesystem back into /

2013-12-02 Thread Charles Marcus
On 2013-12-02 4:49 PM, Kevin Korb k...@sanitarium.net wrote: A little Gentoo specific info here... On 12/02/13 16:24, Leen Besselink wrote: On Mon, Dec 02, 2013 at 02:31:23PM -0500, Charles Marcus wrote: Hello, I'm going to be moving a filesystem around, and was planning on using rsync to do

Re: [Bug 8512] rsync is slower than cp -- Reduce overhead to cp for transfer of large files

2013-11-17 Thread Charles Marcus
On 2013-11-17 4:02 AM, samba-b...@samba.org samba-b...@samba.org wrote: I'm using gigabit ethernet, obviously, with mtu set to 1500 and no TCP options other than the following in smb.conf: socket options = TCP_NODELAY SO_RCVBUF=131072 SO_SNDBUF=131072 First, remove these... These

Re: Data Pull Vs Push

2012-01-17 Thread Charles Marcus
On 2012-01-16 4:37 PM, Kevin Korb k...@sanitarium.net wrote: As far as rsync is concerned an NFS mount is neither push or pull. Oh baloney... it is pushing a backup from a local system to a remote system. -- Best regards, Charles -- Please use reply-all for most replies to avoid omitting

Re: Data Pull Vs Push

2012-01-16 Thread Charles Marcus
On 2012-01-16 3:03 PM, Kevin Korb k...@sanitarium.net wrote: On 01/16/12 09:55, L. V. Lammert wrote: On Mon, 16 Jan 2012, Satish Shukla wrote: b) pulling the data from source to destination ( i.e. running rsync from destination machine) The main reason to pull is with hard linking

Re: Data Pull Vs Push

2012-01-16 Thread Charles Marcus
On 2012-01-16 4:06 PM, Kevin Korb k...@sanitarium.net wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 - From http://rsnapshot.org/faq.html: Q: Can I set the snapshot_root to a remote SSH path? The OP didn't specify over SSH (... I'm doing this to an NFS mount) - that came into the

Re: Newbie question Third try...

2010-09-09 Thread Charles Marcus
On 2010-09-09 5:07 PM, Blaine Miller blaine.mil...@smithmicro.com wrote: I give up... this is one of the least intuitive lists I've ever tried to subscribe to... What are you talking about? Your messages are coming through. You don't need to ask permission to ask a question, just ask your

Re: RFE: ignore case of files

2010-01-21 Thread Charles Marcus
On 2010-01-17 12:29 PM, Linda A. Walsh wrote: It would be 'nice' if there was an option for rsync to ignore case -- Windows is real lax about what case files are, and often files will end up with different cases depending on what util installed a font last. When you transfer to linux, you

Re: Will rsync support btrfs file system?

2009-12-06 Thread Charles Marcus
On 12/6/2009, Louise Hoffman (louise.hoff...@gmail.com) wrote: The way I read that, it's not something rsync-specific. It sounds like btrfs would allow the generation of a list of files, which rsync (or tar, or zip, or whatever) could accept. (Rsync obviously being the best choice, :-) ) So,

Re: LVM snapshots vs. --link-dest

2009-10-05 Thread Charles Marcus
On 10/5/2009, Ed W (li...@wildgooses.com) wrote: If you resist using a fileformat which has some kind of implicit chunking capability (eg maildir isn't perfect, but kind of goes in the opposite direction and chunks your mail into lots of smaller files - perhaps too many in the opinion of

Re: LVM snapshots vs. --link-dest

2009-10-05 Thread Charles Marcus
On 10/5/2009, Ed W (li...@wildgooses.com) wrote: Ideally I would like to see a kind of half and half maildir/mbox format emerge for email (perhaps dbox from dovecot will get there?) Guess I should have read your entire email before replying... ;) Its slated for 2.0 now, so will be a bit longer

Re: How to speed up rsync when haveing lots of files

2009-03-04 Thread Charles Marcus
On 3/4/2009, Daniel.Li (daniel...@usish.com) wrote: So I wanna know how to maximize the performance both of large file (1GB patter file) and small file (MP3, about 2~5MB per file) Maybe MP3 shouldn't be considered small files, right? Do u guys have any suggestions? Any hint or advice is

Re: How to speed up rsync when haveing lots of files

2009-03-04 Thread Charles Marcus
On 3/4/2009, Boniforti Flavio (fla...@piramide.ch) wrote: Why has upgrading to 3.0.5 to be done *on both sides*? Any explanation?! It is quite simple... support for the new options requires 3.0.x on both sides... As I'm running Debian Lenny (which has 3.0.3), do I have to switch to Debian Sid

Re: How to speed up rsync when haveing lots of files

2009-03-03 Thread Charles Marcus
On 3/3/2009 8:52 AM, m...@bortal.de wrote: unfortunatelly rsync is beeing REALLY slow and produces a high load when we try to sync lots of files (250 000 small files). What version of rsync are you using? # rsync --version rsync version 2.6.9 protocol version 29 Upgrade to 3.0.5 (on both

Re: Win32 GUI Client

2008-12-07 Thread Charles Marcus
On 12/5/2008 11:31 AM, Ansar Mohammed wrote: I downloaded the client and it wont allow you to enter something that does not have the rsync.net as a substring. Hmmm... maybe you could get around that by a little local DNS magic... I may try that sometime in the next few weeks... -- Best

Re: Win32 GUI Client

2008-12-04 Thread Charles Marcus
On 12/3/2008 9:41 PM, Ansar Mohammed wrote: Can anyone recommend a good win32 GUI rsync client? The rsync.net guys recently released one... it is not hidden on their website, and there are no restrictions from downloading it, or in the license when you install it, so I'm guessing you can use it

Re: some files could not be transferred (code 23) at main.c (1506)

2008-07-11 Thread Charles Marcus
On 7/11/2008, Jeff MacDonald ([EMAIL PROTECTED]) wrote: I'm trying to rsync a fairly large chunk of data [around 350 gigs, mostly 1 gig files] between 2 hosts in separate colo facilities. Link is plenty fast, I can pull 10 megs easily. Everytime, it seems to die with something like this,

Re: some files could not be transferred (code 23) at main.c (1506)

2008-07-11 Thread Charles Marcus
On 7/11/2008 3:11 PM, Jeff MacDonald wrote: I'm trying to rsync a fairly large chunk of data [around 350 gigs, mostly 1 gig files] between 2 hosts in separate colo facilities. Link is plenty fast, I can pull 10 megs easily. Everytime, it seems to die with something like this, whether I try rsync

Re: Rsync roadmap and version numbering (3.1.0 vs 3.0.4)

2008-07-06 Thread Charles Marcus
On 7/4/2008, Wayne Davison ([EMAIL PROTECTED]) wrote: Other things in the patches dir, suggestions made here, and enhancement requests from bugzilla will all be reviewed for possible inclusion. I'd still like to see the --ignore-case patch to be made part of the official rsync source... --

Re: Status of --ignorcase option in main tree/build?

2008-05-16 Thread Charles Marcus
On 5/15/2008 7:18 PM, Wayne Davison wrote: On Thu, May 15, 2008 at 06:39:03PM -0400, Matt McCutchen wrote: Wayne, do you have a comment about the inclusion of --ignore-case? I don't particularly like the option, so my current inclination is to just keep it available in the patches directory

Re: Status of --ignorcase option in main tree/build?

2008-05-16 Thread Charles Marcus
On 5/16/2008, Matt McCutchen ([EMAIL PROTECTED]) wrote: To some degree I can see Wayne's rationale for not including --ignore-case in the main version of rsync. Officially, rsync targets only Unix-like systems, not Windows, though OS-specific compatibility changes/features are fair game for

Hard Links on Windows?

2008-03-28 Thread Charles Marcus
Anyone ever heard of or used something called DataSafe Backup? http://sofgem.selfip.com/ Claims to take advantage of 'hard links' on windows to windows backups... Interesting... I'll be giving it a try on one of my clients networks just for fun... -- Best regards, Charles -- To

Re: PST Rsync Issues

2008-03-03 Thread Charles Marcus
On 3/3/2008, Jason Haar ([EMAIL PROTECTED]) wrote: Basically PST (and OST) files don't play nicely with differential copy tools. They also get very unstable the closer to 2GB in size you get... I'd never let a PST file get over about 500MB - had too many problems when I did (don't use it any

rsync+compression

2008-01-01 Thread Charles Marcus
Hi, A recent thread here reminded me to ask a question I've been wondering about... Is there a way to use rsync with large COMPRESSED files? Specifically, I have a large Quickbooks Data file (600MB) that compresses down to about 100MB - so obviously I'd rather rsync the smaller file (this

Re: Pushing hard-linked backups

2007-12-27 Thread Charles Marcus
On 12/25/2007, Eric S. Johansson ([EMAIL PROTECTED]) wrote: [[ related thought. if rsync had a plugin architecture allowing per file transformation (pre and post transfer) one could build encryption in as an addon]] the idea of the encryption extension is that when a file is ready for block

Re: (no subject)

2007-10-05 Thread Charles Marcus
Frank Thomas, on 10/4/2007 3:57 PM, said the following: it would be nice to have rsync to be intelligent enough to recognize a name change but not an inode change on the source. Seems to me the best way to accomplish this is to be sure that the parent directory is not a directory that someone

Re: moderation?

2007-08-28 Thread Charles Marcus
On 8/28/2007, Paul Slootman ([EMAIL PROTECTED]) wrote: The list is open to non-members, to make help with rsync more accessible. Unfortunately some idiots feel the need to abuse this (what the point of the last set of subscriptions to some webshop's mailing list is, is beyond me). In this day

Re: moderation?

2007-08-28 Thread Charles Marcus
Matt McCutchen, on 8/28/2007 9:59 AM, said the following: On 8/28/07, Charles Marcus [EMAIL PROTECTED] wrote: In this day and age, that is a most unwise policy. For one, it opens up *MY* email address to spammers. Please, rsync list maintainers - join the 21st century, respect *MY* privacy

Re: Status of --ignorcase option in main tree/build?

2007-08-03 Thread Charles Marcus
Rather than waiting for the ignore case patch to be added to the standard rsync, One big reason I pinged the list (and you and Wayne) is to be the 'squeaky wheel' - I'm hoping this doesn't fall through the cracks and actually does make it into the 3.0 release... otherwise, I'll have to keep

Re: Which rsync version?

2007-08-02 Thread Charles Marcus
If those files don't have hardlinks (or you're not interested in preserving hardlinks), you can greatly improve performance by trying the 3.0.0 cvs snapshot. Which suggests that the current CVS version won't preserve hardlinks? -- Best regards, Charles -- To unsubscribe or change options:

Re: Which rsync version?

2007-08-02 Thread Charles Marcus
The issue is that asking to preserve hardlinks turns off incremental recursion mode, which was what gives the performance benefit. Ahh... ok, sorry... -- Best regards, Charles -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read:

Re: Status of --ignorcase option in main tree/build?

2007-07-30 Thread Charles Marcus
Matt McCutchen, on 7/20/2007 10:28 AM, said the following: On 7/20/07, Charles Marcus [EMAIL PROTECTED] wrote: Hi Wayne, Just checking to see if this is in the official tree yet? It isn't. Wayne, perhaps you have a further comment about when it will be. Wayne? Thanks, -- Best regards

Re: Status of --ignorcase option in main tree/build?

2007-07-20 Thread Charles Marcus
Wayne Davison, on 5/4/2007 12:11 PM, said the following: On Wed, May 02, 2007 at 01:01:20PM -0400, Charles Marcus wrote: I'm very interested in learning the status of the --ignorecase patch being included in the main tree... My currently plan is to include that functionality in 3.0.0. I've

Re: Rysnc Schedule

2007-07-18 Thread Charles Marcus
On 7/18/2007, Chuck Wolber ([EMAIL PROTECTED]) wrote: In linux, you delete files with the rm command... OT follow-up... Is there an alternate way to remove an entire directory *without* traversing the directory itself? -- Best regards, Charles -- To unsubscribe or change options:

Re: rsync replacement

2007-07-17 Thread Charles Marcus
Matt McCutchen, on 7/17/2007 2:50 PM, said the following: On 7/17/07, Jamie Lokier [EMAIL PROTECTED] wrote: I am in fact working towards such a program, though not with proprietary congestion control. :-) It's currently in the form of a distributed database of 650 devices, which I aim to scale

Re: rsync fails to sync files

2007-05-08 Thread Charles Marcus
You need to supply the --checksum option if you want to make sure that the contents are indeed identical. This is normally not done as that would cause a massive IO load; cases that size and timestamp are identical but not the contents don't usually happen... The manual is indeed not very

Re: Status of --ignorcase option in main tree/build?

2007-05-04 Thread Charles Marcus
Wayne Davison wrote: On Wed, May 02, 2007 at 01:01:20PM -0400, Charles Marcus wrote: I'm very interested in learning the status of the --ignorecase patch being included in the main tree... My currently plan is to include that functionality in 3.0.0. I've been improving the patch in recent

Re: Status of --ignorcase option in main tree/build?

2007-05-04 Thread Charles Marcus
That said - you said '3.0', and 'fairly soon'... does that mean that 3.0 will be the next major release? To clarify... will the next version be 2.7, or 3.0? Thanks again! -- Best regards, Charles -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before

Status of --ignorcase option in main tree/build?

2007-05-02 Thread Charles Marcus
Hi, I'm very interested in learning the status of the --ignorecase patch being included in the main tree... is there a reason it still isn't in there? For anyone who is forced to dealing with backing up windows boxes, this is a big problem, and I can't believe that it isn't affecting a lot