backend_connect source address and config_servername

2006-03-05 Thread Bron Gondwana
connections? 2) If so, would it make sense to have a separate configuration item (config_backend_ip ?) that could override the default behaviour? Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http

Re: backend_connect source address and config_servername

2006-03-06 Thread Bron Gondwana
On Mon, Mar 06, 2006 at 02:54:12PM -0500, Ken Murchison wrote: Bron Gondwana wrote: Hi, I'm working on setting up replication for our (FastMail.FM) new servers. One issue I've run in to is that our machines are set up as follows: 10.*: imap$n.internal 66.111.4.*: imap

Re: doing replication from two machine to one machine

2006-05-04 Thread Bron Gondwana
On Thu, May 04, 2006 at 02:35:55PM +0200, Rudy Gevaert wrote: For now we are not going to use that in a murder. At [ http://users.ugent.be/~rgevaert/HA-IMAP-2.png ] you can find a picture of the setup we are aiming at. Looks rather similar to what we're doing at FastMail.FM. Each user has

Replication and Virtual Domains

2006-05-14 Thread Bron Gondwana
if you need the entire configs (minus passwords, natch) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Replication question

2006-05-17 Thread Bron Gondwana
On Wed, May 17, 2006 at 03:40:17PM -0400, Patrick Radtke wrote: when we switch we comment out the sync_server line on the replica to make sure it won't listen. We have a as master config and an as slave config - and switch them via symlinks. Similar basic concept though - or at least it will

Some imapd processes getting permission denied setting flags

2006-05-18 Thread Bron Gondwana
This one is really strange. I've just recently upgraded one of our old Redhat 7.3 servers from Cyrus 2.2.something CVS to Cyrus 2.3.3. We're getting lots of users unable to mark messages read or deleted. Now, our code works by adding the 'selected' flag to whatever messages it wishes to act

Re: cyrus 2.3.3 change + solved: permission denied setting flags

2006-05-18 Thread Bron Gondwana
On Fri, May 19, 2006 at 02:40:11AM +1000, Robert Mueller wrote: [...] saying that it's in [READ-WRITE] mode on an examine while previously it used to say [READ-ONLY]. Is that an expected behaviour change, or a bug? And if it's expected, then why was it saying Permission denied when our code

Re: Removing Shared Folders

2006-05-19 Thread Bron Gondwana
On Fri, May 19, 2006 at 04:19:13PM -0400, David Korpiewski wrote: Hi all, While shared folders might be a cool concept, I don't really want my users randomly creating them on the mail server. Is there any way to pernamentally disable them? I didn't see an option in the man pages for

Cyrus Patches used at FastMail.FM

2006-05-22 Thread Bron Gondwana
I've finally split out all the patches that we use here into individual items. I know some people were interested in the don't allow users to set the anyone ACL patch as well. http://cyrus.brong.fastmail.fm/ Ken - I'd love to work with you on getting as many as possible of these into upstream,

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
. OK Completed (2 msgs in 0.000 secs) Message appears in search index. . uid fetch 185 rfc822 . OK Completed (0.000 sec) Any attempt to retrieve message body data returns nothing :( Rob -- Bron Gondwana [EMAIL PROTECTED] diff -ur cyrus-imapd-2.3.5/imap/append.c cyrus-imapd-2.3.5

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
certainly fine for those of us where modseq will always be 1. Bron. On Thu, 25 May 2006 17:16:17 +1000, Bron Gondwana [EMAIL PROTECTED] said: I suspect what you're looking for is in the patch attached to this message. You forgot (entirely) to put modseq code in the append_copy path. Since

Re: Cyrus IMAPd 2.3.4 Released

2006-05-25 Thread Bron Gondwana
corrupt indexes in a release. Bron ( who shouldn't have blindly gone ahead and rolled out the latest code either, even just to one server... ) -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
of us where modseq will always be 1. Bron. On Thu, 25 May 2006 17:16:17 +1000, Bron Gondwana [EMAIL PROTECTED] said: I suspect what you're looking for is in the patch attached to this message. You forgot (entirely) to put modseq code in the append_copy path. Since modseq appears

Re: Cyrus IMAPd 2.3.4 Released

2006-05-25 Thread Bron Gondwana
users we retain the UIDVALIDITY so my entire offlineimap store doesn't get stale next time) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-25 Thread Bron Gondwana
in that case too - because modseq should always have a non-zero value, and if it doesn't then the value of highestmodseq is probably 1 anyway, so 1 is still a better answer than 0. Release early, release often - isn't that what they say. Numbers are cheap. Bron. -- Bron Gondwana [EMAIL

Re: Some part of bug from 2.3.4 still in 2.3.5

2006-05-26 Thread Bron Gondwana
have one when in reconstruct mode. I don't know enough about reconstruct to go the alternative route (actually creating a cache_fd back up in mailbox_open_index) This is fine for us, because we generally lock users from logging in when we're running reconstructs on them anyway. Bron. -- Bron

Re: Cyrus Patches used at FastMail.FM

2006-05-27 Thread Bron Gondwana
what you were told. The middle ground is to accept the message, store it as is and ignore the stuff you don't understand when building indexes. Erm.. but I rant. Sorry about that. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ

Re: Replicate to more than one replica?

2006-06-08 Thread Bron Gondwana
On Wed, Jun 07, 2006 at 11:52:16AM +1200, Roland Pope wrote: Bron Gondwana wrote: Unless sync_server is logging all its actions to sync_client then this is a bit pointless, Replica2 will never have anything automatically sent to it. A quick grep of my 2.3.6 source directory suggests

Replication is broken with modseq issue in 2.3.6

2006-07-05 Thread Bron Gondwana
If I sound a little bitter, it's because I was up until 5:30am the other night after a hardware failure left us with corrupted filesystems on our master server, and fetching old messages from the replica returned blank responses. We eventually discovered that reconstruct could fix it, and 36(!!)

Re: Replication is broken with modseq issue in 2.3.6

2006-07-06 Thread Bron Gondwana
on undocumented behaviour is a stupid long-term strategy. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Replication is broken with modseq issue in 2.3.6

2006-07-06 Thread Bron Gondwana
On Thu, 06 Jul 2006 17:17:39 -0400, David S. Madole [EMAIL PROTECTED] said: On 05 Jul 2006, at 02:54, Bron Gondwana wrote: If you're running replication on any post 2.3.3 cyrus, your replica contains indexes with '0' as the modseq value. This means that your messages will not be fetchable

Re: [POLL] Cyrus 2.3.x and CONDSTORE

2006-07-08 Thread Bron Gondwana
On Fri, Jul 07, 2006 at 10:54:13AM -0400, Ken Murchison wrote: The reason I ask is that I want to push out a 2.3.7 release ASAP which contains a number of important bugfixes, but I've realized that the replication protocol doesn't have any support for the metadata that is used by CONDSTORE.

Re: Performance and cheap storage

2006-08-05 Thread Bron Gondwana
On Fri, Aug 04, 2006 at 03:26:39PM +1000, Robert Mueller wrote: Anyway the good news: Before: 2 frontend servers with 7000+ connections (eg 14,000+ total) using 6G of RAM with a load on each of about 2 After: 1 frontend server with 14,000+ connections, less than 1G of RAM usage, load of

Re: Performance and cheap storage

2006-08-05 Thread Bron Gondwana
On Sat, 5 Aug 2006 16:02:44 -0700 (PDT), David Lang [EMAIL PROTECTED] said: On Sat, 5 Aug 2006, Bron Gondwana wrote: Your frontend only can make connections out using any port it likes, but there are only 65k of them, and at any one time, a fraction of those will be tied up doing other

Re: [Cyrus-CVS] src/cyrus by jeaton

2006-08-06 Thread Bron Gondwana
On Wed, Aug 02, 2006 at 12:12:05AM -0400, [EMAIL PROTECTED] wrote: Update of /afs/andrew.cmu.edu/system/cvs/src/cyrus In directory mail5.andrew.cmu.edu:/afs/andrew.cmu.edu/system/src/local/cyrus/111 Modified Files: Tag: cyrus-imapd-2_3 SMakefile Log Message: cmu changes

Re: Performance and cheap storage

2006-08-08 Thread Bron Gondwana
On Mon, Aug 07, 2006 at 05:59:33PM +0200, Phil Pennock wrote: On 2006-08-07 at 12:15 -0300, Henrique de Moraes Holschuh wrote: On Mon, 07 Aug 2006, Kjetil Torgrim Homme wrote: I think David is missing the issue: it's the proxied connection which is problematic, not the connection to the

Re: Performance and cheap storage

2006-08-08 Thread Bron Gondwana
On Mon, Aug 07, 2006 at 10:47:10PM +0200, Phil Pennock wrote: On 2006-08-07 at 19:23 +0200, Hack Kampbjorn wrote: Phil Pennock wrote: The easy fix is theoretically to configure up extra private addresses as aliases on the backend, and distribute the load over all of them. This avoids

Re: [Cyrus-CVS] src/cyrus by jeaton

2006-08-09 Thread Bron Gondwana
On Wed, 9 Aug 2006 21:01:17 -0400, Jeffrey T Eaton [EMAIL PROTECTED] said: On Aug 6, 2006, at 11:31 PM, Bron Gondwana wrote: On Wed, Aug 02, 2006 at 12:12:05AM -0400, [EMAIL PROTECTED] wrote: Update of /afs/andrew.cmu.edu/system/cvs/src/cyrus In directory mail5.andrew.cmu.edu:/afs

Re: 2.3.7 replica with multiple partitions?

2006-08-16 Thread Bron Gondwana
will have two Cyrus instances (slave to 2 masters). Interesting, what's your failover scenario? Master on the Sun while you bring up a new HP/storage unit, or just suspend those accounts while you recover to a master? -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http

Re: OT: Mulberry availiable again and for free

2006-08-21 Thread Bron Gondwana
://asg.web.cmu.edu/cyrus/mailing-list.html -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Multiple username/passwords pointing to the same mailbox .. possible?

2006-08-21 Thread Bron Gondwana
domain split them. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

sync_client bails out after 3 MAILBOXES need upgrading to USER in one run

2006-08-26 Thread Bron Gondwana
for me - start over with the whole list of unmarked folders again without incrementing the failure count. It can't stave (always one more folder marked per loop) but it sure could get slow if every folder was a subfolder for a user that hadn't been created yet. Regards, Bron. -- Bron Gondwana

Another sync-client issue

2006-08-26 Thread Bron Gondwana
and is an unreachable path. Bron. -- Bron Gondwana [EMAIL PROTECTED] cyrus-perm-check-uniqueid.diff.proposed Description: Binary data Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-26 Thread Bron Gondwana
files, etc. All of this drops out pretty easily from a pattern which produces a single log file per day and calls the sync_client fork children with a byte-range on the log file to run rather than moving the file and then running the copy. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-26 Thread Bron Gondwana
On Sat, Aug 26, 2006 at 08:32:24PM -0400, Wesley Craig wrote: On 26 Aug 2006, at 16:22, Paul Dekkers wrote: I don't know if this is a known issue: as soon as I enable replication and the sync_client gets a No route to host from the replica, the rest of the cyrus startup seems to stall: no

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-28 Thread Bron Gondwana
On Mon, Aug 28, 2006 at 02:19:31PM -0400, Wesley Craig wrote: On 26 Aug 2006, at 21:42, Bron Gondwana wrote: Though it is dying less as we discover bugs and patch them. See my post last night (au time) about the three MAILBOX - USER promotions and you're out issue. That's the first thing

Re: failover scenario's for replication

2006-08-28 Thread Bron Gondwana
On Mon, Aug 28, 2006 at 02:23:22PM -0400, Wesley Craig wrote: On 26 Aug 2006, at 16:09, Paul Dekkers wrote: Right now, it looks tricky to me to enable replication after failover, or the replicated machine itself if you're not sure that the replica is identical and the sync-processes

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-08-29 Thread Bron Gondwana
On Tue, 29 Aug 2006 09:51:49 +0100 (BST), David Carter [EMAIL PROTECTED] said: On Sun, 27 Aug 2006, Bron Gondwana wrote: To tell you the truth, I'm seriously considering writing a replacement to sync_client that does a bunch of different things including multiple replicas, maintaining

Re: Problems with a crashed BDB

2006-08-30 Thread Bron Gondwana
Luckily for you, you haven't lost any actual emails, just meta data. The emails are still on the disk as individual files. Do you know which specific DB file is corrupted? You can probably nuke deliver.db at start up (we do). Worst case, just move your mailboxes.db somewhere else and run

sync_server memory leak with giant new mailbox first sync

2006-09-10 Thread Bron Gondwana
on that drive unit, so debugging was more of a pain than you'd hope. I hope something inspired by this can be merged upstream to solve the spam sync_server until it falls over failure mode. Bron. -- Bron Gondwana [EMAIL PROTECTED] diff -ur --new-file cyrus-imapd-cvs/imap/sync_client.c cyrus

Re: sync_server memory leak with giant new mailbox first sync

2006-09-12 Thread Bron Gondwana
contains no messages at all, which is somewhat worse in a failure situation where you actually need to cut over to the replica. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http

Re: sync_client bails out after 3 MAILBOXES need upgrading to USER in one run

2006-09-13 Thread Bron Gondwana
that sounds interesting, deleting a folder that has subfolders without deleting the subfolders as well... My urgent todo list is down to about 10 items now, and I'm sure at least one of those is easy :) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http

Re: Restrict cyrus admins to certain hosts

2006-09-18 Thread Bron Gondwana
may be an option. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sync_client stalls the rest of cyrus while 'no route to host'

2006-09-27 Thread Bron Gondwana
On Sat, Aug 26, 2006 at 10:22:15PM +0200, Paul Dekkers wrote: Hi, I don't know if this is a known issue: as soon as I enable replication and the sync_client gets a No route to host from the replica, the rest of the cyrus startup seems to stall: no imap, no lmtp... just because a replica is

Re: replication, how to see if it 'up to date'

2006-09-28 Thread Bron Gondwana
inconsistencies. Obviously, there's a possibility that it catches changes where sync_client just hasn't caught up yet, but it retries multiple times with a tunable delay, so generally it will get the same value on one of the retries unless the folder is seeing a lot of traffic. Bron. -- Bron Gondwana

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-16 Thread Bron Gondwana
On Thu, Nov 16, 2006 at 07:24:32PM +0300, Igor Zhbanov wrote: The main problem is to build a shared storage that can survive server crashes, where mail will be stored. I have found that MySQL-cluster is reliable and fast. My god. You are aware that MySQL-cluster only supports in-memory

Re: Cyrus IMAP and MySQL mailboxes (Building load-balancing cluster)

2006-11-17 Thread Bron Gondwana
On Fri, Nov 17, 2006 at 03:31:52AM +0300, Igor Zhbanov wrote: Yes, I need the cluster exactly. Have I lots of domains, I could store mailboxes of each domain on separate server. But I have only one big domain. So, I need to spread mailboxes on one domain across several servers. And than I need

[BUG] Replication synchronisation fails when message size on disk doesn't match index data

2006-11-25 Thread Bron Gondwana
that happens and we'll get in and fix things pronto. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] diff -ur --new-file cyrus-imapd-cvs.orig/imap/sync_client.c cyrus-imapd-cvs/imap/sync_client.c --- cyrus-imapd-cvs.orig/imap/sync_client.c 2006-07-26 20:03:15.0 -0400 +++ cyrus-imapd

Re: Replication and virtual domains revisited

2006-11-27 Thread Bron Gondwana
On Mon, Nov 27, 2006 at 04:21:56PM +0100, Rudy Gevaert wrote: Janne Peltonen wrote: Hi! I was wondering about replication and virtual domains. Last May, it wasn't supported yet: http://lists.andrew.cmu.edu/pipermail/info-cyrus/2006-May/021943.html -- the 2.3.7 from last July includes

Re: Bug with rename INBOX - INBOX.blah and replication

2006-12-04 Thread Bron Gondwana
. Hmm... Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: cyr_expire error

2006-12-18 Thread Bron Gondwana
is a patch we apply at FastMail (I really should mail the list with our full patch list again some time)... While this doesn't solve the underlying problem, it does stop a single corrupted mailbox from killing the entire cyr_expire run! Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED

Re: IMAP sync tool (rsync for IMAP)

2006-12-22 Thread Bron Gondwana
On Thu, Dec 21, 2006 at 03:47:26PM -0800, Florin Andrei wrote: Essentially, I need a tool that I can point at servers A and B and tell it get all the email from my account on server A to a specific folder on my account on server B, preserving the subfolders hierarchy. The tool needs to be

Re: IMAP sync tool (rsync for IMAP)

2006-12-26 Thread Bron Gondwana
not causing excessive IO for temporary files, and /tmp/ could very well be a memory disk anyway (we have /tmpfs/ for precisely this sort of purpose) (that and: unless your IMAP servers are really closely network connected the network IO is going to be your critical path anyway) Bron. -- Bron

Patches used at FastMail.FM - URL

2007-01-07 Thread Bron Gondwana
I guess it would be polite to send the URL again! Oops. http://cyrus.brong.fastmail.fm/ Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu

Patches used at FastMail.FM

2007-01-07 Thread Bron Gondwana
be nice if there was another 2.3 release that checkpointed some of those in time (*hint*, *hint*) but we're doing OK tracking CVS. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List

Re: Patches used at FastMail.FM

2007-01-08 Thread Bron Gondwana
On Mon, 08 Jan 2007 11:23:50 -0500, Ken Murchison [EMAIL PROTECTED] said: Bron Gondwana wrote: It's been a while since I posted our list of patches, and there have been a couple of changes since then. I'm generating the site from a script and a bunch of patch description files now, so

Re: Patches used at FastMail.FM

2007-01-09 Thread Bron Gondwana
On Tue, 09 Jan 2007 12:49:25 -0500, Ken Murchison [EMAIL PROTECTED] said: Bron Gondwana wrote: It's been a while since I posted our list of patches, and there have been a couple of changes since then. I'm generating the site from a script and a bunch of patch description files now, so

Re: Comments on remaining FastMail.FM patches

2007-01-09 Thread Bron Gondwana
to think some more to see if there might be a better solution. Fair enough. This is Rob's baby. We have noticed that it has timing issues due to only 1 second resolution on some things. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ

Re: Re[2]: Migrating Cyrus 2 Cyrus new hardware

2007-01-26 Thread Bron Gondwana
On Fri, Jan 26, 2007 at 05:07:28PM +0200, Kristaps Armanis wrote: Hello info-cyrus, Thursday, January 25, 2007, 6:38:17 PM, Jus rakstijat: New setup is 2 boxes each with 2 partitions each ~2T. RG What filesystem? ReiserFS, till know it worked good and fast with hell a lot of small files.

Re: Clustering and replication

2007-01-26 Thread Bron Gondwana
On Fri, Jan 26, 2007 at 12:20:15PM -0800, Tom Samplonius wrote: - Wesley Craig [EMAIL PROTECTED] wrote: Close. imapd, pop3d, lmtpd, and other processes write to the log. The log is read by sync_client. This merely tells sync_client what (probably) has changed. sync_client roll

Re: Clustering and replication

2007-01-29 Thread Bron Gondwana
On Mon, Jan 29, 2007 at 04:04:36PM -0800, Tom Samplonius wrote: sync_client prints errors from time to time, but most seem harmless. It certainly does not print anything like Exiting..., when it decides to quit. I don't really know which log lines are bad, or not. What do you consider a

Re: Running a shell command on update/creation of an item

2007-01-30 Thread Bron Gondwana
On Tue, Jan 30, 2007 at 12:31:58PM +0100, Jochem Meyers wrote: Hi all, Currently, I'm trying to build an application involving synchronizing some data stored in a cyrus imap store (as messages with attachments) to an sql database. To accomplish this, I would like to have cyrus run a shell

Potential replica message file corruption/replacement

2007-02-15 Thread Bron Gondwana
before trying to create a new one (Bron Gondwana) --- links to diffs follow --- http://bugzilla.andrew.cmu.edu/cgi-bin/cvsweb.cgi/src/cyrus/imap/sync_support.c.diff?r1=1.2r2=1.3 ... here's what our cyrus patches page has to say about it: Our automated check scripts compare message bodies

Re: Moving mail into IMAP server and the Received date

2007-02-19 Thread Bron Gondwana
On Mon, Feb 19, 2007 at 08:51:10AM -0500, Joseph Brennan wrote: Ideally you might be able to find a client that sends internaldate when it moves mail from local to server. The catch is that since so many clients, like Thunderbird, do not use internaldate to sort, they probably don't preserve

FastMail.FM patchset updated

2007-02-19 Thread Bron Gondwana
into a /patches/ directory. Of interest: the sync_server unlink patch (accepted upstream) and support for a few new windows codepages so search for those users works. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http

Re: FastMail.FM patchset updated

2007-02-23 Thread Bron Gondwana
On Thu, Feb 22, 2007 at 10:07:51PM +, Matt Bernstein wrote: At 16:00 -0500 Ken Murchison wrote: I still don't understand why the allow-plaintext-for-sync_client patch is needed. Doesn't 'sync_server -p2' accomplish the same thing? I was bitten by this today, and saw you mention

FastMail.FM patchset - new patches

2007-03-14 Thread Bron Gondwana
slower writes for the seen DB. Guess what our users do more of. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: FastMail.FM patchset - new patches

2007-03-15 Thread Bron Gondwana
:( Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Message retention policies

2007-03-16 Thread Bron Gondwana
On Fri, Mar 16, 2007 at 12:16:21PM +1300, Malcolm Locke wrote: On Thu, Mar 15, 2007 at 04:24:00PM -0600, Jason Bailey, Sun Advocate Webmaster wrote: Is it possible to set up a message retention policy that deletes email that is, say, over a year old from the mailboxes on the server? I

Re: sync_client doesn't sync sieve scripts

2007-03-27 Thread Bron Gondwana
On Tue, Mar 27, 2007 at 02:48:00PM +0400, Dmitriy Kirhlarov wrote: On Tue, Mar 27, 2007 at 09:44:56AM +0100, David Carter wrote: On Mon, 26 Mar 2007, Dmitriy Kirhlarov wrote: I have properly configured sync between two cyrus-imapd 2.3.8 servers. Mailboxes rolling synchronization work

Re: Plain text dump of cyrus.index?

2007-04-03 Thread Bron Gondwana
On Sun, Apr 01, 2007 at 07:30:11PM -0400, Miller, Greg wrote: Hello, I found myself in a the situation where I need to do the opposite of a reconstruct on my mailboxes. That is, instead of rebuilding the cyrus.* files to reflect the messages on the file system, I want to query the

Re: FastMail.FM patchset - new patches

2007-04-05 Thread Bron Gondwana
On Thu, Mar 15, 2007 at 04:12:11PM +1100, Bron Gondwana wrote: All the patches mentioned here are available for download at: http://cyrus.brong.fastmail.fm/ We've been busy working on a bunch of cyrus issues since I last posted. In particular things we have hit cleaning up from

Re: Recomendations for a 15000 Cyrus Mailboxes

2007-04-11 Thread Bron Gondwana
On Tue, Apr 10, 2007 at 04:58:23PM +0200, Timo Schoeler wrote: On Tue, 10 Apr 2007 06:56:43 -0500 1. Linux LVM over a 600 GB RAID 10 ( 4 x 300 GB) 2. Which filesystem seems to be the better ? ext3 ? xfs ? reiserfs ? Do NEVER use XFS on GNU/Linux. (C)XFS is a brilliant FS on sgi's

Re: Recomendations for a 15000 Cyrus Mailboxes

2007-04-11 Thread Bron Gondwana
On Wed, 11 Apr 2007 07:51:57 -0700, David R Bosso [EMAIL PROTECTED] said: --On April 11, 2007 8:26:37 PM +1000 Bron Gondwana [EMAIL PROTECTED] wrote: We also apply one patch to reiserfs. It's a one liner, using generic_write rather than the Hans Reiser special (5% faster, can

Re: remove entry from deliver.db

2007-04-14 Thread Bron Gondwana
On Fri, Apr 13, 2007 at 11:25:08AM -0700, Andrew Morgan wrote: On Fri, 13 Apr 2007, Derek T. Yarnell wrote: On Thu, 2007-04-12 at 13:40 -0400, Greg A. Woods wrote: At Thu, 12 Apr 2007 11:32:49 -0400, Derek T. Yarnell wrote: Subject: remove entry from deliver.db Is there a way to remove an

Re: last cyrus login date

2007-04-16 Thread Bron Gondwana
On Mon, Apr 16, 2007 at 11:13:54AM -0500, Blake Hudson wrote: John M. Crawford wrote: Blake, I'm wondering about the same thing... Did you come up with a nice method to determine last login event? thanks, John I have not yet put in the effort into making a system to do this. It may

Re: syncserver[4715]: Fatal error: Virtual memory exhausted

2007-04-18 Thread Bron Gondwana
On Tue, Apr 17, 2007 at 04:28:04PM -0400, Wesley Craig wrote: You probably encountered a single very large mailbox. This patch: --- cyrus-imapd-2.3.8/imap/sync_support.c 2006-11-30 12:11:20.0 -0500 +++ cyrus-imapd-2.3.8p3/imap/sync_support.c 2007-04-12 13:27:49.0

Building Cyrus with GCC 4.0+ (Debian Etch), autoconf issues

2007-04-24 Thread Bron Gondwana
I'm in the process of rebuilding all our packages to target Debian Etch rather than Debian Sarge so we can switch our infrastructure forwards once I'm happy it's all stable. Our Cyrus build is one of the most tricky ones, so I thought I should compare config.h and the output of running configure

Re: mail coming without MX; how ?

2007-04-28 Thread Bron Gondwana
On Thu, Apr 26, 2007 at 09:10:35AM +0200, Jukka Salmi wrote: Andrew McNamara -- info-cyrus (2007-04-26 16:16:49 +1000): if you check the domain infoservices.in with dnsstuff.com you can see no MX for that domain. But still mail is coming at [EMAIL PROTECTED]we are using it for our

Re: copying and renaming mailboxes to clean up directories

2007-05-02 Thread Bron Gondwana
On Wed, May 02, 2007 at 03:11:03PM +0200, Thorsten B?ker wrote: Dear all, But wondering about the heavily increased amount of partition in use, I noticed that my call of rsync lacked of the --delete attribute. In consequence the restored mailbox directories include not only the messages,

Re: Recomendations for a 15000 Cyrus Mailboxes

2007-05-10 Thread Bron Gondwana
On Thu, May 10, 2007 at 08:30:11AM -0400, Nik Conwell wrote: On Apr 11, 2007, at 8:37 PM, Bron Gondwana wrote: As for complexity? It's on the cusp. We've certainly had many more users on a single instance before, but we prefer to keep under 10k users per Cyrus instance these days

Re: Replication and failover

2007-05-11 Thread Bron Gondwana
On Thu, May 10, 2007 at 12:14:44PM -0400, Nik Conwell wrote: Do you have separate IP addresses for each instance of cyrus on the machine as well, or just the machine itself? If just the machine, what 'names' does the front-end know the back-end instances by? Every store has an IP address

Re: load balancing at fastmail.fm

2007-05-11 Thread Bron Gondwana
On Thu, May 10, 2007 at 09:49:01AM -0400, Nik Conwell wrote: On Jan 12, 2007, at 10:43 PM, Rob Mueller wrote: Yep, this means we need quite a bit more software to manage the setup, but now that it's done, it's quite nice and works well. For maintenance, we can safely fail all masters

Re: System I/O errors?

2007-06-17 Thread Bron Gondwana
On Sun, Jun 17, 2007 at 06:49:17PM +0200, Anders Norrbring wrote: Inside the dir I see this; -rw--- 1 cyrus mail 30049 May 28 22:24 34. -rw--- 1 cyrus mail 3206 Jun 2 11:09 35. -rw--- 1 cyrus mail 19310 Jun 6 01:20 36. -rw--- 1 cyrus mail 2696 Jun 7 15:15 37. -rw---

Re: cyrus 2.3.8, internal dates not stored in message file time ?

2007-06-21 Thread Bron Gondwana
On Thu, Jun 21, 2007 at 09:07:07PM +0200, Nicolas KOWALSKI wrote: Hello, I am testing a new cyrus 2.3.8 installation. I have noticed that copying messages from one folder to another one does keep messages internal dates but does not set message files write time in the destination folder,

Re: Backup $CONFIDIRECTORY/proc?

2007-07-30 Thread Bron Gondwana
On Mon, Jul 30, 2007 at 11:20:46AM -0700, Ross Boylan wrote: http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/Backup doesn't mention it, but should I backup $CONFIGDIRECTORY/proc? No - the only things in there are files showing which process IDs are connected by which user and what folder is

Re: Old replication logs

2007-08-09 Thread Bron Gondwana
On Thu, Aug 09, 2007 at 02:08:11PM +0300, Janne Peltonen wrote: Hi! It appears that is a cyrus system is forcibly shut down, there is a replication log left (if the replica system wasn't up at the time). Now, is it safe to delete the log? What about the transactions that are in the log, is

Re: Replication to more than one replica?

2007-08-10 Thread Bron Gondwana
On Fri, Aug 10, 2007 at 01:24:29PM -0400, Wesley Craig wrote: With such a small number of users, you might be all set. Keep in mind that -u only gets users, not shared mailboxes not associated with any user. In UMich's system, we just run tape backups on the replica, no need for a

[PATCH] Changing folder paths on disk to support fast-rename

2007-08-21 Thread Bron Gondwana
the raw upstream source. I hope to post my entire quilt series once I fix the one thing that has a FastMail specific key encoded in it to use a config option instead. -- Bron Gondwana [EMAIL PROTECTED] Index: cyrus-imapd-2.3.9/imap/mailbox.c

Updated FastMail patches

2007-08-24 Thread Bron Gondwana
Hi, I've pushed out latest patches (the quilt series against 2.3.9) out to the website. I've fixed the DELETED issue per David's email. I haven't yet finished the rehash stuff, sorry. It's more complex than I thought, and the perl code that's there is pretty brittle. It doesn't extend nicely

Re: [PATCH] Changing folder paths on disk to support fast-rename

2007-08-29 Thread Bron Gondwana
On Tue, Aug 21, 2007 at 11:30:45PM +1000, Bron Gondwana wrote: This is a very small patch for a very big change (and incomplete, it doesn't alter rehash, dohash, etc) Now updated with a working rehash. dohash and undohash I just removed - they are subsets of the functionality of rehash. http

Re: storing mail across several cyrus partitions

2007-09-03 Thread Bron Gondwana
On Mon, Sep 03, 2007 at 07:54:25PM +0700, Artem Bokhan wrote: Cyrus puts one folder on one partition. you can put subfolders on other partitions, but you cant have two partitions connected with one folder. Cyrus has no way to decide where it would store the email on disk and it

Re: Replication and single instance store

2007-09-03 Thread Bron Gondwana
On Mon, Sep 03, 2007 at 05:36:15PM +0200, [EMAIL PROTECTED] wrote: Hello, With the latest 2.3.9 release, the rolling replication duplicates correctly single instance store messages on the replica ( as many hard links as recipients for the same message ). We have tried to re-initialize

Re: Replication and single instance store

2007-09-04 Thread Bron Gondwana
On Tue, 4 Sep 2007 09:15:32 +0100 (BST), David Carter [EMAIL PROTECTED] said: On Tue, 4 Sep 2007, Bron Gondwana wrote: for all the users across which the single instance store needs to apply, then run 'sync_client -r -f $file'. I typically use -u -f to do this. However: Creating

Re: Replication and single instance store

2007-09-04 Thread Bron Gondwana
On Tue, 4 Sep 2007 10:09:40 +0100 (BST), David Carter [EMAIL PROTECTED] said: On Tue, 4 Sep 2007, Bron Gondwana wrote: Ah - yeah, that's right. Except that the restart only got negotiated after each folder was processed, and if you're pushing a new folder with 200,000 messages (say

Re: masters signals cyr_expire to death by 11

2007-09-05 Thread Bron Gondwana
On Wed, Sep 05, 2007 at 08:19:21AM +0200, Rudy Gevaert wrote: Thank you for the responds. I'll try to run reconstruct on the mailbox. And I hope to upgrade to 2.3.9 soon, I'm already running a small instance with a couple of your patches Bron. But I still got 6 to upgrade and those are

Re: squatter problem

2007-09-05 Thread Bron Gondwana
On Wed, Sep 05, 2007 at 03:15:33PM -0400, Robert Banz wrote: On Sep 5, 2007, at 14:49, Michael D. Sofka wrote: On Wednesday 05 September 2007 09:44:16 am Robert Banz wrote: Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 454541 local6.debug] skipping mailbox user/a28/Spam Sep

Re: Cyrus 2.3.8 thanks for help

2007-09-12 Thread Bron Gondwana
/caching behaviour - a quote the FastMail guys find all the interesting bugs :) Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus replication problems

2007-09-12 Thread Bron Gondwana
to a fault-tolerant tool that can be used without significant effort into maintaining it. That said, once you have that infrastructure around it, it works pretty well most of the time. Be glad you didn't live through the really buggy early days! Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus

Re: Cyrus replication and file system problem

2007-09-16 Thread Bron Gondwana
synchronisation and restart sync_client after replica restarts. There's no polite shutdown mode. Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus

  1   2   3   4   5   6   7   8   9   10   >