Re: tool for migration to cyrus ?

2006-07-17 Thread Robert Banz
I found the mailutil program, which is distributed in the UW imapd distribution, particularly well suited for this. It allows you to transfer the contents of one c-client supported mail hierarchy to another, such as a local mail store to a cyrus-hosted IMAP space. The 'transfer'

Re: Cyrus::SIEVE::managesieve documentation?

2006-07-19 Thread Robert Banz
On Jul 19, 2006, at 11:23, Chris St. Pierre wrote: Ditto here. I tried emailing the guy listed in the Cyrus::SIEVE::managesieve man page, but the address no longer appears to be active. As of now, my options appear to be: 1. Learn Ruby, and write the first (and probably last) Ruby script

Re: hardware recommendations for MURDER?

2006-07-20 Thread Robert Banz
My personal leaning is towards Sun hardware with RHEL4 but I wanted to get some fresh opinions. Thought this topic worth a rehash since 2004 data is useful but not current enough IMO. (sun just announce a 3u dual proc 16G ram box with 24TB of disk space for ~$70k for example) I admit a

Re: Performance and cheap storage

2006-07-23 Thread Robert Banz
I'm not a postfix expert, however, if it's like any other MTA it's queue directory is usually what runs pretty hot. The first thing I would do is isolate the MTA-related stuff to a very fast piece disk that is *not* the same storage that houses you Cyrus mailboxes databases. The

Re: Idea for filtered access to cyrus

2006-08-02 Thread Robert Banz
Cyrus gets this and slices off the +filter= and places the value foo into a FILTER variable. On the mail delivery side: LMTP is changed to look for X-IMAP- FILTER headers and to store the value of the header as an IMAP flag. Assuming X-IMAP-Filter: foo then we add /filter=foo to the IMAP

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 12:40, Elizabeth Schwartz wrote: Is anyone happily running all of the above? All of the above except NIS? Any tuning hints? I'm running Solaris 10 (06/06), cyrus 2.3.7 (Blastwave build) , sendmail 8.13.8 (ditto), mailspool on a zfs filesystem, authenticating via NIS.

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 13:59, Elizabeth Schwartz wrote: There's a bug in ZFS regarding performance problems when fsync'ing file descriptors -- there's apparently going to be a patch coming real soon now -- your options are: Thanks! Ugh, that would be bad news. Except, I think the delay is

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 4:46 PM, Chaskiel M Grundman wrote: --On Thursday, October 05, 2006 04:13:18 PM -0400 Elizabeth Schwartz [EMAIL PROTECTED] wrote: http://www.gsd.harvard.edu/users/betsys/dapptrace.timed The interesting bit seems to be here: . . - mynewstate(0x165769,

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 10:05 PM, Kjetil Torgrim Homme wrote: On Thu, 2006-10-05 at 16:46 -0400, Chaskiel M Grundman wrote: mynewstate is taking 8s to run, and very little of the time is taken up in local subroutines. auth_unix.c:mynewstate calls getpwnam, and then iterates over all the groups

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 10:50 PM, Elizabeth Schwartz wrote: On 10/5/06, Igor Brezac [EMAIL PROTECTED] wrote: Already done. man imapd.conf :) unix_group_enable: 0 Cool :) I was looking at an older cyrus distribution that doesn't seem to have it... -rob Cyrus Home Page:

Re: very slow syncing, any ideas?

2006-10-20 Thread Robert Banz
On Oct 20, 2006, at 04:09, Michael Menge wrote: Hi, i had much better performance with mailutil from UW-Imapd. It uses the IMAP-protocol like imapscyn but is not a scipt but a binary program and uses the imap APPEND command and does noe checks to see wich E-Mails are on the new server.

Re: ZFS fsync performance and cyrus (was Patches used at FastMail.FM)

2007-01-08 Thread Robert Banz
On Jan 8, 2007, at 21:08, Rob Mueller wrote: We are using 2.3.7 on Debian Sarge. We will maybe move to solaris because of the features of ZFS. Does anyone know the status of ZFS + fsync performance problems? http://www.irbs.net/internet/info-cyrus/0610/0058.html Supposedly fixed in

Re: Connection throttling POP3.

2007-05-21 Thread Robert Banz
On May 21, 2007, at 21:50, Daniel O'Connor wrote: On Tuesday 22 May 2007 05:10, Matthew Schumacher wrote: I'm getting some spammer trying to guess usernames and passwords: I use the following to protect my SSH server (well not the SSH server per se, just me reading logfiles the next day)

Re: Connection throttling POP3.

2007-05-22 Thread Robert Banz
On May 22, 2007, at 10:34, Philip H. O'Neill wrote: We do the same but there is an issues. One File::Tail delays polling the log for up to 30 seconds unless you tell it otherwise. So it will allow a number of attempts before reading the log. If you increase the polling you add load to the

Re: Cyrus ZFS performance

2007-07-04 Thread Robert Banz
On Jul 4, 2007, at 12:59 PM, Vincent Fox wrote: Dale Ghent wrote: each with a zpool comprising of a mirror between two se3511s on our SAN... Sun recommends against the 3511 in most literature I read, saying that the SATA drives are slower and not going to handle as much IOPS loading. But

xfer problem - unified murder

2007-07-24 Thread Robert Banz
Hey all, I'm currently testing out a two-server + mupdate master unified murder cluster. I was testing the mailbox xfer functionality -- I created a mail box (this one empty), and tried to move it between servers and got this: Jul 24 16:09:57 ms4.mail.umbc.edu imap[15165]: [ID 813612

Re: rename bunch of folders [auf Viren überpr üft]

2007-08-01 Thread Robert Banz
On Aug 1, 2007, at 09:19, Hans Moser wrote: Hans Moser schrieb: If I do this outside IMAPd (i.e. by shell's mv command), I have to run reconstruct to repair mailboxes.db, right? First I remove the Spam dir in the file system. # rm -rf /var/imap/users/foo/Spam When I dump mailbox.db #

Odd mailbox xfer result

2007-08-07 Thread Robert Banz
Hi, I've got a 'traditional' Cyrus cluster, 2.3.8 running on Solaris x86. Everything seems to be fine, and we're about to go live and in production... however... Earlier today I was testing how well transferring my rather massive personal folder hierarchy from one backend server to

Re: Odd mailbox xfer result

2007-08-07 Thread Robert Banz
So, anyone seen anything like this before? I did some looking around on bugzilla, and nothing jumped out at me. Look for bug 2917 `xfer copies the last message instead of sieve scripts to the remote server'. The patch is there too. Wow, how did I miss that one? Thanks! -rob Cyrus

Re: SQUAT config

2007-08-14 Thread Robert Banz
Last question: i'm really not sure i understand what the benefit of having a SQUAT index is (aside from avoiding seeing SQUAT failed to open index file in the log). I mean, i get that it makes searching faster. But does this have to do with, let's say, clicking on a mailbox folder in a

Re: SQUAT config

2007-08-14 Thread Robert Banz
On Aug 14, 2007, at 9:32 PM, brian wrote: brian wrote: I'd like to index my mailboxes using squatter and have a couple of questions. ~groan~ I had one more question. The squatter man page says: -s Skip mailboxes whose index file is older than their current squat file (within a

Re: SQUAT config

2007-08-16 Thread Robert Banz
Yes, i see, that's to invoke it. But i'm also reading that the config must be in imapd.conf yet i've seen no example for the syntax to do so (nor what is required (or even suggested)). I'm also wondering how to have squatter run against all IMAP mailboxes. Do i need to specify them all

Re: SSL/TLS certificates with virtual domains

2007-08-23 Thread Robert Banz
How much configuration similarity does there have to be between the different config files? Can I change anything except for the tls_[*]_file directives? Thanks very much for the information! I think this could work for us. Make one master imapd.conf file with everything but the

sieve and date

2007-08-28 Thread Robert Banz
Following on to the sieve vacation discussion -- anyone have any interest in the sieve date extension? Sounds like it'd be awfully nice to have, for example, being able to wrap your vacation in a date- range conditional... -rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus

Re: sieve and date

2007-08-29 Thread Robert Banz
Here's the extension I'm referring to: http://tools.ietf.org/wg/sieve/draft-freed-sieve-date-index-06.txt On Aug 29, 2007, at 09:38, Jan Schneider wrote: Zitat von Robert Banz [EMAIL PROTECTED]: Following on to the sieve vacation discussion -- anyone have any interest in the sieve date

squatter problem

2007-09-05 Thread Robert Banz
Hidey ho everybody, So, one of my backend mailservers in my cyrus cluster is doing something silly: Sep 5 02:00:00 ms1.mail.umbc.edu master[29759]: [ID 392559 local6.debug] about to exec /local/cyrus/bin/squatter Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 621814

Re: squatter problem

2007-09-05 Thread Robert Banz
On Sep 5, 2007, at 14:49, Michael D. Sofka wrote: On Wednesday 05 September 2007 09:44:16 am Robert Banz wrote: Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 454541 local6.debug] skipping mailbox user/a28/Spam Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 454541 local6

Re: squatter problem

2007-09-05 Thread Robert Banz
Are you running the command line squatter as root? If so, then maybe there's a file early in the squatter run that's root owned and causing squatter to abort when run as the cyrus user - I'm afriad I don't know much about squatter, but that would be my first suspicion. Another theory - do

Re: Murder works wonderfully but alarms users

2007-09-10 Thread Robert Banz
Its much more productive to eliminate the complaining users and replace them with something less alarmist. On Sep 10, 2007, at 11:59, Gary Mills wrote: We have a Cyrus murder configuration with one proxy front-end and one storage back-end. I'm very pleased with it. However, users who

Re: Quick Utilities for getting into user mail file

2007-09-19 Thread Robert Banz
Currently, I'm modifying a pinerc file and running PC-Pine to do this if necessary. Are there any other tools available for this kind of quick and dirty mailbox manipulation? Modifying config files on a per-user basis is kind of a pain, and running webmail can be slow with huge

Re: delete messages from INBOX.Trash INBOX.Junk

2007-09-20 Thread Robert Banz
Going this same direction... With our previous mail system, we used to chug through our users' Spam Trash folders, and send them a weekly notification reminding them of the messages they had in these folders, and how many would be deleted in the next week. Anyone done something similar

Re: Cyrus 2.3.9: Errors compiling outside source directory

2007-09-23 Thread Robert Banz
I have a repository copy of the cyrus source, and build in an 'lndir'- d tree. Sadly, while building-outside-the-source tree should work fine, every once and awhile you run into gotchas like this which aren't work the time tracking down. lndir symlink trees give you almost the same

Re: duplicate messages

2007-09-28 Thread Robert Banz
it appears that after Cyrus gets the message it gets duplicated. Anyone have any suggestions? Sieve rules? I always think its because the users are staring at their mail clients cross-eyed. ;) Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ:

Nifty imapmagicplus usage

2007-10-03 Thread Robert Banz
So, I got an iPhone this week. Totally rocks -- even if I can't hack it. But, I was a bit frustrated by it showing *every* folder I had in its IMAP client. I mean, really, I'm not going to want to read my managers mathematica license information folder while I'm sportin' the iPhone

Re: LARGE single-system Cyrus installs?

2007-10-04 Thread Robert Banz
One of the things Rob Banz recently did here was to move the data/ config/proc directory from a real fs to tmpfs. This reduces the disk IO from Cyrus process creation/management. So the way we do stuff here is that each Cyrus backend has its own ZFS pool. That zpool is divided up into four

Re: LARGE single-system Cyrus installs?

2007-10-05 Thread Robert Banz
On Oct 5, 2007, at 10:01, John Madden wrote: I think that this is partly because ext3 does more aggressive read ahead (which would be a mixed blessing under heavy load), partly because reiserfs suffers from fragmentation. I imagine that there is probably a tipping point under the

Re: Cyrus infrastructure performance less than expected

2008-04-28 Thread Robert Banz
I don't have any system log that complains about something and the only Cyrus message I got is a DB4 warning about lockers. I think the DB4 in question is the TLS sessions cache DB and in my case the number of lockers can be as high as 8 000... Dump Berkeley DB with a quickness, and

Re: choosing a file system

2008-12-30 Thread Robert Banz
On Dec 30, 2008, at 8:49 AM, LALOT Dominique wrote: Hello, We are using cyrus-imap for a long time. Our architecture is a SAN from EMC and thanks to our DELL support we are obliged to install redhat. The only option we have is to use ext3fs on rather old kernels. We have 4000

Re: choosing a file system

2008-12-30 Thread Robert Banz
On Dec 30, 2008, at 9:06 AM, Pascal Gienger wrote: LALOT Dominique dom.la...@gmail.com wrote: zfs (but we should switch to solaris or freebsd and throw away our costly SAN) Why that? SAN volumes are running very fine with Solaris 10 hosts (SPARC and x86). You have extended

Re: choosing a file system

2009-01-08 Thread Robert Banz
On Jan 8, 2009, at 4:46 PM, Bron Gondwana wrote: On Thu, Jan 08, 2009 at 08:01:04AM -0800, Vincent Fox wrote: (Summary of filesystem discussion) You left out ZFS. Sometimes Linux admins remind me of Windows admins. I have adminned a half-dozen UNIX variants professionally but keep

Re: choosing a file system

2009-01-08 Thread Robert Banz
There's a significant upfront cost to learning a whole new system for one killer feature, especially if it comes along with signifiant regressions in lots of other features (like a non-sucky userland out of the box). ... The non-sucky userland comment is simply a matter of preference, and

Re: Implement Cyrus IMAPD in High Load Enviromment

2009-09-29 Thread Robert Banz
With my ever-growing experience with these things, I'm tending to think that application-level HA solutions are a much more robust way of dealing with the potential failure modes of hardware or software. While this doesn't mean you shouldn't buy reasonably robust hardware (not the cheapest

Re: Cyrus Aggregator

2010-01-11 Thread Robert Banz
Wow, did I miss something? It's not called murder anymore? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: OT: Enhanced IMAP protocol

2010-01-14 Thread Robert Banz
An extension or protocol enhancement is only good as the client implementations are -- and we know how successful that's been for other optional capabilities -- such as ACL management. On Jan 14, 2010, at 9:42 AM, kael wrote: On 01/06/2010 08:47 AM, Rob Banz wrote: I would argue that it's

Re: Nginx configuration for imap

2010-03-17 Thread Robert Banz
memcached would certainly be fast, but what sort of authentication rate are you talking about here. My bet is that you've got other bits of system, such as the authentication validation with the target IMAP server, that will be more of a dominant term when it comes to the performance of your

Re: Nginx configuration for imap

2010-03-18 Thread Robert Banz
On Thu, Mar 18, 2010 at 3:49 AM, ram r...@netcore.co.in wrote: On Wed, 2010-03-17 at 22:45 -0700, Robert Banz wrote: memcached would certainly be fast, but what sort of authentication rate are you talking about here. My bet is that you've got other bits of system