[Dovecot] Good bye (and thanks for all the fish)
The management decided to switch over to Zimbra so we will no longer be using Dovecot...which served us exceedingly well. May Timo and the Dovecot community prosper. Thanks for all the help from all of you in the years since our switch from UW-IMAP. -- Grant us, in our direst need, the smallest gifts: the nail of the horseshoe, the pin of the axle, the feather at the pivot point, the pebble at the mountain's peak, the kiss in despair, the one right word. In darkness, understanding. Paladin of Souls by Lois McMaster Bujold -- Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] v2.0.beta6 released
But there's already a Finnish director :) Timo Sirainen wrote: http://dovecot.org/releases/2.0/beta/dovecot-2.0.beta6.tar.gz http://dovecot.org/releases/2.0/beta/dovecot-2.0.beta6.tar.gz.sig Unfortunately this still isn't rc1 yet, but the next one will be, I promise :) Basically all of the important changes are done now. The TODO list for rc1 is: - Test and fix dsync bugs - Finish director -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] message to imap users when connecting ?
With UWIMAP and TBird, if you had a file /etc/imap.alert (or some such, I forget), the message therein would pop up in a small window (the length of the text was severely limited) on the client when you did virtually anything, again and again. This would be valuable in the case of a campus-wide emergency/lockdown/etc. The behavior was really persistently in-your-face annoying amounting to making mail difficult to use (which could be a problem if a user is trying to send discrete emergency msgs to other individualstha ALERTs get in the way). Correct me if I am wrong (please), but the referenced measure seems like it would only popup at login (does it appear on the TBIRD client?). FWIW, Timo prototyped an reincarnation of that classic ALERT function here: http://www.dovecot.org/patches/1.1/imap-alert-plugin.c at my request, but I got sidetracked and never implemented it. Has anyone else implemented it? Steffen Kaiser wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Thu, 22 Apr 2010, Frank Bonnet wrote: Is it possible that a IMAP client (thunderbirs in my case) popup a message box containing a short message when a user connect to the server ? Is there such feature in Dovecot ? http://wiki.dovecot.org/PostLoginScripting see IMAP ALERT and the note Although note that not all clients show the alerts, even though IMAP RFC requires it. Regards, - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.6 (GNU/Linux) iQEVAwUBS9BXnL+Vh58GPL/cAQKDUgf/Y/Ae9eA9fZQhEnYAT+7sFteEHNVmLWXp k995OHsOCYSaLgReA5mmI0Aml4Cklu1GbdGtBKkr24jD1ygRjQTOYcu8oLKpgRG+ zVuATKf/F0evHGcrkQRPr0NYjR8EgwlM2MixOM+HEHzIyWUc21FYlwoubqeG99eD 7bhpGl46Zeq4lHerm+QdaZnXH1tV/T488isS9LTlreKklhv5l+d5nBulfif2LNd7 ZqvUhFXvvppezN88WbGRN8vT1b3ia2vRVXEnfyUiVFuPBumNriraZN95ZImJRk7Z 6qBLXLinPhBecsRMNUoL4s/0DLvSI5SVWHfFn5el5dWAbilnnF2IFQ== =9qic -END PGP SIGNATURE- -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Dovecot 1.2.8 problem on AIX
Back when (5-6 ? years ago) I first put DC on our AIX mail server, I thought to put it in the inted.conf file, as was the old UWIMAP invocation. But a) I had problems with that and b) people here informed me that it was much more efficient just to directly invoke it, so I put it in the /etc/rc.local file and it has knock on wood never failed to start and run cleanly. Sothis is an easy one with an easy answer. :) Jonathan Siegle wrote: Running revision 9492:3efdbaab2960(Mon Nov 23) on AIX 5.3. I run dovecot out of inetd. Every once in a while I get the following error: Dovecot is already running with PID 2592842 (read from /usr/ladmin/dovecot-1.2.8/var/run/dovecot/master.pid) when I try to connect to the imap port. -Jonathan -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Understanding migrateuser.sh
I'm sure it comes from my being a gormless idiot, but whatever is the
-UKWS argument immediately after the mb2md.pl invocation?
$MB2MD -UKWS -s $INBOX -d $WORKING
As always, reading the idiom of someone else's scripting is an
education. And some of it wouldn't work with native AIX sh/ksh, so
changed the functions:
folders_hash() {
local HASH=`find $FOLDERS -type f |sort|(IFS=\
;while read file; do ls -l \$file; done)`
eval $1=\$HASH\
}
to:
folders_hash() {
local IFS=\
local HASH=`find $FOLDERS -type f | sort | \
while read file
do
ls -l \$file
done`
# the escapes are so that $1 gets $HASH NOT $HASH
# So the resolution is deferred...
eval $1=\$HASH\
}
I would have wished for a few more comments within the script.
--
Once upon a time, the Internet was a friendly,
neighbors-helping-neighbors small town, and no one locked their doors.
Now it's like an apartment in Bed-Stuy: you need three heavy duty
pick-proof locks, one of those braces that goes from the lock to the
floor, and bars on the windows Stewart Dean, Unix System Admin,
Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax:
845-758-7035
Re: [Dovecot] Understanding migrateuser.sh
Thanks to Julian, I now understand that the mb2md exec downloadable from the wiki Migration/Mail Format page is NOT the same as the vanilla one (even though it has the same name) and it has these extra flags. For some reason I can download and unpack it just fine on my PC with WinZip but on AIX the tar barfs after the gunzip Thanks Julian! Stewart Dean wrote: I'm sure it comes from my being a gormless idiot, but whatever is the -UKWS argument immediately after the mb2md.pl invocation? $MB2MD -UKWS -s $INBOX -d $WORKING -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] mailutil question re: translating mbox folders to maildir
I need mailutil in order to use the mbox to maildir translation routines that are posted in the Dovecot wiki, but there is no mailutil with the AIX image... mailutil is apparently built as part of Pine, and indeed I can see it in the build tree from my V4.6.1 Pine build, which I still haveOTOH, my version of Pine is not patched for maildir. Will the native pine mailutil work with mb2md or does it have be a mailutil built in a patched Pine :) tree? Oh Tannebaum, oh Tannebaum -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Not understanding namespaces
I would be happy to involved in this as someone to read drafts for comprehension by an idiot (me). It's (somewhat) clear to me what the namespace concept could cover, as is the syntax, but just what they do and how they are used is utterly ambiguous. For instance: I think DC uses them to publish what mail folders are available, and I can see how ACLs could be used to limit access, but how does a user on a client (much less on webmail) find them, know which is which, use them, make them available in the IMAP client. It's like having a telephone without instructions or a phonebook...and never having used it before, knowing only that it can be used for communication. Well...maybe not *that* bad. And then there's the ambiguity/confusion of different usages of the word namespace used here and in Thunderbird...much less in C++ or XML! Try Goggling namespace! It's as bad as the words domain and alias Timo Sirainen wrote: On Sat, 2010-01-30 at 08:10 -0500, Jerry wrote: On Fri, 29 Jan 2010 23:26:40 +0200 Timo Sirainen t...@iki.fi articulated: Maybe we need a: Namespaces for Dummies books. I didn't realize namespaces were so difficult to understand for many people. I'll see if I can get the wiki page updated to describe them better. Seriously, I am surprised that someone has not written one all ready. There is a Getting Your Book Published for Dummies (Paperback) available. Perhaps I will purchase it and then (hopefully with Timo's help) publish a complete Dovecot for Dummies paperback. It might even help fund the Dovecot project. Dovecot book(s) would be nice too. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Want to have some users with Maildir, some with mbox
GREAT! Timo Sirainen wrote: Yes. Yes. :) Getting to Yes! :) Question 3: When converting existing users from mbox to maildir, should I delete the index contents? They'll be created into different directories. mbox is in .imap/ dirs, while Maildir doesn't use it. So you can delete the .imap/ dirs afterwards from wasting space. Does this mean that DC with Maildir doesn't use indices OR that it doesn't use that directory tree? Timo: Thanks SO much for your help. Do you still have an Amazon wish list :)? -- Grant us, in our direst need, the smallest gifts: the nail of the horseshoe, the pin of the axle, the feather at the pivot point, the pebble at the mountain's peak, the kiss in despair, the one right word. In darkness, understanding. Paladin of Souls by Lois McMaster Bujold -- Stewart Dean, Unix System Admin, Henderson Computer Center, Bard College, Annandale, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Not understanding namespaces
I have been diligently reading about namespace in the DC doc and what I can find in Google. Like the blind men and the elephant, I see the nature of some individual bits of namespace, some syntax and the overall purpose (overriding defaults and providing extensions), but I don't see the whole thing and how it is used. I am looking to do some maildir testing in what is a mbox default system, so I thought to employ namespace to do so. I see that namespace(s) can be defined in dovecot.conf and I see that it can be defined in TBird (under ServerSettings, Advanced Account Settings), but it isn't clear to me how they are made to work together. Some questions: - Is it that you can define multiple namespaces in dovecot.conf and then specify which of these you use in the TBird server settings? - What is the syntax of the TBird namespace specification? -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Want to have some users with Maildir, some with mbox
Want to have some users with Maildir, some with mbox, as I migrate from mbox format to maildir over the space of a month. After everyone is converted to maildir, I'll change the mail_location in dovecot.conf. During the interim, can I use the Custom mailbox location script (at the bottom of the Mail Location DC Wiki page)? if [ -d $HOME/.maildir ]; then export MAIL=maildir:$HOME/.maildir else export MAIL=mbox:$HOME/mail:INBOX=/var/mail/$USER fi Questions: 1) What does explicitly specifying MAIL this way override? The dovecot.conf mail_location variable? 2) My mail_location var is defined as: mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u and my prospective maildir INBOX and mail folder root is to be ~/Maildir. So would I change the above to: if [ -d $HOME/Maildir ]; then export MAIL=maildir:$HOME/Maildir:INDEX=/var/dcindx/$USER else export MAIL=mbox:$HOME/mail:INBOX=/var/spool/mail/$USER: INDEX=/var/dcindx/$USER fi Question 3: When converting existing users from mbox to maildir, should I delete the index contents? Thanks in advance! dovecot -n output # 1.2.8: /usr/local/etc/dovecot.conf # OS: AIX 3 0001378F4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no lda: postmaster_address: postmas...@example.com auth default: passdb: driver: pam userdb: driver: passwd -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Not understanding namespaces
Timo Sirainen wrote: Maybe your main confusion comes from Thunderbird's settings. It has almost nothing to do with Dovecot's namespaces. Golly! mutter muttermutter The namespace configuration in TB is mostly a workaround for some servers. I guess you've read http://wiki.dovecot.org/Namespaces? Again and again until I have a flat spot on my forehead from banging my head against the wall. What's there is perfectly understandable as far as it goes, but I'm having trouble with the larger context, things like: - How does a user (or client automagic) select or access among multiple namespaces? - Can they select more than one namespace, can they select from a hierachy, ex, could I have a mbox namespace first and if it's not found, fall down the hierarchy to a Maildir namespace -- Users have been complaining that their password is broken, so... We now offer Grade 5 10 Industrial Strength passwords of high-tensile strength alloy steel and titanium.. -- Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Anyone successfully setup Continous Backup of mailboxes using rsync ?
The answer, if you can sell the cost, might be network storage. Most of them provide the capability of take inode snapshots CoolAtt NNA wrote: Hi All.. Am working on continous backup of mailboxes using rsync(for e.g by running rsync every 2 min) Things gets more complicated when users create Subfolders in INBOX , SENT , etc.. If anyone among you did that plz guide advise. Thanks CoolAtt _ Your E-mail and More On-the-Go. Get Windows Live Hotmail Free. https://signup.live.com/signup.aspx?id=60969 -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Need simplest method for providing alternate mail location
I am looking to migrate my DC V1.2 from mbox to maildir formatand want to do this in stages, user group by user group rather than in one horrendous fell swoopsince I'd rather fell things didn't happen. Since I'm running sendmail/procmail, I can change the ~/.procmailrc to change the writing of the INBOX, but the IMAP mail location access info is knottier when one wants to do things a bit at a time. Setting aside for now the matter of converting existing folders, I will be moving: = from a mbox setup with the INBOX in /var/spool/mail/userid and the folders in ~/mail = to both in ~/Maildir (unless someone has better ideas) It seems that one could: 1) Change the namespaces in the client...but this is not feasible, because it would means going out to all my 4000+ users desktop and modifying them. 2) Having some sort of db to tell DC it a mail_userdb extra field and override the mail_location in dovecot.conf 3) Perhaps waiting for DC v2.0 which will have this architected in. A) Is there any sense the v2.0 will be coming Real Soon Now and will fulfill #3? B) What's the simplest way to implement #2? I would really rather not install MySQL on my mail server and have all the overhead of installing and managing it when all I need it for is a temporary resource to tell DC where things are until the switchover is complete and Maildir is the default. Is it feasible to do this with an additional flat file in the /etc/passwd mode with some extra fields tacked on that is *only* used for mail location info? Or some other and simple way? My apologies if this is a Stupid Question. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Moving
Now that you're back in your native land. . If and only if you're interested, I'D be interested in hearing what you thought of America: the things/customs that you thought were just plain wrong or stupid, the things/customs you liked, things that made you think, things that make you feel relieved to be back home I'm always curious about how others see my screwy country and its inhabitants... Timo Sirainen wrote: On 2.1.2010, at 23.18, Timo Sirainen wrote: I'm moving back to Finland tomorrow. It's probably going to take a week or so until things settle down and I'm again back to coding. And now I'm without internet at home, hopefully my mobile 3g connection opens in a few days.. And in any case I'll get cable modem by Saturday. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Moving
My apologies for posting this to the list; I meant to send it Timo only Now that you're back in your native land. . If and only if you're interested, I'D be interested in hearing what you thought of America -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Moving
Hope that the change in residence wasn't due to the insanity of America or any of its residents. Your work is a greatly appreciated wonder. If this was a world where exceptional achievement and effort were recognized and rewarded, the world would be at your feet along with a river of riches and anything else you desired. Of course... Be of good cheer. On 1/2/2010 4:18 PM, Timo Sirainen wrote: I'm moving back to Finland tomorrow. It's probably going to take a week or so until things settle down and I'm again back to coding.
Re: [Dovecot] Max IMAP fodlers
dunno about how DC does its quotas, but Berkely O/S filesystem quotas as implemented on IBM's AIX controls not only how much storage you can have but also how many inodes, with 1 inode per file or folder Jeffrey Nikoletich wrote: Is there a way to limit the amount of maildir folders a user can have? Also is there is hard limit on the amount of folders dovecot can handle? I have a user who has over 3000 folder (including subfolders) that is having issues with delays in loading, moving, and deleting messages. Thanks in advance Jeff N. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Ownership and permissions for the index directory/filesystem
I recently upgraded from DC 1.1.15 to 1.2.6. The /var/dcindx index root directory is: drwxrwsrwt 3962 root sys 192512 Nov 13 11:56 ./ thus 3777. It appears that the user index directories created under DC1.1 look like this (here for /var/dcindx/cep): drwx--S---5 cep sys 256 Nov 13 14:26 cep/ while those created under V1.2 look like: drwx--3 lrenart sys 256 Nov 12 14:59 lrenart/ It seems that the first time that DC goes to do indexing, I now see this error msg: Nov 12 11:45:15 mercury mail:err|error dovecot: IMAP(bpyi): open(/var/spool/mail/bpyi) failed: Permission denied (euid=2586(bpyi) egid=2000(bard2) missing +w perm: /var/spool/mail) ...but never again... Questions: 1) Are the ownership and permissions on the /var/dcindx index root directory ideal or should they be something else? 2) Ideally what should the ownership and permissions be for individual user subdirs? I create the user mail directories when creating a new account, so it would be little extra trouble to create and set the ownership and permissions. I am currently using mbox mailbox format but will be migrating to maildir over the next some months. Dovecot -n # 1.2.6: /usr/local/etc/dovecot.conf # OS: AIX 3 0001378F4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no lda: postmaster_address: postmas...@example.com auth default: passdb: driver: pam userdb: driver: passwd -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Seeing Corrupted transaction log file error messages.
In V1.1.15 that I fell back to. Again: # 1.1.15: /usr/local/etc/dovecot.conf # OS: AIX 3 0001378F4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1024 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd This is happening during peak load; the error msgs I'm seeing look like: Nov 5 15:01:47 mercury mail:err|error dovecot: IMAP(olson): Corrupted transaction log file /var/dci ndx/olson/.imap/INBOX/dovecot.index.log seq 742: file_seq=742, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:04:13 mercury mail:err|error dovecot: IMAP(herchenr): Corrupted transaction log file /var/ dcindx/herchenr/.imap/INBOX/dovecot.index.log seq 357: file_seq=357, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:04:13 mercury mail:info dovecot: IMAP(herchenr): Disconnected: Internal error occurred. Re fer to server log for more information. [2009-11-05 15:04:13] bytes=1314/18024 Nov 5 15:04:33 mercury mail:err|error dovecot: IMAP(olson): Transaction log file /var/dcindx/olson/ .imap/INBOX/dovecot.index.log: marked corrupted Nov 5 15:06:17 mercury mail:err|error dovecot: IMAP(olson): Corrupted transaction log file /var/dci ndx/olson/.imap/INBOX/dovecot.index.log seq 742: file_seq=742, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:06:17 mercury mail:err|error dovecot: IMAP(olson): Transaction log got desynced for index /var/dcindx/olson/.imap/INBOX/dovecot.index Is worrisome or inconsequential? About 40 such messages in 30 minutes, mostly clumped together -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Seeing Corrupted transaction log file error messages.
These may be happening to people with big (250MB) mbox folders Stewart Dean wrote: In V1.1.15 that I fell back to. Again: # 1.1.15: /usr/local/etc/dovecot.conf # OS: AIX 3 0001378F4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1024 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd This is happening during peak load; the error msgs I'm seeing look like: Nov 5 15:01:47 mercury mail:err|error dovecot: IMAP(olson): Corrupted transaction log file /var/dci ndx/olson/.imap/INBOX/dovecot.index.log seq 742: file_seq=742, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:04:13 mercury mail:err|error dovecot: IMAP(herchenr): Corrupted transaction log file /var/ dcindx/herchenr/.imap/INBOX/dovecot.index.log seq 357: file_seq=357, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:04:13 mercury mail:info dovecot: IMAP(herchenr): Disconnected: Internal error occurred. Re fer to server log for more information. [2009-11-05 15:04:13] bytes=1314/18024 Nov 5 15:04:33 mercury mail:err|error dovecot: IMAP(olson): Transaction log file /var/dcindx/olson/ .imap/INBOX/dovecot.index.log: marked corrupted Nov 5 15:06:17 mercury mail:err|error dovecot: IMAP(olson): Corrupted transaction log file /var/dci ndx/olson/.imap/INBOX/dovecot.index.log seq 742: file_seq=742, min_file_offset (24) hdr_size (40) (sync_offset=24) Nov 5 15:06:17 mercury mail:err|error dovecot: IMAP(olson): Transaction log got desynced for index /var/dcindx/olson/.imap/INBOX/dovecot.index Is worrisome or inconsequential? About 40 such messages in 30 minutes, mostly clumped together -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Question about Windows Mail for Vista IMAP client
When TBird logs on, it does it quietly, that is it opens one or two logins. When you start working it'll open a few more. Quiet, no thrashing around When WM4Vista opens, it appears to login and disconnect (immediately) once for every folder a person has. 20 folders, 20 logins and disconnect, ripple fire. Anybody have an idea why WM4V is so busy and TB is quiet doing the same thing? I fell over this doing testing on V1.2.6 but find it's also the case back on my production V1.1.15 -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Test environment question
I want to test out my first V1.2 Dovecot (upgraded from V1.1) instance. What I have in mind to do is to run it on another machine that has the Inbox dir and homedirs NFS import mounted from the production mailserver. I then have 5 people test it in this test environment A) Then I can deal with the index filesystem in one of two ways: 1) Make it local OR 2) NFS import it from the production DC server Comments as to which is best? I have used #1 before...which caused some temporary unhappiness with the switchover and switchbackduring which time the index is badly wrong and DC auto-rebuilds it... B) Is there anything else I should do/not do? C) Any ugliness that will surface in this testing lashup but isn't important? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Binary locations
ummm... I like the idea of an anchor as per Jim Redi anchor/sbin is for the dovecot daemon, anchor/libexec/dovecot is for supporting tools utilities anchor/lib is for dovecot's (shared) libraries anchor/etc is for config files ...I use /usr/local for that in my installation. Which means that, if upgrades (of the OS) do messy things to the contents of /etc/ or/bin or..., the dovecot stuff is in /usr/local/etc, /usr/local/bin or sbin and is left alone. And, of course, the anchor can be null. Timo Sirainen wrote: Where do you think the following binaries should be installed to? The possible locations are: - bin/ - sbin/ - libexec/dovecot/ (or lib/dovecot/ in most Linux distros) So the binaries are: 1) These probably belong to bin/ or sbin/ or both: - authtest - dovecotpw - doveadm 2) Binaries that you might want to call from mail_executable setting: - rawlog - gdbhelper 3) Index file dumping programs, mostly meant for debugging problems: - idxview - listview - logview - mailboxlogview - threadview 4) Some extra tools that might be useful sometimes: - imap-utf7 : Encode/decode IMAP mailbox names (mUTF-7 - UTF-8) - maildirlock : Lock a Maildir, primarily intended for compressing files in maildir And perhaps some of the binaries should be renamed? The authtest actually now looks like a bad name. Maybe it should have been doveauthtest or dovecot-authtest or ..? -- One must think like a hero to behave like a merely decent human being. - May Sarton Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Weird mirgration problem
Most likely non-Dovecot, but I'd appreciate any comments on WTF might be going on here. Preparatory to migration from mbox to maildir format on our AIX mail server, I am migrating from the JFS filesystem (being deprecated by IBM) to JFS2 to better handling the jump in the number of files. Two nights ago, I took the first step and migrated the IT homedir filesystem: copied it to a scratch disk, melted down the FS and recreated it as a JFS2 FS. In order to keep changes from happening to it during this process, I killed off DC (dovecot -n ouput is appended to bottom of this note) and dropped the export of the FS. The bringup was a little ragged due to time constraints and the fact that I had trouble re-establishing the export. FWIW, the homedirs and Inobx FSes are mounted by a majordomo mailing list server. Everything went fine except for an anomaly with old pre-existing mailing list emails in my INBOX and that of a few others. Note that the inbox FS wasn't touched by this process, just the homedir FS for the IT department. What happened there was that the mbox headers went from looking like this: From owner-hcrcstaff Mon Aug 24 14:53:29 2009 From majordom Mon Aug 24 14:53:29 2009 the rest of the normal header here To looking like this: From owner-hcrcstaff Mon Aug 24 14:53:29 2009 Status: RO X-UID: 871476 Content-Length: 1915 From majordom Mon Aug 24 14:53:29 2009 normal header lines here It appears that the Status, X-UID and Content-Length lines were inserted just under the top line of the header in every old mailing list mailing email header...and not in any other mailing As a result of this, = these emails appear in the email client's TOC listing with blank Sender and Subject fields, even though the data for that is properly in the header further down = This happens both in TBird and Horde webmail. = All these emails (some 300, going back to 2008) are listed in one block, in proper order for their actual date, as having the datestamp of 5AM, when I was bringing everything back up. Unfortunately, because of time pressures, I can say exactly what I was doing then. = I never took down my TBird session while doing this process...and I imagine that others, who haven't said anything and presumably didn't have this problem, left their TBird or IMAP email client up... Does this anomaly bring to mind anything to you? FWIW, I plan on doing the students' homedir FS early tomorrow morning. This time I'll be more scrupulous about tracking things AND I will take down the mailing list and login servers to remove the possibility that they had something to do with this... dovecot -n output # 1.1.15: /usr/local/etc/dovecot.conf # OS: AIX 3 0001378F4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1024 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] AIX and posix_fallocate
I bumped into this a while back, and having IBM support for both AIX and the C for AIX V9 compiler, went to the mat on it. What a pointless waste of time; the new IBM increasingly doesn't care about making things right. While IBM has been proclaiming its POSIX compliance, it turned out that AIX and the compiler development have been tasked with its implementation, such as it maybe, only on the JFS2 filesystem. Now they haven't discontinued JFS FS support, but it's a disinterested, neglectful support. Now in the old IBM, everything, but everything, would be tested in n! ways, and everything would work. In the posix_fallocate development, for both AIX and the IBM compiler, apparently nobody did nuffin' with it for the old JFS FS...so until I raised Hell, the call returned a random value error code. Which means that the design team didn't consider JFS at all; not even to the point of documenting non-suppport in JFS. Their charge was JFS2. So they figured out a fix: a patch to return a generic something-wrong errcode. I screamed some more. Their final fix was to return a function not supported errcode. There. Done. It only took 3-4 months. FWIW, the patch will be in the mainline Technical level as follows: This APAR will be available 53V (AIX 53 TL11 ) and 61H (AIX 61 TL4 ). Their POSIX compliance position: we would like to clarify you on below points on posix compliant details in AIX. Your comment: Obviously, if you don't support both of AIX's file systems, you are not totally compliant. Response: Unix standards for posix_fallocate( ) function does not state what all filesystems the implementation need to support. Having said that AIX implementation of posix_fallocate() only supports JFS2. Hence not supporting JFS does not mean that AIX implementation of posix_fallocate() is not posix compliant. However as stated earlier you can open a Design change request for AIX to implement the support of JFS. Regarding the list of non-posix compliant APIs we do not maintain any separate list nor we have any known issues. Developers can get information about APIs from IBM documentation http://publib.boulder.ibm.com/infocenter/pseries/v5r3/index.jsp and also looking through Open Group standards specification http://www.opengroup.org/onlinepubs/009695399/toc.htm Working with the Indian IBM support was intriguing: they were always courteous, but they were only interested in fulfilling checklists, not in making the product right or necessarily making it work. They didn't, as I have seen elsewhere, declare victory by closing out the trouble ticket (PMR in IBMese) without informing you or getting your consentbut they would continue talking and doing not much of anything until you gave up. What I now do is to: 1) run configure 2) edit config.h and put // in front of the HAVE_POSIX_FALLOCATE define, like this: //#define HAVE_POSIX_FALLOCATE 3) then run make as usual I'm sorry; I should have posted this before, but the whole thing left such a bad taste in my mouth all I wanted to do was move on. S. Ralf Becker wrote: Hi, AIX's implementation of posix_fallocate is a little bit, let me say, peculiar. Attached is a patch to fix (=work around) this. Without you'll see this in the logs: Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(beckerr): posix_fallocate() failed: File exists Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(beckerr): file_set_size() failed with mbox file /u/f0/rzuser/beckerr/Mail/Ham: File exists Funny, isn't it? This is what it should be: Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(beckerr): posix_fallocate() failed: Operation not supported on socket Jul 28 01:17:41 trevi mail:err|error dovecot: IMAP(beckerr): file_set_size() failed with mbox file /u/f0/rzuser/beckerr/Mail/Ham: Operation not supported on socket The problem is, that errno is not correcly set, when posix_fallocate returns EOPNOTSUPP (=Operation not supported on socket). In this case the return code has to be checked rather than errno. When patched dovecot handles err==EOPNOTSUPP the same way like errno==EINVAL on Solaris. A note for all AIX Admins: Without APAR IZ48778: POSIX_FALLOCATE() FAILS WITH ERROR-25(ENOTTY) resp. IZ46961: POSIX_FALLOCATE() FAILS WITH ERROR-25(ENOTTY) APPLIES TO AIX 5300-06 you don't even get EOPNOTSUPP: posix_fallocate fails with NOTTY. So you have to install one of this fixes to make the patch work. Ralf -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Some people asked me lately about how professional Dovecot is.
I purely love that kind of crap. As if presentations meant anything, as if there aren't all kinds of scholarly work about theoretical perfect world algorithms and conceptual systems that will never be implemented and are as practical and effective as wings on a pig. Please. I'm reminded of the story about how, during the American Civil War, when the North had finally, after years of ignominious defeats, gotten a general would could fight and win a battle, General Grant. A fussy old lady approached President Lincoln and complained loudly that Grant was a drunk. Lincoln blinked at the woman, then said, Ma'am, if you'll be so kind as to find out what kind of whiskey Grant drinks, I'll send a case of it to all the other generals. Dovecot Works. That's all anyone needs to know. Plus it has a towering wizard of a developer and an avid, engaged and endlessly helpful community. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] enourmous amount of disc writes
I think I mentioned this twice with little response by the DC community, but here goes a third time. I have things set up so that I can kill DC, swap in the new executables and restart DC, all in about 4 minutes or less. And if things go wrong, I can fall back just as fast. Users don't know that I've done anything (if the upgrade is good); I usually do it during lunchtimeso there shouldn't be a problem with doing it prime shift. So upgrade shouldn't be a big deal. Of course, I'm running a pretty vanilla DC install with no real plugin, no deliver, etc. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] dovecot and ntp: Fatal: Time just moved backwards
I have been running AIX, IBM's Unix on IBM hardware for years but am being forced into Lintel, mostly because of IBM hollowing out support, moving to a Fortune 500 only customer base and leaving the small shop increasingly SOL. One of the realities of Lintel is that the hardware is, compared to purpose built Unix hardware with a matching O/S, crap. Partially because it's based on commodity hardware, 'little' matters like time consistency don't necessarily work consistently. Another area is storage corruption. Interesting piece here: http://linuxmafia.com/faq/Filesystems/reiserfs.html Juergen wrote: I'm pretty familiar with ntp in particular and computer timekeeping in general. I've also seen a fair number of situations where the hardware clock is just wrong, especially after a reboot. In my world, it's about getting things to work right in as many cases as possible. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Filesystem experience question was Migration questions
Doing a cursory Google scan on journaled Linux filesystems, it seems that the three ground-up journaled FSes: XFS, reiser and JFS all have their separate strong points but all compare favorably. Reiser does a better job with many small files...which would seem to be the reality of maildir formatted inboxes. Any comments on that? Any war stories, that is, any comments on reliability, availability and recoverability of them. Support issues? Possible down the road orphaning? Is FS quotaing support and does it work well with a lot (for me that means 4000) users? Anybody using IBM's open source JFS? I currently use AIX and it's been as dependable as a hammer there. In some 20 years with AIX, I can count on the fingers of one hand the number of times that I've had to use fsck. We had one set of machines that would drop hard 2-3x a week due to a bad main electrical trunk splice2 or 3 years of that and the worst I ever saw was having to BRS once every two months or so. OTOH, I distrust IBM's commitment to the little shop and affordable entry machines: this is fast vanishing in the pSeries/AIX world...or else we wouldn't be moving towards Linux. Thanks! Feel free to contact me offline if you deem this marginally related to DC. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Possibly dumb questions about DC and user/system limits
Maybe it's a D'uh for everyone else, but the reason I wasn't getting anywhere when I increased the no_size and no_size_hard (and confirmed that it had changed using the lsuser cmd) was that a) it needed to be done against root, not dovecot and b) I had to exit root and re-login for that to be part of root environment instance. Indeed, before going out and coming back, ulimit -n did still show 2000. So lsuser shows the configuration and ulimit shows the current environment. All better until the next time. I was also interested to learn, while I was looking under rocks here and there, that in AIX with a 64 bit kernel there is total number of files that can be in use by all users of ~3,355,236. Wouldn't it be nasty to bump into that! Jonathan Siegle wrote: On May 14, 2009, at 2:17 PM, Stewart Dean wrote: The only changes was that max_mail_processes went from 1024 to 1280. Now I get a error message when I start DC: Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 2054). Either grow the limit or change login_max_processes_count and max_mail_processes settings So I changed the no_size and no_size_hard to 3500 and 4000 respectively in both dovecot and root AIX defines nosize:* *Sets the soft limit for the number of file descriptors a user process may have open at one time. I found a way to recreate the problem on my side. Since I start dovecot from inetd, I must verify my shell has the proper ulimits then do stopsrc -s inetd;startsrc -s inetd to pick up the new ulimits. I didn't notice how you started dovecot. Maybe this helps. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Migration questions...
I'd point out that the big *practical* issue with mbox is the reality of big inboxes. While you can restrict the hoi polloi to something limited like a quota of under 60MB (and remember that inbox is one big honking file), the powers that be will not allow themselves to be so limited...nor will they be particularly good about cleaning up. I dunno how it is with you and your hardware/OS implementation, but there is a serious CPU hit when somebody with a 1GB inbox (one big file, remember) deletes a message...or gets new mail...or searches their inbox (I call this the python swallowing the pig). The first two will be trivial when we switch to maildir. OTOH, boy is it quick to do a backup with mbox. I dread that part of our move from mbox to maildir format. We will probably go from 2 hours to a day in the switch from 3000 inboxes of one file each (mbox) to 3000 directories with hundreds or thousands of files in each (maildir). Pick your poison Timo Sirainen wrote: On May 13, 2009, at 9:57 AM, Richard Hobbs wrote: OK... so Dovecot is certainly significantly faster that uw-imapd in both cases, but is dovecot fastest with mbox or maildir? I would assume maildir, but you never know... It's not that simple to answer. With mbox it's probably faster to read through all mails, because they're in a single file. With Maildir it's faster to delete mails, because it only needs to delete a single file, instead of moving data around in the mbox file. But Maildir has less problems and it's much less likely to get corrupted, so even if mbox performance would be better in some cases I'd recommend Maildir. -- One must think like a hero to behave like a merely decent human being. - May Sarton Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Possibly dumb questions about DC and user/system limits
Because of user access growth, the number of processes associated with IMAP has increased and I thought to change some of the configured parms. dovecot -n yields: # 1.1.14: /usr/local/etc/dovecot.conf # OS: AIX 1 005A928C4C00 listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1280 mail_max_userip_connections: 12 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd The only changes was that max_mail_processes went from 1024 to 1280. Now I get a error message when I start DC: Warning: fd limit 2000 is lower than what Dovecot can use under full load (more than 2054). Either grow the limit or change login_max_processes_count and max_mail_processes settings So I changed the no_size and no_size_hard to 3500 and 4000 respectively in both dovecot and root AIX defines nosize:* *Sets the soft limit for the number of file descriptors a user process may have open at one time. an lsuser dovecot returns: dovecot id=417 pgrp=dovecot groups=dovecot shell=/bin/false daemon=true admin=false ... fsize=2097151 cpu=-1 data=262144 stack=65536 core=2097151 rss=65536 nofiles=3500 nofiles_hard=4000 I kill dovecot and all children and restart itsame error message What am I missing? Does the machine have to be rebooted for the no_size to be updated? -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Dovecot v2.0 hg tree
I'll break down and ask the stupid question... Does this mean there will not be a V1.3 release? I'm currently at 1.1.8 and using mbox. Any comments about the advisability of going to 1.1.14? Better for going to v1.2? What does the crystal ball show for 1.2.0? As always thanks for all the wizardry Timo Sirainen wrote: http://hg.dovecot.org/dovecot-2.0/ I just did the initial commit for master process rewrite, which marks the beginning of Dovecot v2.0. Several things are still missing/broken, but at least I was just able to successfully log in using imap :) I left v1.3 hg tree there for now, but once v2.0 tree is fully usable I'll just delete the v1.3 tree. Note the new dovecot-master-example.conf, which you'll need to !include to get the services running. Some settings have also been removed because they're now more generically set in the dovecot-master.conf. I'm thinking that perhaps the config process could still be run in compatibility mode where it's able to use an existing v1.x dovecot.conf and translate the old settings to new settings. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] [Fwd: Re: [Pine-info] incomplete SecBuffer exceeds maximum buffer size ?]
Forgive me if I've been asleep at the switch on the SSL problem and it's already been figured out, butcould this be what the prob is? Original Message Subject: Re: [Pine-info] incomplete SecBuffer exceeds maximum buffer size ? Date: Mon, 27 Apr 2009 09:47:04 -0700 (PDT) From: Steve Hubert hub...@washington.edu Organization: Univ of Washington; UW Technology; Seattle To: Pine Forum pine-i...@u.washington.edu References: pine.wnt.4.64.0904261823300.-1877...@zuluone There is a feature called quell-ssl-largeblocks that addresses this. In alpine it is called Prevent SSL Largeblocks. The help text in alpine says FEATURE: Prevent SSL Largeblocks PC-Alpine only. This feature changes the behavior of fetching messages and attachments so that the message data is fetched in chunks no larger than 12K bytes. This works around a bug in Microsoft's SSL/TLS support. Some versions of Microsoft SSL are not able to read full-sized (16K) SSL/TLS packets. Some servers will send such packets and this will cause PC-Alpine to crash with the error incomplete SecBuffer exceeds maximum buffer size Microsoft is aware of the problem and has developed a hotfix for it, it is discussed in article 300562 in the Microsoft Knowledge Base. ___ Pine-info mailing list pine-i...@u.washington.edu http://mailman1.u.washington.edu/mailman/listinfo/pine-info -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] v1.3 plugin locations
Oh, this makes excellent sense. Still, I can't help thinking of the
famous prayer of Augustine of Hippo:Grant me chastity and continence,
but not yet (/da mihi castitatem et continentiam, sed noli modo/).
That is, my current build environment just works and has worked for a
couple of yearsand I dread having to reverse-engineer why it does
what it does and then make those things happen for a new plugin
environment. Excellent, *righteous* program engineering in this...but
not yet, O Timo.and yes, I'm chicken-$%#@ to be fussing about it.
Timo Sirainen wrote:
It's getting more and more annoying to have separate plugin directories
for lda, pop3 and imap. Currently all the plugins are installed into
$lib/dovecot/ and then symlinked to the lda, pop3, imap directories. The
original reason was that v0.99 just loaded everything in those
directories since there was no mail_plugins setting.
But then there are things like expire-tool and convert-tool (and the
upcoming doveadm) that don't load plugins at all, even though they
probably should. Adding just more directories to them seems to be
pointless.
Also SQL plugins are shared by dovecot-auth and dict and those would
need symlinking.. And in future you might want to load SQL plugins to
e.g. imap process.
So, I was planning on just putting everything into $lib/dovecot/.
expire-tool etc. would use mail_plugins setting that wasn't inside
protocol {}. So for example:
mail_plugins = quota
protocol lda {
mail_plugins = quota sieve
}
protocol imap {
mail_plugins = quota imap_quota
}
protocol pop3 {
# defaults to mail_plugins=quota above, no need to set it explicitly
}
That leaves auth and dict.. I was considering adding new auth_plugins
and dict_plugins settings, but that might make it more difficult to
start using distro-compiled Dovecot where sql, ldap, etc. are in
plugins. So perhaps the auth/ and dict/ directories can stay and contain
symlinks. But the $lib/dovecot/sql/ directory could go away and the sql
plugins be stored just in $lib/dovecot/ among everything else.
Any thoughts?
--
Once upon a time, the Internet was a friendly,
neighbors-helping-neighbors small town, and no one locked their doors.
Now it's like an apartment in Bed-Stuy: you need three heavy duty
pick-proof locks, one of those braces that goes from the lock to the
floor, and bars on the windows Stewart Dean, Unix System Admin,
Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax:
845-758-7035
Re: [Dovecot] Compiling v1.3 on different OSes
Runs to completion now error free. BTW, this compile includes plugin support Timo Sirainen wrote: On Mon, 2009-04-06 at 16:05 -0400, Stewart Dean wrote: I'm compiling using IBM's C for AIX Enterprise compiler (with its crappy partial POSIX support) V9. imap-search.h, line 36.16: 1506-007 (S) struct timeval is undefined. make: 1254-004 The error code from the last command is 1. This should fix it: http://hg.dovecot.org/dovecot-1.3/rev/a5185de111a4 -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] MAILBOXDIR question
I'm unclear about where and how this is to be used. I gather it is to be a new standard, but I didn't seem to find anything about it in the Dovecot Wiki Mail Location page. There are some words about it in the 1.1.12/3 release notes, but perhaps I'm thick, but they're meta-ambiguous to me. Is it meant to be used like this: mail_location = mbox:MAILBOXDIR=~/mail:INBOX=/var/mail/%u instead of the current mail_location = mbox:~/mail:INBOX=/var/mail/%u ??? Sorry to be so dense. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Staged migration from mbox to maildir
So much changes in this migration that the ideal way to do it would be to begin with a few users or a department, then migrate the users affinity group by affinity group: first an institute or so, then the faculty, then the staff, then the students, moving to bigger and bigger groupings as the bugs work out of the migration and the move becomes more assured. We use sendmail and procmail. There's no problem there, as the ~./procmailrc can be changed to over-ride the mbox default until all groups are done and it become the default. The problem comes with IMAP. While dovecot can tell if a folder is mbox or maildir, it has to be pointed to the right place (by namespace definitions in the client, IIRC), and the default of putting the inbox under ~/mail is one I'd like to embrace for various reason...but given that that means moved inbox folders and *that* means either making a global change (there goes staged migration) OR changing the namespace definitions on each PC. I can get to the early few and change the namespaces definition, but there doesn't appear to any equivalent (enlighten me, if I'm missing something) to ~/.procmailrc for imap, so that I don't have to get on the client machine. Is this correct or am I (hopefully) wrong and there *is* a way to change things on the server that allows for staged migration? Oh, I would so like to be wrong! IMAP should have an rc file. -- Eppur si muove. (But Still it moves) Galileo, leaving the Inquisition, after buckling under the threat of torture and excommunication and recanting from his proof that the heavens do not revolve around the earth -- Stewart Dean, Unix System Admin, Henderson Computer Center, Bard College, Annandale, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] I've moved to US
Curious. What are the small annoyances Timo Sirainen wrote: On Feb 6, 2009, at 8:29 PM, Ron Wilhoite wrote: Congratulations! Wow, Finland to Blacksburg. That could make for some interesting 'culture shock' posts. Actually I find Blacksburg to be very similar to Finland. I haven't really had any shocks. Just some small annoyances how some things are better/easier in Finland :) -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] I've moved to US
Make sure you have a medical plan. Our country is way behind the rest of the developed world in social services.
Re: [Dovecot] Error: Maximum number of mail processes exceeded (see max_mail_processes setting)
Question: Do you have to have a radically greater setting for maildir than for mbox? I would think... What sort of values are people using with both formats? Sounds like a nasty thing that could bite one in the $%# come migration from mbox to maildir Frank Bonnet wrote: Jack Stewart wrote: Frank Bonnet wrote: Hello I have this message repeated several times each *seconds* in /var/log/dovecot/dovecot.log the max_mail_processes is set to 8192 and I can see an average of 500 imap processes on the machine , I think there is a problem somewhere ... Debian 64 bits , IBM X3650 biproc , 7 Gb RAM , RAID5 disks , 2 ethernet Gb ports bonded. Dovecot 1.1.11 has been compiled from scratch on the machine Thanks for any info. Hi Frank, Your system is plenty powerful - no issues there. What are your settings in the init script? I found that putting in a ulimit -n 8192 and ulimit -f 16384 prior to invoking dovecot was worthwhile on my system. I would first try tweaking these settings in a root shell and then invoke dovecot with a -c conf make sure it is picking up the right conf file. I'm sure the list will ask for the dovecot -n -c ... output as well. ---Jack Bingo ! since the begining I was modifying the wrong configuration file now everything is clear , when I modified the right file the OS instant write to the shell I haven't enough file descriptors ... Shame on me and thanks a lot Jack ! Frank -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Killing Dovect, an unpleasant surprise
When it came time to upgrade DC or replace the certificate, I would find the root instance of dovecot and do a kill -7 of it. Within 20-30 seconds, all the hundreds of DC related processes would go away, I would swap the executable or certificate/key and restart DC. Very clean and quick. Surprise. After switching from 1.0.15 to 1.1.8 and doing the kill, I found that all the imap-login instances had been inherited by the root (1) process and did not go away. Yikes! An Unpleasant Surprise. So instead of being down for a minute, I was out for a much more noticeable 5-7 minutes, while I QUICK did an awk of the ps list to give me the pids and then xarg killed them. My boss asked me if this was a pink slip notice. :( Is this The Way Things Will Be? Is there a new way to kill everything DC related quickly and cleanly? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035 Resolve then, that on this very ground, with small flags waving and tinny blasts on tiny trumpets, we shall meet the enemy, and not only may he be ours, he may be us. === From the introduction to the original Pogo Papers
Re: [Dovecot] v1.1.10 released
As someone once pointed out to me when I was on a jihad for error-checking/returning in a code development project, it's the things that you *know* might break that you can slow down your code by putting RC evals (evals are always very, very slow) to report on, but you generally check for them *anyway* in your testing process...so why put them in?it's the stuff that you never thought of (and couldn't put RC checking in for) that will break and bite you in the ass and leave you wondering WTF is going on Timo Sirainen wrote: On Tue, 2009-01-27 at 11:21 -0600, Eric Rostetter wrote: Quoting Timo Sirainen t...@iki.fi: Something automated. There are several different testing possibilities actually. Unit tests is one thing. Last time I brought this up, it lead to so much endless arguing/debate over what type of testing to use, what toolset to use, etc. that nothing ever happened. Why don't I remember the arguing? :) Maybe I was just following to see what's going to be the result and it eventually died out and I thought people just lost interest. I'd still be willing to do unit tests, if there is no longer any arguments from others to stop it. I'm open to suggestions as to tools to use and such as long as it isn't a flame war... I've already written some unit tests in src/tests/. I don't really care if you continue them the way I started or use some other toolset. And unless someone else is also willing to actually write the tests, I don't think you should care all that much about their arguing. -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Errmsgs b4 and after migration DC V1.0.15 to V1.1.8
Last Wednesday at 12:21 I made this switch, which seemed to be uneventful. In any case, no user has reported problems since the migration. Not content to leave well enough alone, this morning I scanned the syslog and maillog for dovecot related errors. What I found was that: Before the Migration=== I saw a lot of SSL errors that look like this: Jan 14 11:49:23 mercury mail:warn|warning dovecot: imap-login: SSL_read() syscall failed: Connection reset by peer [69.180.200.184] Jan 14 11:52:28 mercury mail:warn|warning dovecot: imap-login: SSL_read() syscall failed: Connection reset by peer [68.6.82.45] Which l took to be breakin attempts of some sort, except that I haven't seen any since the migration! After the migration I see errors like this: Jan 14 12:21:45 mercury mail:err|error dovecot: IMAP(eg115): Corrupted index cache file /var/dcindx/eg115/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 1934 Jan 14 12:21:46 mercury mail:err|error dovecot: IMAP(alexande): Corrupted index cache file /var/dcindx/alexande/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 132641 Jan 14 12:21:46 mercury mail:err|error dovecot: IMAP(ls454): Corrupted index cache file /var/dcindx/ls454/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 47 Jan 14 12:21:46 mercury mail:err|error dovecot: IMAP(tr489): Corrupted index cache file /var/dcindx/tr489/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 1 Jan 14 12:21:54 mercury mail:err|error dovecot: IMAP(bh265): Corrupted index cache file /var/dcindx/bh265/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 2 Jan 14 12:22:01 mercury mail:err|error dovecot: IMAP(crouch): Corrupted index cache file /var/dcindx/crouch/.imap/INBOX/dovecot.index.cache: Broken MIME parts for mail UID 4863 It appears that this error appears the first time a folder is referenced, then not again (I think but am not absolutely positive). Did the indexing method/format change in some way that would cause this (and Dovecot heals itself!) ? Is there any continuing problem inherent in this that needs to be dealt with? Thanks! -- Eppur si muove. (But Still it moves) Galileo, leaving the Inquisition, after buckling under the threat of torture and excommunication and recanting from his proof that the heavens do not revolve around the earth -- Stewart Dean, Unix System Admin, Henderson Computer Center, Bard College, Annandale, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Enforcing TLS
Dunno if I'm talking about the right thing or if this would help, but... we have gone over to a single wildcard certficate for everything in the *.bard.edu domain (from Digicert)...this costs $495 for a single year, less for multiple years. Then everything coming at a machine of the format: somename.bard.edu comes up valid. If the hostname is of the format somename1.somename2.bard.edu (or somename1.somename2...somenameN.bard.edu) , then you have to explicitly list it when submitting the CSR, but you can list up 10 host names for the certificate you generate for that machine when submitting the CSR Jan-Frode Myklebust wrote: On 2009-01-06, Timo Sirainen t...@iki.fi wrote: We're afraid that if we enable STARTTLS, many of our existing clients will automatically try using SSL towards the wrong name, and get ugly SSL warnings about certifcate mismatch. -jf -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] DC testing observation and a question
I have been running a test DC IMAP server to evaluate the new release before migrating from 1.0.15 to 1.1.8. The test server access all the INBOX and homedir folder filesystems through NFS imports. The index file filesystem is local on both the production server and the test one.. This is messy in that when I ask some one tests using the test sever, the index has to be created or re-gennned, since the local index either doesn't exist or is several months old (from the last time a prospective upgrade was tested) and thus doesn't reflect data on the production DC IMAP server. 1) Watching the syslog maillog has been intriguing...different IMAP client show widely differently use patterns. a) Users running TBird and Seamonkey have 2-5 imap sessions (ps -aef | grep userid) *but* very little syslog activity...sparse occasional logins and disconnects b) Users running Exchange have only 1 imap sessions *but* every 5 minutes will generate login and disconnect messages (in and out in the space of a second) for each folders. So for a user with 22 folders, there will be 44 syslog messages in the maillog every 5 minutes. Just curiousany thought as to which is more efficient and by how much? 2) When I try to switch a MacMail client over, it sees the new mail, but not the old mail in the INBOX. How do I force re-indexing on the test server? -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] New SSL certificate problem
Although I was told by Digicert that the order of chained certs in /var/ssl/certs/dovecot.pem should make no difference, after I put our public cert first, followed by Digicert's intermediate cert, dovecot started up fine. Of course, there were so many things I looked into, it might have been something else I touched.. Stewart Dean wrote: Our DC has been using a Verisign certificate. Over the past year, we've been using a Digicert Wildcard Plus certificate for almost all of our machines, and I wanted to switched over our DC mailserver. I used the following command to generate the CSR and key: openssl req -new -newkey rsa:1024 -nodes -out star_bard_edu.csr -keyout star_bard_edu.key -subj /C=US/ST=NY/L=ourtown/O=Bard College IT/OU=Bard College /CN=*.bard.edu The resultant CSR verified and I submitted it to digicert and got back our cert, plus their intermediate and Trusted root certs. I killed the root instance of dovecot and waited for all the children to die I put together the intermediate cert (first) and our cert (second) into /usr/ssl/certs/dovecot.pem I put the key star_bard_edu.key in /var/ssl/private/dovecot.pem I restarted dovecot, but the imap login instances didn't appear, so I shifted back to the original combined cert file and key, restarted dovecot and it came up OK I check the syslog and saw these error messages: Jan 5 10:19:49 mercury mail:err|error dovecot: imap-login: Can't load private k ey file /var/ssl/private/dovecot.pem: error:0B080074:x509 certificate routines:X 509_check_private_key:key values mismatch Jan 5 10:19:49 mercury mail:err|error last message repeated 8 times Jan 5 10:19:49 mercury mail:err|error dovecot: child 4051108 (login) returned e rror 89 Jan 5 10:19:49 mercury mail:err|error dovecot: child 4231382 (login) returned e rror 89 I checked my key and it has the same time stamp as my CSR, so I didn't somehow get the wrong key. Both the old and new key are 600; if the old one works based on perms, the new one should too. Would some kind soul tell me what I'm missing? Or is there a problem using wild card certificate with DC? Is there an openssl command to verify the key. Or is it that the key is unencrypted? -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
[Dovecot] OT: Looking for a robust IMAP client
This weekend we had a runaway email endless loop. When it was killed after 18 hours, my inbox had 135,000 messages in it...there were two messages that were being endlessly sent and bounced and I'm on the postmaster alias. Thunderbird was able to do a mass select of one of the two messages, and deleted 65,000, but after that it locked up. I ended up firing up Pine to do the final 65,000...whereas TBird had had mulitple imap sessions (and failed), Pine only had one and did the job. And even after I had done the mass delete of the other 65,000 and the inbox was down to 2000 messages, TBird was still hiding under the covers and telling me there were still 135,000 messages. In the end, I had to kill the TBird profile for that account and recreate it. Is there a simple robust IMAP client to replace Pine (which I *think* is no longer supported)? GUI or TTY session? I'm wondering if there is something we can tell users to use when Things Are Dire. GUI would be better since it removes one of the few remaining reasons for a logon server -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] OT: Looking for a robust IMAP client
Charles Marcus wrote: On 12/15/2008, Ed W (li...@wildgooses.com) wrote: Thunderbird was able to do a mass select of one of the two messages, and deleted 65,000, but after that it locked up. I'd never try to delete that many at once... It very likely wasn't locked up though, it probably was working furiously to try to do what you told it to do - the problem is, it can *appear* to be locked up, even for many minutes, but if you let it go, it will eventually finish (or time out)... Pine did it in2-3 minutes with one imapd instance; TBird was thrashing mightly for 20+ minutes with 4-8 imapd instances, and no progress in siteeven after Pine had deleted the inbox down to 2000 messages. But, if you ever try this again, it helps a LOT if you do a 'SHIFT-delete' (press/hold the shift key, then tap the Delete button on the keyboard) - this bypasses the Trash - otherwise, it isn't deleting them it is MOVING them to the Trash, which can take a long time for that many messages. Was not moving to Trash, just directly expunging stuff that had been marked for deletion I usually work with a thousand or so at a time if I need to do something like this, and it works, although it certainly isn't instantaneous... With sigh, I know, I know a mbox format inbox, I don't know that it matters much whether it's 10 files or 10,000...it's still gotta haul out the whole ugly thing. We had a bad, bad user that got up to 1.3GB...and our server still handled it without undue distress. Must be some amazingly optimized file system I/O in the O/S (AIX) -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] OT: Looking for a robust IMAP client
Charles Marcus wrote: On 12/15/2008 2:34 PM, Stewart Dean wrote: Thunderbird was able to do a mass select of one of the two messages, and deleted 65,000, but after that it locked up. I'd never try to delete that many at once... It very likely wasn't locked up though, it probably was working furiously to try to do what you told it to do - the problem is, it can *appear* to be locked up, even for many minutes, but if you let it go, it will eventually finish (or time out)... Pine did it in2-3 minutes with one imapd instance; TBird was thrashing mightly for 20+ minutes with 4-8 imapd instances, and no progress in siteeven after Pine had deleted the inbox down to 2000 messages. I never said TBird was 'better' than Pine, I merely commented on how TBird works with lots of messages in my experience... Oh, I only use Pine as a last resort. Tbrid had done the first 65,000 just fine...and then it locked up Also, from what you just said, you were working with that many messages with Pine at the same time as with TBird? TBird is an excellent IMAP client, as long as you understand its quirks and work with them. Been using it for years Bottom line - if you expect it to behave exactly like Pine - or like you think it *should* - then expect to be disappointed. I would like Tbird to do just what it does now, but be more robust (and maybe a little quicker) about it. Bombproof, as they say. But, if you ever try this again, it helps a LOT if you do a 'SHIFT-delete' (press/hold the shift key, then tap the Delete button on the keyboard) - this bypasses the Trash - otherwise, it isn't deleting them it is MOVING them to the Trash, which can take a long time for that many messages. Was not moving to Trash, just directly expunging stuff that had been marked for deletion I don't know what that means in TBird-speak. There is no 'expunge' command that I am aware of, either as a toolbar button or a menu choice. There is a 'delete' button on the toolbar, and you can select messages and hit the 'delete' key on the keyboard. You can also right-click on the Trash and 'empty' it. The only place I know of that contains the word 'expunge' is in the Account Settings, where you can tell it to expunge the Inbox on exit. So, I'm curious - what, exactly, did you do in TBird? You selected all of the messages in the Inbox, then... ? I marked them for Deletion (dunno what exactly that does, maybe something in that first mbox entry or in the index orbut it does NOT xfer them to another folder, just gives them a black spot. Then, under file, I would select Compact Folders, though now I use a TBird AddOn called Purge, which give me a control bar Icon to do it. I usually work with a thousand or so at a time if I need to do something like this, and it works, although it certainly isn't instantaneous... With sigh, I know, I know a mbox format inbox, I don't know that it matters much whether it's 10 files or 10,000...it's still gotta haul out the whole ugly thing. Ok, well, I only use maildir format, so can't speak to TBirds performance or quirks wrt mbox... -- Once upon a time, the Internet was a friendly, neighbors-helping-neighbors small town, and no one locked their doors. Now it's like an apartment in Bed-Stuy: you need three heavy duty pick-proof locks, one of those braces that goes from the lock to the floor, and bars on the windows Stewart Dean, Unix System Admin, Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Backing Up
Dave McGuire wrote: On Oct 29, 2008, at 3:42 PM, Scott Silva wrote: What is the best way to do a (server-side) backup of all mail in a user's mail? I usually just rsync the /home directories to another server. The inital sync can take a while, but it gets faster after there is a base to work from. ...and it's much less painful if you're using maildir instead of mbox! -Dave I have to wonder. I have a mailserver that I do a bootable complete image copy of with all files and O/S in two hours to an Ultrium-2 tape, 95 GB. When I switch to maildir, I will go from some 25,000 mbox files to 2.5 to 3 million files...I can't believe that isn't going to hurt and will force me into incrementals.
Re: [Dovecot] Test environment question
I have a call open to IBM with their Compiler group on this to see if this can't be fixed right. A side question: how come is it that this happens when the session starts up and reoccurs periodically for the first day or so...and then not again unless and until those imap process sessions are closed out Timo Sirainen wrote: On Fri, 2008-10-03 at 14:33 -0400, Stewart Dean wrote: I am seeing posix_fallocate and file_set_size errmsgs in the mail syslog, but see a pattern: 1) They only happen with the /var/spool/mail inbox NOT with any of the /home folders and appear to be happening every 10 minutes from the time I started DC (9AM, 10/1/98) until 11AM, 10/2...and then ceased The every ten minute message sets looked like this: Oct 1 22:30:31 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() failed: Resource temporarily unavailable The main problem here is that posix_fallocate() is broken in your AIX (v1.0 doesn't even try to use it). My previous patch attempted to make Dovecot detect this and silently fallback to not using it, but apparently it can fail in more ways. I thought about adding another check for EAGAIN, but perhaps posix_fallocate() just returns the previous errno so it can't be checked that way. So I moved the check to configure instead: http://hg.dovecot.org/dovecot-1.1/rev/12565ef10d1c Alternatively you could just remove HAVE_POSIX_FALLOCATE from config.h after running configure. Or yet another way would be to try to find out if it's already been fixed in AIX. This looks related: http://www-01.ibm.com/support/docview.wss?uid=isg1IY77112 3) However, then there was the following: a) If I used webmail, which accessed the production server and got the indices on my test server out of sync, I got this error message from in the mail syslog on my test server: Oct 3 12:20:23 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /var/spool/mail/sdean (648818 648046, seq=1153, idx_ msgs=1187) v1.1 also has a bug that can cause this, although normally it should be visible only when index files aren't being used, or they're out of sync for some reason. This'll fix it: http://hg.dovecot.org/dovecot-1.1/rev/a5bf7e12f3cc Oct 3 12:44:58 egg mail:info dovecot: imap-login: Maximum number of connections from user+IP exceeded: user=sdean, method=PLAIN, rip=10.20.10.169, lip=192.24 6.229.31 Turns out I had 10+ sessions, one back from yesterday, so I killed them all and could get mail, but...about six minutes later, I had the two posix_fallocate and file_set_size errmsgs again after not having any for a day. So something about new connections maybe causes this? Any ideas why: a) I am having leftover IMAP sessions on my test server? This doesn't happen on my production DC V1.0 server Are you sure? Perhaps you just didn't notice them since v1.0 didn't have any limits to how many were allowed? I think it's more likely that the client(s) really just left that many connections. So the choices are: a) Increase mail_max_userip_connections setting. b) Figure out where the sessions are from and see if you can do something about them on the client side. In Thunderbird there's a setting which specifies how many connections it can use.
[Dovecot] Test environment question
I have V1.1 running on a test server that NFS mounts mbox-formatted inbox and home folder dirs. I have eliminated the profile listing for connection to the V1.0 production servers so that can't start up and corrupt the synch of the test servers indices I am seeing posix_fallocate and file_set_size errmsgs in the mail syslog, but see a pattern: 1) They only happen with the /var/spool/mail inbox NOT with any of the /home folders and appear to be happening every 10 minutes from the time I started DC (9AM, 10/1/98) until 11AM, 10/2...and then ceased The every ten minute message sets looked like this: Oct 1 22:30:31 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() failed: Resource temporarily unavailable Oct 1 22:30:31 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: Resource temporarily unavailable Oct 1 22:40:31 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() failed: Resource temporarily unavailable Oct 1 22:40:31 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: Resource temporarily unavailable Oct 1 22:50:31 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() failed: Resource temporarily unavailable 2) My Thunderbird client's server settings are set to check for mail every 10 minutes AND I don't access the mail overnight, so it this must be causing it! I did check the crontabs on both my test and production servers and they had nothing with this time periodicity 3) However, then there was the following: a) If I used webmail, which accessed the production server and got the indices on my test server out of sync, I got this error message from in the mail syslog on my test server: Oct 3 12:20:23 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /var/spool/mail/sdean (648818 648046, seq=1153, idx_ msgs=1187) Which is what one would expect...once the V1.1 code is on production server that won't happen anymore, so that's OK and can be ignored b) I seem to end up having leftover imap session on the test server. Around 1PM today, I was unable to get mail and saw these messages in the test server's mail syslog: Oct 3 12:44:58 egg mail:info dovecot: imap-login: Maximum number of connections from user+IP exceeded: user=sdean, method=PLAIN, rip=10.20.10.169, lip=192.24 6.229.31 Turns out I had 10+ sessions, one back from yesterday, so I killed them all and could get mail, but...about six minutes later, I had the two posix_fallocate and file_set_size errmsgs again after not having any for a day. So something about new connections maybe causes this? Any ideas why: a) I am having leftover IMAP sessions on my test server? This doesn't happen on my production DC V1.0 server b) Ditto on the the posix_fallocate and file_set_size errmsgs which also aren't found on my production server's mail syslog. ? I do realize that these seem to be related to Tbird, but they don't happen with V1.0 I have attached my original note with its copies of the dovecot -n output for both machines ---BeginMessage--- My production DC machine owns the mail filesystems and is running DC V1.0.15 and mbox folder format. I am looking to test V1.1.3 on another machine, which NFS mounts the mail filesystems, but has its own local index FS. I have made this test environment my default connection in TBird, and it seems to work just fine. Also, I have made sure that my TBird client isn't connecting to the production server (it has multiple accounts but I have turned off the cehck for mail when starting and check for new mail every N minutes functions, and then check the ps table to make sure there are no imap connections) However, I'm seeing two errmsgs in the maillog on the test machine: Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: Protocol not available Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: Protocol not available which appear to happen AFTER mail arrives at the production serverit seems to happen on my test server the next time my client goes to access mail AFTER mail has arrived at the production server. Subsequent client requests of the test server execute without error until AFTER the next time mail arrives at and my inbox is updated with it. Again, if I hadn't looked at the logs, I wouldn't know there was a problem...I can see my new mail just fine from the test server. The questions: Is this anything I should be concerned about? Is this a bug or a legit problem coming from my improper use of two servers against the same data. FWIW, I am using fcntl for both mbox read and write locks. procmail in the MDA on the production server, and its locking hierarchy dotlock,fcntl, which Timo previously approved. Thanks! Production dovecot -n output: # 1.0.15: /usr/local/etc/dovecot.conf listen:
Re: [Dovecot] Test environment question
Timo Sirainen wrote: On Mon, 2008-09-22 at 13:04 -0400, Stewart Dean wrote: Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: Protocol not available See if this helps: http://hg.dovecot.org/dovecot-1.1/rev/ad13463328aa My apologies for not getting back to you...I was sick and out last week and am not exactly shining brightly this week :) I rebuilt with the patch you specified. I made sure that my imap session from my TBird client to my production (DC V1.0.15) server was shut down, that it was reconfigured NOT to periodically look for mail, and I have rechecked since then to make sure that there are no session in the PS table for it. When I started up on my DC V1.1.3 test server, I got the following messages: Sep 30 13:24:13 egg mail:info dovecot: Dovecot v1.1.3 starting up Sep 30 13:24:26 egg mail:info dovecot: imap-login: Login: user=sdean, method=P LAIN, rip=10.20.10.169, lip=192.246.229.31 Sep 30 13:24:28 egg mail:info dovecot: imap-login: Login: user=sdean, method=P LAIN, rip=10.20.10.169, lip=192.246.229.31 Sep 30 13:24:30 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /var/spool/mail/sdean (646581 646564, seq=1125, idx_ msgs=1126) Sep 30 13:24:31 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /var/spool/mail/sdean (646581 646564, seq=1125, idx_ msgs=1126) Sep 30 13:24:33 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: File exists Sep 30 13:24:33 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: File exists Sep 30 13:24:35 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: File exists Sep 30 13:24:35 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: File exists Sep 30 13:25:37 egg mail:info dovecot: ssl-build-param: SSL parameters regenerat ion completed Sep 30 13:27:42 egg mail:info dovecot: imap-login: Login: user=sdean, method=P LAIN, rip=10.20.10.169, lip=192.246.229.31 Sep 30 13:30:28 egg mail:info dovecot: imap-login: Login: user=sdean, method=P LAIN, rip=10.20.10.169, lip=192.246.229.31 I would assume that, when the test server started up, the index and such stuff it had from the last time it was run was grossly out of synch and that this is therefore just DC on the test server setting things right. Since then, as I wrote a message, DC on the test machine coughed out an errmsg relating to the Drafts folder, which again makes sense as it also likely out of sync: Sep 30 13:49:25 egg mail:info dovecot: imap-login: Login: user=sdean, method=P LAIN, rip=10.20.10.169, lip=192.246.229.31 Sep 30 13:51:03 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /home/hcrc/sdean/mail/Drafts (9422 9403, seq=607, id x_msgs=651) Sep 30 13:51:04 egg mail:err|error dovecot: IMAP(sdean): mbox sync: UID inserted in the middle of mailbox /home/hcrc/sdean/mail/Drafts (9422 9403, seq=607, id x_msgs=651) Sep 30 13:53:45 egg mail:info dovecot: IMAP(sdean): Disconnected: Logged out byt es=73/3631 So there are two possibilities 1) That this just happens once (for any given folder), as long as the test DC server is the only one to ride heard on the folders and/or 2) even so, these messages shouldn't happen and something is wrong. I will watch it carefully for a day and see if I can confirm that #1 is true I have attached my original note with its copies of the dovecot -n output for both machines ---BeginMessage--- My production DC machine owns the mail filesystems and is running DC V1.0.15 and mbox folder format. I am looking to test V1.1.3 on another machine, which NFS mounts the mail filesystems, but has its own local index FS. I have made this test environment my default connection in TBird, and it seems to work just fine. Also, I have made sure that my TBird client isn't connecting to the production server (it has multiple accounts but I have turned off the cehck for mail when starting and check for new mail every N minutes functions, and then check the ps table to make sure there are no imap connections) However, I'm seeing two errmsgs in the maillog on the test machine: Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: Protocol not available Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: Protocol not available which appear to happen AFTER mail arrives at the production serverit seems to happen on my test server the next time my client goes to access mail AFTER mail has arrived at the production server. Subsequent client requests of the test server execute without error until AFTER the next time mail arrives at and my inbox is updated with it. Again, if I hadn't looked at the logs, I wouldn't know there was a problem...I can see
[Dovecot] Test environment question
My production DC machine owns the mail filesystems and is running DC V1.0.15 and mbox folder format. I am looking to test V1.1.3 on another machine, which NFS mounts the mail filesystems, but has its own local index FS. I have made this test environment my default connection in TBird, and it seems to work just fine. Also, I have made sure that my TBird client isn't connecting to the production server (it has multiple accounts but I have turned off the cehck for mail when starting and check for new mail every N minutes functions, and then check the ps table to make sure there are no imap connections) However, I'm seeing two errmsgs in the maillog on the test machine: Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): posix_fallocate() faile d: Protocol not available Sep 22 11:54:13 egg mail:err|error dovecot: IMAP(sdean): file_set_size() failed with mbox file /var/spool/mail/sdean: Protocol not available which appear to happen AFTER mail arrives at the production serverit seems to happen on my test server the next time my client goes to access mail AFTER mail has arrived at the production server. Subsequent client requests of the test server execute without error until AFTER the next time mail arrives at and my inbox is updated with it. Again, if I hadn't looked at the logs, I wouldn't know there was a problem...I can see my new mail just fine from the test server. The questions: Is this anything I should be concerned about? Is this a bug or a legit problem coming from my improper use of two servers against the same data. FWIW, I am using fcntl for both mbox read and write locks. procmail in the MDA on the production server, and its locking hierarchy dotlock,fcntl, which Timo previously approved. Thanks! Production dovecot -n output: # 1.0.15: /usr/local/etc/dovecot.conf listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd Test dovecot -n output: # 1.1.3: /usr/local/etc/dovecot.conf listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no verbose_ssl: yes login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 max_mail_processes: 1024 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_write_locks: fcntl mbox_dirty_syncs: no auth default: passdb: driver: pam userdb: driver: passwd
[Dovecot] Any sense of whether or not we're close to a V1.1.4 release?
Am about to make a push to go from V1.0 to V1.1 and wondered. run a simple installation with PAM/passwd authent and mbox folders, no plugins. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Any sense of when V1.1.3 might appear?
It's been a month since 1.1.2I'm about to do some V1.0 to V1.1 move work and I'd rather start on the curve instead of behind it.. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Any sense of when V1.1.3 might appear?
THANKS, Timo...you da man! Especially since we use mbox exclusively :( Timo Sirainen wrote: On Aug 27, 2008, at 5:40 PM, Stewart Dean wrote: It's been a month since 1.1.2I'm about to do some V1.0 to V1.1 move work and I'd rather start on the curve instead of behind it.. Wait. v1.1.2 seems to be especially broken with mboxes.. I'll try to get v1.1.3 out somewhat soon, although there are again something like 60 messages I should read/reply to in this list and several of them having bugs that need to be fixed.. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] How Can I Tell How Dovecot Was Installed?
Because it isn't busted? Charles Marcus wrote: Why anyone would knowingly run ancient versions of critical apps is beyond me. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Yea[h]
But Timo walks through the valley of the shadow for us all.so maybe he's entitled. Timo Sirainen wrote: On Aug 13, 2008, at 5:24 PM, Chris Wakelin wrote: Timo Sirainen wrote: Yea, ... I've been meaning to tell you that should be Yeah for an informal version of Yes, otherwise it's a very archaic form of Yes or Indeed as in Yea, though I walk in the valley of the shadow of death! Hmm. I've never paid attention to that. Grepping my IRC logs I seem to have used that since the beginning. But I can also see a lot of other people are saying yea (but no idea if they're native english speakers). Wikipedia says it's a common misspelling. Perhaps I should try to change it. :) -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Fwd: [MORG] IMAP5 List
And I wish to deity. that the IMAP protocol had feedback elements to inform the user of appropriate usage of IT resources, such as green/yellow/red indicators denoting info on the size of messages about to be sent, quotas, etc. Oh, yes, and that the imap alert, part of UWIMAP be made part of the core standard -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] [Fwd: Re: University of Washington lays off 66 technology workers.]
I would expect this means the end of UWIMAPwhich probably leaves DC as open-source IMAP of choice. There were 66 people doing IMAP and Pine/Alpine development that were laid off at UWash due to funding cuts; Mark Crispin, one of the fathers of IMAP, was among those laid off. From the keyboard of: James Morris Lead Engineer, UW Technology University of Washington = Here's the official text on the status of Alpine and UW imapd development for those that were asking: --- Here is what we know about our future plans for development of Alpine and UW IMAPd products. We are committed to completing our work on a new Web Alpine user interface and a corresponding release of Alpine and UW IMAPd. After this next release, which is anticipated later this summer, we'll continue assessing any future development plans and resources we can allocate to this effort. Thanks. == -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] v1.1.rc11 released
) quota-fs.c:327: error: expected ')' before 'xdr_getquota_args' quota-fs.c:333: warning: implicit declaration of function 'clnt_destroy' quota-fs.c:335: error: 'RPC_SUCCESS' undeclared (first use in this function) quota-fs.c:336: warning: implicit declaration of function 'clnt_sperrno' quota-fs.c:336: warning: initialization makes pointer from integer without a cast quota-fs.c:348: error: 'rquota' has no member named 'rq_active' quota-fs.c:350: error: 'rquota' has no member named 'rq_curblocks' quota-fs.c:352: error: 'rquota' has no member named 'rq_bsoftlimit' quota-fs.c:355: error: 'rquota' has no member named 'rq_curfiles' quota-fs.c:356: error: 'rquota' has no member named 'rq_fsoftlimit' quota-fs.c:363: error: 'rquota' has no member named 'rq_active' quota-fs.c:287: warning: unused variable 'call_status' quota-fs.c: In function 'fs_quota_get_bsdaix': quota-fs.c:478: warning: implicit declaration of function 'quotactl' make: 1254-004 The error code from the last command is 1. TIA, Woonsan --- On Thu, 6/19/08, Timo Sirainen [EMAIL PROTECTED] wrote: From: Timo Sirainen [EMAIL PROTECTED] Subject: [Dovecot] v1.1.rc11 released To: Dovecot News List [EMAIL PROTECTED] Cc: Dovecot Mailing List dovecot@dovecot.org Date: Thursday, June 19, 2008, 7:50 AM http://dovecot.org/releases/1.1/rc/dovecot-1.1.rc11.tar.gz http://dovecot.org/releases/1.1/rc/dovecot-1.1.rc11.tar.gz.sig This is the final v1.1 RC. Tomorrow I'll change only the version number, update the documentation and call it v1.1.0. But please test this anyway to make sure I didn't happen to break anything since rc10 :) - dovecot-uidlist is now recreated if it results in file shrinking over 25%. - Some other minor fixes -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Dovecot index, NFS, and multiple architectures
Gee, I've been running for a year now, albeit in an NFS environment where there are only four machines, 3 AIX (A master where the files are resident and 2 other machines as NFS clients...a mailing list server (which can write heavily to the mounts) and a login server (which writes lightly if at all)) and one Linux Fedora (reading only). I only use fcntl locks and no caching on the clients. Knock on wood, but we've had no corruption Charles Marcus wrote: On 6/18/2008, David Halik ([EMAIL PROTECTED]) wrote: * Linux workstations running Fedora 8/9 i386 and a locally called Dovecot 1.0.14 * NFS'd homedir with Maildir setup * NFS is on Solaris 9 sparcv9 (64bit) running Dovecot 1.0.14 NFS is only fully supported on 1.1+. This is why you're having trouble. 1.1rc10 is the latest, and the stable release is imminent, so you should have no trouble moving to it. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Dovecot index, NFS, and multiple architectures
When I opened your message, before I could even read it, NFS failed and corrupted everything. Shades of Shroedinger's Cat! Just kidding (I hope) :) Charles Marcus wrote: On 6/18/2008, Stewart Dean ([EMAIL PROTECTED]) wrote: Gee, I've been running for a year now, Note I said *fully* supported. Specifically - Timo recommends to use 1.1 if you're using NFS... but by all means, do what ever you like... :) -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Thanks to all who responded on Blackberry IMAP
Many good suggestions and comments. But while I was trying to do it right (silly me), the brass hat got it working with whatever is on the phone and I am told that everything is fine (until it isn't). Thanks to all who responded -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
The CFO of our college, a most formidable man, had decided to go Blackberry and Something Functional Must Be Done. We've had some users who we've not supported (and things got better for them when we switched from UWIMAP to Dovecot). BB, of course, has their half-baked sorta-IMAP-compliant client (and we do NOT want the BB Enterprise Server) that persistently keeps grabbing the mailbox and breaking the mailbox lock, causing no end of grief for the secretaries (plural, more than one) would also work with the mailbox. 1) Does anyone have recommendations and experience with a genuine BB IMAP client? Googling shows up LogicMail 2) I have been avoiding the plunge in multiple-access mailbox and just let the early BB adapter users thrash but I suppose it is time to do what I can with DC. We are running 1.0.12 with mbox format. Would some kind person grovel,grovel tell me where I should start reading plus any warnings. BB DC experience info would be a big help. Our CFO has a legendary temper and I would like to get as much as possible right the first time out... -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
Sure it will in your situation...but when you have more than one client going after the mailbox, they'll step on each other's work n vanilla Dovecot. And in this case there are at least 2 and as many as 4 or 5 mail clients all open at the same time going after an mbox format inbox. We originally had some Unpleasantness with the unsupported BB users where they left their BBs on at home and came to work and found that they would delete stuff and that it would then come back (their Macs were set to make deleted stuff disappear from the list but not be expunged until they did thatand when the BB popped up from its 5 minute nap and checked the mailbox, it would break the lock and invalidate the work). Those user now do an atomic delete with immediate expunge. And their use was simple compared to the CFO's...would you believe one of his 3 secretaries uses the Trash folder as a secondary storage area? shudder And cannot be talked out of it? Knute Johnson wrote: The CFO of our college, a most formidable man, had decided to go Blackberry and Something Functional Must Be Done. We've had some users who we've not supported (and things got better for them when we switched from UWIMAP to Dovecot). BB, of course, has their half-baked sorta-IMAP-compliant client (and we do NOT want the BB Enterprise Server) that persistently keeps grabbing the mailbox and breaking the mailbox lock, causing no end of grief for the secretaries (plural, more than one) would also work with the mailbox. 1) Does anyone have recommendations and experience with a genuine BB IMAP client? Googling shows up LogicMail 2) I have been avoiding the plunge in multiple-access mailbox and just let the early BB adapter users thrash but I suppose it is time to do what I can with DC. We are running 1.0.12 with mbox format. Would some kind person grovel,grovel tell me where I should start reading plus any warnings. BB DC experience info would be a big help. Our CFO has a legendary temper and I would like to get as much as possible right the first time out... My wife has a Blackberry Curve, 8310 (ATT version). I'm running my mailserver on Fedora 8 and the Dovecot is version dovecot-1.0.10- 4.fc8. She is using the built-in IMAP client with SSL and it works just fine. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
No. Other than: a) the griping fear of me personally (1 person) migrating 4000 users and b) the recurrent experience of trying to marshal everything necessary to do it, getting about a tenth of the way into *beginning* it and having some 4-alarm fire interrupt things...and then it's a month or two before things calm down again that I might take a shot at it again. These days, I've gotten cynical. I enjoy the peace and quiet for 4 hours to 3 days on the outside whereupon something else falls in the cart that I have deal with. Plus I have to wonder what the realities of moving from 1) mbox with one monster file to 2) maildir with inodes beyond measure and its effect on backup. Yes I know I should be able to just convert one user and find out...but the time isn't there for even that... Fear and Loathing, Sickness unto Death... Remember: when you (the sysadmin) do things really, really right, nobody knows you've done anything. Sounds like a 0 to negative sum game.. Benjamin R. Haskell wrote: Any particular reason you're tied to mbox other than having migrated from UW-IMAP? I suspect maildir, though not as lock-free as advertised, would have a much better time of things. (i.e. it's far better suited for multiple-client access.) -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
so far: LogicMail...V0.4.0 (not even V1.x, but O.x...is this beta?) http://www.logicprobe.org/proj/logicmail http://www.berryreview.com/2007/10/30/faq-alternative-3rd-party-email-applications-for-blackberry/ http://www.berryreview.com/2007/08/22/logicmail-free-imap-pop3-client-for-blackberry/ in beta, Tiggit http://www.berryreview.com/2008/02/15/tiggit-beta-another-3rd-part-email-client-for-blackberry/ Knute Johnson wrote: I don't know of any IMAP apps to get for a BB but if you come across a good one, please post a note here. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
It's been a while so I don't have the logs any more except for what was in my Sent folder As an example of what I am talking about, here is BB polling every 15 minutes in the maillog: Mar 5 03:06:09 mercury mail:info imapd[2085096]: Login user=sshore host=bda037. bis.na.blackberry.com [216.9.249.37] Mar 5 03:06:09 mercury mail:info imapd[2085096]: Logout user=sshore host=bda037 .bis.na.blackberry.com [216.9.249.37] Mar 5 03:20:39 mercury mail:info imapd[2961602]: Login user=sshore host=ten003. bis.na.blackberry.com [216.9.249.252] Mar 5 03:20:48 mercury mail:info imapd[2961602]: Logout user=sshore host=ten003 .bis.na.blackberry.com [216.9.249.252] and here are some clients fighting over the lock Mar 6 09:05:48 mercury mail:info imapd[970952]: Killed (lost mailbox lock) user =x host=cpe-24-161-103-11.hvc.res.rr.com [24.161.103.11] Mar 6 09:08:04 mercury mail:info imapd[844000]: Killed (lost mailbox lock) user =x host=[10.40.70.71] Mar 6 09:08:18 mercury mail:info imapd[2547784]: Killed (lost mailbox lock) use r=x host=cpe-24-161-103-11.hvc.res.rr.com [24.161.103.11] All I know is that I had some moderately important people screaming at me (I even heard the word useless) that the mail service was %^$#ed up. That after I made it dianetically clear (took 2 weeks) to them that there Must Only Ever Be One Mail Client Open At A Time, they no longer had problems. Scott Silva wrote: on 3-13-2008 11:14 AM Knute Johnson spake the following: so far: LogicMail...V0.4.0 (not even V1.x, but O.x...is this beta?) http://www.logicprobe.org/proj/logicmail http://www.berryreview.com/2007/10/30/faq-alternative-3rd-party-email-applications-for-blackberry/ http://www.berryreview.com/2007/08/22/logicmail-free-imap-pop3-client-for-blackberry/ in beta, Tiggit http://www.berryreview.com/2008/02/15/tiggit-beta-another-3rd-part-email-client-for-blackberry/ Knute Johnson wrote: I don't know of any IMAP apps to get for a BB but if you come across a good one, please post a note here. LogicMail looks interesting but it won't do StartTLS which I need. My setup uses mbox and I haven't seen any problems with multiple clients. What is the problem that I should be having? Thanks, So am I. The only time I had a problem is if multiple programs are trying to access the mbox file directly at the same time. As long as the multiple clients all go through dovecot, I don't have any problems. In fact, I often leave an instance of thunderbird running over my mailstore at my main office, and will hit the same store from my lappy, or from my other office. I have also had thunderbird and outlook running on the same machine looking at the mailstore while I try and reproduce an error that one of my users is having, and although it can sometimes slow down a bit, I don't see any problems. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Help! OT: Blackberry IMAP client suggestions/experience needed
I didn't field DC until 1.0 and have kept pretty much up to date...these problems were present with UWIMAP but got somewhat better since the switchover to DC. I can't imagine how DC could deal with two clients working on the same mbox inbox, where the first instance has changes that are local to the PC and not yet put on the server without DC breaking the lock of the first instance (and thus invalidating the incomplete changes on the PC) and giving it to the second...or is there some magic? Scott Silva wrote: on 3-13-2008 12:02 PM Stewart Dean spake the following: It's been a while so I don't have the logs any more except for what was in my Sent folder As an example of what I am talking about, here is BB polling every 15 minutes in the maillog: Is your dovecot version fairly current? This looks like some of the problems I saw in the betas. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Test Environment Question
I have my master IMAP server running DC V1.0.10. The homedir and INBOXdir are physically resident there and NFS exported (no caching) to 3 other machines. I have installed V1.1beta13 on one of them (which thus accesses the homedir/INBOXdir remotely) and plan to have a limited community test-drive it there. Are there any hazards or drawbacks in doing this? While the homedirs and INBOXdirs are thus shared, I have it so that each machine has its own local index directory and /var/run dir. Comments or dire warnings?
Re: [Dovecot] V1.1beta11 compile problem
Yep, that fixes it. THANKS! Timo Sirainen wrote: On Thu, 2007-12-20 at 18:48 +0200, Timo Sirainen wrote: On Wed, 2007-12-19 at 11:20 -0500, Stewart Dean wrote: Using IBM's C for AIX V9 with Ralf Becker's AIX adaption, I see this: + exec /usr/vac/bin/xlc -DHAVE_CONFIG_H -I. -I. -I../.. -I/opt/freeware/include/ openssl -g -c close-keep-errno.c -M source='compat.c' object='compat.o' libtool=no DEPDIR=.deps depmode=aix /bin/sh ../../depcomp /usr/local/dovecot/dovecot-cc -DHAVE_CONFIG_H -I. -I. -I ../..-I/opt/freeware/include/openssl -g -c compat.c + exec /usr/vac/bin/xlc -DHAVE_CONFIG_H -I. -I. -I../.. -I/opt/freeware/include/ openssl -g -c compat.c -M compat.c, line 64.71: 1506-275 (S) Unexpected text ';' encountered. compat.c, line 64.23: 1506-238 (S) Function argument cannot be type void. make: 1254-004 The error code from the last command is 1. Is this enough or do you need more? I was a bit worried this might happen with some compilers. Oh well, I'll just do it another slightly more complex way then. Oh, actually probably not. I had just accidentally committed it using a macro name that I later changed. See if this helps: http://hg.dovecot.org/dovecot/rev/0375f2c0a1f6 -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Timo'd BACK!
and he's taking names and answering questions. The bugs run for cover... Timo Sirainen wrote: On Thu, 2007-12-20 at 11:20 -0600, Andrew Garner wrote: On Dec 20, 2007 11:10 AM, Timo Sirainen [EMAIL PROTECTED] wrote: On Mon, 2007-12-17 at 12:52 -0600, Andrew Garner wrote: I've been getting the following error fairly often, which tends to result in a corrupted dovecot-uidlist. dovecot: IMAP([EMAIL PROTECTED]): file maildir-uidlist.c: line 1009 (maildir_uidlist_recreate): assertion failed: (file_size == (uoff_t)st.st_size) What filesystem do you use? This is an NFS filesystem on an EMC Clariion CX700 backend. The local client OS is Linux 2.6.18-5-686 (from debian/etch). And there are multiple Dovecot servers? Did you set mail_nfs_storage=yes? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] got too little data ??
For God's sake, Timo, cut us adrift for a week and study for your exams. You warned us; exercise some self-preservation. The community should understand that it has to fend for itself for awhile.and not make big changes on production systems Timo Sirainen wrote: On 11.12.2007, at 19.54, Benoit Branciard wrote: IMAP(username): FETCH for mailbox INBOX UID 23862 got too little data: 3186 vs 3206 Wonder why this started happening only now. I heard first about this last saturday, and now you.. Looks like I can reproduce this myself with stress testing as well. I don't remember seeing it before though. I'll see if I can get it fixed soon.
Re: [Dovecot] imap process consuming 100% CPU (Dovecot 1.0.3)
io_loop_run(ioloop = 0x2001d0e8), line 329 in ioloop.c
(dbx) list
329 io_loop_handler_run(ioloop);
330 }
331
332 void io_loop_stop(struct ioloop *ioloop)
333 {
334 ioloop-running = FALSE;
335 }
336
337 void io_loop_set_running(struct ioloop *ioloop)
338 {
(dbx) dump
io_loop_run(ioloop = 0x2001d0e8), line 329 in ioloop.c
(dbx) up
main(argc = 1, argv = 0x2ff22b50, envp = 0x2ff22b58), line 290 in main.c
(dbx) list
290 io_loop_run(ioloop);
291 main_deinit();
292
293 io_loop_destroy(ioloop);
294 lib_deinit();
295
296 return 0;
297 }
(dbx) dump
main(argc = 1, argv = 0x2ff22b50, envp = 0x2ff22b58), line 290 in main.c
(dbx) up
__start() at 0x11d8
(dbx) list
no source file
(dbx) dump
__start() at 0x11d8
(dbx) cont
execution completed
(dbx) quit
$
--
Stewart Dean, Unix System Admin, Henderson Computer Resources
Center of Bard College, Annandale-on-Hudson, New York 12504
[EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Jackie Hunt
ACNSVoice: (970) 663-3789
Colorado State University FAX:(970) 491-1958
Fort Collins, CO 80523 Email: [EMAIL PROTECTED]
--
Stewart Dean, Unix System Admin, Henderson Computer Resources
Center of Bard College, Annandale-on-Hudson, New York 12504
[EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Is there any way to query a secure imap server for certificate details
? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] alert function, V2
My thanks to Timo. Over here in the US, we just had another college campus shooting, but this time the campus was locked down and no more than the initial two victims were shot (not fatally). Implementing the imap alert function will give our college administration immediate emergency notification to anyone using email. Timo Sirainen wrote: http://dovecot.org/patches/1.0/imap-alert-plugin.c -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] alert function, V2
I guess the alert function is not part of the spec, because it appears to be unimplemented in Dovecot, even though most clients implement it. Timo, I would hope this would be easy to implement, and it's functionality that will be valuable to every installation. Here's why. America recently had the tragedy of a shooting rampage on a large university campus (yes, America should do something about the violence and free access to guns in our culture/society). What was worse was that, due to the lack of an emergency notification process, some 20+ people died needlessly. Now all college and university administration are scrambling to set up emergency notification processes. Our first take on this is a massive all-hands mailing list, but a) best case, it would take 15 minutes (and as much as an hour) to get to everybody's mailbox. b) users would have to read through their mail and stumble on the message What's needed is an in-your-face unavoidable alert, and the UWIMAP alert functionality provides this. As I recall, you touch just about anything in your IMAP client and there's a popup message in the middle of the client IMAP window...and it happens repeatedly. We tried it back 3-4 years ago and found it too annoying to use. For this purpose, it's perfect. The wy UWIMAP did it, the presence of the file /etc/imapd.alert triggers it, and the text in that file is transmitted to the client. The message has to be short, a one-liner for a small popup window, but this could be a pointer to a shared system message folder. Of course, DC could sense the activation of the alert in some other fashion that the presence of a file. Ideally, whatever activates the alert function should be able to be turned on remotely; I had in mind to do it using a mail aliases that is a pipe to a executable... What say you? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] alert function, V2
If you want to discuss politics, please contact me directly and off-list. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] alert function (possible WIBNI)
The imapd spec has a provision for an alert pop-up of any ASCII text message contained in /etc/imapd.alert on the IMAP server. Can I assume this is implemented on DC? It'd be real nice if in addition to the current all-users message, it was possible to do a per-user alert...but I guess that would be something for IMAP standards... -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] NFS rquota support
Sorry to be so clueless, but all the activity about rquotad drives me to admit my puzzlement (or ignorance)... I run rquotad on my mail server that also runs DCrquotad is used by the other 3 hosts (a login/FTP server, a mailing list server and a user mgmnt server) that NFS mount the folder and inbox filesystem...which are under filesystem quota on the mail server where they are physically resident. AFAIK it is not queried on the mail server...after all, filesystem quota is running there. How/why does DC need/use rquotad? Timo Sirainen wrote: On Tue, 2007-08-07 at 10:29 +0200, Nicolas STRANSKY wrote: Le 06.08.2007 18:08, Timo Sirainen a écrit : So both http://hg.dovecot.org/dovecot/rev/078d9dde99c8 and http://hg.dovecot.org/dovecot/rev/abec53314897 are needed to have rquota support with 1.0.x or is there anything else ? http://hg.dovecot.org/dovecot/rev/0dda1f746d63 also. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] Resend: How do I configure sendmail to accept emails for dovecot when dovecot has sql auth/user db.
I don't regard myself as much of an expert, but this is NOT a Dovecot question, rather one relating to sendmail or your O/S native authentication functionality. Speaking for myself, I run NIS/yp on my mailserver and then restrict login...this supplies authentication to all users receiving mail. I might (but don't) run LDAP as the primary authentication resource on this AIX box, in which case I could then use LDAP when receiving mail. Understand: Dovecot doesn't receive mail, sendmail does. Scott Silva wrote: Joseph Silverman spake the following on 8/1/2007 5:24 PM: Apologies for resending this, I am not sure it made it through the first time.. --- Included below are my config files: sendmail.mc, dovecot.m4, dovecot.conf, dovecot-sql.conf. Whenever I try to send email into this system, it rejects it with user does not exist, however, the user does exist as far as dovecot (imap) is concerned, it is in the database. THANKS - Yossie It came through the first time, but nobody has answered you yet. I don't have a good answer either, but you need to find a way for sendmail to use the same auth database, or replicate it somehow into virtualusers system. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] apparent bug with filesystem quota and message lists
Don't know if anyone else uses Berkeley derived filesystem quota, but IBM's AIX does. A little over a week after migrating from UWIMAP to DC (with mbox format unchanged) everything is clean except for this one problem: When users go over quota, when they login the next time, the folder list is blank. You can imagine the panicked calls to the Helpdesk. If their quotas are raised or re-graced, Get Mail returns the expected list. This behavior happens with a variety of clients: Pine, MacMail,TBird, Horde Webmail, etc. The index filesystem has no quota on it. I would have to imagine the Dovecot is using (or trying to use) some space in the quota'ed filesystems which the operating system won't allow, and this results in there being an empty file that DC uses for the message list sent to the client. There are NO messages in syslog (other than the expected login and logout) indicating any problems. Our legacy setup has the inboxes in /var/spool/mail, and the folders in ~/mail. The problem can happen either place. dovecot -n returns: # 1.0.1: /usr/local/etc/dovecot.conf listen: *:143 ssl_listen: *:993 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login login_processes_count: 12 login_max_processes_count: 774 verbose_proctitle: yes first_valid_uid: 200 mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u:INDEX=/var/dcindx/%u mbox_dirty_syncs: no mbox_lazy_writes: no auth default: passdb: driver: pam userdb: driver: passwd Suggestions? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] errmsg question
Am seeing: Jul 19 14:59:19 mercury mail:err|error dovecot: IMAP(jab): dotlock /var/spool/mail/jab.lock was immediately delet ed under us Jul 19 14:59:19 mercury mail:err|error dovecot: IMAP(jab): file_lock_dotlock() failed with mbox file /var/spool/m ail/jab: No such file or directory what does it mean, what should I be doing to alleviate or troubleshoot the problem? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] 1.0.1: corrupt index on fresh mailbox, ideas?
when will there be a respin for a V1.0.2? Timo Sirainen wrote: On Mon, 2007-07-09 at 11:45 -0700, Troy Engel wrote: dovecot: Jul 09 09:38:54 Error: IMAP(xxx): Maildir /home/x/xxx/Maildir sync: UIDVALIDITY changed (1183406107 - 1183999134) Fixed: http://hg.dovecot.org/dovecot-1.0/rev/90ea01bfaf82 -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Migrating subscription lists
I thought this would be relatively straightforwardI would create .subscriptions by doing an ls -1 of ~/mail. I'm running into some problems. 1) the ~/mail directories haves directories in them for 5% of the accounts! AFAIK, our mail sevice has always been UWIMAP with mbox format INBOXes, and it was my understanding that the mbox format is flat and NOT hierarchical and thus I'd have thought that ~/mail would be all folders and wouldn't have a directory with folders in it. Plus our users are not, as a rule, power/geek user that would understand even making subdirs in ~mail, so I don't know how this would have come to pass. Should this be? Or am I misunderstanding things? 2) Some people are consciously or unconsciously using the UWIMAP .mailboxlist subscription file as it is meant to be used, namely to *restrict* the folders shown. If/when I generated the Dovecot .subsbcriptions file by just doing an ls -1 of their mail directory, they will be surprised to see stuff not previously displayedthat they may very well not know they'd had. Murphy must be a terribly overworked deity...you'd think he'd take a rest now and then from maximizing entropy -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Tbird-DC state problem
A experienced sysadmin who's doing some guinea-pig use of DC just ran into the following situation: 1) He brings up SeaMonkey 2) About 30 minutes later, he's in the middle of some involved messaging, mistakenly hits the redX in the top right of the SeaMonkey window, knocking himself out of SeaMonkey. 3) He immediately reinvokes SeaMonkey, all appeared to be OK Viewed some e-mail and some web page references, tries to send a message and then the Send hung for a time with a message Sending Authenticate Info..after some minutes, a new E-mail window appeared stating the Server reported a timeout. As far as the message, it was apparently sent successfully, and saved in the Sent folder successfully. 4) He calls me in. I look through the syslog logging. There is nothing in the syslog critical stuff...and everything in the maillog looks normal. 5) He starts another message, tries to save it to Drafts and that hangs 6) I look more closely at the maillog and see a lot of logins (one a minute in some cases, but all appear to have been cleanly executed) plus one bunch of disconnected messages with one disconnected in idle in the period when the write to the Drafts would have been hung. Could it be that DC was in the middle of clean up in the initial disconnect/reconnect and SeaMonkey came back in the middle of it and one or the other's state tables got messed up (or both of them)? Shutting out of SeaMonkey, waiting a minute and reconnecting seems to have gotten things working again. Any comments? Anything I should be looking for? OTOH, this is the first real problem I've seen in some person-months of testing. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] Index question
The day I switch our user to dovecot and it goes into production, there will be a few thousand people all generating their indices for the first time (we have a legacy requirement for procmail, at least for now), so I wondered: 1) Is there is anyway to pre-emptively force indexing? 2) Is there any value in doing so? That is, will I gain much in terms of making the first time everyone connects to dovecot quicker (not that big initial wait)? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] listen parm questions
Q1: My imap server has 4 interfaces, but only one is used for imap traffic. Can I do this: listen = 10.20.30.40:10143 (when imap.mycollege.edu is 10.20.30.40) Or is there even any benefit to doing this? Q2: Can I specify more than one portduring test eval, I've had the IT dept using port 1043 for listenwhich I will, of course, change to 143 when DC goes production. So my department isn't cut off by that switchover, can I do this? listen = *:10143,143 or this listen = 10.20.30.40:10143,143 I did look at the wiki but didn't see anything -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] how do I download concurrency.c
When I click on the link I get not found on the server. I run on a 4 way and AIX has some pretty fancy concurrency so it would be interesting. But then I'm leaving this afternoon and won't be back until Monday. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] How do I test new code?
I know how to run a second instance of the *base* code (to check different functionality/config) and documented it in http://wiki.dovecot.org/RunningDovecot What I realize I don't know how to do is to run an altogether different version or build of the code as that second instance, which would be good to have to check out upgrades before they go into production. While I could do a build in the regular fashion and put DC somewhere else or name it something else, so I could invoke this different code, presumably that different code will still look for the subsidiary executables in the usual place. Do I have to change the DESTDIR parm when doing the make install or some such? I do realize that, just as I did with running a second instance of the *same* code, I'd have to change the config file, have a separate /var/run directory.. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] DC V1.0.1 release date
Is there a sense of when this might be? Will it include a fix for SSL with a second invocation? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] AIX mail quota plugin problems + dotlock problem resolved
1) The AIX quotactl subroutine is defined here(put it in the search box)
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/index.jsp
Partial cut and paste of it:
*#include jfs/quota.h*
*int quotactl (*/Path/*,*/ Cmd/*,*/ ID/*,*/ Addr/*)*
*int* /Cmd/
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/topic/com.ibm.aix.basetechref/doc/basetrf2/quotactl.htm#a2qk21b0bob*,* /ID/
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/topic/com.ibm.aix.basetechref/doc/basetrf2/quotactl.htm#bqk2d0bob*;*
*char ** /Addr/
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/topic/com.ibm.aix.basetechref/doc/basetrf2/quotactl.htm#oqk2310bob*,
** /Path/
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/topic/com.ibm.aix.basetechref/doc/basetrf2/quotactl.htm#xpk2250bob*;*
Description
The *quotactl* subroutine enables, disables, and manipulates disk
quotas for file systems on which quotas have been enabled.
On AIX, disk quotas are supported by the legacy Journaled File System
(JFS) and the enhanced Journaled File System (JFS2).
The /Cmd/ parameter is constructed through use of the
*QCMD(*/Qcmd/*,*/ type/*)* macro contained within the
*sys/fs/quota_common.h* file. The /Qcmd/ parameter specifies the quota
control command. The /type/ parameter specifies either user
(*USRQUOTA*) or group (*GRPQUOTA*) quota type.
The valid values for the /Cmd/ parameter in all supported file system
types sare:
*Q_QUOTAON*
Enables disk quotas for the file system specified by the /Path/
parameter. The /Addr/ parameter specifies a file from which to
take the quotas. The quota file must exist; it is normally created
with the *quotacheck*
http://publib.boulder.ibm.com/infocenter/pseries/v5r3/topic/com.ibm.aix.cmds/doc/aixcmds4/quotacheck.htm#a84c12e
command. The /ID/ parameter is unused. Root user authority is
required to enable quotas. By specifying the new quota file path
in the /Addr/ parameter, the *quotactl* command can also be used
to change the quota file that is being used without first
disabling disk quotas.
*Q_QUOTAOFF*
Disables disk quotas for the file system specified by the /Path/
parameter. The /Addr/ and /ID/ arguments are unused. Root user
authority is required to disable quotas.
Additional JFS specific values for the /Cmd/ parameter are as follows:
*Q_GETQUOTA*
Gets disk quota limits and current usage for a user or group
specified by the /ID/ parameter. The /Addr/ parameter points to a
*dqblk* buffer to hold the returned information. The *dqblk*
structure is defined in the *jfs/quota.h* file. Root user
authority is required if the /ID/ value is not the current ID of
the caller.
Did the trace hold any more information? Note that I didn't attach it
the first time I sent it to you, the second time I did. I also resent
the note with the trace attached to mailing list, but the mailman
software said it was too big, so I canceled the second post.
2) No, nothing is remote here:
1) dovecot is running here on mercury
2) mercury is where all the inboxes and home/folder dirs physically reside
3) These /are/ exported to other machines by mercury.
4) The quotaing is running on here mercury itself as part of O/S and
FSes; it is enabled during boot
5) rquotad runs to provide quota info to the remote machines where the
inboxes and home/folder dirs are NFS client imported and mounted
Timo Sirainen wrote:
On Tue, 2007-06-05 at 12:30 -0400, Stewart Dean wrote:
quotactl(Q_GETQUOTA, /) failed: Invalid argument
So apparently this quotactl() call is wrong with AIX:
if (quotactl(root-mount-mount_path, QCMD(Q_GETQUOTA, USRQUOTA),
root-uid, (void *)dqblk) 0) {
I don't know why though. You could try changing root-mount-mount_path
to some actual mbox file path to see if it returns errors then.
Except weren't your mailboxes NFS mounted? quotactl() doesn't work for
NFS mounts at all. For NFS you could try this instead
http://dovecot.org/patches/quota-rquotad.c
--
Stewart Dean, Unix System Admin, Henderson Computer Resources
Center of Bard College, Annandale-on-Hudson, New York 12504
[EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] multiple dovecot invocations
I need to have multiple invocations of dovecot running, one for productions and then one or more for test/dev, doing things like trying different authentication methods, getting quota working, etc. I knew how to do this with inetd, but I have been convinced that direct invocation is preferable, so I need to know how to do multiple invocations of dovecot. I had thought that perhaps I could do this: dovecot -c /usr/local/etc/dovecot2.conf where dovecot2.conf has different different listen port parms. This I did, and while it does seem to work, I get this error in the syslog: Jun 5 14:42:43 mercury mail:err|error dovecot: Socket already exists: /usr/local/var/run/dovecot/dict-server Jun 5 14:42:43 mercury mail:crit dovecot: execv(/usr/local/libexec/dovecot/dict) failed: No such file or directo ry Jun 5 14:42:43 mercury mail:err|error dovecot: child 1437914 (dict) returned error 84 (exec() failed) How do I correctly run multiple dc instances? -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
[Dovecot] AIX mail quota plugin problems
From reading the wiki for a filesystem quota, I took my shot at
1) building my binaries using the mods in AIXPluginsSupport
2) changing dovecot.conf and
3) putting the plugins in the library
But I'm getting this error message when I invoke dovecot:
Plugin imap_quota not found from directory /usr/local/lib/dovecot
Error: imap dump-capability process returned 89
It would seem that
a) I have the syntax or the parameters wrong
b) I didn't get the changes to the AIX build environment right
I've attached the dovecot -n output.
Here are the details of what I did.
1) dovecot.conf
=== within the imap config section ===
# Support for dynamically loadable plugins. mail_plugins is a space
separated
# list of plugins to load.
#mail_plugins =
#mail_plugin_dir = /usr/lib/dovecot/imap
# SD 5/24/07 tryout FS quota plugin
mail_plugins = quota imap_quota
mail_plugin_dir = /usr/local/lib/dovecot/imap
plugin {
# Here you can give some extra environment variables to mail processes.
# This is mostly meant for passing parameters to plugins. %variable
# expansion is done for all values.
# Quota plugin. Multiple backends are supported:
# dirsize: Find and sum all the files found from mail directory.
#Extremely SLOW with Maildir. It'll eat your CPU and disk
I/O.
# dict: Keep quota stored in dictionary (eg. SQL)
# maildir: Maildir++ quota
# fs: Read-only support for filesystem quota
#quota = maildir
# SD 5/24/07 Try FS quota support
quota = fs
I've tried it as both
mail_plugin_dir = /usr/local/lib/dovecot/imap
and
mail_plugin_dir = /usr/local/lib/dovecot
2) Both ways I see this error message:
4229 [EMAIL PROTECTED]:/usr/local/etc ## dovecot
ILoading modules from directory: /usr/local/lib/dovecot
IModule loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so
FPlugin imap_quota not found from directory /usr/local/lib/dovecot
Error: imap dump-capability process returned 89
4272 [EMAIL PROTECTED]:/usr/local/lib/dovecot/imap ## dovecot
ILoading modules from directory: /usr/local/lib/dovecot/imap
IModule loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so
FPlugin imap_quota not found from directory /usr/local/lib/dovecot/imap
Error: imap dump-capability process returned 89
3) These directories have the following contents:
4292 [EMAIL PROTECTED]:/usr/local/lib/dovecot ## ls -al
total 1168
drwxr-xr-x 3 root system 512 May 24 12:36 ./
drwxr-xr-x 7 root system 512 May 21 14:31 ../
-rw-r--r-- 1 root sys 292522 May 22 15:12
052207-1455-64bit-ssl.lib10_quota_plugin.a
-rwxr-xr-x 1 root sys 904 May 22 15:12
052207-1455-64bit-ssl.lib10_quota_plugin.la*
-rwxr-xr-x 1 root sys 270499 May 22 15:12
052207-1455-64bit-ssl.lib10_quota_plugin.so*
drwxr-xr-x 2 root system 512 May 24 12:41 imap/
lrwxrwxrwx 1 root system 65 May 24 12:36
lib10_quota_plugin.a@ - /usr/local/lib/dovecot/052207-1
455-64bit-ssl.lib10_quota_plugin.a
lrwxrwxrwx 1 root system 66 May 24 12:36
lib10_quota_plugin.la@ - /usr/local/lib/dovecot/052207-
1455-64bit-ssl.lib10_quota_plugin.la*
lrwxrwxrwx 1 root system 66 May 24 12:36
lib10_quota_plugin.so@ - /usr/local/lib/dovecot/052207-
1455-64bit-ssl.lib10_quota_plugin.so*
[EMAIL PROTECTED]:/usr/local/lib/dovecot/imap ## ls -al
total 152
drwxr-xr-x 2 root system 512 May 24 12:41 ./
drwxr-xr-x 3 root system 512 May 24 12:36 ../
-rw-r--r-- 1 root system19250 May 22 15:12
052207-1455-64bit-ssl.lib11_imap_quota_plugin.a
-rwxr-xr-x 1 root system 944 May 22 15:12
052207-1455-64bit-ssl.lib11_imap_quota_plugin.la*
-rwxr-xr-x 1 root system28645 May 22 15:12
052207-1455-64bit-ssl.lib11_imap_quota_plugin.so*
lrwxrwxrwx 1 root system 66 May 24 12:36
lib10_quota_plugin.so@ - /usr/local/lib/dovecot/052207-
1455-64bit-ssl.lib10_quota_plugin.so*
lrwxrwxrwx 1 root system 75 May 24 12:36
lib11_imap_quota_plugin.a@ - /usr/local/lib/dovecot/ima
p/052207-1455-64bit-ssl.lib11_imap_quota_plugin.a
lrwxrwxrwx 1 root system 76 May 24 12:36
lib11_imap_quota_plugin.la@ - /usr/local/lib/dovecot/im
ap/052207-1455-64bit-ssl.lib11_imap_quota_plugin.la*
lrwxrwxrwx 1 root system 76 May 24 12:36
lib11_imap_quota_plugins.so@ - /usr/local/lib/dovecot/i
Any suggestions?
--
Stewart Dean, Unix System Admin, Henderson Computer Resources
Center of Bard College, Annandale-on-Hudson, New York 12504
[EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
---BeginMessage---
# /usr/local/etc/dovecot.conf
listen: *:10143
ssl_listen: *:10943
disable_plaintext_auth: no
login_dir: /var/run/dovecot/login
login_executable: /usr/local/libexec/dovecot/imap-login
login_processes_count: 12
login_max_processes_count: 774
verbose_proctitle: yes
first_valid_uid: 200
mail_location: mbox
Re: [Dovecot] No authentication sockets found
AIX has a similar command istat, I have created a script to run and store it every 5 minutes and send me a text msg if the problem shows up... Timo Sirainen wrote: On Fri, 2007-05-18 at 15:23 -0400, Stewart Dean wrote: 3) What can I do to debug it, given that it happens infrequently and of no known causation? What should I check and look for afterwards? I guess I could put a cronjob that checks that /var/run/dovecot/login/ default= and ssl-parameters.dat exists periodically do ls -la /var/run/dovecot/login now, and when it breaks do it again. Also check /var/run/dovecot/login directory's inode (I've this nice stat command in Linux, don't know about AIX). That would tell if the files were really deleted or if the login directory was recreated. -- Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
Re: [Dovecot] No authentication sockets found
Back on 5/9, I made a post by this subject http://dovecot.org/list/dovecot/2007-May/022482.html Timo replied: The error message means that /var/run/dovecot/login directory or its contents was deleted while Dovecot was running. I'd guess that you start Dovecot too early and after startup another script goes and deletes the entire /var/run/ directory. Or maybe that's done in background. Or something.. and funkypunkydrunky reported: I have lived the same problem in my system. But not evrytime sometimes it only happens when i restart dovecot while mta is working. I think postfix (my mta) cannot connect the new authentication socket. If i need the restarting dovecot, i restart postfix too. It happens only for the above situation. This happened again under these circumstances: 1) The machine had been up for 5 days. Having made some changes (largely de-verbosifying the dovecot.conf file), I killed the master dovecot process and restarted it (this before I was informed I could just do a kill -1 to effect the same result with less trouble). May 14 15:34:09 mercury mail:info dovecot: Dovecot v1.0.0 starting up 2) Using TBird a an imap client, I got back on May 14 15:24:48 mercury mail:info dovecot: auth(default): client out: CONT 1 May 14 15:24:48 mercury mail:info dovecot: auth(default): client in: CONT 1 AHNkZWFuAEFsYW1hcjJi May 14 15:24:48 mercury mail:info dovecot: auth(default): pam(sdean,10.20.10.75): lookup service=dovecot May 14 15:24:49 mercury mail:info sendmail-SndRcv[2220248]: l4EJOief2949348: to=[EMAIL PROTECTED], delay=00:00:01, xdelay=00:00:01, mailer=local, pri=36928, dsn=2.0.0, stat=Sent May 14 15:24:49 mercury mail:info dovecot: auth(default): client out: OK 1 user=sdean May 14 15:24:49 mercury mail:info dovecot: auth(default): master in: REQUEST 6 909440 1 May 14 15:24:49 mercury mail:info dovecot: auth(default): passwd(sdean,10.20.10.75): lookup May 14 15:24:49 mercury mail:info dovecot: auth(default): master out: USER 6 sdean system_user=sdean uid=202 gid=200 home=/home/hcrc/sdean May 14 15:24:49 mercury mail:info dovecot: imap-login: Login: user=sdean, method=PLAIN, rip=10.20.10.75, lip=192.246.229.21, TLS May 14 15:24:49 mercury mail:info dovecot: IMAP(sdean): Effective uid=202, gid=200, home=/home/hcrc/sdean May 14 15:24:49 mercury mail:info dovecot: IMAP(sdean): mbox: data=/home/hcrc/sdean/mail:INBOX=/var/spool/mail/sdean:INDEX=/var/dcndx/sdean May 14 15:24:49 mercury mail:info dovecot: IMAP(sdean): mbox: root=/home/hcrc/sdean/mail, index=/var/dcndx/sdean, inbox=/var/spool/mail/sdean 3) 15 seconds after that, I started seeing a slew of these error messages, every 15 seconds or so: May 14 15:25:03 mercury mail:info imapd[2052334]: Logout user=ot119 host=[10.20.10.10] May 14 15:25:04 mercury mail:err|error dovecot: imap-login: No authentication sockets found May 14 15:25:04 mercury mail:err|error dovecot: child 835676 (login) returned error 89 4) Since this is the production server, I kill the master dovecot instance and reinvoke dovecot in the foreground. I haven't seen the problem again sincebut twice is problematic with just 3 people using DC. Now. My thoughts about what has been suggested so far, first by Timo: 1) This machine had been booted 5 days before so it's not a boot related problem 2) I'd find it hard to believe that something is nuking the contents of /var/run because: a) The directory doesn't exist by default in AIX; I created it for the DC install b) I have cron jobs that do cleanup with /var/log, /var/log/arc and /var/spool/mqueue, but nothing that does anything to /var/run 3) /var/run is local to the DC host and is not exported 4) funkypunkydrunky's comments about interaction with the MTA (sendmail in my case) seem unlikely, since it doesn't use SSL...or the same ports My questions: 1) What is happening? This is OpenSSL related, yes? 2a) Will this affect my production UWIMAP (which also supports/utilizes SSL)? If it doesn't, I can take my time debugging it (given that there are only 3 IT guys using DC currently), instead of frantically shutting it up by rebooting ASAP. I /think/ previously established DC connections continued to work 2b) How will this affect other imaps DC nex and pre-extant connections? I'm thinking of putting the whole IT dept on DC, but it'd be good to know how flaky things would get if/when this happens again. 3) What can I do to debug it, given that it happens infrequently and of no known causation? What should I check and look for afterwards? I guess I could put a cronjob that checks that /var/run/dovecot/login/ default= and ssl-parameters.dat exists periodically Stewart Dean, Unix System Admin, Henderson Computer Resources Center of Bard College, Annandale-on-Hudson, New York 12504 [EMAIL PROTECTED] voice: 845-758-7475, fax: 845-758-7035
