Re: [Dovecot] FTS cron script to force index updates
On 2/25/10 1:00 AM -0600 Stan Hoeppner wrote: From: http://wiki.dovecot.org/Plugins/FTS You could also build a cronjob to index users' mailboxes once in a while (by selecting each mailbox and issuing a SEARCH TEXT xyzzyx command). Has anyone written a script to perform the above? If not, how would I do this? Would I write a shell script to telnet to the IMAP port and then issue the commands? Can this be done with a bash script? Or would I need something more serious like a perl script? See the recent thread, fts squat - webmail ... -frank
Re: [Dovecot] Regarding: **OFF LIST** subject declaration
On Wed, 24 Feb 2010 21:28:29 -0600 Stan Hoeppner s...@hardwarefreak.com articulated: Is this all clear for you now? That **OFF LIST** was a simple mistake of forgetting to edit the subject line before getting the discussion back on the list? Interestingly enough, the 'OFF LIST declaration has now populated itself, which was what I meant in my original post. Personally, I feel that subject line declarations like OT, etc are just a wasted finger exercise. It ranks up there with those totally useless and legally unenforceable 'disclaimer' declarations. (see example below) By the way, this was in no way directed at you, or anyone else in particular. I was just curious as to why someone (anyone) would employ this tactic. In any case, it is time to retire this post. -- Jerry ges...@yahoo.com |=== |=== |=== |=== | This email and any files transmitted with it are confidential and intended solely for the use of the individual or entity to which they are addressed. If you are not the intended recipient of this transmission, please delete it immediately. Obviously, I am the idiot who sent it to you by mistake. Furthermore, there is no way I can force you to delete it. Worse, by the time you have reached this disclaimer you have all ready read the document. Telling you to forget it would seem absurd. In any event, I have no legal right to force you to take any action upon this email anyway. This entire disclaimer is just a waste of everyone's time and bandwidth. Therefore, let us just forget the whole thing and enjoy a cold beer instead.
[Dovecot] dovecot-2.0.beta3 tcpwrapper support in Solaris
Hi, 2.0 compiles fine in Solaris but and I've found only one glitch so far. Tcpwapper support needs some tweaks. I need to add CPPFLAGS=/usr/sfw/include because tcpd.h is in there. Then also LDFLAGS='-R/usr/sfw/lib -L/usr/sfw/lib' is needed. It would be nice to have --with-tcpwrap-dir or something. After this linking gives an error Undefined first referenced symbol in file deny_severity /usr/sfw/lib//libwrap.so allow_severity /usr/sfw/lib//libwrap.so These are not defined but application itself should define these globally so I've added these to configure and src/util/tcpwrap.c #include syslog.h int allow_severity = LOG_INFO; int deny_severity = LOG_WARNING; Tomppa
Re: [Dovecot] qmail-secretary plugin for dovecot deliver
hi, maybe look into mlmmj. (http://mlmmj.org/) darix -- openSUSE - SUSE Linux is my linux openSUSE is good for you www.opensuse.org
Re: [Dovecot] Duplicate Elimination
On 24.2.2010, at 16.15, Steffen Kaiser wrote: group1: us...@example.com,us...@example.com group2: us...@example.com,us...@example.com If i am sending a mail to group1 and group2. It is going two times a single mail to the user1 mailbox. But in dovecot it is not eliminating since it has the same message-id. Previously i was able to accomplish this task with cyrus duplicate elimination. two times a single mail to the user1 mailbox actually I do expect that the MTA detects the duplication of the two aliases and does NOT send the mail two times to user1. Yeah, I think that's what I answered before too. Dovecot currently has no duplicate elimination code. (I hate the whole concept of dropping incoming messages as duplicates based on Message-ID. I would definitely want it disabled for my own mails, for example that would mean I couldn't filter messages to mailing lists based on List-ID: header, because the first mail usually comes directly from the other user, and then the second mail with the List-ID: would get dropped.) Thanks for your valuable information. Actually its not a mailing list, its just an aliases created in my mail server. I had made changes in my mta to handle duplicate mails. Rgds, Aravind M D
Re: [Dovecot] IMAP Folders Don't Make Sense
On Thu, Feb 25, 2010 at 2:19 PM, Rick Romero r...@havokmon.com wrote: The entire structure doesn't look correct for Maildir. The folders you listed, puts you already in the INBOX, so your MUA should be seeing: INBOX\ Drafts INBOX\ ClamAV Dell.Quotes Dell.Warranty etc.etc.etc.. Sent Spam Trash If you are not seeing the folders in that order, then I think your dovecot.conf isn't quite right. Please post the output of dovecot -n No I don't appear to be seeing this and I think the fact that I have used different mail clients (Thunderbird, Evolution, etc etc etc) and think that their default folder structure may have made a mess on my IMAP Maildir structure over the years. Below is my dovecot -n: [r...@mail Maildir]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_cert_file: /srv/ssl/ghost.crt ssl_key_file: /srv/ssl/ghost.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix --- Beyond that I don't know why it's messed up and more importantly, how I can fix it. Any suggestions?
Re: [Dovecot] IMAP Folders Don't Make Sense
Quoting Carlos Williams carlosw...@gmail.com: On Thu, Feb 25, 2010 at 2:19 PM, Rick Romero r...@havokmon.com wrote: The entire structure doesn't look correct for Maildir. The folders you listed, puts you already in the INBOX, so your MUA should be seeing: INBOX\ Drafts INBOX\ ClamAV Dell.Quotes Dell.Warranty etc.etc.etc.. Sent Spam Trash If you are not seeing the folders in that order, then I think your dovecot.conf isn't quite right. Please post the output of dovecot -n No I don't appear to be seeing this and I think the fact that I have used different mail clients (Thunderbird, Evolution, etc etc etc) and think that their default folder structure may have made a mess on my IMAP Maildir structure over the years. Below is my dovecot -n: [r...@mail Maildir]# dovecot -n # 1.0.7: /etc/dovecot.conf protocols: imap ssl_cert_file: /srv/ssl/ghost.crt ssl_key_file: /srv/ssl/ghost.key login_dir: /var/run/dovecot/login login_executable: /usr/libexec/dovecot/imap-login mail_location: maildir:~/Maildir auth default: mechanisms: plain login passdb: driver: pam userdb: driver: passwd socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix --- Beyond that I don't know why it's messed up and more importantly, how I can fix it. Any suggestions? Try adding a namespace. namespace private { separator = . prefix = INBOX. inbox = yes }
Re: [Dovecot] IMAP Folders Don't Make Sense
Quoting Carlos Williams carlosw...@gmail.com: On Thu, Feb 25, 2010 at 2:07 PM, Frank Elsner fr...@moltke28.b.shuttle.de wrote: It might be useful to tell Thunderbird not only to show subscribed folders. Edit - Account settings - Server settings - Advanced, first check box. There are some MUAs which create folders but do not add subscriptions for the folders. The sylpheed I currently use is such a beast :-) In Thunderbird that option is already checked and it wouldn't explain why webmail (RoundCube) shows the exact same thing. I can't delete the folder from Thunderbird and I don't see it when I login to the mail server via shell. I am thinking there is something wrong with the folder listing or something like that. The entire structure doesn't look correct for Maildir. The folders you listed, puts you already in the INBOX, so your MUA should be seeing: INBOX\ Drafts INBOX\ ClamAV Dell.Quotes Dell.Warranty etc.etc.etc.. Sent Spam Trash If you are not seeing the folders in that order, then I think your dovecot.conf isn't quite right. Please post the output of dovecot -n Rick
Re: [Dovecot] IMAP Folders Don't Make Sense
On Thu, Feb 25, 2010 at 2:41 PM, Rick Romero r...@havokmon.com wrote: Try adding a namespace. namespace private { separator = . prefix = INBOX. inbox = yes } I made that change and reloaded Dovecot and all my users on the mail server lost the folders...
[Dovecot] Thunderbird 3.0.2 released (CONDSTORE fixed)
Just wanted to mentioned that those of you who were having issues with unread messages in Thunderbird should see your problem fixed with TB 3.0.2 that was released today. http://www.rumblingedge.com/2010/02/25/thunderbird-3-0-2-released/ If you previously turned off CONDSTORE support, don't forget to enable it. -- David Halik System Administrator OIT-CSS Rutgers University dha...@jla.rutgers.edu
Re: [Dovecot] **OFF LIST** Re: body search very slow since upgrade from 1.0.15 to 1.2.10
On 24.2.2010, at 20.27, Timo Sirainen wrote: Looks like there's something very wrong with mbox with v1.2+. It's doing a *lot* of message header parsing work that doesn't happen with v1.1 or with other mailbox formats. Probably because I fixed some bugs where it was wrongly caching some state, but now it's not caching it long enough. Looks like some input stream seeking optimizations are broken (when one input stream reads from another, which reads from another, ...). I already managed to fix the performance problem, but now it's corrupting saved mails sometimes. So a while longer to get it fully fixed :) And since it's a pretty big change, I'm not sure if I want to risk breaking v1.2 by changing it, so maybe it's v2.0 only.
Re: [Dovecot] IMAP Folders Don't Make Sense
Quoting Carlos Williams carlosw...@gmail.com: On Thu, Feb 25, 2010 at 2:41 PM, Rick Romero r...@havokmon.com wrote: Try adding a namespace. namespace private { separator = . prefix = INBOX. inbox = yes } I made that change and reloaded Dovecot and all my users on the mail server lost the folders... Yikes! I thought this was a private install. :( The namespace would be a pretty radical change. It tells dovecot how to present folders. I'm not a namespace guru - but I'm fairly sure that's the issue. http://wiki.dovecot.org/Namespaces I would suggest creating an alternate config file, using different ports and system directories, to test a namespace change. Rick
Re: [Dovecot] body search very slow since upgrade from 1.0.15 to 1.2.10
Quoting Stan Hoeppner s...@hardwarefreak.com: Are you using any FTS plugins? Squat? Nope, not as far as I know. Dovecot -n lists the following plugins: mail_plugins(default): zlib acl imap_acl mail_plugins(imap): zlib acl imap_acl mail_plugins(pop3): zlib mail_plugin_dir(default): /usr/lib64/dovecot/imap mail_plugin_dir(imap): /usr/lib64/dovecot/imap mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3 plugin: acl: vfile:/var/dovecot/acls acl_shared_dict: file:/var/dovecot/indexes/shared_mailboxes And are you sure you're doing full body searches, not just headers only? Yes. Header searches are much faster. :) -- Eric Rostetter The Department of Physics The University of Texas at Austin Go Longhorns!
Re: [Dovecot] IMAP Folders Don't Make Sense
Quoting Carlos Williams carlosw...@gmail.com: On Thu, Feb 25, 2010 at 2:55 PM, Carlos Williams carlosw...@gmail.com wrote: On Thu, Feb 25, 2010 at 2:41 PM, Rick Romero r...@havokmon.com wrote: Try adding a namespace. namespace private { separator = . prefix = INBOX. inbox = yes } I made that change and reloaded Dovecot and all my users on the mail server lost the folders... Sorry - I was wrong. This didn't remove anything from my server. I guess it helps when you issue the ls -la command. I was just being paranoid. My question now is how do I clean up my Maildir/ to how it should be? No problem - it's the display that was changed due to the namespace config. Right now after the change and successfully restarting IMAP, I have the following directory when I login to Linux. I haven't opened up any mail clients yet... Do your users have their mailboxes back? That's the first thing. If you're the only one with a funky layout, then forget yours, and get theirs back to normal. :) So instead of changing the namespace, I suppose it would be better to conform your mailbox to what the server expects. So I guess I'd do: mv .INBOX.CDW .CDW mv .INBOX.Dell .Dell mv .INBOX.Dell.Certification .Dell.Certification etc etc etc Your .INBOX/ directory should contain cur/ new/ and tmp/ directories, where you can move/copy the individual emails into your ~home/Maildir/cur/ new/tmp/ Maybe you had a MUA with a .INBOX prefix set, and when you created your folders, it stuck that in there... ? Rick
Re: [Dovecot] IMAP Folders Don't Make Sense
Quoting Carlos Williams carlosw...@gmail.com: On Thu, Feb 25, 2010 at 3:08 PM, Rick Romero r...@havokmon.com wrote: Yikes! I thought this was a private install. :( The namespace would be a pretty radical change. It tells dovecot how to present folders. I'm not a namespace guru - but I'm fairly sure that's the issue. http://wiki.dovecot.org/Namespaces I would suggest creating an alternate config file, using different ports and system directories, to test a namespace change. It's OK. It appears to not have impacted any existing data. Perhaps just changes how the new folders are managed. Yep. I did see a file in my Maildir called 'subscriptions' and when I opened it with a text editor, it had the old invalid IMAP directory structure...should I delete or rename this file on my mailbox and then restart the client to force it to re-build this subscriptions file? The subscriptions file is only used by the MUAs, and you can set them to ignore it. I would just tell the MUAs to ignore it. You can safely delete it - except if you have an MUA that is using it then the folders will disappear... I suppose if you have a PDA and a huge folder structure you might have the PDA use subscriptions and trim down the folder list... I would 'start fresh' and remove it.
Re: [Dovecot] IMAP Folders Don't Make Sense
On Thu, Feb 25, 2010 at 3:21 PM, Rick Romero r...@havokmon.com wrote: The subscriptions file is only used by the MUAs, and you can set them to ignore it. I would just tell the MUAs to ignore it. You can safely delete it - except if you have an MUA that is using it then the folders will disappear... I suppose if you have a PDA and a huge folder structure you might have the PDA use subscriptions and trim down the folder list... I would 'start fresh' and remove it. When I remove this file, my mail clients (webmail Thunderbird) no longer see any of my sub folders. How can I remove this file if it holds obsolete data and still be able to see my Inbox sub folders? I reverted back to my original dovecot.conf file as when I posted my original. No changes basically have been made. When I add your suggestion for namespace to my config, I for some reason then have a main Inbox folder in my mail client and then it has a subdirectory called inbox and that has all my IMAP folders listed. So it's a bit redundant for the Inbox folder only.
Re: [Dovecot] IMAP Folders Don't Make Sense
On 2/25/2010 4:35 PM, Carlos Williams wrote: On Thu, Feb 25, 2010 at 4:10 PM, Brian Haydenbhay...@umn.edu wrote: You need to: 1. Remove your subscriptions file. This I did. Now I can no longer see from the client side any of my IMAP folders. 2. Set your client to ignore subscriptions and view all folders. I logged into my webmail and in the main mailbox view all my IMAP folders except for Inbox and the default ones were missing. I then opened up the folders settings option and 'subscribed' to all the folders I didn't see in my main mailbox view. Once I enabled 'subscription' via webmail, I could then see all my folders again. Is this wrong? You stated the opposite should be done. I would think if they were not selected for subscription, I would see them but it appears to be the other way around. How can I see my messages on my email client with out the 'subscriptions' file in my Maildir? I am assuming this questions' answer varies depending on what client we're talking about, no? 3. Then, and only then, settle on a server configuration (including any namespaces you may choose to use), and then re-subscribe to folders in your client (if you are going to insist on using subscriptions). It's impossible to get your server configuration correct if you're judging the user-visible side by a client using legacy subscriptions, particularly if the subscriptions file is in an unreliable state (as it sounds like yours is--as most of them almost always are). I just can't see how to get any IMAP client to read IMAP folders w/o that 'subscriptions' file. It appears that it looks for it or is in some way dependent on this file. Am I wrong? The subscriptions file is technically optional. For instance, Thunderbird has a setting to either use nor not use it. If TB uses subscriptions then you need to subscribe to all folders that you want to see. Otherwise it will show all folders. Dunno about your webmail, however as an example SquirrelMail uses subscriptions, no way around it. With this combination, I'd enable webmail subscriptions and disable TB's use of subscriptions. For TB if you want to ignore subscriptions, go into your Account Settings, select Server Settings under the correct account, click the Advanced button in the Server Settings sub-box, and uncheck Show only subscribed folders. Leeman
[Dovecot] any limitations running on a Mac?
I have postfix/dovecot/mysql installed using MacPorts on a quad-core 2.8GHz MacPro running Snow Leopard (10.6.2). I moved the base mail directory to a pair of 10k RPM Raptors that are mirrored (/Volumes/email/) and everything seems to be working fine on an unused domain with very little traffic. I used imapsync to pull everything from the current mailserver to this test server to play with. Our current mailserver's IMAP performance *really* suffers when an IMAP folder exceeds ~500MB or ~5k messages. I've become very tired of being the mailbox police trying to get my 20 users to delete email or divide into smaller mailboxes. Are there folks on the list running postfix/dovecot on similar Mac hardware that can share their experiences? Specifically, are there any limitations (file descriptors, other?) that can impact performance I should be aware of? How does dovecot on the Mac deal with 500GB maildirs? Is there a recommended tool for loading and testing the server? Postal? I have 20 IMAP users, with a total of ~37GB of mail currently. Thanks for any help and insight. -Terry Terry Barnum digital OutPost San Diego, CA http://www.dop.com 800/464-6434
Re: [Dovecot] any limitations running on a Mac?
On Feb 25, 2010, at 5:17 PM, Bradley Giesbrecht wrote: On Feb 25, 2010, at 4:31 PM, Terry Barnum wrote: On Feb 25, 2010, at 3:29 PM, Bradley Giesbrecht wrote: On Feb 25, 2010, at 2:17 PM, Terry Barnum wrote: I have postfix/dovecot/mysql installed using MacPorts on a quad-core 2.8GHz MacPro running Snow Leopard (10.6.2). I moved the base mail directory to a pair of 10k RPM Raptors that are mirrored (/Volumes/email/) and everything seems to be working fine on an unused domain with very little traffic. I used imapsync to pull everything from the current mailserver to this test server to play with. Our current mailserver's IMAP performance *really* suffers when an IMAP folder exceeds ~500MB or ~5k messages. I've become very tired of being the mailbox police trying to get my 20 users to delete email or divide into smaller mailboxes. Are there folks on the list running postfix/dovecot on similar Mac hardware that can share their experiences? Specifically, are there any limitations (file descriptors, other?) that can impact performance I should be aware of? How does dovecot on the Mac deal with 500GB maildirs? Is there a recommended tool for loading and testing the server? Postal? I have 20 IMAP users, with a total of ~37GB of mail currently. Thanks for any help and insight. Mac OS X 10.5.8 dovecot 1.2.9 Two mirrored 7200rpm sata drives. dbox mailbox format Thanks Brad. What hardware is this running on? Also, are you using the plain vanilla Apple RAID tool for mirroring or something else like SoftRAID? DP G5 2Ghz. 5.5GB ram. Apple Disk Utility software RAID 1. Users are virtual in mysql. I also have a fairly busy application hitting mysql. Mysql seems to be cacheing around 120 threads which is less the config max and I usually have a around 700MB of free memory. User Inbox count around 200 on 20 domains but we are a Print company and have to except large attachments and store indefinitely. I looked at the wiki on dbox but shied away from it because the compatibility matrix said postfix didn't like it. Did I read that wrong? Would you mind sharing your postfix -n and dovecot -n? Edited and offlist would be fine. Did you use macports to build dovecot? Yes. 1.2.10. If so I'm working of some new packages you may be interested in. Mostly dovecot-sieve and dovecot-managesieve. I have started to look at sieve and can see how it could be useful for my iPhone users. Currently they have to leave Mail.app running on their desktop to sort mail into IMAP folders since the phone doesn't have any sort by rules filters. So yes, I'm interested. Your welcome to hit me up off list if you have some non-dovecot questions. I'm small time compared to many here but I love dovecot and won't be looking elsewhere till I come home broke and bleeding. // Brad Terry Barnum digital OutPost San Diego, CA http://www.dop.com 800/464-6434
[Dovecot] What does mailman do with a 'post' command?
Dear list, I am sorry if this question should not be posted here, but I believe that there are many experts of postfix or any other thing such as mailing lists in this list. I am kind of in hurry and need some advices to know about my questions. Could anyone in this list please answer my questions if you know. My questions are about routing work of mailman. As I am not quite fimiliar with the use of mailman, I am sorry if this is a stupid question. One of my customer gets the following log message into /var/log/maillog at around 12:00 every day. ---/var/log/maillog--- 12:00:04 relay postfix/pickup[6279]: 244811C805C: uid=41 from=mailman 12:00:04 relay postfix/cleanup[21529]: 244811C805C: message-id=20100215030004.244811c8...@example.co.jp 12:00:04 relay postfix/qmgr[20068]: 244811C805C: from=mail...@example.co.jp, size=1728, nrcpt=1 (queue active) 12:00:04 relay postfix/local[21232]: 244811C805C: to=mail...@example.co.jp, orig_to=mailman, relay=local, delay=0.17, delays=0.05/0/0/0.12, dsn=2.0.0, status=sent (delivered to command: /usr/lib/mailman/mail/mailman post mailman) This message seems that it delivers a command '/usr/lib/mailman/mail/mailman post' to execute against the mailman mailing list, however, the customer never use mailman mailing list on their system. One thing that I doubt is that a cronjob in /etc/cron.d/mailman does something relevant of this because the post time of the messages is always reight after the following work. ---/etc/cron.d/mailman--- 0 12 * * * mailman /usr/lib/mailman/cron/senddigests or 0,5,10,15,20,25,30,35,40,45,50,55 * * * * mailman /usr/lib/mailman/cron/gate_news --- I'm afraid that I don't have /etc/mailman/aliases file of cutomer's, but by default(in my test env), it should looks like below. /etc/mailman/aliease # STANZA START: mailman # CREATED: Mon Jan 25 16:48:18 2010 mailman: |/usr/lib/mailman/mail/mailman post mailman mailman-admin: |/usr/lib/mailman/mail/mailman admin mailman mailman-bounces: |/usr/lib/mailman/mail/mailman bounces mailman mailman-confirm: |/usr/lib/mailman/mail/mailman confirm mailman mailman-join: |/usr/lib/mailman/mail/mailman join mailman mailman-leave: |/usr/lib/mailman/mail/mailman leave mailman mailman-owner: |/usr/lib/mailman/mail/mailman owner mailman mailman-request: |/usr/lib/mailman/mail/mailman request mailman mailman-subscribe: |/usr/lib/mailman/mail/mailman subscribe mailman mailman-unsubscribe: |/usr/lib/mailman/mail/mailman unsubscribe mailman # STANZA END: mailman My questions are as follows. 1.What exactly is the cause the message in /var/log/maillog? 2.Why does the messages send to mailman(mail...@example.co.jp) user even though that mailing list never be used? OS:RHEL5 postfix-2.3.3-2.1.el5_2 mailman-2.1.9-4.el5 Any comments would be greatly appreciated. Best Regards, -- --- Masaharu Kawada Associate Technical Support Engineer Red Hat K K Ebisu Neonato 5F 1-18 Ebisu 4-chome, Shibuya-ku Tokyo 150-0013, Japan Direct: +81-3-5798-8482
Re: [Dovecot] any limitations running on a Mac?
On 26.2.2010, at 3.50, Terry Barnum wrote: I looked at the wiki on dbox but shied away from it because the compatibility matrix said postfix didn't like it. Did I read that wrong? You need to be delivering mails with Dovecot LDA when using dbox. And that might help improve performance even when you're using maildir. Did you use macports to build dovecot? Yes. 1.2.10. You could try if maildir_very_dirty_syncs=yes helps. With v2.0+ mdbox will probably work very nicely. dbox (with v1.x or v2.0) still uses one file/message and I guess if you had trouble with 5k+ messages in a mailbox with Maildir, you'll probably hit the same slowness with dbox.
Re: [Dovecot] any limitations running on a Mac?
On Feb 25, 2010, at 9:42 PM, Timo Sirainen wrote: On 26.2.2010, at 3.50, Terry Barnum wrote: I looked at the wiki on dbox but shied away from it because the compatibility matrix said postfix didn't like it. Did I read that wrong? You need to be delivering mails with Dovecot LDA when using dbox. And that might help improve performance even when you're using maildir. Did you use macports to build dovecot? Yes. 1.2.10. You could try if maildir_very_dirty_syncs=yes helps. With v2.0+ mdbox will probably work very nicely. dbox (with v1.x or v2.0) still uses one file/message and I guess if you had trouble with 5k+ messages in a mailbox with Maildir, you'll probably hit the same slowness with dbox. Will there be a way to convert from dbox t mdbox in version v2.0+? // Brad