Re: ATrpms repo
Am 15.07.2014 05:42, schrieb Will Yardley: Tried mailing the maintainer, but didn't get a response -- anyone know what's happened to the ATrpms repo? Not only is http://atrpms.net/name/dovecot/ empty, but: http://packages.atrpms.net/dist/el6/ seems to return a 404. Some of the mirrors still have the packages, but does anyone know if they're going to continue to build 2.2.x packages? avoid ATrpms enable this repo unconditionally sooner or later will *** your OS installation because he overrides base packages often in incompatible ways and mixed with sane repos like rpmfusion years ago already leaded in randomly crashing applications additionally the packages are poor tested i remember a WLAN driver which crashed my system after an update and the reponse was sorry typo which means for me careless maintaining signature.asc Description: OpenPGP digital signature
Re: If local Dovecot stops working, check lo
On 7/14/14, Jiri Bourek bou...@thinline.cz wrote: On 14.7.2014 00:24, Nick Edwards wrote: On 7/12/14, Steve Litt sl...@troubleshooters.com wrote: experience with Debian Wheezy is that lo goes down a lot, so this is one of the first things I do when odd stuff happens. Use a better operating system then Blaming operating system after *one* person reports something strange about it seems a bit overboard, doesn't it...? debian has a long history of being clueless: old packages in new releases, untested packages in releases (mailscanner did not, and was never going to, work out of thebox in a recent release) debian has history of thinking it knows better than upstream: openssl screwup they told debian was wrong but debian released it anyway causing grief for not only debian systems but all systems including windows that used certs generated on a debi\an server. and dont get me started on debians release/ftp manager and the personal biases there either, shall I go? I can but it would be a bore for most.
Re: Postfix user@domain splitting
you need to show doveconf -n and what you have in the master.conf for dovecot On 7/15/14, Ricardo Branco rica...@wenn.com wrote: I have been trying looking though all the wiki documents to setup LMTP. It now seems to all be connected except that it keeps saying that the user is not recognised when postfix sends to LMTP, it sends the full recipent email address but seems that on the dovecot side it is unable to work with this. I have checked the userdb and made sure its using %n but alas it still does not work. Currently ive had to revert to using LDA as it works fine with that but i still dont know how as the postfix config variable $RECIPIENT is the full email address and does not seem to matter to LDA.
Re: Permissions with mailman
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 4 Jul 2014, Niklas Lemcke - 林樂寬 wrote: On Thu, 03 Jul 2014 12:49:14 -0700 Robert L Mathews li...@tigertech.com wrote: On 7/3/14, 11:03 AM, Niklas Lemcke - 林樂寬 wrote: Jul 2 15:29:39 blade01 dovecot: lda(list): Error: user list: Initialization failed: Initializing mail storage from mail_location setting failed: mkdir(/var/mail/vmail//list/mail) failed: Permission denied (euid=38(list) egid=38(list) Now since dovecot is running as user vmail According to the error, it's not running as user vmail for this delivery. It's running as uid/gid 38, list. Look at how lda gets executed for this delivery to see why it's using uid 38. I'm not sure why it's using uid 38, but even so, the user list is in the group vmail and thus should be able to write to /var/mail/vmail. However it reports it's not in the group. = confused is it possible that Dovecot cannot read /etc/group ? Maybe you can strace the Dovecot LDA and see something in the trace. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBU8T2+3z1H7kL/d9rAQLMTAf/ZFovEOpyXMPqlOJxWR4Sgrm+grv0hhZV +pFnerDeDxKJxWGJ5LcfQaNWGQTMR1L3Hu7wiZ4Pk79tmaL0J3QRmBDCcXIh63Uu mLFnzJcDx9wtZ5lVzOELabrHEedmLScAEaqXmuz30hVdHM/uL/h5+RU1FmOQSvjB HKLs1HiGTkUaqazVY4lMM7Ig1MurqzWzOnko0VwnP5yVYSmQyO+V02T1TV7gulsB lOXR+cKHxcRm6IXnGTEKhm2Q4JFi+45Ny/RvnHb3nUsls3n2YZ6TPHFA2P9WrCEn +kOoKGCzXIqW3tz8GY4zemxWsF+iasoaux2OuQzAsHsTEHcOYcdasw== =fogh -END PGP SIGNATURE-
Re: If local Dovecot stops working, check lo
On 15.7.2014 11:13, Nick Edwards wrote: On 7/14/14, Jiri Bourek bou...@thinline.cz wrote: On 14.7.2014 00:24, Nick Edwards wrote: On 7/12/14, Steve Litt sl...@troubleshooters.com wrote: experience with Debian Wheezy is that lo goes down a lot, so this is one of the first things I do when odd stuff happens. Use a better operating system then Blaming operating system after *one* person reports something strange about it seems a bit overboard, doesn't it...? debian has a long history of being clueless: old packages in new releases, untested packages in releases (mailscanner did not, and was never going to, work out of thebox in a recent release) As most Linux distributions, Debian is a collective work done mostly by volunteers. If you want newer versions and tested packages, feel free to help them. And honestly, the situation about untested and old packages isn't as grim as you're trying to say. debian has history of thinking it knows better than upstream: openssl screwup they told debian was wrong but debian released it anyway causing grief for not only debian systems but all systems including windows that used certs generated on a debi\an server. AFAIK it was actually the other way around. Debian maintainers asked on openssl-dev list if their change is ok and were told that it is. and dont get me started on debians release/ftp manager and the personal biases there either, shall I go? I can but it would be a bore for most. As far as I am concerned, there's no need to be more OT than we are now. Also please stop sending me personal messages, I am on the list.
fts solr database size
Hi, Could anyone share any numbers about real life solr database size/cpu/memory usage for certain amounts of messages ? We have now over 5TB of maildirs (about 5 000-6 000 concurrent imap clients) and I'm trying to guess how much hardware might be needed. -- Michal
Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated messages, constant reloading (TB) missing new messages (K-9)
Am 15.07.2014 03:12, schrieb David Gessel:
* In thunderbird, I get constant downloading of messages. Every time I
switch to the inbox from another folder, the messages start
redownloading. This sometimes, but not always, seems to create
duplicate messages, but I'm now fairly sure they are only created in the
client and not on the server. Searching through various forums, it
appears this has been a problem for Thunderbird for some time, but it
wasn't for me on Courier. As posts about similar errors seem to have
petered out over the last year without any clear guidance on how to fix
it that I could find, I expect there's a simple fix I just haven't found
yet, either in TB configuration or in Dovecot. Any hints? I tried
Thunderfix to remove the .msf files and will be redownloading my mail
over the thin pipe out to Iraq for the next 6 months (DOH!). One
artifact is that when I restart thunderbird, my inbox is reported as
having about 130 messages in it, then thunderbird starts redownloading
headers and eventually gets back up to the 1297 currently listed both in
the TB pane and by ls | wc -l in /cur. Is it possible there is a time
out that needs to be extended? In TB, I've set (among other less
apparently relevant options)
mailnews.tcptimeout;1000
mail.db.idle_limit;3000
How old is your Thunderbird profile. Have you tried creating a new one
and see if the problem persists?
Thunderfix should not be needed by the way. Just right click on the
folder = Properties = Repair
server # dovecot -n
# 2.2.13: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 9.2-RELEASE amd64
auth_default_realm = mydomain.com
auth_mechanisms = plain login
auth_realms = mydomain.com mydomain2.org
disable_plaintext_auth = no
first_valid_gid = 5000
first_valid_uid = 5000
hostname = mydomain.com
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
imap_idle_notify_interval = 29 mins
last_valid_gid = 5000
last_valid_uid = 5000
lda_mailbox_autocreate = yes
listen = *
mail_gid = 5000
mail_location = maildir:~/:CONTROL=/var/no-quota/%u
mail_plugins = quota mail_log notify
mail_temp_dir = /var/tmp
mail_uid = 5000
maildir_broken_filename_sizes = yes
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave duplicate spamtest spamtestplus editheader
mbox_lazy_writes = no
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
special_use = \Sent
}
mailbox Sent Messages {
special_use = \Sent
}
mailbox Trash {
special_use = \Trash
}
prefix =
}
passdb {
args = /usr/local/etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
plugin {
expire = Trash
mail_log_events = delete undelete expunge copy mailbox_delete
mailbox_rename
mail_log_fields = uid box msgid size
quota = maildir:User quota
quota_exceeded_message = Storage quota for this account has been
exceeded, please try again later.
quota_rule = *:storage=50G
quota_rule2 = Trash:storage=+30%%
quota_rule3 = Sent:storage=+30%%
quota_warning = storage=90%% quota-warning 90 %u
quota_warning2 = storage=75%% quota-warning 75 %u
sieve = ~/.dovecot.sieve
sieve_before = /usr/local/etc/dovecot/sieve/
sieve_dir = ~/sieve
sieve_extensions = +spamtest +spamtestplus +relational
+comparator-i;ascii-numeric +editheader
}
postmaster_address = ges...@mydomain.com
protocols = imap lmtp sieve sieve
sendmail_path = /usr/local/sbin/sendmail
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0666
user = postfix
}
unix_listener auth-userdb {
group = vmail
mode = 0600
user = vmail
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
service_count = 1
vsz_limit = 128 M
}
service quota-warning {
executable = script /usr/local/bin/quota-warning.sh
unix_listener quota-warning {
user = vmail
}
user = vmail
}
ssl = required
ssl_cert = /usr/local/etc/ca/server-cert.pem
ssl_cipher_list =
ECDHE-RSA-AES256-GCM-SHA384:ECDHE-RSA-AES256-SHA384:ECDHE-RSA-AES128-GCM-SHA256:ECDHE-RSA-AES128-SHA256:ECDHE-RSA-RC4-SHA:ECDHE-RSA-AES256-SHA:!SSLv2
ssl_key = /usr/local/etc/ca/server-unencrypted-key.pem
ssl_prefer_server_ciphers = yes
userdb {
driver = prefetch
}
userdb {
args = /usr/local/etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
protocol lda {
mail_plugins = quota mail_log notify sieve
}
protocol imap {
mail_max_userip_connections = 20
mail_plugins = quota mail_log notify imap_quota imap_zlib
}
protocol lmtp {
mail_plugins = quota mail_log notify sieve
}
I don't know if it makes a difference for you as you are not using
LAYOUT=fs but try to disable those imap_client_workarounds.
--
Re: fts solr database size
We are no way as big as you but in terms users but our user vs mailbox size is large. Dovecot: 50 users 425Gb (mdbox + zlib) Note solr only indexes folders within a mailbox when a search is done on them so size can vary and most people dont realise that the default type of search in Thunderbird is on Sender/Recipients/Subject which happens localy and not on the server so you dont get solr indexing unless the user does a custom search and forces remote. Webmail systems though will tend to do server searches. Solr: Num Docs: 17m Size: 4.5GB Lazy wrote, On 15/07/2014 10:53: Hi, Could anyone share any numbers about real life solr database size/cpu/memory usage for certain amounts of messages ? We have now over 5TB of maildirs (about 5 000-6 000 concurrent imap clients) and I'm trying to guess how much hardware might be needed.
Re: Postfix user@domain splitting
Attached files
Nick Edwards wrote, On 15/07/2014 10:19:
you need to show doveconf -n
and what you have in the master.conf for dovecot
On 7/15/14, Ricardo Branco rica...@wenn.com wrote:
I have been trying looking though all the wiki documents to setup LMTP.
It now seems to all be connected except that it keeps saying that the
user is not recognised when postfix sends to LMTP, it sends the full
recipent email address but seems that on the dovecot side it is unable
to work with this.
I have checked the userdb and made sure its using %n but alas it still
does not work.
Currently ive had to revert to using LDA as it works fine with that but
i still dont know how as the postfix config variable $RECIPIENT is the
full email address and does not seem to matter to LDA.
# 2.2.13: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.32-431.20.3.el6.x86_64 x86_64 CentOS release 6.5 (Final)
auth_master_user_separator = *
auth_mechanisms = plain login
auth_username_chars =
abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_
auth_username_format = %n
base_dir = /var/run/dovecot/
debug_log_path = /var/log/imapd_debug.log
deliver_log_format = msgid=%m: , From:%f , Subject:%s , Status:%$
disable_plaintext_auth = no
dotlock_use_excl = no
info_log_path = /var/log/imapd_info.log
log_path = /var/log/imapd.log
login_greeting = I am ready.
mail_cache_min_mail_count = 5
mail_fsync = always
mail_location = mdbox:~/mdbox
mail_plugins = acl zlib fts fts_solr fts_squat
mail_privileged_group = mail
maildir_stat_dirs = yes
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy
include variables body enotify environment mailbox date ihave duplicate
imapflags notify
mdbox_rotate_interval = 1 days
mmap_disable = yes
namespace {
location = maildir:/home/public
prefix = Public/
separator = /
subscriptions = no
type = public
}
namespace {
list = children
location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u
prefix = shared/%%u/
separator = /
subscriptions = no
type = shared
}
namespace inbox {
inbox = yes
location =
prefix =
separator = /
type = private
}
passdb {
driver = pam
}
plugin {
acl = vfile
antispam_allow_append_to_spam = no
antispam_backend = mailtrain
antispam_debug_target = /var/log/imapd_debug.log
antispam_mail_notspam = --ham
antispam_mail_sendmail = /usr/bin/sa-learn-pipe.sh
antispam_mail_spam = --spam
antispam_signature = X-WENN-MailScanner-SpamCheck
antispam_signature_missing = error
antispam_spam_pattern_ignorecase = SPAM
antispam_spool2dir_notspam = /tmp/spamspool/.HAM/%%020lu-%u-%%05luh
antispam_spool2dir_spam = /tmp/spamspool/.SPAM/%%020lu-%u-%%05lus
antispam_tmp = /tmp
antispam_trash_pattern_ignorecase = mail-trash;Trash;*Deleted*
antispam_unsure = CHECK4SPAM
antispam_verbose_debug = 1
fts = solr
fts_solr = break-imap-search url=http://db.wenn.com:8983/solr/dovecot/
fts_squat = partial=4 full=10
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
sieve_extensions = +notify +imapflags
zlib_save = gz
zlib_save_level = 2
}
protocols = imap pop3 sieve lmtp
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0666
user = postfix
}
user = dovecot
}
service imap-login {
process_min_avail = 2
service_count = 10
vsz_limit = 128 M
}
service imap-postlogin {
executable = script-login /root/bin/imap_login_checks.sh
}
service imap {
executable = imap imap-postlogin
vsz_limit = 512 M
}
service lmtp {
inet_listener lmtp {
address = 127.0.0.1
port = 24
}
unix_listener /var/spool/postfix/private/dovecot-lmtp {
group = postfix
mode = 0600
user = postfix
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
inet_listener sieve_deprecated {
port = 2000
}
}
service pop3-postlogin {
executable = script-login /root/bin/pop3_login_checks.sh
}
service pop3 {
executable = pop3 pop3-postlogin
}
ssl_cert = /etc/pki/dovecot/certs/dovecot.crt
ssl_key = /etc/pki/dovecot/private/dovecot.pem
userdb {
args = username_format=%u /etc/passwd
driver = passwd-file
name = passwd-file
}
protocol lda {
info_log_path = /var/log/dovecot-deliver.log
log_path = /var/log/dovecot-deliver.log
mail_plugins = acl zlib fts fts_solr fts_squat sieve acl zlib fts fts_solr
postmaster_address = postmas...@wenn.com
sendmail_path = /usr/lib/sendmail
}
protocol imap {
imap_capability = IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE
SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN
NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 ESEARCH ESORT SEARCHRES WITHIN
CONTEXT=SEARCH LIST-STATUS ACL SPECIAL-USE
mail_max_userip_connections = 50
mail_plugins = acl zlib fts fts_solr fts_squat acl imap_acl antispam
}
protocol lmtp {
info_log_path = /var/log/dovecot-lmtp.log
Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated messages, constant reloading (TB) missing new messages (K-9)
Original Message
Subject: Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated
messages, constant reloading (TB) missing new messages (K-9)
From: Alex JOST jost+li...@dimejo.at
To: dovecot@dovecot.org
Date: Tue Jul 15 2014 13:30:31 GMT+0300 (Arabic Standard Time)
Am 15.07.2014 03:12, schrieb David Gessel:
* In thunderbird, I get constant downloading of messages. Every time I
switch to the inbox from another folder, the messages start
redownloading. This sometimes, but not always, seems to create
duplicate messages, but I'm now fairly sure they are only created in the
client and not on the server. Searching through various forums, it
appears this has been a problem for Thunderbird for some time, but it
wasn't for me on Courier. As posts about similar errors seem to have
petered out over the last year without any clear guidance on how to fix
it that I could find, I expect there's a simple fix I just haven't found
yet, either in TB configuration or in Dovecot. Any hints? I tried
Thunderfix to remove the .msf files and will be redownloading my mail
over the thin pipe out to Iraq for the next 6 months (DOH!). One
artifact is that when I restart thunderbird, my inbox is reported as
having about 130 messages in it, then thunderbird starts redownloading
headers and eventually gets back up to the 1297 currently listed both in
the TB pane and by ls | wc -l in /cur. Is it possible there is a time
out that needs to be extended? In TB, I've set (among other less
apparently relevant options)
mailnews.tcptimeout;1000
mail.db.idle_limit;3000
How old is your Thunderbird profile. Have you tried creating a new one
and see if the problem persists?
It is a new profile created with the transition from Cyrus to Dovecot
about a week ago, but I used IMAPSync to move all my mail from the
ancient Cyrus server to the shiny new Dovecot server. I then deleted
the old profile.
Thunderfix should not be needed by the way. Just right click on the
folder = Properties = Repair
I did see that, but first thought there was something magic about
thunderfix then decided to use it anyway because I have annual
sent/recieved archives from 2000 (and one for pre-2000) so that would
have been a lotta right-clicking.
server # dovecot -n
# 2.2.13: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 9.2-RELEASE amd64
auth_default_realm = mydomain.com
auth_mechanisms = plain login
auth_realms = mydomain.com mydomain2.org
disable_plaintext_auth = no
first_valid_gid = 5000
first_valid_uid = 5000
hostname = mydomain.com
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
imap_idle_notify_interval = 29 mins
last_valid_gid = 5000
last_valid_uid = 5000
lda_mailbox_autocreate = yes
listen = *
mail_gid = 5000
mail_location = maildir:~/:CONTROL=/var/no-quota/%u
mail_plugins = quota mail_log notify
mail_temp_dir = /var/tmp
mail_uid = 5000
maildir_broken_filename_sizes = yes
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave duplicate spamtest spamtestplus editheader
mbox_lazy_writes = no
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
special_use = \Sent
}
mailbox Sent Messages {
special_use = \Sent
}
mailbox Trash {
special_use = \Trash
}
prefix =
}
passdb {
args = /usr/local/etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
plugin {
expire = Trash
mail_log_events = delete undelete expunge copy mailbox_delete
mailbox_rename
mail_log_fields = uid box msgid size
quota = maildir:User quota
quota_exceeded_message = Storage quota for this account has been
exceeded, please try again later.
quota_rule = *:storage=50G
quota_rule2 = Trash:storage=+30%%
quota_rule3 = Sent:storage=+30%%
quota_warning = storage=90%% quota-warning 90 %u
quota_warning2 = storage=75%% quota-warning 75 %u
sieve = ~/.dovecot.sieve
sieve_before = /usr/local/etc/dovecot/sieve/
sieve_dir = ~/sieve
sieve_extensions = +spamtest +spamtestplus +relational
+comparator-i;ascii-numeric +editheader
}
postmaster_address = ges...@mydomain.com
protocols = imap lmtp sieve sieve
sendmail_path = /usr/local/sbin/sendmail
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0666
user = postfix
}
unix_listener auth-userdb {
group = vmail
mode = 0600
user = vmail
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
service_count = 1
vsz_limit = 128 M
}
service quota-warning {
executable = script /usr/local/bin/quota-warning.sh
Re: Postfix user@domain splitting
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On Tue, 15 Jul 2014, Ricardo Branco wrote:
Attached files
Nick Edwards wrote, On 15/07/2014 10:19:
you need to show doveconf -n
and what you have in the master.conf for dovecot
On 7/15/14, Ricardo Branco rica...@wenn.com wrote:
I have been trying looking though all the wiki documents to setup LMTP.
It now seems to all be connected except that it keeps saying that the
user is not recognised when postfix sends to LMTP, it sends the full
recipent email address but seems that on the dovecot side it is unable
to work with this.
I have checked the userdb and made sure its using %n but alas it still
does not work.
userdb {
args = username_format=%u /etc/passwd
driver = passwd-file
name = passwd-file
}
In opposite to your sentence I see a %u there.
Currently ive had to revert to using LDA as it works fine with that but
i still dont know how as the postfix config variable $RECIPIENT is the
full email address and does not seem to matter to LDA.
- --
Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
iQEVAwUBU8UcInz1H7kL/d9rAQKXQAgAmu6NnZOqdQKEgKhk6q/CPtXza+dkUh7f
4Ms2tJFw2krwKNeZOvKGOsEeD7XyFDYpfZFDqEewjffqlABUUytIRPXzD3xFvzXV
DuXTW1VseEP26ewR7odHN9J+WL1Unh52HnxFgM63Bo1IwYzF84K09VO3DxqobuF7
S8MqQYj6MPqB73IZUbVzRkCDBM0mv52Gx14LFmmPXbphgZFmtixkUy2CpPOT/l02
0aBSsJZqV/ySKcB2V5UNCj8GoGvwyH3Jh9RFeNIlUKYZYT9s534rfbKu7+T6645I
67daEtZjfAbBOi/foqh41kbSpSaHIMvF970EP/EozFgMBsnghQ+SLg==
=6YKs
-END PGP SIGNATURE-
Re: HIGHESTMODSEQ tracking
2014-07-15 3:47 GMT+04:00 Michael M Slusarz slus...@curecanti.org: Quoting Kostya Vasilyev kmans...@gmail.com: Gmail still does have a few users, though. A few dozen at least, maybe more :) And it has a big advantage, from my point of view, over Cyrus / Dovecot -- there is but one server version that's consistent for all accounts. Yes, they do some things wrong (like not sending message flags changes over IDLE connections), but I can test something in my personal account, get feedback from 3-5-10 users with @gmail accounts, and be reasonably confident that everything is fine (and that I'd know know if it's not). This is getting a bit off-topic on this list... but Gmail does a LOT of things wrong. Head over to one of the IMAP lists for further information. This is just one glaring example. Maybe you've ran into more than I have. In any case, the point stands - with Gmail, it's much easier to be confident, from actual testing, that things works a certain way. If you are testing against Gmail as the gold standard as to how a IMAP server should operate, I never said or implied that. In fact, I pointed out a serious issue with Gmail's IMAP IDLE implementation, which means the exact opposite of holding it as a gold standard. I can safely say you are Doing It Wrong. It seems you enjoy pointing out to people when they're wrong or incorrect so much, you actually put meaning into their words that's not there? Or it it just me? For the more than 50% market share of Dovecot / Cyrus, do you have a breakdown by version number? At least in terms of 1.* vs 2.0 and higher? I do not. And without being able to get a version number from a Dovecot session (or so it seems to me -- nothing returned from ID...) it looks kind of sad. Maybe. You can't tell until you actually see whether the EXAMINE/SELECT returns HIGHESTMODSEQ or NOMODSEQ. Are you saying that Dovecot will always (*will always*, and I mean *always*) return NOMODSEQ after a client expresses interested in modseq values and the server can't enable it for some reason? Much like UIDVALIDITY should never change, NOMODSEQ will never be sent (practical usage) for an active CONDSTORE access. You are asking about a tremendously rare occurrence. In theory, yes, but I just wouldn't want to be surprised (and surprise my users). The whole deal with HIGHESTMODSEQ 1 is irrelevant if you enable CONDSTORE. I can't tell you what a server will return if you enable CONDSTORE in one session, but then don't in another. But that doesn't matter, since you aren't using HIGHESTMODSEQ in the latter case. As long as CONDSTORE is active, HIGHESTMODSEQ will be updated, at least in my 6 year experience with Dovecot which involves handling installations with millions of users. Thank you. This is the type of response, based on actual real-world experience, that I was looking for. Or if it was previously enabled, and then well, I don't know, something happened? By *always* I mean -- since Dovecot first started having a CONDSTORE in its CAPS, including version a.b.c that came with now really old Debian X, and version h.j.k that came with now really old RHEL Y, but which are still out there on actual mail servers, being used in actual mail accounts? I have never run into an issue with HIGHESTMODSEQ for a properly CONDSTORE-enabled session for Dovecot ever. I was one of the first people (that I am aware of) that implemented CONDSTORE/QRESYNC back in the early days (2009) ... and Dovecot was exclusively the server I was developing with at that time. Great. Thank you again for a data point that comes from the real world. When something goes wrong in an email app, then to the user, it's always the email app developer's fault. Nobody gives a damn about the subtleties of what RFC abc says about xyz, or if server version j.k.l from three years ago had a bug. Agree, but only up to a certain point. If something is so onerous to work around, then it *is* ok to say it's the server's fault and we're not going to work around this. Like everything else in life, there is a cost/benefit analysis that must be done to determine where that line needs to be drawn. Using modseq is an optimization. An optimization that makes things not work is not something I'd like to have. So, before enabling certain optimizations for Dovecot, I thought I'd ask on a Dovecot mailing list, about actual behavior for this server feature. [snip] There are certainly bugs - I found several of them years ago when the code was brand new (here's a thread: http://markmail.org/message/ fj74xta5z5uv4nix). But nothing that was showstopping. And none of those versions are being run anymore for all intents and purposes. Thanks. It's somewhat worrying that enabling CONDSTORE just once will cause the server to always track modseq values from that point on -- causing new code paths to execute. But
Dovecot2 Antispam MAILTRAIN backend with SpamAssassin
Hi there,
I've already asked this question on FreeBSD forums without getting any
response. So, I thought it's a good idea to ask it again here.
I've setup Dovecote2 (2.2.13) + Postfix + SpamAssassin on my FreeBSD 10
VPS and it works flawlessly. Though, I couldn't setup the Dovecot
Antispam plugin to train SpamAssassin when I move mails to the Junk
folder.
I installed the plugin from FreeBSD ports and followed the official
documentation [1] and the man page [2] without any success.
This is my configuration:
# 2.2.13: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-RELEASE-p6 i386 ufs
auth_mechanisms = plain login digest-md5
disable_plaintext_auth = no
first_valid_gid = 6
first_valid_uid = 26
last_valid_gid = 6
last_valid_uid = 26
lmtp_save_to_detail_mailbox = yes
mail_gid = mail
mail_location = mdbox:/mail/%d/%u
mail_privileged_group = mail
mail_uid = mailnull
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave
namespace inbox {
inbox = yes
location =
mailbox Archive {
auto = no
special_use = Archive
}
mailbox Drafts {
auto = subscribe
special_use = Drafts
}
mailbox Flagged {
auto = no
special_use = Flagged
}
mailbox Junk {
auto = subscribe
special_use = Junk
}
mailbox Sent {
auto = subscribe
special_use = Sent
}
mailbox Trash {
auto = subscribe
special_use = Trash
}
mailbox virtual/All {
auto = no
special_use = All
}
prefix =
separator = /
}
passdb {
args = /mail/%d/dovecot_passwd
driver = passwd-file
}
plugin {
antispam_backend = MAILTRAIN
antispam_mail_notspam = --ham
antispam_mail_sendmail = /mail/sa-learn-pipe.sh
antispam_mail_spam = --spam
antispam_spam = Junk
antispam_trash = Trash
quota_rule = *:storage=8GB
sieve = /mail/%d/%u/dovecot.sieve
sieve_dir = /mail/%d/%u
sieve_global_dir = /mail/sieve
sieve_global_path = /mail/sieve/globalfilter.sieve
}
protocols = imap pop3 lmtp sieve
service auth {
unix_listener auth-client {
group = mail
mode = 0660
user = postfix
}
unix_listener auth-master {
group = mail
mode = 0600
user = mailnull
}
user = root
}
service imap-login {
inet_listener imap {
address = *
port = 143
}
inet_listener imaps {
address = *
port = 993
}
process_limit = 32
process_min_avail = 1
}
service lmtp {
unix_listener /var/spool/postfix/private/dovecot-lmtp {
group = postfix
mode = 0660
user = postfix
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
process_min_avail = 0
service_count = 1
vsz_limit = 64 M
}
service managesieve {
process_limit = 1024
}
service pop3-login {
inet_listener pop3 {
address = *
port = 110
}
inet_listener pop3s {
address = *
port = 995
}
process_limit = 32
process_min_avail = 1
}
ssl_cert = /etc/ssl/dovecot/cert.pem
ssl_key = /etc/ssl/dovecot/key.pem
userdb {
args = /mail/%d/dovecot_passwd
driver = passwd-file
}
verbose_proctitle = yes
protocol lmtp {
mail_plugins = sieve
postmaster_address = postmas...@somedomain.com
quota_full_tempfail = yes
}
protocol sieve {
mail_max_userip_connections = 10
managesieve_implementation_string = Dovecot Pigeonhole
managesieve_logout_format = bytes=%i/%o
managesieve_max_line_length = 65536
}
protocol imap {
imap_client_workarounds = delay-newmail tb-extra-mailbox-sep
mail_plugins = quota imap_quota antispam
}
protocol pop3 {
mail_plugins = quota
pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
}
protocol lda {
mail_plugins = quota sieve
postmaster_address = postmas...@somedomain.com
sendmail_path = /usr/local/sbin/sendmail
}
And, this is the script /mail/sa-learn-pipe.sh:
echo /usr/local/bin/sa-learn $* /tmp/sendmail-msg-$$.txt
echo $$-start ($*) /tmp/sa-learn-pipe.log
#echo $* /tmp/sendmail-parms.txt
cat0 /tmp/sendmail-msg-$$.txt
/usr/local/bin/sa-learn $* /tmp/sendmail-msg-$$.txt
rm -f /tmp/sendmail-msg-$$.txt
echo $$-end /tmp/sa-learn-pipe.log
exit 0
I made it excecutable by all users using chmod a+x
/mail/sa-learn-pipe.sh
The problem is, there is no log in /var/log/maillog regarding the
Antispam plugin, and the script won't get called when I move any message
in/out to/from Junk folder.
I'll appreciate any help.
--
When I give, I give myself. - Walt Whitman
Links:
--
[1] http://wiki2.dovecot.org/Plugins/Antispam
[2]
http://hg.dovecot.org/dovecot-antispam-plugin/raw-file/tip/doc/dovecot-antispam.7.txt
Re: Dovecot2 Antispam MAILTRAIN backend with SpamAssassin
I remember, that I also struggled for quite a while until I figured it
out. Here is what I used on my FreeBSD Dovecot installation ...
Remember, that the following code is working on dovecot --version
1.2.12 ... but it could also be valid for later versions. I simply
havn't checked it out yet.
### Dovecot AntiSpam ###
# mail signature (used with any backend requiring a signature)
#antispam_signature = X-Spam-Status
#antispam_signature_missing = move
antispam_mail_sendmail = /usr/local/etc/dovecot/sa-learn-helper.sh
antispam_mail_sendmail_args = --username=%Lu
antispam_mail_spam = --spam
antispam_mail_notspam = --ham
antispam_mail_tmpdir = /tmp
antispam_spam = Spam
#antispam_unsure = Virus
antispam_trash = Trash
echo '#!/usr/local/bin/bash
#/usr/local/bin/sa-learn ${1} ${2} ${3} ${4}
/var/log/DoveDamnAntiSpam.log
/usr/local/bin/sa-learn ${1} ${2} ${3} ${4}
exit 0
' /usr/local/etc/dovecot/sa-learn-helper.sh
chmod 0777 /usr/local/etc/dovecot/sa-learn-helper.sh ;
chown root:wheel /usr/local/etc/dovecot/sa-learn-helper.sh ;
Best regards
Leander
Am 15.07.14 15:00, schrieb Mohammad S. Babaei:
Hi there,
I've already asked this question on FreeBSD forums without getting any
response. So, I thought it's a good idea to ask it again here.
I've setup Dovecote2 (2.2.13) + Postfix + SpamAssassin on my FreeBSD 10
VPS and it works flawlessly. Though, I couldn't setup the Dovecot
Antispam plugin to train SpamAssassin when I move mails to the Junk
folder.
I installed the plugin from FreeBSD ports and followed the official
documentation [1] and the man page [2] without any success.
This is my configuration:
# 2.2.13: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 10.0-RELEASE-p6 i386 ufs
auth_mechanisms = plain login digest-md5
disable_plaintext_auth = no
first_valid_gid = 6
first_valid_uid = 26
last_valid_gid = 6
last_valid_uid = 26
lmtp_save_to_detail_mailbox = yes
mail_gid = mail
mail_location = mdbox:/mail/%d/%u
mail_privileged_group = mail
mail_uid = mailnull
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave
namespace inbox {
inbox = yes
location =
mailbox Archive {
auto = no
special_use = Archive
}
mailbox Drafts {
auto = subscribe
special_use = Drafts
}
mailbox Flagged {
auto = no
special_use = Flagged
}
mailbox Junk {
auto = subscribe
special_use = Junk
}
mailbox Sent {
auto = subscribe
special_use = Sent
}
mailbox Trash {
auto = subscribe
special_use = Trash
}
mailbox virtual/All {
auto = no
special_use = All
}
prefix =
separator = /
}
passdb {
args = /mail/%d/dovecot_passwd
driver = passwd-file
}
plugin {
antispam_backend = MAILTRAIN
antispam_mail_notspam = --ham
antispam_mail_sendmail = /mail/sa-learn-pipe.sh
antispam_mail_spam = --spam
antispam_spam = Junk
antispam_trash = Trash
quota_rule = *:storage=8GB
sieve = /mail/%d/%u/dovecot.sieve
sieve_dir = /mail/%d/%u
sieve_global_dir = /mail/sieve
sieve_global_path = /mail/sieve/globalfilter.sieve
}
protocols = imap pop3 lmtp sieve
service auth {
unix_listener auth-client {
group = mail
mode = 0660
user = postfix
}
unix_listener auth-master {
group = mail
mode = 0600
user = mailnull
}
user = root
}
service imap-login {
inet_listener imap {
address = *
port = 143
}
inet_listener imaps {
address = *
port = 993
}
process_limit = 32
process_min_avail = 1
}
service lmtp {
unix_listener /var/spool/postfix/private/dovecot-lmtp {
group = postfix
mode = 0660
user = postfix
}
}
service managesieve-login {
inet_listener sieve {
port = 4190
}
process_min_avail = 0
service_count = 1
vsz_limit = 64 M
}
service managesieve {
process_limit = 1024
}
service pop3-login {
inet_listener pop3 {
address = *
port = 110
}
inet_listener pop3s {
address = *
port = 995
}
process_limit = 32
process_min_avail = 1
}
ssl_cert = /etc/ssl/dovecot/cert.pem
ssl_key = /etc/ssl/dovecot/key.pem
userdb {
args = /mail/%d/dovecot_passwd
driver = passwd-file
}
verbose_proctitle = yes
protocol lmtp {
mail_plugins = sieve
postmaster_address = postmas...@somedomain.com
quota_full_tempfail = yes
}
protocol sieve {
mail_max_userip_connections = 10
managesieve_implementation_string = Dovecot Pigeonhole
managesieve_logout_format = bytes=%i/%o
managesieve_max_line_length = 65536
}
protocol imap {
imap_client_workarounds = delay-newmail tb-extra-mailbox-sep
mail_plugins = quota imap_quota antispam
}
protocol pop3 {
mail_plugins = quota
pop3_client_workarounds = outlook-no-nuls oe-ns-eoh
}
protocol lda {
mail_plugins = quota sieve
postmaster_address = postmas...@somedomain.com
sendmail_path = /usr/local/sbin/sendmail
}
And,
Re: ATrpms repo
On Tue, Jul 15, 2014 at 10:43:32AM +0200, Reindl Harald wrote: Not only is http://atrpms.net/name/dovecot/ empty, but: http://packages.atrpms.net/dist/el6/ seems to return a 404. Some of the mirrors still have the packages, but does anyone know if they're going to continue to build 2.2.x packages? avoid ATrpms enable this repo unconditionally sooner or later will *** your OS installation because he overrides base packages often in incompatible ways and mixed with sane repos like rpmfusion years ago already leaded in randomly crashing applications We don't have the repo enabled - we're just pulling in the package into our internal repo (after testing). That said, I'm happy to get recommendations for any RHEL6 repos that have Dovecot 2.2.x (or SRPMs that will build cleanly on EL6). While I'm comfortable with my ability to build my own packages, I'd rather not have to. Unfortunately, 2.1 didn't work properly with our setup (proxy / backend on the same machines), so despite some recent bugs, I need 2.2 train. w
Re: Dovecot2 Antispam MAILTRAIN backend with SpamAssassin
Hello Leander,
Thank you so much for the answer.
But I believe there are two versions of the AntiSpam plugin. One is so
called Johannes version for version 1.x and the other Eugene version for
2.x series, which is also based on the Johannes version but it is
different and the configurations for version 1.x may not work on 2.x.
Anyway, thanks to you, there are now good news. I've tried you're
configuration and script, it seemed that your script was getting called.
Then I reverted back to my own configuration and script, and boom,
automagically it started working. Probably, I may have made a stupid
mistake the first time. Now I see the temp files are being created and I
can see SpamAssassin getting called with the right parameters.
Thank you so much.
Regards,
Mohammad S. Babaei
---
When I give, I give myself. - Walt Whitman
On 2014-07-15 17:43, Leander Schäfer wrote:
I remember, that I also struggled for quite a while until I figured it out.
Here is what I used on my FreeBSD Dovecot installation ...
Remember, that the following code is working on dovecot --version 1.2.12
... but it could also be valid for later versions. I simply havn't checked it
out yet.
### Dovecot AntiSpam ###
# mail signature (used with any backend requiring a signature)
#antispam_signature = X-Spam-Status
#antispam_signature_missing = move
antispam_mail_sendmail = /usr/local/etc/dovecot/sa-learn-helper.sh
antispam_mail_sendmail_args = --username=%Lu
antispam_mail_spam = --spam
antispam_mail_notspam = --ham
antispam_mail_tmpdir = /tmp
antispam_spam = Spam
#antispam_unsure = Virus
antispam_trash = Trash
echo '#!/usr/local/bin/bash
#/usr/local/bin/sa-learn ${1} ${2} ${3} ${4} /var/log/DoveDamnAntiSpam.log
/usr/local/bin/sa-learn ${1} ${2} ${3} ${4}
exit 0
' /usr/local/etc/dovecot/sa-learn-helper.sh
chmod 0777 /usr/local/etc/dovecot/sa-learn-helper.sh ;
chown root:wheel /usr/local/etc/dovecot/sa-learn-helper.sh ;
Best regards
Leander
Am 15.07.14 15:00, schrieb Mohammad S. Babaei:
Hi there, I've already asked this question on FreeBSD forums without getting
any response. So, I thought it's a good idea to ask it again here. I've
setup Dovecote2 (2.2.13) + Postfix + SpamAssassin on my FreeBSD 10 VPS and
it works flawlessly. Though, I couldn't setup the Dovecot Antispam plugin to
train SpamAssassin when I move mails to the Junk folder. I installed the
plugin from FreeBSD ports and followed the official documentation [1] and
the man page [2] without any success. This is my configuration: #
2.2.13: /usr/local/etc/dovecot/dovecot.conf # OS: FreeBSD 10.0-RELEASE-p6
i386 ufs auth_mechanisms = plain login digest-md5 disable_plaintext_auth =
no first_valid_gid = 6 first_valid_uid = 26 last_valid_gid = 6
last_valid_uid = 26 lmtp_save_to_detail_mailbox = yes mail_gid = mail
mail_location = mdbox:/mail/%d/%u mail_privileged_group = mail mail_uid =
mailnull managesieve_notify_capability = mailto managesieve_sieve_capability
= fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric relational
regex imap4flags copy include variables body enotify environment mailbox date
ihave namespace inbox { inbox = yes location = mailbox Archive { auto = no
special_use = Archive } mailbox Drafts { auto = subscribe special_use = Drafts
} mailbox Flagged { auto = no special_use = Flagged } mailbox Junk { auto =
subscribe special_use = Junk } mailbox Sent { auto = subscribe special_use =
Sent } mailbox Trash { auto = subscribe special_use = Trash } mailbox
virtual/All { auto = no special_use = All } prefix = separator = / } passdb {
args = /mail/%d/dovecot_passwd driver = passwd-file } plugin { antispam_backend
= MAILTRAIN antispam_mail_notspam = --ham antispam_mail_sendmail =
/mail/sa-learn-pipe.sh antispam_mail_spam = --spam antispam_spam = Junk
antispam_trash = Trash quota_rule = *:storage=8GB sieve =
/mail/%d/%u/dovecot.sieve sieve_dir = /mail/%d/%u sieve_global_dir =
/mail/sieve sieve_global_path =
/mail/sieve/globalfilter.sieve } protocols = imap pop3 lmtp sieve service auth
{ unix_listener auth-client { group = mail mode = 0660 user = postfix }
unix_listener auth-master { group = mail mode = 0600 user = mailnull } user =
root } service imap-login { inet_listener imap { address = * port = 143 }
inet_listener imaps { address = * port = 993 } process_limit = 32
process_min_avail = 1 } service lmtp { unix_listener
/var/spool/postfix/private/dovecot-lmtp { group = postfix mode = 0660 user =
postfix } } service managesieve-login { inet_listener sieve { port = 4190 }
process_min_avail = 0 service_count = 1 vsz_limit = 64 M } service managesieve
{ process_limit = 1024 } service pop3-login { inet_listener pop3 { address = *
port = 110 } inet_listener pop3s { address = * port = 995 } process_limit = 32
process_min_avail = 1 } ssl_cert = /etc/ssl/dovecot/cert.pem ssl_key =
/etc/ssl/dovecot/key.pem userdb { args =
Re: Postfix user@domain splitting
That was done for testing to see if it made any difference when I moved to LDA, in LDA mode it seems to not care if that
is %n or %u, it always takes the first part of the email address which is weird.
Ive just tested again to confirm on %n and its not working so ive reverted again back to LDA which does. Seems to not
matter how that variable is set it does not do anything.
When using %n ive tried to see if I can login via IMAP with the whole username but again no, this is the error, note the
difference between the 'user' field on each line.
Jul 15 18:22:17 imap-login: Info: Login: user=mark.whittaker, method=PLAIN, rip=10.0.0.180, lip=10.100.0.198,
mpid=9493, session=VVE8pj7+9wAKAAC0
Jul 15 18:22:20 imap-login: Info: Disconnected: Shutting down (auth failed, 4 attempts in 37 secs):
user=mark.whitta...@wenn.com, method=PLAIN, rip=10.0.0.3, lip=10.100.0.198, TLS, session=Vjs9pD7+IgAKAAAD
Steffen Kaiser wrote, On 15/07/2014 13:18:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On Tue, 15 Jul 2014, Ricardo Branco wrote:
Attached files
Nick Edwards wrote, On 15/07/2014 10:19:
you need to show doveconf -n
and what you have in the master.conf for dovecot
On 7/15/14, Ricardo Branco rica...@wenn.com wrote:
I have been trying looking though all the wiki documents to setup LMTP.
It now seems to all be connected except that it keeps saying that the
user is not recognised when postfix sends to LMTP, it sends the full
recipent email address but seems that on the dovecot side it is unable
to work with this.
I have checked the userdb and made sure its using %n but alas it still
does not work.
userdb {
args = username_format=%u /etc/passwd
driver = passwd-file
name = passwd-file
}
In opposite to your sentence I see a %u there.
Currently ive had to revert to using LDA as it works fine with that but
i still dont know how as the postfix config variable $RECIPIENT is the
full email address and does not seem to matter to LDA.
- -- Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)
iQEVAwUBU8UcInz1H7kL/d9rAQKXQAgAmu6NnZOqdQKEgKhk6q/CPtXza+dkUh7f
4Ms2tJFw2krwKNeZOvKGOsEeD7XyFDYpfZFDqEewjffqlABUUytIRPXzD3xFvzXV
DuXTW1VseEP26ewR7odHN9J+WL1Unh52HnxFgM63Bo1IwYzF84K09VO3DxqobuF7
S8MqQYj6MPqB73IZUbVzRkCDBM0mv52Gx14LFmmPXbphgZFmtixkUy2CpPOT/l02
0aBSsJZqV/ySKcB2V5UNCj8GoGvwyH3Jh9RFeNIlUKYZYT9s534rfbKu7+T6645I
67daEtZjfAbBOi/foqh41kbSpSaHIMvF970EP/EozFgMBsnghQ+SLg==
=6YKs
-END PGP SIGNATURE-
Re: ATrpms repo
On 07/15/2014 03:42 AM Will Yardley wrote: Tried mailing the maintainer, but didn't get a response -- anyone know what's happened to the ATrpms repo? dunno :) Not only is http://atrpms.net/name/dovecot/ empty, but: http://packages.atrpms.net/dist/el6/ seems to return a 404. Some of the mirrors still have the packages, but does anyone know if they're going to continue to build 2.2.x packages? There are some mirrors: http://atrpms.net/documentation/mirrors/ Regards, Pascal -- The trapper recommends today: f007ba11.1419...@localdomain.org
Re: HIGHESTMODSEQ tracking
Quoting Kostya Vasilyev kmans...@gmail.com: This is getting a bit off-topic on this list... but Gmail does a LOT of things wrong. Head over to one of the IMAP lists for further information. This is just one glaring example. Maybe you've ran into more than I have. In any case, the point stands - with Gmail, it's much easier to be confident, from actual testing, that things works a certain way. If you are testing against Gmail as the gold standard as to how a IMAP server should operate, I never said or implied that. In fact, I pointed out a serious issue with Gmail's IMAP IDLE implementation, which means the exact opposite of holding it as a gold standard. I can safely say you are Doing It Wrong. It seems you enjoy pointing out to people when they're wrong or incorrect so much, you actually put meaning into their words that's not there? Or it it just me? I was just trying to point out that this statement is very dangerous/incorrect: In any case, the point stands - with Gmail, it's much easier to be confident, from actual testing, that things works a certain way. Gmail behavior may/can/will change overnight, and you will have no idea. It makes a lot more sense to pick a local server of a known version, that has deterministic behavior, to develop with. For the more than 50% market share of Dovecot / Cyrus, do you have a breakdown by version number? At least in terms of 1.* vs 2.0 and higher? I do not. And without being able to get a version number from a Dovecot session (or so it seems to me -- nothing returned from ID...) it looks kind of sad. ID extension is pretty much worthless for version identification. It is trivially spoofed -- and some servers do exactly this in the real world. All it takes is one server/version to be spoofed to make that data worthless. It's possible to do some level of basic version sniffing by things like banner messages, Human-readable responses, CAPABILITY lists, and ordering of responses to various commands. However, this is really only useful for broad statistical surveys and not precise version determination. I have been able to work around all IMAP issues that have been reported to us solely based on the data returned, rather than knowing what IMAP server/version I am connected to. michael
Re: HIGHESTMODSEQ tracking
2014-07-16 0:13 GMT+04:00 Michael M Slusarz slus...@curecanti.org: Quoting Kostya Vasilyev kmans...@gmail.com: It seems you enjoy pointing out to people when they're wrong or incorrect so much, you actually put meaning into their words that's not there? Or it it just me? I was just trying to point out that this statement is very dangerous/incorrect: In any case, the point stands - with Gmail, it's much easier to be confident, from actual testing, that things works a certain way. Gmail behavior may/can/will change overnight, and you will have no idea. Yes I will have a very good idea. First, I use GMail myself, and second, I'll get messages from my users if the changes cause something in my app to break. And because Gmail's software is pretty much identical for everyone (less the staged rollouts that I'm sure they use), I can see those changes very easily (one such case happened just recently). And not just for Gmail -- I get messages from users about other issues too, and then I can react by: - putting a banner on my web site / forum (e.g. Yahoo recently letting their SSL certificate for SMTP expire) - or making changes to my software It makes a lot more sense to pick a local server of a known version, that has deterministic behavior, to develop with. For development, I use about a dozen test accounts, from Fastmail (probably my overall favorite) to Gmail, Yahoo, Dovecot, Yandex, Hotmail, and a few more that you've probably not heard of. However, I'm not at liberty to pick mail servers / services for my users. Sometimes the decision is made for them by someone else -- a corporate mail system, or a web hosting company. Assuming latest versions of mail server software in those cases would be foolish on my part. And yes, sometimes I look at the app's network logs and tell the user you won't be able to do this, the server is broken. However, I'd like to avoid such cases if I can, and sometimes have to implement compatibility hacks. For the more than 50% market share of Dovecot / Cyrus, do you have a breakdown by version number? At least in terms of 1.* vs 2.0 and higher? I do not. And without being able to get a version number from a Dovecot session (or so it seems to me -- nothing returned from ID...) it looks kind of sad. ID extension is pretty much worthless for version identification. It is trivially spoofed -- and some servers do exactly this in the real world. All it takes is one server/version to be spoofed to make that data worthless. I'm not talking about doing it for security purposes, and for compatibility, spoofing seems to me like less of an issue. In the realm of technically possible, someone could even write a random text generator and run it on port 993. Why, GoDaddy has been doing exactly this for years, and they're even able to charge their customers for it. It's possible to do some level of basic version sniffing by things like banner messages, Human-readable responses, CAPABILITY lists, and ordering of responses to various commands. However, this is really only useful for broad statistical surveys and not precise version determination. Well, in theory, CAPABILITY is all you need, because all mail servers / services are strictly RFC compliant... ...and when they're not, they get fixed / upgraded very quickly... ...as soon as just one user relays a message from the developer of some random mail app to the mail service's support. Hahaha. I'd feel more confident about enabling CONDSTORE / modseq for Dovecot if I could exclude versions below 2.0, just to be safe. This has more practical value to me than a statistical survey. Oh well. Anyway, this thread has gotten quite far off-topic, thanks again for sharing your real-world experiences with Dovecot and its CONDSTORE / modseq support. -- K
TRANSLATION extension to the NAMESPACE response supported?
Hello, I would like to ask if the TRANSLATION extension to the NAMESPACE response is supported by dovecot. context: http://lists.horde.org/archives/horde/Week-of-Mon-20140714/052136.html Thanks, Andreas
Re: TRANSLATION extension to the NAMESPACE response supported?
On 7/15/2014 10:47 PM, A. Schulze wrote: Hello, I would like to ask if the TRANSLATION extension to the NAMESPACE response is supported by dovecot. context: http://lists.horde.org/archives/horde/Week-of-Mon-20140714/052136.html Afaict, Oracle currently has the only implementation of the LANGUAGE capability: http://www.imapwiki.org/Specs I haven't seen any plans for it in Dovecot so far and I think you are one of the first to request it. :) Regards, Stephan.
Re: fts solr database size
2014-07-15 13:05 GMT+02:00 Ricardo Branco rica...@wenn.com: We are no way as big as you but in terms users but our user vs mailbox size is large. Dovecot: 50 users 425Gb (mdbox + zlib) Note solr only indexes folders within a mailbox when a search is done on them so size can vary and most people dont realise that the default type of search in Thunderbird is on Sender/Recipients/Subject which happens localy and not on the server so you dont get solr indexing unless the user does a custom search and forces remote. Webmail systems though will tend to do server searches. Solr: Num Docs: 17m Size: 4.5GB Thank You for the data, I also have noticed that most of the fat clients do their own search, so fts whould be limited mostly to webmail users. -- Michal
Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated messages, constant reloading (TB) missing new messages (K-9)
Original Message
Subject: Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated
messages, constant reloading (TB) missing new messages (K-9)
From: David Gessel ges...@blackrosetech.com
To: Alex JOST jost+li...@dimejo.at, dovecot@dovecot.org
Date: Tue Jul 15 2014 15:08:31 GMT+0300 (Arabic Standard Time)
Original Message
Subject: Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated
messages, constant reloading (TB) missing new messages (K-9)
From: Alex JOST jost+li...@dimejo.at
To: dovecot@dovecot.org
Date: Tue Jul 15 2014 13:30:31 GMT+0300 (Arabic Standard Time)
Am 15.07.2014 03:12, schrieb David Gessel:
* In thunderbird, I get constant downloading of messages. Every time I
switch to the inbox from another folder, the messages start
redownloading. This sometimes, but not always, seems to create
duplicate messages, but I'm now fairly sure they are only created in the
client and not on the server. Searching through various forums, it
appears this has been a problem for Thunderbird for some time, but it
wasn't for me on Courier. As posts about similar errors seem to have
petered out over the last year without any clear guidance on how to fix
it that I could find, I expect there's a simple fix I just haven't found
yet, either in TB configuration or in Dovecot. Any hints? I tried
Thunderfix to remove the .msf files and will be redownloading my mail
over the thin pipe out to Iraq for the next 6 months (DOH!). One
artifact is that when I restart thunderbird, my inbox is reported as
having about 130 messages in it, then thunderbird starts redownloading
headers and eventually gets back up to the 1297 currently listed both in
the TB pane and by ls | wc -l in /cur. Is it possible there is a time
out that needs to be extended? In TB, I've set (among other less
apparently relevant options)
mailnews.tcptimeout;1000
mail.db.idle_limit;3000
How old is your Thunderbird profile. Have you tried creating a new one
and see if the problem persists?
It is a new profile created with the transition from Cyrus to Dovecot
about a week ago, but I used IMAPSync to move all my mail from the
ancient Cyrus server to the shiny new Dovecot server. I then deleted
the old profile.
Thunderfix should not be needed by the way. Just right click on the
folder = Properties = Repair
I did see that, but first thought there was something magic about
thunderfix then decided to use it anyway because I have annual
sent/recieved archives from 2000 (and one for pre-2000) so that would
have been a lotta right-clicking.
server # dovecot -n
# 2.2.13: /usr/local/etc/dovecot/dovecot.conf
# OS: FreeBSD 9.2-RELEASE amd64
auth_default_realm = mydomain.com
auth_mechanisms = plain login
auth_realms = mydomain.com mydomain2.org
disable_plaintext_auth = no
first_valid_gid = 5000
first_valid_uid = 5000
hostname = mydomain.com
imap_client_workarounds = tb-extra-mailbox-sep tb-lsub-flags
imap_idle_notify_interval = 29 mins
last_valid_gid = 5000
last_valid_uid = 5000
lda_mailbox_autocreate = yes
listen = *
mail_gid = 5000
mail_location = maildir:~/:CONTROL=/var/no-quota/%u
mail_plugins = quota mail_log notify
mail_temp_dir = /var/tmp
mail_uid = 5000
maildir_broken_filename_sizes = yes
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave duplicate spamtest spamtestplus editheader
mbox_lazy_writes = no
namespace inbox {
inbox = yes
location =
mailbox Drafts {
special_use = \Drafts
}
mailbox Junk {
special_use = \Junk
}
mailbox Sent {
special_use = \Sent
}
mailbox Sent Messages {
special_use = \Sent
}
mailbox Trash {
special_use = \Trash
}
prefix =
}
passdb {
args = /usr/local/etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
plugin {
expire = Trash
mail_log_events = delete undelete expunge copy mailbox_delete
mailbox_rename
mail_log_fields = uid box msgid size
quota = maildir:User quota
quota_exceeded_message = Storage quota for this account has been
exceeded, please try again later.
quota_rule = *:storage=50G
quota_rule2 = Trash:storage=+30%%
quota_rule3 = Sent:storage=+30%%
quota_warning = storage=90%% quota-warning 90 %u
quota_warning2 = storage=75%% quota-warning 75 %u
sieve = ~/.dovecot.sieve
sieve_before = /usr/local/etc/dovecot/sieve/
sieve_dir = ~/sieve
sieve_extensions = +spamtest +spamtestplus +relational
+comparator-i;ascii-numeric +editheader
}
postmaster_address = ges...@mydomain.com
protocols = imap lmtp sieve sieve
sendmail_path = /usr/local/sbin/sendmail
service auth {
unix_listener /var/spool/postfix/private/auth {
group = postfix
mode =
Re: TRANSLATION extension to the NAMESPACE response supported?
Quoting Stephan Bosch step...@rename-it.nl: On 7/15/2014 10:47 PM, A. Schulze wrote: Hello, I would like to ask if the TRANSLATION extension to the NAMESPACE response is supported by dovecot. context: http://lists.horde.org/archives/horde/Week-of-Mon-20140714/052136.html Afaict, Oracle currently has the only implementation of the LANGUAGE capability: http://www.imapwiki.org/Specs I haven't seen any plans for it in Dovecot so far and I think you are one of the first to request it. :) This is not the LANGUAGE extension - this is namespace translations (I18NLEVEL=1). Dovecot has supported this since 1.1 according to that page. michael
Re: ATrpms repo
On Tue, Jul 15, 2014 at 06:04:22PM +, Pascal Volk wrote: On 07/15/2014 03:42 AM Will Yardley wrote: Not only is http://atrpms.net/name/dovecot/ empty, but: http://packages.atrpms.net/dist/el6/ seems to return a 404. Some of the mirrors still have the packages, but does anyone know if they're going to continue to build 2.2.x packages? There are some mirrors: http://atrpms.net/documentation/mirrors/ Yes, I can get to some of the mirrors, and they still have the latest version that atrpms packaged, but it's a little disconcerting that the main site has been broken for this long without an announcement. I thought it could be related to a security breach, but haven't heard anything so far. There are some pending bugs in their Bugzilla database, all assigned to the main guy (Axel), but don't see any status changes on them. w
Re: Dovecot/K9/Thunderbird IMAP interaction issues: replicated messages, constant reloading (TB) missing new messages (K-9)
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wed, 16 Jul 2014, David Gessel wrote: Disabling the imap_client_workarounds in TB ended up neither helping nor harming. The first sync was promising but as soon as that was finished (it can take a while to download 8 messages to Iraq) it started over re-downloading the entire mailbox. I don't seem to be generating duplicate messages, but I am redownloading every message over and over. My TB activity manager is filled with paused bringing folder XXX up to date messages. Maybe you should check: http://wiki2.dovecot.org/Debugging/Rawlog and see if the IMAP commands make sense. Check if IMAP validity / UIDs changing ... . If it can take a while, maybe the connection gets interrupted or corrupted and some client is trying to work around this. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.11 (GNU/Linux) iQEVAwUBU8YPEXz1H7kL/d9rAQJ/jggAqJUsxAUFRCcQWtOHXj9X+nE9QU3ck/pR hMdzFtv6BZjAOC9eZrefD80Md6aUa1d35RzvE2kLG3D8mnkx6hLVETemT70I1KqA EniRIn6svb3jP2H32n0DdIIPHEtmC+Wf3k/HK2yhH6RAlZu2GNJhbuQ8Bf9kvATS pyauaQ+qHirPzo8MjAv90wBmyrgN3PHZ7+4kE2P6W9th9sHFgW3YOB0BuPqnBLvy Jb/qM1BHqz/Yt+T9qCDgCzPknm5RR+iwHPTcjF2Vz/GKz/8WWM0bJniRqFs4g1a6 9UWffK8FO5QC2oI5KpD6KOkJSKhUAs54Qj9+VuxesUC6Bm7eLfJ4CA== =AH5A -END PGP SIGNATURE-
