Remote IP address in dovecot
Hello, I am using a webmail, SOGo, to access Dovecot mail server in IMAP. SOGo correctly logs the remote IP address, using the standard nginx headers, especially X-Forwarded-For. However, when I check the IMAP logs, I see my server's IP address for the "remote_ip" value. I think there is a way to override this value from the environment, but I could not find it. Thanks for your help, -- André Rodier ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Indexer opening emails in write mode ?
Hi, I have dovecot indexer working inside AppArmor, and I am confused by some error messages: > name="/home/users/andre/mails/maildir/.Sent/cur/1682251668.M110083P109814.pigment,S=1743,W=1776:2,S" > pid=111784 > comm="indexer-worker" requested_mask="wd" denied_mask="wd" fsuid=1001 > ouid=1001 Why the indexer would open email files in write mode, please ? Thanks for your advice ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Re: Message searching in Dovecot
On Wed, 2023-04-19 at 16:34 -0500, John Gateley via dovecot wrote: > Hello, > For mobile clients (gmail on Android), I need a server side searching > solution. > A few months ago, I tried getting Solr to work with Dovecot, but failed. > The instructions here https://doc.dovecot.org/configuration_manual/fts/solr/ > are quite out of date, they reference > Debian 8 and 9 (current version 11), and Solr 7.7 (current version 9.2) > My Solr experience is pretty much zero. > Questions/Requests: > * Is there a different tool than Solr I should be using for this? > * Does anyone have a recent version of Solr and Debian working? > * If you do, would you be willing to help me? > * I cannot afford much, this is a home mailserver for my wife and I, but I > could pay a small consulting fee. > I use ansible to deploy the server, I'd be willing to contribute the > playbooks somewhere for documentation, or help > with the docs. > Thanks! > John > ___ > dovecot mailing list -- dovecot@dovecot.org > To unsubscribe send an email to dovecot-le...@dovecot.org Hello, John, I successfully use Xapian, by the way included in Debian standard packages. If you need real code example, see here: https://github.com/progmaticltd/homebox/tree/main/roles/dovecot The project is a set of Ansible scripts to deploy a mail server from scratch, on Debian. Kind regards, André ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Self hosting solution for Christmas
Hello everyone, Here my present for Christmas: a new version of HomeBox, the self hosted email solution. Feel free to drop comments, create issues, update the docs, etc. I released this quickly before going on vacation, so you may find some issues. However, this is mostly stable, and the code is easy to modify. Also, you can now add and remove components individually, with an Ansible playbook. https://github.com/progmaticltd/homebox System installation and features - Custom Debian installer generation with full disk encryption and fully automatic installation. - Unlock the system upon boot by entering the passphrase through SSH. - Install packages only from Debian stable (Bullseye). - Automatic letsencrypt certificates generation using Lego and DNS challenge. - Automatic security updates (optional). - Centralised authentication with an LDAP users database, SSL certificate, password policies, PAM integration. - AppArmor activated with a profile for all daemons. - XKCD Random passwords generated and saved into pass (or on file system). - Can be used at home, on a dedicated or virtual server hosted online. - Flexible IP address support: IPv4 only, IPv6 only, and IPv4+IPv4 or IPv4+IPv6. - Embedded DNS server, with CAA, DNSSEC and SSHFP (SSH fingerprint) support. - Grade A https sites, HSTS implemented by default. - Automatic configuration of OpenPGP Web Key Directory. - Automatic firewall rules for inbound, outbound and forwarding traffic, using nftables. - Restricted outbound web sites access to the minimum. - Automatic update of DNS keys, DNS servers and glue records on Gandi. Emails - Postfix configuration and installation, with LDAP lookups, internationalised email aliases, fully SSL compliant. - Generate DKIM keys, SPF and DMARC DNS records. The DKIM keys are generated every year. - Automatic copy of sent emails into the sent folder. - Automatic creation of the postmaster account and special email addresses using RFC 2142 specifications. - Dovecot configuration, IMAPS, POP3S, Quotas, ManageSieve. - Simple spam and ham learning by moving emails in and out the Junk folder - Sieve and vacation scripts. - Virtual folders for server search: unread messages, conversations view, all messages, flagged and messages labelled as "important". - Email addresses with recipient delimiter included, e.g. john.doe+li...@dbcooper.com. - Optional master user creation, e.g. for families with children or moderated communities. - Server side full text search inside emails, attached documents and files and compressed archives, with better results than GMail. - SOGo webmail with sieve filters management, password change form, Calendar and Address book management, GUI to import other account emails. - Powerful and light antispam system with rspamd and optional access to the web interface. - Antivirus for inbound and outbound emails with clamav (optional). - Automatic configuration for Thunderbird and Outlook using published XML and other clients with special DNS records (RFC 6186). Calendar and Address book - Install and configure a CalDAV / CardDAV server, with automatic discovery (RFC 6186). - Groupware functionality in a web interface, with SOGo. - Recurring events, email alerts, shared address books and calendars. - Mobile devices compatibility: Android, Apple iOS, BlackBerry 10 and Windows mobile through Microsoft ActiveSync. Other optional features - Incremental backups, encrypted, on multiple destination (SFTP, S3, Samba share or USB drive), with email and Jabber reporting. - Jabber server, using ejabberd, with LDAP authentication, direct or offline file transfer and optional server to server communication. - Static web site skeleton configuration, with https certificates and A+ security grade by default. Development - YAML files validation on each commit, using travis-ci. - End to end integration tests for the majority of components. - Playbooks to facilitate the installation or removal of development packages. - Global debug flag to activate the debug mode of all components. - Fully open source Ansible scripts licensed under GPLv3. Merry Christmas, André
Re: Questions around mailcrypt and LDAP
Dear dovecot developers. When using mailcrypt plugin, how can store the encryption key in LDAP, please ? There is an example with SQL in the doc, but no LDAP. Thanks, André On Thu, 2022-11-10 at 19:39 +, Andre Rodier wrote: > Hello, all. > > I read carefully the messages about mailcrypt on the mailing list, > especially this response from Aki: > > > It's best suited for securing external storage such as NFS or > > object storage. > > There are possibilities to encrypt the key using user's password, > > but this > > takes careful planning. The keys can also come from userdb , e.g. > > LDAP. > > I am able to extend the LDAP schema of my OpenLDAP server to store a > key > into LDAP attribute for each user. > > In this case, would it be enough for Dovecot to encrypt the messages > when they arrive ? > > Maybe I misunderstand the documentation. Even when using user keys > protected by a password, the Dovecot LMTP process should be able to > encrypt the emails with user’s public key, without a password, no ? > > Ideally, I would like to store user's emails encrypted, so each users > cannot access other user's emails. I don't need folder sharing. > > Thanks for your advice. > > Kind regards, > André Rodier >
Questions around mailcrypt and LDAP
Hello, all. I read carefully the messages about mailcrypt on the mailing list, especially this response from Aki: It's best suited for securing external storage such as NFS or object storage. There are possibilities to encrypt the key using user's password, but this takes careful planning. The keys can also come from userdb , e.g. LDAP. I am able to extend the LDAP schema of my OpenLDAP server to store a key into LDAP attribute for each user. In this case, would it be enough for Dovecot to encrypt the messages when they arrive ? Maybe I misunderstand the documentation. Even when using user keys protected by a password, the Dovecot LMTP process should be able to encrypt the emails with user’s public key, without a password, no ? Ideally, I would like to store user's emails encrypted, so each users cannot access other user's emails. I don't need folder sharing. Thanks for your advice. Kind regards, André Rodier
Re: v2.2.35 released
On 19/03/2018 13:23, Aki Tuomi wrote: https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz.sig - charset_alias: compile fails with Solaris Studio, reported by John Woods. - Fix local name handling in v2.2.34 SNI code, bug found by cPanel. - imapc: Don't try to add mails to index if they already exist there. - imapc: If email is modified in istream_opened hook, mail size isn't updated. - lib-dcrypt: When reading encrypted data, more data would not be read if buffer was not consumed causing panic or hang. - notify: When notify plugin is used and transaction commit fails in dsync, crash occurs. - sdbox: When delivering to a mailbox that is over quota, temp files are not cleaned up when saving or copying fails. Thank you, Aki, This is great to know Dovecot is so active, and to have updates on this mailing list as well. -- https://github.com/progmaticltd/homebox
Re: Accentuated email addresses stored in LDAP
On 20/03/2018 08:00, Steffen Kaiser wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 19 Mar 2018, Andre Rodier wrote: In fact, I am using the otherMailBox attribute, from the standard OpenLDAP distribution, which is also IA5String. - Is there any way in Dovecot to encode the fields in base 64, to send queries? as the query is "eq", this would be enough, I think. Check out: https://wiki2.dovecot.org/Variables?highlight=(base64) However, I never used this modifier and Aki pointed out, that UTF8 usernames are not (100%) supported, yet. - Or is the LDAP server is supposed to store attributes as UTF8, and in this case, how to configure it that way? To achieve this, you must/can extend the schema with your own attribute that uses: https://www.ldap.com/understanding-ldap-schema "Directory String "The directory string syntax is basically a catch-all syntax for UTF-8 strings. It allows values with this syntax to have any combination of one or more UTF-8 characters (empty directory string values are not allowed, although some directory servers ignore this constraint). "The directory string syntax is defined in RFC 4517 section 3.3.6, and has an OID of "1.3.6.1.4.1.1466.115.121.1.15"." Otherwise, you could _misuse_ an exiting attribute of this type unused in your directory otherwise. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1 iQEVAwUBWrC/hcQnQQNheMxiAQLV+wf+P/gzADRyNSIQtILNKoN7eHEVPNGt9iVd TzHl5rka9XB89eUE2lsGjlURH3PIVqDKjtTEAl27CYiBr9OI66u+PvhE1o2lvY7R YBG1Z/R3n8FWF58HpxwJGBbY4iiPQKSvvRM43/Q2mYnEveyIBvNZawNo0okTNMOM bMSmpUhxGKsqmAeEoUQHOKrujAK0qfucZDI7nuSGjJeej7L2HXm3sEEKTEuYmUDQ E2ox5fAyIMURA+NINzdmk7chXu30DfWuHNY8jwezM3SEds5xlAy4x6qD6EZ4f7qP KnYEfxnYyISDqcXSy9AL20srIzn2OXiTA3/TiVOKFXpHrrst8kVCeg== =+Me+ -END PGP SIGNATURE- Thank you, Steffen, this is a great link. I am probably going to keep this attribute, and use base64, for now. Kind regards, Andre -- https://github.com/progmaticltd/homebox
Re: Accentuated email addresses stored in LDAP
On 19/03/2018 07:23, Steffen Kaiser wrote:
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
On Mon, 19 Mar 2018, André Rodier wrote:
I had to use base64 encoding to store email addresses, because they
are
rejected otherwise, with an error message of illegal characters. I
also
you are using the stock "mail" attribute in LDAP as:
olcAttributeTypes: ( 0.9.2342.19200300.100.1.3
NAME ( 'mail' 'rfc822Mailbox' )
DESC 'RFC1274: RFC822 Mailbox'
EQUALITY caseIgnoreIA5Match
SUBSTR caseIgnoreIA5SubstringsMatch
SYNTAX 1.3.6.1.4.1.1466.115.121.1.26{256} )
http://www.oid-info.com/get/1.3.6.1.4.1.1466.115.121.1.26
https://en.wikipedia.org/wiki/IA5STRING
IA5 :- 7bit
noticed that some of the fields, like 'dn' and 'cn' where
automatically
encoded in base64 when stored when including accentuated chars.
you mean when you use ldapsearch or similiar tool to export data? LDIF
traditionally encode all data in 7bit ASCII, which is noted by the
double "::" after the LDAP attribute name. The data in LDAP is UTF8
and binary connections need not encode it either.
- -- Steffen Kaiser
-BEGIN PGP SIGNATURE-
Version: GnuPG v1
iQEVAwUBWq9lWMQnQQNheMxiAQL3ywgAtbWsT1U+PQgdK0D3StI9c44r8KgEG7dr
AXhIvFPowuD3U0KH0ZJ8VHc+/WN0DMqCONvuaUyueaGY8bgqx+cNw8z01zMC9hTF
xfs8x1lQsgikacyyjo3o9WehOJzgnlGvt33LLwjsI62WOLFE8PXnkZFXpkAWI1f4
yTWoTFOxPnAA90CDBS4aBHdBaFI0TwbiGP5oIyjGCvI1aHJSTy5lNKfwUkvTdI+L
tH4Z0JDkB3YBnRVIL6ST5W7p0VvBAQo+ia+UXpsZ4b1t3/xYCKtNV0ls9jIoqVzg
dEFeyUoKQe8k5N8k6/vVVElzwtW6fxzQUJQXj01u03udqVMmTqXhrw==
=8rp9
-END PGP SIGNATURE-
Hello Steffen,
Thank you for your answer.
In fact, I am using the otherMailBox attribute, from the standard
OpenLDAP distribution, which is also IA5String.
- Is there any way in Dovecot to encode the fields in base 64, to send
queries? as the query is "eq", this would be enough, I think.
- Or is the LDAP server is supposed to store attributes as UTF8, and in
this case, how to configure it that way?
Thanks!
# RFC1274: Cosine and Internet X.500 schema:
# 9.3.18. Other Mailbox
#
# The Other Mailbox attribute type specifies values for electronic
# mailbox types other than X.400 and rfc822.
#
#otherMailbox ATTRIBUTE
#WITH ATTRIBUTE-SYNTAX
#SEQUENCE {
#mailboxType PrintableString, -- e.g. Telemail
#mailbox IA5String -- e.g. X378:Joe
#}
#::= {pilotAttributeType 22}
#
attributetype ( 0.9.2342.19200300.100.1.22 NAME 'otherMailbox'
SYNTAX 1.3.6.1.4.1.1466.115.121.1.39 )
--
https://github.com/progmaticltd/homebox
Dovecot on Debian Stretch with AppArmor
Hello all, I am using dovecot on Debian stretch, with AppArmor, and I have this audit log: Mar 16 11:25:10 mail kernel: audit: type=1400 audit(1521199510.705:580): apparmor="DENIED" operation="file_mmap" info="Failed name lookup - disconnected path" error=-13 profile="/usr/lib/dovecot/auth" name="var/cache/nscd/hosts" pid=26797 comm="auth" requested_mask="r" denied_mask="r" fsuid=0 ouid=0 With 'name="var/cache/nscd/hosts"', is there any missing '/' at the beginning of the path, somewhere? The version is: 1:2.2.27-3+deb9u2 Thanks for your advices, André Rodier. -- https://github.com/progmaticltd/homebox
Email hosting provider
Hello, Sorry if I am off topic a little. I am looking for an email host provider that supports dovecot, sieve and manage sieve. Ideally with the roundcube webmail and managesieve plugin Better if it is in Europe or switzerland. I don't mind paying a little. Thanks, André.
Re: Dbox and Exim
On 09/10/14 23:06, Timo Sirainen wrote: On 09 Oct 2014, at 15:20, C Peters chuck.pet...@gmail.com wrote: The Dovecot wiki [1] doesn't list either Exim, Postfix or anything else as supporting the dbox. I did some searching in the Exim archives and have found only one message mentioning dbox, sdbox or mdbox. [2] I think an RFC would go a long way towards getting the format supported. Has Timo, or anyone else, considered submitting an RFC to the IETF? No, and I don't want it to happen anytime in near future. The dbox format is highly Dovecot-specific, because it relies on Dovecot's index files. These index files are still changing and I'm not sure if they will ever be fully finished. I don't want any other software to even attempt to implement the same functionality. My question was how are we going to use it if Exim doesn't support it. As others said, use LMTP or dovecot-lda with Sieve filtering. Hi, I am sorry if I am presumptuous or out of topic, but it seems to me that the mail storage should be standardised. I am still using Maildir myself, simply because I like the simplicity, one file is one email, one directory is one email folder, for backup or restore. The only thing I don't like is the naming convention, but I don't know if a file system exists today to store such information in label or tags associated to each file. Regarding the optimisation, I think it's the file system's role, albeit I appreciate Dovecot's efforts to optimise the storage by taking in consideration file system's specificities. A feature I would like, is dovecot being able to store emails in databases, SQL or NoSQL. I would use this for archiving and queries purposes. MariaDB / Drizzle, or MongoDB, CouchDB, etc. There is plenty of choice. Maybe this storage scheme would be slower, but IMHO, this is not a problem when people just want to archive their emails on a remote computer. Maybe I could start this if I had some template or example to start. Kind regards, André.
Send an alert on master user login
Hello, I want to know if there is an option in Dovecot to send an alert, or run a script when someone is using the master user facility. I can do something myself with fail2ban, but maybe there is an option in Dovecot? Thanks. André. attachment: andre.vcf
Re: Send an alert on master user login
Hello Again, It's more complex than I thought to do this with fail2ban, especially when using the web mail. So, I am asking again, if anyone knows how to run a custom script every time master user is used, I would be happy. I already have a post login script, but I don't find any variable in the environment that tell me if it's a master user login or not. Thanks. On 09/10/14 10:36, Andre Rodier wrote: Hello, I want to know if there is an option in Dovecot to send an alert, or run a script when someone is using the master user facility. I can do something myself with fail2ban, but maybe there is an option in Dovecot? Thanks. André.
Re: Send an alert on master user login
On 09/10/14 13:04, Andre Rodier wrote: Hello Again, It's more complex than I thought to do this with fail2ban, especially when using the web mail. So, I am asking again, if anyone knows how to run a custom script every time master user is used, I would be happy. I already have a post login script, but I don't find any variable in the environment that tell me if it's a master user login or not. Thanks. On 09/10/14 10:36, Andre Rodier wrote: Hello, I want to know if there is an option in Dovecot to send an alert, or run a script when someone is using the master user facility. I can do something myself with fail2ban, but maybe there is an option in Dovecot? Thanks. André. Hi again, I found the variable passed to the script that refers to master user. It's 'MASTER_USER' Thanks.
Re: Send an alert on master user login
On 09/10/14 10:36, Andre Rodier wrote: Hello, I want to know if there is an option in Dovecot to send an alert, or run a script when someone is using the master user facility. I can do something myself with fail2ban, but maybe there is an option in Dovecot? Thanks. André. I am answering to myself. If anyone is interested, here a custom perl script to report master user login functionality: Regards, André. [Email] Dest=administra...@example.com From=postmas...@example.com Server=smtp1 Bcc=ad...@example2.com master-user-report.pl Description: Perl program post-login.sh Description: application/shellscript
Re: [Dovecot] Dovecot Solr Panic
Sorry,
I checked my dovecot version, and it has not been updated by Debian yet.
I will check if I can find a method to update without breaking dependancies.
André
On 28/04/13 17:42, Andre Rodier wrote:
Hello Everyone,
I have a small base of users (30), but a lot of emails.
I have an error again when I am indexing a virtual folder with a large number
of folders.
I appreciate this is a special case, but I am using dovecot and solr as it
is, according to the documentation, the favourite way.
One user is using a large number of archives sub folders, by years, months
and subfolders, since 5 years. I am convincing this user to give up this
organisation, but in the mean time, I hope to solve this problem.
The virtual folder, called Archives, references all the sub folders in the
Archive folder. There is about 380 folders, and worst of all, 55k characters
with
their names concatenated.
On solr, I have increased the value of headerBufferSize to a huge value, but
I have still this error.
Anyway, this is the error I have when I try to index this virtual folder:
---8---
root@lapetus:/mnt/emails/indiefield.co.uk/jsmith/Mails/Virtual# doveadm -v
index -u 'john smith' 'Search/Archives'
doveadm(john smith): Info: Search/Archives: Caching mails seq=109580..127362
1800/17783doveadm(john smith): Panic: file solr-connection.c: line 416
(solr_connection_select): assertion failed: (!conn-posting)
doveadm(john smith): Error: Raw backtrace:
/usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7fcb7b5b014a] -
/usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7fcb7b5b020a]
- /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fcb7b58782a] -
/usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x754a) [0x7fcb790fa54a]
- /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4037)
[0x7fcb790f7037] -
/usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_backend_get_last_uid+0x5a)
[0x7fcb79b2f66a] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc1fd)
[0x7fcb79b341fd] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc689)
[0x7fcb79b34689] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc51e)
[0x7fcb79b3451e] - doveadm(+0x16719) [0x7fcb7bf71719] - doveadm(+0x13346)
[0x7fcb7bf6e346] - doveadm(+0x13e21) [0x7fcb7bf6ee21] -
doveadm(doveadm_mail_try_run+0x161) [0x7fcb7bf6f2e1] - doveadm(main+0x3d1)
[0x7fcb7bf6def1] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd)
[0x7fcb7b200ead] - doveadm(+0x13125) [0x7fcb7bf6e125]
Aborted
---8---
On the solr side:
---8---
28-Apr-2013 17:13:33 org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: {add=[1/70af772eafc17c51fb35812a8a77/john sm...@indiefield.co.uk,
2/70af772eafc17c51fb35812a8a77/john sm...@indiefield.co.uk,
3/70af772eafc17c51fb35812a8a
77/john sm...@indiefield.co.uk, 4/70af772eafc17c51fb35812a8a77/john
sm...@indiefield.co.uk, 5/70af772eafc17c51fb35812a8a77/john
sm...@indiefield.co.uk, 6/70af772ea
fc17c51fb35812a8a77/john sm...@indiefield.co.uk,
7/70af772eafc17c51fb35812a8a77/john sm...@indiefield.co.uk,
8/70af772eafc17c51fb35812a8a77/john smith@indiefie
ld.co.uk, ... (8 added)]} 0 19141
28-Apr-2013 17:13:33 org.apache.solr.common.SolrException log
SEVERE: org.apache.solr.common.SolrException: ParseError at
[row,col]:[1188418,131]
Message: Premature end of file.
at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:72)
at
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:54)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:131)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1317)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:338)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:241)
at
org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1157)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:388)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at
org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:418)
at
org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230
[Dovecot] Dovecot Solr Panic
) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:943) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:843) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:410) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[1188418,131] Message: Premature end of file. at com.sun.org.apache.xerces.internal.impl.XMLStreamReaderImpl.next(XMLStreamReaderImpl.java:592) at org.apache.solr.handler.XMLLoader.readDoc(XMLLoader.java:273) at org.apache.solr.handler.XMLLoader.processUpdate(XMLLoader.java:138) at org.apache.solr.handler.XMLLoader.load(XMLLoader.java:69) ... 22 more ---8--- Kind regards, Andre Rodier
Re: [Dovecot] Problem when indexing maildir with a large number of folders
Hello again, I am sorry to be a pain, but is there any chance someone knows this problem, and how I can fix this, please? Kind regards, André On Tuesday, 26.03.13 at 23:20, Andre Rodier wrote: Hello everybody, As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc! I am using Maildir++ I can run the doveadm index command on the private namespace, however, I am not able to do this on the virtual folders. Here the error I have: doveadm(john smith): Panic: file mail-index-transaction-update.c: line 875 (mail_index_update_header_ext): assertion failed: (offset = (uint16_t)-1 size = (uint16_t)-1 offset + size = (uint16_t)-1) doveadm(gareth walters): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f9b7100714a] - /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f9b7100720a] - /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9b70fde82a] - /usr/lib/dovecot/libdovecot-storage.so.0(+0xb8079) [0x7f9b7130a079] - /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x788) [0x7f9b6f1775a8] - /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x33) [0x7f9b712cf3e3] - /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f9b712cf507] - doveadm(+0x16618) [0x7f9b719c8618] - doveadm(+0x13346) [0x7f9b719c5346] - doveadm(+0x13e21) [0x7f9b719c5e21] - doveadm(doveadm_mail_try_run+0x161) [0x7f9b719c62e1] - doveadm(main+0x3d1) [0x7f9b719c4ef1] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f9b70c57ead] - doveadm(+0x13125) [0x7f9b719c5125] Aborted I can see I have reached a limit, but is there any configuration value I can use to increase this limit, please? Kind regards, André.
[Dovecot] Importing emails from PST Archives
Hello everyone, I am currently migrating a small company from exchange 2003 to Dovecot. So far, the most painful process has been the PST archives. (Except the inconditionals of Outlook) I have been able to create the directory structure using the last version of readpst, with the -r flag. But once this done, I have not been able to find one tool that worked correctly. Maybe the configuration I have is complex. The perl script to transform mbox files into maildirs in the dovecot distribution is old, and crashed many times in the middle of the process. I had a look to the script, and gave up trying to fix it. I found a python script that was supposed to crawl this folder structure, and to replicate it using IMAP commands, but it crashed as well, and restarting the process would import twice the same messages. The script is here: http://costela.net/2011/06/importing-an-outlook-pst-into-imap/ I found another python script that was working better, and seemed to be well written, but with one mbox to one IMAP folder only. It can be found here: http://imap-upload.svn.sourceforge.net/viewvc/imap-upload/trunk/ I have modified, and I have added some minor fixes: - Recursively traverse a folder structure, and replicate it using IMAP commands on the server. - Properly manage folder names with special characters. (dovecot can manage these characters using the listescape plugin). - Avoid taking all the resources of the server (A quirty hack that can change). I am not an expert in Python, and the script has been quickly writter to fit my needs. However I think it can be modified easily to any configuration. In the future, maybe this script can use the libpst python bindings to import the emails directly. The last version of the script, modified is here: https://github.com/arodier/EmailTools/tree/master/Migration. Do not hesitate to help me, to make the script as generic as possible, particularly if you are a python expert. I post this on this list, because I think you maybe interested if you are in the same case as me. The license is not specified, but I will probably use GPLv3. Regards, André
[Dovecot] Problem when indexing maildir with a large number of folders
Hello everybody, As part of a migration from exchange 2003 to dovecot, I have converted a lot of PST files for a user. I am importing his PST files in a maildir folder called 'Archives'. Actually, I reached about 770 'Archives' folders, and the total length of their names is about 59k characters. Thanks to wc! I am using Maildir++ I can run the doveadm index command on the private namespace, however, I am not able to do this on the virtual folders. Here the error I have: doveadm(john smith): Panic: file mail-index-transaction-update.c: line 875 (mail_index_update_header_ext): assertion failed: (offset = (uint16_t)-1 size = (uint16_t)-1 offset + size = (uint16_t)-1) doveadm(gareth walters): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f9b7100714a] - /usr/lib/dovecot/libdovecot.so.0(default_fatal_handler+0x2a) [0x7f9b7100720a] - /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f9b70fde82a] - /usr/lib/dovecot/libdovecot-storage.so.0(+0xb8079) [0x7f9b7130a079] - /usr/lib/dovecot/modules/lib20_virtual_plugin.so(virtual_storage_sync_init+0x788) [0x7f9b6f1775a8] - /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x33) [0x7f9b712cf3e3] - /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x27) [0x7f9b712cf507] - doveadm(+0x16618) [0x7f9b719c8618] - doveadm(+0x13346) [0x7f9b719c5346] - doveadm(+0x13e21) [0x7f9b719c5e21] - doveadm(doveadm_mail_try_run+0x161) [0x7f9b719c62e1] - doveadm(main+0x3d1) [0x7f9b719c4ef1] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f9b70c57ead] - doveadm(+0x13125) [0x7f9b719c5125] Aborted I can see I have reached a limit, but is there any configuration value I can use to increase this limit, please? Kind regards, André.
[Dovecot] Zlib plugin: Compress emails for one folder only
Hello everyone, Is it possible to configure the zlib plugin to compress the emails in one folder only? I would like to compress the emails when they are stored in my 'Archives' folders and sub folders. Thanks, André Rodier.
[Dovecot] Panic when indexing virtual folder with solr
Hello Timo and everyone, I am using dovecot 2.1 on debian7 with the fts-solr plugin, and everything is working fine. I have a Virtual folder with all emails, and when I run a doveadm index, I have an error if I don't index real folders first. Example: doveadm -v index -u 'andre rodier' 'Search/*' = Panic: file solr-connection.c: line 416 (solr_connection_select): assertion failed: (!conn-posting) Now, if I rune the doveadm index on the real folders first, the next time I do the index on the virtual folder, everything is fine: doveadm -v index -u 'andre rodier' '*' doveadm -v index -u 'andre rodier' 'Search/*' I wonder if dovecot can run the index on the real folder instead of displaying this error? I hope that will help.
Re: [Dovecot] panic in dovecot when using fts with solr
Hello again, Sorry for the duplicate post earlier. My dovecot version is 2.1.7-7 (included in Debian Wheezy) I don't think that addinf doveconf output would be useful, but I can add it if you are interested. Kind regards, André Rodier On 02/03/13 22:57, Andre Rodier wrote: Hello All, I have a panic error in dovecot when I try to use the fts search with Solr. The version of dovecot I use is version 2.1 I have used a telnet session to search, but I don't know if this make a difference: telnet localhost imap Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 1 login andre-rodier XX 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY QUOTA ACL RIGHTS=texk] Logged in 2 select Inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback \*)] Flags permitted. * 2158 EXISTS * 0 RECENT * OK [UIDVALIDITY 1354776694] UIDs valid * OK [UIDNEXT 2568] Predicted next UID * OK [HIGHESTMODSEQ 9739] Highest 2 OK [READ-WRITE] Select completed. 3 search text Valentine * OK Searched 47% of the mailbox, ETA 0:10 * OK Searched 79% of the mailbox, ETA 0:05 * SEARCH 1120 1238 1279 1975 1990 1991 1992 1998 1999 2000 2001 2002 2058 2106 2107 2110 2151 3 OK Search completed (32.210 secs). -- Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd = 0) Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f5f4237214a] - /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7f5f4237218e] - /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5f4234982a] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(solr_connection_post_more+0x249) [0x7f5f402d48d9] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4ac7) [0x7f5f402d1ac7] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0x339) [0x7f5f408f1f19] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc6e0) [0x7f5f408f66e0] - dovecot/indexer-worker(+0x28d4) [0x7f5f42ae88d4] - /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f5f4237f016] - /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f5f4237fcc7] - /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f5f4237ea28] - /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5f4236b483] - dovecot/indexer-worker(main+0xfe) [0x7f5f42ae834e] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f5f41fc2ead] - dovecot/indexer-worker(+0x23f5) [0x7f5f42ae83f5] Mar 2 22:48:02 lapetus dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for andre rod...@indiefield.co.uk Mar 2 22:48:02 lapetus dovecot: imap(andre rod...@indiefield.co.uk): Error: indexer failed to index mailbox INBOX Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Fatal: master: service(indexer-worker): child 19644 killed with signal 6 (core dumps disabled) -- Regards, Andre
[Dovecot] panic in dovecot when using fts with solr
Hello All, I have a panic error in dovecot when I try to use the fts search with Solr. The version of dovecot I use is version 2.1 I have used a telnet session to search, but I don't know if this make a difference: telnet localhost imap Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 1 login andre-rodier XX 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY QUOTA ACL RIGHTS=texk] Logged in 2 select Inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback \*)] Flags permitted. * 2158 EXISTS * 0 RECENT * OK [UIDVALIDITY 1354776694] UIDs valid * OK [UIDNEXT 2568] Predicted next UID * OK [HIGHESTMODSEQ 9739] Highest 2 OK [READ-WRITE] Select completed. 3 search text Valentine * OK Searched 47% of the mailbox, ETA 0:10 * OK Searched 79% of the mailbox, ETA 0:05 * SEARCH 1120 1238 1279 1975 1990 1991 1992 1998 1999 2000 2001 2002 2058 2106 2107 2110 2151 3 OK Search completed (32.210 secs). -- Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd = 0) Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f5f4237214a] - /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7f5f4237218e] - /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5f4234982a] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(solr_connection_post_more+0x249) [0x7f5f402d48d9] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4ac7) [0x7f5f402d1ac7] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0x339) [0x7f5f408f1f19] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc6e0) [0x7f5f408f66e0] - dovecot/indexer-worker(+0x28d4) [0x7f5f42ae88d4] - /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f5f4237f016] - /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f5f4237fcc7] - /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f5f4237ea28] - /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5f4236b483] - dovecot/indexer-worker(main+0xfe) [0x7f5f42ae834e] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f5f41fc2ead] - dovecot/indexer-worker(+0x23f5) [0x7f5f42ae83f5] Mar 2 22:48:02 lapetus dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for andre rod...@indiefield.co.uk Mar 2 22:48:02 lapetus dovecot: imap(andre rod...@indiefield.co.uk): Error: indexer failed to index mailbox INBOX Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Fatal: master: service(indexer-worker): child 19644 killed with signal 6 (core dumps disabled) -- Regards, Andre
[Dovecot] panic in dovecot when using fts with solr
Hello All, I have a panic error in dovecot when I try to use the fts search with Solr. The version of dovecot I use is version 2.1 I have used a telnet session to search, but I don't know if this make a difference: telnet localhost imap Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE STARTTLS AUTH=PLAIN AUTH=LOGIN] Dovecot ready. 1 login andre-rodier XX 1 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS MULTIAPPEND UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE SEARCH=FUZZY QUOTA ACL RIGHTS=texk] Logged in 2 select Inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft NonJunk $labels_4f9cce7caf4df $Forwarded $MDNSent Junk $labels_50f53a5862fb9 $label2 $label1 $label4 $label3 announce announces $ulabels_50f548e03429e feedback \*)] Flags permitted. * 2158 EXISTS * 0 RECENT * OK [UIDVALIDITY 1354776694] UIDs valid * OK [UIDNEXT 2568] Predicted next UID * OK [HIGHESTMODSEQ 9739] Highest 2 OK [READ-WRITE] Select completed. 3 search text Valentine * OK Searched 47% of the mailbox, ETA 0:10 * OK Searched 79% of the mailbox, ETA 0:05 * SEARCH 1120 1238 1279 1975 1990 1991 1992 1998 1999 2000 2001 2002 2058 2106 2107 2110 2151 3 OK Search completed (32.210 secs). -- Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Panic: file solr-connection.c: line 545 (solr_connection_post_more): assertion failed: (maxfd = 0) Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x4414a) [0x7f5f4237214a] - /usr/lib/dovecot/libdovecot.so.0(+0x4418e) [0x7f5f4237218e] - /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f5f4234982a] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(solr_connection_post_more+0x249) [0x7f5f402d48d9] - /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so(+0x4ac7) [0x7f5f402d1ac7] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0x339) [0x7f5f408f1f19] - /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xc6e0) [0x7f5f408f66e0] - dovecot/indexer-worker(+0x28d4) [0x7f5f42ae88d4] - /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) [0x7f5f4237f016] - /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xa7) [0x7f5f4237fcc7] - /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) [0x7f5f4237ea28] - /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f5f4236b483] - dovecot/indexer-worker(main+0xfe) [0x7f5f42ae834e] - /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) [0x7f5f41fc2ead] - dovecot/indexer-worker(+0x23f5) [0x7f5f42ae83f5] Mar 2 22:48:02 lapetus dovecot: indexer: Error: Indexer worker disconnected, discarding 1 requests for andre rod...@indiefield.co.uk Mar 2 22:48:02 lapetus dovecot: imap(andre rod...@indiefield.co.uk): Error: indexer failed to index mailbox INBOX Mar 2 22:48:02 lapetus dovecot: indexer-worker(andre rod...@indiefield.co.uk): Fatal: master: service(indexer-worker): child 19644 killed with signal 6 (core dumps disabled) -- Regards, Andre
Re: [Dovecot] case insensitive acl
On 19/08/12 17:25, Timo Sirainen wrote: On 19.8.2012, at 19.03, Andre Rodier wrote: I have notice that when I use ACL, the name of the user in the dovec-acl-list file is case sensitive. Because I use LDAP, the name of the users is case insensitive. Translate the username to lowercase. It's the default nowadays: auth_username_format = %Lu Would it be possible to have an option in Dovecot, to ignore the case of the ACL ? No. Thanks, Timo. Thanks for your huge work on Dovecot.
Re: [Dovecot] per user sieve after filters
On 04/05/12 08:02, Stephan Bosch wrote: On 4/9/2012 6:26 PM, Andre Rodier wrote: Hello, Thanks for dovecot, as it's still the best mail server. I'd like to use per users sieve_after scripts. Can I put in my dovecot config file, something like that: sieve_after = %h/Mails/Sieve/After/ It would be very useful for me, as I'd like to add vacation script to be executed from this place. I've tested this recently and it works for the above example. Additionally, I've extended multiscript support with the possibility to specify multiple sieve_before and sieve_after scripts: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/b2ff597c2279 So, you can now (once released) have a configuration like: sieve_after = %h/Mails/Sieve/After sieve_after2 = /usr/lib/dovecot/sieve-after.d And I changed the implementation to accept ~/ substitutions, so it is now also possible to do the following: sieve_after = ~/Mails/Sieve/After Turns out more people need/use a solution similar to yours and that is the reason I made it more flexible. Regards, Stephan. Thank you Stephan. I have started a small vacation plugin for roundcube, that uses this feature. (https://github.com/arodier/Roundcube-Plugins) By using sieve filters that way, I can create complex filters with templates, that does not interfering with normal sieve filter scripts. Kind regards, André
[Dovecot] per user sieve after filters
Hello, Thanks for dovecot, as it's still the best mail server. I'd like to use per users sieve_after scripts. Can I put in my dovecot config file, something like that: sieve_after = %h/Mails/Sieve/After/ It would be very useful for me, as I'd like to add vacation script to be executed from this place. Kind regards, André.
Re: [Dovecot] domain variable still empty
On Mon, 11 Apr 2011 06:11:08 +0100, Andre Rodier wrote: On Mon, 11 Apr 2011 00:35:33 +0300, Timo Sirainen wrote: On 11.4.2011, at 0.19, Andre Rodier wrote: What surprise me is this line during the authentication: === auth(arodier@red2team,10.10.2.19): username changed arodier@red2team - arodier That means that the username gets changed from %n = arodier and %d = redteam2 to %n = arorier and %d = empty. So I don't understand why %d would ever be anything else than empty. Anyway, http://wiki2.dovecot.org/DomainLost Thanks Timo, it was what I thought. However, even if I know know the cause, it doesn't help me too much to do what I want. In the link provided, none of the reason is applied in my settings. - My auth_username_format is set to the full username+domain, event empty, it's dropped. - I use LDAP, not SQL, so I don't know how to return the domain from my query. The question is now, how can I return both the username and the domain from LDAP, please ? Once I have the answer, I can add the information to the wiki page. However, it seems I can use this method, specified on this page: http://wiki.dovecot.org/AuthDatabase/LDAP/Userdb: You can add static fields that aren't looked up from LDAP (v1.1.rc5+). For example create a mail field with value /var/vmail/%d/%n: user_attrs = \ quotaBytes=quota_rule=*:bytes=%$, \ =mail=/var/vmail/%d/%n It is exactly what I want to do. But once I have created a mail field, how can I access this field from the main dovecot configuration file, please ? Thanks for your answer and your patience. Once I have finished to setup my environment, I'll publish a document to help others. Kind regards, Hello again, Timo, I am nearly there. I finally got it working, using the ldap prefetch option. I don't know why, but it is only in this way that the '%d' domain is kept after the authentication: Now, this line is normally resolved in my private namespace (mail location) = location = maildir:/home/emails/%d/%%n/Maildir: In my dovecot ldap configuration: -8 hosts = callisto.red2.srv thebe.red2.srv auth_bind = yes ldap_version = 3 base = dc=red2,dc=srv scope = subtree user_attrs = gosaMailQuota=quota_rule=*:storage=%$M,=home=/home/emails/%d/%n,=mail=/home/emails/%d/%n, mail_plugins user_filter = ((objectClass=posixAccount)(uid=%n)) pass_attrs = uid=uid,userPassword=password,\ =userdb_home=/home/emails/%d/%n,gosaMailQuota=userdb_quotarule=*:storage=%$M pass_filter = ((objectClass=posixAccount)(uid=%n)(ou=%d)) default_pass_scheme = PLAIN-MD5 -8 Obviously, I now need to cleanup and remove all options that are not needed. Kind regards, André
Re: [Dovecot] domain variable still empty
On Mon, 11 Apr 2011 07:42:21 +0100, Andre Rodier wrote: On Mon, 11 Apr 2011 06:11:08 +0100, Andre Rodier wrote: On Mon, 11 Apr 2011 00:35:33 +0300, Timo Sirainen wrote: On 11.4.2011, at 0.19, Andre Rodier wrote: What surprise me is this line during the authentication: === auth(arodier@red2team,10.10.2.19): username changed arodier@red2team - arodier That means that the username gets changed from %n = arodier and %d = redteam2 to %n = arorier and %d = empty. So I don't understand why %d would ever be anything else than empty. Anyway, http://wiki2.dovecot.org/DomainLost Thanks Timo, it was what I thought. However, even if I know know the cause, it doesn't help me too much to do what I want. In the link provided, none of the reason is applied in my settings. - My auth_username_format is set to the full username+domain, event empty, it's dropped. - I use LDAP, not SQL, so I don't know how to return the domain from my query. The question is now, how can I return both the username and the domain from LDAP, please ? Once I have the answer, I can add the information to the wiki page. However, it seems I can use this method, specified on this page: http://wiki.dovecot.org/AuthDatabase/LDAP/Userdb: You can add static fields that aren't looked up from LDAP (v1.1.rc5+). For example create a mail field with value /var/vmail/%d/%n: user_attrs = \ quotaBytes=quota_rule=*:bytes=%$, \ =mail=/var/vmail/%d/%n It is exactly what I want to do. But once I have created a mail field, how can I access this field from the main dovecot configuration file, please ? Thanks for your answer and your patience. Once I have finished to setup my environment, I'll publish a document to help others. Kind regards, Hello again, Timo, I am nearly there. I finally got it working, using the ldap prefetch option. I don't know why, but it is only in this way that the '%d' domain is kept after the authentication: Now, this line is normally resolved in my private namespace (mail location) = location = maildir:/home/emails/%d/%%n/Maildir: In my dovecot ldap configuration: -8 hosts = callisto.red2.srv thebe.red2.srv auth_bind = yes ldap_version = 3 base = dc=red2,dc=srv scope = subtree user_attrs = gosaMailQuota=quota_rule=*:storage=%$M,=home=/home/emails/%d/%n,=mail=/home/emails/%d/%n, mail_plugins user_filter = ((objectClass=posixAccount)(uid=%n)) pass_attrs = uid=uid,userPassword=password,\ =userdb_home=/home/emails/%d/%n,gosaMailQuota=userdb_quotarule=*:storage=%$M pass_filter = ((objectClass=posixAccount)(uid=%n)(ou=%d)) default_pass_scheme = PLAIN-MD5 -8 Obviously, I now need to cleanup and remove all options that are not needed. Kind regards, André Hi everybody, It is me again, a typo error that I want to inform people. The resolved line I gave in example is my shared namespace. But the private namespace works as well. The private namespace location: -8 location = maildir:~/Maildir:INDEX=/var/mail/indexes/private/%n:CONTROL=/var/mail/indexes/private/%n -8 The shared namespace location: -8 location = maildir:/home/emails/%d/%%n/Maildir: -8 The only strange thing, is that the quota seems to have been cached. After changing the value on my LDAP server, the value is read, but both roundcube and thunderbird are displaying the same percentage. It will be another thread, now. Kind regards, André.
Re: [Dovecot] domain variable still empty
On Mon, 11 Apr 2011 00:35:33 +0300, Timo Sirainen wrote: On 11.4.2011, at 0.19, Andre Rodier wrote: What surprise me is this line during the authentication: === auth(arodier@red2team,10.10.2.19): username changed arodier@red2team - arodier That means that the username gets changed from %n = arodier and %d = redteam2 to %n = arorier and %d = empty. So I don't understand why %d would ever be anything else than empty. Anyway, http://wiki2.dovecot.org/DomainLost Thanks Timo, it was what I thought. However, even if I know know the cause, it doesn't help me too much to do what I want. In the link provided, none of the reason is applied in my settings. - My auth_username_format is set to the full username+domain, event empty, it's dropped. - I use LDAP, not SQL, so I don't know how to return the domain from my query. The question is now, how can I return both the username and the domain from LDAP, please ? Once I have the answer, I can add the information to the wiki page. However, it seems I can use this method, specified on this page: http://wiki.dovecot.org/AuthDatabase/LDAP/Userdb: You can add static fields that aren't looked up from LDAP (v1.1.rc5+). For example create a mail field with value /var/vmail/%d/%n: user_attrs = \ quotaBytes=quota_rule=*:bytes=%$, \ =mail=/var/vmail/%d/%n It is exactly what I want to do. But once I have created a mail field, how can I access this field from the main dovecot configuration file, please ? Thanks for your answer and your patience. Once I have finished to setup my environment, I'll publish a document to help others. Kind regards, -- Andre Rodier
[Dovecot] sieve vacation error
Hello everybody, First, I want to thank the development team for the quality and the stability of dovecot. It's now running without problem since two years on my debian box. Next, I'd like you help me to solve the problem I have with vacation/sieve script. My configuration is debian lenny, with standard dovecot packages (1.0). I have setup the sieve plugin, using roundcube on another machine, and filter is working fine. fileinto is working, as well as forward and discard. However, vacation is not working at all, and I have no error message. The mails sent to the account marked as vacation are received, but the auto answer process is not working. Here the successful logs from the vacation reject script, that I temporary use: Sep 23 17:32:41 mail deliver(some.user): Loading modules from directory: /usr/lib/dovecot/modules/lda Sep 23 17:32:41 mail deliver(some.user): Module loaded: /usr/lib/dovecot/modules/lda/lib90_cmusieve_plugin.so Sep 23 17:32:41 mail deliver(some.user): maildir: data=/home//some.user/Maildir Sep 23 17:32:41 mail deliver(some.user): maildir: root=/home//some.user/Maildir, index=/home//some.user/Maildir, control=, inbox= Sep 23 17:32:41 mail deliver(some.user): cmusieve: Using sieve path: /home//some.user/sieve/dovecot.sieve Sep 23 17:32:41 mail deliver(some.user): cmusieve: Executing script /home//some.user/sieve/dovecot.sievec Sep 23 17:32:41 mail deliver(some.user): msgid=72817c95458dbded987b82ec644f7...@red2.co.uk: rejectedReturn-Path: andre.rod...@red2.co.uk Here the headers of an email received, and supposed to be auto answered. X-Original-To: some.u...@red2.co.uk Delivered-To: some.u...@localhost Received: from webmail.red2.co.uk (webmail.red2.co.uk [84.45.46.48]) by mail.red2.co.uk (Postfix) with ESMTP id 0D1607E418D for some.u...@red2.co.uk; Wed, 23 Sep 2009 17:30:44 +0100 (BST) Received: by webmail.red2.co.uk (Postfix, from userid 33) id 227E67FE5; Wed, 23 Sep 2009 17:16:30 +0100 (BST) To: Some User some.u...@red2.co.uk Subject: vacation test MIME-Version: 1.0 Date: Wed, 23 Sep 2009 17:16:30 +0100 From: Andre Rodier andre.rod...@red2.co.uk Organization: Red2 Message-ID: 854f02eceb84d80d272212de405a1...@red2.co.uk X-Sender: andre.rod...@red2.co.uk User-Agent: RoundCube Webmail/0.2 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8 X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Wed Sep 23 17:30:44 2009 X-DSPAM-Confidence: 0.9989 X-DSPAM-Probability: 0. X-DSPAM-Signature: 4aba4d34317622670999051 Here my questions : * If the sieve vacation script had to use a counter for limits per day, where this counter is supposed to be stored ? I cant see any dovecot file. I have temporary try to use 0777 for home/sieve/maildir folders, but no file is created at all. * Is it the same process used to forward, discard and finally vacation ? * I use virtual file for users on postfix, and I also have a LDAP server for authentication. Do I have something to configure on dovecot to be sure that vacation is working with this configuration ? * As you may have noticed above, mails are redirected to localhost users. ( c.f X-Original-To: some.u...@red2.co.uk and Delivered-To: some.u...@localhost ) Is this can affect the process ? ( Remember that forward and reject is working ). * Is there a way to debug the vacation process ? Thanks for your help. André Rodier.
Re: [Dovecot] Sending log messages too fast
This can also happen if you use the debug option of dovecot. Luigi Rosa wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 What does this error message means? IMAP(xx...@y.com): Sending log messages too fast, throttling.. It appeared twiche on the same user during a period when the server was very high on CPU load I don't know if it is related, but the user later told me that Thunderbird forced a reload of all the messages. Ciao, luigi - -- / +--[Luigi Rosa]-- \ It is not the strongest of the species that survives, nor the most intelligent, but the one most responsive to change. --Charles Darwin -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.9 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkp4HOwACgkQ3kWu7Tfl6ZSIeACgrzXidrLIh783fr7DVFblfwc5 s/kAnAy5rztbmeqFt11uPGF0LVp6UBga =ZgWV -END PGP SIGNATURE-
Re: [Dovecot] Antispam plugin custom behavior?
On Wed, 2008-06-11 at 10:25 -0500, Kyle Wheeler wrote: Hello, I currently have a setup on my system with what I call magic folders to enable spam filter training. Here's how it works: 1. If you have a false-negative, put the spam into the Spam.Report folder 2. If you have a false-positive (which has all kinds of ugly spamassassin protective markup in it), put the message into the Spam.NotSpam folder Currently what happens is that a cron job comes along every five minutes and processes the messages in those folders. In the case of the NotSpam folder, it strips the message of the spamassassin markup, retrains the bayesian net, and redelivers the message (e.g. via deliver). In the case of the Report folder, the message is used to train the bayesian net (among other things) and then deleted. I'd love to be able to trigger these actions when the mail is moved, rather than have a cron job inspecting the mailboxes. I looked into the antispam plugin (http://johannes.sipsolutions.net/Projects/dovecot-antispam), which seems nice but doesn't appear sufficiently generic for my needs. What would really work is if I could get it set up such that putting a message into either of those directories is turned into piping the message to a script of my choosing (a different one for each folder). Does anyone know a good way of getting my own custom behavior in here, or is my cronjob setup probably the best way? ~Kyle Hello Kyle, As a temporary solution, and if your linux box as iNotify support, I suggest you use incron. incron is an inotify cron system. It works like the regular cron but is driven by filesystem events instead of time events. Andre Rodier r e d 2 - Service Driven Development 34-35 Eastcastle Street, London W1W 8DW www.red2.co.uk | [EMAIL PROTECTED] (+44) 0870 471 8492 direct (+44) 0751 124 4961 mobile
[Dovecot] Multiple SSL certificates with dovecot.
Hello all, By advance, I hope you'll excuse my probably not perfect English, which is not my mother tongue. I have always appreciated dovecot for this simplicity to setup and lightweight, but today, after many installations, I cannot find how to setup dovecot for my configuration. - I use only IMAPS to retrieve the mails. - I manage two domain names - I use CA-Cert certificates So,the question is : how to setup dovecot to select the appropriate certificate, according to the domain name I use when I retrieve mails using the IMAPS protocol ? Thanks. Andre Rodier.
Re: [Dovecot] Multiple SSL certificates with dovecot.
Hello all, Thanks a lot for your answers, I was not sure it was possible, anyway, Thanks Steffen, to have take the time to detail to me the IMAP protocol, and Daniel for your advices about CSR and vhost task force, I'll try them later. André Rodier.
