mmap failed messages in syslog

2018-04-14 Thread Shawn Heisey
I'm getting mmap failed messages in syslog on version 1.2.15 for dovecot.index.cache files.  This old dovecot version is installed with debian packages.  The OS and all software is 64-bit. I've found info on this log message, with a suggested fix of raising vsz_limit ... but this seems to be a

Re: mmap failed messages in syslog

2018-05-09 Thread Shawn Heisey
On 4/14/2018 8:36 AM, Shawn Heisey wrote: I'm getting mmap failed messages in syslog on version 1.2.15 for dovecot.index.cache files.  This old dovecot version is installed with debian packages.  The OS and all software is 64-bit. I've found info on this log message, with a sugges

Re: mmap failed messages in syslog

2018-05-09 Thread Shawn Heisey
On 5/9/2018 10:15 PM, Shawn Heisey wrote: It's been about three weeks since I asked this question.  All the information I have available says that all users have no limits on virtual memory, so it must be dovecot itself that sets the limit.  Can that be changed in the 1.2 version?  I

best practices for migrating to new dovecot version

2018-07-17 Thread Shawn Heisey
I have a machine with my mail service on it running Debian Squeeze. The version of dovecot on that server is 1.2.15. I'm building a new server with Ubuntu 18.04 (started with 16.04, upgraded in place), where the dovecot version is 2.2.33. I plan to migrate all my services to this new machine. T

Re: best practices for migrating to new dovecot version

2018-07-18 Thread Shawn Heisey
On 7/17/2018 1:16 PM, Aki Tuomi wrote: > You can just rsync everything over to new system. I did a few initial rsyncs some time ago. So a new rsync will be relatively quick. There's 25GB of data and over a million files in the copy on the new server, which is probably a few months out of date co

Re: [SOLR] Where is solr-schema.xml?

2018-07-27 Thread Shawn Heisey
On 7/27/2018 7:50 AM, Peter Nabbefeld wrote: > > running dovecot 2.3.2.1 on Arch Linux, and installed solr 7.4.0. > > According to the wiki, there should be doc/solr-schema.xml, but I > cannot find it. On ubuntu, this is in the "dovecot-solr" package, not the main dovecot package.  With that packa

Re: Disable logging for localhost

2018-10-22 Thread Shawn Heisey
On 10/21/2018 8:23 AM, André Rodier wrote: I am using Zabbix to monitor my Dovecot server, and my logs are filled with lines like this: Oct 21 15:04:46 osaka dovecot[1256]: pop3-login: Aborted login (no auth attempts in 0 secs): user=<>, rip=127.0.0.1, lip=127.0.0.1, secured, session= Oct 21

Re: Disable logging for localhost

2018-10-24 Thread Shawn Heisey
On 10/24/2018 4:46 AM, André Rodier wrote: These lines are in the mail.log. I am not talking about Zabbix. Zabbix generate a connection every second, on both Postfix and Dovecot. I want these two services to not log connections when they are coming from 127.0.0.1, if possible. Both journalct

Re: solr and dovecot-2.2.36.4

2020-07-20 Thread Shawn Heisey
On 7/17/2020 3:23 AM, Maciej Milaszewski wrote: I try schema.xml and solrconfig.xml from working solr-6.6.5 (dovecot) "dovecot: org.apache.solr.common.SolrException:org.apache.solr.common.SolrException: Error initializing QueryElevationComponent" That looks like a Solr error. This list is not

Re: Trying to use solr

2020-07-24 Thread Shawn Heisey
On 7/22/2020 11:13 AM, Francis Augusto Medeiros-Logeay wrote: On Solr I get this error: org.apache.solr.common.SolrException: Exception writing document id 210/9fd7941e8297d25d9160c3fdd3da/fran...@francisaugusto.com

Re: Trying to use solr

2020-07-26 Thread Shawn Heisey
On 7/26/2020 3:48 AM, r...@med-lo.eu wrote: Thanks a lot Shawn. I will send the full error when I get home a week from now. But this was my first attempt to use solr - is it still subject to those conflicts? You'll have to be more specific ... but I believe the answer to your question is likely

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

2020-10-18 Thread Shawn Heisey
On 10/11/2020 4:27 PM, PGNet Dev wrote: I'm running, dovecot --version 2.3.11.3 (502c39af9) solr -version 8.6.3 Attempting to test/debug from from cmd line, doveadm fts lookup -u myu...@example.com body "tambien" causes a PANIC I

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

2020-10-18 Thread Shawn Heisey
On 10/18/2020 6:33 PM, PGNet Dev wrote: is it that you're not using the dovecot plugin, but _DO_ have solr search setup?  by what method/mean? or that you're avoiding solr usage altogether? I am using dovecot for my mail service. My host in AWS only has 2GB of memory ... I would expect an i

Re: Sieve by the addressee

2021-02-20 Thread Shawn Heisey
On 2/20/2021 8:50 AM, Markus Schönhaber wrote: I consider it a better idea to filter mailing list messages by their List-ID header. I agree with Markus. It's what I do. This works well: if header :regex "list-id" "solr-user.lucene.apache.org" { fileinto "asf.solr-user"; stop;

Re: Incorrect value sent to solr

2021-04-03 Thread Shawn Heisey
On 4/2/2021 7:11 AM, Łukasz Szczepański wrote: On a Solr side I got an error: java.lang.NumberFormatException: For input string: "2206267083" NumberFormat expect an int which max value is 2147483647. Quick test reviles that rows parameter isn't required for correct response from solr. I think t

Re: Incorrect value sent to solr

2021-04-03 Thread Shawn Heisey
On 4/3/2021 12:12 PM, Łukasz Szczepański wrote: Rows isn't part of manage-schema for solr collection its build in common query parameters in solr, and type of this field cannot be changed. It controls the number of returned results (by default 10). I still think that an issue on dovecot side, bu

Re: Incorrect value sent to solr

2021-04-07 Thread Shawn Heisey
On 4/7/2021 4:13 AM, Łukasz Szczepański wrote: I've prepared pull request with fixed rows parameter: https://github.com/dovecot/core/pull/160 I've tested this fix on mailbox which caused a problem earlier, and its works fine. I admit to not being very familiar with dovecot source, but I did a

OT: Re: Bypass Trash Folder Sometimes.

2021-07-03 Thread Shawn Heisey
On 7/3/2021 1:18 PM, dove...@ptld.com wrote: this is imho not controlled in dovecot at all Oops, wrong mailing list. I meant to send this to the roundcube mailing list. Roudcube user here, talking to dovecot. I've just verified something I thought was true. If you select one or more messag

Major upgrade of mail server

2021-07-07 Thread Shawn Heisey
I have a mail server in AWS that is currently running Ubuntu 18. Every time I log in, I am reminded that I can upgrade to Ubuntu 20. On Ubuntu 18, the dovecot version is 3.3.0-1ubuntu0.3. On Ubuntu 20, it is 2.3.7.2-1ubuntu3. Many other packages, probably including the mysql server, would a

Re: Major upgrade of mail server

2021-07-09 Thread Shawn Heisey
On 7/8/2021 7:46 AM, Oscar del Rio wrote: It would also be a good opportunity to switch to using the official Dovecot repositories. https://repo.dovecot.org/ I tried this, and at first couldn't figure out why the packages were in a broken state that wouldn't install. Then I realized I had ad

Re: Dovecot - FTS Solr: disk usage & position information?

2021-08-04 Thread Shawn Heisey
On 8/4/2021 1:24 AM, Vincent Brillault wrote: On a local dovecot cluster currently hosting roughly 2.1TB of data, using Solr as its FTS backend, we now have 256GB of data in Solr, split in 12 shard (to which replication adds 256GB of data through 12 additional cores). I'm now trying to see if we

Re: Dovecot - FTS Solr: disk usage & position information?

2021-08-05 Thread Shawn Heisey
On 8/5/2021 1:00 AM, Vincent Brillault wrote: Indeed, I should have. I'm using Solr 8.6, which is clearly not the same as Solr 6.2.0, but when looking at more recent versions of the documentation, no information about the use of each file appeared. That's why I was mentioning it was slightly outd

[OT] Re: What kind of search response time are you setting with solr full text search?

2021-08-25 Thread Shawn Heisey
On 8/24/2021 7:19 PM, Steve Dondley wrote: THE PROBLEM: When I do a full text search through all my inbox and all subfolders on a single word, search results are returned in about 10 to 15 seconds. This is better than the 40 seconds or so I'm getting when I turn off the fts and fts_solr plugins b

Re: [OT] Re: What kind of search response time are you setting with solr full text search?

2021-08-25 Thread Shawn Heisey
On 8/25/2021 11:33 AM, Steve Dondley wrote: OK, I take this back. I did an imap search via telnet and solr reports the search takes about 3 to 4 seconds. Here's the output: a search text "maynez" Try this in on the commandline of the Solr server: time curl "http://localhost:YYY/solr/doveco

Re: [OT] Re: What kind of search response time are you setting with solr full text search?

2021-08-25 Thread Shawn Heisey
On 8/25/2021 12:05 PM, Steve Dondley wrote: OK I had to modify the query path slightly to get it to work with my core to: time curl http://localhost:8983/solr/dondley/select?q=maynez&defType=edismax&qf=body+to+subjec:t+ccfrom But it didn't return any results: I only have emails for th

Re: [OT] Re: What kind of search response time are you setting with solr full text search?

2021-08-25 Thread Shawn Heisey
On 8/25/2021 2:10 PM, Steve Dondley wrote: And it looks like I'm running into a major bug in the slightly dated version of dovecot debian uses: https://www.mail-archive.com/dovecot@dovecot.org/msg78825.html Recently I did a fairly major upgrade.  I had an older Ubuntu release with Dovecot

Solr FTS - when does indexing happen?

2021-09-03 Thread Shawn Heisey
I have Solr FTS on my dovecot install.  I followed the instructions on the dovecot wiki. How long a delay should I expect to see between new mail being delivered with the dovecot LDA and an indexing request sent to Solr?  Because I get a LOT of email from various mailing lists, and I do not se

Re: Solr FTS - when does indexing happen?

2021-09-04 Thread Shawn Heisey
On 9/4/2021 4:06 PM, Steve Dondley wrote: As I recall, indexing an email is triggered immediately when an email is received if you have you dovecot settings set properly to trigger the indexing. The dovecot documentation for FTS, it spells it out. See https://doc.dovecot.org/configuration_man

Re: Solr FTS - when does indexing happen?

2021-09-04 Thread Shawn Heisey
On 9/4/2021 4:52 PM, Shawn Heisey wrote: I see something talking about autoindex, but it does not have an example so that I can see where it needs to go.  I cannot work it out from what is there. With a little googling, I was able to figure out where it needs to go. And now it acts like I

Re: Dovecot - FTS Solr: disk usage & position information?

2021-09-06 Thread Shawn Heisey
On 9/6/2021 12:58 AM, Vincent Brillault wrote: Hi Alessio, this optimization also produce a less RAM requirements on Solr server? Unfortunately we didn't measure this before/after the change. Since we are removing features (position information), I wouldn't expect the memory requirement to

Solr FTS - message deletes not working as expected

2021-10-26 Thread Shawn Heisey
I have Solr FTS enabled in dovecot.  It is behaving differently than I would expect. When I delete messages in Thunderbird normally, using IMAP to talk to dovecot, the deletion hits Solr right away.  If I then ask Thunderbird to empty the trash, that delete also hits Solr immediately. But if

Re: Solr FTS - message deletes not working as expected

2021-10-28 Thread Shawn Heisey
On 10/26/21 12:18 PM, Shawn Heisey wrote: But if I use shift-delete in Thunderbird, which deletes the message immediately without going through Trash, things are different. Also, when I send a message with Thunderbird, which deletes the message in Drafts and adds one to Sent, I am not

Re: Solr FTS - message deletes not working as expected

2021-11-02 Thread Shawn Heisey
On 10/28/21 8:00 AM, Shawn Heisey wrote: Also, when I send a message with Thunderbird, which deletes the message in Drafts and adds one to Sent, I am not seeing a delete request in the Solr log.  I do see the add. So this isn't limited to just the shift-delete workflow. I have conf

Re: Solr FTS - message deletes not working as expected

2021-11-03 Thread Shawn Heisey
On 11/3/21 12:38 PM, Michael Slusarz wrote: Have you tried another client? I only have two clients configured:  Thunderbird 78.13.0 on Linux and Thunderbird 91.2.1 on Windows.  Behavior is the same on both. I will see if I can get another client configured.  Windows Mail is included on Wind

Re: Solr FTS - message deletes not working as expected

2021-11-03 Thread Shawn Heisey
On 11/3/21 1:09 PM, Michael Slusarz wrote: For Solr, there's a code path in the FTS expunge code that will silently toss expunge requests: if (ctx->last_indexed_uid == 0 || uid > ctx->last_indexed_uid + 100) { /* don't waste time asking Solr to expunge a m

Re: Solr FTS - message deletes not working as expected

2021-11-03 Thread Shawn Heisey
On 11/3/2021 10:12 PM, Shawn Heisey wrote: Maybe I can do a custom compile of the source code and replace the /usr/lib/dovecot/modules/lib21_fts_solr_plugin.so file with what the compile produces.  I'm going to try that, and see if it explodes. :) Bit of a problem trying to do this. I p

Re: Solr FTS - message deletes not working as expected

2021-11-03 Thread Shawn Heisey
On 11/3/2021 11:10 PM, Shawn Heisey wrote: Then I downloaded the source archive from the main site, extracted it, and the configure script was included in that.  After compiling, I found the .so file and moved it into place, and I will be testing it. The new library is significantly larger

Re: Solr FTS - message deletes not working as expected

2021-11-04 Thread Shawn Heisey
On 11/3/21 12:38 PM, Michael Slusarz wrote: Have you tried another client? I tried evolution on Linux. I can't work out how to do an expunge in evolution.  I'm not sure that it CAN do it.  Whenever I delete a message, even with shift-delete, it is moved to the Trash folder (with delete and

Re: Solr FTS - message deletes not working as expected

2021-11-18 Thread Shawn Heisey
On 11/3/21 11:45 PM, Shawn Heisey wrote: Manual expunges of existing messages also are not sending a delete request to Solr.  I waited several minutes for that too. Update on this, since you're all on the edge of your seat waiting. :) I did a Send test with TypeApp, a mail client for An

Re: FTS config - cannot search substrings

2021-11-18 Thread Shawn Heisey
On 11/18/2021 4:43 PM, infoomatic wrote: sometimes ignoring the problem for a few moments and then starting over again helps ... the solution was already solved here in a mail over 10 years ago - https://dovecot.org/list/dovecot/2011-May/059338.html Thanks Daniel Miller! There's something to

No source packages in APT repo?

2021-12-03 Thread Shawn Heisey
I added a deb-src entry to my APT config matching the deb entry: deb https://repo.dovecot.org/ce-2.3-latest/ubuntu/focal focal main deb-src https://repo.dovecot.org/ce-2.3-latest/ubuntu/focal focal main When this is there, I see a warning when running "apt update". W: Skipping acquire of config

Re: No source packages in APT repo?

2021-12-03 Thread Shawn Heisey
On 12/3/21 1:28 PM, Aki Tuomi wrote: Is there a particular reason you need to build source packages? There are sometimes moments when I want to test out a code change in a program I'm running on a server.  If a source package is available, I can make the change and build a new package that i

Re: No source packages in APT repo?

2021-12-08 Thread Shawn Heisey
On 12/8/21 3:46 AM, Aki Tuomi wrote: You only need dovecot-dev for that, not the sources. The dovecot-dev package looks like it's for writing programs that integrate with dovecot, not for building dovevot. If I'm wrong about that, can somebody explain how I can use it to build custom doveco

Re: modernizing dovecot.conf

2021-12-29 Thread Shawn Heisey
On 12/29/2021 9:53 PM, Benny Pedersen wrote: On 2021-12-30 05:40, Laura Steynes wrote: Because gmail is dumb. good mail client interfaces see reply-all with a mailing list as reply to list only so you are just a gmail victim ? :=) I have no experience on this with gmail. I haven't subscribe

Re: Error: fts_solr: received invalid uid

2022-01-04 Thread Shawn Heisey
On 1/2/22 3:08 PM, John Fawcett wrote: unless I'm missing something that doesn't look like the type of query dovecot launches - dovecot sends various parameters including the request for xml results. The thing that looks odd to me is that the results fields should be single values not arrays en

Re: email location - files or sql

2022-02-24 Thread Shawn Heisey
On 2/22/2022 9:12 AM, Robert Moskowitz wrote: What I am seeing is that many of the packages seem to roll the messages into some SQL database.  My Dovecot setup uses the /home/vmail/doman/../{cur,new,etc} tree structure. I use dovecot and postfix in conjunction with a postfixadmin database in

Re: solr fts and removing accounts

2020-01-19 Thread Shawn Heisey
On 1/19/2020 3:31 AM, Wojciech Puchar wrote: i use solr fts indexing. It worls very well but it have one database per system, not per user. Lets suppose i delete one or more e-mail users in system. How to remove them in solr database to reclaim space? I cannot say whether there is anything t

Re: Dovecot - Upgrade Solr 7.7.2 to 8.4.1

2020-01-22 Thread Shawn Heisey
On 1/22/2020 4:03 PM, Domenico Pastore wrote: So, with Dovecot is it possible to use Apache Solr 8.4? High RAM usage is the only problem? I don't know whether it's possible, but I imagine there is some way to make it work. I don't see anything in the solrconfig or schema provided for fts_sol

Re: Problem with Let's Encrypt Certificate

2017-02-17 Thread Shawn Heisey
On 2/17/2017 2:38 PM, chaouche yacine wrote: > Seems wrong to me too, Robert. If you put your private key inside your > certificate, won't it be sent to the client along with it ? The private key should not be sent to the connecting client, even if it is contained in the same place as the certifi

Slow performance with large folders over the Internet

2017-03-30 Thread Shawn Heisey
Dovecot package version is 1:1.2.15-7+deb6u1. It is in Debian 6.0.10, using the Debian package. The server is in my basement at home, and is exposed to the Internet so I can fully access my mail from anywhere. I use IMAP for reading mail. I have a number of folders in my mailbox that have thous

Re: resend whole inbox to user

2022-04-06 Thread Shawn Heisey
On 2022-04-06 13:29, Marc wrote: I was wondering if there is some way to force an imap client to 're-download' all the messages from the inbox. I can remember in the 'old days' that when the connection was dropped during a pop download, the whole inbox was re-downloaded, resulting in quite a lot

Re: Set up per user sieve rules

2022-04-09 Thread Shawn Heisey
On 4/9/2022 6:00 PM, Austin Witmer wrote: I am struggling to wrap my mind around how to set up sieve rules for my individual users on my mail server. I set up a global sieve script file at "/var/lib/dovecot/sieve/default.sieve” and that works great. My users maildirs are located at /mnt/volum

Re: Set up per user sieve rules

2022-04-09 Thread Shawn Heisey
On 4/9/2022 9:29 PM, Austin Witmer wrote: I am curious Shawn, what the contents of your /etc/dovecot/conf.d/90-sieve.conf file is? It's almost all comments.  A LOT of detailed comments.  Stripping those out: --- root@bilbo:~# cat /etc/dovecot/conf.d/90-sieve.conf | egrep -v "^#|^\s+#|^$" plug

Re: Set up per user sieve rules

2022-04-10 Thread Shawn Heisey
On 4/9/2022 9:36 PM, Shawn Heisey wrote: sieve_default = file:/var/vmail/global.sieve And in case it matters, here are the contents of the global.sieve file: --- require ["envelope", "fileinto", "reject", "vacation", "regex", "

Re: Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox

2022-04-17 Thread Shawn Heisey
On 4/16/2022 11:32 PM, Turritopsis Dohrnii Teo En Ming wrote: Both Roundcube and Squirrelmail webmail cannot search for anything because there are more than 200,000 emails in my Inbox. Both Roundcube and Squirrelmail webmail cannot open many emails because there are more than 200,000 emails

Re: Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox

2022-04-17 Thread Shawn Heisey
On 4/17/2022 7:44 AM, Turritopsis Dohrnii Teo En Ming wrote: My Dovecot, Postfix, Roundcube and Squirrelmail were automatically installed, configured and deployed by Virtualmin web hosting control panel install scripts. How do I integrate Apache SOLR searching capability with Dovecot? Are there

Re: Bad Signature - Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox

2022-04-19 Thread Shawn Heisey
On 4/19/2022 5:12 PM, Turritopsis Dohrnii Teo En Ming wrote: It is not true that no email system was ever designed for 200,000 or more emails. If I did not remember wrongly, more than 10 years ago, I used to have a Gmail email account, with 4-5 MILLION email messages in the Inbox. There was no p

Re: Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox

2022-04-20 Thread Shawn Heisey
On 4/20/22 08:03, Turritopsis Dohrnii Teo En Ming wrote: Dear Shawn Heisey, Your instructions for integrating Apache SOLR with Dovecot is too much for me to understand. Do you have links/URLs to excellent guides for doing this? Here's the dovecot manual page on it: https://doc.doveco

Re: Bad Signature - Both Roundcube and Squirrelmail webmail cannot search for anything + cannot open many emails because there are more than 200, 000 emails in my Inbox

2022-04-20 Thread Shawn Heisey
On 4/20/22 07:51, Turritopsis Dohrnii Teo En Ming wrote: I believe Gmail is using IMAP. The instructions for configuring Gmail email accounts in Outlook specifically mention IMAP server hostname: imap.gmail.com TCP Port 993, SSL Indeed you CAN use IMAP with gmail.  For work, I mostly use my e

Re: how to setup IMAPs with letsencrypt

2022-04-22 Thread Shawn Heisey
On 4/22/22 02:20, Jean-Daniel Dupas wrote: While it's true for SMTP, my experience is that IMAP clients prefer imaps in 993 instead of STARTTLS. I have a server with only port 993 opened, and almost never had any issue with client configuration. I have noticed the opposite.  Every time I hav

Re: auth between postfix and dovecot?

2022-04-23 Thread Shawn Heisey
On 4/22/2022 10:35 PM, ミユナ (alice) wrote: my question is: when postfix talks to dovecot, does it require user's username/password for authentication? or this communication just goes without authentication? I asked this, b/c my webmail send mail from localhost has been going without authenti

Re: auth between postfix and dovecot?

2022-04-23 Thread Shawn Heisey
On 4/23/2022 9:07 AM, Alexander Dalloz wrote: With this Postfix configuration you do not make use of LMTP delivery. Interesting.  I thought it was using LMTP but it looks like master.cf has it running /usr/lib/dovecot/dovecot-lda to deliver. Would LMTP be a better option? It has always worked

Re: how to setup IMAPs with letsencrypt

2022-04-23 Thread Shawn Heisey
On 4/23/2022 6:45 PM, Richard Hector wrote: _A_ web server has to be there. It doesn't have to serve anything else useful. My mail server has a web server that only serves the LE challenge. Well, actually it's a proxy server that serves several other domains too, but there's nothing else served

Re: Recovering deleted mailbox

2022-04-27 Thread Shawn Heisey
On 4/27/22 16:18, Sean McBride wrote: I have a user (coworker) that accidentally deleted a mailbox and all its sub-mailboxes. I use Maildir format storage. I have backups. Is it enough to put the mailbox folder back where it was? I'm talking about the folder that contains 'cur', 'new', 'tmp

Re: Recovering deleted mailbox

2022-04-27 Thread Shawn Heisey
On 4/27/2022 11:27 PM, Aki Tuomi wrote: There is no reason to delete the dovecot files after recovery. You can run `doveadm force-resync` to ensure everything is synced. Removing the files just cause more problems than benefit usually. Thanks for that information!  Very helpful for future fid

Re: Recovering deleted mailbox

2022-04-27 Thread Shawn Heisey
On 4/27/2022 11:48 PM, Aki Tuomi wrote: # drop fts data doveadm fts rescan -u user # rebuild index doveadm index -u user "*" I do full reindexes a lot more often than a typical user would. When I do a reindex, I want it to happen for all users, not one at a time.  Do you have a sequence of co

Re: dovecot-fts-solr Solr9 support

2022-05-17 Thread Shawn Heisey
On 5/17/22 09:02, PGNet Dev wrote: Modifying the config to use CaffeineCache cp solr-config-7.7.0.xml solr-config-9.0.0.xml perl -pi -e '\ s|solr.FastLRUCache|solr.CaffeineCache|g; \ s|solr.LRUCache|solr.CaffeineCache|g; \ s|solr.search.LRUCache|solr.search.CaffeineCache|

Re: dovecot-fts-solr Solr9 support

2022-05-17 Thread Shawn Heisey
On 5/17/22 11:32, PGNet Dev wrote: Something that is missing from the current instructions is how to initiate a FULL reindex of all data in the dovecot install. Beyond looping over each $acct  doveadm fts rescan -u ${acct}  doveadm index  -u ${acct} -q '*' I hadn't seen the fts rescan be

FTS Solr -- no commit on message delete

2022-05-18 Thread Shawn Heisey
I've been chasing down oddities in behavior related to FTS Solr for a while now. First the part that isn't a problem with dovecot:  In cases where message deletes bypass the Trash folder (such as shift-delete and normal workflow with the Drafts and Sent folders), Thunderbird does not inform D

Re: FTS Solr -- no commit on message delete

2022-05-18 Thread Shawn Heisey
On 5/18/2022 8:24 AM, Shawn Heisey wrote: Today I discovered a related problem that I think IS in Dovecot.  I did a shift-delete on some messages, and then exited Thunderbird.  Dovecot did delete the messages from Solr, but it did not send a commit to make those changes affect subsequent

Re: dovecot-fts-solr Solr9 support

2022-05-23 Thread Shawn Heisey
On 5/17/2022 11:32 AM, PGNet Dev wrote: CaffeineCache  _should_ be a solution for both series. I'm just starting to do a bit of testing, but so far, indexing/search with Caffeine seems quicker, at least. I do not yet know in which case(s) CaffeineCache is _not_ an appropriate solution. Caffei

Re: solr-jetty package in Debian 11 bullseye

2022-05-25 Thread Shawn Heisey
On 5/25/22 13:30, John Gateley wrote: I am in the process of upgrading the OS on my mailserver, currently Debian 9, to Debian 11. The solr-jetty package does not appear to exist in Debian 11. The Solr package that was included in Debian and derivatives was REALLY ancient -- Solr 3.6.  Looks

Re: Maybe a bit offtopic, Sieve beaviour

2022-08-23 Thread Shawn Heisey
On 8/23/22 03:44, João Silva wrote: If a sieve filter contains a rule if header :regex ["From"] ["@xxx.com","@yyy.pt"] {     fileinto :create "ac"; } The mail should be copied to the folder ac and then proceed to other rules that a user might have or I understood the fileinto wrong? I ju

Re: Replication

2022-09-05 Thread Shawn Heisey
On 9/5/22 08:18, Silvio Siefke wrote: On Mon, 5 Sep 2022 14:59:01 +0200 Narcis Garcia wrote: I SEE THIS IN LOG COPY: Sep 5 18:02:18 asia dovecot: replicator: Panic: data stack: Out of memory when allocating 268435496 bytes Yes but Memory is enough free. I had follow the link It is very li

Re: dovecot-fts-solr Solr9 support

2022-09-30 Thread Shawn Heisey
On 9/27/22 19:32, Nathanael Anderson wrote: I was trying a new install of dovecot w/ solr9.   I've manually fixed the file linking to the proper directories, however one plugin is no longer shipped.   Since the solr files aren't updated yet to 9, can anyone tell me if I need the discontinued ve

Re: Matching Addresses in Sieve

2022-09-30 Thread Shawn Heisey
On 9/30/22 15:14, Doug Hardie wrote: I have an email with the following header line: From: 'Thank you!Kohls' I am trying to match that with: if address :contains "from" "Thank you!Kohls" { addflag "\\Seen"; fileinto "Junk"; stop; } However, the matching portion of t

Re: Dovecot does not start on MacOS Monterey

2022-10-28 Thread Shawn Heisey
On 10/26/22 04:27, Doro Rose wrote: Thanks for the quick response! No. If I set default_vsz_limit to 0 it works. My understanding was that this shouldn't be necessary in the first place, shouldn't it? Most systems and software do not limit the virtual memory size. This is because virtual memo

Re: how to configure imapsieve to be used per user

2022-10-28 Thread Shawn Heisey
On 10/17/22 04:46, Marc wrote: I only see configurations that are active for all users, how to configure this in the user sieve rules. I only need this for specific users. I have a working setup where every user can have their own sieve rules and manage them with managesieve, which I think is

Re: Dovecot does not start on MacOS Monterey

2022-10-30 Thread Shawn Heisey
On 10/30/22 07:24, Doro Rose wrote: Thanks for the explanation. In the other thread it was mentioned that the only setting that works with this problem is setting default_vsz_limit to 0 which sounds like the lowest limit possible. A setting of 0 tells dovecot to not set a limit, at which poin

Re: Dovecot 2.2 to 2.3 migration

2022-11-17 Thread Shawn Heisey
On 11/15/22 03:29, Markus Wienhöfer wrote: we are currently using Dovecot 2.2 (from the Ubuntu 18.04 repos) and would like to migrate to 2.3 I have read the migration documentation regarding the configuration changes. Apart from that, is it feasible/possible to change from Ubuntu to official

Re: Dovecot 2.2 to 2.3 migration

2022-11-17 Thread Shawn Heisey
On 11/17/22 09:28, Oscar del Rio wrote: I believe there is no Dovecot APT repo for Ubuntu 22 (yet) https://repo.dovecot.org/ Very true.  I believe I read somewhere that there will not be a Dovecot 2.3 repo for jammy, but there will be one for 2.4 when it is released. Thanks, Shawn

Re: Backups and disaster recovery

2022-12-03 Thread Shawn Heisey
On 12/3/22 16:02, GDS wrote: After reading some of the past threads on backups, I was wondering if I could get a sanity check... I run a Maildir configuration for a small (10 mailboxes) mail server. Using "/doveadm backup"/, for each mailbox I do: - Weekly full backups and then copy the files

Re: Backups and disaster recovery

2022-12-04 Thread Shawn Heisey
On 12/3/22 20:16, Sam Kuper wrote: You might want to consider using ZFS. Bystander reply: I do like ZFS.  There are two reasons that I chose btrfs for my deployment: 1) License incompatibilities with ZFS and Linux.  These don't affect end users, but the situation is a little murky if you try

Re: sasl service for other app

2022-12-08 Thread Shawn Heisey
On 12/7/22 21:53, Henry R wrote: can dovecot run as a general sasl service for other apps? such as webdav. I am using dovecot to provide authentication for postfix submission.  This is the config in postfix: smtpd_sasl_type = dovecot # Referring to /var/spool/postfix/private/auth smtpd_sasl_

Re: Backups

2022-12-11 Thread Shawn Heisey
On 12/11/22 01:42, John Tulp wrote: sorry, no clue. i did find this link quickly... https://doc.dovecot.org/configuration_manual/quota/ looks like the following section near the bottom of page may apply ? "Maximum Saved Mail Size" I was looking into this on my server.  My config has the 100

Re: mail filters

2022-12-19 Thread Shawn Heisey
On 12/18/22 20:59, mick.crane wrote: On 2022-12-13 00:42, John Stoffel wrote: Maybe you're filtering the wrong way? I use something like this and it's pretty good:    require ["fileinto", "envelope"];    require "imap4flags";    require "regex";    if header :contains "Sender" "linux-kerne

Re: mail filters

2022-12-19 Thread Shawn Heisey
On 12/19/22 11:08, mick.crane wrote: On 2022-12-19 16:07, Shawn Heisey wrote: I actually have a filter for exactly that purpose: https://www.dropbox.com/s/5alqcawio2e1vki/roundcube_managesieve_lkml.png?dl=0 I should experiment further then to see what filters actually do. "stop evalu

2.4 ballpark release date?

2023-01-17 Thread Shawn Heisey
I'm wondering whether there is a ballpark release date for Dovecot 2.4. I know an exact release date is probably not available, but can it at least be narrowed to a specific quarter? Is it likely in 2023? I have seen on previous messages that an Ubuntu repository for 22.04 (jammy) will appear

Re: iPhone Mail clients generate high Solr I/O

2023-03-21 Thread Shawn Heisey
On 3/20/23 09:52, Alessio Cecchi wrote: I'm running a mail server with Dovecot 2.3.20 and Apache Solr as FTS backend. It seems that iPhone/iPad Mail clients are generating some IMAP searches, especially on header Message-ID, that are increasing our Solr I/O load, especially during the night.

Re: ot: how to t/s TBird problems ?

2023-03-21 Thread Shawn Heisey
On 3/21/23 07:27, Christopher Wensink wrote: Jim, can you explain the format of the Date header, what each digit should represent? Chris A date value that's a big number like that is "seconds since epoch". The epoch is 1970-01-01 00:00:00 UTC. This is a common way of telling time on POSI

Re: Error: /proc/self/status is larger than expected

2023-03-22 Thread Shawn Heisey
On 3/20/23 21:29, Elisamuel Resto Donate wrote: Hello, I don't know what the error means or how to get rid of it. But in the replies, I do see something that might indicate a misunderstanding of how /proc works. Every pid will be getting a different file than another pid when it accesses t

Re: 2.4 ballpark release date?

2023-04-30 Thread Shawn Heisey
On 1/17/23 14:04, Shawn Heisey wrote: I'm wondering whether there is a ballpark release date for Dovecot 2.4. I know an exact release date is probably not available, but can it at least be narrowed to a specific quarter?  Is it likely in 2023? I have seen on previous messages that an U

Re: fts crash

2023-05-20 Thread Shawn Heisey
On 5/20/23 00:13, Przemysław Kwiatkowski via dovecot wrote: I started full reindex of whole emails base (doveadm index -A '*') and solr crashed due to out of memory. I had plenty of such messages: If you are seeing Java's "OutOfMemoryError" exception, you must figure out what resource was depl

Re: Dovecot reposting inactivity as auth failed

2023-06-17 Thread Shawn Heisey
On 6/16/23 10:53, pe...@netsecpt.pt wrote: Hi , i am having an issue with dovecot , in log files of imap inactivity lines have the word included "auth failed" , witch is not true , what happens next is that fail2ban is looking for that word too in log file of dovecot ,and when it finds it it b

Re: Dovecot reposting inactivity as auth failed

2023-06-19 Thread Shawn Heisey
On 6/19/2023 2:21 PM, pe...@netsecpt.pt wrote: I am not using custom rules for fail2ban , in fact my fail2ban is using the default settings , i do not have that file zzz-custom in that directory however jail.conf is using the default jail time for every filter , witch is : I created the zz-cu

Re: Dovecot reposting inactivity as auth failed

2023-06-19 Thread Shawn Heisey
On 6/19/2023 10:52 PM, Shawn Heisey wrote: Interesting.  In the 2.3.20 tag, I found the code that prints that message in src/login-common/client-common.c ... but that same code is not present in the main branch.  It looks to me like that code has been completely overhauled and maybe 2.4 won&#

Re: Motion for OCSP Support in Dovecot

2023-07-11 Thread Shawn Heisey
On 7/10/23 21:47, Sean Gallagher wrote: While I am always for security improvements, the utility of this unclear. I will ABSTAIN from this poll. Presently, any system administrator who intends to issue must-staple certificates, faces the dilemma to either chose to a) Refrain from issuing mus

Re: DOvecot requires both IPv4 and IPV6 to start

2023-09-04 Thread Shawn Heisey
On 9/4/23 12:36, Michael Peddemors wrote: However, I 'get' this persons' opinion, from a developers perspective. The system should either run, or provide a clear reason why it didn't startup (that reason could be .. You have selected * but IPv6 is not available). Doesn't really matter what the

Re: DOvecot requires both IPv4 and IPV6 to start

2023-09-04 Thread Shawn Heisey
On 9/4/23 13:42, TWHG Technical via dovecot wrote: I believe it really would be good practice to fallback to IPV4 only listeners if IPV6 listener fails. Rather than crash out. On my previous reply, I had not yet read the other messages. They were part of another thread in Thunderbird that I

[offtopic] Re: DOvecot requires both IPv4 and IPV6 to start

2023-09-04 Thread Shawn Heisey
On 9/4/23 15:40, Arjen de Korte wrote: Citeren Shawn Heisey : An interesting read: https://cr.yp.to/djbdns/ipv6mess.html FUD. This document was written something like two decades ago and pretty much all arguments against IPv6 are no longer relevant anymore. In most cases nowadays, the

  1   2   >