Re: Log sync error

2018-12-10 Thread Jakobus Schürz

Am 11.09.18 um 21:19 schrieb Jakobus Schürz:
> Hi there!
>
> I get a lot of errormessages. My dovecot is: dovecot-core
> 2:2.3.2.1-1~stretch from Debian stable.
>
> I found this: https://www.dovecot.org/list/dovecot/2013-July/091648.html
>
> So the bug came back...
>

This Problem was also solved, when i solved the problem, that dovecot
marked every mail as \Recent and Unseen which was moving to another mailbox.
The solution was i my case:

Removing the INDEXPVT from mail_location

mail_location = 
maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:INDEXPVT=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u

so that it looked like

mail_location = 
maildir:/var/mail/%u/Maildir:LAYOUT=fs:INDEX=/var/lib/dovecot/db/indexes/Maildir/%u:CONTROL=/var/lib/dovecot/db/control/Maildir/%u

This is for completeness.


BR

Jakob




Re: Replication Error - Trying to Interate Users

2018-12-10 Thread Aki Tuomi


On 11.12.2018 9.13, Antonino Sidoti wrote:
> HI,
>
> My first post to this list;
>
> I am trying to configure replication between two host, both hosts are
> having the same errors. Using ‘dovecot log errors’ gives the following
> errors;
>
> Dec 11 18:05:12 Error: auth: Trying to iterate users, but userdbs
> don't support it (created 0 msecs ago, handshake 0 msecs ago)
> Dec 11 18:05:12 Error: replicator: User listing returned failure
> Dec 11 18:05:12 Error: replicator: listing users failed, can't
> replicate existing data
>
> My version of Dovecot version = 2.2.36
>
> My Configuration is attached.
>
>
>
> Any help is greatly appreciated. Thanks


Static userdb cannot be used for iteration, use


userdb  {

  driver = passwd-file

  args = /etc/mail/passwd

}


and configure

mail_home=/var/mail/%d/%n

mail_uid=vmail

mail_gid=vmail


Aki



Replication Error - Trying to Interate Users

2018-12-10 Thread Antonino Sidoti
HI,My first post to this list;I am trying to configure replication between two host, both hosts are having the same errors. Using ‘dovecot log errors’ gives the following errors;Dec 11 18:05:12 Error: auth: Trying to iterate users, but userdbs don't support it (created 0 msecs ago, handshake 0 msecs ago)Dec 11 18:05:12 Error: replicator: User listing returned failureDec 11 18:05:12 Error: replicator: listing users failed, can't replicate existing dataMy version of Dovecot version = 2.2.36My Configuration is attached.# 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf
# OS: OpenBSD 6.4 amd64  
# Hostname: obsd-mail1.sidoti.local
doveadm_password =  # hidden, use -P to show it
doveadm_port = 2727
hostname = mail.sidoti.id.au
listen = *
mail_location = maildir:~/Maildir
mail_plugins = " notify replication"
namespace inbox {
  inbox = yes
  location = 
  mailbox "Deleted Messages" {
special_use = \Trash
  }
  mailbox Drafts {
special_use = \Drafts
  }
  mailbox Junk {
special_use = \Junk
  }
  mailbox Sent {
special_use = \Sent
  }
  mailbox "Sent Messages" {
special_use = \Sent
  }
  mailbox Trash {
special_use = \Trash
  }
  prefix = 
}
passdb {
  args = scheme=BLF-CRYPT /etc/mail/passwd
  driver = passwd-file
}
plugin {
  mail_replica = tcp:207.148.115.175:2727
}
protocols = imap lmtp
service aggregator {
  fifo_listener replication-notify-fifo {
user = vmail
  }
  unix_listener replication-notify {
user = vmail
  }
}
service doveadm {
  inet_listener {
port = 2727
  }
}
service imap-login {
  inet_listener imap {
port = 0
  }
  inet_listener imaps {
port = 993
ssl = yes
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
mode = 0600
  }
}
ssl = required
ssl_cert = Any help is greatly appreciated. Thanks

Re: Solr

2018-12-10 Thread Joan Moreau via dovecot
Additionally, here the errors I get in logs: 

Dovecot: 


Dec 09 09:21:09 imap(j...@grosjo.net)<3349>: Error:
fts_solr: received invalid uid '0'
Dec 09 09:21:10 imap(j...@grosjo.net)<3349>: Error:
fts_solr: received invalid uid '0' 

or 


11 03:36:03
indexer-worker(j...@grosjo.net)<2093>:
Error: fts_solr: Indexing failed: 500 Server Error 

Solr: 


CAUSED BY: ORG.APACHE.LUCENE.STORE.ALREADYCLOSEDEXCEPTION: THIS
INDEXWRITER IS CLOSED
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:679)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:693)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4929)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:290)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:279)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:235)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2039)
Dec 11 06:00:14 gjserver solr[16761]: ... 51 more
DEC 11 06:00:14 GJSERVER SOLR[16761]: CAUSED BY:
JAVA.LANG.ARRAYINDEXOUTOFBOUNDSEXCEPTION: -65536
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.TermsHashPerField.writeByte(TermsHashPerField.java:198)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.TermsHashPerField.writeVInt(TermsHashPerField.java:224)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.FreqProxTermsWriterPerField.writeProx(FreqProxTermsWriterPerField.java:80)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.FreqProxTermsWriterPerField.addTerm(FreqProxTermsWriterPerField.java:184)
Dec 11 06:00:14 gjserver solr[16761]: at
org.apache.lucene.index.TermsHashPerField.add(TermsHashPerField.java:185)


On 2018-12-10 21:40, Joan Moreau wrote:

Hi Daniel, 

THere is no need of all this, just the command (on Solr 7.5) "create -c dovecot " is enough 

The chema.xml provided on the wiki basically does not work on 7.5 

Here the latest one I am working on , but nothing works properly (bad search results, errors in ftp_solr, etc..) 




id








 








 























 


On 2018-12-10 21:17, Daniel Miller via dovecot wrote: On 12/4/2018 10:40 AM, 
Joan Moreau via dovecot wrote:

In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would nice to stipulate to the reader  to type the command : 

sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the dovecot instance 

before updating the schema.xml . 

Also,  schema.xml is in /opt/solr/server/solr/dovecot/conf for archlinux users 


Additionaly, the url is http://(solr_ [1]server):8983/solr/dovecot/ (error in 
wiki)

After installing Solr, wherever the installation sets up there should a folder similar to: 

/solr/server/solr/configsets 

If you look there, you'll probably see folders like '_default' and 'sample_techproducts_configs'.  I haven't played with the 'techproducts' sample.  Copy the '_default' folder, with all its contents, to a 'dovecot' folder.  In the new dovecot folder, replace the 'managed-schema' file with the file from the Dovecot Wiki 

https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile=view=solr-7.x-schema.xml 

after that, you should be able to run 'solr /opt/solr/bin/solr create -c dovecot' to create the instance.  If things still don't work let us know. 


The schema is one I've tweaked and updated during my own migrations since Solr 
3.3.  It's possible there's something else in my config that needs documenting 
- but having experienced Solr search against my mailstore I never want to be 
without it.

Daniel



Links:
--
[1] http://(solr

Re: Indexer worker small bug

2018-12-10 Thread André Rodier via dovecot

On 2018-12-10 14:12, André via dovecot wrote:

Hello Timo,

I will try this evening.

Kind regards,
André.

On 10 December 2018 07:56:26 GMT+00:00, Timo Sirainen  
wrote:

On 10 Dec 2018, at 7.50, André Rodier  wrote:


On 2018-12-09 23:13, Timo Sirainen wrote:

On 9 Dec 2018, at 16.44, André Rodier via dovecot

 wrote:

Hello,
I think I submitted this before, but I am not sure this has been

addressed

I am using AppArmor with Dovecot, without any issue.
However, I think there is a bug in the indexer working, from what I

can see, a missing trailing slash. See:


Dec 09 14:35:53 portal2 kernel: audit: type=1400

audit(1544366153.379:3035): apparmor="DENIED" operation="file_mmap"
info="Failed name lookup - disconnected path" error=-13
profile="/usr/lib/dovecot/indexer-worker" name="var/cache/nscd/hosts"
pid=10540 comm="indexer-worker" requested_mask="r" denied_mask="r"
fsuid=1001 ouid=0


The indexer worker is trying to open the file

"var/cache/nscd/hosts" instead of "/var/cache/nscd/hosts", which of
course fails.

Can someone double check the code of the indexer worker, or this

has been fixed?

Dovecot is definitely not trying to open that file itself. It has to
be libc or some other library. I also can't think of anything

special

in indexer-worker compared to other Dovecot binaries that could

cause

this. What's your doveconf -n?


You are probably right, I will continue to investigate on my side.
My configuration is attached.


Does it make a difference if you use "127.0.0.1" instead of 
"localhost"

in fts_solr setting?


Sorry for the top-posting.

Same error, with 127.0.0.1.

However, if I disable the nscd cache in nscd.conf, the error does not 
happen any more.


I have downloaded the source code (glibc, if I understand correctly), 
but I have not yet found the cause.


Kind regards,
André


Re: Solr

2018-12-10 Thread Daniel Miller via dovecot
The one on the Wiki is mine...which I'm using now.  So it certainly does 
work - but perhaps there's a setting you have differently from me.


Performing a "create -c dovecot" creates a Solr instance *named* dovecot 
- that does *not* initialize it with the necessary schema.  You need to 
specify "-d dovecot", with a dovecot configset already setup, to do that.


The other choice is to create the instance as you show, ensure Solr is 
stopped, delete the "/solr/dovecot/data" folder, and copy the 
managed-schema file to "/solr/dovecot/conf".  Again, the 
filename saved in the /conf folder needs to be "managed-schema" - no 
".xml" suffix.


If that doesn't work for you - please share the errors.

Daniel

On 12/10/2018 11:40 AM, Joan Moreau wrote:


Hi Daniel,

THere is no need of all this, just the command (on Solr 7.5) "create 
-c dovecot " is enough


The chema.xml provided on the wiki basically does not work on 7.5


Here the latest one I am working on , but nothing works properly (bad 
search results, errors in ftp_solr, etc..)





id


positionIncrementGap="0" />
autoGeneratePhraseQueries="true" positionIncrementGap="100">



ignoreCase="true"/>
generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" 
splitOnNumerics="1" catenateWords="1" catenateNumbers="1" 
catenateAll="1"/>
 


maxGramSize="15" />
protected="protwords.txt"/>





ignoreCase="true" synonyms="synonyms.txt"/>
 
ignoreCase="true"/>
generateWordParts="1" generateNumberParts="1" splitOnCaseChange="1" 
splitOnNumerics="1" catenateWords="1" catenateNumbers="1" 
catenateAll="1"/>


maxGramSize="15" />
protected="protwords.txt"/>









stored="true"/>




stored="true"/>



stored="true"/>
stored="true"/>






On 2018-12-10 21:17, Daniel Miller via dovecot wrote:


On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote:


In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would 
nice to stipulate to the reader  to type the command :


sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the 
dovecot instance


before updating the schema.xml .

Also,  schema.xml is in /opt/solr/server/solr/dovecot/conf for 
archlinux users


Additionaly, the url is http://(solr_ 
server):8983/solr/dovecot/ (error in wiki)


After installing Solr, wherever the installation sets up there should 
a folder similar to:


/solr/server/solr/configsets

If you look there, you'll probably see folders like '_default' and 
'sample_techproducts_configs'.  I haven't played with the 
'techproducts' sample.  Copy the '_default' folder, with all its 
contents, to a 'dovecot' folder.  In the new dovecot folder, replace 
the 'managed-schema' file with the file from the Dovecot Wiki


https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile=view=solr-7.x-schema.xml

after that, you should be able to run 'solr /opt/solr/bin/solr create 
-c dovecot' to create the instance. If things still don't work let us 
know.


The schema is one I've tweaked and updated during my own migrations 
since Solr 3.3.  It's possible there's something else in my config 
that needs documenting - but having experienced Solr search against 
my mailstore I never want to be without it.


Daniel



Re: QUERY string clarification

2018-12-10 Thread Michael Slusarz
> On December 9, 2018 at 3:02 AM Ralf Hildebrandt  
> wrote:
> 
> 
> The manpage
> https://wiki.dovecot.org/Tools/Doveadm/SearchQuery
> specifies:
> 
> BODY string
> Matches messages, which contain string in the body part.
> 
> and a bit further down:
> 
> TEXT string
> Matches messages, which contain string in the message body.
> 
> Where's the difference?

BODY = body part (meaning, the non-header part of the message)
TEXT = entire message (header + body)

michael


Re: Replication fatal error

2018-12-10 Thread Gerald Galster



> Am 10.12.2018 um 19:39 schrieb Aki Tuomi :
> 
> This has been fixed in a later version of Dovecot, so your best course of 
> action is to upgrade to some more recent version. I'd recommend 2.2.36.

There is a replication bug that duplicates mails on deletion via pop3 under 
special circumstances. The last known good version is 2.2.33.2.

See:

https://dovecot.org/list/dovecot/2018-March/111422.html
https://dovecot.org/list/dovecot/2018-September/112945.html

Aki, can you tell if this bug is on your list and will be fixed eventually (as 
it seems to exist in 2.3 tree as well)

Best regards,
Gerald



>> On 10 December 2018 at 18:28 admin via dovecot  wrote:
>> 
>> 
>> Dear suscribers.
>> 
>> I just dont understand this error. Don't know where to look first. If 
>> someone have already meet this problem...
>> 
>> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
>> Panic: file dsync-brain-mailbox.c: line 370 
>> (dsync_brain_sync_mailbox_deinit): assertion failed: (brain->failed)
>> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
>> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xa0112) 
>> [0x7f2c66f62112] -> /usr/lib/dovecot/libdovecot.so.0(+0xa020a) 
>> [0x7f2c66f6220a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) 
>> [0x7f2c66ef21d8] -> 
>> dovecot/doveadm-server(dsync_brain_sync_mailbox_deinit+0x1b0) 
>> [0x5587f89936b0] -> 
>> dovecot/doveadm-server(dsync_brain_slave_recv_mailbox+0x417) 
>> [0x5587f8994447] -> dovecot/doveadm-server(dsync_brain_run+0x286) 
>> [0x5587f8991a86] -> dovecot/doveadm-server(+0x430d9) [0x5587f89920d9] -> 
>> dovecot/doveadm-server(+0x595cf) [0x5587f89a85cf] -> 
>> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
>> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
>> [0x7f2c66f7984e] -> 
>> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
>> [0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
>> [0x7f2c66f783e8] -> dovecot/doveadm-server(+0x27eed) [0x5587f8976eed] -> 
>> dovecot/doveadm-server(+0x298cd) [0x5587f89788cd] -> 
>> dovecot/doveadm-server(+0x3f30b) [0x5587f898e30b] -> 
>> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
>> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
>> [0x7f2c66f7984e] -> 
>> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
>> [0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
>> [0x7f2c66f783e8] -> 
>> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
>> [0x7f2c66efc9f3] -> dovecot/doveadm-server(main+0x1b5) [0x5587f89691c5] 
>> -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) 
>> [0x7f2c66af2b97] -> dovecot/doveadm-server(_start+0x2a) [0x5587f896928a]
>> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
>> Fatal: master: service(doveadm): child 22362 killed with signal 6 (core 
>> dumped)
>> 
>> 
>> server 1 dovecot configuration (version 2.2.9):
>> 
>> default_client_limit = 2048
>> default_process_limit = 2048
>> disable_plaintext_auth = no
>> doveadm_password = xxx
>> doveadm_port = 11225
>> hostname = 
>> listen = 127.0.0.1,XX.XX.XX.XX
>> mail_location = maildir:/srv/mail/%d/%n/Maildir
>> mail_plugins = " notify replication"
>> managesieve_notify_capability = mailto
>> managesieve_sieve_capability = fileinto reject envelope 
>> encoded-character vacation subaddress comparator-i;ascii-numeric 
>> relational regex imap4flags copy include variables body enotify 
>> environment mailbox date ihave
>> namespace inbox {
>>   inbox = yes
>>   location =
>>   mailbox Drafts {
>> auto = subscribe
>> special_use = \Drafts
>>   }
>>   mailbox Junk {
>> auto = subscribe
>> special_use = \Junk
>>   }
>>   mailbox Sent {
>> auto = subscribe
>> special_use = \Sent
>>   }
>>   mailbox "Sent Messages" {
>> special_use = \Sent
>>   }
>>   mailbox Trash {
>> auto = subscribe
>> special_use = \Trash
>>   }
>>   prefix =
>> }
>> passdb {
>>   args = /etc/dovecot/dovecot-sql.conf.ext
>>   driver = sql
>> }
>> plugin {
>>   mail_replica = tcp:x:11225
>>   sieve = ~/.dovecot.sieve
>>   sieve_default = /etc/dovecot/sieve/Ingenie.sieve
>>   sieve_default_name = Ingenie
>>   sieve_dir = ~/sieve
>>   sieve_max_redirects = 0
>>   sieve_vacation_dont_check_recipient = yes
>> }
>> postmaster_address = ad...@ingenie.fr
>> protocols = " imap lmtp sieve pop3"
>> service aggregator {
>>   fifo_listener replication-notify-fifo {
>> user = vmail
>>   }
>>   unix_listener replication-notify {
>> user = vmail
>>   }
>> }
>> service auth {
>>   unix_listener /var/spool/postfix-submission/private/dovecot-auth {
>> group = postfix
>> mode = 0600
>> user = postfix
>>   }
>> }
>> service doveadm {
>>   inet_listener {
>> address = XX.XX.XX.XX
>> port = 11225
>>   }
>>   vsz_limit = 100 M
>> }
>> service lmtp {
>>   inet_listener lmtp {
>> 

Re: Solr

2018-12-10 Thread Joan Moreau via dovecot
Hi Daniel, 


THere is no need of all this, just the command (on Solr 7.5) "create -c
dovecot " is enough 

The chema.xml provided on the wiki basically does not work on 7.5 


Here the latest one I am working on , but nothing works properly (bad
search results, errors in ftp_solr, etc..) 




id








 








 























 


On 2018-12-10 21:17, Daniel Miller via dovecot wrote:


On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote:

In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would nice to stipulate to the reader  to type the command : 

sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the dovecot instance 

before updating the schema.xml . 

Also,  schema.xml is in /opt/solr/server/solr/dovecot/conf for archlinux users 


Additionaly, the url is http://(solr_ [1]server):8983/solr/dovecot/ (error in 
wiki)


After installing Solr, wherever the installation sets up there should a folder similar to: 

/solr/server/solr/configsets 

If you look there, you'll probably see folders like '_default' and 'sample_techproducts_configs'.  I haven't played with the 'techproducts' sample.  Copy the '_default' folder, with all its contents, to a 'dovecot' folder.  In the new dovecot folder, replace the 'managed-schema' file with the file from the Dovecot Wiki 

https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile=view=solr-7.x-schema.xml 

after that, you should be able to run 'solr /opt/solr/bin/solr create -c dovecot' to create the instance.  If things still don't work let us know. 


The schema is one I've tweaked and updated during my own migrations since Solr 
3.3.  It's possible there's something else in my config that needs documenting 
- but having experienced Solr search against my mailstore I never want to be 
without it.

Daniel



Links:
--
[1] http://(solr

Re: Solr

2018-12-10 Thread Daniel Miller via dovecot

On 12/4/2018 10:40 AM, Joan Moreau via dovecot wrote:


In the Wiki, ( https://wiki.dovecot.org/Plugins/FTS/Solr ), it would 
nice to stipulate to the reader  to type the command :


sudo -u solr /opt/solr/bin/solr create -c dovecot # to create the 
dovecot instance


before updating the schema.xml .

Also,  schema.xml is in /opt/solr/server/solr/dovecot/conf for 
archlinux users


Additionaly, the url is http://(solr_ 
server):8983/solr/dovecot/ (error in wiki)


After installing Solr, wherever the installation sets up there should a 
folder similar to:


/solr/server/solr/configsets

If you look there, you'll probably see folders like '_default' and 
'sample_techproducts_configs'.  I haven't played with the 'techproducts' 
sample.  Copy the '_default' folder, with all its contents, to a 
'dovecot' folder.  In the new dovecot folder, replace the 
'managed-schema' file with the file from the Dovecot Wiki


https://wiki.dovecot.org/Plugins/FTS/Solr?action=AttachFile=view=solr-7.x-schema.xml

after that, you should be able to run 'solr /opt/solr/bin/solr create -c 
dovecot' to create the instance.  If things still don't work let us know.


The schema is one I've tweaked and updated during my own migrations 
since Solr 3.3.  It's possible there's something else in my config that 
needs documenting - but having experienced Solr search against my 
mailstore I never want to be without it.


Daniel



Re: Replication fatal error

2018-12-10 Thread Aki Tuomi
This has been fixed in a later version of Dovecot, so your best course of 
action is to upgrade to some more recent version. I'd recommend 2.2.36.

Aki

> On 10 December 2018 at 18:28 admin via dovecot  wrote:
> 
> 
> Dear suscribers.
> 
> I just dont understand this error. Don't know where to look first. If 
> someone have already meet this problem...
> 
> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
> Panic: file dsync-brain-mailbox.c: line 370 
> (dsync_brain_sync_mailbox_deinit): assertion failed: (brain->failed)
> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xa0112) 
> [0x7f2c66f62112] -> /usr/lib/dovecot/libdovecot.so.0(+0xa020a) 
> [0x7f2c66f6220a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) 
> [0x7f2c66ef21d8] -> 
> dovecot/doveadm-server(dsync_brain_sync_mailbox_deinit+0x1b0) 
> [0x5587f89936b0] -> 
> dovecot/doveadm-server(dsync_brain_slave_recv_mailbox+0x417) 
> [0x5587f8994447] -> dovecot/doveadm-server(dsync_brain_run+0x286) 
> [0x5587f8991a86] -> dovecot/doveadm-server(+0x430d9) [0x5587f89920d9] -> 
> dovecot/doveadm-server(+0x595cf) [0x5587f89a85cf] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
> [0x7f2c66f7984e] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
> [0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
> [0x7f2c66f783e8] -> dovecot/doveadm-server(+0x27eed) [0x5587f8976eed] -> 
> dovecot/doveadm-server(+0x298cd) [0x5587f89788cd] -> 
> dovecot/doveadm-server(+0x3f30b) [0x5587f898e30b] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
> [0x7f2c66f7984e] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
> [0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
> [0x7f2c66f783e8] -> 
> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
> [0x7f2c66efc9f3] -> dovecot/doveadm-server(main+0x1b5) [0x5587f89691c5] 
> -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) 
> [0x7f2c66af2b97] -> dovecot/doveadm-server(_start+0x2a) [0x5587f896928a]
> Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
> Fatal: master: service(doveadm): child 22362 killed with signal 6 (core 
> dumped)
> 
> 
> server 1 dovecot configuration (version 2.2.9):
> 
> default_client_limit = 2048
> default_process_limit = 2048
> disable_plaintext_auth = no
> doveadm_password = xxx
> doveadm_port = 11225
> hostname = 
> listen = 127.0.0.1,XX.XX.XX.XX
> mail_location = maildir:/srv/mail/%d/%n/Maildir
> mail_plugins = " notify replication"
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope 
> encoded-character vacation subaddress comparator-i;ascii-numeric 
> relational regex imap4flags copy include variables body enotify 
> environment mailbox date ihave
> namespace inbox {
>    inbox = yes
>    location =
>    mailbox Drafts {
>      auto = subscribe
>      special_use = \Drafts
>    }
>    mailbox Junk {
>      auto = subscribe
>      special_use = \Junk
>    }
>    mailbox Sent {
>      auto = subscribe
>      special_use = \Sent
>    }
>    mailbox "Sent Messages" {
>      special_use = \Sent
>    }
>    mailbox Trash {
>      auto = subscribe
>      special_use = \Trash
>    }
>    prefix =
> }
> passdb {
>    args = /etc/dovecot/dovecot-sql.conf.ext
>    driver = sql
> }
> plugin {
>    mail_replica = tcp:x:11225
>    sieve = ~/.dovecot.sieve
>    sieve_default = /etc/dovecot/sieve/Ingenie.sieve
>    sieve_default_name = Ingenie
>    sieve_dir = ~/sieve
>    sieve_max_redirects = 0
>    sieve_vacation_dont_check_recipient = yes
> }
> postmaster_address = ad...@ingenie.fr
> protocols = " imap lmtp sieve pop3"
> service aggregator {
>    fifo_listener replication-notify-fifo {
>      user = vmail
>    }
>    unix_listener replication-notify {
>      user = vmail
>    }
> }
> service auth {
>    unix_listener /var/spool/postfix-submission/private/dovecot-auth {
>      group = postfix
>      mode = 0600
>      user = postfix
>    }
> }
> service doveadm {
>    inet_listener {
>      address = XX.XX.XX.XX
>      port = 11225
>    }
>    vsz_limit = 100 M
> }
> service lmtp {
>    inet_listener lmtp {
>      address = 127.0.0.1
>      port = 11125
>    }
> }
> service replicator {
>    process_min_avail = 1
>    unix_listener replicator-doveadm {
>      group = vmail
>      mode = 0600
>      user = vmail
>    }
> }
> ssl_ca =  ssl_cert =  ssl_key =  submission_host = 127.0.0.1:10025
> userdb {
>    driver = prefetch
> }
> userdb {
>    args = /etc/dovecot/dovecot-sql.conf.ext
>    driver = sql
> }
> protocol lmtp {
>    mail_plugins = " sieve"
> }
> protocol imap {
>    mail_max_userip_connections = 500
> }
> protocol sieve {
>    

Replication fatal error

2018-12-10 Thread admin via dovecot

Dear suscribers.

I just dont understand this error. Don't know where to look first. If 
someone have already meet this problem...


Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
Panic: file dsync-brain-mailbox.c: line 370 
(dsync_brain_sync_mailbox_deinit): assertion failed: (brain->failed)
Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xa0112) 
[0x7f2c66f62112] -> /usr/lib/dovecot/libdovecot.so.0(+0xa020a) 
[0x7f2c66f6220a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) 
[0x7f2c66ef21d8] -> 
dovecot/doveadm-server(dsync_brain_sync_mailbox_deinit+0x1b0) 
[0x5587f89936b0] -> 
dovecot/doveadm-server(dsync_brain_slave_recv_mailbox+0x417) 
[0x5587f8994447] -> dovecot/doveadm-server(dsync_brain_run+0x286) 
[0x5587f8991a86] -> dovecot/doveadm-server(+0x430d9) [0x5587f89920d9] -> 
dovecot/doveadm-server(+0x595cf) [0x5587f89a85cf] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
-> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
[0x7f2c66f7984e] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
[0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
[0x7f2c66f783e8] -> dovecot/doveadm-server(+0x27eed) [0x5587f8976eed] -> 
dovecot/doveadm-server(+0x298cd) [0x5587f89788cd] -> 
dovecot/doveadm-server(+0x3f30b) [0x5587f898e30b] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f2c66f781a2] 
-> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) 
[0x7f2c66f7984e] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) 
[0x7f2c66f78236] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) 
[0x7f2c66f783e8] -> 
/usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
[0x7f2c66efc9f3] -> dovecot/doveadm-server(main+0x1b5) [0x5587f89691c5] 
-> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) 
[0x7f2c66af2b97] -> dovecot/doveadm-server(_start+0x2a) [0x5587f896928a]
Dec 10 16:06:17 prudence dovecot: dsync-server(addr...@domain.fr): 
Fatal: master: service(doveadm): child 22362 killed with signal 6 (core 
dumped)



server 1 dovecot configuration (version 2.2.9):

default_client_limit = 2048
default_process_limit = 2048
disable_plaintext_auth = no
doveadm_password = xxx
doveadm_port = 11225
hostname = 
listen = 127.0.0.1,XX.XX.XX.XX
mail_location = maildir:/srv/mail/%d/%n/Maildir
mail_plugins = " notify replication"
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex imap4flags copy include variables body enotify 
environment mailbox date ihave

namespace inbox {
  inbox = yes
  location =
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox Junk {
    auto = subscribe
    special_use = \Junk
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Trash {
    auto = subscribe
    special_use = \Trash
  }
  prefix =
}
passdb {
  args = /etc/dovecot/dovecot-sql.conf.ext
  driver = sql
}
plugin {
  mail_replica = tcp:x:11225
  sieve = ~/.dovecot.sieve
  sieve_default = /etc/dovecot/sieve/Ingenie.sieve
  sieve_default_name = Ingenie
  sieve_dir = ~/sieve
  sieve_max_redirects = 0
  sieve_vacation_dont_check_recipient = yes
}
postmaster_address = ad...@ingenie.fr
protocols = " imap lmtp sieve pop3"
service aggregator {
  fifo_listener replication-notify-fifo {
    user = vmail
  }
  unix_listener replication-notify {
    user = vmail
  }
}
service auth {
  unix_listener /var/spool/postfix-submission/private/dovecot-auth {
    group = postfix
    mode = 0600
    user = postfix
  }
}
service doveadm {
  inet_listener {
    address = XX.XX.XX.XX
    port = 11225
  }
  vsz_limit = 100 M
}
service lmtp {
  inet_listener lmtp {
    address = 127.0.0.1
    port = 11125
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
    group = vmail
    mode = 0600
    user = vmail
  }
}
ssl_ca = managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex imap4flags copy include variables body enotify 
environment mailbox date ihave

namespace inbox {
  inbox = yes
  location =
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox Junk {
    auto = subscribe
    autoexpunge = 30 days
    special_use = \Junk
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Trash {
    auto = subscribe
    autoexpunge = 30 days
    special_use = \Trash
  }
  prefix =
}
passdb {
  args = /etc/dovecot/sql.conf
  driver = sql
}
plugin {
  mail_replica = tcp::11225
  sieve = ~/.dovecot.sieve
  sieve_default = /etc/dovecot/sieve/Ingenie.sieve
  

Re: replication dropped imap flags

2018-12-10 Thread Patrick Cernko

Hi list, hi devs,

On 26.11.18 16:26, Patrick Cernko wrote:

Hi list,

I think, I found a bug in the replication setup, that drops (custom) 
flags like Thunderbird labels. I have set up a simple 2 node setup to 
reproduce and explain it:


Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n 
attached) have dovecot-imapd (from repo.dovecot.org) installed on an 
ext4 filesystem. They only have one account "test" via 
/etc/dovecot/userdb ("test:testpassword:::Test User::/bin/bash:"). It's 
mailbox contains one message, that is flagged with "$label1":


doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d5a350039 flags=\Recent $label1

Now I simulate a node reinstall on adove by uninstalling dovecot, 
removing all remnants, reinstalling and configuring it again:


apt purge dovecot-core dovecot-imapd
rm -rf /var/vmail /var/lib/dovecot /etc/dovecot
apt install dovecot-imapd
# disable system auth
: > /etc/dovecot/conf.d/auth-system.conf.ext
# create /var/vmail
install -d -o nobody -g nogroup -m 700 /var/vmail
# create userdb
echo 'test:testpassword:::Test User::/bin/bash:' > /etc/dovecot/userdb
# create /etc/dovecot/local.conf
# not described here, the resulting doveconf -n is attached!
service dovecot restart


When I check the flags of the mail of user test now, the "$label1" is 
disapeared on both machines, even after "doveadm replicator replicate -f 
test":


doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d5a350039 flags=\Recent


Any hints what I am doing wrong here or is this really a bug?



it's been 2 weeks now, since my bug(?) report without any 
reactions/answers. I wonder if anyone is working on this already or if 
my report got lost or if I did something wrong on my side.


Regards,
--
Patrick Cernko  +49 681 9325 5815
Joint Administration: Information Services and Technology
Max-Planck-Institute fuer Informatik & Softwaresysteme



smime.p7s
Description: S/MIME Cryptographic Signature


Re: Indexer worker small bug

2018-12-10 Thread André via dovecot
Hello Timo,

I will try this evening.

Kind regards,
André.

On 10 December 2018 07:56:26 GMT+00:00, Timo Sirainen  wrote:
>On 10 Dec 2018, at 7.50, André Rodier  wrote:
>> 
>> On 2018-12-09 23:13, Timo Sirainen wrote:
>>> On 9 Dec 2018, at 16.44, André Rodier via dovecot
> wrote:
 Hello,
 I think I submitted this before, but I am not sure this has been
>addressed
 I am using AppArmor with Dovecot, without any issue.
 However, I think there is a bug in the indexer working, from what I
>can see, a missing trailing slash. See:
 
 Dec 09 14:35:53 portal2 kernel: audit: type=1400
>audit(1544366153.379:3035): apparmor="DENIED" operation="file_mmap"
>info="Failed name lookup - disconnected path" error=-13
>profile="/usr/lib/dovecot/indexer-worker" name="var/cache/nscd/hosts"
>pid=10540 comm="indexer-worker" requested_mask="r" denied_mask="r"
>fsuid=1001 ouid=0
 
 The indexer worker is trying to open the file
>"var/cache/nscd/hosts" instead of "/var/cache/nscd/hosts", which of
>course fails.
 Can someone double check the code of the indexer worker, or this
>has been fixed?
>>> Dovecot is definitely not trying to open that file itself. It has to
>>> be libc or some other library. I also can't think of anything
>special
>>> in indexer-worker compared to other Dovecot binaries that could
>cause
>>> this. What's your doveconf -n?
>> 
>> You are probably right, I will continue to investigate on my side.
>> My configuration is attached.
>
>Does it make a difference if you use "127.0.0.1" instead of "localhost"
>in fts_solr setting?

-- 
André