Re: Frequent Out of Memory for service(config)

2019-06-05 Thread Root Kev via dovecot
Hello Aki + group.

The following is the latest dump output that I have. Does this give any
indication of what is wrong?  I am not sure what this is really showing
me...

# coredumpctl gdb -1
   PID: 14432 (config)
   UID: 0 (root)
   GID: 0 (root)
Signal: 6 (ABRT)
 Timestamp: Wed 2019-06-05 13:25:32 UTC (4h 52min ago)
  Command Line: dovecot-Pop3 Mail Service/config
Executable: /usr/libexec/dovecot/config
 Control Group: /system.slice/dovecot.service
  Unit: dovecot.service
 Slice: system.slice
   Boot ID: 9ae422871a814d699f5feb4ca52d3b69
Machine ID: 05cb8c7b39fe0f70e3ce97e5beab809d
  Hostname: <*REMOVED**>
  Coredump:
/var/lib/systemd/coredump/core.config.0.9ae422871a814d699f5feb4ca52d3b69.14432.155974113200.xz
   Message: Process 14432 (config) of user 0 dumped core.

Stack trace of thread 14432:
#0  0x7fd25a809207 raise (libc.so.6)
#1  0x7fd25a80a8f8 abort (libc.so.6)
#2  0x7fd25ac79567 fatal_handler_real (libdovecot.so.0)
#3  0x7fd25ac79651 i_internal_fatal_handler
(libdovecot.so.0)
#4  0x7fd25abdf2d9 i_fatal_status (libdovecot.so.0)
#5  0x7fd25ac9b900 pool_system_malloc (libdovecot.so.0)
#6  0x7fd25aca220a o_stream_grow_buffer
(libdovecot.so.0)
#7  0x7fd25aca2506 o_stream_add (libdovecot.so.0)
#8  0x7fd25aca3388 o_stream_file_sendv (libdovecot.so.0)
#9  0x7fd25aca03f5 o_stream_sendv_int (libdovecot.so.0)
#10 0x7fd25aca0a5c o_stream_nsendv (libdovecot.so.0)
#11 0x7fd25aca0aca o_stream_nsend (libdovecot.so.0)
#12 0x556e753617dc config_connection_input (config)
#13 0x7fd25ac91e0f io_loop_call_io (libdovecot.so.0)
#14 0x7fd25ac9384b io_loop_handler_run_internal
(libdovecot.so.0)
#15 0x7fd25ac91f16 io_loop_handler_run (libdovecot.so.0)
#16 0x7fd25ac92138 io_loop_run (libdovecot.so.0)
#17 0x7fd25ac07973 master_service_run (libdovecot.so.0)
#18 0x556e7535edc9 main (config)
#19 0x7fd25a7f53d5 __libc_start_main (libc.so.6)
#20 0x556e7535ee3b _start (config)

GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-114.el7
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
...
Reading symbols from /usr/libexec/dovecot/config...Reading symbols from
/usr/lib/debug/usr/libexec/dovecot/config.debug...done.
done.
[New LWP 14432]
Core was generated by `dovecot-Pop3 Mail Service/config'.
Program terminated with signal 6, Aborted.
#0  0x7fd25a809207 in __GI_raise (sig=sig@entry=6) at
../nptl/sysdeps/unix/sysv/linux/raise.c:55
55return INLINE_SYSCALL (tgkill, 3, pid, selftid, sig);

Thanks,

Kevin

On Wed, May 15, 2019 at 4:34 AM Aki Tuomi 
wrote:

>
> On 13.5.2019 22.56, Root Kev via dovecot wrote:
> > Hello Group,
> >
> > We have dovecot deployed as solely a Pop3 service that is used by our
> > applications to pass mail from one application to another internally.
> > We have roughly 4 applications that connect to the Pop3 service every
> > 2 seconds, to check for new messages and pop them for processing if
> > they are present.  Depending on the site, we have between 1024-2048MB
> > of memory set for default_vsz_limit.  In all systems we see the Out of
> > memory alert several times a day. We previously did not see this at
> > all when running on CentOS6, with less memory.
> >
> > We have tried increasing the memory to the vsz_limit up to 2gb without
> > success.
> >
> > We are running on CentOS 7 servers, running dovecot 2.3.6 (7eab80676)
> > (from the dovecot repo).
> >
> > Can anyone advise any other settings that could be modified in order
> > to correct these out of memory issues?
> >
> > # dovecot -n
> > # 2.3.6 (7eab80676): /etc/dovecot/dovecot.conf
> > # OS: Linux 3.10.0-957.5.1.el7.x86_64 x86_64 CentOS Linux release
> > 7.6.1810 (Core)
> > # Hostname: ** #
> > auth_cache_size = 10 M
> > auth_verbose = yes
> > default_vsz_limit = 1 G
> > instance_name = Pop3 Mail Service
> > listen = 10.*.*.* #
> > log_path = /var/log/dovecot.log
> > login_greeting = Pop3 Mail Service
> > login_trusted_networks = 10.*.*.* 10.*.*.* 10.*.*.* 10.*.*.* 10.*.*.*
> > #
> > mail_location = maildir:~/Maildir
> > namespace inbox {
> >   inbox = yes
> >   location =
> >   mailbox Drafts {
> > special_use = \Drafts
> >   }
> >   

Re: FTS Xapian

2019-06-05 Thread Daniel Miller via dovecot

Logs:

Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_f2857830c70c844e2f1d3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 0 results in 1 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_78544714f3f1ae5b9b0d3bda95b5
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 53 results in 
40 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_bdcb8e2172fadf4db50b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 0 results in 
12 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_be25c00241fedf4de00b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 3 results in 
32 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_a7e75820d9fadf4dd90b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 0 results in 
11 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_6fa78f2738cbdf4d007b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 0 results in 
21 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_6ea78f2738cbdf4d007b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 0 results in 1 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_f2c3522c5d9b9d4f8847e130c744
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 43 results in 
51 ms
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: Opening DB (RO) 
/var/mail/amfes.com/dmiller/sdbox/xapian-indexes/db_58c26f3b9085134fe04b3bc41c5f
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: FLAG=AND
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: Query= 
(subject:"dovecot" OR from:"dovecot" OR to:"dovecot" OR cc:"dovecot" OR 
bcc:"dovecot" OR message-id:"dovecot" OR body:"dovecot")
Jun 5 06:02:25 bubba dovecot: 
imap(dmil...@amfes.com)<25877>: FTS Xapian: 

Fwd: Potfix+Dovecot with dsync replication problem

2019-06-05 Thread Zeljko Dokman via dovecot
Hi,
Any ideas?

Regards

-- Forwarded message -
From: Zeljko Dokman 
Date: Mon, 3 Jun 2019 at 13:14
Subject: Re: Potfix+Dovecot with dsync replication problem
To: 


Hi all,

I am still struggling with this issue.
I scraped my previous configuration and started from beginning.
Thanks to Aki Tuomi and his suggestion I changed the users in my
configurations from vmail --> root and that helped.
Now I have a working replication but with some problems and strange
behavior.
Replication works only when I manually execute a command:

"doveadm sync -A tcp:secundary:server:12345"

Automatic fast and full sync do not work:

doveadm replicator status "*"
username
 priority fast sync full sync success sync failed
zdokman
none 01:46:14  01:46:14  01:46:14 -

doveadm replicator status
Queued 'sync' requests0
Queued 'high' requests0
Queued 'low' requests 0
Queued 'failed' requests  0
Queued 'full resync' requests 0
Waiting 'failed' requests 0
Total number of known users   1

doveadm replicator dsync-status
username
  type status

 -Not connected

maillog has no error entries.
my conf files are attached.

I don't understand why is this happening and how to fix it, any help is
much appreciated.

Best regards,




On Mon, 13 May 2019 at 15:23, Zeljko Dokman  wrote:

> Hi,
> Thank you for your reply Aki.
> I changed my configuration and substituted vmail user with root user.
>
> Now I have no error massages in maillog but replication is not working,
> mails are not visible on second server.
>
> BR
>
>
>
>
>
> On Mon, 13 May 2019 at 10:50, Aki Tuomi 
> wrote:
>
>> Your problem is that you are running service doveadm as vmail, but you
>> are using real uids. You need to start doveadm server as root to be able to
>> switch into the correct target user.
>>
>> Aki
>>
>>
>> On 13.5.2019 11.26, Zeljko Dokman via dovecot wrote:
>>
>> Hi all,
>>
>> Any suggestion?
>>
>> BR
>>
>> On Mon, 6 May 2019 at 14:22, Zeljko Dokman  wrote:
>>
>>> Hi all,
>>>
>>> I am in need of some help.
>>>
>>> Straggling to make something work, trying to configure postfix and
>>> dovecote imap server with dovecote replication.
>>>
>>> Can’t figure out what is wrong with my configuration.
>>>
>>>
>>>
>>> Replication is working only for vmail user account, I am getting this
>>> error on my secondary server  for all other users…
>>>
>>>
>>>
>>> dovecot: doveadm: Fatal: setgid(4015(zdokman) from userdb lookup) failed
>>> with euid=5000(vmail), gid=5000(vmail), egid=5000(vmail): Operation not
>>> permitted (This binary should probably be called with process group set to
>>> 4015(zdokman) instead of 5000(vmail))
>>>
>>>
>>>
>>> primary server reports this error:
>>>
>>>
>>>
>>> dovecot: doveadm(zdokman): Error: doveadm server disconnected before
>>> handshake: EOF
>>>
>>> dovecot: doveadm(zdokman): Error: sync: Disconnected from remote: EOF
>>>
>>>
>>>
>>>
>>>
>>> doveadm replicator status '*'
>>>
>>> username
>>>  priority fast sync full sync success sync failed
>>>
>>> vmail
>>> none 01:58:13  02:05:25  01:58:13 -
>>>
>>> zdokman
>>>  none 00:00:25  02:55:26  -y
>>>
>>> test
>>>   none 00:01:00  21:48:13  -y
>>>
>>>
>>>
>>> doveadm sync *
>>>
>>> doveadm(root): Fatal: execvp(Maildir) failed: Permission denied
>>>
>>> dsync-local(root): Error: read(remote) failed: EOF (version not received)
>>>
>>>
>>>
>>> I am attaching my dovecot.conf main.cf and master.cf.
>>>
>>>
>>>
>>> I think my problem is with permissions  but I can figure out how to
>>> workaround it.
>>>
>>>
>>>
>>> Best regards
>>>
>>
>>
>> --
>>
>>
>>
>>
>>
>>
>
> --
>
>
>
>
>


-- 






--


dovecot.conf
Description: Binary data


main.cf
Description: Binary data


master.cf
Description: Binary data