Re: Plugin virtual, Horde BAD IMAP QRESYNC not enabled

2017-11-14 Thread Michael Slusarz 
Probably better to get the full protocol debug log from the Horde/IMP side.  
Instructions on how to enable that can be found in imp/config/backends.php. See:
https://github.com/horde/imp/blob/master/config/backends.php#L288

rawlog output below only shows what Dovecot is returning - would be more useful 
to see the entire client round-trip transactions however.


> On November 14, 2017 at 4:15 PM Jakob Schürz  
> wrote:
> 
> 
> Hi there!
> 
> I'm new on this list, so hello to all!
> First i want say, that dovecot is a really great mailserver. I use it
> since many years for my private usecase. I'm planning to setup a new
> Mailserver, so i'm fiddeling around to understand dovecot better and get
> a "perfect" Mailserver. (Linux and Win10) Outlook, k9mail and the
> gmail-app on android.
> 
> I want to leave google behind me, so i'm searching for a good server for
> cloudbased  and selfhosted calendar- and addressbook-server.
> On some discussion in debianforum.de i got the hint, to use horde.
> 
> So i installed horde from pear. Got ActiveSync working with the Android
> and Outlook. Mails, Calendar and Addressbook... very fine.
> 
> But then i run into a gotcha.
> 
> There is a problem  with some mails in dovecots virtual mailboxes.
> I tried a lot to find out, how to debug this. First i thought, it's a
> problem from horde, because the problem is only with horde-client.
> 
> Some Emails are not shown in horde. Exactly, they are not shown in horde
> on dovecots virtual mailboxes (plugin virtual in a separate virtual
> namespace)
> If i try to open this email in its original directory, it gets opened
> without any problem.
> 
> So, when i try to open it from within the virtual mailbox, i get this error:
> ---8<--
> Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Panic: file
> index-mail-binary.c: line 586 (index_mail_get_binary_stream): assertion
> failed: (mail->data.stream != NULL)
> Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Error: Raw
> backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x95272) [0x7f671137e272]
> -> /usr/lib/dovecot/libdovecot.so.0(+0x9536d) [0x7f671137e36d] ->
> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f6711314951] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x238)
> [0x7f67116b3de8] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x60)
> [0x7f6711640fa0] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x139)
> [0x7f67116f40f9] -> dovecot/imap [jakob 192.168.0.14 UID
> FETCH](+0x1ebbc) [0x55bef3095bbc] -> dovecot/imap [jakob 192.168.0.14
> UID FETCH](+0x1cfb6) [0x55bef3093fb6] -> dovecot/imap [jakob
> 192.168.0.14 UID FETCH](imap_fetch_more+0x39) [0x55bef30950e9] ->
> dovecot/imap [jakob 192.168.0.14 UID FETCH](cmd_fetch+0x33b)
> [0x55bef3086d9b] -> dovecot/imap [jakob 192.168.0.14 UID
> FETCH](command_exec+0xa5) [0x55bef3092735] -> dovecot/imap [jakob
> 192.168.0.14 UID FETCH](+0x199c2) [0x55bef30909c2] -> dovecot/imap
> [jakob 192.168.0.14 UID FETCH](+0x19a4c) [0x55bef3090a4c] ->
> dovecot/imap [jakob 192.168.0.14 UID FETCH](client_handle_input+0x1b5)
> [0x55bef3090e55] -> dovecot/imap [jakob 192.168.0.14 UID
> FETCH](client_input+0x86) [0x55bef30913c6] ->
> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f6711392dd2]
> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
> [0x7f6711394409] ->
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c)
> [0x7f6711392e6c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
> [0x7f6711393018] ->
> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
> [0x7f671131ae93] -> dovecot/imap [jakob 192.168.0.14 UID
> FETCH](main+0x328) [0x55bef3083e68] ->
> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f6710f6a2b1]
> -> dovecot/imap [jakob 192.168.0.14 UID FETCH](_start+0x2a) [0x55bef3083fea]
> Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Fatal: master:
> service(imap): child 2704 killed with signal 6 (core dumps disabled)
> ---8<--
> 
> So i activated rawlog as after-login executeable. The IMAP-dialog when
> opening this email is:
> ---8<--
> 9 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE
> IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS
> THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN
> NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH
> ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE XDOVECOT
> SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in
> 10 BAD Error in IMAP command SELECT: QRESYNC not enabled (0.000 + 0.000
> secs).
> 11 OK No quota (0.000 + 0.000 secs).
> ---8<--
> 
> If found only one Report for this problem, but on regular imap-folders,
> and there was not really a solution. This report is from 2015.
> On regular folders, i have no problem with this emails, only on virtual
> folders.
> So i think, it is a problem of the virtual-plugin.
> 
> Here is one of this

dict host param and fqdn

2017-11-14 Thread Stéphane Cottin 

Hi,

I would like to use a fqdn instead of an IP address as redis host

quota_clone_dict = redis:host=redis.host.name:port=6379

But only ip adresses are supported

	Error: quota_clone_dict: Failed to initialize 
'redis:host=redis.host.name:port=6379': dict redis: Invalid IP: 
redis.host.name


Why is name resolution not implemented here ? Is it for performance 
considerations ?



Stéphane

Plugin virtual, Horde BAD IMAP QRESYNC not enabled

2017-11-14 Thread Jakob Schürz 
Hi there!

I'm new on this list, so hello to all!
First i want say, that dovecot is a really great mailserver. I use it
since many years for my private usecase. I'm planning to setup a new
Mailserver, so i'm fiddeling around to understand dovecot better and get
a "perfect" Mailserver. (Linux and Win10) Outlook, k9mail and the
gmail-app on android.

I want to leave google behind me, so i'm searching for a good server for
cloudbased  and selfhosted calendar- and addressbook-server.
On some discussion in debianforum.de i got the hint, to use horde.

So i installed horde from pear. Got ActiveSync working with the Android
and Outlook. Mails, Calendar and Addressbook... very fine.

But then i run into a gotcha.

There is a problem  with some mails in dovecots virtual mailboxes.
I tried a lot to find out, how to debug this. First i thought, it's a
problem from horde, because the problem is only with horde-client.

Some Emails are not shown in horde. Exactly, they are not shown in horde
on dovecots virtual mailboxes (plugin virtual in a separate virtual
namespace)
If i try to open this email in its original directory, it gets opened
without any problem.

So, when i try to open it from within the virtual mailbox, i get this error:
---8<--
Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Panic: file
index-mail-binary.c: line 586 (index_mail_get_binary_stream): assertion
failed: (mail->data.stream != NULL)
Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Error: Raw
backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x95272) [0x7f671137e272]
-> /usr/lib/dovecot/libdovecot.so.0(+0x9536d) [0x7f671137e36d] ->
/usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f6711314951] ->
/usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_binary_stream+0x238)
[0x7f67116b3de8] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mail_get_binary_stream+0x60)
[0x7f6711640fa0] ->
/usr/lib/dovecot/libdovecot-storage.so.0(imap_msgpart_open+0x139)
[0x7f67116f40f9] -> dovecot/imap [jakob 192.168.0.14 UID
FETCH](+0x1ebbc) [0x55bef3095bbc] -> dovecot/imap [jakob 192.168.0.14
UID FETCH](+0x1cfb6) [0x55bef3093fb6] -> dovecot/imap [jakob
192.168.0.14 UID FETCH](imap_fetch_more+0x39) [0x55bef30950e9] ->
dovecot/imap [jakob 192.168.0.14 UID FETCH](cmd_fetch+0x33b)
[0x55bef3086d9b] -> dovecot/imap [jakob 192.168.0.14 UID
FETCH](command_exec+0xa5) [0x55bef3092735] -> dovecot/imap [jakob
192.168.0.14 UID FETCH](+0x199c2) [0x55bef30909c2] -> dovecot/imap
[jakob 192.168.0.14 UID FETCH](+0x19a4c) [0x55bef3090a4c] ->
dovecot/imap [jakob 192.168.0.14 UID FETCH](client_handle_input+0x1b5)
[0x55bef3090e55] -> dovecot/imap [jakob 192.168.0.14 UID
FETCH](client_input+0x86) [0x55bef30913c6] ->
/usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f6711392dd2]
-> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
[0x7f6711394409] ->
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c)
[0x7f6711392e6c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7f6711393018] ->
/usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13)
[0x7f671131ae93] -> dovecot/imap [jakob 192.168.0.14 UID
FETCH](main+0x328) [0x55bef3083e68] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f6710f6a2b1]
-> dovecot/imap [jakob 192.168.0.14 UID FETCH](_start+0x2a) [0x55bef3083fea]
Nov 14 23:29:52 aldebaran dovecot[2495]: imap(jakob): Fatal: master:
service(imap): child 2704 killed with signal 6 (core dumps disabled)
---8<--

So i activated rawlog as after-login executeable. The IMAP-dialog when
opening this email is:
---8<--
9 OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE
IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS
THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN
NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH
ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS BINARY MOVE XDOVECOT
SPECIAL-USE QUOTA ACL RIGHTS=texk] Logged in
10 BAD Error in IMAP command SELECT: QRESYNC not enabled (0.000 + 0.000
secs).
11 OK No quota (0.000 + 0.000 secs).
---8<--

If found only one Report for this problem, but on regular imap-folders,
and there was not really a solution. This report is from 2015.
On regular folders, i have no problem with this emails, only on virtual
folders.
So i think, it is a problem of the virtual-plugin.

Here is one of this failing emails:

---8<--
Return-path: 
Envelope-to: jakob@mydomain.example
Delivery-date: Mon, 13 Nov 2017 09:23:52 +0100
Received: from 1.2.3.4.wireless.dyn.drei.com ([1.2.3.4] helo=marketingnh)
by mydomain.example with esmtpsa 
(TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.89)
(envelope-from )
id 1eEA24-0002AR-IW
for jakob@mydomain.example; Mon, 13 Nov 2017 09:23:52 +0100
From: Microsoft Outlook 
To: =?utf-8?B?SmFrb2J1cyBTY2jDvHJ6?= 
MIME-Version: 1.0
Content-Type: text/html;

Doveadm: Skipping module doveadm_mail_crypt_plugin loading

2017-11-14 Thread vkoshars...@gmail.com 
# dovecot --version  

Doveadm unable to load plugin  bacause plugin doveadm_mail_crypt_plugin.so not 
compiled with function mail_crypt_box_get_pvt_digests, who defned in 
mail-crypt-key.c

Fix for these problem:

dovecot_doveadm_mail_crypt_fix.diff:

--- src/plugins/mail-crypt/Makefile.am.old  2017-11-10 19:51:18.155088706 
+0200
+++ src/plugins/mail-crypt/Makefile.am  2017-11-10 20:06:30.557814167 +0200
@@ -70,7 +70,8 @@
 libfs_mail_crypt_la_LDFLAGS = -module -avoid-version

 libdoveadm_mail_crypt_plugin_la_SOURCES = \
-   doveadm-mail-crypt.c
+   doveadm-mail-crypt.c \
+   mail-crypt-key.c
 libdoveadm_mail_crypt_plugin_la_LIBADD = $(LIBDOVECOT)
 libdoveadm_mail_crypt_plugin_la_DEPENDENCIES = $(LIBDOVECOT_DEPS)
 libdoveadm_mail_crypt_plugin_la_LDFLAGS = -module -avoid-version


# doveadm -D sis 
_*Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: 
mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore 
this message)

*_

After compile:

# doveadm -D sis

Doubt about replacing alt storage disks

2017-11-14 Thread Amol Kulkarni 
Hello,

I have a working setup of dovecot 2.2.19 on centos 6.
The mailbox format is mdbox. I've configured primary and alt storage.

Now I want to replace the disk of the alt storage only.

Broadly my plan to change it is as follows :
1. Mount the new disk on a temporary server.
2. Rsync data only from alt storage to the new disk - while the original
server is live. This may take a few days. In between altmove will happen on
the live disk.
3. Once the basic rsync is complete, stop all services on the live server
4. Mount the new disk on live server, in addition to live disk
5. Do final rsync - with the delete option
6. Unmount the live disk and mount new disk in its place
7. Start services

I've 2 doubts abt this plan :
1. I've tried the first part until step 2. After the first rsync, I found
unexpected differences between the m.* files on the live and new disk. The
new disk has some additional files for some users, which are not present on
the live disk. Since the rsync was run without delete option, these files
were not deleted from the new disk. Does altmove delete some m.* files to
reorganize mail ? Can end user mail deletion cause deletion of m.* files ?

2. I'm worried about commonly occuring problems with such movement :
duplicate mail download in pop / resync in imap / index corruption. Is
there any way to check integrity of data before switching to the new disk ?

Thanks in advance,
Amol.

Re: Building dovecot 2.2.33.2 is broken with uclibc-ng

2017-11-14 Thread Josef 'Jeff' Sipek 
On Tue, Nov 14, 2017 at 05:56:52 +0100, Bernd Kuhls wrote:
> Am Mon, 13 Nov 2017 15:40:14 -0500 schrieb Josef 'Jeff' Sipek:
> 
> > What happens if in dovecot's byteorder.h you add this before line 30:
> > 
> > #undef bswap_8
> > #undef bswap_16
> > #undef bswap_32
> > #undef bswap_64
> > 
> > Hopefully that does it.
> 
> Hi Jeff,
> 
> adding these four lines fixes the build error, thanks!

Good to know.  I'll get them committed into dovecot itself.

Jeff.

-- 
NT is to UNIX what a doughnut is to a particle accelerator.