Re: Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Sami Ketola via dovecot]

Hi,

then please post doveconf -n

Sami


> On 3 Dec 2019, at 21.31, Tomek Lutelmowski via dovecot  
> wrote:
> 
> Neither of dovecot.index files are created (.cache, .log, .thread) - these 
> files are created when I open the folder with IMAP client. When mailbox is 
> not used for long time, the indexing takes very long time. So I'm looking for 
> any solution (preferably with doveadm) to manually reindex folders in 
> background. 
> 
> wt., 3 gru 2019 o 20:23 Aki Tuomi  > napisał(a):
> Wait, did you mean 'dovecot.index' file? That file is only created 
> occasionally, the actual index is kept in dovecot.index.log.
> 
> Aki
> 
> > On 03/12/2019 21:20 Tomek Lutelmowski via dovecot  > > wrote:
> > 
> > 
> > Thanks, but both commands didn't create dovecot.index. Only when I open 
> > folder with IMAP client, the dovecot.index is created.
> > 
> > 
> > wt., 3 gru 2019 o 18:16 Aki Tuomi  > > napisał(a):
> > > 
> > >  > On 03/12/2019 18:30 Tomek Lutelmowski via dovecot  > > > wrote:
> > >  > 
> > >  > 
> > >  > Hello,
> > >  > 
> > >  > I'm using maildirs, and I have problems with big mailboxes (~ 2 
> > > emails, 30-50GB) - sometimes access to such mailbox takes very long (~10 
> > > minutes), I would like to be able to create index for mailbox in 
> > > background, but I couldn't find any way to do it. So far I tried:
> > >  > 
> > >  > doveadm -D -vvv index -u user 'Folder' 
> > >  > 
> > >  > But even if this folder have no dovecot.index* files - I always get:
> > >  > 
> > >  > doveadm(user): Info: Wersje robocze: Cache is already up to date
> > >  > 
> > >  > It seems that doveadm doesn't actually checks if the index is present. 
> > > The index is created only when I log with IMAP client and check the 
> > > folder.
> > >  > 
> > >  > So i tried:
> > >  > doveadm mailbox cache purge -u user 'Folder' 
> > >  > 
> > >  > No joy either:
> > >  > doveadm(user): Error: Cache is unusable
> > >  > 
> > >  > And command below doesn't actually do anything to index:
> > >  > doveadm -vvv force-resync -u user 'Folder'
> > >  > 
> > >  > Is there any way to use doveadm tool to create/fix index? Shouldn't 
> > > the index be updated on each email arrival?
> > >  > 
> > >  > Cheers,
> > >  > TomekL
> > >  
> > >  Try first 'doveadm fetch -u victim body ALL'. If this does not produce 
> > > any useful results, try 'doveadm force-resync -u victim "*"'.
> > >  
> > >  Aki
> > >

Re: Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Tomek Lutelmowski via dovecot]

Neither of dovecot.index files are created (.cache, .log, .thread) - these
files are created when I open the folder with IMAP client. When mailbox is
not used for long time, the indexing takes very long time. So I'm looking
for any solution (preferably with doveadm) to manually reindex folders in
background.

wt., 3 gru 2019 o 20:23 Aki Tuomi  napisał(a):

> Wait, did you mean 'dovecot.index' file? That file is only created
> occasionally, the actual index is kept in dovecot.index.log.
>
> Aki
>
> > On 03/12/2019 21:20 Tomek Lutelmowski via dovecot 
> wrote:
> >
> >
> > Thanks, but both commands didn't create dovecot.index. Only when I open
> folder with IMAP client, the dovecot.index is created.
> >
> >
> > wt., 3 gru 2019 o 18:16 Aki Tuomi 
> napisał(a):
> > >
> > >  > On 03/12/2019 18:30 Tomek Lutelmowski via dovecot <
> dovecot@dovecot.org> wrote:
> > >  >
> > >  >
> > >  > Hello,
> > >  >
> > >  > I'm using maildirs, and I have problems with big mailboxes (~ 2
> emails, 30-50GB) - sometimes access to such mailbox takes very long (~10
> minutes), I would like to be able to create index for mailbox in
> background, but I couldn't find any way to do it. So far I tried:
> > >  >
> > >  > doveadm -D -vvv index -u user 'Folder'
> > >  >
> > >  > But even if this folder have no dovecot.index* files - I always get:
> > >  >
> > >  > doveadm(user): Info: Wersje robocze: Cache is already up to date
> > >  >
> > >  > It seems that doveadm doesn't actually checks if the index is
> present. The index is created only when I log with IMAP client and check
> the folder.
> > >  >
> > >  > So i tried:
> > >  > doveadm mailbox cache purge -u user 'Folder'
> > >  >
> > >  > No joy either:
> > >  > doveadm(user): Error: Cache is unusable
> > >  >
> > >  > And command below doesn't actually do anything to index:
> > >  > doveadm -vvv force-resync -u user 'Folder'
> > >  >
> > >  > Is there any way to use doveadm tool to create/fix index? Shouldn't
> the index be updated on each email arrival?
> > >  >
> > >  > Cheers,
> > >  > TomekL
> > >
> > >  Try first 'doveadm fetch -u victim body ALL'. If this does not
> produce any useful results, try 'doveadm force-resync -u victim "*"'.
> > >
> > >  Aki
> > >
>

Re: Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Aki Tuomi via dovecot]

Wait, did you mean 'dovecot.index' file? That file is only created 
occasionally, the actual index is kept in dovecot.index.log.

Aki

> On 03/12/2019 21:20 Tomek Lutelmowski via dovecot  wrote:
> 
> 
> Thanks, but both commands didn't create dovecot.index. Only when I open 
> folder with IMAP client, the dovecot.index is created.
> 
> 
> wt., 3 gru 2019 o 18:16 Aki Tuomi  napisał(a):
> > 
> >  > On 03/12/2019 18:30 Tomek Lutelmowski via dovecot  
> > wrote:
> >  > 
> >  > 
> >  > Hello,
> >  > 
> >  > I'm using maildirs, and I have problems with big mailboxes (~ 2 
> > emails, 30-50GB) - sometimes access to such mailbox takes very long (~10 
> > minutes), I would like to be able to create index for mailbox in 
> > background, but I couldn't find any way to do it. So far I tried:
> >  > 
> >  > doveadm -D -vvv index -u user 'Folder' 
> >  > 
> >  > But even if this folder have no dovecot.index* files - I always get:
> >  > 
> >  > doveadm(user): Info: Wersje robocze: Cache is already up to date
> >  > 
> >  > It seems that doveadm doesn't actually checks if the index is present. 
> > The index is created only when I log with IMAP client and check the folder.
> >  > 
> >  > So i tried:
> >  > doveadm mailbox cache purge -u user 'Folder' 
> >  > 
> >  > No joy either:
> >  > doveadm(user): Error: Cache is unusable
> >  > 
> >  > And command below doesn't actually do anything to index:
> >  > doveadm -vvv force-resync -u user 'Folder'
> >  > 
> >  > Is there any way to use doveadm tool to create/fix index? Shouldn't the 
> > index be updated on each email arrival?
> >  > 
> >  > Cheers,
> >  > TomekL
> >  
> >  Try first 'doveadm fetch -u victim body ALL'. If this does not produce any 
> > useful results, try 'doveadm force-resync -u victim "*"'.
> >  
> >  Aki
> >

Re: Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Tomek Lutelmowski via dovecot]

Thanks, but both commands didn't create dovecot.index. Only when I open
folder with IMAP client, the dovecot.index is created.

wt., 3 gru 2019 o 18:16 Aki Tuomi  napisał(a):

>
> > On 03/12/2019 18:30 Tomek Lutelmowski via dovecot 
> wrote:
> >
> >
> > Hello,
> >
> > I'm using maildirs, and I have problems with big mailboxes (~ 2
> emails, 30-50GB) - sometimes access to such mailbox takes very long (~10
> minutes), I would like to be able to create index for mailbox in
> background, but I couldn't find any way to do it. So far I tried:
> >
> > doveadm -D -vvv index -u user 'Folder'
> >
> > But even if this folder have no dovecot.index* files - I always get:
> >
> > doveadm(user): Info: Wersje robocze: Cache is already up to date
> >
> > It seems that doveadm doesn't actually checks if the index is present.
> The index is created only when I log with IMAP client and check the folder.
> >
> > So i tried:
> > doveadm mailbox cache purge -u user 'Folder'
> >
> > No joy either:
> > doveadm(user): Error: Cache is unusable
> >
> > And command below doesn't actually do anything to index:
> > doveadm -vvv force-resync -u user 'Folder'
> >
> > Is there any way to use doveadm tool to create/fix index? Shouldn't the
> index be updated on each email arrival?
> >
> > Cheers,
> > TomekL
>
> Try first 'doveadm fetch -u victim body ALL'. If this does not produce any
> useful results, try 'doveadm force-resync -u victim "*"'.
>
> Aki
>

Re: Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Aki Tuomi via dovecot]

> On 03/12/2019 18:30 Tomek Lutelmowski via dovecot  wrote:
> 
> 
> Hello,
> 
> I'm using maildirs, and I have problems with big mailboxes (~ 2 emails, 
> 30-50GB) - sometimes access to such mailbox takes very long (~10 minutes), I 
> would like to be able to create index for mailbox in background, but I 
> couldn't find any way to do it. So far I tried:
> 
> doveadm -D -vvv index -u user 'Folder' 
> 
> But even if this folder have no dovecot.index* files - I always get:
> 
> doveadm(user): Info: Wersje robocze: Cache is already up to date
> 
> It seems that doveadm doesn't actually checks if the index is present. The 
> index is created only when I log with IMAP client and check the folder.
> 
> So i tried:
> doveadm mailbox cache purge -u user 'Folder' 
> 
> No joy either:
> doveadm(user): Error: Cache is unusable
> 
> And command below doesn't actually do anything to index:
> doveadm -vvv force-resync -u user 'Folder'
> 
> Is there any way to use doveadm tool to create/fix index? Shouldn't the index 
> be updated on each email arrival?
> 
> Cheers,
> TomekL

Try first 'doveadm fetch -u victim body ALL'. If this does not produce any 
useful results, try 'doveadm force-resync -u victim "*"'.

Aki

Dovecot 2.3.8 - How to force index creation for user/mailbox?

[Tomek Lutelmowski via dovecot]

Hello,

I'm using maildirs, and I have problems with big mailboxes (~ 2 emails,
30-50GB) - sometimes access to such mailbox takes very long (~10 minutes),
I would like to be able to create index for mailbox in background, but I
couldn't find any way to do it. So far I tried:


*doveadm -D -vvv index -u user 'Folder'  *

But even if this folder have no dovecot.index* files - I always get:

doveadm(user): Info: Wersje robocze: Cache is already up to date

It seems that doveadm doesn't actually checks if the index is present. The
index is created only when I log with IMAP client and check the folder.

So i tried:

*doveadm mailbox cache purge -u user 'Folder' *

No joy either:
doveadm(user): Error: Cache is unusable

And command below doesn't actually do anything to index:

*doveadm  -vvv force-resync -u user 'Folder'*

Is there any way to use doveadm tool to create/fix index? Shouldn't the
index be updated on each email arrival?

Cheers,
TomekL

Re: Fast searching from android device with Dovecot/Maildir

[John Gateley via dovecot]

Thank you Frank-Ulrich, this looks perfect.

John

On 12/2/19 7:25 PM, Frank-Ulrich Sommer via dovecot wrote:
I dont't know the capabilities of gmail, but IMAP supports server side 
search which is quite fast if the Solr full text search plugin for 
dovecot is used (wiki.dovecot.org/Plugins/FTS/Solr). For debian 
"dovecot-solr" can be used.


For Android K9-Mail does not really support server side search, 
Aquamail does and for other mail clients I don't know.


Am 1. Dezember 2019 22:18:37 MEZ schrieb John Gateley via dovecot 
:


Hello,

I am using dovecot as an imap server, mail is stored in mail directories.
Configuration is below.

One mail directory has about 14 Gb of mail in the inbox and .Sent
directories.

Searching from an Android phone with gmail is slow or doesn't work (it
times out).

Is there a configuration for Dovecot that can improve this? A better
e-mail client
for Android?

Thanks,

John

Re: About "received" header when using Dovecot proxy

[Riku via dovecot]

Hello.

Thank you for teaching.
I'd like to try it out if 2.3.9 comes out.
I look forward to the release of 2.3.9.
Thank you very much.

Best regards.

Can't see a specific mail in thunderbird but with mobile mail client

[J. Echter via dovecot]

Hi,

i've seen a strange behaviour in our system (centos 7, dovecot 2.2.36
(1f10bfa63) today.

We got a mail and it got delivered.

Dec  3 07:56:25 mail postfix/lmtp[4013]: 915B0CEF4C2: to=,
relay=mail[private/dovecot-lmtp], delay=1.5, delays=1.3/0.03/0.02/0.19,
dsn=2.0.0, status=sent (250 2.0.0  AOhCNBgH5l2vDwAAtnFApQ:2
Saved)
Dec  3 07:56:25 mail dovecot: lmtp(user@domain):
AOhCNBgH5l2vDwAAtnFApQ:2: sieve:
msgid=<289913405.81.1575356173625.JavaMail.SYSTEM@EUWS0716>: stored mail
into mailbox 'INBOX'

I also see this mail on the filesystem in the users cur dir:

-rw-r--r--.  1 vmail vmail  448818  3. Dez 07:56
1575356184.M937345P4015.mail,S=611100,W=619338:2,Sae

But i don't see this single mail in thunderbird and not in sogo
(http://www.sogo.nu), but i can see it in the mobile mail client.

Does anyone have a suggfestion what may be wrong here?

I paste my dovecot -n output here:

# 2.2.36 (1f10bfa63): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.4.24 (124e06aa)
# OS: Linux 3.10.0-1062.4.3.el7.x86_64 x86_64 CentOS Linux release
7.7.1908 (Core) xfs
# Hostname: mail.workgroup.local
auth_master_user_separator = *
auth_verbose = yes
base_dir = /var/run/dovecot/
default_vsz_limit = 2 G
imap_id_log = *
imap_id_send = *
log_timestamp = "%Y-%m-%d %H:%M:%S "
login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k
mail_gid = 5000
mail_home = /DATEN/vmail/%Ld/%Ln
mail_location = maildir:/DATEN/vmail/%Ld/%Ln/mail/
mail_plugins = " zlib fts fts_solr mail_log notify"
mail_uid = 5000
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date ihave
namespace inbox {
  inbox = yes
  location =
  mailbox Archive {
    auto = no
    special_use = \Archive
  }
  mailbox Archives {
    auto = subscribe
    special_use = \Archive
  }
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox Junk {
    auto = subscribe
    special_use = \Junk
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox "Sent Messages" {
    special_use = \Sent
  }
  mailbox Spam {
    auto = no
    special_use = \Junk
  }
  mailbox Trash {
    auto = subscribe
    special_use = \Trash
  }
  prefix =
}
passdb {
  args = /etc/dovecot/passwd.masterusers
  driver = passwd-file
  master = yes
}
passdb {
  args = /etc/dovecot/dovecot-ldap.conf
  driver = ldap
}
plugin {
  fts = solr
  fts_autoindex = yes
  fts_solr = break-imap-search url=http://localhost:8983/solr/dovecot/
  imapsieve_mailbox1_before = file:/etc/dovecot/sieve/learn-spam.sieve
  imapsieve_mailbox1_causes = COPY
  imapsieve_mailbox1_name = Junk
  imapsieve_mailbox2_before = file:/etc/dovecot/sieve/learn-ham.sieve
  imapsieve_mailbox2_causes = COPY
  imapsieve_mailbox2_from = Junk
  imapsieve_mailbox2_name = *
  mail_log_events = delete undelete expunge copy mailbox_delete
mailbox_rename
  mail_log_fields = uid box msgid size
  mailbox_alias_new = Sent Messages
  mailbox_alias_new2 = Sent Items
  mailbox_alias_new3 = Deleted Messages
  mailbox_alias_new4 = Papierkorb
  mailbox_alias_new5 = Spam
  mailbox_alias_old = Sent
  mailbox_alias_old2 = Sent
  mailbox_alias_old3 = Trash
  mailbox_alias_old4 = Trash
  mailbox_alias_old5 = Junk
  mailbox_list_index = yes
  recipient_delimiter = +
  sieve = /DATEN/vmail/%Ld/%Ln/.dovecot.sieve
  sieve_after = /etc/dovecot/sieve-after
  sieve_global_extensions = +vnd.dovecot.pipe
  sieve_pipe_bin_dir = /usr/bin
  sieve_plugins = sieve_imapsieve sieve_extprograms
  zlib_save = gz
  zlib_save_level = 6
}
protocols = sieve imap lmtp
service auth {
  unix_listener /var/spool/postfix/private/auth {
    group = postfix
    mode = 0660
    user = postfix
  }
  unix_listener auth-userdb {
    group = vmail
    mode = 0660
    user = vmail
  }
  user = root
}
service imap-login {
  chroot = login
  executable = /usr/libexec/dovecot/imap-login
  inet_listener imap {
    port = 0
  }
  process_min_avail = 4
  user = dovecot
}
service imap {
  executable = /usr/libexec/dovecot/imap
}
service lmtp {
  unix_listener /var/spool/postfix/private/dovecot-lmtp {
    group = postfix
    mode = 0600
    user = postfix
  }
}
service managesieve-login {
  chroot = login
  user = dovecot
}
service pop3-login {
  chroot = login
  user = dovecot
}
ssl = required
ssl_cert =