Re: Migration issue

2020-07-28 Thread Kishore Potnuru
Adding the dovecot.conf configuration from old and new servers:

=
My old server dovecot.conf (production1):
=

disable_plaintext_auth = no

listen = *
log_path = /var/log/dovecot.log
mail_location = maildir:/z1dev/mail/virtual/%d/%n/Maildir/
passdb {
args = /etc/dovecot/passwd
driver = passwd-file
master = yes
pass = yes
}
pop3_uidl_format = %g
protocols = pop3 imap
ssl = yes
ssl_cert =  wrote:

> Not sure if this is the issue but the error says no password database is
> cfg’d…is that truly the case?
>
> Maybe post a redacted config for the community to review…
>
>
>
> On Jul 28, 2020, at 7:20 AM, Kishore Potnuru 
> wrote:
>
> Hi Aki & Dovecot team,
>
> Just continuing with the previous discussion "Migration from one server
> to 2 new servers".
>
> Hi,
>
> I have tried the same way as per your suggestion. But it's throwing an
> error.
>
> -
> [root@production2 log]# doveadm backup -a All -R -u kish...@test.ba.com
>  imapc:
> dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
> Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:45992)
> dsync(kish...@test.ba.com): Warning: imapc(production1.baplc.com:143):
> connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - reconnecting
> (delay 0 ms)
> dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
> Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:46014)
> dsync(kish...@test.ba.com): Error: imapc(production1.baplc.com:143):
> connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - disconnecting
> dsync(kish...@test.ba.com): Error: User initialization failed: imapc:
> Login to production1.baplc.com failed: Disconnected from server
> [root@production2 log]#
> --
>
> I looked into the production1 (old server) logs. I see the below error.
>
> ===
> Jul 28 11:14:23 auth: Fatal: Master passdb can't have pass=yes if there
> are no passdbs
> Jul 28 11:14:23 master: Error: service(auth): command startup failed,
> throttling
> ===
>
> after the above error, I have commented "pass=yes" in production1 (old
> server) server, then I see the below error.
>
> 
> Jul 28 11:17:10 auth: Fatal: No passdbs specified in configuration file.
> PLAIN mechanism needs one
> Jul 28 11:17:10 master: Error: service(auth): command startup failed,
> throttling
> ===
>
> Please suggest me on fixing the issue.
>
>
>
>


Re: Migration issue

2020-07-28 Thread Antonio Leding
Not sure if this is the issue but the error says no password database is 
cfg’d…is that truly the case?  

Maybe post a redacted config for the community to review…



> On Jul 28, 2020, at 7:20 AM, Kishore Potnuru  
> wrote:
> 
> Hi Aki & Dovecot team,
> 
> Just continuing with the previous discussion "Migration from one server to 2 
> new servers".
> 
> Hi,
> 
> I have tried the same way as per your suggestion. But it's throwing an error.
> 
> -
> [root@production2 log]# doveadm backup -a All -R -u kish...@test.ba.com 
>  imapc:
> dsync(kish...@test.ba.com ): Info: 
> imapc(production1.baplc.com:143 ): 
> Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:45992)
> dsync(kish...@test.ba.com ): Warning: 
> imapc(production1.baplc.com:143 ): 
> connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - reconnecting 
> (delay 0 ms)
> dsync(kish...@test.ba.com ): Info: 
> imapc(production1.baplc.com:143 ): 
> Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:46014)
> dsync(kish...@test.ba.com ): Error: 
> imapc(production1.baplc.com:143 ): 
> connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - disconnecting
> dsync(kish...@test.ba.com ): Error: User 
> initialization failed: imapc: Login to production1.baplc.com 
>  failed: Disconnected from server
> [root@production2 log]#
> --
> 
> I looked into the production1 (old server) logs. I see the below error.
> 
> ===
> Jul 28 11:14:23 auth: Fatal: Master passdb can't have pass=yes if there are 
> no passdbs
> Jul 28 11:14:23 master: Error: service(auth): command startup failed, 
> throttling
> ===
> 
> after the above error, I have commented "pass=yes" in production1 (old 
> server) server, then I see the below error.
> 
> 
> Jul 28 11:17:10 auth: Fatal: No passdbs specified in configuration file. 
> PLAIN mechanism needs one
> Jul 28 11:17:10 master: Error: service(auth): command startup failed, 
> throttling
> ===
> 
> Please suggest me on fixing the issue.  
>  



Re: Client shows incorrect message counts

2020-07-28 Thread Antonio Leding
One last datapoint…

If I right-clink on a given account in Apple Mail, the message counts there 
actually match what doveadm tells me.  But looking at the message counts in the 
main Mail application pane, those counts are low.  I initially thought this 
could just be cosmetic but I then confirmed that messages are missing — in some 
cases over 1000 messages — but again, only on the Apple client.  If I go to 
Mailmate or Thunderbird, the messages are there...

I have also confirmed that Apple “features” such as mail filtering, Junk mail, 
etc. are disabled...



> On Jul 28, 2020, at 12:35 PM, Antonio Leding  wrote:
> 
> Hello all…
> 
> First, a disclaimer…I am aware that this is very likely not a Dovecot related 
> issue but I am truly pulling whatever hair I have left out of my head and 
> given the brain-power of this mailer, I thought someone might know what is 
> going in here.
> 
> The issues is this…
> 
> I check the message counts for a given account using doveadm and get a given 
> number.  I then configure the same account in 3 mail clients: Apple Mail, 
> Mailmate, and Thunderbird.  Both the Mailmate and Thunderbird message counts 
> match exactly with the doveadm numbers.  Apple Mail is low in almost all 
> cases.
> 
> I have tried every idea I have found including:
> 
> — Delete and recreate the mail account
> — Rebuild mailbox
> — Resync mailbox
> — Reindex Spotlight
> — Removing the "~/Library/Mail/V*/Envelope*” files; restart Mail
> — Remove the entire "~/Library/Mail/V*” directory; restart Mail
> 
> So, at wit’s end and again, apologies for this not being a Dovecot-centric 
> issue but I know you are all on top of this stuff and may have an idea…
> 
> Thanks in advance...



Client shows incorrect message counts

2020-07-28 Thread Antonio Leding
Hello all…

First, a disclaimer…I am aware that this is very likely not a Dovecot related 
issue but I am truly pulling whatever hair I have left out of my head and given 
the brain-power of this mailer, I thought someone might know what is going in 
here.

The issues is this…

I check the message counts for a given account using doveadm and get a given 
number.  I then configure the same account in 3 mail clients: Apple Mail, 
Mailmate, and Thunderbird.  Both the Mailmate and Thunderbird message counts 
match exactly with the doveadm numbers.  Apple Mail is low in almost all cases.

I have tried every idea I have found including:

— Delete and recreate the mail account
— Rebuild mailbox
— Resync mailbox
— Reindex Spotlight
— Removing the "~/Library/Mail/V*/Envelope*” files; restart Mail
— Remove the entire "~/Library/Mail/V*” directory; restart Mail

So, at wit’s end and again, apologies for this not being a Dovecot-centric 
issue but I know you are all on top of this stuff and may have an idea…

Thanks in advance...

Migration issue

2020-07-28 Thread Kishore Potnuru
Hi Aki & Dovecot team,

Just continuing with the previous discussion "Migration from one server to
2 new servers".

Hi,

I have tried the same way as per your suggestion. But it's throwing an
error.

-
[root@production2 log]# doveadm backup -a All -R -u kish...@test.ba.com
 imapc:
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:45992)
dsync(kish...@test.ba.com): Warning: imapc(production1.baplc.com:143):
connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - reconnecting
(delay 0 ms)
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:46014)
dsync(kish...@test.ba.com): Error: imapc(production1.baplc.com:143):
connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - disconnecting
dsync(kish...@test.ba.com): Error: User initialization failed: imapc: Login
to production1.baplc.com failed: Disconnected from server
[root@production2 log]#
--

I looked into the production1 (old server) logs. I see the below error.

===
Jul 28 11:14:23 auth: Fatal: Master passdb can't have pass=yes if there are
no passdbs
Jul 28 11:14:23 master: Error: service(auth): command startup failed,
throttling
===

after the above error, I have commented "pass=yes" in production1 (old
server) server, then I see the below error.


Jul 28 11:17:10 auth: Fatal: No passdbs specified in configuration file.
PLAIN mechanism needs one
Jul 28 11:17:10 master: Error: service(auth): command startup failed,
throttling
===

Please suggest me on fixing the issue.


Re: Migration from one server to 2 new servers

2020-07-28 Thread Kishore Potnuru
Hi,

I have tried the same way as per your suggestion. But it's throwing an
error.

-
[root@production2 log]# doveadm backup -a All -R -u kish...@test.ba.com
imapc:
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:45992)
dsync(kish...@test.ba.com): Warning: imapc(production1.baplc.com:143):
connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - reconnecting
(delay 0 ms)
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to xxx.xxx.xxx.xxx:143 (local yyy.yyy.yyy.yyy:46014)
dsync(kish...@test.ba.com): Error: imapc(production1.baplc.com:143):
connect(xxx.xxx.xxx.xxx, 143) timed out after 30 seconds - disconnecting
dsync(kish...@test.ba.com): Error: User initialization failed: imapc: Login
to production1.baplc.com failed: Disconnected from server
[root@production2 log]#
--

I looked into the production1 (old server) logs. I see the below error.

===
Jul 28 11:14:23 auth: Fatal: Master passdb can't have pass=yes if there are
no passdbs
Jul 28 11:14:23 master: Error: service(auth): command startup failed,
throttling
===

after the above error, I have commented "pass=yes" in production1 (old
server) server, then I see the below error.


Jul 28 11:17:10 auth: Fatal: No passdbs specified in configuration file.
PLAIN mechanism needs one
Jul 28 11:17:10 master: Error: service(auth): command startup failed,
throttling
===

Please suggest me on fixing the issue.

On Tue, Jul 28, 2020 at 6:57 AM Aki Tuomi 
wrote:

> Hi!
>
> Kishore, you got the command wrong..
>
> `doveadm backup -R -u username-goes-here imapc:`
>
> for this to work, you need to configure following things:
>
> imapc_host = old-host-name
> imapc_password = master-password
> imapc_master_user = master-user-name
>
> and on the old host you need
>
> passdb {
>args = /etc/dovecot/passwd.masterusers
>driver = passwd-file
>master = yes
>pass = yes
> }
>
> This should let you pull the mails from the old host to your new host over
> IMAP.
>
> You should probably also look at
>
> https://wiki.dovecot.org/Migration/Dsync
>
> Aki
>
> > On 28/07/2020 03:02 Antonio Leding  wrote:
> >
> >
> > Hey Kishore…
> >
> > I believe this is the thread I mentioned earlier. It is quite long and
> spans a monthly barrier (Feb\Mar 2012) so if you use the “Next\Previous
> message” links, you need to be sure to pick up the thread in each monthly
> archive. I have provided links to the first post of the thread in each
> archive here:
> >
> > https://dovecot.org/list/dovecot/2012-February/133718.html
> > https://dovecot.org/list/dovecot/2012-March/134110.html
> >
> > Also, mention of a working syntax for the remote side command can be
> found in this post:
> >
> > https://dovecot.org/list/dovecot/2012-February/081425.html
> >
> > I’m sure one of the Dovecot devs will chime in at some point but in the
> meantime, hopefully the above will offer some relief…
> >
> >
> >
> >
> > > On Jul 27, 2020, at 4:38 PM, Antonio Leding  wrote:
> > >
> > >
> > > I seem to recall a post a while back where, due to the age of the
> remote end, the remote side command had to be entered in the command
> executed on the local side.
> > >
> > > Do you have dsync on the 2.0.9 machine?
> > >
> > >
> > >
> > >
> > >
> > > > On Jul 27, 2020, at 4:16 PM, Kishore Potnuru <
> kishore.reac...@gmail.com> wrote:
> > > >
> > > >
> > > > This is what my understanding. May be I am also wrong here.
> > > >
> > > > Backup option is there in my new server, production2.
> > > >
> > > > When I use the command with -R option from new server, it is
> connecting to old server, Production1 and giving the output of the doveadm
> backup command in old server to get the data. If you see the command and
> error I posted, it shows the same.
> > > >
> > > > Sorry just incase if I am wrong.
> > > >
> > > > Kishore
> > > >
> > > >
> > > > On Mon, 27 Jul, 2020, 11:32 pm Antonio Leding, 
> wrote:
> > > > > Well that option set still doesn’t look correct…
> > > > >
> > > > > Here is the doveadm option set from my 2.2.2 server which is
> several weeks\months before 2.2.36…
> > > > >
> > > > >
> > > > >
> > > > > [Jul-27 @ 15:25:09 ] > dovecot --version
> > > > > 2.2.2
> > > > >
> > > > > [Jul-27 @ 15:26:53 ] > ls -l /usr/local/bin/doveadm
> > > > > -rwxr-xr-x 1 root root 1379203 May 22 2013 /usr/local/bin/doveadm
> > > > >
> > > > > [Jul-27 @ 15:25:12 ] > doveadm
> > > > > usage: doveadm [-Dv] [-f ]  []
> > > > >
> > > > > altmove [-u |-A] [-S ] [-r] 
> > > > > auth cache|test
> > > > > backup [-u |-A] [-S ] [-dfR] [-l ] [-m
> ] [-n ] [-s ] 
> > > > > batch [-u |-A] [-S ]   [ 
> [..]]
> > > > > config [doveconf parameters]
> > > > > copy [-u |-A] [-S ]  [user  user>] 
> > > > > director add|dump|flush|map|move|remove|ring|ring|ring|status
> > > > > dump [-t ] 
> > > > > exec  [binary parameters]
> > > > > expunge [-u |-A] [-S ] [-d] 
> > > > > 

Re: Migration from one server to 2 new servers

2020-07-28 Thread Kishore Potnuru
Hi,

I have tried the same way as per your suggestion. But it's throwing the
below error.

-
[root@production2 log]# doveadm backup -a All -R -u kish...@test.ba.com
imapc:
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to 161.2.11.119:143 (local 161.2.12.152:45992)
dsync(kish...@test.ba.com): Warning: imapc(production1.baplc.com:143):
connect(161.2.11.119, 143) timed out after 30 seconds - reconnecting (delay
0 ms)
dsync(kish...@test.ba.com): Info: imapc(production1.baplc.com:143):
Connected to 161.2.11.119:143 (local 161.2.12.152:46014)
dsync(kish...@test.ba.com): Error: imapc(production1.baplc.com:143):
connect(161.2.11.119, 143) timed out after 30 seconds - disconnecting
dsync(kish...@test.ba.com): Error: User initialization failed: imapc: Login
to production1.baplc.com failed: Disconnected from server
[root@production2 log]#
--

I looked into the production1 (old server) logs. I see the below error.

===
Jul 28 11:14:23 auth: Fatal: Master passdb can't have pass=yes if there are
no passdbs
Jul 28 11:14:23 master: Error: service(auth): command startup failed,
throttling
===

After the above error, I have commented "pass=yes" in production1 (old
server) server, then I see the below error.


Jul 28 11:17:10 auth: Fatal: No passdbs specified in configuration file.
PLAIN mechanism needs one
Jul 28 11:17:10 master: Error: service(auth): command startup failed,
throttling
===

Please suggest me on fixing the issue. I have also copied the dovecot.conf
from both the servers below.

=
My old server dovecot.conf (production1):
=

disable_plaintext_auth = no

listen = *
log_path = /var/log/dovecot.log
mail_location = maildir:/z1dev/mail/virtual/%d/%n/Maildir/
passdb {
args = /etc/dovecot/passwd
driver = passwd-file
master = yes
pass = yes
}
pop3_uidl_format = %g
protocols = pop3 imap
ssl = yes
ssl_cert = 
wrote:

> Hi!
>
> Kishore, you got the command wrong..
>
> `doveadm backup -R -u username-goes-here imapc:`
>
> for this to work, you need to configure following things:
>
> imapc_host = old-host-name
> imapc_password = master-password
> imapc_master_user = master-user-name
>
> and on the old host you need
>
> passdb {
>args = /etc/dovecot/passwd.masterusers
>driver = passwd-file
>master = yes
>pass = yes
> }
>
> This should let you pull the mails from the old host to your new host over
> IMAP.
>
> You should probably also look at
>
> https://wiki.dovecot.org/Migration/Dsync
>
> Aki
>
> > On 28/07/2020 03:02 Antonio Leding  wrote:
> >
> >
> > Hey Kishore…
> >
> > I believe this is the thread I mentioned earlier. It is quite long and
> spans a monthly barrier (Feb\Mar 2012) so if you use the “Next\Previous
> message” links, you need to be sure to pick up the thread in each monthly
> archive. I have provided links to the first post of the thread in each
> archive here:
> >
> > https://dovecot.org/list/dovecot/2012-February/133718.html
> > https://dovecot.org/list/dovecot/2012-March/134110.html
> >
> > Also, mention of a working syntax for the remote side command can be
> found in this post:
> >
> > https://dovecot.org/list/dovecot/2012-February/081425.html
> >
> > I’m sure one of the Dovecot devs will chime in at some point but in the
> meantime, hopefully the above will offer some relief…
> >
> >
> >
> >
> > > On Jul 27, 2020, at 4:38 PM, Antonio Leding  wrote:
> > >
> > >
> > > I seem to recall a post a while back where, due to the age of the
> remote end, the remote side command had to be entered in the command
> executed on the local side.
> > >
> > > Do you have dsync on the 2.0.9 machine?
> > >
> > >
> > >
> > >
> > >
> > > > On Jul 27, 2020, at 4:16 PM, Kishore Potnuru <
> kishore.reac...@gmail.com> wrote:
> > > >
> > > >
> > > > This is what my understanding. May be I am also wrong here.
> > > >
> > > > Backup option is there in my new server, production2.
> > > >
> > > > When I use the command with -R option from new server, it is
> connecting to old server, Production1 and giving the output of the doveadm
> backup command in old server to get the data. If you see the command and
> error I posted, it shows the same.
> > > >
> > > > Sorry just incase if I am wrong.
> > > >
> > > > Kishore
> > > >
> > > >
> > > > On Mon, 27 Jul, 2020, 11:32 pm Antonio Leding, 
> wrote:
> > > > > Well that option set still doesn’t look correct…
> > > > >
> > > > > Here is the doveadm option set from my 2.2.2 server which is
> several weeks\months before 2.2.36…
> > > > >
> > > > >
> > > > >
> > > > > [Jul-27 @ 15:25:09 ] > dovecot --version
> > > > > 2.2.2
> > > > >
> > > > > [Jul-27 @ 15:26:53 ] > ls -l /usr/local/bin/doveadm
> > > > > -rwxr-xr-x 1 root root 1379203 May 22 2013 /usr/local/bin/doveadm
> > > > >
> > > > > [Jul-27 @ 15:25:12 ] > doveadm
> > > > > usage: doveadm [-Dv] [-f