On 09/20/2016 01:20 PM, Andy Dorman wrote:
Ellie, I agree a "crack" exists that idled processes may be slipping
through but so far I have little data to prove it.
Empirically I have one server with two clients (I have moved everyone
else to other servers to decrease the number of variables), and the
process count in the IDLED state for those two clients grows apparently
without bound (at least I haven't found an upper limit yet). I have
been increasing the point at which I am alerted for "excess imapd
processes" and it is up to 100 processes now. After about 24 hours
these two clients reach that point and every process in
/var/run/cyrus/proc/ is attributed to them like this.
imap hermione.ironicdesign.com [192.168.0.17] b...@cogift.co
cogift.co!user.b2b Idle
hermione is our nginx load balancer on an internal network.
As far as we have been able to tell, no other client has this problem.
Another data point...these are very low traffic accounts (6 emails for
one and 0 for the other in the last week).
I am going to contact the owner of these two accounts today and ask her
what client she is using and how often she has it set up to check email.
OK, the client that appears to be causing our problem with apparently
abandoned imapd idled processes is an old (possibly more than 5 years
old) BlackBerry. Our client has it set to check all her mailboxes every
10-15 minutes. I have no idea how reliable the connectivity is for this
BB, but given how active she is I would not be surprised to hear that
the BB regularly loses connectivity when she is driving (which she does
a lot).
FWIW, I have more empirical data to report on the above server with only
2 accounts that are being checked by an old BlackBerry (along with
Thunderbird an hour or two each day...but the BB is the only device
checking 24/7)
It has been ~24 hr since the last cyrus-imapd restart.
There are now 123 imapd processes, all idled, and all of course for
those two accounts. Looking at the proc file times in the time-sorted
list below they span from when the restart happened (Sep 20 0734) to
just a few minutes ago.
root@dorcas:~# ls -alt /run/cyrus/proc/
total 492
drwx------ 2 cyrus mail 2500 Sep 21 07:19 .
-rw------- 1 cyrus mail 84 Sep 21 07:10 20204
-rw------- 1 cyrus mail 96 Sep 21 07:10 20152
-rw------- 1 cyrus mail 96 Sep 21 06:52 19799
-rw------- 1 cyrus mail 84 Sep 21 06:52 19063
-rw------- 1 cyrus mail 84 Sep 21 06:44 18774
-rw------- 1 cyrus mail 96 Sep 21 06:44 18561
-rw------- 1 cyrus mail 84 Sep 21 06:21 18121
-rw------- 1 cyrus mail 96 Sep 21 06:21 18175
-rw------- 1 cyrus mail 84 Sep 21 06:15 18022
-rw------- 1 cyrus mail 96 Sep 21 06:15 17888
-rw------- 1 cyrus mail 96 Sep 21 04:53 15008
-rw------- 1 cyrus mail 84 Sep 21 04:53 14951
-rw------- 1 cyrus mail 96 Sep 21 04:45 14791
-rw------- 1 cyrus mail 84 Sep 21 04:45 14650
-rw------- 1 cyrus mail 96 Sep 21 04:34 14111
-rw------- 1 cyrus mail 84 Sep 21 04:34 14065
-rw------- 1 cyrus mail 84 Sep 21 04:19 13428
-rw------- 1 cyrus mail 96 Sep 21 04:19 13708
-rw------- 1 cyrus mail 84 Sep 21 04:04 13358
-rw------- 1 cyrus mail 96 Sep 21 04:02 13120
-rw------- 1 cyrus mail 96 Sep 21 03:49 12369
-rw------- 1 cyrus mail 84 Sep 21 03:48 12186
-rw------- 1 cyrus mail 96 Sep 21 03:31 11798
-rw------- 1 cyrus mail 84 Sep 21 03:31 11744
-rw------- 1 cyrus mail 84 Sep 21 03:14 11339
-rw------- 1 cyrus mail 96 Sep 21 03:13 11303
-rw------- 1 cyrus mail 84 Sep 21 02:56 10747
-rw------- 1 cyrus mail 96 Sep 21 02:56 10686
-rw------- 1 cyrus mail 84 Sep 21 02:44 10357
-rw------- 1 cyrus mail 96 Sep 21 02:44 10407
-rw------- 1 cyrus mail 84 Sep 21 02:32 9588
-rw------- 1 cyrus mail 96 Sep 21 02:32 9646
-rw------- 1 cyrus mail 84 Sep 21 02:19 9308
-rw------- 1 cyrus mail 96 Sep 21 02:19 9257
-rw------- 1 cyrus mail 96 Sep 21 02:07 8712
-rw------- 1 cyrus mail 84 Sep 21 02:07 8767
-rw------- 1 cyrus mail 84 Sep 21 01:49 7935
-rw------- 1 cyrus mail 96 Sep 21 01:49 7873
-rw------- 1 cyrus mail 84 Sep 21 01:34 7418
-rw------- 1 cyrus mail 96 Sep 21 01:34 7480
-rw------- 1 cyrus mail 96 Sep 21 01:18 6862
-rw------- 1 cyrus mail 84 Sep 21 01:18 7104
-rw------- 1 cyrus mail 84 Sep 21 01:04 6556
-rw------- 1 cyrus mail 96 Sep 21 01:04 6509
-rw------- 1 cyrus mail 84 Sep 21 00:47 5517
-rw------- 1 cyrus mail 96 Sep 21 00:47 5675
-rw------- 1 cyrus mail 96 Sep 21 00:36 5317
-rw------- 1 cyrus mail 84 Sep 21 00:36 5257
-rw------- 1 cyrus mail 84 Sep 21 00:22 4874
-rw------- 1 cyrus mail 96 Sep 21 00:22 4893
-rw------- 1 cyrus mail 84 Sep 21 00:14 4598
-rw------- 1 cyrus mail 96 Sep 21 00:14 4779
-rw------- 1 cyrus mail 84 Sep 20 23:59 4345
-rw------- 1 cyrus mail 96 Sep 20 23:59 4091
-rw------- 1 cyrus mail 96 Sep 20 23:49 3987
-rw------- 1 cyrus mail 84 Sep 20 23:49 3943
-rw------- 1 cyrus mail 84 Sep 20 23:36 3245
-rw------- 1 cyrus mail 96 Sep 20 23:36 3163
-rw------- 1 cyrus mail 84 Sep 20 23:34 2887
-rw------- 1 cyrus mail 96 Sep 20 23:34 2940
-rw------- 1 cyrus mail 84 Sep 20 23:19 2622
-rw------- 1 cyrus mail 96 Sep 20 23:19 2575
-rw------- 1 cyrus mail 84 Sep 20 23:03 2135
-rw------- 1 cyrus mail 96 Sep 20 23:02 2181
-rw------- 1 cyrus mail 84 Sep 20 22:52 1745
-rw------- 1 cyrus mail 96 Sep 20 22:52 1651
-rw------- 1 cyrus mail 96 Sep 20 22:39 1194
-rw------- 1 cyrus mail 84 Sep 20 22:39 1315
-rw------- 1 cyrus mail 84 Sep 20 22:27 879
-rw------- 1 cyrus mail 96 Sep 20 22:27 830
-rw------- 1 cyrus mail 84 Sep 20 22:07 32249
-rw------- 1 cyrus mail 96 Sep 20 22:07 413
-rw------- 1 cyrus mail 96 Sep 20 21:52 32104
-rw------- 1 cyrus mail 84 Sep 20 21:52 32068
-rw------- 1 cyrus mail 84 Sep 20 21:49 31857
-rw------- 1 cyrus mail 96 Sep 20 21:49 31990
-rw------- 1 cyrus mail 96 Sep 20 21:44 31670
-rw------- 1 cyrus mail 84 Sep 20 21:44 31622
-rw------- 1 cyrus mail 96 Sep 20 21:26 31202
-rw------- 1 cyrus mail 84 Sep 20 21:26 31191
-rw------- 1 cyrus mail 96 Sep 20 20:38 28554
-rw------- 1 cyrus mail 84 Sep 20 20:38 28441
-rw------- 1 cyrus mail 84 Sep 20 19:49 27037
-rw------- 1 cyrus mail 96 Sep 20 19:49 27086
-rw------- 1 cyrus mail 84 Sep 20 19:32 26567
-rw------- 1 cyrus mail 96 Sep 20 19:32 26517
-rw------- 1 cyrus mail 84 Sep 20 19:20 5333
-rw------- 1 cyrus mail 84 Sep 20 19:18 26200
-rw------- 1 cyrus mail 96 Sep 20 19:18 25941
-rw------- 1 cyrus mail 84 Sep 20 18:52 24665
-rw------- 1 cyrus mail 96 Sep 20 18:52 24524
-rw------- 1 cyrus mail 84 Sep 20 18:16 20635
-rw------- 1 cyrus mail 96 Sep 20 18:16 20515
-rw------- 1 cyrus mail 84 Sep 20 16:17 19196
-rw------- 1 cyrus mail 96 Sep 20 16:17 19195
-rw------- 1 cyrus mail 96 Sep 20 16:16 19194
-rw------- 1 cyrus mail 84 Sep 20 16:16 19241
-rw------- 1 cyrus mail 84 Sep 20 16:08 18934
-rw------- 1 cyrus mail 96 Sep 20 16:08 18941
-rw------- 1 cyrus mail 96 Sep 20 16:07 18732
-rw------- 1 cyrus mail 84 Sep 20 15:38 9424
-rw------- 1 cyrus mail 96 Sep 20 15:38 9743
-rw------- 1 cyrus mail 96 Sep 20 10:30 5590
-rw------- 1 cyrus mail 84 Sep 20 10:30 5543
-rw------- 1 cyrus mail 96 Sep 20 10:16 5391
-rw------- 1 cyrus mail 84 Sep 20 10:16 5015
-rw------- 1 cyrus mail 84 Sep 20 10:08 30606
-rw------- 1 cyrus mail 84 Sep 20 09:35 3326
-rw------- 1 cyrus mail 96 Sep 20 09:35 3239
-rw------- 1 cyrus mail 84 Sep 20 09:02 2038
-rw------- 1 cyrus mail 96 Sep 20 09:02 2139
-rw------- 1 cyrus mail 84 Sep 20 08:49 1693
-rw------- 1 cyrus mail 96 Sep 20 08:49 1739
-rw------- 1 cyrus mail 84 Sep 20 08:31 534
-rw------- 1 cyrus mail 96 Sep 20 08:31 541
-rw------- 1 cyrus mail 84 Sep 20 08:11 32419
-rw------- 1 cyrus mail 96 Sep 20 08:11 32317
-rw------- 1 cyrus mail 96 Sep 20 07:59 32040
-rw------- 1 cyrus mail 84 Sep 20 07:59 31985
-rw------- 1 cyrus mail 84 Sep 20 07:47 31626
-rw------- 1 cyrus mail 96 Sep 20 07:47 31006
-rw------- 1 cyrus mail 84 Sep 20 07:34 30732
-rw------- 1 cyrus mail 96 Sep 20 07:34 30675
and the contents of all the proc files look like one of these lines:
imap hermione.ironicdesign.com [192.168.0.17] b...@cogift.co
cogift.co!user.b2b Idle
imap hermione.ironicdesign.com [192.168.0.17] donati...@cogift.co
cogift.co!user.donations Idle
Sincere regards,
--
Andy Dorman
Ironic Design, Inc.
AnteSpam.com
