cyrus and Outlook subfolder crawling
Hi, I've got a problem with a Outlook 2010 client. The client is accessing a 10 GB cyrus imap account and crawling with high a frequency like crazy through each subfolders which fills the mail logfile and causes a noticeable higher load. This never stops unless the Outook client is closed. I'm not familiar with Outlook and to my mind this is not a cyrus problem, but does anybody know to say Outlook to stop this annoying behaviour. Ciao Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
successful create but unsuccessful subscribe
Hi List,
we see a strange behaviour in our dev cyrus murder environment which we
can't explain.
We run cyrus 2.4 on ubuntu server.
After successful creation of a new folder, the mailclient tries to
subscribe to the new folder, but gets a error message.
In thunderbird I can subscribe to the new folder with the subscribe
menu, using our webmail client, I have to logout and login again. After
that, the folder is subscribed.
Has anyone else seen this behaviour before? What can we do to fix it?
frontend:
135539380315 create INBOX/Kerstin/loglog
135539380615 OK Completed
135539380616 subscribe INBOX/Kerstin/loglog
135539380616 NO Mailbox does not exist
135539380617 list INBOX/Kerstin/loglog
135539380617 OK Completed (0.000 secs)
backend:
135539380315 CREATE {20+}
INBOX/Kerstin/loglog
135539380615 OK Completed
mupdate:
T 2012/12/13 11:12:00.231163 10.20.20.93:3905 - 10.20.20.48:37428 [AP]
U01 MAILBOX {25+}.
user.mailteam.Kerstin.log {14+}.
regina!default {23+}.
mailteam.lrswipkxtecda..
U01 MAILBOX {25+}.
user.mailteam.Kerstin.log {14+}.
regina!default {23+}.
mailteam.lrswipkxtecda..
--
Regards, Kerstin
signature.asc
Description: OpenPGP digital signature
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: cyrus and Outlook subfolder crawling
On Thu, 2012-12-13 at 10:43 +0100, Marcus Schopen wrote: I've got a problem with a Outlook 2010 client. The client is accessing a 10 GB cyrus imap account and crawling with high a frequency like crazy through each subfolders which fills the mail logfile and causes a noticeable higher load. This never stops unless the Outook client is closed. I'm not familiar with Outlook and to my mind this is not a cyrus problem, but does anybody know to say Outlook to stop this annoying behaviour. Can you unsubscribe from subfolders? If so, does doing so stop the mad crawl? Perhaps there is a folder, or more likely a message in a folder, that the Outlook client doesn't like - and it is then restarting its 'sync' over and over. Are Exchange extensions disabled? I've seen them cause various kinds of wierdness. Tools - Options - Other - Advanced - Options - Add-In Manager - Uncheck Exchange Extensions property. or Tools / Options / Other / Advanced Options / COM Add-Ins/ remove anything that isnt essential, (we remove everything) Those may not correspond to your version of Outlook. Although it may make matters much worse [temporarily] you might want to turn on telemetry for that user to see if there is a protocol error somewhere. But clients just walking folders shouldn't generally drive massive syslog traffic; perhaps you are logging mail at the DEBUG level? Don't do that, it is better to use telemetry logs selectively. -- Adam Tauno Williams awill...@whitemice.org Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: cyrus and Outlook subfolder crawling
On 12/13/2012 11:59 AM, Adam Tauno Williams wrote: On Thu, 2012-12-13 at 10:43 +0100, Marcus Schopen wrote: I've got a problem with a Outlook 2010 client. The client is accessing a 10 GB cyrus imap account and crawling with high a frequency like crazy through each subfolders which fills the mail logfile and causes a noticeable higher load. This never stops unless the Outook client is closed. I'm not familiar with Outlook and to my mind this is not a cyrus problem, but does anybody know to say Outlook to stop this annoying behaviour. Don't forget that 2010 will, by default, crawl the IMAP store and fetch a copy of all messages locally (instead of subj only), check the size of the local .pst file. The good part is that messages will be available off-line the bad part is that your local .pst file will be as large as the IMAP box; and it takes a lot of time to finish the process... Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: successful create but unsuccessful subscribe
On 12/13/12 11:50 +0100, Kerstin Espey wrote:
Hi List,
we see a strange behaviour in our dev cyrus murder environment which we
can't explain.
We run cyrus 2.4 on ubuntu server.
What specific release are you using?
Could you provide a sanitized copy of the configuration on your frontend,
backend, and mupdate servers?
After successful creation of a new folder, the mailclient tries to
subscribe to the new folder, but gets a error message.
In thunderbird I can subscribe to the new folder with the subscribe
menu, using our webmail client, I have to logout and login again. After
that, the folder is subscribed.
Has anyone else seen this behaviour before? What can we do to fix it?
frontend:
135539380315 create INBOX/Kerstin/loglog
135539380615 OK Completed
135539380616 subscribe INBOX/Kerstin/loglog
135539380616 NO Mailbox does not exist
135539380617 list INBOX/Kerstin/loglog
135539380617 OK Completed (0.000 secs)
Does the mailbox show up immediately in the mailbox list on the frontend
(ctl_mboxlist -d)? If not, approximately how long does it take for the
mupdate server to see it, and how long does it take for the frontend server
to see it?
Those look like timestamp values in your logs, so presumably the issue is
that the mailbox is unknown on the frontend for several seconds while the
mailbox gets propagated to the mupdate server and then to the frontend.
Did this work for you differently in a previous version of cyrus?
backend:
135539380315 CREATE {20+}
INBOX/Kerstin/loglog
135539380615 OK Completed
mupdate:
T 2012/12/13 11:12:00.231163 10.20.20.93:3905 - 10.20.20.48:37428 [AP]
U01 MAILBOX {25+}.
user.mailteam.Kerstin.log {14+}.
regina!default {23+}.
mailteam.lrswipkxtecda..
U01 MAILBOX {25+}.
user.mailteam.Kerstin.log {14+}.
regina!default {23+}.
mailteam.lrswipkxtecda..
--
Dan White
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: successful create but unsuccessful subscribe
On Thu, 13 Dec 2012 11:13:21 -0600 Dan White wrote: [ ... ] Did this work for you differently in a previous version of cyrus? We have exactly the same problem with cyrus 2.3.16 on RHEL. --Frank Elsner Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
RE: successful create but unsuccessful subscribe
I tried to respond to the list before but the list server told me to get bent. Here's a cut-n-paste of my previous reply: Hi, I have seen this problem before. If you only have a single frontend in your dev environment, it's likely a different problem than what I found. In our case, the mupdate process on one of our frontends was not receiving updates from the mupdate master. If a webmail user created a new folder and then immediately reconnected to that frontend, the folder wouldn't exist. If they connected to a different frontend, it would work fine. To see if this is your problem, you need to determine if mailboxes.db is the same across all of your frontends. The easiest thing is to compare the datestamp on the file. You may need to ctl_mboxlist -d each of them and compare. If you find that one of the mailboxes.db files on a frontend is considerably older than the rest, kill mupdate on that frontend and let master re-spawn it. It will reconnect to the mupdate master and scarf a fresh database. In our case, the problem was that the mupdate process on the frontend makes one connection to the mupdate master and then remains connected. Unfortunately, it does not use tcp keepalives so if there's an issue at the network layer where that connection goes away without actually being closed (meaning, the cyrus frontend never receives a tcp reset), the mupdate process will sit in a blocking read() on the mupdate socket forever without ever getting any updates. You can use lsof and/or netstat to see if this is the case, should you discover that you have a stale mailboxes.db on one of your frontends. netstat shows you the source and destination port. If that port isn't open on your mupdate server, and mupdate on your frontend is stuck in a blocking read(), you'll know that's the issue. HTH, Dave From: info-cyrus-bounces+dave64=andrew.cmu@lists.andrew.cmu.edu [info-cyrus-bounces+dave64=andrew.cmu@lists.andrew.cmu.edu] on behalf of Frank Elsner [frank.els...@tu-berlin.de] Sent: Thursday, December 13, 2012 2:09 PM To: info-cyrus@lists.andrew.cmu.edu Subject: Re: successful create but unsuccessful subscribe On Thu, 13 Dec 2012 11:13:21 -0600 Dan White wrote: [ ... ] Did this work for you differently in a previous version of cyrus? We have exactly the same problem with cyrus 2.3.16 on RHEL. --Frank Elsner Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: successful create but unsuccessful subscribe
On Thu, Dec 13, 2012, at 11:50 AM, Kerstin Espey wrote:
we see a strange behaviour in our dev cyrus murder environment which we
can't explain.
We run cyrus 2.4 on ubuntu server.
After successful creation of a new folder, the mailclient tries to
subscribe to the new folder, but gets a error message.
In thunderbird I can subscribe to the new folder with the subscribe
menu, using our webmail client, I have to logout and login again. After
that, the folder is subscribed.
commit 682834a60f66e4d7869a1717d9855567b877040a
Author: Bron Gondwana br...@opera.com
Date: Fri Sep 14 22:06:11 2012 +0200
options: document proxyservers only for murder backends
diff --git a/lib/imapoptions b/lib/imapoptions
index 7e8aa1c..19c315c 100644
--- a/lib/imapoptions
+++ b/lib/imapoptions
@@ -991,7 +991,9 @@ And the notification message will be available on
\fIstdin\fR.
{ proxyservers, NULL, STRING }
/* A list of users and groups that are allowed to proxy for other
users, separated by spaces. Any user listed in this will be
- allowed to login for any other user: use with caution. */
+ allowed to login for any other user: use with caution.
+ In a standard murder this option should ONLY be set on backends.
+ DO NOT SET on frontends or things won't work properly. */
{ pts_module, afskrb, STRINGLIST(afskrb, ldap) }
/* The PTS module to use. */
My guess, you have proxyservers set on the frontends.
Bron.
--
Bron Gondwana
br...@fastmail.fm
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
