Re: Deleting top-level mailbox with 'delete_mode: delayed'
On Tue, 13 Nov 2007, Bron Gondwana wrote:
I have delete_mode: immediate on the replica and delete_mode:
delayed on the master.
sync_server doesn't pay any attention to delete_mode, so the option
shouldn't have any effect on the replica.
Okay, things are a bit more clear now. With allowusermoves: no, which is
the default, delete_mode: delayed doesn't work for deleting user
mailboxes. The quick patch below makes things work but I understand it's
not a clean solution. Am I supposed to enable allowusermoves explicitly
when using delete_mode: delayed? Would it make sense to add an isdeleted
flag to mboxname_isusermailbox() so the code below could check whether to
override the allowusermoves setting for delayed mailbox deletion?
Due to the lack of sane C skills I feel unable to provide a proper fix...
Thanks,
Simon
[EMAIL PROTECTED] imap]# diff -Nau mboxlist.c.ver-20071114083143 mboxlist.c
--- mboxlist.c.ver-20071114083143 2007-10-01 20:35:59.0 +0200
+++ mboxlist.c 2007-11-14 09:42:55.0 +0100
@@ -1221,7 +1221,8 @@
goto done;
}
isusermbox = 1;
- } else if (config_getswitch(IMAPOPT_ALLOWUSERMOVES)
+ } else if ((config_getswitch(IMAPOPT_ALLOWUSERMOVES) ||
+ mboxlist_delayed_delete_isenabled())
mboxname_isusermailbox(newname, 1)) {
/* Special case of renaming a user */
access = cyrus_acl_myrights(auth_state, oldacl);
@@ -1253,7 +1254,8 @@
/* Check ability to create new mailbox */
if (!partitionmove) {
if (mboxname_isusermailbox(newname, 1)) {
- if (config_getswitch(IMAPOPT_ALLOWUSERMOVES)
+ if ((config_getswitch(IMAPOPT_ALLOWUSERMOVES) ||
+ mboxlist_delayed_delete_isenabled())
mboxname_isusermailbox(oldname, 1)) {
if (!isadmin) {
/* Only admins can rename users (INBOX to INBOX) */
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Collaboration replacement via Toltec/Bynari (was How many people to admin a Cyrus system?)
Hi Rob, What are the 3 commercial Outlook plugins? Obviously the Toltec one, but which others? Toltec, Konsec and Bynari(Kolab support in beta AFIAK) There was a showstopper problem however. When I tested it seemed that Toltec would display all sub- folders of INBOX, and using annotations it would set the Calendar, Contacts, etc folders as appropriate to display those items, and all other folders to display emails, but it would not show the INBOX! At the time I asked support about this it was suggested that you should setup a POP account to download the emails from the inbox to the Local Folders PST file. This seemed to completely defeat the purpose of IMAP to me. Has that been fixed? Not a bug, but a feature :) Outlook makes a clear distinction between storage and transport. In IMAP this gets a bit blurred as the INBOX is also the mechanism for receiving new mail. Using the POP3 moves the mail from the IMAP4 INBOX to the Outlook Inbox. This is handled by both Kontact and Horde. Also out of interest, how much caching does toltec do? Basically it seems to me to get any decent performance you effectively have to download all the calendar/task/etc items from the appropriate folders and cache them all inside outlook. Any attempt to get from the server on a when needed basis seems like it would never perform well? But once the initial synchronization is done, it just updates that are done. There is no real model for skipping the initial synchronization. Best Regards Joon Radley Radley Network Technologies CC Cell: +27 (0)83 368 8557 Fax: +27 (0)12 998 4346 E-mail: [EMAIL PROTECTED] Web: www.toltec.co.za Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Re: How many people to admin a Cyrus system?
On 13 Nov 07, at 1505, David Chait wrote: One key piece of functionality that seems to be missing from every OSS solution mentioned thus far is mobile device push support (Activesync), this is not to be underestimated as it is for us, a key reason why we are ultimately being forced to adopt Exchange en-mass and abandon our current Cyrus infrastructure. There's purported to be a solution from Concilliant. http:// www.consilient.com/media/2005/c2-for-cyrus.html ian Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Collaboration replacement via Toltec/Bynari (was How many people to admin a Cyrus system?)
Not a bug, but a feature :) Outlook makes a clear distinction between storage and transport. In IMAP this gets a bit blurred as the INBOX is also the mechanism for receiving new mail. Using the POP3 moves the mail from the IMAP4 INBOX to the Outlook Inbox. This is handled by both Kontact and Horde. I admit I still don't get this at all, but that's because I admit I don't understand Outlook well. From a users perspective though, here is what I see. In Outlook by itself you can setup an IMAP server as a pure email store, and everything works just fine. You see the IMAP INBOX and all the IMAP folders and they work in the way you expect IMAP to, the server is authoriative and the client shows a cached view of the server. In Toltec, it almost works the same way, every other folder does exactly this, except you can't see the INBOX. I just don't understand why the INBOX has to be special if the standard Outlook IMAP integration works without it being? It's really very, very annoying feature, because it destroys much of the point of IMAP, which is that EVERYTHING is on the server, the client only presents a view of what's there. Downloading emails to your local client destroys the safety that IMAP buys you. But once the initial synchronization is done, it just updates that are done. There is no real model for skipping the initial synchronization. I thought that's probably the case. Does it poll/monitor folders regularly to see if there's been any updates from another client on the server, or does it only do it when you start Outlook? Rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Collaboration replacement via Toltec/Bynari (was How many people to admin a Cyrus system?)
Hi Rob, In Toltec, it almost works the same way, every other folder does exactly this, except you can't see the INBOX. I just don't understand why the INBOX has to be special if the standard Outlook IMAP integration works without it being? Outlook processes new messages to support their own calendar, task, voting and custom request. You will lose all this Outlook functionality if you imported the messages directly from the IMAP4 folder and did not use the transport mechanism. There are ways of doing this ourselves, but it is a very risky business as everything is undocumented and can change with almost every version and service pack. Does it poll/monitor folders regularly to see if there's been any updates from another client on the server, or does it only do it when you start Outlook Number of options are available: On Outlook start-up, on folder selection, automatic download based on set intervals and manually. Best Regards Joon Radley Radley Network Technologies CC Cell: +27 (0)83 368 8557 Fax: +27 (0)12 998 4346 E-mail: [EMAIL PROTECTED] Web: www.toltec.co.za Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Deleting top-level mailbox with 'delete_mode: delayed'
Simon Matter wrote: On Tue, 13 Nov 2007, Bron Gondwana wrote: I have delete_mode: immediate on the replica and delete_mode: delayed on the master. sync_server doesn't pay any attention to delete_mode, so the option shouldn't have any effect on the replica. Okay, things are a bit more clear now. With allowusermoves: no, which is the default, delete_mode: delayed doesn't work for deleting user Aha, that explains why it works in my setup. We have allowusermoves set to yes! Rudy -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Rudy Gevaert [EMAIL PROTECTED] tel:+32 9 264 4734 Directie ICT, afd. Infrastructuur Direction ICT, Infrastructure dept. Groep Systemen Systems group Universiteit Gent Ghent University Krijgslaan 281, gebouw S9, 9000 Gent, Belgie www.UGent.be -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- -- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
One more attempt: stuck processes
Hi,
I've brought up this topic before. We've been running cyrus-imapd very
happily for several years. Yet there's one issue that none of the updates
have resolved. The last time I reported it we were running 2.2.12. Now
we're running 2.3.8, but the issues is the same: POP and IMAP processes
that use TLS/SSL get stuck. My observations point towards dropped dial-up
connections as the cause. Here's an example:
[EMAIL PROTECTED] root]# strace -p 4998
Process 4998 attached - interrupt to quit
read(0, unfinished ...
Process 4998 detached
In gdb:
0x003ed41e in __read_nocancel () from /lib/tls/libc.so.6
(gdb) bt
#0 0x003ed41e in __read_nocancel () from /lib/tls/libc.so.6
#1 0x00c422f7 in BIO_new_socket () from /lib/libcrypto.so.4
#2 0x00c402b2 in BIO_read () from /lib/libcrypto.so.4
#3 0x00d26c30 in ssl3_alert_code () from /lib/libssl.so.4
#4 0x00d26dcc in ssl3_alert_code () from /lib/libssl.so.4
#5 0x00d280cf in ssl3_read_bytes () from /lib/libssl.so.4
#6 0x00d28ffc in ssl3_get_message () from /lib/libssl.so.4
#7 0x00d1ecab in ssl3_accept () from /lib/libssl.so.4
#8 0x00d1e944 in ssl3_accept () from /lib/libssl.so.4
#9 0x00d2dc9a in SSL_accept () from /lib/libssl.so.4
#10 0x00d2980d in ssl23_get_client_hello () from /lib/libssl.so.4
#11 0x00d29712 in ssl23_accept () from /lib/libssl.so.4
#12 0x00d2dc9a in SSL_accept () from /lib/libssl.so.4
#13 0x080a0a03 in idle_notify ()
#14 0x0805ef21 in idle_update ()
#15 0x08051fc6 in shut_down ()
#16 0x0804ebe4 in ?? ()
#17 0x08d53458 in ?? ()
#18 0x08d61a98 in ?? ()
#19 0x in ?? ()
(gdb)
Ultimately all processes get stuck in libc, so this might be a library
issue. My problem is that I have no way to confirm that. I've compared that
stack trace to the source and I'm confused. idle_notify() is in idle.c, and
it's very simple:
/*
* Notify idled of a mailbox change
*/
void idle_notify(struct mailbox *mailbox)
{
/* We should try to determine if we need to send this
* (ie, is an imapd is IDLE on 'mailbox'?).
*/
idle_send_msg(IDLE_NOTIFY, mailbox);
}
So why doesn't the stack trace show a call to idle_send_msg()? Shouldn't
the SSL routines be called from a procedure that actually does I/O?
Anyway, if there is anybody who has seen something like this I would like
to know about it. Also if anyone has a clue how to further debug this,
please let me know!
Thanks, Sebastian Hagedorn
--
Sebastian Hagedorn - Postmaster - RZKR-R1 (Gebäude 52), Zimmer 18
Zentrum für angewandte Informatik - Universitätsweiter Service RRZK
Universität zu Köln / Cologne University - Tel. +49-221-478-5587
Skype: shagedorn
pgpzRU0VT9Nay.pgp
Description: PGP signature
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: One more attempt: stuck processes
On Wed, Nov 14, 2007 at 04:15:13PM +0100, Sebastian Hagedorn wrote: I've brought up this topic before. We've been running cyrus-imapd very happily for several years. Yet there's one issue that none of the updates have resolved. The last time I reported it we were running 2.2.12. Now we're running 2.3.8, but the issues is the same: POP and IMAP processes that use TLS/SSL get stuck. My observations point towards dropped dial-up connections as the cause. Here's an example: Have you tried setting `tls_session_timeout' to zero in imapd.conf to disable caching of TLS sessions? I believe that that solved the problem for me, although it happened rarely. I only use `berkeley-nosync' for `duplicate_db' and `tlscache_db', but I suspected that the problem was the result of a database deadlock. -- -Gary Mills--Unix Support--U of M Academic Computing and Networking- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Re: How many people to admin a Cyrus system?
On Wed, 2007-11-14 at 13:25 +, Ian G Batten wrote: On 13 Nov 07, at 1505, David Chait wrote: One key piece of functionality that seems to be missing from every OSS solution mentioned thus far is mobile device push support (Activesync), this is not to be underestimated as it is for us, a key reason why we are ultimately being forced to adopt Exchange en-mass and abandon our current Cyrus infrastructure. There's purported to be a solution from Concilliant. http:// www.consilient.com/media/2005/c2-for-cyrus.html ian Be forewarned, last I had checked on this the licensing costs were a bit onerous IMO. The software was basically a repackaged BES with their custom client software. Z -- Zachariah Mully Director, Systems and Networks SmartBrief, Inc. [EMAIL PROTECTED] p: 202-737-5500 x226 c: 202-422-8780 f: 202-737-7577 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: v2.3.10 build fails, pcreposix problems
Upgrading PCRE to v7.4 fixed the problem. (Previous version was v6.5) From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Rosenbaum, Larry M. Sent: Tuesday, November 13, 2007 2:25 PM To: info-cyrus@lists.andrew.cmu.edu Subject: v2.3.10 build fails, pcreposix problems When trying to build Cyrus IMAP v2.3.10 on a Solaris 9 system, I get the following error: gmake[1]: Entering directory `/usr/local/src/cyrus/cyrus-imapd-2.3.10/sieve' ../com_err/et/compile_et ./sieve_err.et gcc -c -I.. -I./../lib -I../com_err/et -I/usr/local/BerkeleyDB.4.4/include -I/usr/local/ssl/include -I/usr/local/include -DHAVE_CONFIG_H -g -O2 \ sieve_err.c gcc -c -I.. -I./../lib -I../com_err/et -I/usr/local/BerkeleyDB.4.4/include -I/usr/local/ssl/include -I/usr/local/include -DHAVE_CONFIG_H -g -O2 \ sieve.c In file included from comparator.h:33, from sieve.y:38: /usr/local/include/pcreposix.h:110: error: syntax error before int /usr/local/include/pcreposix.h:111: error: syntax error before int /usr/local/include/pcreposix.h:113: error: syntax error before size_t /usr/local/include/pcreposix.h:114: error: syntax error before void gmake[1]: *** [sieve.o] Error 1 gmake[1]: Leaving directory `/usr/local/src/cyrus/cyrus-imapd-2.3.10/sieve' gmake: *** [all] Error 1 There are some definitions in pcreposix.h that depend on some #define's in pcre.h, but pcre.h isn't #include'd anywhere. Here are some relevant lines from the configure step: checking pcreposix.h usability... no checking pcreposix.h presence... yes configure: WARNING: pcreposix.h: present but cannot be compiled configure: WARNING: pcreposix.h: check for missing prerequisite headers? configure: WARNING: pcreposix.h: see the Autoconf documentation configure: WARNING: pcreposix.h: section Present But Cannot Be Compiled configure: WARNING: pcreposix.h: proceeding with the preprocessor's result configure: WARNING: pcreposix.h: in the future, the compiler will take precedence configure: WARNING: ## -- ## configure: WARNING: ## Report this to the AC_PACKAGE_NAME lists. ## configure: WARNING: ## -- ## checking for pcreposix.h... yes So the configure script finds that pcreposix.h is unusable, but uses it anyway. The build works fine on a different Solaris 9 system that doesn't have pcre installed. Is there a fix for this problem, preferable one that doesn't involve hacking code? Is there a config option to pretend pcreposix.h doesn't exist? Thanks, Larry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: LARGE single-system Cyrus installs?
Michael Bacon wrote: Solid state disk for the partition with the mailboxes database. This thing is amazing. We've got one of the gizmos with a battery backup and a RAID array of Winchester disks that it writes off to if it loses power, but the latency levels on this thing are non-existent. Writes to the mailboxes database return almost instantaneously when compared to regular spinning disks. Based on my experience, that's bound to be a much bigger chunk of time than traversing a linked list in kernel memory. For anyone doing a big Cyrus install, I would strongly recommend this. Thanks for the idea Michael. I am thinking when our Sun Dtrace testing starts, to see if I can throw in one config where the DB are run out of tmpfs in order to excercise whether latency to those databases is causing the pileup. I have also seen a posting from Pascal that ZFS mirrored configs have latency issues which may be contributing. I'm not ready to point any fingers but it certainly seems worth investigating. It's a pity I can't find any Sun SDD drives that could just slot into our existing SAN setups. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: One more attempt: stuck processes
--On 14. November 2007 09:30:45 -0600 Gary Mills [EMAIL PROTECTED] wrote: On Wed, Nov 14, 2007 at 04:15:13PM +0100, Sebastian Hagedorn wrote: I've brought up this topic before. We've been running cyrus-imapd very happily for several years. Yet there's one issue that none of the updates have resolved. The last time I reported it we were running 2.2.12. Now we're running 2.3.8, but the issues is the same: POP and IMAP processes that use TLS/SSL get stuck. My observations point towards dropped dial-up connections as the cause. Here's an example: Have you tried setting `tls_session_timeout' to zero in imapd.conf to disable caching of TLS sessions? No. While it's possible that there's some connection, I don't see it from the stack trace. I think I'd like some indication from one of the developers that caching *could* be the cause before I try that. I believe that that solved the problem for me, although it happened rarely. I only use `berkeley-nosync' for `duplicate_db' and `tlscache_db', but I suspected that the problem was the result of a database deadlock. We use skiplist, which to my mind makes it even less likely that that's the cause ... thanks for the suggestion anyway. -- .:.Sebastian Hagedorn - RZKR-R1 (Gebäude 52), Zimmer 18.:. Zentrum für angewandte Informatik - Universitätsweiter Service RRZK .:.Universität zu Köln / Cologne University - ✆ +49-221-478-5587.:. .:.:.:.Skype: shagedorn.:.:.:. pgpbKouWlbjeE.pgp Description: PGP signature Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Re: How many people to admin a Cyrus system?
On Nov 14, 2007, at 10:01, Zachariah Mully wrote: On Wed, 2007-11-14 at 13:25 +, Ian G Batten wrote: On 13 Nov 07, at 1505, David Chait wrote: One key piece of functionality that seems to be missing from every OSS solution mentioned thus far is mobile device push support (Activesync), this is not to be underestimated as it is for us, a key reason why we are ultimately being forced to adopt Exchange en-mass and abandon our current Cyrus infrastructure. There's purported to be a solution from Concilliant. http:// www.consilient.com/media/2005/c2-for-cyrus.html ian Be forewarned, last I had checked on this the licensing costs were a bit onerous IMO. The software was basically a repackaged BES with their custom client software. After trying consilient, and becoming very frustrated with it, we went with a vendor called NotifyLink for our wireless devices. Their product worked well with our crackberrys palms, integrating with Cyrus and Oracle Calendar. -rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Strange problem with timsieved 2.2.12
On Wed, 14 Nov 2007, Lukasz Michalski wrote: Hi, I am observing strange problem with timsieved daemon. This is on small mail server running cyrus-imapd 2.2.12. For most hosts, timsieved does not respond to commands at all. It sits in select() and never read any data. Data written at start of daemon is not readed to telnet client too. But I identified two good hosts for which timsieved works ok. This situation is perfectly and happens only to timsieved process. Everything else works ok. I would be grateful for any help, hints org suggestions. Here is telnet session and strace from bad host. When telnet connects to port 2000 strace outputs first line only. Rest of strace is written when I issue close command in telnet session. [EMAIL PROTECTED] ~]# telnet ssl.zork.pl 2000 Trying 195.66.73.37.2000... Connected to black.zork.pl. Escape character is '^]'. test ^] telnet cl We had a similar behavior occur that turned out to be caused by a firewall. We use a Cisco FWSM. The culprit was a fix-up for the Cisco SCCP (Skinny) protocol, which also uses port 2000. Responses from the timsieved server to the sieve client were dropped. Once we disabled the SCCP fix-up, sieve worked normally. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Strange problem with timsieved 2.2.12
Andrew Morgan pisze: We had a similar behavior occur that turned out to be caused by a firewall. We use a Cisco FWSM. The culprit was a fix-up for the Thank you very much! I've changed port from 2000 to 2002 and sieve started to work again. It looks like my provider routers/firewalls are doing something nasty to TCP sessions on port 2000. Thanks again for hint, -- Lukasz Michalski pgp key: http://www.zork.pl/lm.asc signature.asc Description: OpenPGP digital signature Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Strange problem with timsieved 2.2.12
Hi,
I am observing strange problem with timsieved daemon.
This is on small mail server running cyrus-imapd 2.2.12.
For most hosts, timsieved does not respond to commands at all. It sits in
select() and never read any data. Data written at start of daemon is not
readed to telnet client too.
But I identified two good hosts for which timsieved works ok. This situation
is perfectly and happens only to timsieved process. Everything else works ok.
I would be grateful for any help, hints org suggestions.
Here is telnet session and strace from bad host. When telnet connects to port
2000 strace outputs first line only. Rest of strace is written when I issue
close command in telnet session.
[EMAIL PROTECTED] ~]# telnet ssl.zork.pl 2000
Trying 195.66.73.37.2000...
Connected to black.zork.pl.
Escape character is '^]'.
test
^]
telnet cl
11592 20:01:04.807071 select(1, [0], NULL, NULL, {1799, 976000}) = 1 (in [0],
left {1770, 78})
11592 20:01:34.010422 time(NULL)= 1195066894
11592 20:01:34.010575 read(0, test\r\n, 4096) = 6
11592 20:01:34.010764 write(1, NO \Expected a command. Got some..., 46) =
46
11592 20:01:34.010924 time(NULL)= 1195066894
11592 20:01:34.011014 select(1, [0], NULL, NULL, {1800, 0}) = 1 (in [0], left
{1795, 764000})
11592 20:01:38.244091 time(NULL)= 1195066898
11592 20:01:38.244222 read(0, , 4096) = 0
11592 20:01:38.244343 write(1, OK \Logout Complete\\r\n, 22) = 22
11592 20:01:38.244574 munmap(0xb68fb000, 114688) = 0
11592 20:01:38.244703 close(6) = 0
11592 20:01:38.244911 munmap(0xb6942000, 32768) = 0
11592 20:01:38.245034 munmap(0xb7afe000, 98304) = 0
11592 20:01:38.245143 munmap(0xb694a000, 18563072) = 0
11592 20:01:38.245282 munmap(0xb7b16000, 663552) = 0
11592 20:01:38.245397 munmap(0xb7fce000, 8192) = 0
11592 20:01:38.245527 open(/dev/null, O_RDWR) = 6
11592 20:01:38.245679 shutdown(0, 0 /* receive */) = 0
11592 20:01:38.245786 dup2(6, 0)= 0
11592 20:01:38.245874 shutdown(1, 0 /* receive */) = 0
11592 20:01:38.245957 dup2(6, 1)= 1
11592 20:01:38.246042 shutdown(2, 0 /* receive */) = 0
11592 20:01:38.246124 dup2(6, 2)= 2
11592 20:01:38.246274 close(6) = 0
11592 20:01:38.246563 exit_group(0) = ?
Here is telnet session and strace from good host:
[EMAIL PROTECTED] ~]$ telnet ssl.zork.pl 2000
Trying 195.66.73.37.2000...
Connected to black.zork.pl.
Escape character is '^]'.
IMPLEMENTATION Cyrus timsieved v2.2.12
SASL OTP CRAM-MD5 DIGEST-MD5
SIEVE fileinto reject envelope vacation imapflags notify subaddress
relational comparator-i;ascii-numeric regex
STARTTLS
OK
test
NO Expected a command. Got something else.
^]
telnet cl
Connection closed.
11595 20:01:21.994956 waitpid(11596, [{WIFEXITED(s) WEXITSTATUS(s) == 0}],
0) = 11596
11595 20:01:21.995386 rt_sigaction(SIGINT, {SIG_DFL}, NULL, 8) = 0
11595 20:01:21.995493 rt_sigaction(SIGQUIT, {SIG_DFL}, NULL, 8) = 0
11595 20:01:21.995582 rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
11595 20:01:21.995694 --- SIGCHLD (Child exited) @ 0 (0) ---
11595 20:01:21.995798 time([1195066881]) = 1195066881
11595 20:01:21.995910 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.996063 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.996195 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.996359 send(5, 183Nov 14 20:01:21 sieve[11595..., 68,
MSG_NOSIGNAL) = 68
11595 20:01:21.996777 time([1195066881]) = 1195066881
11595 20:01:21.996876 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.997013 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.997145 stat64(/etc/localtime, {st_mode=S_IFREG|0644,
st_size=976, ...}) = 0
11595 20:01:21.997290 send(5, 183Nov 14 20:01:21 sieve[11595..., 44,
MSG_NOSIGNAL) = 44
11595 20:01:21.997609 fcntl64(4, F_GETFD) = 0
11595 20:01:21.997697 fcntl64(4, F_SETFD, FD_CLOEXEC) = 0
11595 20:01:21.997778 fcntl64(3, F_GETFD) = 0
11595 20:01:21.997857 fcntl64(3, F_SETFD, FD_CLOEXEC) = 0
11595 20:01:21.997957 getsockopt(4, SOL_SOCKET, SO_TYPE, [1], [4]) = 0
11595 20:01:21.998238 getuid32()= 76
11595 20:01:21.998348 geteuid32() = 76
11595 20:01:21.998436 getgid32()= 12
11595 20:01:21.998522 getegid32() = 12
11595 20:01:21.998700 open(/etc/sasl/Cyrus.conf, O_RDONLY) = -1 ENOENT (No
such file or directory)
11595 20:01:21.998974 getuid32()= 76
11595 20:01:21.999056 geteuid32() = 76
11595 20:01:21.999133 getgid32()= 12
11595 20:01:21.999208 getegid32() = 12
11595 20:01:21.999323 open(/usr/lib/sasl2, O_RDONLY|O_NONBLOCK|O_LARGEFILE|
O_DIRECTORY) = 6
11595 20:01:21.999438 fstat64(6, {st_mode=S_IFDIR|0755, st_size=4096, ...}) =
0
11595 20:01:21.999561 fcntl64(6, F_SETFD, FD_CLOEXEC) = 0
11595 20:01:21.999660 getdents64(6, /* 20 entries */, 4096) = 736
11595 20:01:22.94 open(/usr/lib/sasl2/libplain.la, O_RDONLY) = -1 ENOENT
(No such
Re: Deleting top-level mailbox with 'delete_mode: delayed'
Simon Matter wrote: On Tue, 13 Nov 2007, Bron Gondwana wrote: I have delete_mode: immediate on the replica and delete_mode: delayed on the master. sync_server doesn't pay any attention to delete_mode, so the option shouldn't have any effect on the replica. Okay, things are a bit more clear now. With allowusermoves: no, which is the default, delete_mode: delayed doesn't work for deleting user Aha, that explains why it works in my setup. We have allowusermoves set to yes! I have created a patch which fixes the issue for me. I also opened a bugzilla entry for it http://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3006 Would be nice if someone with better C skills than me could have a look at it. Thanks, Simon Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Re: How many people to admin a Cyrus system?
I looked into using NotifyLink with Zimbra. The cost was a bit heavy, and the only option for us would have been them hosting it. (We did not/would not have any Windows Servers/Desktops to run the software). However luckily my Manager refused to run any software that did not offer a 'linux solution'. To quote his exact words No Linux, No sale I spoke to someone who had been using NotifyLink with Cyrus for a bit later on, and he said it was initially bumpy but eventually it more or less worked better then the Blackberry Internet Service client. ... afterwards I never heard from NotifyLink again. I imagine their software was just not that portable. Scott Rob Banz wrote: After trying consilient, and becoming very frustrated with it, we went with a vendor called NotifyLink for our wireless devices. Their product worked well with our crackberrys palms, integrating with Cyrus and Oracle Calendar. -rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: LARGE single-system Cyrus installs?
On Nov 14, 2007, at 15:20, Michael Bacon wrote: Sun doesn't make any SSDs, I don't think, but while I'm not certain, I think the RamSan line (http://www.superssd.com/products/ramsan-400/) has some sort of partnership with Sun. To be honest, I'm not sure which brand we're using, but like RamSan, it's a FC disk that slots into our SAN like any other target. I'd love to find out what your dtrace output says, though. So, is it just your mailboxes db that lies on the SSD? Or your entire 'meta' partition? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: One more attempt: stuck processes
Sebastian Hagedorn wrote:
Hi,
I've brought up this topic before. We've been running cyrus-imapd very
happily for several years. Yet there's one issue that none of the
updates have resolved. The last time I reported it we were running
2.2.12. Now we're running 2.3.8, but the issues is the same: POP and
IMAP processes that use TLS/SSL get stuck. My observations point
towards dropped dial-up connections as the cause. Here's an example:
[EMAIL PROTECTED] root]# strace -p 4998
Process 4998 attached - interrupt to quit
read(0, unfinished ...
Process 4998 detached
In gdb:
0x003ed41e in __read_nocancel () from /lib/tls/libc.so.6
(gdb) bt
#0 0x003ed41e in __read_nocancel () from /lib/tls/libc.so.6
#1 0x00c422f7 in BIO_new_socket () from /lib/libcrypto.so.4
#2 0x00c402b2 in BIO_read () from /lib/libcrypto.so.4
#3 0x00d26c30 in ssl3_alert_code () from /lib/libssl.so.4
#4 0x00d26dcc in ssl3_alert_code () from /lib/libssl.so.4
#5 0x00d280cf in ssl3_read_bytes () from /lib/libssl.so.4
#6 0x00d28ffc in ssl3_get_message () from /lib/libssl.so.4
#7 0x00d1ecab in ssl3_accept () from /lib/libssl.so.4
#8 0x00d1e944 in ssl3_accept () from /lib/libssl.so.4
#9 0x00d2dc9a in SSL_accept () from /lib/libssl.so.4
#10 0x00d2980d in ssl23_get_client_hello () from /lib/libssl.so.4
#11 0x00d29712 in ssl23_accept () from /lib/libssl.so.4
#12 0x00d2dc9a in SSL_accept () from /lib/libssl.so.4
#13 0x080a0a03 in idle_notify ()
#14 0x0805ef21 in idle_update ()
#15 0x08051fc6 in shut_down ()
#16 0x0804ebe4 in ?? ()
#17 0x08d53458 in ?? ()
#18 0x08d61a98 in ?? ()
#19 0x in ?? ()
(gdb)
It looks to me like we are timing out the client while the client is
IDLEing, but we get a signal from idled in the middle of shutdown().
Try this patch.
--- imapd.c.~1.535.~2007-11-14 16:16:21.0 -0500
+++ imapd.c 2007-11-14 16:22:59.0 -0500
@@ -836,6 +836,8 @@
{
int i;
+idle_done(imapd_mailbox);
+
proc_cleanup();
i = 0;
--
Kenneth Murchison
Systems Programmer
Project Cyrus Developer/Maintainer
Carnegie Mellon University
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: LARGE single-system Cyrus installs?
Sun doesn't make any SSDs, I don't think, but while I'm not certain, I think the RamSan line (http://www.superssd.com/products/ramsan-400/) has some sort of partnership with Sun. To be honest, I'm not sure which brand we're using, but like RamSan, it's a FC disk that slots into our SAN like any other target. I'd love to find out what your dtrace output says, though. -Michael --On Wednesday, November 14, 2007 10:21 AM -0800 Vincent Fox [EMAIL PROTECTED] wrote: Michael Bacon wrote: Solid state disk for the partition with the mailboxes database. This thing is amazing. We've got one of the gizmos with a battery backup and a RAID array of Winchester disks that it writes off to if it loses power, but the latency levels on this thing are non-existent. Writes to the mailboxes database return almost instantaneously when compared to regular spinning disks. Based on my experience, that's bound to be a much bigger chunk of time than traversing a linked list in kernel memory. For anyone doing a big Cyrus install, I would strongly recommend this. Thanks for the idea Michael. I am thinking when our Sun Dtrace testing starts, to see if I can throw in one config where the DB are run out of tmpfs in order to excercise whether latency to those databases is causing the pileup. I have also seen a posting from Pascal that ZFS mirrored configs have latency issues which may be contributing. I'm not ready to point any fingers but it certainly seems worth investigating. It's a pity I can't find any Sun SDD drives that could just slot into our existing SAN setups. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: OT: Re: How many people to admin a Cyrus system?
On Nov 14, 2007, at 16:20, Scott M. Likens wrote: I looked into using NotifyLink with Zimbra. The cost was a bit heavy, and the only option for us would have been them hosting it. (We did not/would not have any Windows Servers/Desktops to run the software). We're using their hosted solution, which has the added benefit of them doing the end-user support for *insert stupid device here.* Your support folks tell you its worth every cent, if they've ever had to support every idiot and their idiot device. However luckily my Manager refused to run any software that did not offer a 'linux solution'. To quote his exact words No Linux, No sale That's a rather bad attitude to have. ;) Then again, I'm of the attitude where I go what, you don't support Solaris? ONLY Linux!? Ok, what about your windows solution again... -rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: LARGE single-system Cyrus installs?
The whole meta partition as of 1.6 (so no fancy splitting of mailbox metadata), minus the proc directory, which is on tmpfs. -Michael --On Wednesday, November 14, 2007 4:32 PM -0500 Rob Banz [EMAIL PROTECTED] wrote: On Nov 14, 2007, at 15:20, Michael Bacon wrote: Sun doesn't make any SSDs, I don't think, but while I'm not certain, I think the RamSan line (http://www.superssd.com/products/ramsan-400/) has some sort of partnership with Sun. To be honest, I'm not sure which brand we're using, but like RamSan, it's a FC disk that slots into our SAN like any other target. I'd love to find out what your dtrace output says, though. So, is it just your mailboxes db that lies on the SSD? Or your entire 'meta' partition? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Replication: problems with synctest
It looks like my problem with replication not working in one direction was a SASL thing. One of my servers was advertising GSSAPI as an authentication mechanism, but it didn't really work (I don't have Kerberos installed on my systems). Apparently, sync_client on the other box was deciding to use GSSAPI, but was giving up because it wasn't actually functional. I fixed the problem by moving the libgss* libraries out of the SASL2 library directory. While I was at it, I also moved the libntlm* and libotp* libraries out of the SASL2 library directory, since I'm not using either of these authentication methods either. I'm mildly concerned that a future software upgrade might cause these libraries to reappear. Is there a more reliable way to disable SASL authentication mechanisms, other than removing files from the library directory? -- Rich Wales === Palo Alto, CA, USA === [EMAIL PROTECTED] http://www.richw.org === http://en.wikipedia.org/wiki/User:Richwales The difference between theory and practice is that, in theory, theory and practice are identical -- whereas in practice, they aren't. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Replication: problems with synctest
Hi Rich, That truly depends on how your Unixlike (Linux) handles the package. If you're using a rpm, you may want to look into using a SRPM the next time and tweek the .spec file so it does not try and pull in ntlm and otp and gssapi. That's one thing I dislike about most package management systems. Instead of letting you decide what you want, they pull in every option it can. :( That, or when you upgrade you can upgrade using a source tarball to upgrade. Then you can disable gssapi, otp and ntlm to ensure they don't come back. Scott Rich Wales wrote: It looks like my problem with replication not working in one direction was a SASL thing. One of my servers was advertising GSSAPI as an authentication mechanism, but it didn't really work (I don't have Kerberos installed on my systems). Apparently, sync_client on the other box was deciding to use GSSAPI, but was giving up because it wasn't actually functional. I fixed the problem by moving the libgss* libraries out of the SASL2 library directory. While I was at it, I also moved the libntlm* and libotp* libraries out of the SASL2 library directory, since I'm not using either of these authentication methods either. I'm mildly concerned that a future software upgrade might cause these libraries to reappear. Is there a more reliable way to disable SASL authentication mechanisms, other than removing files from the library directory? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Replication: problems with synctest
I'm mildly concerned that a future software upgrade might cause these libraries to reappear. Is there a more reliable way to disable SASL authentication mechanisms, other than removing files from the library directory? Set sasl_mech_list to the list of mechanism you wish to support. For example, sasl_mech_list: kerberos_v4 gssapi plain anonymous -jeaton Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Replication: problems with synctest
Rich Wales wrote, at 11/14/2007 06:13 PM: It looks like my problem with replication not working in one direction was a SASL thing. One of my servers was advertising GSSAPI as an authentication mechanism, but it didn't really work (I don't have Kerberos installed on my systems). Apparently, sync_client on the other box was deciding to use GSSAPI, but was giving up because it wasn't actually functional. I fixed the problem by moving the libgss* libraries out of the SASL2 library directory. While I was at it, I also moved the libntlm* and libotp* libraries out of the SASL2 library directory, since I'm not using either of these authentication methods either. I'm mildly concerned that a future software upgrade might cause these libraries to reappear. Is there a more reliable way to disable SASL authentication mechanisms, other than removing files from the library directory? I don't use replication, but for normal authentication, I'm able to specify which mechanisms are advertised by including this in imapd.conf: sasl_mech_list: PLAIN LOGIN CRAM-MD5 DIGEST-MD5 Maybe this (or some variation) will also work for replication, and you can leave the libraries in place. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: v2.3.10 build fails, pcreposix problems
On Wed, Nov 14, 2007 at 12:16:29PM -0500, Larry Rosenbaum wrote: Upgrading PCRE to v7.4 fixed the problem. (Previous version was v6.5) Excellent - because I was a little surprised otherwise - then again I only tested on Debian Etch because that's all I have handy. Ken - I think the solution is to put: #include pcre.h directly before #include pcreposix.h in sieve/comparator.h I tested that that works fine on my systems, and looks like it will also work on systems with older PCRE that don't do the include themselves. RE: your other question - I guess it would be reasonably easy to add a --disable-pcre to configure so that it never gets tested for or included, even if it is installed. Bron. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: LARGE single-system Cyrus installs?
This thought has occurred to me: ZFS prefers reads over writes in it's scheduling. I think you can see where I'm going with this. My WAG is something related to Pascal's, namely latency. What if my write requests to mailboxes.db or deliver.db start getting stacked up, due to the favoritism shown to reads? The actual usage mix on a Cyrus system ends up being more writes than reads. Despite having channels that seem under-utilized perhaps the stacking of small latencies hits a tipping point that is causing the slowdown. We have all Cyrus lumped in one ZFS pool, with separate filesystems for imap, mail, sieve, etc. However, I do have an unused disk in each array such that I could setup a simple ZFS mirror pair for /var/cyrus/imap so that the databases are in their own pools. Or even I suppose a UFS filesystem with directio and all that jazz set. Perhaps I wouldn't get all the effects of a RAM-SAN 500 but it could be a worthwhile improvement. I liked having one big pool, but if it works, c'est la vie. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
