Re: per-user quotas
Quoting Philippe Trolliet [EMAIL PROTECTED]: Hi, in the log i see following message: ... Mar 13 12:17:41 mail lmtpunix[10500]: verify_user(novaware.de!user.p^trolliet) failed: Over quota Mar 13 12:17:41 mail postfix/pipe[10689]: E644F5E44F9: to=[EMAIL PROTECTED], relay=cyrus, delay=1, status=deferred (temporary failure) ... in one of the mailinglist archives i read sth about the error codes. my problem is that the message is not bounced and so the sender is not notified. it is stuck somewhere in the postfix-queue. i have virtual users and domains and i´m using per-user quotas stored in a mysql-db. i can set the quota for every single user. what do i have to configure that cyrus bounces the message over the lmtp if a quota exceeds? in the archives somebody said sth about the error codes too. how can i do this in the cyrus configuration? postfix will also bounce the messages on temporary failure if it could not delive the message for some time (maximal_queue_lifetime default: 5d) is there any way to tell cyrus to read the per-user quota settings from the mysql-db like in dovecot? or is this just done in postfix? you could write an perl-script which reads the data form the mysql-db and sets the quota in cyrus M.Menge Tel.: (49) 7071/29-70316 Universitaet Tuebingen Fax.: (49) 7071/29-5912 Zentrum fuer Datenverarbeitung mail: [EMAIL PROTECTED] Waechterstrasse 76 72074 Tuebingen smime.p7s Description: S/MIME krytographische Unterschrift Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: per-user quotas
Andrew Morgan wrote: On Tue, 13 Mar 2007, Philippe Trolliet wrote: you are my hero. ;) thank you. finally i´m able to test it on thursday. but it seems that cyrus knows in some way which quota the specific user has. is it possible that cyrus communicates with postfix and asks postfix about the quota of the recipient? i´ve set autocreatequota to 40 MB and in postfix i´ve set the quota for the test-account to 10MB. i send some mail with big attachments to this test account. the mailbox of the user has a size of something over 10MB now and doesn´t accept any mail. the messages aren´t delivered and deferred now. so i think there is a way cyrus talks to postfix about per-user quotas. I don't know what setting a quota in postfix does... You can view the quota in Cyrus by running cyradm and executing the command lq user.username. Andy i have these settings in postfix: /etc/postfix/main.cf: ... virtual_create_maildirsize = yes virtual_mailbox_extended = yes virtual_mailbox_limit_maps = proxy:mysql:/etc/postfix/mysql-virtual_mailbox_limit_maps.cf virtual_mailbox_limit_override = yes virtual_maildir_limit_message = Sorry, the user's maildir has overdrawn his diskspace quota, please try again later. virtual_overquota_bounce = yes ... /etc/postfix/mysql-virtual_mailbox_limit_maps.cf: user = user password = pw hosts = localhost dbname = postfixadmin query = SELECT quota FROM mailbox WHERE username='%s' in my cyrus config i have autocreatequota enabled with 40 MB. with postfixadmin i´ve set the user quota for my test account to 10MB and seems that cyrus knows in some way about this quota. but i don´t know how and why. regards philippe Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
64-bit quota again (in 2.3.8).
Hello!
I use cyrus-imapd-2.3.8. According to change log:
--
Changes to the Cyrus IMAP Server since 2.2.x
...
* Support 64-bit quota usage (both per mailbox and for the entire
quotaroot),
based on a patch from Jeremy Rumpf. Development sponsored by FastMail.
--
But something doesn't work.
I log into cyradm and see following:
192.168.0.9 sq user/[EMAIL PROTECTED] STORAGE 20
192.168.0.9 sq user/[EMAIL PROTECTED] STORAGE 30
setquota: Invalid quota list in Setquota
After little digging in sources I have found a function cmd_setquota
in imap/imapd.c:
--
/*
* Parse and perform a SETQUOTA command
* The command has been parsed up to the resource list
*/
void cmd_setquota(const char *tag, const char *quotaroot)
{
int newquota = -1;
..
c = getword(imapd_in, arg);
if (c != ')' || arg.s[0] != '\0') {
for (;;) {
..
newquota = 0;
for (p = arg.s; *p; p++) {
if (!isdigit((int) *p)) goto badlist;
newquota = newquota * 10 + *p - '0';
if (newquota 0) goto badlist; /* overflow */
}
if (c == ')') break;
}
}
..
return;
badlist:
prot_printf(imapd_out, %s BAD Invalid quota list in Setquota\r\n, tag);
eatline(imapd_in, c);
}
--
But, as you may see, variable 'newqouta' is a type of 'int' and not 'int64'
or 'long' or something greater than 32-bit.
So, the first question, what is the units used with command 'sq' of cyradm.
If bytes, than is there any patches to fix this problem?
Thanks.
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Exchange's handling of Sieve Reject
Users on two separate Exchange servers here have reported that they
don't see the reason part of messages rejected by sieve.
The Cyrus user has a reject rule. I can reproduce it simply as:
##INGO
# sieve filter generated by Ingo (March 14, 2007, 8:51 am)
require reject;
# Sieve Reject Test
if header :comparator i;ascii-casemap :contains Subject please reject
this message {
reject You want it rejected, you get it rejected.;
stop;
}
-
To see precisely what is returned, send mail to [EMAIL PROTECTED] with
the subject please reject this message. The mime message looks
syntactically correct to me, as follows:
main message is multipart/report
part 1 is text/plain
part 2 is message/disposition-notification
part 3 is message/rfc822
The Exchange messages were viewed with Outlook. Outlook users did not
see any of the message sent by Sieve, but only a new text generated by
Exchange or Outlook that looks like this:
-
From: Mail Sieve Subsystem [mailto:[EMAIL PROTECTED]
Sent: Tuesday, March 13, 2007 5:20 PM
To: [EMAIL PROTECTED]
Subject: Automatically rejected mail
Your message
To: [EMAIL PROTECTED]
Subject: test
Sent: 3/13/2007 5:19 PM
was deleted without being read on 3/13/2007 5:20 PM.
-
One of our staff looked at one of the message also with Evolution, and
reported a *variant* form of the above message, making me wonder what
data Exchange is sending to the client. It looks like this:
-
Your message
To: [EMAIL PROTECTED]
Subject: test attachment
Sent:Tue, 13 Mar 2007 17:18:41 -0400
was not readTue, 13 Mar 2007 17:20:06 -0400?
mail disposition
report attachment
Content-Type: message/disposition-notification
Content-Transfer-Encoding: 7bit
Final-Recipient: RFC822; [EMAIL PROTECTED]
Disposition: automatic-action/MDN-sent-automatically; deleted
Original-Message-ID:
[EMAIL PROTECTED]
-
Notice the changes in the line spacing, the Sent: line, the was line,
and the inclusion here of the text from mime part 2. Evolution also
indicated the presence of a dat attachment after this, which the Outlook
users did not see.
We did not yet test what Outlook shows when it reads as an imap client
off the Cyrus server. All the above was read off an Exchange server.
Possible fixes would be to format the rejection like a reply or a
forwarded message, or plain text, but it would be pretty dumb. Has
anyone else dealt with this at all? Any bright ideas?
Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: 64-bit quota again (in 2.3.8).
-- Igor Zhbanov [EMAIL PROTECTED] is rumored to have mumbled on 14. März 2007 15:03:51 +0300 regarding 64-bit quota again (in 2.3.8).: But, as you may see, variable 'newqouta' is a type of 'int' and not 'int64' or 'long' or something greater than 32-bit. So, the first question, what is the units used with command 'sq' of cyradm. It's kilobytes. -- Sebastian Hagedorn - RZKR-R1 (Flachbau), Zi. 18, Robert-Koch-Str. 10 Zentrum für angewandte Informatik - Universitätsweiter Service RRZK Universität zu Köln / Cologne University - Tel. +49-221-478-5587 pgpAmGyhBQHGg.pgp Description: PGP signature Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Posting usenet news articles
I hope someone can help me with this problem. I've managed to get som newsgroups into Cyrus and I can read them with my e-mail client and with a netnews client. I can post new messages, but they do not get forwarded to my usenet peer. The only part of the configuration that seems important is: # News setup partition-news: /var/spool/cyrus/news newsspool: /var/spool/news newsprefix: netnews newspeer: @news.versatel.nl:*,!control.*,@local.* newspostuser: netnews I have no real clue where to start looking ehh help? Greetings, Micha Kersloot Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Posting usenet news articles
I hope someone can help me with this problem. I've managed to get som newsgroups into Cyrus and I can read them with my e-mail client and with a netnews client. I can post new messages, but they do not get forwarded to my usenet peer. The only part of the configuration that seems important is: # News setup partition-news: /var/spool/cyrus/news newsspool: /var/spool/news newsprefix: netnews newspeer: @news.versatel.nl:*,!control.*,@local.* newspostuser: netnews I have no real clue where to start looking ehh help? -- Met vriendelijke groet, Micha Kersloot Controleer uw eigen IT. http://www.own-it.nl/ Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Exchange's handling of Sieve Reject
--On March 14, 2007 9:27:03 AM -0400 Joseph Brennan [EMAIL PROTECTED]
wrote:
Users on two separate Exchange servers here have reported that they
don't see the reason part of messages rejected by sieve.
I've seen this and got the recipient to fix their server. See:
http://support.microsoft.com/kb/842120/
-David
The Cyrus user has a reject rule. I can reproduce it simply as:
## INGO
# sieve filter generated by Ingo (March 14, 2007, 8:51 am)
require reject;
# Sieve Reject Test
if header :comparator i;ascii-casemap :contains Subject please
reject this message {
reject You want it rejected, you get it rejected.;
stop;
}
-
To see precisely what is returned, send mail to [EMAIL PROTECTED] with
the subject please reject this message. The mime message looks
syntactically correct to me, as follows:
main message is multipart/report
part 1 is text/plain
part 2 is message/disposition-notification
part 3 is message/rfc822
The Exchange messages were viewed with Outlook. Outlook users did not
see any of the message sent by Sieve, but only a new text generated by
Exchange or Outlook that looks like this:
-
From: Mail Sieve Subsystem [mailto:[EMAIL PROTECTED]
Sent: Tuesday, March 13, 2007 5:20 PM
To: [EMAIL PROTECTED]
Subject: Automatically rejected mail
Your message
To: [EMAIL PROTECTED]
Subject: test
Sent: 3/13/2007 5:19 PM
was deleted without being read on 3/13/2007 5:20 PM.
-
One of our staff looked at one of the message also with Evolution, and
reported a *variant* form of the above message, making me wonder what
data Exchange is sending to the client. It looks like this:
-
Your message
To: [EMAIL PROTECTED]
Subject: test attachment
Sent:Tue, 13 Mar 2007 17:18:41 -0400
was not readTue, 13 Mar 2007 17:20:06 -0400?
mail disposition
report attachment
Content-Type: message/disposition-notification
Content-Transfer-Encoding: 7bit
Final-Recipient: RFC822; [EMAIL PROTECTED]
Disposition: automatic-action/MDN-sent-automatically; deleted
Original-Message-ID:
[EMAIL PROTECTED]
-
Notice the changes in the line spacing, the Sent: line, the was line,
and the inclusion here of the text from mime part 2. Evolution also
indicated the presence of a dat attachment after this, which the Outlook
users did not see.
We did not yet test what Outlook shows when it reads as an imap client
off the Cyrus server. All the above was read off an Exchange server.
Possible fixes would be to format the rejection like a reply or a
forwarded message, or plain text, but it would be pretty dumb. Has
anyone else dealt with this at all? Any bright ideas?
Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
QUestions... need Sieve primer
Hello all, I am familiar with what Sieve does, but have never used it. We now have a need, and I'm struggling to find info on sieve, particularly relating to Cyrus. I want a sieve script that moves all mail marked as junk by spam assassin (x-spam-flag) into the Junk folder (for only one of 4 domains we host). Is this possible, and if so, is there a good place to look for help? I know my Cyrus has sieve support and the directories are defined, but I don't know how to enable or install the script, and I have few questions on sieve scripting in general. Suggestions? -- Jason Bailey, Web/IT Administrator Sun Advocate / Emery County Progress [EMAIL PROTECTED] / [EMAIL PROTECTED] (435) 637-0732 (ext 31) Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: QUestions... need Sieve primer
Hi Jason,
is that what you want?
# Mail rules to file Junk
require [fileinto];
if allof (header :contains X-Spam-Flag YES) {
fileinto INBOX.Junk;
}
Best regards
Roland
Jason Bailey, Sun Advocate Webmaster wrote:
Hello all,
I am familiar with what Sieve does, but have never used it. We now
have a need, and I'm struggling to find info on sieve, particularly
relating to Cyrus.
I want a sieve script that moves all mail marked as junk by spam
assassin (x-spam-flag) into the Junk folder (for only one of 4
domains we host).
Is this possible, and if so, is there a good place to look for help? I
know my Cyrus has sieve support and the directories are defined, but I
don't know how to enable or install the script, and I have few
questions on sieve scripting in general.
Suggestions?
smime.p7s
Description: S/MIME Cryptographic Signature
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Questions... need Sieve primer
Roland Felnhofer wrote:
Hi Jason,
is that what you want?
# Mail rules to file Junk
require [fileinto];
if allof (header :contains X-Spam-Flag YES) {
fileinto INBOX.Junk;
}
Best regards
Roland
Jason Bailey, Sun Advocate Webmaster wrote:
Hello all,
I am familiar with what Sieve does, but have never used it. We now
have a need, and I'm struggling to find info on sieve, particularly
relating to Cyrus.
I want a sieve script that moves all mail marked as junk by spam
assassin (x-spam-flag) into the Junk folder (for only one of 4 domains
we host).
Is this possible, and if so, is there a good place to look for help?
I know my Cyrus has sieve support and the directories are defined, but I
don't know how to enable or install the script, and I have few questions
on sieve scripting in general.
Suggestions?
I think so, except I need it to only apply to one mail domain. In other
words, if recipient is part of domain.com1, and X-Spam-Flag is set to
YES, move it into the junk - otherwise do nothing. The reasoning is that
the other domains we host are entirely POP3 based, and mail moved into
junk folders on the server could be detrimental to their work flow.
I have been doing some reading in the mean time, and discovered
sieveshell. Unfortunately, it doesn't allow me to login.
unable to connect to server at /usr/bin/sieveshell line 174, STDIN
line 1.
I checked the logs and it says:
Mar 14 17:08:16 fs2 sieve[2714]: executed
Mar 14 17:08:16 fs2 sieve[2714]: accepted connection
Mar 14 17:08:19 fs2 sieve[2714]: no secret in database
Mar 14 17:08:19 fs2 sieve[2714]: badlogin: localhost[127.0.0.1] CRAM-MD5
authentication failure
Mar 14 17:08:22 fs2 sieve[2714]: badlogin: localhost[127.0.0.1] LOGIN
authentication failure
Cyrus is set up to use /etc/sasldb2 for authentication. This is where
I'm the most incapable when it comes to Cyrus. I'm lucky I even got the
software to do what it does now.
In my imapd.conf, I have:
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
sievedir: /var/lib/sieve
admins: cyrus
allowanonymouslogin: no
reject8bit: no
quotawarn: 90
timeout: 30
poptimeout: 10
dracinterval: 0
drachost: localhost
#sasl_pwcheck_method: saslauthd
lmtp_overquota_perm_failure: no
lmtp_downcase_rcpt: yes
virtdomains: userid
loginrealms: domain1.com domain2.com domain3.com
autocreatequota: 102400
quotawarnkb: 5120
unixhierarchysep: yes
altnamespace: yes
allowplaintext: yes
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN LOGIN CRAM-MD5
saslauthd is set up to use pam and is running (the default config for
the rpm). I have /etc/pam.d/imap and /etc/pam.d/sieve. But given I am
using /etc/sasldb2, shouldn't it look there before defaulting to
saslauthd in the first place?
I am running SLES 10 on x86_64 (EM64T)
Jason Bailey, Web/IT Administrator
Sun Advocate / Emery County Progress
[EMAIL PROTECTED] / [EMAIL PROTECTED]
(435) 637-0732 (ext 31)
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Questions... need Sieve primer
On Wed, Mar 14, 2007 at 05:34:52PM -0600, Jason Bailey, Sun Advocate Webmaster
wrote:
Roland Felnhofer wrote:
Hi Jason,
is that what you want?
# Mail rules to file Junk
require [fileinto];
if allof (header :contains X-Spam-Flag YES) {
fileinto INBOX.Junk;
}
Best regards
Roland
Jason Bailey, Sun Advocate Webmaster wrote:
Hello all,
I am familiar with what Sieve does, but have never used it. We now
have a need, and I'm struggling to find info on sieve, particularly
relating to Cyrus.
I want a sieve script that moves all mail marked as junk by spam
assassin (x-spam-flag) into the Junk folder (for only one of 4 domains
we host).
Is this possible, and if so, is there a good place to look for help?
I know my Cyrus has sieve support and the directories are defined, but I
don't know how to enable or install the script, and I have few questions
on sieve scripting in general.
Suggestions?
I think so, except I need it to only apply to one mail domain. In other
words, if recipient is part of domain.com1, and X-Spam-Flag is set to
YES, move it into the junk - otherwise do nothing. The reasoning is that
the other domains we host are entirely POP3 based, and mail moved into
junk folders on the server could be detrimental to their work flow.
Sieve is applied per mailbox, not across the whole server. To upload
and enable the sieve script 'mysieve' for mailbox 'joebloggs':
$ sieveshell -a joebloggs -u joebloggs cyrusserver
# Enter joebloggs IMAP / POP password
put mysieve
activate mysieve
list
mysieve - active script
You will have to tune the contents of 'mysieve' to your needs, if you
google 'spamassassin sieve' you should find plenty of examples.
Malc
I have been doing some reading in the mean time, and discovered
sieveshell. Unfortunately, it doesn't allow me to login.
unable to connect to server at /usr/bin/sieveshell line 174, STDIN
line 1.
I checked the logs and it says:
Mar 14 17:08:16 fs2 sieve[2714]: executed
Mar 14 17:08:16 fs2 sieve[2714]: accepted connection
Mar 14 17:08:19 fs2 sieve[2714]: no secret in database
Mar 14 17:08:19 fs2 sieve[2714]: badlogin: localhost[127.0.0.1] CRAM-MD5
authentication failure
Mar 14 17:08:22 fs2 sieve[2714]: badlogin: localhost[127.0.0.1] LOGIN
authentication failure
Cyrus is set up to use /etc/sasldb2 for authentication. This is where
I'm the most incapable when it comes to Cyrus. I'm lucky I even got the
software to do what it does now.
In my imapd.conf, I have:
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
sievedir: /var/lib/sieve
admins: cyrus
allowanonymouslogin: no
reject8bit: no
quotawarn: 90
timeout: 30
poptimeout: 10
dracinterval: 0
drachost: localhost
#sasl_pwcheck_method: saslauthd
lmtp_overquota_perm_failure: no
lmtp_downcase_rcpt: yes
virtdomains: userid
loginrealms: domain1.com domain2.com domain3.com
autocreatequota: 102400
quotawarnkb: 5120
unixhierarchysep: yes
altnamespace: yes
allowplaintext: yes
sasl_pwcheck_method: auxprop
sasl_mech_list: PLAIN LOGIN CRAM-MD5
saslauthd is set up to use pam and is running (the default config for
the rpm). I have /etc/pam.d/imap and /etc/pam.d/sieve. But given I am
using /etc/sasldb2, shouldn't it look there before defaulting to
saslauthd in the first place?
I am running SLES 10 on x86_64 (EM64T)
Jason Bailey, Web/IT Administrator
Sun Advocate / Emery County Progress
[EMAIL PROTECTED] / [EMAIL PROTECTED]
(435) 637-0732 (ext 31)
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
--
Malcolm Locke - Systems Administrator, http://www.e2-media.co.nz/
Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
IOERROR: fstating sieve script ??
Hi All, I am used the autocreatepatch 2.3.1. It works fine. But when a mailbox created my /var/log/syslog shows the following error. Let me know why this happened and how to fix it. - Mar 14 12:28:43 cyrus lmtpunix[12454]: IOERROR: fstating sieve script /var/spool/sieve/d/divya/defaultbc: No such file or directory. -- Here I am pasting the imapd.conf file related to sieve. --- sieveusehomedir: false sievedir: /var/spool/sieve - What should I do to fix this problem ? -- Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
FastMail.FM patchset - new patches
All the patches mentioned here are available for download at: http://cyrus.brong.fastmail.fm/ We've been busy working on a bunch of cyrus issues since I last posted. In particular things we have hit cleaning up from the sync_server left files lying around after a bail out that caused random messages to be overwritten a lot later bug. Ken - some of these are definite candidates for upstream. As much as possible we've made new behaviour optional with the default being the current behaviour. REMAINING ON MY TODO LIST: == * undoable DELETE * investigate why data path directories aren't always being created for domainsplit users but meta paths are on the replica. * use the MD5 based UUID and the RFC822.MD5 to do spot-checks in our checkreplication script, similarly RFC822.SIZE and RFC822.FILESIZE. * expand logging for message delivery to include the UUID and UID of the delivered message. WHAT'S NEW: === * Make UUIDs work at all. The initialisation order of the UUID subsystem was wrong, so we had very few messages with a non-zero UUID. Also, the documentation for provide_uuid was misleading/ difficult to understand. Make that clearer. * MD5 UUIDs - we've created a new scheme for UUID generation, of the format: 02[first 11 bytes of message file md5]. This allows some basic integrity checking of the file on disk, and is still plenty random. Also adds the non standard IMAP FETCHable items UUID, RFC822.MD5 (calculated on the fly), RFC822.FILESIZE (does a stat or looks at the MMAP result if something else needs it) * Abort sync on mismatched UUIDs (to go with above) - make failover much safer to avoid deleting files that got delivered while the other machine was the replica. * windows-1250/1251/1255 codepages - some users we having trouble searching for things in messages with these codepages. I believe this is already accepted upstream. * pcreposix - use the PCRE engine for regexp matching in sieve. The gnu posix library had some nasty edge case behaviour which we're hoping won't exist in the prce library. * sync_client permissions check - I thought this had gone in upstream but must have been missed. Ken, please apply this one, it's a really obvious typo fix! * Set internal date based on first Received header - this one is probably a lot more controversial - but we have a pile of messages all with an internaldate of November 2005 when we restored from backups and lost all internaldate information. We also have a pile with bogus values thanks to having had mtimes way out due to being on a replica. * Speaking of which, there's a patch to set the mtime of the file on the replica based on the internaldate as well! We try to keep all these values in sync so re-creating the internaldate correctly is much easier. * RENAME INBOX. It's a cow no matter how you look at it, broken in one way or another, but the thing that hurt us was that it broke replication. The patch we chose makes replication work again at the expense of losing all seen state for the copied messages. The alternative was much more invasive, because sync_server does the rename operation as the admin user and they don't get the special treatment. Man I hate special cases. Moo. * Statuscache. There has been a pretty major rewrite. It's a lot faster for the common case now, because it avoids statting the seen file, opting instead to make all codepaths that affect the seen file also delete the associated statuscache record. Faster reads, slightly slower writes for the seen DB. Guess what our users do more of. Regards, Bron. -- Bron Gondwana [EMAIL PROTECTED] Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Skiplist feedback (was: BerkeleyDB problems, converting away)
Good morning I understood that you wanted to hear feedback from users about skiplist. A couple of weeks ago I converted all remaining cyrus databases to skiplist. The conversion went fine and skiplist is working very well. I got rid of berleleydb errors and I am happy :) I can recommend this to anybody who does not like berkeleydb. I used this simple conversion script ---8--- #!/bin/sh /etc/init.d/cyrus2.2 stop cd /root/cyrus-tietokantakonversio/ cp /var/lib/cyrus/deliver.db /root/cyrus-tietokantakonversio/berkeleydb-vanhat cp /var/lib/cyrus/tls_sessions.db /root/cyrus-tietokantakonversio/berkeleydb-vanhat cp -r /var/lib/cyrus/db/ /root/cyrus-tietokantakonversio/berkeleydb-vanhat cp berkeleydb-vanhat/deliver.db ./deliver.db.berkeley cp berkeleydb-vanhat/tls_sessions.db ./tls_sessions.db.berkeley /usr/sbin/cvt_cyrusdb /root/cyrus-tietokantakonversio/deliver.db.berkeley berkeley /root/cyrus-tietokantakonversio/deliver.db.skiplist skiplist /usr/sbin/cvt_cyrusdb /root/cyrus-tietokantakonversio/tls_sessions.db.berkeley berkeley /root/cyrus-tietokantakonversio/tls_sessions.db.skiplist skiplist cp imapd.conf.skiplist /etc/imapd.conf cp deliver.db.skiplist /var/lib/cyrus/deliver.db cp tls_sessions.db.skiplist /var/lib/cyrus/tls_sessions.db rm -f /var/lib/cyrus/db/log.* /etc/init.d/cyrus2.2 start ---8--- Cyrus developers, please, change the defaults to skiplist, or anything else than berkeleydb. At least in this use berkeleydb seems to be really crappy, and I personally find stupid defaults very annoying, especially when changing them afterwards might be risky. Some background info about server: ~50 users, ~50 GB mail, ~1500 incoming messages/day. So not very busy one. Decent server hardware. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
