Re: Some part of bug from 2.3.4 still in 2.3.5
On Thu, 25 May 2006 09:00:36 -0400, Ken Murchison [EMAIL PROTECTED] said:
Robert Mueller wrote:
Hi Ken
There's still a serious bug in 2.3.5 that causes copied messages to be
pseudo invisible in the moved to folder. I can reproduce it as follows:
Have you uncovered any other bugs that need to be fixed before I
embarrass myself again by making a premature 2.3.6 release?
*cough* (line numbers may vary, I'm working on a patched source set
here).
Symptom: reconstruct of a newly copied user fails with:
...
May 26 00:15:17 imap5 reconstruct[12807]: IOERROR: locking cache for
user.foobarbaz: Bad file descriptor
May 26 00:15:17 imap5 reconstruct[12807]: IOERROR: locking cache for
user.foobarbaz.Drafts: Bad file descriptor
May 26 00:15:17 imap5 reconstruct[12807]: IOERROR: locking cache for
user.foobarbaz.Trash: Bad file descriptor
...
So, it appears that in mailbox_open_index:
mailbox.c:628 if (mailbox_doing_reconstruct) break;
means we don't run:
mailbox.c:636 mailbox-cache_fd = open(fname-buf, O_RDWR, 0);
But in mailbox_upgrade_index:
mailbox.c:1696 r = mailbox_lock_pop(mailbox);
We go ahead and try to lock pop. Unfortunately, lock_pop actually
locks (you guessed it) cache_fd.
The attached patch protects mailbox_lock_pop and mailbox_unlock_pop
so that they turn into a noop when mailbox_doing_reconstruct is set.
Of the various approaches, this seemed the sanest to me - since they
can't possibly work without a cache_fd and you'll never have one
when in reconstruct mode. I don't know enough about reconstruct to
go the alternative route (actually creating a cache_fd back up in
mailbox_open_index)
This is fine for us, because we generally lock users from logging in
when we're running reconstructs on them anyway.
Bron.
--
Bron Gondwana
[EMAIL PROTECTED]
diff -ur --new-file cyrus-imapd-2.3.6.orig/imap/mailbox.c cyrus-imapd-2.3.6/imap/mailbox.c
--- cyrus-imapd-2.3.6.orig/imap/mailbox.c 2006-05-23 09:09:37.0 -0400
+++ cyrus-imapd-2.3.6/imap/mailbox.c 2006-05-26 01:27:42.0 -0400
@@ -1121,6 +1121,10 @@
{
int r = -1;
+/* we don't have a cache_fd in reconstruct mode, so we can't lock
+ * pop */
+if (mailbox_doing_reconstruct) return 0;
+
if (mailbox-pop_lock_count++) return 0;
r = lock_nonblocking(mailbox-cache_fd);
@@ -1173,6 +1177,10 @@
mailbox_unlock_pop(mailbox)
struct mailbox *mailbox;
{
+/* we don't have a cache_fd in reconstruct mode, so we can't lock
+ * pop */
+if (mailbox_doing_reconstruct) return;
+
assert(mailbox-pop_lock_count != 0);
if (--mailbox-pop_lock_count == 0) {
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
SRS in cyrus sieve
Hi, I am using cyrus-imapd-2.2.12-3 on centos. How can I enable SRS address rewriting in sieve I want all redirected mails ( vacation or forward ) to go with ids from my domain instead of ids of the from domain Thanks Ram Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Routing messages to subfolders
I run cyrus+postfix+fetchmail and i have a problem with mail routing to subfolders.Say , 4 example I have a mailbox user.test then I create user.test.linux and I assign the permission p to anyone 2 both folders i.e user.test and user.test.linux but when I send e-mail to [EMAIL PROTECTED] it only ends up in user.test not in user.test.linux. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Routing messages to subfolders
I run cyrus+postfix+fetchmail and i have a problem with mail routing to subfolders.Say , 4 example I have a mailbox user.test then I create user.test.linux and I assign the permission p to anyone 2 both folders i.e user.test and user.test.linux but when I send e-mail to [EMAIL PROTECTED] it only ends up in user.test not in user.test.linux. Siqhamo Sifo Linux Administrator NewLunar Technology Solutions 5th Floor SmartXchange 5 Walnut Road Durban http://www.newlunar.co.za Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus IMAPd 2.3.6 Released
On 05/25/2006 07:01 PM, Ken Murchison wrote: I am pleased (embarrassed) to announce the release of Cyrus IMAPd 2.3.6. This is a BETA-quality release, reflecting that it has significant numbers of new features that have not been tested on a wide-scale basis, although earlier versions of this code have been running at several sites for quite some time. This release fixes a bug in 2.3.[45] which caused copied messages to not be displayed by clients. My apologies to all of the early adopters that have been inconvenienced by this bug. Mailboxes that had messages copied into them by 2.3.[45] imap will need to be reconstructed. For full details, please see doc/changes.html and doc/install-upgrade.html which are included in the distribution. URLs for this release: ftp://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.6.tar.gz or http://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.6.tar.gz Works like a charm. I'm happy, that I didn't try 2.3.[4,5], because I had to fix my patches first... :-) -of Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus IMAPd 2.3.6 Released
Lenny wrote: Will this version seemlessly upgrade from 2.3.3 or will a reconstruct have to be run on each mailbox? It should upgrade mailboxes on the fly with out requiring a reconstruct. Quoting Ken Murchison [EMAIL PROTECTED]: I am pleased (embarrassed) to announce the release of Cyrus IMAPd 2.3.6. This is a BETA-quality release, reflecting that it has significant numbers of new features that have not been tested on a wide-scale basis, although earlier versions of this code have been running at several sites for quite some time. This release fixes a bug in 2.3.[45] which caused copied messages to not be displayed by clients. My apologies to all of the early adopters that have been inconvenienced by this bug. Mailboxes that had messages copied into them by 2.3.[45] imap will need to be reconstructed. For full details, please see doc/changes.html and doc/install-upgrade.html which are included in the distribution. URLs for this release: ftp://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.6.tar.gz or http://ftp.andrew.cmu.edu/pub/cyrus/cyrus-imapd-2.3.6.tar.gz Questions and comments can be directed to info-cyrus@lists.andrew.cmu.edu (public list), or [EMAIL PROTECTED] --Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
base64 decoding error again in 2.2?
Hi I am using cyrus-imapd-2.2.13_1 build from FreeBSD ports. Seems like *test tools are affected again(*) pop3test -u test1 10.10.10.1 S: +OK 10.10.10.1 Cyrus POP3 v2.2.13 server ready [EMAIL PROTECTED] C: CAPA S: +OK List of capabilities follows S: SASL DIGEST-MD5 CRAM-MD5 S: STLS S: EXPIRE 0 S: LOGIN-DELAY 0 S: TOP S: UIDL S: PIPELINING S: RESP-CODES S: AUTH-RESP-CODE S: USER S: IMPLEMENTATION Cyrus POP3 server v2.2.13 S: . C: AUTH DIGEST-MD5 S: + bm9uY2U9Ikt4Vk1FK1FCeHNrN09YcEszTzh1Lzg2OUJNZ25wRVVhSG9JZUpFT0J3Wms9IixyZWFsbT0iMTAuMTAuMTAuMSIscW9wPSJhdXRoLGF1dGgtaW50LGF1dGgtY29uZiIsY2lwaGVyPSJyYzQtNDAscmM0LTU2LHJjNCxkZXMsM2RlcyIsbWF4YnVmPTQwOTYsY2hhcnNldD11dGYtOCxhbGdvcml0aG09bWQ1LXNlc3M= base64 decoding error Authentication failed. generic failure Security strength factor: 0 imtest -u test1 -a test1 10.10.10.1 S: * OK 10.10.10.1 Cyrus IMAP4 v2.2.13 server ready C: C01 CAPABILITY S: * CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ MAILBOX-REFERRALS NAMESPACE UIDPLUS ID NO_ATOMIC_RENAME UNSELECT CHILDREN MULTIAPPEND BINARY SORT THREAD=ORDEREDSUBJECT THREAD=REFERENCES ANNOTATEMORE IDLE STARTTLS AUTH=DIGEST-MD5 AUTH=CRAM-MD5 SASL-IR X-NETSCAPE S: C01 OK Completed C: A01 AUTHENTICATE DIGEST-MD5 S: + bm9uY2U9InR5TVYvRmhCNCt0bXV0RWc1ZE5NZ2VEaU5QV2dNaUV1Rk0vMkJkR3JOM009IixyZWFsbT0iMTAuMTAuMTAuMSIscW9wPSJhdXRoLGF1dGgtaW50LGF1dGgtY29uZiIsY2lwaGVyPSJyYzQtNDAscmM0LTU2LHJjNCxkZXMsM2RlcyIsbWF4YnVmPTQwOTYsY2hhcnNldD11dGYtOCxhbGdvcml0aG09bWQ1LXNlc3M= base64 decoding error Authentication failed. generic failure Security strength factor: 0 (*) I searched archives and found reports showing same effect in 2.2.6. It was supposedly fixed in 2.2.7. M. -- Miroslaw Psyborg Jaworski GCS/IT d- s+:+ a C++$ UBI$ P+++$ L- E--- W++(+++)$ N++ o+ K- w-- O- M- V- PS+ PE++ Y+ PGP t 5? X+ R++ !tv b++(+++) DI++ D+ G e* h++ r+++ y? Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
good cyrus installation howto
Hi there, might somebody send me to a good cyrus installation howto for a first timer. CHeers, Noah Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: good cyrus installation howto
Hi Noah, if you get a good response, please share it with me. Thanks, Jerry -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Noah Sent: Friday, May 26, 2006 7:04 PM To: cyrus Subject: good cyrus installation howto Hi there, might somebody send me to a good cyrus installation howto for a first timer. CHeers, Noah Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: base64 decoding error again in 2.2?
On Fri, May 26, 2006 at 03:04:39PM +0200, Miros?aw Jaworski wrote: Hi I am using cyrus-imapd-2.2.13_1 build from FreeBSD ports. Seems like *test tools are affected again(*) Did you just happen to have updated cyrus-sasl to 2.1.22? Checkout this thread and the patch at the end: Hmm, cyrus-sasl mailing list archives down it seems. Well, you can get the cyrus-imapd (yes, imapd) patch here: http://cvs.mandriva.com/cgi-bin/cvsweb.cgi/SPECS/cyrus-imapd/cyrus-imapd-2.2.12-saslcompatfix.patch imtest was relying on a bug that got fixed in sasl-2.1.22. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: base64 decoding error again in 2.2?
On Fri, 2006-05-26 at 10:46 -0300, Andreas Hasenack wrote: I am using cyrus-imapd-2.2.13_1 build from FreeBSD ports. Seems like *test tools are affected again(*) Did you just happen to have updated cyrus-sasl to 2.1.22? Checkout this thread and the patch at the end: I withdraw with 2.3.x testing, just made fresh chroot's for 2.2. Indeed, cyrus-sasl made to 2.1.22 meanwhile and that's the version i have installed. Thank you very much. M. -- Miroslaw Psyborg Jaworski GCS/IT d- s+:+ a C++$ UBI$ P+++$ L- E--- W++(+++)$ N++ o+ K- w-- O- M- V- PS+ PE++ Y+ PGP t 5? X+ R++ !tv b++(+++) DI++ D+ G e* h++ r+++ y? Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Routing messages to subfolders
Duplicate suppression. Messages with duplicate Message-ID's only get delivered once. --On May 26, 2006 10:44:40 AM +0200 Siqhamo Sifo [EMAIL PROTECTED] wrote: I run cyrus+postfix+fetchmail and i have a problem with mail routing to subfolders.Say , 4 example I have a mailbox user.test then I create user.test.linux and I assign the permission p to anyone 2 both folders i.e user.test and user.test.linux but when I send e-mail to [EMAIL PROTECTED] it only ends up in user.test not in user.test.linux. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Genius might be described as a supreme capacity for getting its possessors into trouble of all kinds. -- Samuel Butler Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
v2.3.6 message delete causes signal 10
I have just installed Cyrus IMAP v2.3.6 on a test system. Whenever I try to delete a message in my INBOX, the delete fails and I see the following message in the log file: May 26 11:41:01 master[10821]: [ID 970914 local6.error] process 10841 exited, signaled to death by 10 This happens whether or not expunge_mode: delayed is set. This is on Solaris 8 with the following setup: name : Cyrus IMAPD version: v2.3.6 2006/05/25 15:21:49 vendor : Project Cyrus support-url: http://asg.web.cmu.edu/cyrus os : SunOS os-version : 5.8 environment: Built w/Cyrus SASL 2.1.22 Running w/Cyrus SASL 2.1.22 Built w/Sleepycat Software: Berkeley DB 4.4.20: (January 10, 2006) Running w/Sleepycat Software: Berkeley DB 4.4.20: (January 10, 2006) Built w/OpenSSL 0.9.8a 11 Oct 2005 Running w/OpenSSL 0.9.8a 11 Oct 2005 CMU Sieve 2.3 mmap = shared lock = fcntl nonblock = fcntl idle = idled Cyrus IMAP v2.3.3 (with sasl v2.1.21) ran fine. Any ideas? Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: v2.3.6 message delete causes signal 10
Rosenbaum, Larry M. wrote: I have just installed Cyrus IMAP v2.3.6 on a test system. Whenever I try to delete a message in my INBOX, the delete fails and I see the following message in the log file: May 26 11:41:01 master[10821]: [ID 970914 local6.error] process 10841 exited, signaled to death by 10 This happens whether or not expunge_mode: delayed is set. This is on Solaris 8 with the following setup: name : Cyrus IMAPD version: v2.3.6 2006/05/25 15:21:49 vendor : Project Cyrus support-url: http://asg.web.cmu.edu/cyrus os : SunOS os-version : 5.8 environment: Built w/Cyrus SASL 2.1.22 Running w/Cyrus SASL 2.1.22 Built w/Sleepycat Software: Berkeley DB 4.4.20: (January 10, 2006) Running w/Sleepycat Software: Berkeley DB 4.4.20: (January 10, 2006) Built w/OpenSSL 0.9.8a 11 Oct 2005 Running w/OpenSSL 0.9.8a 11 Oct 2005 CMU Sieve 2.3 mmap = shared lock = fcntl nonblock = fcntl idle = idled Cyrus IMAP v2.3.3 (with sasl v2.1.21) ran fine. Any ideas? Can you get a backtrace from a core dump? -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Bron Gondwana wrote: I've finally split out all the patches that we use here into individual items. Comments on the non-local ones: - cyrus-8bit-2.3.3.diff Applied to CVS. - cyrus-anyone-2.3.3.diff If you want to complete the documentation, I'll consider applying the patch. - cyrus-commandtimer-2.3.3.diff This looks useful, and I'll probably commit it. - cyrus-defaultfix-2.3.3.diff Already fixed in CVS. - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? - cyrus-imapd-2.3.1-autoreply-0.1-0.diff The Sieve notify is undergoing a lot of changes, so I'll probably wait until the dust settles. - cyrus-isdigit-2.3.3.diff This seems like an OS problem rather than a Cyrus problem. Have you taken this up with the Debian folks? - cyrus-longwords-2.3.3.diff I have to see if there is a better way to handle long UID lists. - cyrus-plainsync-2.3.3.diff I just committed some code which does this in another way. I added a '-p' option to sync_server, pop3d, nntpd, that does the same thing as the 'imapd -p' option. It allows you to specify an external layer security strength factor, so setting it to =2 will allow PLAIN to be advertised w/o TLS. - cyrus-reconstruct-2.3.1.diff Already fixed in CVS. - cyrus-statuscache-2.3.3.diff This looks reasonable, but I want to give it some more thought. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Quoting Ken Murchison ([EMAIL PROTECTED]): - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? Its not an Outlook issue. Its other IMAP providers that deliver non-standard headers to IMAP clients. The problem arises when copying mail from foreign IMAP account to an account on a Cyrus server. John Capo Tuffmail.com Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
move /var/imap
Hello I want to move /var/imap to a new drive but while I'm doing this FreeBSD 5.4 could not move sockets (...yes I stopped before all daemons). How can I deal with that? Any hints are welcom. Thank you in advance. -- Martin Schweizer [EMAIL PROTECTED] Fax: +1 619 3300587 Tel.: +1 619 3300597 (VoIP) Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: move /var/imap
Hello I want to move /var/imap to a new drive but while I'm doing this FreeBSD 5.4 could not move sockets (...yes I stopped before all daemons). How can I deal with that? Any hints are welcom. I guess I don't understand what you did. Did you use mv to move? My suggestions: - don't use mv but something like rsync instead. - the sockets are creating by cyrus-imapd on startup, you don't have to create them on the new disk. Simon Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Hij - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? I do not think it is just outlook. I've also seen problems with notes doing stuff like this. I get errors like this one in my logs: host /var/lib/imap/socket/lmtp[/var/lib/imap/socket/lmtp] said: 554 5.6.0 Message contains invalid header (in reply to end of DATA command) Does anyone know if there is a way to configure postfix or amavis to clean up emails with with errors like these? kind regards, Tarjei - cyrus-imapd-2.3.1-autoreply-0.1-0.diff The Sieve notify is undergoing a lot of changes, so I'll probably wait until the dust settles. - cyrus-isdigit-2.3.3.diff This seems like an OS problem rather than a Cyrus problem. Have you taken this up with the Debian folks? - cyrus-longwords-2.3.3.diff I have to see if there is a better way to handle long UID lists. - cyrus-plainsync-2.3.3.diff I just committed some code which does this in another way. I added a '-p' option to sync_server, pop3d, nntpd, that does the same thing as the 'imapd -p' option. It allows you to specify an external layer security strength factor, so setting it to =2 will allow PLAIN to be advertised w/o TLS. - cyrus-reconstruct-2.3.1.diff Already fixed in CVS. - cyrus-statuscache-2.3.3.diff This looks reasonable, but I want to give it some more thought. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
On Fri, May 26, 2006 at 08:14:51PM +0200, Tarjei Huse wrote: Hij - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? I do not think it is just outlook. I've also seen problems with notes doing stuff like this. I get errors like this one in my logs: host /var/lib/imap/socket/lmtp[/var/lib/imap/socket/lmtp] said: 554 5.6.0 Message contains invalid header (in reply to end of DATA command) Does anyone know if there is a way to configure postfix or amavis to clean up emails with with errors like these? Maybe a postfix header regexp? There was a time I used sed, because I was already calling a shell script of mine to do other stuff. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Hij - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? I do not think it is just outlook. I've also seen problems with notes doing stuff like this. I get errors like this one in my logs: host /var/lib/imap/socket/lmtp[/var/lib/imap/socket/lmtp] said: 554 5.6.0 Message contains invalid header (in reply to end of DATA command) Does anyone know if there is a way to configure postfix or amavis to clean up emails with with errors like these? I'm not sure that is the same problem here but I have this in my /etc/postfix/header_checks: # Remove empty Message-ID headers from broken Notes implementation /^Message-ID:[[:space:]]*$/ IGNORE Simon Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: move /var/imap
On Fri, 2006-05-26 at 19:50 +0200, Martin Schweizer wrote: Hello I want to move /var/imap to a new drive but while I'm doing this FreeBSD 5.4 could not move sockets You don't need to move them. Discard these warnings ( if these are indeed only warnings and your copying process wasn't interrupted ). Cyrus will make new sockets at start if necessary. M. -- Miroslaw Psyborg Jaworski GCS/IT d- s+:+ a C++$ UBI$ P+++$ L- E--- W++(+++)$ N++ o+ K- w-- O- M- V- PS+ PE++ Y+ PGP t 5? X+ R++ !tv b++(+++) DI++ D+ G e* h++ r+++ y? Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Hi I get only a daily few of Message contains invalid header but a couple of thousand per day of Message contains NUL characters from lmtpd ... I've read through all threads both in postfix and cyrus lists about this, but didn't find any conclusion on how to avoid the bounces ... has the Fastmail.FM patch anything to do with the NUL chars in the body ? -Carlos Tarjei Huse wrote: Hij - cyrus-fromheader-2.3.3.diff Outlook sucks. I hate to have to commit yet another M$ workaround. How widespread are these non-RFC2822-compliant messages? I do not think it is just outlook. I've also seen problems with notes doing stuff like this. I get errors like this one in my logs: host /var/lib/imap/socket/lmtp[/var/lib/imap/socket/lmtp] said: 554 5.6.0 Message contains invalid header (in reply to end of DATA command) Does anyone know if there is a way to configure postfix or amavis to clean up emails with with errors like these? kind regards, Tarjei - cyrus-imapd-2.3.1-autoreply-0.1-0.diff The Sieve notify is undergoing a lot of changes, so I'll probably wait until the dust settles. - cyrus-isdigit-2.3.3.diff This seems like an OS problem rather than a Cyrus problem. Have you taken this up with the Debian folks? - cyrus-longwords-2.3.3.diff I have to see if there is a better way to handle long UID lists. - cyrus-plainsync-2.3.3.diff I just committed some code which does this in another way. I added a '-p' option to sync_server, pop3d, nntpd, that does the same thing as the 'imapd -p' option. It allows you to specify an external layer security strength factor, so setting it to =2 will allow PLAIN to be advertised w/o TLS. - cyrus-reconstruct-2.3.1.diff Already fixed in CVS. - cyrus-statuscache-2.3.3.diff This looks reasonable, but I want to give it some more thought. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
On Fri, 26 May 2006, Ken Murchison wrote: Comments on the non-local ones: - cyrus-8bit-2.3.3.diff As I said in my reply to the CVS commit (which I noticed before this mail), I am quite surprised by this patch being accepted. Was it not the position held by CMU in the last five years or so that one such patch would *have* do to it properly and re-encode the header to some default charset, in order not to corrupt the store with lack of charset information (for searches) ? Or am I getting completely confused, here? -- One disk to rule them all, One disk to find them. One disk to bring them all and in the darkness grind them. In the Land of Redmond where the shadows lie. -- The Silicon Valley Tarot Henrique Holschuh Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
On Fri, May 26, 2006 at 05:02:25PM -0300, Carlos Horowicz wrote: Hi I get only a daily few of Message contains invalid header but a couple of thousand per day of Message contains NUL characters from lmtpd ... What version of cyrus? There was a bug that caused the NUL error with long lines. This has already been fixed in later versions. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Andreas Hasenack wrote: On Fri, May 26, 2006 at 05:02:25PM -0300, Carlos Horowicz wrote: Hi I get only a daily few of Message contains invalid header but a couple of thousand per day of Message contains NUL characters from lmtpd ... What version of cyrus? There was a bug that caused the NUL error with long lines. This has already been fixed in later versions. all of my servers complain : there are several 2.3.3 and several 2.2.12 ... Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
On Fri, May 26, 2006 at 05:35:30PM -0300, Carlos Horowicz wrote: Andreas Hasenack wrote: On Fri, May 26, 2006 at 05:02:25PM -0300, Carlos Horowicz wrote: Hi I get only a daily few of Message contains invalid header but a couple of thousand per day of Message contains NUL characters from lmtpd ... What version of cyrus? There was a bug that caused the NUL error with long lines. This has already been fixed in later versions. all of my servers complain : there are several 2.3.3 and several 2.2.12 ... Then it's probably for real: there are NUL characters in the messages. There is a postfix patch floating around that can get rid of these, and I think it's integrated in postfix's snapshot. Here is a version for 2.2.x: http://cvs.mandriva.com/cgi-bin/cvsweb.cgi/SPECS/postfix/patch_reject_strip-postfix-2.2.4.diff Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Migrating a Cyrus IMAP installation to a new server
We have SuSE Email Server III, this product has a cyrus IMAP server. We have plans to set a nuew server based in SuSE Linux 10, with Cyrus. We plan to move all the excisting users to that server. Are there any howtos of that kind of migration? Thanks A/P Andres Tarallo WDB Consultores Montevideo - Uruguay Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Comments on the non-local ones: - cyrus-8bit-2.3.3.diff Was it not the position held by CMU in the last five years or so that one such patch would *have* do to it properly and re-encode the header to some default charset, in order not to corrupt the store with lack of charset information (for searches) ? Or am I getting completely confused, here? I think having this as an *option* is perfectly reasonable. There are already other imapd options like rfc2046_strict and rfc3028_strict that control some strictness of RFC behaviour. In this case it seems to me the options are: 1. Reject the message - users hate loosing email just because it's not fully RFC compliant, especially when my other provider doesn't have a problem 2. Replace with X/? - users hate mail being mangled and not being able to read it, especially when my other provider doesn't have a problem 3. Accept the message and store as is, leave it up to the email client to handle - This seems to be the 90% good enough that works well. Most clients well display 8-bit data from the message headers in the same charset as the message body, which generally works 4. Recode correctly in MIME encoding based on the message charset - Would be great but: a) Hard because what if it's a multipart/alternative message, and the alternative parts have different charsets? What do recode the header as? b) Some messages just don't have a charset at all (some Japanese clients seems particularly bad at this), what to do then? c) Some HTML messages only include the charset in the HTML as a meta header. Do you parse the HTML? I agree that this option is truly a hack, and technically the email is non-RFC compliant so you can do whatever you want, but unfortunately out in the real world I think a hack like this allows people to actually get their email and should be provided. I'm sure quite a few sites already apply this patch to their installations in some way (eg I think Simon's RPMs include it?) Rob Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
Andreas Hasenack wrote: On Fri, May 26, 2006 at 05:35:30PM -0300, Carlos Horowicz wrote: Andreas Hasenack wrote: On Fri, May 26, 2006 at 05:02:25PM -0300, Carlos Horowicz wrote: Hi I get only a daily few of Message contains invalid header but a couple of thousand per day of Message contains NUL characters from lmtpd ... What version of cyrus? There was a bug that caused the NUL error with long lines. This has already been fixed in later versions. all of my servers complain : there are several 2.3.3 and several 2.2.12 ... Then it's probably for real: there are NUL characters in the messages. There is a postfix patch floating around that can get rid of these, and I think it's integrated in postfix's snapshot. Here is a version for 2.2.x: http://cvs.mandriva.com/cgi-bin/cvsweb.cgi/SPECS/postfix/patch_reject_strip-postfix-2.2.4.diff Thanks but I was just asking to the list if Fastmail's cyrus-8bit-2.3.3.diff would let avoid rejections due to Message contains NUL chars Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Cyrus Patches used at FastMail.FM
On Sat, 27 May 2006, Robert Mueller wrote: I think having this as an *option* is perfectly reasonable. There are So do I, Debian has this patch for three or four years now. It comes with a big warning to the likes of You are stupid to enable this and still wonder why multi-language search is now broken in your server. But this has never been the instance on this issue for upstream inclusion of this patch, and I was (and still am) quite surprised it was included without any further comment. 3. Accept the message and store as is, leave it up to the email client to handle - This seems to be the 90% good enough that works well. Most clients This breaks IMAP SEARCH, or so I have been told for four years, now. This is why I want a better explanation now for the inclusion of such a patch :-) 4. Recode correctly in MIME encoding based on the message charset - Would be great but: Nah, just according to some site-wide config option from imap.conf would be more than good enough. I agree that this option is truly a hack, and technically the email is non-RFC compliant so you can do whatever you want, but unfortunately out in This is not the issue. The issue is whether Cyrus is corrupting its innards or not by letting this thing into the spool. -- One disk to rule them all, One disk to find them. One disk to bring them all and in the darkness grind them. In the Land of Redmond where the shadows lie. -- The Silicon Valley Tarot Henrique Holschuh Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
