Thunderbird's color labels

[Joseph Brennan]

I am trying to find where cyrus imap stores the colors Thunderbird uses in
the message index display. I thought they were probably custom flags and I
could use mbexamine to find them.

I have a mailbox that has this in the first stanza from mbexamine, which
looked promising--
   User Flags: $label1 $label2 $label3 $label4 $label5 $Forwarded
Redirected

Each message has a line with "> USERFLAGS" but those are mostly four groups
of zeros, and  the values do not correspond to the Tbird colors.

What else can I try?


-- 
Joseph Brennan
Lead, Email and Systems Applications

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailboxes messed up after migration

[Joseph Brennan]

IMAP provides two kinds of timestamp: the time the message was placed into
the mailbox, and the time in the Date header line. In a typical inbox and
sent mailbox the two are the same order. In other folders it might not be
the same. I think Roundcube uses the first kind of timestamp, which for
cyrus is not a sort at all since it is the internal order of messages in a
mailbox.

I guess the question is whether the migration moved messages out of order,
or whether the users are noticing something that was true before migration.

Joe Brennan
Columbia University



On Mon, Feb 5, 2018 at 9:26 AM, Hiago Prata  wrote:

> Hi!
>
> After the migration of all users I was supposed to migrate to a new
> server, some of them reported that in some of their mailboxes
> subdirectories the display order of the messages is all messed up, with
> messages received or sent months ago being shown before them most recent
> ones. I thought it might be date format or something related, but all dates
> of creation and access of all mailboxes look the same.
>
>

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: 421 4.3.0 deliver: Trying to unput wrong character

[Joseph Brennan]

> This is one of those weird inconsistencies between IMAP and SMTP protocols …
> as far as I remember, the NUL character restriction only applies to the IMAP
> protocol … so your MTA (e.g. sendmail) is not breaking the SMTP RFC by
> transferring them.

True, but it's breaking the Internet Message Format RFC, namely RFC
2822. Under "Obsolete Syntax" includes this:

   Finally, certain characters that were formerly allowed in messages
   appear in this section.  The NUL character (ASCII value 0) was once
   allowed, but is no longer for compatibility reasons.

Compatibility with POP and IMAP, presumably.

Sendmail seems to be following still the old "be generous in what you
accept" maxim, and as a result it accepts something that modern
software cannot read-- just in case you have some odd way of reading
mail that can handle it.


-- 
Joseph Brennan
Columbia University


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Cyrus 2.15.10. Shared folders.Bug or feature?

[Joseph Brennan]

On Fri, May 19, 2017 at 12:17 AM, Anton Shilov via Info-cyrus <
info-cyrus@lists.andrew.cmu.edu> wrote:

> Hi Cyrus-List!
>
> Bugs or features?
>
> case_1 (shared folder and subscribe):
> Lots of users have subscribe to the same shared folder. If I delete it via
> cyradm (dm shared.folder) the users find out that they cannot unsubscribe
> from it because foldes starts to be inactive onto mail client, for example
> onto Thunderburd that folder has grey color in subsrcibe lists. Are there
> any algorithms to delete shared folders and automatically unsubscribe users
> from it?
>

Thunderbird bug. It should be able to subscribe and unsubscribe folders
that do not exist, and the server "MUST NOT unilaterally remove an existing
mailbox name from the subscription list even if a mailbox by that name no
longer exists", quoting RFC 3501 (IMAPv4), section 6.3.6 which explains the
reason behind it.  Of course there are cases in client-server systems where
one breaks protocol on one side to cope with software that breaks protocol
on the other! But the "MUST NOT" would explain why Cyrus doesn't
automatically unsubscribe.

Joseph Brennan

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Request: Please sign this list's messages via DKIM or SPF

[Joseph Brennan via Info-cyrus]

Binarus via Info-cyrus <info-cyrus@lists.andrew.cmu.edu> wrote:


But with SPF or DKIM, you can immediately blacklist any sender
domain after having received SPAM from that domain.


It would never be a phished stolen account, so that would be safe.

Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: unable to delete corrupted mail box on cyrus v2.3.16

[Joseph Brennan via Info-cyrus]

Sophie Loewenthal via Info-cyrus <info-cyrus@lists.andrew.cmu.edu> wrote:


touch cyrus.header
chown cyrus:mail cyrus.header


I might be out of date, using an older cyrus, but I think cyrus.header has 
to contain:


Cyrus mailbox header
"The best thing about this system was that it had lots of goals."
--Jim Morris on Andrew

Compare cyrus.header in any other account.

Joseph Brennan
Columbia University IT




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

RE: Disappearing Mailbox Content

[Joseph Brennan]

--On September 9, 2015 at 5:06:34 PM -0500 "Robert T. Covell" 
<rcov...@rolet.com> wrote:

> I have verified that the user is allowed to delete the mailbox.  If I
> change it at the root level will it propagate down?  If not how can this
> be done without writing a script?  As stated before they have thousands
> of folders.


In cyradm you can use * as a wildcard.

If the names start with "foo" and "." is the separator and "user" is the 
user, you can do:

> sam foo.* user lrswikte

Possibly you have "/" not "." but it's the same idea. "lrswikte" is 
everything except "x".

Joseph Brennan
Columbia University Information Technology





Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

RE: Disappearing Mailbox Content

[Joseph Brennan]

--On September 9, 2015 at 13:49:40 -0500 "Robert T. Covell" 
<rcov...@rolet.com> wrote:

> That is the problem.  I cannot reproduce (reliably or at all).  It might
> be months before we hear about it.  It has been happening for about two
> years.  Always chalked it up to user error.  But I can't say that it is
> or isn't.
>

Check the ACL on the mailbox and make sure no user has permission to delete 
the mailbox-- no "x" right. Loss of all content including the cyrus* files 
is mailbox deletion. (This is the voice of experience talking)

Too bad you didn't implement delayed delete. You can just rename the 
deleted folder to its original name.


Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: messages removed before expire

[Joseph Brennan]

 Oct  1 09:45:41 imap1 imap[7357]: Expunged 19 messages from user.ken.Trash

The above shows *imap* doing an expunge. The imap client did this. Given 
delayed expunge the messages would still be there on the filesystem after 
this.

The real expunge done by the expire job does not say imap:

Oct 17 05:16:28 salmon cyr_expire[11566]: Expunged 2 messages from user.xxx


Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Mailbox last access - most reliable source

[Joseph Brennan]

Fabio S. Schmidt fa...@improve.inf.br wrote:

  I actually need to consider only the last access via IMAP or POP 
protocols.

That can be very misleading, because a device may keep checking for new 
mail for a very long time after the user abandons the account.

A recent timestamp on the user.seen file should be good, but that seems to 
update mysteriously sometimes.


Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Cyrus POP3 long line problem

[Joseph Brennan]

Vincent Fox vb...@ucdavis.edu wrote:

 I have recently noticed that certain malformed messages hang POP3 clients.
 The pattern is that the mesages all have obscenely long last lines. I
 can see it
 when I set up debug log dir for the account, that the download of the
 message
 proceeds fine up until 2048th character and then stops.


How is that possible? The SMTP maximum is 1000 including the CR LF pair. 
I'm surprised a message like that is accepted by your MTA and/or LMTP. If 
Cyrus IMAP handles up to 2047 characters that's very generous.

Joseph Brennan
Columbia University I T




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Help on quota usage.

[Joseph Brennan]

--On February 14, 2014 5:11:19 PM +0530 Anant Athavale 
athavale.an...@gmail.com wrote:




 Dear List,

 for one user, the lq user.xx is showing 1.6 GB, where as actual usage on
 file system is less than 1 GB.  I want to know, how can get where is the
 additional quota sitting in /var/spool/imap partition for user xxx.



mbexamine user.xx | egrep '(Number.of.Messages|^Examining)'


Joseph Brennan
Columbia University IT




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: duplicate delivery.

[Joseph Brennan]

Alvin Starr al...@netvel.net wrote:

 I am guessing that since one copy of the message is created using the
 imap interface and the other is created using the LMTP delivery that the
 duplicate delivery is not catching them.

To be precise, a client creates the sent mail copy by writing it to the 
folder with IMAP. That copy is not delivered by SMTP or LMTP.

What makes this idea a hopeless task, in my opinion, is that each client 
has its own name for the sent folder. Sent, Sent Mail, Sent Messages, and 
sent-mail, are the most common but not a full list.

Joseph Brennan



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: IMAP Flags clarification.

[Joseph Brennan]

\Seen is an IMAP flag. Unseen means Messages that do not have the \Seen 
flag set.

I don't know what high priority means in this context. If you mean 
headers like Priority: Urgent or X-Priority: 1, those are not IMAP 
flags. And for that reason I don't know what Michael Slusarz means by the 
order in which the server returns the flags.

Evidently Horde IMP can show only one of the two things, but whether it 
prefers an IMAP state to the content of a header sure seems to me like an 
IMP client-side decision.

I am probably missing something here.

Joseph Brennan
Columbia University Information Technology



--On August 27, 2013 13:51:35 +0530 Anant Athavale 
athavale.an...@gmail.com wrote:

 It's entirely dependent on the order the IMAP server returns the IMAP
 flags.

 The problem is that both 'unseen' and 'high priority' have the same CSS
 importance.  CSS only allows a binary determination of what is
 important.  Thus, 2 or more rules with labeled important necessarily
 need to overwrite each other in either a FIFO or LIFO manner.

 Writing code to get around this would be prohibitively expensive and not
 worth it - especially since priority is not even a real, recognized
 flag.






Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: HasChildren flag on two mailboxes with similar name

[Joseph Brennan]

--On February 13, 2013 18:08:56 +0100 Tobias Riekeberg t...@trs-computer.de 
wrote:

 So the user.joe has the flag \HasNochildren instead of
 \HasChildren. This happens whenever I have two users of which one's
 name is the first part of the other users name. Result of this seem to
 be, that I cannot access user.joe in Thunderbird.

 Is this a known problem?


Yes, but it's a Thunderbird problem. We saw one case of it here.

Telnet to the imap port and give the list query, to verify that cyrus gives 
the correct response.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Weird vanishing e-mail question

[Joseph Brennan]

--On September 4, 2012 12:02:11 +0100 Ken Smith k...@kensnet.org wrote:

 I was editing a mail using Seamonkey as the mua on one machine. I saved
 the mail to drafts and opened it on another machine again with
 Seamonkey, made the changes I wanted and saved the mail to drafts again.
 The draft message has vanished. Both machines had active sessions to
 Cyrus at the same time.


Does the second Seamonkey save to a local drafts folder instead of imap?

I assume you are not using delayed expunge on cyrus.

Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Inaccessible emails

[Joseph Brennan]

Outlook is known to have the same problem with large mailboxes.
Large as in many messages, not bytes.

Recommend keeping inbox under 15,000 messages, so the client can
maintain its local index file without corruption.  He may ignore you,
and when he gets tired of the failures then he will change.

It's not a cyrus problem. Cyrus's capacity exceeds that of all the
popular clients.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology




--On Thursday, March 15, 2012 11:51 +1100 Puthick Hok hputh...@gmail.com 
wrote:

 Thanks for your helpful comments. This problem used to happen
 occasionally in the past but over the last 3 months and recently very
 often that becomes counter productive for him. One of the contributing
 factors to this problem after reading your comments is that his hard
 drive has crashed twice and each time we restored his Window profile,
 we didn't remove and recreate his thunderbird profile.

 He has archived his emails but I didn't instruct him to rebuild the
 index since he is happy with MS Outlook and its not worth wasting his
 time and my time fixing the thunderbird problem. I think next time,
 this problem happens again, I will know quickly what to do rather
 wasting time doing things that do not fix the problem.

 Puthick

 On Thu, Mar 15, 2012 at 6:47 AM, Jules Agee jul...@pcf.com wrote:
 On 03/13/2012 07:09 PM, Puthick Hok wrote:
 Hi,

 I'm using cyrus-imapd 2.3.7 with postfix and thunderbird as the client.
 My boss mailbox is about 17GB with around 56000 emails directly in the
 inbox.

 This is almost certainly a Thunderbird issue. It keeps its own index
 files, and sometimes they get corrupted. They tend to get corrupted more
 often with folders that have lots of messages. If you can find a way to
 archive the old messages into other folders, Thunderbird should start
 behaving well again. You might need to right-click on the Inbox folder,
 select Properties, and then press the Rebuild Index button. That will
 take a long time for 56K+ messages.

 --
 --
 Jules Agee
 System Administrator
 Pacific Coast Feather Co.
 jul...@pcf.com       x284

 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
 
 Cyrus Home Page: http://www.cyrusimap.org/
 List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: cyrus.index file

[Joseph Brennan]

 how can I check if a user deleted a mail ?
 Is there is history somewhere?
 How can I read the cyrus.index file?


If it's not expunged, only marked deleted, give your account lrs on
the mailbox temporarily and open it with a client. I find that a
very usable way to read the cyrus.index :-)

If it's expunged, if you use delayed expunge and it was expunged
within the delay period, unexpunge -l user.xxx will show it.

If neither, you might be able to make a guess based on the known
delivery time (from postfix logs) and timestamps on the message
files on the file system. E.g. postfix says it was delivered at
Nov 1 10:25, and you have in the mailbox message 4566. at 10:10,
no message 4567., and message 4568. at 10:30... conclusion, it
was there and was deleted and expunged.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Deleting unused or dormant mail accounts.

[Joseph Brennan]

Andres Tarallo atara...@acm.org wrote:

 In order to get a list of mailboxes to be removed we're looking the
 date the file username.seen was last modified. Do we have a better
 strategy?


Judging by the last delivery date is compromised by spam. Getting
mail unfortunately does not mean the account is being used.

Judging by seen state is much better provided you can assume IMAP.
I don't think POP updates seen. But POP devices tend to check in
regularly, so you could cover obvious cases by checking the last
couple of weeks of system log. It won't be perfect.


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Backing up mailboxes

[Joseph Brennan]

--On Friday, June 10, 2011 10:03 -0500 Blake Hudson bl...@ispn.net wrote:

 Delayed
 delete/expunge serves this task better than frequent backups, but has
 the consequence of needing a lot more production storage - which is
 usually more expensive than backup storage.


It's the only way to restore ALL mail, since backups miss anything
that came and went between backups.

The additional storage is only for storing messages expunged in the
past N days.  A short 7 days meets most needs, and also, then your
backups would be complete.  Weigh the cost of disk space against the
staff cost of mounting backups, finding and copying data, and doing
reconstructs.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Vacation Not Working...

[Joseph Brennan]

--On Tuesday, May 10, 2011 9:43 -0600 Nathanael D. Noblet 
nathan...@gnat.ca wrote:

 IMHO :days 0 is not allowed/ignored

 Ok, I've set it to 1.


Try 3.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: imapd 2.4.6 sendmail and rtcyrus v3

[Joseph Brennan]

Mogens Melander mog...@fumlersoft.dk wrote:

 My virtusertable has these mappings:

 postmas...@example.comtestu...@example.com
 webmas...@example.com testu...@example.com
 dom...@example.comtestu...@example.com
 @example.com  error:nouser 550 No such user at example.com

Sendmail does recursive table lookups, so:

webmas...@example.com resolves to testu...@example.com
testu...@example.com resolves to error:nouser


Use the aliases file, e.g.

postmaster: testuser
webmaster: testuser
domain: testuser


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: imapd 2.4.6 sendmail and rtcyrus v3

[Joseph Brennan]

--On Wednesday, April 13, 2011 16:14 +0200 Mogens Melander 
mog...@fumlersoft.dk wrote:

 I can se that postmas...@example.com resolves to testu...@example.com
 when testing on localhost:

# echo '/map virtuser postmas...@example.com' | sendmail -bt



Sure, but then resolve:-

echo '/map virtuser testu...@example.com' | sendmail -bt

because that's what sendmail does. For this to work you'll need to
define testu...@example.com going to some address not @example.com.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: imapd 2.4.6 sendmail and rtcyrus v3

[Joseph Brennan]

--On Wednesday, April 13, 2011 17:54 +0200 Mogens Melander 
mog...@fumlersoft.dk wrote:

 Ok, thanks anyway.

 How are you doing it? sendmail - cyrus imapd.


Gateway columbia.edu resolves virtusers, aliases, users, to the correct
destination for that end user, which might be our Cyrus cluster or our
Exchange cluster or forwarding elsewhere. For Cyrus users, gateway
re-sends (smtp) to the end user @ the cyrus cluster's hostname.

On the cyrus hosts, all they have to do is deliver to the user given
in the address. There are no virtuser or alias tables there. There IS
an access.db that tells these hosts to accept mail only from the
gateway.


Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: multipart message with pdf file gets truncated

[Joseph Brennan]

Julien Vehent jul...@linuxwall.info wrote--

  Now, without being a MIME expert, I assume that the last NextPart
  line not being followed by anything is not a good thing.

No, that last boundary marks the end of the mime part, signfifed by
the two hyphens at the end. In this case it's the end of the whole
message.

That happens to prove that the message is not truncated. Only the
software that created the message would have written that end boundary.

My conclusion is that the message arrived as is. Either the original
PDF was damaged, or the message was created with damage.



Mike Eggleston mikee...@mac.com wrote--

 My truncation problem was happening when the internal server pulled
 the mail, then injected the mail into the internal sendmail. At the
 reinjection time there were a few messages that had a dot (.) in column
 one. Per the RFC a dot (.) in column one is the signal to end the SMTP
 input session (the data command).

No, the end of DATA is signalled by the five-character sequence
CR LF dot CR LF, that is, a dot on a line by itself. So your software
is buggy if it stops at CR LF dot without examining what follows dot.



Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Shared mailboxes doc

[Joseph Brennan]

Julien Vehent jul...@linuxwall.info wrote:



 ---
 . namespace
 * NAMESPACE ((INBOX. .)) ((user. .)) (( .))
 ---

 Question is: shouldn't the 3rd argument be of the type shared. ?
 (Like in example 5.4 of the RFC [1]).


There can be a null namespace.  We use it for one's own mailboxes.--

b namespace
* NAMESPACE (( .)) ((~ Other Users. .)) ((~ Public Folders. .))



 roundcube lists it (LSUB) but can't access it (It looks for
 INBOX.shared.testshared instead of shared.testshared).


So shared.testshared is subscribed, but roundcube prefixes INBOX.
to that?  Is that configured into roundcube?

Does LSUB return the right names?  Given the above, I expect your own
folders to have names starting INBOX. and the shared folders to
have just their names.

(
On our system, my own folders are in the null namespace:
* LSUB () . Words
while a shared folder has the prefix we established:
* LSUB () . ~ Public Folders.bboard
)


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

RE: disable IMAP IDLE

[Joseph Brennan]

--On Tuesday, November 23, 2010 9:15 -0500 Ron Vachiyer 
prout...@hotmail.com wrote:

 No it isn't, I had already checked and strangely it is notwhich is
 really surprising me that the sessions remain;


A client can keep a session open by sending NOOP every 25 minutes.
If you won't allow IDLE that's probably exactly what a client does.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Does anyone allow unlimited or extremely large quotas?

[Joseph Brennan]

 We know things will be fine with 10,000 messages too, but
 100,000 msgs in a folder is pushing things.

My inbox is 17,338 at the moment, and it's still fast.  But I'm using
an old copy of Mulberry, which was designed for IMAP.

The problem area is clients designed for POP and adapted to IMAP.  I'd
say this relevant to Cyrus, because if we have a great server side but
weak user-facing software, we lose the game.

I wish we'd somehow financed a native Cyrus webmail interface, that is
not using IMAP but built into Cyrus.  I don't think users know how good
Cyrus is because they look at it through a weak intermediary.



 (Admission: we haven't yet tried imapproxy
 -- it appears to be a good piece of C which will help things.)

Do it.  It makes a huge difference.  You go from crawling to just slow.


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Cyrus IMAP server

[Joseph Brennan]

--On Thursday, October 21, 2010 16:43 +0200 JC Putter 
jancarel.put...@gmail.com wrote:

 i we are running cyrus-imapd 2.3 on centos 5.5

 we are getting complains from users getting error messages saying Mailbox
 locked by POP Server, i understand that pop3 server can handle only 1
 concurrent connection, can cyrus be configured to support more
 connection?


The POP protocol requires the mailbox to be locked during a POP session.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Using mbox2cyrus.pl

[Joseph Brennan]

--On Thursday, October 7, 2010 10:00 -0500 Patrick Goetz 
pgo...@mail.utexas.edu wrote:

 I have a few mbox files that I need to transfer to cyrus (one relatively
 large ~3MB).  I downloaded the perl script mbox2cyrus.pl, and looked
 over the code, and I'm not confident that this will work for a system with

 unixhierarchysep: yes

 Does anyone have any experience with this?  Am I going to have to
 rewrite this script to get at my mbox files?



If this is relevant-- Pine can copy a local mbox file to an imap server.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Using mbox2cyrus.pl

[Joseph Brennan]

--On Thursday, October 7, 2010 11:07 -0500 Patrick Goetz 
pgo...@mail.utexas.edu wrote:

 On 10/07/2010 11:03 AM, Joseph Brennan wrote:


 If this is relevant-- Pine can copy a local mbox file to an imap server.



 How would this work?  We use alpine extensively, and AFAIK it's either
 configured for IMAP or mbox, but not both.


$ alpine -f path/to/file

Select all, and tell it to save them to a mailbox on the imap server.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: De-duping attachments

[Joseph Brennan]

Outside the cyrus box:  The Mimedefang milter has a built-in function
(optional of course) to remove an attachment, write it to a file, and
replace the attachment part with a text part giving a web link to the
file.  The files could be on a slower type of disk drive than you need
for email storage.  You could write code choosing which attachments to
do this to, say by size or file extension.  A mechanism to remove the
files is not provided, but it's suggested that recipients would need
to download the attachment to their own computer and that therefore
the files could be deleted by a cron job based on age.

I mention this only as another way to do it.  Note that this could be
implemented for outgoing mail too.  We have not implemented it here
so I can't say more than that it is possible.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/

Re: Occasionally weird behaviour with mboxes

[Joseph Brennan]

Dan White dwh...@olp.net wrote:

 For instance, creating the mailbox INBOX/Work/Jim without first creating
 INBOX/Work would make INBOX/Work non selectable, with children.


I tested that, and our cyrus server returns also NonExistent...

* LIST (\NonExistent \Noselect \HasChildren) . alpha

not what he got which was only...

* LIST (\Noselect \HasChildren) . Fornitori G-Z


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sieve problem with vacation filter again.

[Joseph Brennan]

Maria McKinley ma...@shadlen.org wrote:

 The only thing unusual about this account, that I can think of, is that
 he is forwarding mail to this account from other accounts.


Did you put those other addresses in the sieve rule?


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus vacation notice

[Joseph Brennan]

Andrew Nash nash...@btinternet.com wrote:

 Return-Path:   r...@server.domain

So the vacation reply should go to r...@server.domain.



 We have a multi-drop POP3 mailbox on the ISP, and our server uses a
 program called Fetchmail to download all the messages, handing each
 downloaded message to a program called Trestlemail which examines the
 header before dropping it off to the correct recipient.

Holy expletive.

By the time cyrus gets the message, you have lost the envelope sender
and envelope recipients. So you can't send any type of delivery status
notice correctly, whether vacation replies, bounces, or receipts. It
looks like you can't deliver bcc'd messages either, if you are trying
to guess recipients by reading headers.

Anyway none of this is a cyrus problem. I'm out of here.



Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus vacation notice

[Joseph Brennan]

 From: outofofficeu...@domain
 To: r...@server.domain
 Subject: Absence notification


This would be OK if the incoming message came from r...@server.domain.

Are you doing something funny at the gateway, such that mail gets re-sent
to the cyrus system with MAIL FROM r...@server.domain ?  If so, bounces
don't go back to sender either.  Have people reported that too?

Look at the log records on the gateway and the cyrus system to see what
the sender address is.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus vacation notice

[Joseph Brennan]

Andrew Nash nash...@btinternet.com wrote:

 I?m not too sure, to be honest.  I?ve just sent a test message from the
 LAN to an invalid external user (eg asd...@btinternet.com), and I
 received a ?non delivery? message from the mail server of the domain
 saying the mailbox I was trying to send to was invalid.  Is this what you
 mean?



I meant the opposite, but forget that.


I am guessing that by LAN you mean a private network that is firewalled
from the Internet.  Right?

I am guessing that mail from outside arrives on a gateway host that is
on the Internet, and it re-sends the message into the private network.
Right?

Identify a message from outside that should have got a vacation reply
but did not.  For that message:

-- Find the log record on the gateway that shows it coming in, and
note the sender address.

-- Find the log record for the same message on the cyrus host, and
note the sender address.  Is it the same, or r...@server.domain?
If it has changed to r...@server.domain, that is the problem.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Odd Behavior w/ HTML Attachment

[Joseph Brennan]

Gary Furash fura...@email.arizona.edu wrote:

 Problem: when users pick up specific type of email from our CYRUS IMAP
 server with Outlook 2007 as the client, the body of the mail is turned
 into an attachment and there is no email body.


It sounds like a bad interaction between the MIME formatting and
Outlook 2007.

If you want, send me an example directly and I'll examine the MIME
format.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus vacation notice

[Joseph Brennan]

 However, when I send to a user with a set vacation message using an
 external email system (eg Hotmail) then it?s a bit hit and miss as to
 whether an out of office message gets delivered to the sender.

Check this by looking at your syslog or maillog, for an outgoing
message from  to the hotmail address.  It will be within seconds
of the incoming message from the hotmail address.

Actual delivery to the hotmail inbox is not your concern, and from
stories I've heard, don't count on it to work.  The hotmail user may
have a user-level configuration that throws the mail away, without
realizing it.

If there are any other rules in the sieve filter before the vacation
rule, check whether they say to stop.  For example, if I say put mail
from f...@example.com in inbox and stop, and then have the vacation
rule after that, f...@example.com won't get the vacation message.

You know of course that vacation replies per sender only once a day,
or some longer period, right?  Just checking.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: [cyrus-imapd] unexpunge folder problem

[Joseph Brennan]

--On Thursday, April 15, 2010 3:06 PM +0200 Eric Luyten 
eric.luy...@vub.ac.be wrote:

 While we're at it : what happens on a Cyrus server with two or more
 partitions ? Does a mail folder delete imply a move to the 'default'
 partition or can every partition have its own 'DELETED/user/...'
 hierarchy ?


DELETED is in same the partition the user is in.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: user_deny.db, very high load and Apple-Spotlight

[Joseph Brennan]

Mark Heisterkamp heisterk...@rrzn.uni-hannover.de wrote:

 Kenneth Murchison stated in some mail on this list that user_deny.db is
 used once per login, that's definitely not true, it is used every time
 the client 'uses' an IMAP-folder and that can be pretty often!


Some clients open a new login session every time they open a new folder.
Enable telemetry if you want to check what these clients do.


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Deleting messages

[Joseph Brennan]

Nybbles2Byte nybbles2b...@gmail.com wrote:

 Expunge sounds more like a legal term
 than anything to do with software and I'm surprised that it became an
 official
 command as programmers would far more likely think of purge first.
 Perhaps a
 non-programmer came up with that one.


Expunge comes from the MM client developed in the 1970s.  One of the
developers, Mark Crispin, designed the IMAP protocol in 1986, and he
carried over the term Expunge as the command to remove messages marked
deleted.

http://www.columbia.edu/acis/email/mm.home/mmmanual/8.about.mm.html

I can't think of a good reason not to use the term that the protocol
uses, since it is a word people know and using it would make it simpler
to discuss commands applicable to any IMAP client.

I first saw purge used in the mid 1990s.  I don't know whether it
first appeared in the Exchange Client (the interoffice memo and
scheduling client that became Outlook) or Netscape Navigator (one
the first GUI IMAP clients).  It was an unfamiliar term and I did
not understand why it was being used.  None of the old email clients
used it, nor did the POP or IMAP protocols.


Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Deleting messages

[Joseph Brennan]

--On Friday, April 2, 2010 5:30 PM -0700 Nybbles2Byte 
nybbles2b...@gmail.com wrote:

 Okay, I am sure this is stupid question but how do you really delete
 messages. When I delete messages in my email client and then log in to
 see the mailbox through a web program I see that the message are marked
 as deleted but still there.


That's what delete does.  It marks the messages deleted.  You can still
undelete them, in case of error.

Then the command expunge removes all messages marked deleted.  For no
known reason some clients call this purge instead of expunge.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: trouble with sieve and cyrus murder

[Joseph Brennan]

--On Wednesday, February 3, 2010 9:26 -0800 Andrew Morgan mor...@orst.edu 
wrote:

 On Wed, 3 Feb 2010, Carlos Ricardo Bernal Veiga wrote:

 Ohhh Thank you Dan, this parameter worked really good in our Webmail,
 and so sorry for my english, We are studying the cyrus murder to deploy
 in our company, do you know about some success case with murder?? We
 have about seventy thousand accounts and we want know more about this
 project...


Our murder has 749,620 mailboxes for 98,186 users.  12 frontends
and 8 backends plus 1 murder master.  And 8 replica backends, since
we are doing replication too.

I agree with Andrew Morgan, I/O is key.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: TLS fails on imaps port

[Joseph Brennan]

Examples:

[1] openssl s_client -connect mail.columbia.edu:993
[2] openssl s_client -connect mail.columbia.edu:143 -starttls imap
[3] openssl s_client -connect mail.columbia.edu:993 -starttls imap


[1] and [2] should work ; [3] fails.

The U Wash IMAP server gives the same results.

These alternatives are commonly called ssl and tls, but the actual
distinction is whether the starttls command is used to get Transport
Layer Security.  First described in RFC 2595.


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: TLS fails on imaps port

[Joseph Brennan]

--On Saturday, January 23, 2010 4:54 PM -0800 Bob Dye 
bob...@vintagefactor.com wrote:

 I'm running Cyrus-imapd 2.3.7 on a Redhat Enterprise Linux 5 system.

 TLS works fine if I connect to the imap port (143). If I try to connect
 instead via the imaps port (993), the attempt times out and I get the
 following in the log:

 imaps[27170]: imaps TLS negotiation failed: [xx.xx.xx.xx]
 imaps[27170]: Fatal error: tls_start_servertls() failed



Normal.  It should fail.  993 requires SSL.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Repeating emails

[Joseph Brennan]

--On Tuesday, November 3, 2009 9:44 AM -0500 Tom Plancon 
tplan...@bkaarchs.com wrote:

 Hello all,

 Not sure if this is the place to ask this, just trying to track it down.
 I'm running Cyrus 2.2.12 with Postfix 2.2.2 for only 45 users. Every once
 in a while, but much more recently, users are receiving emails sent a few
 days ago - again. The recent repeat emails were all from users on our
 network sent to all users on our network. The headers appear like
 regular, legit emails. Any thoughts as to what could be going on or where
 to begin looking.

 Any input is greatly appreciated. Thanks.



Find out whether the message was actually sent twice by the sender.
See system log ; diff the Received headers and Message-ID.  Most
likely it was sent twice, indicating a sender client problem.

If sent only once, find out whether the message is really repeated
on the cyrus server.  Grep the Message-ID.  If it's there only once,
it's some kind of index problem on cyrus or in the client.  You could
reconstruct.  You could have the recipient read the mailbox with a
different client and see whether the duplication still appears.


Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Invalid Header problems

[Joseph Brennan]

Google is your friend.  Notice that a Message-ID header exists but has
no string after the label:

Jul 28 09:45:10 boom3 postfix/cleanup[6921]: B9A7225C001: message-id=

See  http://archives.neohapsis.com/archives/postfix/2005-02/1410.html


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: AW: Re: AW: Re: Message contains NUL characters - howto dump?

[Joseph Brennan]

 (IMHO is the max. line lenght in emails 4000 characters.)


RFC 2821 sec 4.5.3.1 says the max length is 1000 characters including
the two CR LF characters.

However if the MTA fixes this, Cyrus won't see it.  Sendmail for example
breaks long lines at 997 characters and inserts ! CR LF.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: limit tcp sessions opened by an IMAP client

[Joseph Brennan]

LALOT Dominique dom.la...@gmail.com wrote:

 Hello,

 I've looked at google before asking, but I didn't find something.
 Some imap clients are using many tcp connexions. I would like to know if
 there is a way to limit them?


This could make the client fail and increase your helpdesk calls.  Do
you mean more than five?

Whatever you do should check both host and user, so that you don't cut
off multiple users on a timeshare host or a firewall gateway.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: limit tcp sessions opened by an IMAP client

[Joseph Brennan]

Strange to see so many logins spread over a short time.  They seem to
be in pairs, which is the way some clients start up.  I wonder if the
client thinks the connection has dropped, and so it starts new sessions.
I realize the server's netstat shows them as still connected.

It might be interesting to log sessions and see what's going on.  Or
to strace live processes.  And of course ask the user what it looks
like from his/her end.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: limit tcp sessions opened by an IMAP client

[Joseph Brennan]

LALOT Dominique dom.la...@gmail.com wrote:

 . I've seen once entourage on macosx ignoring 5xx code from our smtp
 server, and trying to upload a 50Mo file every minute.


Outlook will try every second, under some conditions!

Funny, I was thinking Outlook Express for this imap problem.  I've seen
it start a new imap login to see whether there's new mail in the inbox
it already has open (this is horrible in U Wash imap, where the new
session kills the older one).  If these were evenly timed, like every
5 minutes, I would have said Outlook Express.  But these are at irregular
intervals, so I think it's something else.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: thoughts on running an IMAP-over-SSL server exposed to the Internet?

[Joseph Brennan]

--On Friday, March 27, 2009 9:46 -0400 Zachariah Mully 
zmu...@smartbrief.com wrote:

 How comfortable y'all are with exposing Cyrus IMAPd's imaps port to the
 big wild Internet?


Not much point running it if you can't connect to it, is there?
It's totally standard.  Actually you need only plain imap with tls
required, but imaps helps some clients work right.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Delayed delete, restoring deleted mailboxes

[Joseph Brennan]

--On Tuesday, March 17, 2009 7:57 -0400 Adam Tauno Williams 
awill...@whitemice.org wrote:

 On Tue, 2009-03-17 at 13:26 +0200, Leena Heino wrote:
 What is the recommended process to restore deleted messages or mailboxes
 when delayed delete is in use?

 Use the unexpunge command;  the man page isn't bad, and I have examples
 and some notes in the Cyrus chapter of WMOGAG
 http://docs.opengroupware.org/Members/whitemice/wmogag/file_view.


Unexpunge for messages.

For entire mailboxes, use rename.  You can find the name by doing a
lm *string* in cyradm.  It will start DELETED. and end with an
extra string.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Security risk of POP3 IMAP protocols

[Joseph Brennan]

Adam Tauno Williams awill...@whitemice.org wrote:

 A friend of mine is asking me about security risks of using IMAP 
 POP3 protocols. Why? Because a sales person told my friend that IMAP
 protocol is less secure than POP3 protocol.


This reminds me of a concern that was raised about U Wash IMAP and storage
of mail in unix home directories.  In that setup IMAP access is based on
unix file system permissions, and IMAP will open files that are not mail
files if the user has unix file permissions to open them-- including
various system files.  This always struck me as a bogus concern since
the user could also telnet in and see the same files!

The protocol itself is no less secure than POP.  I don't understand why
POP is still around.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: howto list inactive users in cyrus:

[Joseph Brennan]

 is there any way to easily list 'last login' for users with cyradm ?
 I got over 1000 accounts and want to find out if there are any inactive
 accounts as in haven't logged on for like 6 months or so' .


 The lastupdate field corresponds with the last time the account received
 an email, not my last login (which was yesterday).


How about checking the timestamp on the user.seen files?  It seems to
get touched at login, even if you don't open a message.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Rights question

[Joseph Brennan]

--On Monday, December 15, 2008 17:30 +0100 Paul van der Vlis 
p...@vandervlis.nl wrote:

 Hello,

 I gave anyone the right to list and post to the mailbox user.jan.Sent.
 But when I give that as the folder for sent-messages in Thunderbird, I
 get an error refused. What do I wrong?

 localhost lam user.jan.Sent
 jan lrswipcda
 anyone lp

 I don't want that anyone can read all the messages, only post messages.

 Met vriendelijke groet,
 Paul van der Vlis.



I assume you are not the user 'jan'.

Sent messages are not mailed, but written with imap, so you need the
'i' right to save sent mail there.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Folder allowed character

[Joseph Brennan]

--On Tuesday, November 18, 2008 11:28 +0100 Antonio Talarico 
[EMAIL PROTECTED] wrote:

 Hi
 Where i can found a list with allowed character for a folder name?



RFC 3501, section 5.1 to 5.1.3

Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: IMAP account used for multiple users

[Joseph Brennan]

--On Monday, October 13, 2008 12:58 -0500 Jason Voorhees 
[EMAIL PROTECTED] wrote:

 Hi all:

 A simple question:
 Is there any kind of problem if a unique IMAP account is used by more
 than one client at the same time?
 I'm thinking to give access to all my users (up to 90 users) trough MS
 Outlook to a unique IMAP account.



I hope you mean that they would each log in with their own account,
and share the same folder.  That should work.

If not, various problems might arise.  Off the top of my head:

-- Anybody could delete and expunge, or, nobody can.

-- They can't keep track of what messages each person has seen.

-- Somebody might POP the mailbox and remove everything.



Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Question ??

[Joseph Brennan]

--On Thursday, October 2, 2008 9:10 -0400 Valentino Sawney 
[EMAIL PROTECTED] wrote:



 Periodically some clients get this error Mailbox is locked by POP server
  whenever they try to connect to our frontend mail servers.



 I am currently running the cyrus murder cluster in production with two
 frontend servers and two backend servers. The error above pops up on the
 backend servers whenever the connection is forwarded to backend .



 Are there any known fixes for this.



That's normal, since the POP protocol requires the mailbox be locked
for the duration of a POP session.  People who run two POP clients at
once will see the error message sometimes.

Of course if POP sessions don't quit when the client quits, that's
another story.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Couple of questions

[Joseph Brennan]

Michael Menge [EMAIL PROTECTED] wrote:

 Beware there is a Bug in Outlook 2003 (don't know which SPs) which
 will get confused if the length of the UID string of a Mail change
 resulting in downloading the same Message over and over again.

Right.  It's an amazing bug, because the examples in the RFC actually
show variable length UIDs!

Users here reported this problem when we first went to Cyrus a few
years ago.  It was solved by applying updates to Outlook, which
the users should have done anyway for security and other reasons.

Or, you have some other problem that we don't have.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Problem on mail boxe

[Joseph Brennan]

I wrote,

 I assume that when Squirrelmail refers to INBOX.Trash it actually
 means a mailbox called Trash under user.satimiscyrus.

But now that I have seen this,

   localhost lm
 INBOX.Drafts (\NonExistent \HasNoChildren)
 INBOX.Sent (\NonExistent \HasNoChildren)
 INBOX.Trash (\NonExistent \HasNoChildren)
 user.aaa (\HasNoChildren)
 user.bbb (\HasNoChildren)
 user.groupware (\HasNoChildren)
 user.ccc (\HasNoChildren)
 user.satimiscyrus (\HasNoChildren)
 user.ddd (\HasNoChildren)
 user/satimiscyrus (\HasNoChildren)

I take it back.  This is really at the point where I think I would
wipe everything out and start over.  Use the dot separator next time,
to clarify the distinction between Cyrus mailboxes and unix files.

Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Problem on mail boxe

[Joseph Brennan]

Stephen Liu [EMAIL PROTECTED] wrote:

 Emails can be received by this user on SquirrelMail.  But they can't be
 deleted.  On deleting following warning popup.

 ERROR: Could not complete request.
 Query: COPY 13 INBOX.Trash
 Reason Given: Permission denied
 * end *
 List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


First of all, the error was not about marking 13 deleted, but about
copying 13 to Trash.  Since the copy failed, Squirrelmail did not
send the delete command, and you don't know whether it would have
worked.  It would be simpler to debug if you configure Squirrelmail
to just mark deleted when you tell it to delete-- no Trash.

Second, stop doing ls on the filesystem.  What you need to know about
is Cyrus mailboxes and permissions-- not what's on the unix filesystem.

Use cyradm to find out whether there is a mailbox called
user.satimiscyrus.Trash, and if not, find out whether the ACL on
user.satimiscyrus allows the user to create subfolders (the c
permission).

It would be weird for a user not to have permission to create
subfolders of his own folders.  That's probably not it.  But
you've been mucking around, so check.

More likely COPY failed because Trash does not exist.  Have the
user create Trash with imap and see if that fixes it.  Or use
cyradm to create user.satimiscyrus.Trash.

I assume that when Squirrelmail refers to INBOX.Trash it actually
means a mailbox called Trash under user.satimiscyrus.  If Squirrelmail
wants to use Trash and it is not there, I don't know why it does not
just create it instead of reporting an error, but I have seen other
clients that dumb.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology














Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Cyrus - can't create user mailbox

[Joseph Brennan]

  $ cyradm -u cyrus localhost
  Password:
  localhost dm user.satimiscyrus
  deletemailbox: Permission denied
 
  I can't delete the mailbox created previously.

 Because you need to give yourself the right before

 Whether I have to run the command as root?

Root doesn't matter.  The cyrus user needs permission to delete.
This is a safety feature.   sam user.satimiscyrus cyrus all



  localhost cm user/satimiscyrus
  localhost lm
  user.groupware (\HasNoChildren)
  user/satimiscyrus (\HasNoChildren)
  user.satimiscyrus (\HasNoChildren)
 
  Still can't create the subdirectory.

It did what you asked, but I don't think you asked for what
you wanted.



 $ sudo find / -name *satimiscyrus*
 Password:
 /var/spool/cyrus/mail/s/user/satimiscyrus
 /var/spool/cyrus/mail/u/user^satimiscyrus
 /home/satimiscyrus

This looks correct.  Note:
(1) Cyrus user.satimiscyrus = filesystem user/satimiscyrus
(2) Cyrus user/satimiscyrus = filesystem user^satimiscyrus
(3) is not a Cyrus mailbox

I would expect mail addressed to satimiscyrus to end up in (1).

(2) is not a user mailbox.  It could work as a bboard mailbox but
that's not what you want in this case.



Joseph Brennan
Columbia University Information Technology







Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Help with bulletin board functionality

[Joseph Brennan]

--On Tuesday, May 20, 2008 10:44 +0200 Mark Clarke 
[EMAIL PROTECTED] wrote:

 We are experimenting with using cyrus imap bulletin boards. Our imap
 server hosts several domains and we figured out how to create bulletin
 board folders for the different domains, in cyradm, by going cm
 [EMAIL PROTECTED].

There are probably issues related to the domain hosting that I never
had to deal with.  But I can answer some of this.



 1) How to post to the bulletin board?
 I have read about using a syntax like [EMAIL PROTECTED] At
 first the smtp server was refusing to deliver to this address until we
 added it to the allowed virtual domain addresses. (We are using postfix
 for smtp). Now the message gets to cyrus but we get a 500 error about
 the mailbox not existing or not having sufficient rights to post. I have
 given myself all  rights to the mailbox.

The permission needed is anyone p.  Depending on how your system
is set up, cyrus may have no way to verify who is sending mail, and
would need to see that anyone has the p permission.

This is no different than for any mailbox.  All inboxes have an
implicit anyone p.



 2)How do you delete an entry from the bulletin board folder?
 Since I had all rights I deleted a test mail I got into the folder by
 dragging and dropping it in evolution. On my machine the folder is
 empty. On other users who has lr rights to the mailbox the mail is still
 showing. How do I delete it from everyones view?

The same way you delete from any mailbox.  Someone with the d
permission can mark it deleted, and then expunge.

I cannot think of any way to duplicate what you describe.  It sounds
like evolution is showing you something different from what is on the
server, which would be pretty bad.  Maybe you could check by reading
with a different client, or from a different computer, using your own
account, or even better, learn how to type imap commands from telnet
so you can get a view without a client.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology












Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Backscatter solutions

[Joseph Brennan]

Ian Eiloart [EMAIL PROTECTED] wrote:

 If you aren't using SPF, then you can't really complain about backscatter.


Forget SPF.  Why should any system accept mail for an unknown recipient
and then mail a bounce?  That's the primary cause of backscatter.  These
systems are just as likely to accept the message, then check SPF, and
mail a bounce :-)


This is getting off topic for the Cyrus list though.  The question
relevant to Cyrus, I thought, was whether a sieve filter can catch
backscatter.  With header-only tests, not so much.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Subject problem

[Joseph Brennan]

--On Thursday, April 3, 2008 17:26 +0300 Nikos Gatsis [EMAIL PROTECTED] 
wrote:

 I'm facing a strange problem.
 Every message I receive with Greek characters in subject cyrus
 translate them to X...

 Does somebody know what's going on?


It means the Subject had 8-bit characters, not encoded.  The sender's
email program should be encoding them.  The header portion of mail
is required to be 7-bit only.

Joseph Brennan
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Sieve forwarding loop destroys e-mail

[Joseph Brennan]

Matt Garretson [EMAIL PROTECTED] wrote:

 Along similar lines, any well-written Procmail recipe which redirects
 mail typically checks for, or adds, an X-Loop header before
 forwarding anything.

Yes, it's an old solution.

The crucial difference is that if one writes a bad procmail recipe,
the message loops round and round until one of the MTAs considers
the hop count exceeded and bounces it to sender, but if one writes
a bad sieve rule, the message _is silently lost_.  That's a much
harsher penalty.

And we stand a chance of here of doing _better_ than procmail.  If
we insert a header roughly like 'X-Sieve-Seen: user hostname' when
we forward, we can look for it in incoming messages and say we
won't forward again.  So the penalty for writing a bad sieve forward
rule would be that it doesn't forward.  That's better than bounce
to sender, and way better than losing the message.


 If the editheader Sieve extension gets implemented, then a well-
 written sieve script should be able to do the same type of thing.
 To me this seems a bit more sane than expecting lmtp or sieve to
 accomplish it automatically.

I've been called crazy before!



Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Sieve forwarding loop destroys e-mail

[Joseph Brennan]

Jo Rhett [EMAIL PROTECTED] wrote:

  I would ask that you spend some time determining how the
 program could determine it is a bad rule, and provide a patch to fix this
 behavior.  (in short -- it's harder than you think)

A mail delivery system that loses mail is buggy.  I don't need to look
at the code to know that.

You can tell me no one has time to fix it, and in an open source project
I can respect that.  But it is a bug.



   or back to sender (grounds: not deliverable as configured).

 Only if you want to become a source for backscatter.

Losing mail is much worse than backscatter.  With bounces limited to
people who get a forward loop going, bounces are not a big issue.



Gary Mills [EMAIL PROTECTED] wrote:

  Of course,
 it's impossible to distinguish between a forwarding loop and a real
 duplicate unless another `Received' header is added to the message
 header.

Hm.  What if duplicate suppression is turned off?  Infinite loop?

Hop count is the classic MTA method of detection, but here the very
first time around the loop will hit dup suppression.  This calls for
something else that lets the system know the message already passed
through a local sieve script.



Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Sieve forwarding loop destroys e-mail

[Joseph Brennan]

 I'm all for trying fix this if someone can come up with some logic to do
 so.  IMO, the code is correctly processing the script as written.  Here
 is the current code logic:

 - original message is sent to lmtpd
 - message is forwarded and a record is put in deliver.db stating as much
 - forwarded message comes back to lmtpd
 - lmtpd executes the script which tells it to forward to another address
 - lmtpd sees that it has already forwarded the message, so doesn't
 forward it again

 At what point should we decide to deliver the message?  The user hasn't
 asked us to do that, even though they think that they have.  How can
 lmtpd be intelligent enough to know that the forwarded address will
 cause the message to come back?


In case [1], user X forwards to an external address which forwards back
to user X.  This could be solved by not suppressing duplicates when
forwarding to external addresses.  Instead the loop would be stopped
by exceeding the hop count in the MTA, and the MTA would bounce.  This
emulates what happens with .forward or .procmailrc loops.

In case [2], user X forwards to user X.  If lmtpd hands this to the
MTA, it's like case [1].  Or does lmtpd handle this by itself?  In
that case the loop should be detectable, I imagine.

I'm probably missing something.

We might be smarter with case [1] if lmtpd inserted a X-Been-Here
type header as it hands off to the MTA, so that it could detect a
loop the first time the message comes back.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Sieve forwarding loop destroys e-mail

[Joseph Brennan]

--On Sunday, March 30, 2008 2:27 PM +0100 Alain Spineux 
[EMAIL PROTECTED] wrote:

  Shouldn't we have a better solution to this problem?  Some people
  expect that forwarding e-mail to yourself should work; nobody expects
  the messages to vanish without a trace.

 You must enforce this at sieve script creation,


No, it is just totally wrong that an action other than 'discard' will
result in mail silently vanishing.  Maybe this is what does happen, but
it is not what _should_ happen as was asked.  It _should_ either go to
inbox (grounds: ignore a bad rule) or back to sender (grounds: not
deliverable as configured).

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: delete messages from a mailboxe matching corresponding SUBJECT header

[Joseph Brennan]

--On Monday, March 24, 2008 2:54 AM +0600 Vladi Lemurov [EMAIL PROTECTED] 
wrote:

 Is there some way to do that, I mean to delete all messages marked in
 subject as !! SPAM by means of cyrus tools?


Give your account 'all' permission.  Open the mailbox with an imap client
to select messages with the word in subject, delete, expunge.  Remove the
permission.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: sieve problem

[Joseph Brennan]

--On Friday, March 21, 2008 13:12 +0100 Christoph Kaminski [EMAIL PROTECTED] 
wrote:

 Hi!

 Why this rule doesnt work?

 IF 'From:' contains '[EMAIL PROTECTED]' AND 'From:' contains
 '[EMAIL PROTECTED]' AND 'From:' contains '[EMAIL PROTECTED]'
 AND 'From:' contains '[EMAIL PROTECTED]' THEN file into
 'INBOX.Informationen.Foren.DVB'

 It is created with smartsieve...


I've never seen a 'From:' with four addresses in it.  Use OR.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Want cyrus to deliver directly into a mailbox's folder.

[Joseph Brennan]

 Mar 20 11:09:05 mypostfix postfix/lmtp[22947]: 348ED583EB:
 to=[EMAIL PROTECTED], orig_to=[EMAIL PROTECTED],
 relay=mycyrus[myip]:24, delay=0.14, delays=0.11/0.01/0/0.02, dsn=2.1.5,
 status=sent (250 2.1.5 Ok)

 and it is delivered in my INBOX mailbox, not in my spam folder!!

 User 'cyrus' has 'lrswipcda' access to this folder.

 Do I need to configure something on my cyrus side ?


It needs 'anyone p' access.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology






Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Importing Mails without to header

[Joseph Brennan]

--On Friday, February 15, 2008 5:18 PM + Phil Chambers 
[EMAIL PROTECTED] wrote:

 This is valid: To: undisclosed recipients :;
 This is not:   To: undisclosed recipients


 I would say that the former is not actually valid, though the syntax
 looks  correct. RFC2822 section 3.6.3 says that To:, Cc: and Bcc: must
 contain at  least one address. The above does not contain an address.


But this IS an address by definition.  RFC 2822 even shows it in an
example, namely the CC address in section A.1.3.  Sec 3.4 says,

address =   mailbox / group

group   =   display-name : [mailbox-list / CFWS] ;
[CFWS]

   Because the list of mailboxes can be empty, using the group construct
   is also a simple way to communicate to recipients that the message
   was sent to one or more named sets of recipients, without actually
   providing the individual mailbox address for each of those
   recipients.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Importing Mails without to header

[Joseph Brennan]

 Situation: an old user has a mail in his account, that was sent _only_ to
 bcc:  People, so in to: you will only find undisclosed recipients.

Check what is really in the message.  Some mail programs display the
null address in modified form.

This is valid: To: undisclosed recipients :;
This is not:   To: undisclosed recipients

I hope Cyrus is complaining only about the latter.


 When we  now try to import these mails into a cyrus imap folder we get a
 message that  an invalid header was detected.

When we migrated to Cyrus we wrote a preprocessor perl script that
rewrote certain header lines to make them standard.  The rewritten
mailbox was output to a staging area, and that's what we moved.  This
approach might work for you.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Reject large emails

[Joseph Brennan]

--On Wednesday, February 13, 2008 12:27 PM +0200 Nikos Gatsis 
[EMAIL PROTECTED] wrote:

 Joseph thank you for your answer.
 We use sendmail. Do you know how to set up sendmail.mc to reject those
 emails?


define(`confMAX_MESSAGE_SIZE',3000)

Read the README for how to put that into sendmail.mc and generate a
sendmail.cf file.  Your choice of size, in bytes.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


 

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Reject large emails

[Joseph Brennan]

--On Tuesday, February 12, 2008 10:58 +0200 Nikos Gatsis [EMAIL PROTECTED] 
wrote:

 Hello list.
 Is it possible with cyrus to reject emails with large attachments and
 inform the sender for the rejection?


As stated, normally done at the MTA level.  But note also, normally
done by total message size, not attachment size.  If you have to
analyze mime parts and measure the size of each one, half the battle
is lost already, that is the sender already transmitted the large
message and you had to store it in a spool file and parse it.

At MTA level, if you and the sender both use ESMTP, your MTA can state
its maximum message size in the ehlo response, and the sender's MTA can
see that and not even send the message.  That is the best outcome.  If
the sender does not use ESMTP, it wastes time sending the entire
message, but you can still reject quickly.

The sender's MTA will create the bounce notice, or do whatever else
it does when mail can't be delivered.

The Cyrus system should not send a bounce.  It should only accept or
reject, and the sending MTA should handle notifying the sender.

Joseph Brennan
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: OT: Re: How many people to admin a Cyrus system?

[Joseph Brennan]

David Chait [EMAIL PROTECTED] wrote:

 One key piece of functionality that seems to be missing from every OSS
 solution mentioned thus far is mobile device push support (Activesync),
 this is not to be underestimated as it is for us, a key reason why we are
 ultimately being forced to adopt Exchange en-mass and abandon our current
 Cyrus infrastructure.

-
Right.  This is a necessity for us too, if we are to integrate the
Exchange and Cyrus systems.  One of the interesting things about
Open-Xchange is support for push via SyncML.  There is a list of PDAs
that it works with.

The devices we support now need the intermediaries of either GoodLink
or BES attached to Exchange, and if I understand it right (I might not),
they use a MAPI connection to find out when there is new mail.  If so
it appears they would work also with systems like Open-Xchange that
offer MAPI connections.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: duplicate messages

[Joseph Brennan]

--On Friday, September 28, 2007 10:42 -0400 Gottschalk, David 
[EMAIL PROTECTED] wrote:

 it appears that after Cyrus gets the message it gets
 duplicated. Anyone have any suggestions?


Sieve rules?

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: delete messages from INBOX.Trash INBOX.Junk

[Joseph Brennan]

--On Thursday, September 20, 2007 11:47 -0400 Robert Banz [EMAIL PROTECTED] 
wrote:

 They're the kind of folks that routinely ask for important mail
 we've deleted from their Trash folder to be restored.



Ha!  The same thing has happened here.

Note, the client makes a Trash folder and provides a nice button to
move things into it.  Imagine if the client also made an Archive folder
and had another button for that.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Relation of filesystem to Cyrus mailbox structure

[Joseph Brennan]

--On Friday, September 14, 2007 8:27 -0700 Rick Kunkel [EMAIL PROTECTED] 
wrote:

 Where I've been stuck recently is trying to figure out things like how to
 manipulate mailboxes by using the file system.  Maybe this isn't really
 practical using mdir.

 Here's the latest:  I have a user that we migrated from mbox.  She has
 her  inbox folder, which migrated fine.  Then she has a couple of other
 folder,  which migrated fine.  Then she has folders within folders, and
 those  refuse to show up, and it won't let her subscribe to them.  Here's
 how it  they're in the filesystem:

 /var/mail/j/user/janedoe   -- Inbox: Migrated fine
 /var/mail/j/user/janedoe/folder1  -- Also migrated fine
 /var/mail/j/user/janedoe/folder1/folderA  -- I can't get to show

 I don't think the user really NEEDS the folder called folder1 above, but
 wants the folders inside of it.  So I tried to move folderA back one
 level  so that it was sitting inside the /var/mail/j/user/janedoe folder,
 but  that doesn't work.  I figured I had to run a reconstruct command,
 but no  avail there either.

 I guess the fundamental question here are these:

 - If I make changes to the file system, how do I get these reflected in
 Cyrus mailbox views?


It's less painful if you can use Cyrus to do this stuff.  I know :-)
The main reason you might have to do this would be restoring entire
mailboxes off backups.

Given  /var/mail/j/user/janedoe/folder1/folderA , Cyrus might have
three mailboxes named user.janedoe, user.janedoe.folder, and
user.janedoe.folder.folderA, but not necessarily.

cyradm will show you what folders exist, in Cyrus's view, and it
lets you create, delete, and rename mailboxes to make the Cyrus
view be what you want it to be.  Cyrus will move the files around
in the filesystem accordingly.

To do batch work a perl script can use Cyrus::IMAP::Admin to do
what cyradm would do.

When we migrated from mbox, we created Cyrus mailboxes for the
directories too.  For ~janedoe/mail/foo/bar (mbox file) we created
both user.janedoe.foo and user.janedoe.foo.bar, even though the
user had never stored mail in foo (since it was a directory).
This seemed simpler than having to explain later that foo could
be part of a mailbox name but not exist as a mailbox!

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology












Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Relation of filesystem to Cyrus mailbox structure

[Joseph Brennan]

Jorey Bump [EMAIL PROTECTED] wrote:

 This is one area migration tools failed me, as well. None of them were
 able to automatically create the mailbox that corresponds to the
 *directory* that held mbox files, even via IMAP. They were able to
 preserve the structure, however.


But analyzing the old file structure is not difficult to script.
find gives a nice list.  if (-z $file || -d $file), just create
a Cyrus mailbox but skip the message moving tool.

Detail will vary depending how the old mail was structured.  We had
to grab /var/spool/mail/user, ~user/mbox, and ~user/mail/*  which
might be common in U Wash for example.  It might have been cool to
test the first five characters in ~user/* for From  to catch
stray files not in the mail directory.

You're right, it's amazing how many users have only inbox and
sent and trash folders (of varying names).

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: problem with cyr_expire

[Joseph Brennan]

--On Monday, September 3, 2007 2:01 PM +0200 Rudy Gevaert 
[EMAIL PROTECTED] wrote:


On Mon, 03 Sep 2007 10:17:47 +0200, Rudy Gevaert
[EMAIL PROTECTED] said:
 Hello,

 I noticed that I'm having a problem with cyr_expire.  I previously set
 an expire annotation on a mailbox.  (Some months ago.)

 I have now seen that cyr_expire goes upto that mailbox and then errors:

 Sep  2 04:40:07 himalaya mail1/cyr_expire[10145]: IOERROR:
 ugent.be!user.rudy^gevaert.Spam zero index/expunge record 8/1183861181


We have had the same problem repeatedly on a folder that has an expire
annotation:

Sep  2 04:01:11 currywurst cyr_expire[7184]: IOERROR: spam zero
index/expunge record 443/1247

The disk was fsck'd about three weeks ago and it did have some data
errors that were repaired.  We then went about a week without the error
and now it is back, every few days.  Running reconstruct definitely
fixes it, but it does not stay fixed.

1247 is not the number of messages in the mailbox.  There are about
19,000 messages.  What does 443/1247 represent?

The only other mailbox that has this problem is also the only other
mailbox we have that has an expire annotation.  But this other one has
the problem much less often, and not at all since the fsck.  It is on
the same partition.

I have wondered whether the bogus Date headers in spam tickle a bug
in expiring by date.


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: better techniques to identify and remove zero-day viruses from cyrus store sought

[Joseph Brennan]

John Crawford [EMAIL PROTECTED] wrote:

 What's the best way, and second best way to react to zero-day virus
 threats - messages that are delivered to the mail store before the
 detection is in place?


Refuse mail with executable attachments.  List is at:

http://support.microsoft.com/kb/262631
http://support.microsoft.com/kb/829982

This 100% effective and there are no zero-day or zero-hour problems.
Done here since February 2003.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Misdelivered messages

[Joseph Brennan]

Recipient addresses don't have to appear anywhere in the message.
And in spam the To: header is often garbage.  Ignore that.

Look at the system log records written by your MTA (Postfix?) to
see who the recipients were.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology





--On Wednesday, May 23, 2007 9:37 -0400 Dana Canfield [EMAIL PROTECTED] 
wrote:



In the past week or so, we've had trouble with spam being delivered to
the wrong recipients.  It's difficult to explain, so I'll use an example:

[EMAIL PROTECTED] and [EMAIL PROTECTED] are local users receiving
hundreds of spam per hour.  None of it is addressed to them.  Their email
addresses don't appear anywhere in the message source.  The messages in
hackxx's account appear to be the same messages that xxmelser is
receiving.  Most of the misdirected messages seem to be addressed to
other local users, such as [EMAIL PROTECTED] or [EMAIL PROTECTED]
To further confuse the issue, this only happens with spam.  A legitimate
message mailed to [EMAIL PROTECTED] goes through to xxmilton's account
and doesn't appear in the other users' mailboxes.  The *only* clue I have
found is that most of these spams that get misdirected have a gap between
the To: and the address in the message header, like this:
To:   [EMAIL PROTECTED]

Does anyone have any clue what might be going on here?

Thanks
DC

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Deleting mailboxes on master

[Joseph Brennan]

We cut over from a primary to a replica, and then back again, all within
one outage, because we got the primary going again pretty fast.

Now we have an interesting situation.  The replica told the master about
some obsolete mailboxes that no longer exist on the primary.  As a result
the mupdate from the primary did not rewrite the location of these
obsolete mailboxes.  They really do exist only on the replica.

The replica does not report to the master (if it did, it would fight with
the primary about where mailboxes are).  Therefore, the following do not
change the master: running cyradm on the replica and doing deletemailbox;
and deleting the mailbox with an imap client.

I have a list of them from running ctl_mboxlist -d on the master.  But I
can't figure how to remove them from the master's mailbox list.  Does
anyone have an idea?

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Bare newlines problem

[Joseph Brennan]

--On Tuesday, April 3, 2007 13:27 +0200 Paul van der Vlis 
[EMAIL PROTECTED] wrote:



Hello,

When I move a message to another mailbox, I get a warning about bare
newlines. How can I remove these bare newlines?

It's a big message with foto's, 3.5 MB. I am not sure this warning is
correct.

I allready tried a perl-script of Joseph Brennan what I found in this
list, but it did not change the message (checked with diff).



The script prepares mbox-format mailboxes for mailutil, which complains
if there are CR characters (\015) in the mbox-format files.  It changes
CRLF to LF and then changes remaining CR to LF.  Bare LF is normal for
unix files.

Are you sure it says bare newlines?  Newline is an ambiguous term.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: POP3 to CyrusIMAP migration howto ?

[Joseph Brennan]

--On Wednesday, March 28, 2007 12:10 +0530 BipinDas [EMAIL PROTECTED] 
wrote:



Hi All,
I would like to migrate my existing POP3 inboxs to newly created Cyrus
IMAP mailbox. Is anybody gone across  this requirement.
Please give me a right solution.




POP3 inboxes are stored locally on each PC.  Each user would have
to run a client that can move messages from the local inbox to
the Cyrus server.  You cannot do it for them unless you have some
kind of remote access to all the PCs (which might be the case in a
controlled corporate environment).


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Exchange's handling of Sieve Reject

[Joseph Brennan]

Users on two separate Exchange servers here have reported that they
don't see the reason part of messages rejected by sieve.

The Cyrus user has a reject rule.  I can reproduce it simply as:


##INGO
# sieve filter generated by Ingo (March 14, 2007, 8:51 am)

require reject;

# Sieve Reject Test
if header :comparator i;ascii-casemap :contains Subject please reject 
this message  {

   reject You want it rejected, you get it rejected.;
   stop;
}

-
To see precisely what is returned, send mail to [EMAIL PROTECTED] with
the subject please reject this message.  The mime message looks
syntactically correct to me, as follows:

main message is multipart/report
part 1 is text/plain
part 2 is message/disposition-notification
part 3 is message/rfc822

The Exchange messages were viewed with Outlook.  Outlook users did not
see any of the message sent by Sieve, but only a new text generated by
Exchange or Outlook that looks like this:
-

From: Mail Sieve Subsystem [mailto:[EMAIL PROTECTED]
Sent: Tuesday, March 13, 2007 5:20 PM
To: [EMAIL PROTECTED]
Subject: Automatically rejected mail


Your message

 To:   [EMAIL PROTECTED]

 Subject:  test

 Sent: 3/13/2007 5:19 PM


was deleted without being read on 3/13/2007 5:20 PM.

-
One of our staff looked at one of the message also with Evolution, and
reported a *variant* form of the above message, making me wonder what
data Exchange is sending to the client.  It looks like this:
-

Your message

 To:  [EMAIL PROTECTED]
 Subject: test attachment
 Sent:Tue, 13 Mar 2007 17:18:41 -0400

was not readTue, 13 Mar 2007 17:20:06 -0400?



mail disposition
report attachment

Content-Type: message/disposition-notification
Content-Transfer-Encoding: 7bit

Final-Recipient: RFC822; [EMAIL PROTECTED]
Disposition: automatic-action/MDN-sent-automatically; deleted
Original-Message-ID:
[EMAIL PROTECTED]

-
Notice the changes in the line spacing, the Sent: line, the was line,
and the inclusion here of the text from mime part 2.  Evolution also
indicated the presence of a dat attachment after this, which the Outlook
users did not see.


We did not yet test what Outlook shows when it reads as an imap client
off the Cyrus server.  All the above was read off an Exchange server.

Possible fixes would be to format the rejection like a reply or a
forwarded message, or plain text, but it would be pretty dumb.  Has
anyone else dealt with this at all?  Any bright ideas?

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology













Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: reconstruct deletes messages

[Joseph Brennan]

--On Tuesday, March 6, 2007 9:01 +0100 Michael Menge 
[EMAIL PROTECTED] wrote:



Hi,

which Version of Cyrus do you run. In 2.3.x is a new feature
expunge_mode: delayed
which leaves the deleted mails on disk, till they are deleted by
cyr_expire.
Till 2.3.8 reconstruct did not recognise these feature and removed the
files.
But this would only delete files if they where deleted in Cyrus before.



Thank you.  We're 2.3.something but not 2.3.8.  This explains what
is happening to messages after we restored from backup.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

reconstruct deletes messages

[Joseph Brennan]

We're running into cases where running reconstruct removes message
files, sometimes all of the messages in a folder, leaving only the
directory and the cyrus.cache, cyrus.header, cyrus.index files.

This makes no sense to me at all.  I thought the only purpose of
reconstruct is to rebuild the index.  Under what circumstances
would it unlink files?

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Moving mail into IMAP server and the Received date

[Joseph Brennan]

--On Monday, February 19, 2007 16:32 +1000 RM [EMAIL PROTECTED] wrote:


I've been experimenting with cyrus and some other imap servers which also
exhibit this problematic behaviour: when I move the mail from a local
folder to an imap folder under cyrus, my adjacent Windows/OutlookXp mail
reader sorts the mail by Received date, and the date registered as
Received is the time/date that the copy operation is carried out (ie:
now) rather than the date that the mail was actually originally received.


Outlook uses the internaldate attribute.  RFC 3501 says:

2.3.3.  Internal Date Message Attribute

  The internal date and time of the message on the server.  This
  is not the date and time in the [RFC-2822] header, but rather a
  date and time which reflects when the message was received.  In
  the case of messages delivered via [SMTP], this SHOULD be the
  date and time of final delivery of the message as defined by
  [SMTP].  In the case of messages delivered by the IMAP4rev1 COPY
  command, this SHOULD be the internal date and time of the source
  message.  In the case of messages delivered by the IMAP4rev1
  APPEND command, this SHOULD be the date and time as specified in
  the APPEND command description.  All other cases are
  implementation defined.

The relevant command is APPEND, and its description says:

6.3.11. APPEND Command

  Arguments:  mailbox name
  OPTIONAL flag parenthesized list
  OPTIONAL date/time string
  message literal

  [ . . . ]

 If a date-time is specified, the internal date SHOULD be set in
 the resulting message; otherwise, the internal date of the
 resulting message is set to the current date and time by default.


So when a client moves mail from local to server, it *could* send
an internaldate.  Cyrus honors this.  When we moved from U Wash to
Cyrus we were careful to get the internaldate from U Wash and send
it in the append command to Cyrus.

When the client does not send an internaldate, Cyrus follows the
RFC and assigns the current date and time.  There is no imap command
to change internaldate once it has been assigned.

Ideally you might be able to find a client that sends internaldate
when it moves mail from local to server.  The catch is that since so
many clients, like Thunderbird, do not use internaldate to sort, they
probably don't preserve it in local folders, and they probably don't
try to reconstruct what it was from Received or Date headers when they
append to a folder on server.

It's not really a Cyrus or Outlook bug.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology











Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: A script for fixing bare newlines in mailbox files?

[Joseph Brennan]

--On Thursday, January 11, 2007 17:35 -0500 Zachariah Mully 
[EMAIL PROTECTED] wrote:



Howdy all-
We've been bitten by migrating some of our people from Outlook to
Thunderbird, and then using Tbird to move their mail off their local
machines onto the IMAP server where it belongs. Unfortunately we've not
patched Cyrus to accept bare newlines, nor intend to... Since I have
access to the local mailboxes does anybody have a perl script or
something of the like that would remove the bare newlines from the raw
mailbox files? My perl-fu sucks this days, and I've not been able to
figure where and how to remove them...



When moving from U Wash to Cyrus we applied this rewrite to all
mailboxes.  Get rid of any nulls while you're at it.


while() {

   # The \000 character (NUL) is not allowed
   if ($line =~ s/\000//g) {
  print STDERR WARNING: Removing NUL\n;
   }

   # Change CRLF or bare CR to LF
   $endcr = $midcr = 0;
   $endcr++ if ($line =~ s/\015$//g); # \n already there
   $midcr++ if ($line =~ s/\015/\n/g); # add \n
   if ($endcr || $midcr) {
  print STDERR WARNING: Correcting CR characters\n;
}


   print;
}


Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: A script for fixing bare newlines in mailbox files?

[Joseph Brennan]

--On Friday, January 12, 2007 12:18 -0500 Jorey Bump [EMAIL PROTECTED] 
wrote:




Did any users report any further corruption of what is arguably already a
corrupted message? I'm not familiar with the cause of this problem, but
having encountered it before, mainly with messages that have large
attachments, I'm wondering if attached files might be unusable after such
a scrubbing (assuming they were not encoded properly).





No.  For a few years we have been refusing or rewriting messages
with nulls or bare returns, so only mail at least 4 years old was
involved.  Many of the messages involved were 10 years old or more.

Amateurish Windows-based mail-sending software is still in use that
sends junk like this.  From the lack of trouble reports, I think it
is text parts that are mainly affected.  Maybe to do encoding the
software writers use standard modules that do it right.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology




Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

cyr_expire error

[Joseph Brennan]

cyr_expire has started failing with this error:

 cyr_expire[4729]: IOERROR: bboard zero index/expunge record 4/1591

This is 2.3.  Here's the info from cyradm:

localhost.columbia.edu info bboard
{bboard}:
 expire: 180
 lastpop:
 lastupdate: 17-Dec-2006 20:42:17 -0500
 partition: default
 size: 8733755

So this is a top-level shared folder, not under user/, and articles
should expire after 180 days.

The error is this in mailbox.c:

   /* Copy over records for nondeleted messages */
   for (msgno = 1; msgno = exists; msgno++) {
   /* Copy index record for this message */
   memcpy(buf,
  index_base + mailbox-start_offset +
  (msgno - 1) * mailbox-record_size, mailbox-record_size);

   /* Sanity check */
   if (*((bit32 *)(buf+OFFSET_UID)) == 0) {
   syslog(LOG_ERR, IOERROR: %s zero index/expunge record %u/%lu,
  mailbox-name, msgno, exists);
   return IMAP_IOERROR;
   }


But bboard contains messages 309. to 704., not 4 to 1591.  We are using
delayed expunge.

What should I look at?


Joseph Brennan
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: cyr_expire error

[Joseph Brennan]

Earlier I wrote:



cyr_expire has started failing with this error:

  cyr_expire[4729]: IOERROR: bboard zero index/expunge record 4/1591




D'oh.  I did reconstruct bboard and that fixed whatever it was.

But this was repeatedly stopping cyr_expire from continuing.  It is
now running through all of the mailboxes it had missed since bboard got
corrupted.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Beyond rtcyrus2 (sendmail integration)

[Joseph Brennan]

Andrzej Adam Filip [EMAIL PROTECTED] wrote:


2) Methods you suggest do not give a chance to reject messages to over
quota mailboxes *in SMTP session*.


...which can be a good thing if you want to give users a chance to
clean up or request more space.

The trouble with smmapd is that it gives only a binary yes/no response,
not distinguishing even 'user unknown' from 'user over quota'.  Reject
'user unknown' in the smtp session-- absolutely-- but temp fail situations
are handled more nicely by accepting and queueing locally.

Joe Brennan



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Beyond rtcyrus2 (sendmail integration)

[Joseph Brennan]

--On Wednesday, November 29, 2006 16:11 +0100 Andrzej Adam Filip 
[EMAIL PROTECTED] wrote:



I would like to know who is interested in helping to develop next
versions of advanced Sendmail and Cyrus IMAP integration methods.
I would like to further improve methods available at links below:
  http://anfi.homeunix.net/sendmail/rtcyrus2.html
  http://anfi.homeunix.net/sendmail/#cyrus


I have created google group for the purpose. Join it if you are
interested:
  http://groups-beta.google.com/group/cyrus-sendmail




Sounds good to me.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology


Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Folders containing messages and subfolders

[Joseph Brennan]

--On Tuesday, November 28, 2006 15:48 + Kevin Clark 
[EMAIL PROTECTED] wrote:



Hi,

Does Cyrus IMAP support the ability to have folders that may contain both
messages and subfolders?

The tdlp.org 'MS Outlook to Unix Mailbox Conversion' MINI-HOWTO suggests
that no Linux IMAP server using the Mailbox format supports this feature.

Does Cyrus IMAP use the Mailbox format and, if so, does it therefore NOT
support folders containing both messages and subfolders?



By 'Mailbox format' they seem to mean 'mbox' format.  When that format
is used, a 'mail folder' is either a directory containing other folders
or a file containing messages.

Cyrus does not use mbox format, and its 'mail folders' can contain both
messages and other folders.

Joseph Brennan
Lead Email Systems Engineer
Columbia University Information Technology



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html