old lock files listed at cyrus-imapd startup
Hi, I do see a lot of .lock file when starting cyrus: /run/cyrus/lock/t/user/test/Drafts.lock [...] This has already been reportet in the Ubuntu bug tracker #1010424 two years ago: https://bugs.launchpad.net/ubuntu/+source/cyrus-imapd-2.4/+bug/1010424 /etc/init.d/cyrus-imapd: # Clean stale entries find $LOCK_DIR -mindepth 1 -depth -size 0 # -delete find $PROC_DIR -mindepth 1 -depth -name '[0-9]*' # -delete Is it safe to use the -delete option and to remove old .lock files at startup? Or what are these old lockfiles for? Ciao Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Problem creating / finding mailboxes
CentOS 6.5, cyrus-imapd 2.3.16-6 So, I gather you're supposed to create mailboxes called user.username But I wind up with user^username, and mailbox can't be found. [joliver@localhost ~]$ cyradm -u testuser1 localhost Password: localhost cm user.testuser2 localhost cm user.testuser3 localhost cm user.textuser4 [joliver@localhost ~]$ sudo ls -l /var/vmail/u/ total 12 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^testuser2 drwx--. 2 cyrus mail 4096 Sep 15 14:51 user^testuser3 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^textuser4 Sep 15 15:05:18 localhost lmtpunix[15704]: verify_user(user.testuser2) failed: Mailbox does not exist Sep 15 15:05:18 localhost master[15929]: about to exec /usr/lib/cyrus-imapd/lmtpd Sep 15 15:05:18 localhost lmtpunix[15929]: executed Sep 15 15:05:18 localhost postfix/lmtp[15928]: 4B2E61ED5: to=testus...@domain.com, relay=localhost.localdomain[/var/lib/imap/socket/lmtp], delay=32, delays=32/0.01/0/0.02, dsn=5.1.1, status=bounced (host localhost.localdomain[/var/lib/imap/socket/lmtp] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) What did I do wrong? -- *** * John Oliver http://www.john-oliver.net/ * * * *** Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: cyrus/chk_cyrus found messages and deleted messages differs on master and slave
Hi, Am Montag, den 15.09.2014, 20:08 +0200 schrieb Marcus Schopen: Or another way: just delete user.userxyz.sent_mail subfolder using cyradm. The sent_mail folder will be moved into a subfolder under u/DELETED/user/userxyz/sent_mail/ and will only keep message 1., because all other emails are not know by the cyrus databases in user.userxyz.sent_mail. This would solve the chk_cyrus error messages. But what happens to hardlink 1807. then? Will cyrus keep these mails in Gesendete Elemente then? I renamed the sent_mail folder to sent_mail_test (using Thunderbird). This action removed all UIDs in the filesystem inside the sent_folder, which were not known by cyrus.* databases in the sent_mail folder. Afterwards I renamed the folder back to sent_mail. The only UID which wasn't deleted is UID 1., which is correct, because this UID was created inside the sent_mail after the users copy/movement/whatever session, first new email/UID. A following chk_cyrus didn't come up with errors. :) Checking files: # ls -li /var/spool/cyrus/mail/u/user/userxyz/sent_mail/1766. No such file or directory - good, deleted by my renaming #ls -li /var/spool/cyrus/mail/u/user/userxyz/Gesendete\ Elemente/1807. 10897103 -rw--- 3 cyrus mail 5520 Sep 9 23:08 /var/spool/cyrus/mail/u/user/userxyz/Gesendete Elemente/1807. - good, still there # ls -li /var/spool/cyrus/mail/u/DELETED/user/userxyz/sent_mail/54101FA9/1766. 10897103 -rw--- 3 cyrus mail 5520 Sep 9 23:08 /var/spool/cyrus/mail/u/DELETED/user/userxyz/sent_mail/54101FA9/1766. - good, will be hopefully deleted after 7 days be nightly expunge Question still is what caused this inconsistence between cyrus.* databases and fileystem, how can that happen? Cheers Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Problem creating / finding mailboxes
CentOS 6.5, cyrus-imapd 2.3.16-6 So, I gather you're supposed to create mailboxes called user.username But I wind up with user^username, and mailbox can't be found. [joliver@localhost ~]$ cyradm -u testuser1 localhost Password: localhost cm user.testuser2 localhost cm user.testuser3 localhost cm user.textuser4 [joliver@localhost ~]$ sudo ls -l /var/vmail/u/ total 12 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^testuser2 drwx--. 2 cyrus mail 4096 Sep 15 14:51 user^testuser3 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^textuser4 Sep 15 15:05:18 localhost lmtpunix[15704]: verify_user(user.testuser2) I guess you should send mail to testuser2, not user.testuser2? Simon failed: Mailbox does not exist Sep 15 15:05:18 localhost master[15929]: about to exec /usr/lib/cyrus-imapd/lmtpd Sep 15 15:05:18 localhost lmtpunix[15929]: executed Sep 15 15:05:18 localhost postfix/lmtp[15928]: 4B2E61ED5: to=testus...@domain.com, relay=localhost.localdomain[/var/lib/imap/socket/lmtp], delay=32, delays=32/0.01/0/0.02, dsn=5.1.1, status=bounced (host localhost.localdomain[/var/lib/imap/socket/lmtp] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) What did I do wrong? -- *** * John Oliver http://www.john-oliver.net/ * * * *** Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Problem creating / finding mailboxes
CentOS 6.5, cyrus-imapd 2.3.16-6 So, I gather you're supposed to create mailboxes called user.username But I wind up with user^username, and mailbox can't be found. [joliver@localhost ~]$ cyradm -u testuser1 localhost Password: localhost cm user.testuser2 localhost cm user.testuser3 localhost cm user.textuser4 [joliver@localhost ~]$ sudo ls -l /var/vmail/u/ total 12 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^testuser2 drwx--. 2 cyrus mail 4096 Sep 15 14:51 user^testuser3 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^textuser4 Sep 15 15:05:18 localhost lmtpunix[15704]: verify_user(user.testuser2) I guess you should send mail to testuser2, not user.testuser2? Sorry, I think that was wrong. However, you should check your unixhierarchysep, hashimapspool and fulldirhash settings. Regards, Simon Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Problem creating / finding mailboxes
On Tue, Sep 16, 2014 at 08:29:33AM -0700, John Oliver wrote: CentOS 6.5, cyrus-imapd 2.3.16-6 So, I gather you're supposed to create mailboxes called user.username But I wind up with user^username, and mailbox can't be found. [joliver@localhost ~]$ cyradm -u testuser1 localhost Password: localhost cm user.testuser2 localhost cm user.testuser3 localhost cm user.textuser4 [joliver@localhost ~]$ sudo ls -l /var/vmail/u/ total 12 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^testuser2 drwx--. 2 cyrus mail 4096 Sep 15 14:51 user^testuser3 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^textuser4 I guess you should send mail to testuser2, not user.testuser2? I am... -- *** * John Oliver http://www.john-oliver.net/ * * * *** Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
messages removed before expire
Each of our user's Trash folders have an expiration of 30 days set using cyr_adm. Recently, one of the mailboxes began losing messages before the 30 days. Viewing mboxconfig inside cyradm for the user's Trash folder clearly shows: expire 30. I tried removing the value and re-setting it to no avail. The mailbox now only holds 14 days worth of email. We don't use delayed expunge on the system. Is there any other setting I might be missing that could be causing the mail to be removed prematurely? Steve Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: old lock files listed at cyrus-imapd startup
It is safe to delete the entire lock file tree at startup. They are normally stored on tmpfs, so a system restart will remove them. Regards, Bron. On Tue, Sep 16, 2014, at 07:43 PM, Marcus Schopen wrote: Hi, I do see a lot of .lock file when starting cyrus: /run/cyrus/lock/t/user/test/Drafts.lock [...] This has already been reportet in the Ubuntu bug tracker #1010424 two years ago: https://bugs.launchpad.net/ubuntu/+source/cyrus-imapd-2.4/+bug/1010424 /etc/init.d/cyrus-imapd: # Clean stale entries find $LOCK_DIR -mindepth 1 -depth -size 0 # -delete find $PROC_DIR -mindepth 1 -depth -name '[0-9]*' # -delete Is it safe to use the -delete option and to remove old .lock files at startup? Or what are these old lockfiles for? Ciao Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: cyrus/chk_cyrus found messages and deleted messages differs on master and slave
If there was a large copy (or append) into the folder which was not finished, those files could be created. The email files are created first, then the index and cache are updated afterwards. If the server crashes, or Cyrus is shut down, then the command doesn't complete - but the program isn't there to clean up after itself. Regards, Bron. On Wed, Sep 17, 2014, at 01:29 AM, Marcus Schopen wrote: Hi, Am Montag, den 15.09.2014, 20:08 +0200 schrieb Marcus Schopen: Or another way: just delete user.userxyz.sent_mail subfolder using cyradm. The sent_mail folder will be moved into a subfolder under u/DELETED/user/userxyz/sent_mail/ and will only keep message 1., because all other emails are not know by the cyrus databases in user.userxyz.sent_mail. This would solve the chk_cyrus error messages. But what happens to hardlink 1807. then? Will cyrus keep these mails in Gesendete Elemente then? I renamed the sent_mail folder to sent_mail_test (using Thunderbird). This action removed all UIDs in the filesystem inside the sent_folder, which were not known by cyrus.* databases in the sent_mail folder. Afterwards I renamed the folder back to sent_mail. The only UID which wasn't deleted is UID 1., which is correct, because this UID was created inside the sent_mail after the users copy/movement/whatever session, first new email/UID. A following chk_cyrus didn't come up with errors. :) Checking files: # ls -li /var/spool/cyrus/mail/u/user/userxyz/sent_mail/1766. No such file or directory - good, deleted by my renaming #ls -li /var/spool/cyrus/mail/u/user/userxyz/Gesendete\ Elemente/1807. 10897103 -rw--- 3 cyrus mail 5520 Sep 9 23:08 /var/spool/cyrus/mail/u/user/userxyz/Gesendete Elemente/1807. - good, still there # ls -li /var/spool/cyrus/mail/u/DELETED/user/userxyz/sent_mail/54101FA9/1766. 10897103 -rw--- 3 cyrus mail 5520 Sep 9 23:08 /var/spool/cyrus/mail/u/DELETED/user/userxyz/sent_mail/54101FA9/1766. - good, will be hopefully deleted after 7 days be nightly expunge Question still is what caused this inconsistence between cyrus.* databases and fileystem, how can that happen? Cheers Marcus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: Problem creating / finding mailboxes
You'll be wanting to cm user/testuser2 (and so on), because with unixheirsep on, the dot gets replaced with DOTCHAR (^) and you actually created a top level folder called user.testuser2 rather than what you expected, a subfolder of user called testuser2. Regards, Bron. On Wed, Sep 17, 2014, at 01:29 AM, John Oliver wrote: CentOS 6.5, cyrus-imapd 2.3.16-6 So, I gather you're supposed to create mailboxes called user.username But I wind up with user^username, and mailbox can't be found. [joliver@localhost ~]$ cyradm -u testuser1 localhost Password: localhost cm user.testuser2 localhost cm user.testuser3 localhost cm user.textuser4 [joliver@localhost ~]$ sudo ls -l /var/vmail/u/ total 12 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^testuser2 drwx--. 2 cyrus mail 4096 Sep 15 14:51 user^testuser3 drwx--. 2 cyrus mail 4096 Sep 15 15:07 user^textuser4 Sep 15 15:05:18 localhost lmtpunix[15704]: verify_user(user.testuser2) failed: Mailbox does not exist Sep 15 15:05:18 localhost master[15929]: about to exec /usr/lib/cyrus-imapd/lmtpd Sep 15 15:05:18 localhost lmtpunix[15929]: executed Sep 15 15:05:18 localhost postfix/lmtp[15928]: 4B2E61ED5: to=testus...@domain.com, relay=localhost.localdomain[/var/lib/imap/socket/lmtp], delay=32, delays=32/0.01/0/0.02, dsn=5.1.1, status=bounced (host localhost.localdomain[/var/lib/imap/socket/lmtp] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) What did I do wrong? -- *** * John Oliver http://www.john-oliver.net/ * * * *** Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: messages removed before expire
Dumb question - but I don't suppose anything happened to your clock recently? More non-dumb question, what version of Cyrus? Bron. On Wed, Sep 17, 2014, at 05:18 AM, Stephen Ingram wrote: Each of our user's Trash folders have an expiration of 30 days set using cyr_adm. Recently, one of the mailboxes began losing messages before the 30 days. Viewing mboxconfig inside cyradm for the user's Trash folder clearly shows: expire 30. I tried removing the value and re-setting it to no avail. The mailbox now only holds 14 days worth of email. We don't use delayed expunge on the system. Is there any other setting I might be missing that could be causing the mail to be removed prematurely? Steve Cyrus Home Page: [1]http://www.cyrusimap.org/ List Archives/Info: [2]http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: [3]https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus -- Bron Gondwana br...@fastmail.fm References 1. http://www.cyrusimap.org/ 2. http://lists.andrew.cmu.edu/pipermail/info-cyrus/ 3. https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Cyrus 2.5 release plan
I've been very idle on Cyrus for a while, I'm sorry. There's always heaps going on at FastMail, and we have been focussing quite a lot on our own branch's calendar support recently. As always, you can see the code we are using, and grab whatever you want - it's all under the same licence as upstream Cyrus - right here: https://github.com/brong/cyrus-imapd/tree/fastmail But that's not the same as a real release! In October 2010, I visited Ken and Dave in Buffalo on my way through to somewhere else - and we released 2.4.0. In October 2014, I'm going to be in the area again. It seems fitting to do the same with 2.5.0 (though we might go to Pittsburgh for Dave this time. Guys, that means 2.6.0 will be in Melbourne in 2018, just so you can get planning). Release date is October 24th if all goes well. This gives us a little over month to get things ship-shape. Tidy up the loose ends. Make sure we've tested the things that people need tested. There's tons of stuff in bugzilla that needs to be sorted out, patches applied, etc. We'll be working to the 'master' branch at cmu at first, and then branching to cyrus-imapd-2.5 at some point. If you have a pet feature that MUST be in, or a pet bug that MUST be fixed - let us know now. Bonus points if you've already got a patch for it, or a test case :) We're setting a pretty aggressive timeline here, but that's good - because important but non-urgent stuff just doesn't get done. And it's only 2.5, not 3.0 - so we don't need to make ALL the giant changes that are in the pipeline (or even all the ones in the fastmail branch). Most of all I'd like to have everyone else using a supported, released version of some of the great speedup and stability improvements we've had at FM for the past few years already. Cheers, Bron. (not having to maintain my own 800+ patch series on top of master would be a bonus too) -- Bron Gondwana br...@fastmail.fm Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
Re: messages removed before expire
On Tue, Sep 16, 2014 at 3:02 PM, Bron Gondwana br...@fastmail.fm wrote: Dumb question - but I don't suppose anything happened to your clock recently? More non-dumb question, what version of Cyrus? Sorry, I should have included the version. I'm using 2.4.16 rpms from Invoca Systems. Nothing has happened with the clock. This is the only mailbox that seems to have the problem too, user.ken.Trash. We are running a murder configuration with 2 backends and 2 front ends. Not may users accounts, just large mailboxes. Maybe there is some setting on the mupdate master or somewhere else that is set for 14 days? Steve Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
