Curious behaviour after deleting a mailbox
Hi, I'm just examining a curious problem on an Open-Xchange ASE server. I have removed a user and so his mailbox, too. After that, all data has been gone, including the data directory. So far, so good... But the problem is: using 'lm' within cyradm still shows a rest of the mailbox: user/tanja.heinrich/Trash@... But trying to delete this ends up in a System I/O error because there ist no more user subdirectory in the spool. 'ctl_mboxlist' also shows this single entry. Neither a reconstruct or a database recovery did remove that stuff. Now my question: how can I remove this rest of that mailbox so I can create this user completely new? That curious mailbox rest prevents the correct new creation of a fully functional mailbox, I guess. Thanks in advance. Best regards Stefan -- STEFAN JURISCH | System Engineer | VMware(R), Software Development Support OpenPGP: ID: 0xC6F20B3E keyserver: pool.sks-keyservers.net SIEGNETZ.Informationstechnologie(R) GmbH Schneppenkauten 1a, DE-57076 Siegen, Phone +49 (271) 68193 -0, Facsimile -28 http://www.siegnetz.de | supp...@siegnetz.de | developm...@siegnetz.de Geschaeftsfuehrer (executive): Oliver Seitz Handelsregister (comm. register): Amtsgericht (local court) Siegen HRB4838 Sitz der Gesellschaft/domicile: Siegen, Germany pgpNeqIBriOsj.pgp Description: PGP signature Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Ever growing mailboxes and archiving
On 18/04/2011 19.41, Bron Gondwana wrote: You probably want to add yourself to the CC list on: http://bugzilla.cyrusimap.org/show_bug.cgi?id=3384 Where we're discussing precisely how to implement something like this. Well, Bron, you ended the discussion pretty fast with an elegant solution. :-) +1 I vote for the feature etc etc Add myself to CC on 3384. Paolo Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Ever growing mailboxes and archiving
On 18/04/2011 17.19, Vincent Fox wrote: What web-based client? Why would you expect it to die? It is Open Xchange. Some users do not organize messages in folders, just leave everything in the INBOX. So, depending on the (web)client implementation, such a huge number of items can be a performance hog. For example OX has a cache of some thousand message headers to make scrolling smooth. If items in the folder are more than the cache can hold, an IMAP LIST is issued at every scrollbar movement... I have seen Thunderbird choke on a Premier Gmail account with some thousands of messages in one folder/label. But that might have well been cause by a slow server response. As to SAN, this maybe related. We have found netbackup on large Cyrus mail-store volumes are a Curiously I read your reply after greeting Symantec's sales team that paid us a visit! So I am now studying netbackup7 on my own. Thank you for the insight in the problems you're running. I will talk with the storage guys here so check how our product is expected to cope with many small files (well, it is already doing it with the existing email infrastructure anyway). Paolo Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Can't see messages, reconstruct doesn't work
I have a problem in which there are messages in my main INBOX directory, but they aren't seen in my IMAP client. Unfortunately, when I tell it to reconstruct through cyradm, I see a pair of .NEW files created, but they're empty and the reconstruct returns? This is with 2.4.7. Eric Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Can't see messages, reconstruct doesn't work
On 04/19/2011 06:34 AM, Eric Knudstrup wrote: I have a problem in which there are messages in my main INBOX directory, but they aren't seen in my IMAP client. Unfortunately, when I tell it to reconstruct through cyradm, I see a pair of .NEW files created, but they're empty and the reconstruct returns? This is with 2.4.7. Are the .NEW files still there after reconstruct ends? If so it sounds like reconstruct is crashing. Anything in your logs files? Eric Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Can't see messages, reconstruct doesn't work
On 04/19/2011 02:43 AM, Patrick Boutilier wrote: On 04/19/2011 06:34 AM, Eric Knudstrup wrote: I have a problem in which there are messages in my main INBOX directory, but they aren't seen in my IMAP client. Unfortunately, when I tell it to reconstruct through cyradm, I see a pair of .NEW files created, but they're empty and the reconstruct returns? This is with 2.4.7. Are the .NEW files still there after reconstruct ends? If so it sounds like reconstruct is crashing. Anything in your logs files? Nothing. I just tried deleting the cyrus.* files and that works. I was replicating this installation to another (new) 2.4.7 installation, starting about a week ago. All of the messages a few days after that weren't indexed in the INBOXen. Fortunately it's a small installation. If I nuke everyone's index files and reconstruct, then add them to the replication log, will that cause problems? I was just switching to the new installation. Will the new server get confused if I let people use it will it is being synced to? I have probably six, maybe 12 hours before people will complain. Eric Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Ever growing mailboxes and archiving
On Tue, Apr 19, 2011 at 11:03:09AM +0200, Paolo Cravero wrote: On 18/04/2011 19.41, Bron Gondwana wrote: You probably want to add yourself to the CC list on: http://bugzilla.cyrusimap.org/show_bug.cgi?id=3384 Where we're discussing precisely how to implement something like this. Well, Bron, you ended the discussion pretty fast with an elegant solution. :-) +1 I vote for the feature etc etc Add myself to CC on 3384. Paolo Excellent. I might be a little while before I can implement it, but it's on our roadmap for FastMail's service as well if we find we need to do a more multi-tiered storage architecture to offer large quotas. Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Curious behaviour after deleting a mailbox
On 19/04/11 10:57 +0200, Stefan Jurisch wrote: Hi, I'm just examining a curious problem on an Open-Xchange ASE server. I have removed a user and so his mailbox, too. After that, all data has been gone, including the data directory. So far, so good... But the problem is: using 'lm' within cyradm still shows a rest of the mailbox: user/tanja.heinrich/Trash@... But trying to delete this ends up in a System I/O error because there ist no more user subdirectory in the spool. 'ctl_mboxlist' also shows this single entry. Neither a reconstruct or a database recovery did remove that stuff. Now my question: how can I remove this rest of that mailbox so I can create this user completely new? That curious mailbox rest prevents the correct new creation of a fully functional mailbox, I guess. If you're using at least version 2.3.7, you can use cyr_dbtool to remove the mailbox directly from the mailboxes database. As the cyrus user: cyrus@mail:/var/spool/imap$ file /var/lib/imap/mailboxes.db /var/lib/imap/mailboxes.db: Cyrus skiplist DB cyrus@mail:/var/spool/imap$ cyr_dbtool /var/lib/imap/mailboxes.db skiplist show user.test1234 user.test1234 (uniqueid 6ebe0fe04dad935f) 0 default test1234 lrswipkxtecda user.test1234.trash (uniqueid 638c3a464dad9368) 0 default test1234 lrswipkxtecda cyrus@mail:/var/spool/imap$ cyr_dbtool /var/lib/imap/mailboxes.db skiplist get 'user.test1234.trash' (uniqueid 638c3a464dad9368) 0 default test1234 lrswipkxtecda cyrus@mail:/var/spool/imap$ cyr_dbtool /var/lib/imap/mailboxes.db skiplist delete 'user.test1234.trash' cyrus@mail:/var/spool/imap$ cyr_dbtool /var/lib/imap/mailboxes.db skiplist get 'user.test1234.trash' cyrus@mail:/var/spool/imap$ Another option was discussed on the list recently, which is to convert the mailboxes database to flat text, edit the database, and reimport it. You might also be able to create the directory structure for the mailbox, perform a reconstruct/cyrreconstruct, then delete the mailbox cyradm (and then clean up the filesystem). -- Dan White Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Can't see messages, reconstruct doesn't work
Eric, On 19/04/11 11:01, Eric Knudstrup wrote: On 04/19/2011 02:43 AM, Patrick Boutilier wrote: On 04/19/2011 06:34 AM, Eric Knudstrup wrote: I have a problem in which there are messages in my main INBOX directory, but they aren't seen in my IMAP client. Unfortunately, when I tell it to reconstruct through cyradm, I see a pair of .NEW files created, but they're empty and the reconstruct returns? This is with 2.4.7. Are the .NEW files still there after reconstruct ends? If so it sounds like reconstruct is crashing. Anything in your logs files? Nothing. I just tried deleting the cyrus.* files and that works. I was replicating this installation to another (new) 2.4.7 installation, starting about a week ago. Are the messages marked as deleted? Try checking with unexpunge -l mailbox - if you deleted cyrus.expunge and reconstructed, the messages would reappear in the mailbox. Regards, Dave. David Mayo Networks/Systems Administrator University of Bath Computing Services, UK Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
Re: Can't see messages, reconstruct doesn't work
On Tue, Apr 19, 2011 at 04:49:21PM +0100, David Mayo wrote: Nothing. I just tried deleting the cyrus.* files and that works. I was replicating this installation to another (new) 2.4.7 installation, starting about a week ago. Are the messages marked as deleted? Try checking with unexpunge -l mailbox - if you deleted cyrus.expunge and reconstructed, the messages would reappear in the mailbox. cyrus.expunge doesn't exist in 2.4.x. Bron. Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
