Re: Email not appearing in list, but files exist on disk

2012-08-30 Thread Patrick Boutilier 

On 08/30/2012 10:00 PM, francis picabia wrote:

On Thu, Aug 30, 2012 at 5:45 PM, Michael Menge
 wrote:

Hi,

IMHO the mails have been marked as deleted, but not expunged by the
webmailer. Most clients will not show these mails by default and some
(e.g. Horde/IMP) count unread mails which are marked as deleted in the
summary view.

By exiting with Thunderbird these messages got expunged.

Regards

Michael Menge


Thanks for the response.  I recovered missing files from tape backup,
did a reconstruct again and now the messages are all there.

Very strange because usually Horde displays messages ready
for expunge with a line strike out, and I had tested the view
from both dimp and imp before doing any reconstruct.



Perhaps "Hide Deleted" was selected in dimp/imp ?










Hopefully that is the last of the gremlin.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus



<>
Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Email not appearing in list, but files exist on disk

2012-08-30 Thread francis picabia 
On Thu, Aug 30, 2012 at 5:45 PM, Michael Menge
 wrote:
> Hi,
>
> IMHO the mails have been marked as deleted, but not expunged by the
> webmailer. Most clients will not show these mails by default and some
> (e.g. Horde/IMP) count unread mails which are marked as deleted in the
> summary view.
>
> By exiting with Thunderbird these messages got expunged.
>
> Regards
>
>Michael Menge

Thanks for the response.  I recovered missing files from tape backup,
did a reconstruct again and now the messages are all there.

Very strange because usually Horde displays messages ready
for expunge with a line strike out, and I had tested the view
from both dimp and imp before doing any reconstruct.

Hopefully that is the last of the gremlin.

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Email not appearing in list, but files exist on disk

2012-08-30 Thread Michael Menge 

Hi,

IMHO the mails have been marked as deleted, but not expunged by the
webmailer. Most clients will not show these mails by default and some
(e.g. Horde/IMP) count unread mails which are marked as deleted in the
summary view.

By exiting with Thunderbird these messages got expunged.

Regards

   Michael Menge

Quoting francis picabia :


We've been running Cyrus imapd for many years and it is normally robust.

It is now on Redhat 5.8, using local storage.

A support call reported that in the webmail summary view, there
were over 130 unread messages, and yet the message list
could show only 8.  The messages showing are the most
recent received since Aug 28.  I checked the disk files and
there were about 130+ files in the top level
of this mailbox.

I su'ed to cyrus and did :

/usr/lib/cyrus-imapd/reconstruct -r -f user.USERNAME

where USERNAME is the account name.

I checked again in webmail (had logged out, back in) and
no difference, still only the same 8 emails showing.

I thought I should try another email client in case the webmail
client had problems digesting something.

I set up my Linux Thunderbird to connect to this account over IMAP.
It showed only 8 emails as well.

I looked again at the files on disk, and now it jived - only 8 messages
on disk.  At first I thought reconstruct had messed it up, but
I can see the IMAP connection from Thunderbird also had
a role.

Looking in the imap logs, I found:

Aug 30 14:47:20 myserver imap[30180]: Expunged 124 messages from  
user.USERNAME


The 30180 thread corresponds to my Thunderbird client.  It must have
done an expunge on connect and somehow these messages
were thought to be marked for deletion by cyrus.

I am currently recovering the lost email files from backup tape, and I'll
do some additional attempts to reconstruct with a copy of those
files.  Are there any suggestions on how I go about a recovery of
this mailbox so it is true again?

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus








M.MengeTel.: (49) 7071/29-70316
Universität Tübingen   Fax.: (49) 7071/29-5912
Zentrum für Datenverarbeitung  mail:  
michael.me...@zdv.uni-tuebingen.de

Wächterstraße 76
72074 Tübingen

smime.p7s
Description: S/MIME Signatur

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Email not appearing in list, but files exist on disk

2012-08-30 Thread francis picabia 
We've been running Cyrus imapd for many years and it is normally robust.

It is now on Redhat 5.8, using local storage.

A support call reported that in the webmail summary view, there
were over 130 unread messages, and yet the message list
could show only 8.  The messages showing are the most
recent received since Aug 28.  I checked the disk files and
there were about 130+ files in the top level
of this mailbox.

I su'ed to cyrus and did :

/usr/lib/cyrus-imapd/reconstruct -r -f user.USERNAME

where USERNAME is the account name.

I checked again in webmail (had logged out, back in) and
no difference, still only the same 8 emails showing.

I thought I should try another email client in case the webmail
client had problems digesting something.

I set up my Linux Thunderbird to connect to this account over IMAP.
It showed only 8 emails as well.

I looked again at the files on disk, and now it jived - only 8 messages
on disk.  At first I thought reconstruct had messed it up, but
I can see the IMAP connection from Thunderbird also had
a role.

Looking in the imap logs, I found:

Aug 30 14:47:20 myserver imap[30180]: Expunged 124 messages from user.USERNAME

The 30180 thread corresponds to my Thunderbird client.  It must have
done an expunge on connect and somehow these messages
were thought to be marked for deletion by cyrus.

I am currently recovering the lost email files from backup tape, and I'll
do some additional attempts to reconstruct with a copy of those
files.  Are there any suggestions on how I go about a recovery of
this mailbox so it is true again?

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Replication and INBOX rename in 2.4.12

2012-08-30 Thread Janne Peltonen 
Um, sorry, folks, I hit "send" before I had a look at the "To" header. This
should have gone to our local list only.


--Janne / Univ. of Helsinki

On Thu, Aug 30, 2012 at 04:34:13PM +0300, Janne Peltonen wrote:
> Tämä siis tiedoksi teillekin. Toki INBOX renamesta seuraavat jumitukset saa
> jatkossakin korjatuksi, seuraavaan USER-operaatioon asti... :(
> 
> 
> --Janne
> 
> On Thu, Aug 30, 2012 at 04:33:18PM +0300, Janne Peltonen wrote:
> > On Wed, Jan 18, 2012 at 01:25:08PM +0200, Janne Peltonen wrote:
> > > On Wed, Jan 18, 2012 at 12:19:57PM +0200, Janne Peltonen wrote:
> > > > What to do, how to circumvent this problem in the current version? I'd 
> > > > really
> > > > like to be able to be able to start replicating a user's mailbox and 
> > > > metadata
> > > > again, even if they have renamed their INBOX sometime in the past.
> > > Well, what do you know. Once I'd sent this mail, I decided to give the old
> > > circumvention method one more try, and lo and behold, it worked. I 
> > > must've done
> > > something wrong the last three times I tried.
> > > So, not as acute as it appeared, just an inconvenience. Sorry.
> > 
> > Um. Apparently, not, after all. It seems that the sync_client -u works /the
> > first time/ after I've removed the user from the replica's mailboxes.db. 
> > But on
> > the second and all later runs I get 1 as a return value fron sync_client and
> > have the same problem as before the removal:
> > 
> > --clip--
> > Aug 30 14:33:43 pcn1 i14/sync_client[10504]: RENAME received NO response: 
> > Operation is not supported on mailbox
> > Aug 30 14:33:43 pcn1 i14/sync_client[10504]: do_folders(): failed to 
> > rename: user. -> user..Saapuneet 
> > Aug 30 14:33:43 pcn1 i14/sync_client[10504]: IOERROR: The remote Server(s) 
> > denied the operation
> > --clip--
> > 
> > So why did I think I didn't have a problem? Apparently, since there probably
> > aren't that many USER operations on a mailbox in a row during normal 
> > operation,
> > I was content after that first USER operation.
> > 
> > ***
> > 
> > Just upgraded my test boxen to Cyrus 2.4.16. The problem still persists. On 
> > my
> > way to file a bug...
> > 
> > Bug number 3734.
> > 
> > ***
> > 
> > I am aware that there was another INBOX renaming related bug in 2.4.12,
> > reported by David Carter, that has been fixed in 2.4.13 (bug #3634). I never
> > saw that bug in my setup; this is something different.
> > 
> > 
> > Yours,
> > -- 
> > Janne Peltonen  PGP Key ID: 0x9CFAC88B
> 
> -- 
> Janne Peltonen  PGP Key ID: 0x9CFAC88B
> Helsingin yliopisto / Tietotekniikkakeskus
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

-- 
Janne Peltonen  PGP Key ID: 0x9CFAC88B
Please consider membership of the Hospitality Club 
(http://www.hospitalityclub.org)

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Replication and INBOX rename in 2.4.12

2012-08-30 Thread Janne Peltonen 
Tämä siis tiedoksi teillekin. Toki INBOX renamesta seuraavat jumitukset saa
jatkossakin korjatuksi, seuraavaan USER-operaatioon asti... :(


--Janne

On Thu, Aug 30, 2012 at 04:33:18PM +0300, Janne Peltonen wrote:
> On Wed, Jan 18, 2012 at 01:25:08PM +0200, Janne Peltonen wrote:
> > On Wed, Jan 18, 2012 at 12:19:57PM +0200, Janne Peltonen wrote:
> > > What to do, how to circumvent this problem in the current version? I'd 
> > > really
> > > like to be able to be able to start replicating a user's mailbox and 
> > > metadata
> > > again, even if they have renamed their INBOX sometime in the past.
> > Well, what do you know. Once I'd sent this mail, I decided to give the old
> > circumvention method one more try, and lo and behold, it worked. I must've 
> > done
> > something wrong the last three times I tried.
> > So, not as acute as it appeared, just an inconvenience. Sorry.
> 
> Um. Apparently, not, after all. It seems that the sync_client -u works /the
> first time/ after I've removed the user from the replica's mailboxes.db. But 
> on
> the second and all later runs I get 1 as a return value fron sync_client and
> have the same problem as before the removal:
> 
> --clip--
> Aug 30 14:33:43 pcn1 i14/sync_client[10504]: RENAME received NO response: 
> Operation is not supported on mailbox
> Aug 30 14:33:43 pcn1 i14/sync_client[10504]: do_folders(): failed to rename: 
> user. -> user..Saapuneet 
> Aug 30 14:33:43 pcn1 i14/sync_client[10504]: IOERROR: The remote Server(s) 
> denied the operation
> --clip--
> 
> So why did I think I didn't have a problem? Apparently, since there probably
> aren't that many USER operations on a mailbox in a row during normal 
> operation,
> I was content after that first USER operation.
> 
> ***
> 
> Just upgraded my test boxen to Cyrus 2.4.16. The problem still persists. On my
> way to file a bug...
> 
> Bug number 3734.
> 
> ***
> 
> I am aware that there was another INBOX renaming related bug in 2.4.12,
> reported by David Carter, that has been fixed in 2.4.13 (bug #3634). I never
> saw that bug in my setup; this is something different.
> 
> 
> Yours,
> -- 
> Janne Peltonen  PGP Key ID: 0x9CFAC88B

-- 
Janne Peltonen  PGP Key ID: 0x9CFAC88B
Helsingin yliopisto / Tietotekniikkakeskus

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Replication and INBOX rename in 2.4.12

2012-08-30 Thread Janne Peltonen 
On Wed, Jan 18, 2012 at 01:25:08PM +0200, Janne Peltonen wrote:
> On Wed, Jan 18, 2012 at 12:19:57PM +0200, Janne Peltonen wrote:
> > What to do, how to circumvent this problem in the current version? I'd 
> > really
> > like to be able to be able to start replicating a user's mailbox and 
> > metadata
> > again, even if they have renamed their INBOX sometime in the past.
> Well, what do you know. Once I'd sent this mail, I decided to give the old
> circumvention method one more try, and lo and behold, it worked. I must've 
> done
> something wrong the last three times I tried.
> So, not as acute as it appeared, just an inconvenience. Sorry.

Um. Apparently, not, after all. It seems that the sync_client -u works /the
first time/ after I've removed the user from the replica's mailboxes.db. But on
the second and all later runs I get 1 as a return value fron sync_client and
have the same problem as before the removal:

--clip--
Aug 30 14:33:43 pcn1 i14/sync_client[10504]: RENAME received NO response: 
Operation is not supported on mailbox
Aug 30 14:33:43 pcn1 i14/sync_client[10504]: do_folders(): failed to rename: 
user. -> user..Saapuneet 
Aug 30 14:33:43 pcn1 i14/sync_client[10504]: IOERROR: The remote Server(s) 
denied the operation
--clip--

So why did I think I didn't have a problem? Apparently, since there probably
aren't that many USER operations on a mailbox in a row during normal operation,
I was content after that first USER operation.

***

Just upgraded my test boxen to Cyrus 2.4.16. The problem still persists. On my
way to file a bug...

Bug number 3734.

***

I am aware that there was another INBOX renaming related bug in 2.4.12,
reported by David Carter, that has been fixed in 2.4.13 (bug #3634). I never
saw that bug in my setup; this is something different.


Yours,
-- 
Janne Peltonen  PGP Key ID: 0x9CFAC88B

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: auxprop ldapdb

2012-08-30 Thread Adam Tauno Williams 
On Tue, 2012-08-28 at 12:46 +0200, zorg wrote:
> the documentation is not very clear to me
> If I want to use auxprop with ldapdb
> Do i have to store my user password in clear in ldap or is the another 
> solution

Technically, no.  Generally, yes.

I have some information & examples concerning ldapdb @
 [starting around slide 13].

People get uneasy about storing clear-text in the DSA but it doesn't
bother me.  You are either storing it in the DSA or  sending it over
the wire!  Which is worse?  And if someone breaches the security of your
DSA / DC then you are humped anyway.

> For the moment I m using saslauthd.conf but I wonder if I can use 
> auxprop to be more secure

Yes, then you can use much more secure authentication mechanisms such as
digest.  Clear text auth with encrypted stored passwords is like buying
a handgun to protect your home but always leaving the doors and windows
wide open.


signature.asc
Description: This is a digitally signed message part

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus