Re: Mail Spool Problems / IMAP

2008-04-08 Thread Jerry McAllister
On Mon, Apr 07, 2008 at 05:49:16PM -0700, Chris Maness wrote:

 
 
 
 Hi, Chris--
 
 On Apr 7, 2008, at 8:52 AM, Chris Maness wrote:
 I am having trouble with my imap account on my FreeBSD box.  I am using 
 WU-IMAP, and thuderbird.  I have been using this combo for years, and not 
 had any issues.  Now, my thuderbird is not displaying messages in the 
 inbox.  I can see them with pine, but not with IMAP clients. 
 (squirrelmail, thunderbird).  Pine complains about sequence error when I 
 send a message. I was able to get it to work for a bit by deleteing the 
 mbox file in my home directory, but now it is not working again.  IS 
 there a database or something somewhere that needs to be rebult?
 
 Can you double-check your mbox file?
 
 With the most recent 2007 version of UW-IMAP, I've seen intermittent 
 corruption of the first line of a mbox file (ie, the From foo header) 
 which causes the mbox to be unreadable by most clients until it is fixed 
 by hand. It seems to be correlated with simultaneous write access by 
 people who have a normal MUA and a second device like a smartphone 
 (iPhone/Treo/BB).
 
 I've seen just over a half-dozen of these since Jan...
 
 -- 
 -Vhuvk
 
 Thanks,
 
 How do I check it?  Should I use another IMAP server?

The best way is to look at the file with an editor such as vi.

jerry

 
 Chris Maness
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to [EMAIL PROTECTED]
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chris Maness


On Tue, 8 Apr 2008, Jerry McAllister wrote:


On Mon, Apr 07, 2008 at 05:49:16PM -0700, Chris Maness wrote:






Hi, Chris--

On Apr 7, 2008, at 8:52 AM, Chris Maness wrote:

I am having trouble with my imap account on my FreeBSD box.  I am using
WU-IMAP, and thuderbird.  I have been using this combo for years, and not
had any issues.  Now, my thuderbird is not displaying messages in the
inbox.  I can see them with pine, but not with IMAP clients.
(squirrelmail, thunderbird).  Pine complains about sequence error when I
send a message. I was able to get it to work for a bit by deleteing the
mbox file in my home directory, but now it is not working again.  IS
there a database or something somewhere that needs to be rebult?


Can you double-check your mbox file?

With the most recent 2007 version of UW-IMAP, I've seen intermittent
corruption of the first line of a mbox file (ie, the From foo header)
which causes the mbox to be unreadable by most clients until it is fixed
by hand. It seems to be correlated with simultaneous write access by
people who have a normal MUA and a second device like a smartphone
(iPhone/Treo/BB).

I've seen just over a half-dozen of these since Jan...

--
-Vhuvk


Thanks,

How do I check it?  Should I use another IMAP server?


The best way is to look at the file with an editor such as vi.

jerry





How is this header look?  I am not quite sure of what I am looking for.


From MAILER-DAEMON Tue Apr  8 10:49:02 2008

Date: 08 Apr 2008 10:49:02 -0700
From: Mail System Internal Data [EMAIL PROTECTED]
Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
Message-ID: [EMAIL PROTECTED]
X-IMAP: 1207676934 4064487180 NonJunk $Forwarded Junk
Status: RO

This text is part of the internal format of your mail folder, and is not
a real message.  It is created automatically by the mail system software.
If deleted, important folder data will be lost, and it will be re-created
with the data reset to initial values.


From [EMAIL PROTECTED] Sat Apr  5 12:04:18 2008

Return-Path: [EMAIL PROTECTED]
Received: from atlanta.eham.net (atlanta.eham.net [69.36.242.135])
by ns1.kq6up.org (8.14.2/8.14.2) with ESMTP id m35J41m2056801
for [EMAIL PROTECTED]; Sat, 5 Apr 2008 12:04:18 -0700 (PDT)
(envelope-from [EMAIL PROTECTED])
Received: by atlanta.eham.net (Postfix, from userid 502)
id 1870EEF401D; Sat,  5 Apr 2008 12:03:59 -0700 (PDT)
To: [EMAIL PROTECTED]
Subject: [TowerTalk] Antennas and Photons?

Chris Maness
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chuck Swiger

On Apr 8, 2008, at 10:50 AM, Chris Maness wrote:
How is this header look?  I am not quite sure of what I am looking  
for.


That seems to be fine.  If it was corrupted, you'd see a line or a few  
lines of obvious binary garbage...


--
-Chuck

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chris Maness



On Tue, 8 Apr 2008, Chuck Swiger wrote:


On Apr 8, 2008, at 11:42 AM, Chris Maness wrote:
It does seem like something something is corrupt.  What can I do to reset 
everything and restore everything so that thunderbird can read my inbox 
again.  I have contempalted deleting the user, but I'm not sure if that 
will delete what ever is corrupted.


Try to delete the account in T'bird, quit, and then re-add the account.  Also 
check /var/log/maillog...imapd should be reporting errors if it sees anything 
wrong...


--
-Chuck



I tried doing that, but I still have the same errors.  Also, squirrelmail 
will list the e-mail, but when I click on the e-mail, I get the message:


ERROR:
The server couldn't find the message you requested.

Most probably your message list was out of date and the message has been 
moved away or deleted (perhaps by another program accessing the same 
mailbox).

Click here to return to INBOX

Also, I see no messages from imapd in the message log.  The grep command 
pulls nothing.


THanks,
Chris
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chuck Swiger

On Apr 8, 2008, at 11:42 AM, Chris Maness wrote:
It does seem like something something is corrupt.  What can I do to  
reset everything and restore everything so that thunderbird can read  
my inbox again.  I have contempalted deleting the user, but I'm not  
sure if that will delete what ever is corrupted.


Try to delete the account in T'bird, quit, and then re-add the  
account.  Also check /var/log/maillog...imapd should be reporting  
errors if it sees anything wrong...


--
-Chuck

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chris Maness


On Tue, 8 Apr 2008, Chuck Swiger wrote:


On Apr 8, 2008, at 10:50 AM, Chris Maness wrote:

How is this header look?  I am not quite sure of what I am looking for.


That seems to be fine.  If it was corrupted, you'd see a line or a few lines 
of obvious binary garbage...


--
-Chuck



It does seem like something something is corrupt.  What can I do to reset 
everything and restore everything so that thunderbird can read my inbox 
again.  I have contempalted deleting the user, but I'm not sure if that 
will delete what ever is corrupted.


Thanks,
Chirs Maness
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Mel
On Tuesday 08 April 2008 21:32:45 Jerry McAllister wrote:
 On Tue, Apr 08, 2008 at 11:42:41AM -0700, Chris Maness wrote:
  On Tue, 8 Apr 2008, Chuck Swiger wrote:
  On Apr 8, 2008, at 10:50 AM, Chris Maness wrote:
  How is this header look?  I am not quite sure of what I am looking for.
  
  That seems to be fine.  If it was corrupted, you'd see a line or a few
  lines of obvious binary garbage...
  
  --
  -Chuck
 
  It does seem like something something is corrupt.  What can I do to reset
  everything and restore everything so that thunderbird can read my inbox
  again.  I have contempalted deleting the user, but I'm not sure if that
  will delete what ever is corrupted.

 Very often it is only one character out of place.   Each header should
 start with  'From' in the beginning of a line

Since you mention one character, it should actually be starting with 'From ' 
and any line that starts with 'From ' that is not the start of a mail should 
be changed to 'From ' before ending up in the mbox file.

This test weeds it out, allthough there's still room for false positives, 
easily resolved by the human brain:
grep '^From ' /var/mail/myloginname |grep -v '200[78]$'
-- 
Mel

Problem with today's modular software: they start with the modules
and never get to the software part.
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Chris Maness



On Tuesday 08 April 2008 21:32:45 Jerry McAllister wrote:

On Tue, Apr 08, 2008 at 11:42:41AM -0700, Chris Maness wrote:

On Tue, 8 Apr 2008, Chuck Swiger wrote:

On Apr 8, 2008, at 10:50 AM, Chris Maness wrote:

How is this header look?  I am not quite sure of what I am looking for.


That seems to be fine.  If it was corrupted, you'd see a line or a few
lines of obvious binary garbage...

--
-Chuck


It does seem like something something is corrupt.  What can I do to reset
everything and restore everything so that thunderbird can read my inbox
again.  I have contempalted deleting the user, but I'm not sure if that
will delete what ever is corrupted.


Very often it is only one character out of place.   Each header should
start with  'From' in the beginning of a line


Since you mention one character, it should actually be starting with 'From '
and any line that starts with 'From ' that is not the start of a mail should
be changed to 'From ' before ending up in the mbox file.

This test weeds it out, allthough there's still room for false positives,
easily resolved by the human brain:
grep '^From ' /var/mail/myloginname |grep -v '200[78]$'
--
Mel

Problem with today's modular software: they start with the modules
   and never get to the software part.



Actually, the mail that is in /var/mail/chris gets moved to 
/home/chris/mbox


Before it gets moved, it does not have this placeholder header.  It only 
has the headers of e-mail sent since the last time mail was checked and 
moved to the mbox file.


Also, none of headers in the mbox have the chicken lips  not even the 
first one that I posted.


Wouldn't these issues be rectified if I deleted the mbox file and started 
from scratch?

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-08 Thread Jerry McAllister
On Tue, Apr 08, 2008 at 11:42:41AM -0700, Chris Maness wrote:

 
 On Tue, 8 Apr 2008, Chuck Swiger wrote:
 
 On Apr 8, 2008, at 10:50 AM, Chris Maness wrote:
 How is this header look?  I am not quite sure of what I am looking for.
 
 That seems to be fine.  If it was corrupted, you'd see a line or a few 
 lines of obvious binary garbage...
 
 -- 
 -Chuck
 
 
 It does seem like something something is corrupt.  What can I do to reset 
 everything and restore everything so that thunderbird can read my inbox 
 again.  I have contempalted deleting the user, but I'm not sure if that 
 will delete what ever is corrupted.

Very often it is only one character out of place.   Each header should 
start with  'From' in the beginning of a line - eg as the first 
character of the file or the first character after a newline-whitespace
combination.

It looks like you have some Greater-Thans ('')  stuck in there.
Try taking those away from in front of the initial From.

jerry

From MAILER-DAEMON Tue Apr  8 10:49:02 2008
Date: 08 Apr 2008 10:49:02 -0700
From: Mail System Internal Data [EMAIL PROTECTED]
Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
Message-ID: [EMAIL PROTECTED]
X-IMAP: 1207676934 4064487180 NonJunk $Forwarded Junk
Status: RO

This text is part of the internal format of your mail folder, and is not 
a real message.  It is created automatically by the mail system software.
If deleted, important folder data will be lost, and it will be re-created   
with the data reset to initial values.

From [EMAIL PROTECTED] Sat Apr  5 12:04:18 2008
Return-Path: [EMAIL PROTECTED]
Received: from atlanta.eham.net (atlanta.eham.net [69.36.242.135])
by ns1.kq6up.org (8.14.2/8.14.2) with ESMTP id m35J41m2056801
for [EMAIL PROTECTED]; Sat, 5 Apr 2008 12:04:18 -0700 (PDT)
(envelope-from [EMAIL PROTECTED])
etc, etc

 
 Thanks,
 Chirs Maness
 ___
 freebsd-questions@freebsd.org mailing list
 http://lists.freebsd.org/mailman/listinfo/freebsd-questions
 To unsubscribe, send any mail to [EMAIL PROTECTED]
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-07 Thread Chuck Swiger

Hi, Chris--

On Apr 7, 2008, at 8:52 AM, Chris Maness wrote:
I am having trouble with my imap account on my FreeBSD box.  I am  
using WU-IMAP, and thuderbird.  I have been using this combo for  
years, and not had any issues.  Now, my thuderbird is not displaying  
messages in the inbox.  I can see them with pine, but not with IMAP  
clients. (squirrelmail, thunderbird).  Pine complains about sequence  
error when I send a message.  I was able to get it to work for a bit  
by deleteing the mbox file in my home directory, but now it is not  
working again.  IS there a database or something somewhere that  
needs to be rebult?


Can you double-check your mbox file?

With the most recent 2007 version of UW-IMAP, I've seen intermittent  
corruption of the first line of a mbox file (ie, the From foo  
header) which causes the mbox to be unreadable by most clients until  
it is fixed by hand.  It seems to be correlated with simultaneous  
write access by people who have a normal MUA and a second device like  
a smartphone (iPhone/Treo/BB).


I've seen just over a half-dozen of these since Jan...

--
-Vhuvk

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-07 Thread Chris Maness





Hi, Chris--

On Apr 7, 2008, at 8:52 AM, Chris Maness wrote:
I am having trouble with my imap account on my FreeBSD box.  I am using 
WU-IMAP, and thuderbird.  I have been using this combo for years, and not 
had any issues.  Now, my thuderbird is not displaying messages in the 
inbox.  I can see them with pine, but not with IMAP clients. (squirrelmail, 
thunderbird).  Pine complains about sequence error when I send a message. 
I was able to get it to work for a bit by deleteing the mbox file in my 
home directory, but now it is not working again.  IS there a database or 
something somewhere that needs to be rebult?


Can you double-check your mbox file?

With the most recent 2007 version of UW-IMAP, I've seen intermittent 
corruption of the first line of a mbox file (ie, the From foo header) which 
causes the mbox to be unreadable by most clients until it is fixed by hand. 
It seems to be correlated with simultaneous write access by people who have a 
normal MUA and a second device like a smartphone (iPhone/Treo/BB).


I've seen just over a half-dozen of these since Jan...

--
-Vhuvk


Thanks,

How do I check it?  Should I use another IMAP server?

Chris Maness
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-07 Thread Chuck Swiger

On Apr 7, 2008, at 5:49 PM, Chris Maness wrote:

How do I check it?  Should I use another IMAP server?


Look at the first few lines; you should see either a placeholder  
message like:



From MAILER-DAEMON Mon Apr  7 13:08:13 2008
Date: 07 Apr 2008 13:08:13 -0400
From: Mail System Internal Data [EMAIL PROTECTED]
Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
Message-ID: [EMAIL PROTECTED]
X-IMAP: 1143826475 000664 NonJunk $NotJunk JunkRecorded $Junk Junk
Status: RO

This text is part of the internal format of your mail folder, and is  
not
a real message.  It is created automatically by the mail system  
software.
If deleted, important folder data will be lost, and it will be re- 
created

with the data reset to initial values.



...or a normal message with an X-IMAPbase: header, depending on which  
version of UW IMAP you created the mailbox under.  If you see binary  
gunk (see forwarded message below), you're running into the same issue  
I've seen.


Regards,
--
-Chuck

PS: Since the mail below was written, I have seen this corruption  
happen with Outlook and Mozilla Tbird, not just with Apple Mail.


Begin forwarded message:

From: Chuck Swiger [EMAIL PROTECTED]
Date: January 24, 2008 11:05:50 AM PST
To: [EMAIL PROTECTED]
Subject: [Imap-uw] imap-2007 on Solaris 8, possible mbox data  
corruption?


Hi, all--

I've been a happy user of UW imapd for many years, but recently a  
number of my users have started really doing a lot of mail access in  
parallel from a workstation and something like an iPhone.  I'd been  
receiving more frequent reports of imapd locking problems with  
imapd-2006h (ie, which would be resolved by them quitting and  
restarting their MUA or smart phone), and have updated the imapd to  
imap-2007 based on the comments in the release notes about the  
locking issues which hopefully were resolved with 2006k.


The users have initially reported that their locking problems were  
much improved after the update, however, the build of imap-2007 is  
now showing signs of a mbox corruption issue which has affected  
several users.  Specifically, the first line or perhaps first few  
lines of their mbox (either /var/mail/$USER, or ~$USER/mail/mbox)  
which is normally the SMTP envelope From header, is being corrupted.


Two examples (with apologies for the length):

# head -2 mbox_200801114
@???h?f??x?#~??$??
 I??U?#LiLQ?
?{?v?۟c??[EMAIL PROTECTED]
Received: from pi.codefab.com (pi.codefab.com [199.103.21.227])
# head -2 mbox_200801114 | od -h
000 1703 0100 4092 9291 0668 9f66 fae3 78df
020 237e c0d2 2415 e4f7 0b1e 499d da55 e223
040 1f8e 084c 694c 1c51 e00b 9f7b a076 0fbc
060 b1be a4e2 93db 9f63 b9b1 226e 46a3 1cc1
100 c9c9 6d8e 8f6d 656e 6465 7a40 676d 6169
120 6c2e 636f 6d3e 0a52 6563 6569 7665 643a
140 2066 726f 6d20 7069 2e63 6f64 6566 6162
160 2e63 6f6d 2028 7069 2e63 6f64 6566 6162
200 2e63 6f6d 205b 3139 392e 3130 332e 3231
220 2e32 3237 5d29 0a00

# head -8 mbox_20080121
?*?D?jZ??{?ڟ V??ùEy ?u?uG?M?Nl?R???:?hx
Q?R?5[EMAIL PROTECTED],?
 [EMAIL PROTECTED] 
C??a6?v?
   fJh 
?k?Kp?g??


 b 
??
?FR_b?k?啾)???t_?ۆtF2?Xh?z?3??ZNr?Yz=ˬ??9߬??6??4?{?mWCX? 
Z2?K??ʩ)?vG??a??}Mi5?Я?9?)?=nUc?,,?~
 :?V 
?w?nB?w8AB   h7???푦X?

??d?d?tQ?bh?\6~rj???~ցa #?y?F??jo??DA޺?e4d?z'???
   ]62??=??? 
%???8???v|??ᄡS?B?( lJp?)^7'???g8?#??F0ɞ??CP??֣??? 
Rڗ3?8(?_??X???Ŧր?E?[?F?K?f뜃?Qq?_ǖ ??咭o?

   vBdhL?1??w???G??
???ZLP???D?E6:?h?ܑNχ?M   ???ax?n?x?\?O/ZF3??=??0?[??1cfX??;???`???-? 
z_?E??\?C}??ׂP?\㋃J?~L^??=?ɶ???Y?4rF?\3?I+DDUP??p??=?ĵD   ?K?? 
FP??dm?|yH??D?E?K

$YS???;F/4x?(e?~$3ʻ䚳=۷nR?.?6
[EMAIL PROTECTED])7,??X?oޞ?T??;?*?6F??)q`\?´? 
0??'?zn??H??9,o?!??EC6??U?( s\H$?h?B?P-7uO7?-Q?/?0?1%1j? 
a???!??!#$?:??b???6??BLSb?|4:11 -0400 (EDT)

Received: from list.precipice.net ([199.103.21.231])
# head -8 mbox_20080121 | od -h
000 1703 0103 e042 3493 4acb baae 3b03 ebab
020 9316 0deb 2ac0 4489 6a5a 8a81 e8a7 12af
040 0504 8e1b 23a2 8b7b d5da 9f20 56dc d5c3
060 b945 1279 1e20 d81f 758a 7547 1a93 1e4d
100 bb4e 6ce3 8606 521e d002 86aa 3ad7 6811
120 780a 51ab 52e9 358a d5ff f296 09c8 72fc
140 cad4 55c7 4e9b 45b4 b9ce b44b b990 d1bc
160 d62d 4bc4 cd91 100e 40ab 21ba a2cd f124
200 a863 2cf0 0c04 8615 a32d f913 30c1 5a97
220 f912 e804 02de 34d6 ef39 c140 b143 dfe6
240 610f 3605 db76 d80b 664a 68ca 036b 9c4b
260 1970 c667 c73f 0b06 0b09 62af c80a a846
300 190e 525f 95a6 9590 62d9 6b3f e595 be29

Re: Mail Spool Problems / IMAP

2008-04-07 Thread Chris Maness




On Mon, 7 Apr 2008, Chuck Swiger wrote:


On Apr 7, 2008, at 5:49 PM, Chris Maness wrote:

How do I check it?  Should I use another IMAP server?


Look at the first few lines; you should see either a placeholder message 
like:



From MAILER-DAEMON Mon Apr  7 13:08:13 2008
Date: 07 Apr 2008 13:08:13 -0400
From: Mail System Internal Data [EMAIL PROTECTED]
Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA
Message-ID: [EMAIL PROTECTED]
X-IMAP: 1143826475 000664 NonJunk $NotJunk JunkRecorded $Junk Junk
Status: RO

This text is part of the internal format of your mail folder, and is not
a real message.  It is created automatically by the mail system software.
If deleted, important folder data will be lost, and it will be re-created
with the data reset to initial values.



This is the header that I have.



...or a normal message with an X-IMAPbase: header, depending on which version 
of UW IMAP you created the mailbox under.  If you see binary gunk (see 
forwarded message below), you're running into the same issue I've seen.


Regards,
--
-Chuck



I am running:

imap-uw-2006j_3,1

This seems to be the current port on the tree.

Thanks,
Chris Maness
___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]


Re: Mail Spool Problems / IMAP

2008-04-07 Thread Chris Maness
Also, in pine.  When I reply to a message, I get the message: [Syntax 
error in sequence]


Thanks,
Chris Maness

Chris Maness
(909) 223-9179
http://www.chrismaness.com

___
freebsd-questions@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-questions
To unsubscribe, send any mail to [EMAIL PROTECTED]