Re: How to import the early mails into mutt ?

2013-01-22 Thread Chris Bannister
On Mon, Jan 21, 2013 at 12:06:04PM -0700, s. keeling wrote:
 Incoming from horseriver:
  
  I subscribed a mail list at date X , Now I want to import these mails which 
  are 
  post  before X , How can I do ?
 
 Just brainstorming here.
 
i) please give a better description of your problem.

The description is pretty clear. OP joins list Y on date X, say X is
20th Jan 2013. He wants to import mails posted before X, i.e. before
20th Jan 2013 into mutt so he can read them.

   ii) what format are mails stored in (ASCII, mbox/maildir, ...)?

Does it matter? 

  iii) what, specifically, is the problem you're running into (error
   messages, corrupted data, whatever).

He doesn't appear to be running into any problem importing them,
simply because he doesn't know where to start.


AFAIUI, it is not possible to import mails for a mailing list which were
sent *before* you joined. I suggest reading/searching the archives of
the list in question.

IOW, it is not something mutt can do.

-- 
If you're not careful, the newspapers will have you hating the people
who are being oppressed, and loving the people who are doing the 
oppressing. --- Malcolm X


Re: How to import the early mails into mutt ?

2013-01-22 Thread Matthias Apitz
El día Tuesday, January 22, 2013 a las 08:53:03PM +1300, Chris Bannister 
escribió:

 AFAIUI, it is not possible to import mails for a mailing list which were
 sent *before* you joined. I suggest reading/searching the archives of
 the list in question.
 
 IOW, it is not something mutt can do.

Some mailing lists have monthly batched archives (from which the HTML monthly
archives are generated/presented)); the OP should contact the list owner
and ask for support/access; if such batched archives exists, they could
be downloaded (technically) and incorparated in the OP's mbox/maildir
archives;

matthias

-- 
Sent from my FreeBSD netbook

Matthias Apitz   |  - No system with backdoors like Apple/Android
E-mail: g...@unixarea.de |  - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |  - No proprietary attachments
phone: +49-170-4527211   |  - Respect for open standards


Re: How to import the early mails into mutt ?

2013-01-22 Thread Cameron Simpson
On 22Jan2013 09:20, Matthias Apitz g...@unixarea.de wrote:
| El día Tuesday, January 22, 2013 a las 08:53:03PM +1300, Chris Bannister 
escribió:
|  AFAIUI, it is not possible to import mails for a mailing list which were
|  sent *before* you joined. I suggest reading/searching the archives of
|  the list in question.
|  
|  IOW, it is not something mutt can do.
| 
| Some mailing lists have monthly batched archives (from which the HTML monthly
| archives are generated/presented)); the OP should contact the list owner
| and ask for support/access; if such batched archives exists, they could
| be downloaded (technically) and incorparated in the OP's mbox/maildir
| archives;

I routinely fetch the old archives from a mailman list when I join and
load them into the folder that will collect future messages.

I have some useful scripts to undo the munging mailman does to the
archives which produces a sane mbox result. This I then open with mutt
and move the messages into the target folder.
-- 
Cameron Simpson c...@zip.com.au

I believe the difficulty is inversely proportional to the crotch-to-shoulder
measurement, and proportional to the coefficient of friction of the inside
surface.  Mine got smelly so I cleaned it, now it's hard to put on!
(Lucky I'm not a well-known DoD'er, or that would end up in someone's .sig).
- tg...@dale.ksc.nasa.gov (Tom Gent)


Re: How to import the early mails into mutt ?

2013-01-22 Thread Michael Elkins

On Tue, Jan 22, 2013 at 08:19:14PM +1100, Cameron Simpson wrote:

I have some useful scripts to undo the munging mailman does to the
archives which produces a sane mbox result. This I then open with mutt
and move the messages into the target folder.


Would you mind sharing your script?  I recently committed support 
for parsing the munged From_ line that pipermail generates, but it 
doesn't undo the munging that occurs in the message header.


Re: How to import the early mails into mutt ?

2013-01-22 Thread David Champion
* On 22 Jan 2013, Michael Elkins wrote: 
 On Tue, Jan 22, 2013 at 08:19:14PM +1100, Cameron Simpson wrote:
 I have some useful scripts to undo the munging mailman does to the
 archives which produces a sane mbox result. This I then open with mutt
 and move the messages into the target folder.
 
 Would you mind sharing your script?  I recently committed support for
 parsing the munged From_ line that pipermail generates, but it doesn't undo
 the munging that occurs in the message header.

I use this for parsing Mailman-munged mail:

https://bitbucket.org/dgc/mutt-dgc/src/tip/obfuscat?at=default

I missed your commit.  I think this patch is an overlap with yours, but
covers the case you're describing as well.

-- 
David Champion • d...@bikeshed.us


Re: How to import the early mails into mutt ?

2013-01-22 Thread Michael Elkins

On Tue, Jan 22, 2013 at 10:17:50AM -0600, David Champion wrote:

I missed your commit.  I think this patch is an overlap with yours, but
covers the case you're describing as well.


http://dev.mutt.org/hg/mutt/rev/1a75c9e477b4

It just handles the user at example.com that may occur in the 
From_ line.


Re: How to import the early mails into mutt ?

2013-01-22 Thread s. keeling
Incoming from Chris Bannister:
 On Mon, Jan 21, 2013 at 12:06:04PM -0700, s. keeling wrote:
  Incoming from horseriver:
   
   I subscribed a mail list at date X , Now I want to import these mails 
   which are 
   post  before X , How can I do ?
  
  Just brainstorming here.
  
 i) please give a better description of your problem.
 
 The description is pretty clear.

No, it's not.  Considering how many ways this stuff is handled
nowadays, it's not a drop dead simple situation.  You assume too much.

ii) what format are mails stored in (ASCII, mbox/maildir, ...)?
 
 Does it matter? 

Well YAA!  Did you just fall off the turnip truck?!?

   iii) what, specifically, is the problem you're running into (error
messages, corrupted data, whatever).
 
 He doesn't appear to be running into any problem importing them,
 simply because he doesn't know where to start.

He's asking us for answers, so he's obviously experiencing some sort
of problem, yes?  Duh.

 AFAIUI, it is not possible to import mails for a mailing list which were
 sent *before* you joined. I suggest reading/searching the archives of
 the list in question.
 
 IOW, it is not something mutt can do.

You need another cup of coffee.

All mutt needs to do is make sense of the result.  Period.

[Apologies if this reaks with hostility; it isn't meant.  Understanding
error reports and missives from users is an art.  I like to think of
it as bang your head on the wall until it falls over.  I've listened
to too many mere users complaining about us geeks not understanding
them.  We need to step up our game.]


-- 
Any technology distinguishable from magic is insufficiently advanced.
(*) :(){ :|: };:
- -


Re: How to import the early mails into mutt ?

2013-01-22 Thread Patrick Shanahan
* s. keeling keel...@nucleus.com [01-22-13 13:04]:
 [...]
 [Apologies if this reaks with hostility; it isn't meant.  Understanding
 error reports and missives from users is an art.  I like to think of
 it as bang your head on the wall until it falls over.  I've listened
 to too many mere users complaining about us geeks not understanding
 them.  We need to step up our game.]

Insincere apologies are worth as much as your post,  us$0.02.  Your abuse is
unwarranted and inexcusable.  Clean up your act!
-- 
(paka)Patrick Shanahan   Plainfield, Indiana, USA  HOG # US1244711
http://wahoo.no-ip.orgPhoto Album: http://wahoo.no-ip.org/gallery2
http://en.opensuse.org   openSUSE Community Member
Registered Linux User #207535@ http://linuxcounter.net


Re: How to import the early mails into mutt ?

2013-01-22 Thread Chris Bannister
On Tue, Jan 22, 2013 at 11:02:24AM -0700, s. keeling wrote:
 
 [Apologies if this reaks with hostility; it isn't meant.  

I've seen your posts before. 

 Understanding error reports and missives from users is an art.

Exactly! So asking a mere user whether the messages are stored in mbox
or maildir or plain ASCII won't help much, IMNSHO. A better question
might be: Oh, OK, what list is this? and then checking yourself.

 I like to think of it as bang your head on the wall until it falls over.  

You're more likely to knock yourself unconscious.

 I've listened to too many mere users complaining about us geeks 
 not understanding them.  

Mmmm, ...

 We need to step up our game.]

What's this we business?

-- 
If you're not careful, the newspapers will have you hating the people
who are being oppressed, and loving the people who are doing the 
oppressing. --- Malcolm X


Re: How to import the early mails into mutt ?

2013-01-22 Thread s. keeling
Incoming from Chris Bannister:
 On Tue, Jan 22, 2013 at 11:02:24AM -0700, s. keeling wrote:
  
  [Apologies if this reaks with hostility; it isn't meant.  
 
 I've seen your posts before. 

Cool!  I've been using Linux/FLOSS/*nix since '93(?), and mutt pretty
much as long.  Honest, I meant no offence with that post.  It's just
frustrating for someone like myself (straddling the user-developer
line) seeing the communication barrier in action.

  Understanding error reports and missives from users is an art.
 
 Exactly! So asking a mere user whether the messages are stored in mbox
 or maildir or plain ASCII won't help much, IMNSHO. A better question

Really?  Maybe they're in some proprietary $thingy with its own data
format, or they're on some $webbythingy that does it $that way, ...  I
don't like to make assumptions.  I want to know what's *really* going
on, and how.  THEN, I can attempt a fix.

  I like to think of it as bang your head on the wall until it falls over.  
 
 You're more likely to knock yourself unconscious.

Funny.  You take things too literally.  It was just an allusion.  :-)

  I've listened to too many mere users complaining about us geeks 
  not understanding them.  
 
 Mmmm, ...

Struth!

  We need to step up our game.]
 
 What's this we business?

Geeks.  The normals (mortals) out there don't understand us when we
try to answer their questions.  Haven't you noticed their eyeballs
rolling up into their heads?  :-|

[Sorry if I'm annoying any of you.  'Seems there's not a lot of mutt
here, so off-topic.  Stopping now.]


-- 
Any technology distinguishable from magic is insufficiently advanced.
(*) :(){ :|: };:
- -


Re: How to import the early mails into mutt ?

2013-01-22 Thread Cameron Simpson
On 22Jan2013 12:58, Michael Elkins m...@sigpipe.org wrote:
| On Tue, Jan 22, 2013 at 08:19:14PM +1100, Cameron Simpson wrote:
| I have some useful scripts to undo the munging mailman does to the
| archives which produces a sane mbox result. This I then open with mutt
| and move the messages into the target folder.
| 
| Would you mind sharing your script?  I recently committed support 
| for parsing the munged From_ line that pipermail generates, but it 
| doesn't undo the munging that occurs in the message header.

The script itself is here:

  https://bitbucket.org/cameron_simpson/css/src/tip/bin/get-mailman-archive

The Raw button will fetch you the script. You invoke it as per the
usage message:

  get-mailman-archive archive-page-url... mlist.mbox

passing the URL of the mailman archive page. It pulls all the archive
files, decompresses then, unmunges them and sticks them into an mbox
file, read for refiling using mutt directly.

It is rather dependent on my other scripts (pilfer in particular is a
web scraper, and still a bit unstable). You can get the kit here:

  http://www.cskk.ezoshosting.com/cs/css/

I need to update the tarball, too; I can make an up to date one soon
enough on request. [...] Here:

  https://www.dropbox.com/s/zy1z13xx5rr0fff/css-20130123.tar.gz

That unpacks to css/...; I traditionally install to /opt/css as a
third party install, and source /opt/css/env.sh to tweak $PATH etc.

If you don't want the whole kit, pilfer's used just to read the URLs
of the archive files and to fetch them. I imagine wget or curl could do
the last half for you easily enough.

The important unmunging bit is at the bottom, which takes the decompressed
archive files as input (they're almost mbox files as they are) and
filters them through:

  fix-mail-dates --mbox | un-at-

fix-mail-dates is here:

  https://bitbucket.org/cameron_simpson/css/src/tip/bin/fix-mail-dates

which is a wrapper for a sed command the reformat the mail date headers
and un-at- is here:

  https://bitbucket.org/cameron_simpson/css/src/tip/bin/un-at-

which is a small Perl script to undo mailman's transcription of addresses
from bill at snort.example.com into b...@snort.example.com in the
message headers.

I'm happy to offer any assistance to make these scripts work for you or
others; they're meant to be an out-of-the-box kit.

Cheers,
-- 
Cameron Simpson c...@zip.com.au

You can't always get what you want. - The Rolling Stones


Re: How to import the early mails into mutt ?

2013-01-21 Thread Matthias Apitz
El día Monday, January 21, 2013 a las 12:13:47PM +0800, horseriver escribió:

 hi:
 
I subscribed a mail list at date X , Now I want to import these mails 
 which are 
 
post  before X , How can I do ?

What do you mean with 'import'? Get them into your mbox?

How to access older mails of a given list depends on how are organized
the archives of the list in question and has less or nothing todo with
our beloved 'mutt'

matthias
-- 
Sent from my FreeBSD netbook

Matthias Apitz   |  - No system with backdoors like Apple/Android
E-mail: g...@unixarea.de |  - No HTML/RTF in E-mail
WWW: http://www.unixarea.de/ |  - No proprietary attachments
phone: +49-170-4527211   |  - Respect for open standards


Re: How to import the early mails into mutt ?

2013-01-21 Thread Chip Camden
Quoth Matthias Apitz on Monday, 21 January 2013:
 El día Monday, January 21, 2013 a las 12:13:47PM +0800, horseriver escribió:
 
  hi:
  
 I subscribed a mail list at date X , Now I want to import these mails 
  which are 
  
 post  before X , How can I do ?
 
 What do you mean with 'import'? Get them into your mbox?
 
 How to access older mails of a given list depends on how are organized
 the archives of the list in question and has less or nothing todo with
 our beloved 'mutt'
 
   matthias

Indeed.  If they're available through a feed, and you use the mbox mail
format, then you can use my feedmbox script to retrieve them
(http://bitbucket.org/sterlingcamden/feedmbox).  However, most feeds only
include the 20 or so most recent items anyway.

-- 
.O. | Sterling (Chip) Camden  | http://camdensoftware.com
..O | sterl...@camdensoftware.com | http://chipsquips.com
OOO | 2048R/D6DBAF91  | http://chipstips.com


pgpJHip4oSQtI.pgp
Description: PGP signature


Re: How to import the early mails into mutt ?

2013-01-21 Thread s. keeling
Incoming from horseriver:
 
 I subscribed a mail list at date X , Now I want to import these mails which 
 are 
 post  before X , How can I do ?

Just brainstorming here.

   i) please give a better description of your problem.
  ii) what format are mails stored in (ASCII, mbox/maildir, ...)?
 iii) what, specifically, is the problem you're running into (error
  messages, corrupted data, whatever).

Do you need to _convert_ earlier mail from one format (file/data type)
to another, and why do you want/need to do that?  :-)  Bon chance.


-- 
Any technology distinguishable from magic is insufficiently advanced.
(*) :(){ :|: };:
- -