Date: Tue, 2 Apr 2002 18:58:55 -0700 (MST) From: Michael Kopplin <[EMAIL PROTECTED]> Subject: Re: [LIB] List archive search problem
> Terrific Mike... Sounds like it may have been a relatively easy tweak if > you got it ironed out this fast. I'm guessing this will be greatly > appreciated by the silent majority. Yes, a couple minutes for modification, an hour or so to rebuild. > >I will soon be switching back to the main server, which > >can update all the indexes daily. Right now, only the yearly > >indexes are updated, and those not every day. > > Not quite sure if I'm following you. Once a past year's worth of messages > has been indexed, why would they have to be re-indexed every day? Sorry, it's only the last year that's done, but I archive several lists, hence the plural. > >Another reason you might not get any hits is if your search term > >is too common. If a word appears in too many messages, e.g. any > > That's a useful bit of info. Maybe it'd be nice to add that to your help > file too. Good suggestions. Thanks. > Great job at setting this all up though Mike! I forget how long back I > discovered your archives, but they've been extremely useful. It seems > you've chosen not to list the URL on the major web engines, which I think is > great. It gives the list members a kind of a firewall from the web email > address spam worms. Thank you. As for the web engines, it's only because I have a robots.txt file excluding them. I have another archive with nearly 70,000 messages and it didn't take long for google and the like to find it on their own. Now all the big boys stop by occasionally and churn through the whole thing. Of course the address harvestors won't pay attention to robots.txt so the potential abuse is there. I have done some work on this. If you look at a message in the archives, you'll see that the domain part of the senders address is xxxxd out. Unfortuneately, this is only part of the problem. The maillist software for some reason always duplicates some of the headers and puts them in the body of the message. And quoted text will often have email addresses in them as well. The archiving software I use does nothing to conceal these. But then, Dan's archive of the digests are in html format, and these are already in google etc., so I must say I haven't worked on it very hard. Cheers, Mike ************************************************************** http://libretto.basiclink.com - Libretto mailing list http://www.silverace.com/libretto/ - Archives -------TO UNSUBSCRIBE------- Reply to any of the list messages. The reply mail should be addressed to: [EMAIL PROTECTED] - Then replace any text on the message's subject line: cmd:unsubscribe --------TO UNSUBSCRIBE DIGEST------ Do above but with this on subject line: cmd:unsubscribe digest **************************************************************
