On Mon, 11 Mar 2002, Melissa Mifsud wrote:
> Date: Mon, 11 Mar 2002 10:33:11 +0100 > From: Melissa Mifsud <[EMAIL PROTECTED]> > To: [EMAIL PROTECTED] > Subject: [htdig] Indexing local directories > > Hi, > > I've been going through the documentation, but i can't seem to find > whether or not it's possible to index a local directory using htdig? > > I am doing some research on a different method of indexing in which i > have to pre-process web pages before they are indexed. For this reason, I > have to download the pages and store them locally. Ideally I would be > able to instruct htdig to index a local directory and any subdirectories. > > Is this possible? Sure! Just point htdig at http://127.0.0.1 > > Also, can the documents be simple text files? All mine are. The trick you use depends on how many you have. If you only have a few hundred to a few thousand, just make sure you add the .txt extention to them. If you are dealing (as we are) in the millions of documents, you'll need to either generate a naming convention [.txt works well] or reset all text files to have no extention at all, and set apache to force mime-type text/plain on any such file... > > Melissa > > -- Yours, J.A. Terranson [EMAIL PROTECTED] If Governments really want us to behave like civilized human beings, they should give serious consideration towards setting a better example: Ruling by force, rather than consensus; the unrestrained application of unjust laws (which the victim-populations were never allowed input on in the first place); the State policy of justice only for the rich and elected; the intentional abuse and occassionally destruction of entire populations merely to distract an already apathetic and numb electorate... This type of demogoguery must surely wipe out the fascist United States as surely as it wiped out the fascist Union of Soviet Socialist Republics. The views expressed here are mine, and NOT those of my employers, associates, or others. Besides, if it *were* the opinion of all of those people, I doubt there would be a problem to bitch about in the first place... -------------------------------------------------------------------- _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
