Thanks Gabriele, How do I 'allow the document retrieval only to the user agent used by htdig'?
My search page is an asp script that calls a PHP script that calls the htsearch on the Apache server. I have found that getting the referring URL (or referer) is not an exact science. I would like to allow only my 'gateway- script' and HTDig to access the documents. Randall S. Fish ><> Analyst/Programmer -----Original Message----- From: Gabriele Bartolini [mailto:[EMAIL PROTECTED]] Sent: Wednesday, January 29, 2003 10:26 AM To: Randall Fish; [EMAIL PROTECTED] Subject: Re: [htdig] Indexing non-public material Ciao! >Can HTDig index documents that are not publicly available through the web >server? Yes ... and no ... I think I don't understand your problem. :-) Sorry, can you be more precise? >Part of the problem is that the search and the site exist on two different >servers. The site is in windows NT, IIS and the search comes from a Unix >server running Apache. I use a PHP script to remotely grab the search >results. I want to be able to index the documents on the IIS server from the >Apache server and still restrict users from linking directly to the >materials. You mean through your search page, don't you? You can make a sort of gateway-script which, given an id, gives back a document. If so ... you should check the referring URL (or referer) and in particular force it to be 'your site/cgi-bin/htsearch'; if yes you give back the document itself, otherwise send back a redirect to your main page or issue a 404 not found page. When indexing, you can do different ways; the simplest one would be to use the same script, and to allow the document retrieval only to the user agent used by htdig. Hope this matches your needs; sorry but I didn't understand a lot ... However, feel free to post your problems again! :-) Ciao ciao -Gabriele -- Gabriele Bartolini - Web Programmer - ht://Dig & IWA Member - ht://Check maintainer Current Location: Prato, Tuscany, Italia [EMAIL PROTECTED] | http://www.prato.linux.it/~gbartolini | ICQ#129221447 ------------------------------------------------------- This SF.NET email is sponsored by: SourceForge Enterprise Edition + IBM + LinuxWorld = Something 2 See! http://www.vasoftware.com _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
