> What I would really like is to have both servers > in the start_url list and if a requires authentication > response is received from the request then authenticate > and save that servers name in the db.
If you enter both servers in the start_url, it will index both. You can't do quite what you want, since an authentication will be sent regardless of whether it's asked. (This doesn't make much difference since the non-authenticating server will just ignore that header.) So what I'd suggest is something like this: start_url: http://server1.foo.com/ http://secure1.foo.com/ authentication: ... local_urls: http://server1.foo.com/=/path/to/files/ \ http://secure1.foo.com/=/path/to/files/ Since each document has one URL and only one URL, you'll need to index "twice." Of course since you're indexing on the filesystem and your OS will cache files, indexing should be relatively quick. -- -Geoff Hutchison Williams Students Online http://wso.williams.edu/ _______________________________________________________________ Hundreds of nodes, one monster rendering program. Now that's a super model! Visit http://clustering.foundries.sf.net/ _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html
