On 21 Aug 2001, at 8:19, Aaron Guy Davies wrote:
> On Mon, 20 Aug 2001, Geoff Hutchison wrote:
>
> > At 8:20 AM -0400 8/20/01, Aaron Guy Davies wrote:
> > >
> > > index.php with no parameters, contains links to the other pages,
> > > something of the form index.php?id=n. htDig doesn't seem to be
> > > indexing anything but the front page. How do I make it do so?
> >
> > I'd check the debugging output from htdig -vvv. If the links do have
> > query strings after them and you're running version 3.1.5 or newer,
> > then these should be seen as unique URLs and indexed as such.
> > (Assuming the page doesn't have a NOFOLLOW directive in it.)
>
> It looks like all the links are getting rejected. Every single line says
> something like
>
> Rejected: URL not in the limits!
> url rejected: (level 1)http://10.228.25.160/?id=2
>
> What's going on? My htdig.conf says
>
> start_url: http://10.228.25.160/directory.php
>
> and
>
> limit_urls_to: ${start_url}
Try changing limit_urls_to to http://10.228.25.160/
--
Dan Langille - DVL Software Limited
FreshPorts - http://freshports.org/ - the place for ports
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
