Tony Grant <[EMAIL PROTECTED]> wrote:
> "Vorl�nder, Martin" wrote:
> > Do an indexing run with very verbose output (htdig -vvv). Then
> > you'll see what links htdig is finding in each page, what links
> > are pushed and thus followed, and what links are rejected (and 
> > for what reason).
> > E.g. for my own homepage
> 
> Done before I mailed the list... 
> 
> >    Rejected: URL not in the limits!
> > url rejected: (level 1)http://www.anybrowser.org/campaign/
> > ...
> 
> I have a problem here: The URL being rejected is under the site root.
> What can that mean?

The reason for "url rejected" is in the line above. If that says
"Rejected: URL not in the limits!" you probably have a problem
with the limit_urls_to config statement.

cu,
  Martin
-- 
 OpenVMS:         | Martin Vorlaender         VMS & WNT programmer
 When you KNOW    | work: [EMAIL PROTECTED]
 where you want   |       http://www.pdv-systeme.de/users/martinv/
 to go today.     | home: [EMAIL PROTECTED]




-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a 
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html

Reply via email to