I was having a problem where my site was not getting indexed at all--running
htdig with -vv ouput showed it reading the page fine, but not going on to
index anything more, and it didn't seem like it recognized any of my hrefs
within the document. In my troubleshooting process, I commented the
following out of my config file:
noindex_start: <script
noindex_stop: </script>
And re-running htdig indexed the site just fine. I have several various
script sections in my index page--a couple at the beginning and one near the
very end of the page. This makes me wonder if noindex is greedy, meaning
it'll try to noindex everything in between the very first <script string and
the very last </script> string (which would cause it to not read about 95%
of my index page). I hope that's not the case Are there known problems
with noindex settings? I'm running 3.1.5. Thanks for any insights.
J
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
