?? wrote:
HI,allin the crawl log, I can see ''fetching http://www.na.gov.la/docs/eng/currentnews/Vietnamese%20Ambassador.html',
> but at the end of the Indexing, I not found it create Indexing, why? > please help me > Hi,that url seems to be blocked by the robots.txt of that site. That is why it does not end up in the index.
-- Sami Siren