- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: Maxime Subject: Re: problem with BodyPattern command
the indexing is a process of text splitting onto words, the crawling is a process of scanning for new hrefs in the text of a webpage. If indexing is forbidden or disallowed for a page, but following the links is allowed for this page (e.g. if "Server hrefonly" is corresponded for the page), then no words from this page will be added into database, but all links on this page will be found, added to the database and scanned further. - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1224091974
