- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: Maxime Subject: Re: robots.txt file disallowing index.
By default, dpsearch cache robots data for 1 week, to change this value, please use RobotsPeriod command: RobotsPeriod 1d or you can delete manualy the records from "robots" table in search database to force indexer reread robots.txt on next run. - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1168096182
