- - - - - - - - - - - - - - - - - - - - - - - - - - - - Name: Dean Subject: Re: How can I avoid bombarding the servers?
Most webmasters are now actively banning this engine with robots.txt and htaccess directives. Unfortunately a delay in crawling should be inherrent in the application. This is poor programming from the developers. It is not for the webmasters to stop users of this application crashing servers and creating DDOS attacks. A little more thought would have gone a long way. - - - - - - - - - - - - - - - - - - - - - - - - - - - - Read the full topic here: http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1157474787
