- - - - - - - - - - - - - - - - - - - - - - - - - - - -
Name: Maxime
Subject: Re: scrapping a website

With the latest snapshot 
http://www.dataparksearch.org/dpsearch-4.51-11112008.tar.bz2
you can specify MirrorRoot and MirrorHeadersRoot on per server basis, i.e.

MirrorRoot /path/to/mirror
Sever http://www.somesite.ext/
MirrorRoot
Server http://www.anothersite.ext/

- - - - - - - - - - - - - - - - - - - - - - - - - - - -

Read the full topic here:
http://www.dataparksearch.org/cgi-bin/simpleforum.cgi?fid=02;topic_id=1224733889

Ответить