A few options that I have tried personally: 1. You can use Amazon Web Service as the platform to crawl and you just need to restart the box to get a new ip. 2. think about using some paid VPN service to guarantee the performance. 3. check out TOR, which is kind of slow but anonymous enough.
/usr/bin On Wed, Apr 9, 2014 at 1:25 PM, Lewis John Mcgibbney < [email protected]> wrote: > Hi, > > On Wed, Apr 9, 2014 at 8:43 AM, <[email protected]> wrote: > > > > > Subject: Re: Crawl Anonymously > > Set up a anonymous proxy server and configure nutch to crawl through the > > proxy. > > > > > > http://wiki.apache.org/nutch/SetupProxyForNutch >
