Hi Sandeep, On Sun, Sep 27, 2015 at 7:36 AM, <[email protected]> wrote:
> > I am trying to configure rotating agent in Nutch. > > I have set following in nutch-site.xml but I cannot see different user ids > in crawl. What am I missing: > > <property> > <name>http.agent.rotate</name> > <value>true</value> > <description> > </description> > </property> > > <property> > <name>http.agent.rotate.file</name> > <value>agents.txt</value> > <description> > </description> > </property> > > Thanks in advance for your help. > > Do you have a file called agents.txt with agent names in it? This file should be located in $NUTCH_HOME/conf, you should then build Nutch if using trunk. Lewis
