Hello,

I am trying to configure rotating agent in Nutch.

I have set following in nutch-site.xml but I cannot see different user ids
in crawl. What am I missing:

<property>
  <name>http.agent.rotate</name>
  <value>true</value>
  <description>
  </description>
</property>

<property>
  <name>http.agent.rotate.file</name>
  <value>agents.txt</value>
  <description>
  </description>
</property>

Thanks in advance for your help.

Reply via email to