Andrzej Bialecki (JIRA) wrote:
[ http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12422244 ]
Andrzej Bialecki commented on NUTCH-293:
-
I'm working on this patch to commit it. Just a quick note to Sami: Math.max()
is
Sami Siren wrote:
Andrzej Bialecki (JIRA) wrote:
[
http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12422244
]Andrzej Bialecki commented on NUTCH-293:
-
I'm working on this patch to commit it. Just a quick note to
[
http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12421930 ]
Sami Siren commented on NUTCH-293:
--
perhaps instead of
delay = crawlDelay 0 ? crawlDelay : serverDelay;
we could do
delay=Math.max(crawlDelay, serverDelay);
[
http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12415171 ]
Stefan Groschupf commented on NUTCH-293:
Any comments? There was already a posting in the nutch agent mailing list,
where someone had banned nutch since nutch does not
[
http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12415202 ]
Andrzej Bialecki commented on NUTCH-293:
-
Stefan, as you remember we had a discussion on modifying the fetcher, and
specifically changing the thread spin-waiting
[
http://issues.apache.org/jira/browse/NUTCH-293?page=comments#action_12415236 ]
Stefan Groschupf commented on NUTCH-293:
Hi Andrzej,
I agree but writing a queue based fetcher is a big step. I already have some
basic code (nio based).
Also I don't
