Hello -
Decided to give the fetch2 a workout from a recent nightly build in the
9.x trunk. Very slow - lots of "spinwaiting" messages (from 2 to 10) in
between every fetch in the hadoop.log. I've tried threads at 100 and
500 and same behavior is seen so in effect the fetch rate is way below 1
page/sec when I do this. Same crawl list with old fetch flies by
comparison ~ 10pages/sec.... Box is only doing nutch. Anyone else seen
this or have a workaround..??
--
rp
- fetch2 very slow - anyone try this?? RP
-