My nutch crawl just stopped. The process is still there, and doesn't
respond to a kill -TERM or a kill -HUP, but it hasn't written
anything to the log file in the last 40 minutes. The last thing it
logged was some calls to my custom url filter. Nothing has been
written in the hadoop directory
Paul Tomblin wrote:
My nutch crawl just stopped. The process is still there, and doesn't
respond to a kill -TERM or a kill -HUP, but it hasn't written
anything to the log file in the last 40 minutes. The last thing it
logged was some calls to my custom url filter. Nothing has been
written in
On Sat, Nov 28, 2009 at 4:45 PM, Andrzej Bialecki a...@getopt.org wrote:
Paul Tomblin wrote:
How can I tell what's going on and why it's stopped?
Try to generate a thread dump to see what code is being executed.
I didn't do any sort of distributed mode because I've only got one
core. I had
Paul Tomblin wrote:
On Sat, Nov 28, 2009 at 5:48 PM, Andrzej Bialecki a...@getopt.org wrote:
Paul Tomblin wrote:
-bash-3.2$ jstack -F 32507
Attaching to process ID 32507, please wait...
Hm, I can't see anything obviously wrong with that thread dump. What's the
CPU and swap usage, and
On Sat, Nov 28, 2009 at 8:25 PM, Andrzej Bialecki a...@getopt.org wrote:
Hm, the curious thing here is that the java process is sleeping, and 99% of
cpu is in system time ... usually this would indicate swapping, but since
there is no swap in your setup I'm stumped. Still, this may be related
