Over night the trackers appeared to have difficulties finding a block
from the datanode and eventually exited. The datanode reports serving
the block mentioned below successfully on several earlier occasions.
Instead of the tracker exiting I would have expected the current task to
be aborted and for it to continue on taking others. Below are the logs
from the problem with the block through to where the tracker was no
longer running.
051014 072850 No node available for block blk_-6130354727587666838
051014 072850 Could not obtain block from any node:
java.io.IOException: No live nodes contain current block
051014 072900 No node available for block blk_-6130354727587666838
051014 072900 Could not obtain block from any node:
java.io.IOException: No live nodes contain current block
051014 072910 parsing file:/opt/nutch-0.8_2/conf/nutch-default.xml
051014 072910 parsing file:/opt/nutch-0.8_2/conf/mapred-default.xml
051014 072910 parsing /home/sitesell/local/tracker/task_m_xlwltz/job.xml
051014 072910 parsing file:/opt/nutch-0.8_2/conf/nutch-site.xml
051014 072910 Task task_m_xlwltz timed out. Killing.
051014 072910 parsing file:/opt/nutch-0.8_2/conf/nutch-default.xml
051014 072910 parsing file:/opt/nutch-0.8_2/conf/mapred-default.xml
051014 072910 parsing /home/sitesell/local/tracker/task_m_xlwltz/job.xml
051014 072910 parsing file:/opt/nutch-0.8_2/conf/nutch-site.xml
051014 072910 task_m_1mewgo done; removing files.
Exception in thread "main" java.util.ConcurrentModificationException
at java.util.TreeMap$EntryIterator.nextEntry(TreeMap.java:1048)
at java.util.TreeMap$ValueIterator.next(TreeMap.java:1079)
at
org.apache.nutch.mapred.TaskTracker.close(TaskTracker.java:130)
at org.apache.nutch.mapred.TaskTracker.run(TaskTracker.java:281)
at
org.apache.nutch.mapred.TaskTracker.main(TaskTracker.java:625)
051014 072911 task_m_xlwltz parsing
file:/opt/nutch-0.8_2/conf/nutch-default.xml
051014 072911 task_m_xlwltz parsing
file:/opt/nutch-0.8_2/conf/nutch-site.xml
051014 072911 task_m_xlwltz Child starting
051014 072911 Server connection on port 64071 from 192.168.100.13:
starting
051014 072911 task_m_xlwltz Client connection to 0.0.0.0:64071:
starting
051014 072911 task_m_xlwltz parsing
file:/opt/nutch-0.8_2/conf/nutch-default.xml
051014 072911 task_m_xlwltz parsing
file:/opt/nutch-0.8_2/conf/mapred-default.xml
051014 072911 task_m_xlwltz
parsing /home/sitesell/local/tracker/task_m_xlwltz/job.xml
051014 072911 task_m_xlwltz parsing
file:/opt/nutch-0.8_2/conf/nutch-site.xml
051014 072911 task_m_xlwltz Client connection to 192.168.100.14:5466:
starting
051014 072912 task_m_xlwltz
0.07144528% /user/sitesell/generate-temp-1200428493/part-00000:3924416
+230848
051014 072912 task_m_xlwltz
1.0% /user/sitesell/generate-temp-1200428493/part-00000:3924416+230848
051014 072912 Task task_m_xlwltz is done.
051014 072912 Task task_m_xlwltz is done.
051014 072912 Server connection on port 64071 from 192.168.100.13:
exiting
051014 072912 task_m_xlwltz done; removing files.
--
Rod Taylor <[EMAIL PROTECTED]>
