hi,everyone
recently i am fetching about 10m pages with 7 PC cluster, after running for
two days,
one of them died. Here is the error message, it shows that the file system of
it turned to be Read-only suddenly.
before reboot it, I can ping it successfully, but I cannot ssh it. when i
connect a monitor to it, the screen is badly white.
so i think maybe the computer is somewhat crashed. if you have encountered the
same error or you have some clue on it
please let me know, thank you very much.
ivannie
java.io.FileNotFoundException:
/nutch/filesystem/mapreduce/local/task_0004_m_000000_0/spill72.out (Read-only
file system)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.(FileOutputStream.java:179)
at java.io.FileOutputStream.(FileOutputStream.java:131)
at
org.apache.hadoop.fs.RawLocalFileSystem$LocalFSFileOutputStream.(RawLocalFileSystem.java:152)
at
org.apache.hadoop.fs.RawLocalFileSystem.create(RawLocalFileSystem.java:191)
at
org.apache.hadoop.fs.ChecksumFileSystem$FSOutputSummer.(ChecksumFileSystem.java:363)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:438)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:346)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:253)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpillToDisk(MapTask.java:343)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.access$100(MapTask.java:231)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:180)
at
org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1445)
java.io.IOException: Read-only file system
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
at
org.apache.hadoop.mapred.TaskLog$Writer.writeIndexRecord(TaskLog.java:251)
at org.apache.hadoop.mapred.TaskLog$Writer.close(TaskLog.java:235)
at org.apache.hadoop.mapred.TaskRunner.runChild(TaskRunner.java:406)
at org.apache.hadoop.mapred.TaskRunner.run(TaskRunner.java:281)