[
https://issues.apache.org/jira/browse/NUTCH-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397411#comment-13397411
]
Julien Nioche commented on NUTCH-1391:
--------------------------------------
A repeart of NUTCH-1110 -> we dump the output of the stats job as a temp
sequence file on HDFS and it contains a _success file on which we choke when
trying to read from it.
> readdb -stats fires java.io.EOFException
> ----------------------------------------
>
> Key: NUTCH-1391
> URL: https://issues.apache.org/jira/browse/NUTCH-1391
> Project: Nutch
> Issue Type: Bug
> Components: crawldb
> Affects Versions: nutchgora
> Reporter: Lewis John McGibbney
> Fix For: nutchgora
>
>
> This is confirmed to be the case with both HBase and Cassandra v1.1.1
> lewis@lewis:~/ASF/nutchgora/runtime/local$ ./bin/nutch readdb -stats
> WebTable statistics start
> WebTableReader: java.io.EOFException
> at java.io.DataInputStream.readFully(DataInputStream.java:180)
> at java.io.DataInputStream.readFully(DataInputStream.java:152)
> at org.apache.hadoop.io.SequenceFile$Reader.init(SequenceFile.java:1508)
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1486)
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1475)
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1470)
> at
> org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:89)
> at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:537)
> at
> org.apache.nutch.crawl.WebTableReader.processStatJob(WebTableReader.java:218)
> at org.apache.nutch.crawl.WebTableReader.run(WebTableReader.java:479)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.nutch.crawl.WebTableReader.main(WebTableReader.java:412)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
