[
https://issues.apache.org/jira/browse/NUTCH-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13882348#comment-13882348
]
Tejas Patil commented on NUTCH-1692:
------------------------------------
Hi [~markus17],
I am tried out the patch on a latest trunk checkout and it ran fine in local
mode. In deploy mode, I encountered this:
{noformat}
$ bin/nutch readseg -list 20140126210858/ -nocontent -nogenerate
14/01/26 22:26:16 INFO util.NativeCodeLoader: Loaded the native-hadoop library
14/01/26 22:26:16 INFO zlib.ZlibFactory: Successfully loaded & initialized
native-zlib library
14/01/26 22:26:16 INFO compress.CodecPool: Got brand-new decompressor
14/01/26 22:26:16 INFO compress.CodecPool: Got brand-new decompressor
14/01/26 22:26:16 INFO compress.CodecPool: Got brand-new decompressor
14/01/26 22:26:16 INFO compress.CodecPool: Got brand-new decompressor
14/01/26 22:26:16 INFO compress.CodecPool: Got brand-new decompressor
Exception in thread "main" java.io.IOException: can't find class:
org.apache.nutch.protocol.ProtocolStatus because
org.apache.nutch.protocol.ProtocolStatus
at
org.apache.hadoop.io.AbstractMapWritable.readFields(AbstractMapWritable.java:204)
at org.apache.hadoop.io.MapWritable.readFields(MapWritable.java:146)
at org.apache.nutch.crawl.CrawlDatum.readFields(CrawlDatum.java:280)
at
org.apache.hadoop.io.SequenceFile$Reader.getCurrentValue(SequenceFile.java:1813)
at org.apache.hadoop.io.SequenceFile$Reader.next(SequenceFile.java:1941)
at org.apache.hadoop.io.MapFile$Reader.next(MapFile.java:517)
at
org.apache.nutch.segment.SegmentReader.getStats(SegmentReader.java:485)
at org.apache.nutch.segment.SegmentReader.list(SegmentReader.java:441)
at org.apache.nutch.segment.SegmentReader.main(SegmentReader.java:597)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
{noformat}
> SegmentReader broken in distributed mode
> ----------------------------------------
>
> Key: NUTCH-1692
> URL: https://issues.apache.org/jira/browse/NUTCH-1692
> Project: Nutch
> Issue Type: Bug
> Affects Versions: 1.7
> Reporter: Markus Jelsma
> Assignee: Markus Jelsma
> Fix For: 1.8
>
> Attachments: NUTCH-1692-trunk.patch
>
>
> SegmentReader -list option ignores the -no* options, causing the following
> exception in distributed mode:
> {code}
> Exception in thread "main" java.lang.NullPointerException
> at java.util.ComparableTimSort.sort(ComparableTimSort.java:146)
> at java.util.Arrays.sort(Arrays.java:472)
> at
> org.apache.hadoop.mapred.SequenceFileOutputFormat.getReaders(SequenceFileOutputFormat.java:85)
> at
> org.apache.nutch.segment.SegmentReader.getStats(SegmentReader.java:463)
> at org.apache.nutch.segment.SegmentReader.list(SegmentReader.java:441)
> at org.apache.nutch.segment.SegmentReader.main(SegmentReader.java:587)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:160)
> {code}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
