[
https://issues.apache.org/jira/browse/NUTCH-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15038010#comment-15038010
]
Harshavardhan Manjunatha commented on NUTCH-2180:
-------------------------------------------------
Merging segments is not feasible here, since it will combine the lowest set of
common data among all segments [1]
[1] http://wiki.apache.org/nutch/bin/nutch%20mergesegs
> FileDumper dumps data, but breaks midway on corrupt segments
> ------------------------------------------------------------
>
> Key: NUTCH-2180
> URL: https://issues.apache.org/jira/browse/NUTCH-2180
> Project: Nutch
> Issue Type: Bug
> Components: bin, dumpers
> Affects Versions: 1.11
> Environment: Ubuntu 14.04.3 x64
> Reporter: Harshavardhan Manjunatha
>
> FileDumper should ignore corrupt segments, and continue dumping data instead
> of throwing NullPointerException
> $ bin/nutch dump -segment ../../../segments/ -outputDir ./firstDump/ -flatdir
> java.lang.NullPointerException
> at org.apache.nutch.tools.FileDumper.dump(FileDumper.java:175)
> at org.apache.nutch.tools.FileDumper.main(FileDumper.java:417)
> $
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
