Jason Boss wrote:
at net.nutch.tools.SegmentMergeTool.run(SegmentMergeTool.java:237) at net.nutch.tools.SegmentMergeTool.main(SegmentMergeTool.java:322) 041006 051544 SEVERE null You have new mail in /var/spool/mail/root [EMAIL PROTECTED] nutch-nightly]#
Yesterday I was able to get a set of segments to merge after updating to nutch-nightly build. I have been messing with this all day and can't seem to get anywhere.
Ah, but now it finally starts making sense... This points to a real deficiency in SegmentMergeTool (or perhaps a wrong assumption). When reading segment data I assumed that if the segment is truncated, all data files (content, parse_text, fetcher, etc) will be truncated to the same index position. Apparently this is not always the case.
I'll send you a patch in a few moments...
-- Best regards, Andrzej Bialecki
------------------------------------------------- Software Architect, System Integration Specialist CEN/ISSS EC Workshop, ECIMF project chair EU FP6 E-Commerce Expert/Evaluator ------------------------------------------------- FreeBSD developer (http://www.freebsd.org)
------------------------------------------------------- This SF.net email is sponsored by: IT Product Guide on ITManagersJournal Use IT products in your business? Tell us what you think of them. Give us Your Opinions, Get Free ThinkGeek Gift Certificates! Click to find out more http://productguide.itmanagersjournal.com/guidepromo.tmpl _______________________________________________ Nutch-developers mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/nutch-developers
