HI All, I thought I'd reply to this on the dev list since there weren't any answers on users.
I'm having the same problem as zennet here, so was hoping there would be someone that's seen something similar. I've read through the list archives and have found a lot of helpful information on merging, but nothing specific to this problem. Basically when I try to merge to a master index I get the "SEVERE no master index" error - and when i try the -cm command I end up with the "too many open files" error. I'm sure I'm missing something simple, but beating my head against it hasn't proven successful yet. Any help would be much appreciated. thanks, Scott On 5/2/05, Zennet Colburn <[EMAIL PROTECTED]> wrote: > Hello Nutch Users, > > I've got about 25 segments and I am trying to merge them. No matter > which way I try I run into fatal errors. If you have an idea of what > is wrong any help is appreciated. I included some commands and the > errors they produce. > > $nutch mergesegs my-segments/ -o output_segment_dir -m > my-segments/20050309012353 > ... > 050502 164206 Segment 20050413210403: 199 entries. > 050502 164206 Segment 20050413201837: 0 entries. > 050502 164206 TOTAL 858045 input entries in 59 segments. > 050502 164206 Looking for master index in segments-tripset/20050309012353 > 050502 164206 SEVERE No master index, and createMaster == false > > $nutch mergesegs my-segments -o output_segment_dir -cm > (works initially but after 4 minutes this error occurs) > ... > java.io.FileNotFoundException: > my-segments/20050118104221/index/_1rq.f5 (Too many open files) > at java.io.RandomAccessFile.open(Native Method) > at java.io.RandomAccessFile.<init>(RandomAccessFile.java:204) > at > org.apache.lucene.store.FSInputStream$Descriptor.<init>(FSDirectory.java:376) > at org.apache.lucene.store.FSInputStream.<init>(FSDirectory.java:405) > at org.apache.lucene.store.FSDirectory.openFile(FSDirectory.java:268) > at > org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:369) > at > org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:122) > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:94) > at > org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:480) > at > org.apache.lucene.index.IndexWriter.maybeMergeSegments(IndexWriter.java:458) > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:310) > at > org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:294) > at net.nutch.indexer.IndexSegment.indexPages(IndexSegment.java:121) > at net.nutch.indexer.IndexSegment.main(IndexSegment.java:223) > at net.nutch.tools.SegmentMergeTool.run(SegmentMergeTool.java:202) > at net.nutch.tools.SegmentMergeTool.main(SegmentMergeTool.java:358) > 050502 165126 SEVERE my-segments/20050118104221/index/_1rq.f5 (Too > many open files) > > zennet >
