Date: Sat, 16 Mar 2002 02:40:03 GMT
Mime-Version: 1.0
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: 7bit
On Friday, March 15, 2002, at 08:46 Uhr, Vadim Gritsenko wrote:
> I guess it is because you are under DOS. You have to add some kind of
> FILES=500
> line to the config.sys.
> Vadim
maybe you better go to sleep now...
and hand this problem over to your coders :-)
it seems that the resources (open file descriptors) are getting short
maybe they are never closed. The problem occurs in traversing
a somehow bigger file tree. I am not sure if the descriptors are lost
on the files to index or on the traversed directory hierarchy.
code snippet from SimpleLuceneCocoonIndexerImpl.java:
try {
lxi = (LuceneXMLIndexer) manager.lookup(LuceneXMLIndexer.ROLE);
writer = new IndexWriter(index, analyzer, create);
writer.mergeFactor = this.mergeFactor;
cocoonCrawler = (CocoonCrawler)
manager.lookup(CocoonCrawler.ROLE);
cocoonCrawler.crawl(base_url);
Iterator cocoonCrawlerIterator = cocoonCrawler.iterator();
while (cocoonCrawlerIterator.hasNext()) {
URL crawl_url = (URL) cocoonCrawlerIterator.next();
if (!crawl_url.getHost().equals(base_url.getHost()) ||
crawl_url.getPort() != base_url.getPort()) {
// skip urls using different host, or port than host,
// or port of base url
if (getLogger().isDebugEnabled()) {
getLogger().debug("Skipping crawling URL " +
crawl_url.toString() +
" as base_url is " + base_url.toString());
}
continue;
}
// build lucene documents from the content of the crawl_url
Iterator i = lxi.build(crawl_url).iterator();
// add all built lucene documents
while (i.hasNext()) {
writer.addDocument((Document) i.next());
}
}
// optimize it
writer.optimize();
} catch (IOException ioe) {
throw new ProcessingException("IOException in index()", ioe);
} catch (ComponentException ce) {
[... stuff deleted ...]
Thx in advance for better help...
/leo
---------------------------------------------------------------------
Please check that your question has not already been answered in the
FAQ before posting. <http://xml.apache.org/cocoon/faqs.html>
To unsubscribe, e-mail: <[EMAIL PROTECTED]>
For additional commands, e-mail: <[EMAIL PROTECTED]>
