Re: Ant: Re: Adding XML searching with Lucene

2001-12-11 Thread Stefano Mazzocchi
Bernhard Huber wrote: > > Hi, > > Using the avalon components might help to speed up the searching, as I > changed the classes to Recyclable, > and corrected a bug in the IndexReaderCache -giving me a > TooManyOpenedFiles exception. > As there will be a lot of clients doing search, it is importa

Re: Ant: Re: Adding XML searching with Lucene

2001-12-11 Thread Stefano Mazzocchi
Bernhard Huber wrote: > > Hi, > > >Wouldn't pagination be a result of transformation? > > > >First request: > > > > > > > >Next request: > > > > > > > >(where 25 and 50 would be replaced with something like pagination * > >no_results_to_display) > > > >no? > > > I prefer to reduce as much in the

RE: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread John Morrison
> -Original Message- > From: Bernhard Huber [mailto:[EMAIL PROTECTED]] > Sent: Sunday, 09 December 2001 9:18 pm > To: [EMAIL PROTECTED] > Subject: Re: Ant: Re: Adding XML searching with Lucene > > > Hi, > > >Wouldn't pagination be a result o

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread Bernhard Huber
Hi, >Wouldn't pagination be a result of transformation? > >First request: > > > >Next request: > > > >(where 25 and 50 would be replaced with something like pagination * >no_results_to_display) > >no? > I prefer to reduce as much in the Generator that way the xml content is kept small, I think a

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread Bernhard Huber
Hi > > http://apache.org/cocoon/search/1.0> > > ... > > > A SearchGenerator: (1) Configure the sitemap: sitemap: (2) add a pipeline: SearchGenerator xml-result: http://apache.org/cocoon/search/1.0"; xmlns:xlink="http://www.w3.org/1999/xlink";> http://l

RE: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread John Morrison
> -Original Message- > From: giacomo [mailto:[EMAIL PROTECTED]] > > > searching for 'cocoon' would result in something like: > > > > > > > > > > > > > Wouldn't rank be determined by 's position() within > > ? > > Not necessarily. Think about pagination. > Wouldn't pagination be a res

RE: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread Kevin O'Neill
Hi, Some time ago (back in August) I created a generator that reads the lucene index I created for jmoz (jmoz.sourceforge.net). This is no crawler (as the application uses the dmoz data) but there is a paging interface to a lucene (1.0) dataset. The source code is (http://cvs.sourceforge.net/cg

RE: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread giacomo
On Sun, 9 Dec 2001, John Morrison wrote: > > -Original Message- > > From: Stefano Mazzocchi [mailto:[EMAIL PROTECTED]] > > Sent: Saturday, 08 December 2001 11:44 pm > > To: [EMAIL PROTECTED] > > Subject: Re: Ant: Re: Adding XML searching with Lucene &g

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread giacomo
On Fri, 7 Dec 2001, Bernhard Huber wrote: > Hi, > > > > >But at the same time, it would be nice to have a synchronous way to > >trigger reindexing of recently modified content (say, a page just > >edited). This could be done by calling a specific behavior on the > >'cocoon' component (which is th

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread giacomo
On Sun, 9 Dec 2001, Stefano Mazzocchi wrote: > Bernhard Huber wrote: > > > >Which leads me to think that making crawling, indexing and searching as > > >Avalon components might be FS since we're not going to use any other > > >implementation of these > > > > > I'm sorry but what means FS? > >

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread giacomo
On Fri, 7 Dec 2001, Stefano Mazzocchi wrote: > Bernhard Huber wrote: > > > > > I have even thought about that the indexing step may act like the > > > > profiler. Instead of collecting profile data about how long > > > something> takes, update, or create the index information. This > > > way the

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread Bernhard Huber
Hi, Using the avalon components might help to speed up the searching, as I changed the classes to Recyclable, and corrected a bug in the IndexReaderCache -giving me a TooManyOpenedFiles exception. As there will be a lot of clients doing search, it is important to have a fast search, hence: The

RE: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread John Morrison
> -Original Message- > From: Stefano Mazzocchi [mailto:[EMAIL PROTECTED]] > Sent: Saturday, 08 December 2001 11:44 pm > To: [EMAIL PROTECTED] > Subject: Re: Ant: Re: Adding XML searching with Lucene > > > Bernhard Huber wrote: > > > >Which leads me to

Re: Ant: Re: Adding XML searching with Lucene

2001-12-09 Thread Stefano Mazzocchi
Bernhard Huber wrote: > >Which leads me to think that making crawling, indexing and searching as > >Avalon components might be FS since we're not going to use any other > >implementation of these > > > I'm sorry but what means FS? Flexibility Syndrome: when you want to do more than necessary

Re: Ant: Re: Adding XML searching with Lucene

2001-12-07 Thread Bernhard Huber
Hi, > >But at the same time, it would be nice to have a synchronous way to >trigger reindexing of recently modified content (say, a page just >edited). This could be done by calling a specific behavior on the >'cocoon' component (which is the engine). > Okay > > >Which leads me to think that mak

Re: Ant: Re: Adding XML searching with Lucene

2001-12-07 Thread Stefano Mazzocchi
Bernhard Huber wrote: > > > I have even thought about that the indexing step may act like the > > > profiler. Instead of collecting profile data about how long > > something> takes, update, or create the index information. This > > way the index is > > > kept up-to-date. > > > This way no explici

Ant: Re: Adding XML searching with Lucene

2001-12-06 Thread Bernhard Huber
Hi, nice to hear that it works now. > > Yes, separating is quite a good idea. It will speed up the > indexing of > > the local sites deployed in > > the same servlet engine. > > same cocoon, you mean. yes, of cource i was mixing this up with some jsp i wrote which access the html pages via the

Re: Adding XML searching with Lucene

2001-12-06 Thread Stefano Mazzocchi
Bernhard Huber wrote: > > Hi, > > >I've integrated Bernhard's excellent code into my local copy of Cocoon > >to see how it worked and unfortunately it doesn't :( > > > >Well, it *should* work since the crawler works and the indexing phase is > >being performed (the work/index directory is create

Re: Adding XML searching with Lucene

2001-12-05 Thread Bernhard Huber
Hi, >I've integrated Bernhard's excellent code into my local copy of Cocoon >to see how it worked and unfortunately it doesn't :( > >Well, it *should* work since the crawler works and the indexing phase is >being performed (the work/index directory is created) but at the end of >the indexing, onl

Adding XML searching with Lucene

2001-12-05 Thread Stefano Mazzocchi
I've integrated Bernhard's excellent code into my local copy of Cocoon to see how it worked and unfortunately it doesn't :( Well, it *should* work since the crawler works and the indexing phase is being performed (the work/index directory is created) but at the end of the indexing, only one file