[CLucene-dev] Parallel indexing and searching..

2010-09-02 Thread suman holani
Hello, 1) How to create distributed index in lucene.If its implemented.? Will we require to make separate instances of indexes itself, such as adding docs into diff indexes manually. or are there any modules/functions already defined. 2) to implement parallel searching using multisearcher.:will

Re: [CLucene-dev] Results Similarity

2010-09-02 Thread Onilton Maciel
I couldn't find it. Can you provide more information? Thanks and sorry for the inconvenience . On Thu, Sep 2, 2010 at 5:54 AM, Ben van Klinken wrote: > One of the overloaded functions of the index searcher exposes the > unnormalised scores. > > Ben > > On Monday, August 30, 2010, Onilton Maciel

Re: [CLucene-dev] wild card query

2010-09-02 Thread Mark Ashworth
Hi Veit, Thank you for the quick response and clarification on how the Query Parser works. It does help. -- Mark. Mark Ashworth IBM Informix Extensibility Architect Office phone: +1 (905) 413-5033, TL: 313-5033 Alternate: +1 (905) 697-8094 Notes: Mark Ashworth/Toronto/i...@ibmca Internet: mail

Re: [CLucene-dev] AddIndexesNoOptimize test added to intensive_testing branch, some problems in core detected

2010-09-02 Thread Kostka Bořivoj
The problem was caused by redundant NULL test in SegmentMerger::mergeVectors(). termVectorsWriter->addAllDocVectors(tmp) contains code for case tmp is NULL, so it should be always called (see fix in intensive_testing branch) Borek > -Original Message- > From: Ben van Klinken [mailto:bva

Re: [CLucene-dev] Span Queries have been ported

2010-09-02 Thread Šplíchal Jiří
Hi Ben, I merged your branch into mine. Now I cannot compile my code because of changes in your branch - especially the Term is no longer reference counted. So I would like to ask - should I change my code in order to match changes in your branch? (Then it would no longer be possible to compile

Re: [CLucene-dev] parallel searching

2010-09-02 Thread suman holani
Thanks Ben for quick reply. I read somewhere , Nutch uses mapper and reducer to do so...but really donno how to go abt it. On net I am not able to find gud papers related to it. If you could provide me the links where I can find more detail abt it.That would be helpful has parallel multi sear

Re: [CLucene-dev] Results Similarity

2010-09-02 Thread Ben van Klinken
One of the overloaded functions of the index searcher exposes the unnormalised scores. Ben On Monday, August 30, 2010, Onilton Maciel wrote: > Can the similarity of the first result be different from 1? I asking this > because I think it's normalized with the first result. In this way it would

Re: [CLucene-dev] Span Queries have been ported

2010-09-02 Thread Ben van Klinken
great news! my branch (ben_working4) contains a lot more stuff than master. That will become mastter soon unless a problem is found with it. I believe we r waiting on some automated tests that someone was running. Either way please try that branch out as well if you could cheers ben On Wednesday

Re: [CLucene-dev] AddIndexesNoOptimize test added to intensive_testing branch, some problems in core detected

2010-09-02 Thread Ben van Klinken
Try running the index test program in Luke. It may show up more ben On Wednesday, September 1, 2010, Veit Jahns wrote: > 2010/8/23 Kostka Bořivoj : >> The last test in suite (testHangOnClose) fails on CND_PRECONDITION in >> SegmentMerger on line 415. >> Is anybody familiar enough with sement me

Re: [CLucene-dev] wild card query

2010-09-02 Thread Ben van Klinken
Itanar would know more about this, but I thought the query parser IS used in the new version. Itamar? On Wednesday, September 1, 2010, Veit Jahns wrote: > Hi Mark, > > in wildcard queries the tokens are not processed by the analyzer (see > also [1]). So in your case the searcher will look for ter

Re: [CLucene-dev] parallel searching

2010-09-02 Thread Ben van Klinken
First of all have a look at the mpi branch ofclucene. It achieves the distributed searches. Nutch is a project which I know does this sort of thing u r looking at, so I look at the theories of that project may give u some good ideas. Good luck and please let us knowhow you go ben On Thursday, S

[CLucene-dev] parallel searching

2010-09-02 Thread suman holani
Hello, I am using Clucene , and want to increase performance. does clucene something like parallel searching for distributed indexes. I want to reduce search time , which query takes for searching clucene indexes. 1. If I can I distribute my indexes such that each index , will have some doc