Re: [CLucene-dev] parallel searching

2010-09-16 Thread Ben van Klinken
map/reduce is used in nutch to do the actual processing of the index. the searching (was when i last looked) a daemon which could run on mutliple servers. looking at their solution for this is useful. I have done such a thing myself before a while back. a branch utilising boost-mpi exists for cluc

Re: [CLucene-dev] parallel searching

2010-09-02 Thread suman holani
Thanks Ben for quick reply. I read somewhere , Nutch uses mapper and reducer to do so...but really donno how to go abt it. On net I am not able to find gud papers related to it. If you could provide me the links where I can find more detail abt it.That would be helpful has parallel multi sear

Re: [CLucene-dev] parallel searching

2010-09-02 Thread Ben van Klinken
First of all have a look at the mpi branch ofclucene. It achieves the distributed searches. Nutch is a project which I know does this sort of thing u r looking at, so I look at the theories of that project may give u some good ideas. Good luck and please let us knowhow you go ben On Thursday, S