Re: Hadoop RPC for distributed Lucene

In terms of a grid system for Lucene. One model that might be compelling is using a Hadoop RPC + Serialization system to implement both the Searchable side and an Indexing side. I personally think it would be interesting to implement code mobility like Jini and RMI for Lucene. This would have se

Re: Hadoop RPC for distributed Lucene

I believe Hadoop RPC was originally built for distributed search for Nutch. Here's some core code I think Nutch still uses http://svn.apache.org/viewvc/lucene/nu

Re: Hadoop RPC for distributed Lucene

I believe Hadoop RPC was originally built for distributed search for Nutch. Here's some core code I think Nutch still uses http://svn.apache.org/viewvc/lucene/nutch/trunk/src/java/org/apache/nutch/searcher/DistributedSearch.java?revision=619648&view=markup One thing I wanted to add to the original

Re: Hadoop RPC for distributed Lucene

I believe there is a subproject over at Hadoop for doing distributed stuff w/ Lucene, but I am not sure if they are doing search side, only indexing. I was always under the impression that it was too slow for search side, as I don't think Nutch even uses it for the search side of the equat