Jerome I worked with Nutch in the past. I think Nutch and Lucene integrated into restlet would be good
ilango --- On Mon, 1/12/09, Rémi Dewitte <r...@gide.net> wrote: From: Rémi Dewitte <r...@gide.net> Subject: Re: Solr integration To: discuss@restlet.tigris.org Date: Monday, January 12, 2009, 10:38 AM Jérôme, Why not to lead the Lucene extension ! I'll do my best. I think that Lucene integration will be really handy with Semantic Web for example to index relations. Cheers, Rémi On Sun, Jan 11, 2009 at 20:37, Jerome Louvel <jerome.lou...@noelios.com> wrote: Rémi, Sounds good! Also, if you are interested (and have enough available time) to lead the whole Lucene extension, I would be happy to have you as the extension committer, with commit rights, etc. See details about development process here: http://wiki.restlet.org/developers/179-restlet/51-restlet.html?branch=docs-1_1&language=en Best regards, Jérôme Louvel -- Restlet ~ Founder and Lead developer ~ http://www.restlet.org Noelios Technologies ~ Co-founder ~ http://www.noelios.com De : remidewi...@gmail.com [mailto:remidewi...@gmail.com] De la part de Rémi Dewitte Envoyé : dimanche 11 janvier 2009 19:17 À : discuss@restlet.tigris.org Objet : Re: Solr integration Jérôme, I'll try to contribute some documentation as soon as possible and possibly look at the Tika stuff too. Have a nice week ! Rémi On Sun, Jan 11, 2009 at 17:41, Jerome Louvel <jerome.lou...@noelios.com> wrote: Hi Rémi, Sorry for the slow reply! 1) Solr support First, let me thank you for contributing this class. I went ahead and created the "org.restlet.ext.lucene" module in SVN trunk with the necessary/minimal library dependencies (for Lucene, Tika, Solr). The build has been updated to include this extension in the Restlet 1.2 distribution. You will also note that I've moved the internal classes in SolrClientHelper up one level to facilitate reuse. I've also completed the Javadocs. So, we are almost there. What is now missing is some proper user documentation. I've created a new developer page on the wiki where you and others can provide this info: "Lucene extension" http://wiki.restlet.org/developers/172-restlet/215-restlet.html Once we get the User Guide ready for Restlet 1.2, we'll migrate the user related content there. 2) Tika support In addition to the Solr client connector, I have also added a TikaRepresentation to facilitate the extraction of metadata from any representation supported by Tika parsers. Hope this helps! Best regards, Jérôme Louvel -- Restlet ~ Founder and Lead developer ~ http://www.restlet.org Noelios Technologies ~ Co-founder ~ http://www.noelios.com De : remidewi...@gmail.com [mailto:remidewi...@gmail.com] De la part de Rémi Dewitte Envoyé : mardi 30 décembre 2008 13:16 À : discuss@restlet.tigris.org Objet : Re: Solr integration Hi ! Basically it allows you to interact with solr with solr:// references the same way you would do it through http : http://wiki.apache.org/solr/SolrRequestHandler It can be seen as a way to deploy solr as a Restlet application instead of in a servlet container. I have uploaded the SolrClientHelper.java on http://restlet.tigris.org/issues/show_bug.cgi?id=697. About creating an extension, I still struggle a bit on how define dependencies to 3rd party jars. Is there a tool to create all the boilerplate in librairies/ directory from this maven dependency ? <dependency> <groupId>org.apache.solr</groupId> <artifactId>solr-core</artifactId> <version>1.3.0</version> </dependency> Regards, Rémi On Sun, Dec 28, 2008 at 13:17, Jerome Louvel <jerome.lou...@noelios.com> wrote: Hi all, Providing Lucene-based search/indexing features sounds like a generic and very useful feature. If the best way to facilitate this integration in Restlet is to leverage Solr, then we should definitely consider a new Restlet extension. I've created a RFE to track this idea: "Add support for Lucene/Solr" http://restlet.tigris.org/issues/show_bug.cgi?id=697 Rémi, could you describe how your client connector works? Which use cases does it handle? Best regards, Jérôme Louvel -- Restlet ~ Founder and Lead developer ~ http://www.restlet.org Noelios Technologies ~ Co-founder ~ http://www.noelios.com De : Ben Johnson [mailto:ben.john...@jandpconsulting.co.uk] Envoyé : vendredi 26 décembre 2008 19:23 À : discuss@restlet.tigris.org Objet : Re: Solr integration Hi Rémi I have been considering using Solr with Tika (http://lucene.grantingersoll.com/2008/12/06/tika-and-solr/) to index text-based documents - mainly PDF I think - with associated XML 'metadata' documents (which would also be indexed with Solr) via Restlet, so I would be interested in what you have come up with. I have been trying to set this up in a Geronimo-Jetty environment, but running into a few issues (such as how to deploy to Solr via the Geronimo admin web page - I'm very new to all this). From what I understand, although Tika has been integrated into Solr, it is scheduled for Solr 1.4 which has not been released yet, so I need to get the latest Solr source code and build that to get this integration - not sure if you've looked into that or not. Cheers Ben From: Rémi Dewitte Sent: Friday, December 26, 2008 1:45 PM To: discuss@restlet.tigris.org Subject: Solr integration Hello, While doing some cleanup to contribute to the authentication work, I thought I could give a restlet integration of Solr. Basically it is a ClientHelper handling "solr://..." request. I just need to know whether someone is interested in it. Cheers, Rémi ------------------------------------------------------ http://restlet.tigris.org/ds/viewMessage.do?dsForumId=4447&dsMessageId=1024263