You all convinced me to investigate the SOLR path further ;-) I already installed SOLR yesterday but I probably did not spent enough time on playing with it due to lack of time. That's why I ask the experts on this mailing list ;-)
David's answer "The facet research funtionality in Solr can give access to all possible values in the index of your data for a given property so the user can pick one among them, then find all matching data." was the missing piece of the puzzle. Thx a lot guys !! Robby -----Original Message----- From: Jeroen Reijn [mailto:j.re...@onehippo.com] Sent: Tuesday, September 08, 2009 10:45 AM To: users@cocoon.apache.org Subject: Re: how-to query an xml repository efficiently Hi Robby, in this case I even think SOLR would be a great match for this use case. You can push XML with a http client to SOLR and let SOLR index the information. See the post.jar that comes with the SOLR example. It pushes XML to the solr app and indexes it based on your configuration. The great thing is that you can even configure all kinds of facets based on what is stored in such a product file, so you can create a nice facet view in your webapp. A couple of years ago I was looking a some Forrest components [1], which were made for using SOLR from a cocooon point of view. It helps you to perform queries to a SOLR instance from your sitemap and get XML response back. Regards, Jeroen [1]http://wiki.apache.org/solr/SolrForrest Robby Pelssers wrote: > Hi jeroen and others who replied to my mail... Let me further explain > my usecase and existing infrastructure. > > My customer stores their product data in xml-files on file system > > E.g. > ${repofolder}/ > products/ > product-1/ > product-1.xml > product-1-image.jpg > ... > product-2/ > product-2.xml > product-2-image.jpg > ... > > This is a simplified representation but as you see there is no concept > of an xml database. > > Now let's start with a small fictive example for product-1.xml: > > <product> > <id>xxxx</id> > <description>grandma's cookies</description> > <category>food</category> > <price>2.0</price> > </product> > > From a functional point of view they want to be able to search for > products based on some criteria. So I'll have to build a small > searchform containing: > - Dropdown with all possible categories > - textbox to search for part of description > - price "between/ equal to / greather then / less then" search > functionality > > So for certain "Filter"-criteria I'll have to get all possible values so > they can pick one and for others I don't need to know anything about the > actual data. > > The actual product xml-files are +- 500kb on average and I'm talking > about LOTS of products so I have to consider performance upfront. > > SOLR seems good for indexing static html files etc but I don't get the > impression it can offer the necessary functionality for this use case. > > Any comments?? > > Cheers, > Robby > > > > > > -----Original Message----- > From: Jeroen Reijn [mailto:j.re...@onehippo.com] > Sent: Tuesday, September 08, 2009 9:01 AM > To: users@cocoon.apache.org > Subject: Re: how-to query an xml repository efficiently > > Hi Robby, > > do you perhaps have any more specs on what kind of XML database it is? > > At our company we have experience with an Apache Slide backed database, > which we used for storing XML files and let Slide indexed them with > Lucene. Then based on DASL queries we could search the repository really > > quickly. > > Next to DASK I know there are also XML databases that can use XQueries > to perform fast searches on their XML database. > > Regards, > > Jeroen > > Robby Pelssers wrote: >> Hi all, >> >> >> >> I have following use case. The customer has an xml repository which > is >> nothing more then a directory on filesystem which contains >> subdirectories containing one or more xml files. They now want to > query >> those xml files on some predefined criteria which might change over > time... >> >> >> I'm looking for a solution which results in high performance search > and >> some things that came to my mind was >> >> * extracting information and storing them in a database (e.g. >> HSQLDB) >> >> * using lucene >> >> >> >> Is there somewhere detailed documentation available on using these? > And >> what would you recommend for my use case? >> >> >> >> I already found some stuff but no real quick-start material. >> >> http://cocoon.apache.org/2.1/userdocs/concepts/xmlsearching.html >> >> http://cocoon.apache.org/2.2/blocks/hsqldb-client/1.0/ >> >> http://cocoon.apache.org/2.2/blocks/hsqldb-server/1.0/ >> >> >> >> Thx in advance, >> >> Robby Pelssers >> >> >> >> >> > > --------------------------------------------------------------------- > To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org > For additional commands, e-mail: users-h...@cocoon.apache.org > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org > For additional commands, e-mail: users-h...@cocoon.apache.org > --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: users-unsubscr...@cocoon.apache.org For additional commands, e-mail: users-h...@cocoon.apache.org
