Re: searching documents in solr
Thank you for your reply. let me clarify that I am trying to do a wildcard search. There are documents with title ( title is default search field ) new1, new2, new3 searching new* will return all three posts but searching whereas *new1 returns no document, when it should return at-least one document with title new1. Here is output of the solr ( I am searching from admin area of solr ) response lst name=responseHeader int name=status0/int int name=QTime1/int lst name=params str name=indenton/str str name=start0/str str name=q*new1/str str name=version2.2/str str name=rows10/str /lst /lst result name=response numFound=0 start=0/ /response Any ideas? -- View this message in context: http://lucene.472066.n3.nabble.com/searching-documents-in-solr-tp844800p847339.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: searching documents in solr
Here is my schema.xml file http://lucene.472066.n3.nabble.com/file/n847355/schema.xml schema.xml -- View this message in context: http://lucene.472066.n3.nabble.com/searching-documents-in-solr-tp844800p847355.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Any realtime indexing plugin available for SOLR
If it is your app that is updating data in the DB, then you could have it update Solr at the same time Regards Stefan Maric -Original Message- From: bbarani [mailto:bbar...@gmail.com] Sent: Wednesday, May 26, 2010 10:39 AM To: solr-user@lucene.apache.org Subject: Any realtime indexing plugin available for SOLR Hi, Sorry if I am asking this question again in this forum.. Is there any plugin which I can use to do a realtime indexing? I have a requirement where we have an application which sits on top of SQL server DB and updates happen on day to day basis. Users would like to see the changes made to the DB immediately in the search results. I am thinking of using JMS queue for achieving this, but before that I just want to check if anyone has implemented similar kind of requirement before? Any help / suggestions would be greatly appreciated. Thanks, bb -- View this message in context: http://lucene.472066.n3.nabble.com/Any-realtime-indexing-plugin-available-for-SOLR-tp845026p845026.html Sent from the Solr - User mailing list archive at Nabble.com.
Help with query boosting syntax
Hi there, I am struggling with the syntax for boosting. My scenario is that we have an algorithm that gives weightings to particular keywords. When a person searches for keywords eg value1 value2 value3 we want to apply boosting so that a document is boosted according to which of the keywords it has. eg of url : q=value1^4.0 OR value2^2.0 OR value3 However this is not working. I tried bq eg: qt=KeywordSearchbq=keyword:value1^4.0 OR value2^2.0 but I just don't seem to be getting the results I am looking for. I have a requesthandler set up to just search on our Keyword column which is a multivalued field. I am using a nightly build of SOLR 1.4 from September 2009. Can anyone help me with the correct syntax?? Please? Thanks in advance Kirsty -- View this message in context: http://lucene.472066.n3.nabble.com/Help-with-query-boosting-syntax-tp847398p847398.html Sent from the Solr - User mailing list archive at Nabble.com.
Help with PatternReplaceFilterFactory
Hi, I have a field that is a text field eg: R500,000-550,000 Per Annum, R350,000-550,000 Per Annum Cost To Company etc. I would like to facet on the salary range. I have created a new field type fieldType name=remuneration class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / filter class=solr.PatternReplaceFilterFactory pattern=([a-z]) replacement= replace=all / /analyzer /fieldType to remove all the letters. I have to two fields like this: field name=Remuneration type=string indexed=true stored=true/ field name=Remuneration_strip type=remuneration indexed=true stored=true/ And then the copy field: copyField source=Remuneration dest=Remuneration_strip/ But my index still has all the text. Am I misunderstanding? Where have I gone wrong? Any help would be greatly appreciated! Kirsty -- View this message in context: http://lucene.472066.n3.nabble.com/Help-with-PatternReplaceFilterFactory-tp847408p847408.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Help with query boosting syntax
kirsty wrote: Hi there, I am struggling with the syntax for boosting. My scenario is that we have an algorithm that gives weightings to particular keywords. When a person searches for keywords eg value1 value2 value3 we want to apply boosting so that a document is boosted according to which of the keywords it has. eg of url : q=value1^4.0 OR value2^2.0 OR value3 However this is not working. I tried bq eg: qt=KeywordSearchbq=keyword:value1^4.0 OR value2^2.0 but I just don't seem to be getting the results I am looking for. I have a requesthandler set up to just search on our Keyword column which is a multivalued field. I am using a nightly build of SOLR 1.4 from September 2009. Can anyone help me with the correct syntax?? Please? Thanks in advance Kirsty UPDATE: I have managed to get this syntax working select/?qt=KeywordSearchq=greenpointbq=Keyword:work^1.5bq=Keyword:Pigalle^1.2 But this just seems quite cumbersome having to specify a bq each time. Also I cannot get more than one q= to work. -- View this message in context: http://lucene.472066.n3.nabble.com/Help-with-query-boosting-syntax-tp847398p847444.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Machine utilization while indexing
Sorry I missed it in the solrconfig.xml (my bad). I wasn't looking for it in the right place. Thijs On 27-5-2010 6:41, Chris Hostetter wrote: : So now I wonder why BinaryRequestWriter (and BinaryUpdateRequestHandler) : aren't turned on by default. (eps considering some threads on the dev-list I don't really understand this question -- the BinaryUpdateRequestHandler is registered with the path /update/javabin in the example solrconfig.xml -- that's about as close to turning something on by default as solr supports. -Hoss
solr.solr.home
Hi to everyone, I'm really sorry for the s3tupid question I'm doing, but I didn't understand how to set the java system property solr.solr.home to my solr home. Can someone help me ? Thanks in advanca
RE: solr.solr.home
* Set the java system property solr.solr.home to your solr home. (On linux - use something like export solr.solr.home=/my/solr/home. On Windows - see http://vlaurie.com/computers2/Articles/environment.htm to set an environment variable named solr.solr.home .) (You can also use the two other options from the wiki page:) * Configure the servlet container such that a JNDI lookup of java:comp/env/solr/home by the solr webapp will point to the solr home. * The default solr home is solr under the JVM's current working directory ($CWD/solr), so start the servlet container in the directory containing ./solr -Original Message- From: Antonello Mangone [mailto:antonello.mang...@gmail.com] Sent: Thursday, May 27, 2010 11:30 AM To: solr-user@lucene.apache.org Subject: solr.solr.home Hi to everyone, I'm really sorry for the s3tupid question I'm doing, but I didn't understand how to set the java system property solr.solr.home to my solr home. Can someone help me ? Thanks in advanca
Re: solr.solr.home
On 05/27/2010 10:30 AM, Antonello Mangone wrote: Hi to everyone, I'm really sorry for the s3tupid question I'm doing, but I didn't understand how to set the java system property solr.solr.home to my solr home. Can someone help me ? Thanks in advanca it should be something like System.setProperty(solr.solr.home, whateverpathyou'dliketosetonyourfilesystem); Claudio
Re: solr.solr.home
But where I have to write this command ??? System.setProperty(solr.solr.home, whateverpathyou'dliketosetonyourfilesystem); Claudio
Re: solr.solr.home
Hi, When you start the tomcat, you can specify the properties, it will be something like this -Dsolr.solr.home=path/to/your/solr/home. For example, in linux ./startup.sh -Dsolr.solr.home=path/to/your/solr/home Marco Martínez Bautista http://www.paradigmatecnologico.com Avenida de Europa, 26. Ática 5. 3ª Planta 28224 Pozuelo de Alarcón Tel.: 91 352 59 42 2010/5/27 Antonello Mangone antonello.mang...@gmail.com But where I have to write this command ??? System.setProperty(solr.solr.home, whateverpathyou'dliketosetonyourfilesystem); Claudio
Re: Highlighting questions
Just set the pre and post tags to be empty strings and you'll get the result you want, I think. No? Erik On May 26, 2010, at 8:36 PM, Blargy wrote: What are the correct for settings to get highlighting excerpting working? Original Text: The quick brown fox jumps over the lazy dog Query: jump Result: fox jumps over Can you do something like the above with the highlighter or can it only surround matches with pre and post tags? Can someone explain what mergeContinuous does? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Highlighting-questions-tp846628p846628.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Any realtime indexing plugin available for SOLR
On May 26, 2010, at 11:29 AM, Dennis Gearon wrote: I thought that if entries were COMMITed to the index, they were immediately visible? Is this true, or am I smoking Java coffee beans? They're visible after a commit AND warming are complete, yes. But there could be a potentially substantial delay between a commit message being sent and the new documents actually searchable. Erik
Re: Help with PatternReplaceFilterFactory
(10/05/27 16:11), kirsty wrote: Hi, I have a field that is a text field eg: R500,000-550,000 Per Annum, R350,000-550,000 Per Annum Cost To Company etc. I would like to facet on the salary range. I have created a new field type fieldType name=remuneration class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / filter class=solr.PatternReplaceFilterFactory pattern=([a-z]) replacement= replace=all / /analyzer /fieldType to remove all the letters. I have to two fields like this: field name=Remuneration type=string indexed=true stored=true/ field name=Remuneration_strip type=remuneration indexed=true stored=true/ And then the copy field: copyField source=Remuneration dest=Remuneration_strip/ But my index still has all the text. Am I misunderstanding? Where have I gone wrong? Any help would be greatly appreciated! Kirsty What do you mean by my index still has all the text ? With your schema above, I think you can get a facet result eg: lst name=facet_fields lst name=Remuneration_strip int name=350,000-550,000 1/int int name=500,000-550,000 1/int /lst /lst when you request q=*:*facet=onfacet.field=Remuneration_strip Koji -- http://www.rondhuit.com/en/
Re: Help with PatternReplaceFilterFactory
Koji Sekiguchi wrote: (10/05/27 16:11), kirsty wrote: Hi, I have a field that is a text field eg: R500,000-550,000 Per Annum, R350,000-550,000 Per Annum Cost To Company etc. I would like to facet on the salary range. I have created a new field type fieldType name=remuneration class=solr.TextField sortMissingLast=true omitNorms=true analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / filter class=solr.TrimFilterFactory / filter class=solr.PatternReplaceFilterFactory pattern=([a-z]) replacement= replace=all / /analyzer /fieldType to remove all the letters. I have to two fields like this: field name=Remuneration type=string indexed=true stored=true/ field name=Remuneration_strip type=remuneration indexed=true stored=true/ And then the copy field: copyField source=Remuneration dest=Remuneration_strip/ But my index still has all the text. Am I misunderstanding? Where have I gone wrong? Any help would be greatly appreciated! Kirsty What do you mean by my index still has all the text ? With your schema above, I think you can get a facet result eg: lst name=facet_fields lst name=Remuneration_strip int name=350,000-550,000 1/int int name=500,000-550,000 1/int /lst /lst when you request q=*:*facet=onfacet.field=Remuneration_strip Koji -- http://www.rondhuit.com/en/ Yes you are right, I get that type of result. I guess my wording was wrong. My field looks like this in the index: str name=RemunerationR500,000-550,000 Per Annum/str str name=Remuneration_stripR500,000-550,000 Per Annum/str How would I search for say salaries in the range of 500,000 - 550,000? Trying fq=Rumeration_strip:500,000-550,00 doesn't bring back anything. I must have something wrong. -- View this message in context: http://lucene.472066.n3.nabble.com/Help-with-PatternReplaceFilterFactory-tp847408p848078.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Help with PatternReplaceFilterFactory
Yes you are right, I get that type of result. I guess my wording was wrong. My field looks like this in the index: str name=RemunerationR500,000-550,000 Per Annum/str str name=Remuneration_stripR500,000-550,000 Per Annum/str How would I search for say salaries in the range of 500,000 - 550,000? Trying fq=Rumeration_strip:500,000-550,00 doesn't bring back anything. I must have something wrong. So you are not asking facet... For query syntax of range search, take a look at: http://lucene.apache.org/java/2_9_1/queryparsersyntax.html#Range%20Searches And you need to index the lower and upper salary to separate fields i.e. low:50 up:55 Then you can search the both of the fields e.g. q=low:[50 TO *] AND up:[* TO 55] Koji -- http://www.rondhuit.com/en/
multicore Vs multiple solr webapps
Hi to all, I have a question for you ... Can someone exaplain me the differences between a unique solr application multicore and multiple solr webapps ??? Thank you all in advance
Re: Need guidance on schema type
There will never be any need to search the actual HTML (tags, markup, etc) so as far as functionality goes it seems like the DIH HTMLStripTransformer is the way to go. Are there any significant performance differences between the two? -- View this message in context: http://lucene.472066.n3.nabble.com/Need-guidance-on-schema-type-tp846923p848874.html Sent from the Solr - User mailing list archive at Nabble.com.
Generic questions
Can someone explain to be what the state of Solr/Lucene is... didn't they recently combine? I know I am running version 1.4 but I keep seeing version numbers out there that are 3.0, 4.0??? Can someone explain what that means. Also is the state of trunk (1.4 or 4.0??) good enough for production use? Thanks! -- View this message in context: http://lucene.472066.n3.nabble.com/Generic-questions-tp848917p848917.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Generic questions
On Thu, May 27, 2010 at 12:48 PM, Blargy zman...@hotmail.com wrote: Can someone explain to be what the state of Solr/Lucene is... didn't they recently combine? Yes, it started in March. Development is combined (committers, dev list, etc), but separate downloads and user lists will remain. I know I am running version 1.4 but I keep seeing version numbers out there that are 3.0, 4.0??? Can someone explain what that means. Lots of other stuff has changed. For example, trunk is now always the next *major* version number. So the trunk of the combined lucene/solr is 4.0-dev There is now a branch_3x that is like trunk for all future 3.x releases. The next version of Solr will probably be 3.1, and it's unlikely there will ever be a 1.5 released. Also is the state of trunk (1.4 or 4.0??) good enough for production use? Yes, Lucene/Solr aims for a stable trunk (runtime stability, not API stability). Plenty of big companies use trunk since they need recent features. Just be sure to test well (good advice even if working off of officially released versions). -Yonik http://www.lucidimagination.com
Re: Generic questions
Yonik Seeley-2-2 wrote: Lots of other stuff has changed. For example, trunk is now always the next *major* version number. So the trunk of the combined lucene/solr is 4.0-dev There is now a branch_3x that is like trunk for all future 3.x releases. The next version of Solr will probably be 3.1, and it's unlikely there will ever be a 1.5 released. Wait.. what? Now, im more confused What version is (http://svn.apache.org/repos/asf/lucene/dev/trunk/)? Im guessing its 4.0-dev but then where does 3.1 fit in? Say I am running 1.4 and want to upgrade, which version should I use? If I want to use a patch that has a fix version of 1.5 which should I be using? (https://issues.apache.org/jira/browse/SOLR-1316). Thanks again -- View this message in context: http://lucene.472066.n3.nabble.com/Generic-questions-tp848917p849161.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Generic questions
On Thu, May 27, 2010 at 2:12 PM, Blargy zman...@hotmail.com wrote: What version is (http://svn.apache.org/repos/asf/lucene/dev/trunk/)? Im guessing its 4.0-dev Yes. but then where does 3.1 fit in? http://svn.apache.org/repos/asf/lucene/dev/branches/branch_3x/ Say I am running 1.4 and want to upgrade, which version should I use? If I want to use a patch that has a fix version of 1.5 which should I be using? (https://issues.apache.org/jira/browse/SOLR-1316). Patches in SVN are not official and not guaranteed to work (or even patch correctly) to any version. You need to look at the specific patch to see what svn path it is relative to, and how old it is. -Yonik http://www.lucidimagination.com
Re: multicore Vs multiple solr webapps
The two approaches solve different needs. In 'multicore' you have a single webapp with multiple indexes. This means they are all running in the same JVM. This may be an advantage or a disadvantage depending on what you are doing. ryan On Thu, May 27, 2010 at 10:44 AM, Antonello Mangone antonello.mang...@gmail.com wrote: Hi to all, I have a question for you ... Can someone exaplain me the differences between a unique solr application multicore and multiple solr webapps ??? Thank you all in advance
Sites with Innovative Presentation of Tags and Facets
I'm a big fan of plain old text facets (or tags), displayed in some logical order, perhaps with a bit of indenting to help convey context. But as you may have noticed, I don't rule the world. :-) Suppose you took the opposite approach, rending facets in non-traditional ways, that were still functional, and not ugly. Are there any pubic sites that come to mind that are displaying facets, tags, clusters, taxonomies or other navigators in really innovative ways? And what you liked / didn't like? Right now I'm just looking for examples of what's been tried. I suppose even bad examples might be educational. My future ideal wish list: * Stays out of the way (of casual users) * Looks clean and cool (to the power users) I'm thinking for example a light gray chevron that casual users don't notice, but when you click on it, cool things come up? * Probably that does not require Flash or SilverLight (just to avoid the whole platform wars) I guess that means Ajax or HTML5 * And since I'm doing pie in the sky, can be made to look good on desktops and mobile Some examples to get the ball rolling: StackOverflow, Flickr and YouTube, Clusty(now Yippy) are all nice, but a bit pedestrian for my mission today. (grokker was cool too) Lucid has done a nice job with Facets and Solr: http://www.lucidimagination.com/search/ And although I really like it, it's not a flashy enough specimen for what I'm hunting today. (and they should thread the actual results list) I did some mockups of 2.0 style search navigators a couple years back: http://www.ideaeng.com/tabId/98/itemId/115/Search-20-in-the-Enterprise-Moving-Beyond-Singl.aspx Though these were intentionally NOT derived from specific web sites. Digg has done some cool stuff, for example: http://labs.digg.com/365/ http://labs.digg.com/arc/ http://labs.digg.com/stack/ But for what I'm after, these are a bit too far off of the searching for something in particular track. Google Image Swirl and Similar Images are interesting, but for images. Lots of other cool stuff at labs.google.com Amazon, NewEgg, etc are all fine, but again text based. TouchGraph has some cool stuff, though very non-linear (many others on this theme) http://www.touchgraph.com/TGGoogleBrowser.html http://www.touchgraph.com/navigator.html Cool articles on the subject: (some examples now offline) http://www.cs.umd.edu/class/spring2005/cmsc838s/viz4all/viz4all_a.html -- Mark Bennett / New Idea Engineering, Inc. / mbenn...@ideaeng.com Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513
Re: Sites with Innovative Presentation of Tags and Facets
Something like sliders perhaps? Of course only numerical ranges can be put into sliders. (or a concept that may be logically presented as some sort of ordening, such as bad, hmm, good, great Use Solr's Statscomponent to show the min and max values Have a look at tripadvisor.com for good uses/implementation of sliders (price, and reviewscore are presented as sliders) my 2c: try to make the possible input values discrete (like at tripadvisor) which gives a better user experience and limits the potential nr of queries (cache-wise advantage) Cheers, Geert-Jan 2010/5/27 Mark Bennett mbenn...@ideaeng.com I'm a big fan of plain old text facets (or tags), displayed in some logical order, perhaps with a bit of indenting to help convey context. But as you may have noticed, I don't rule the world. :-) Suppose you took the opposite approach, rending facets in non-traditional ways, that were still functional, and not ugly. Are there any pubic sites that come to mind that are displaying facets, tags, clusters, taxonomies or other navigators in really innovative ways? And what you liked / didn't like? Right now I'm just looking for examples of what's been tried. I suppose even bad examples might be educational. My future ideal wish list: * Stays out of the way (of casual users) * Looks clean and cool (to the power users) I'm thinking for example a light gray chevron that casual users don't notice, but when you click on it, cool things come up? * Probably that does not require Flash or SilverLight (just to avoid the whole platform wars) I guess that means Ajax or HTML5 * And since I'm doing pie in the sky, can be made to look good on desktops and mobile Some examples to get the ball rolling: StackOverflow, Flickr and YouTube, Clusty(now Yippy) are all nice, but a bit pedestrian for my mission today. (grokker was cool too) Lucid has done a nice job with Facets and Solr: http://www.lucidimagination.com/search/ And although I really like it, it's not a flashy enough specimen for what I'm hunting today. (and they should thread the actual results list) I did some mockups of 2.0 style search navigators a couple years back: http://www.ideaeng.com/tabId/98/itemId/115/Search-20-in-the-Enterprise-Moving-Beyond-Singl.aspx Though these were intentionally NOT derived from specific web sites. Digg has done some cool stuff, for example: http://labs.digg.com/365/ http://labs.digg.com/arc/ http://labs.digg.com/stack/ But for what I'm after, these are a bit too far off of the searching for something in particular track. Google Image Swirl and Similar Images are interesting, but for images. Lots of other cool stuff at labs.google.com Amazon, NewEgg, etc are all fine, but again text based. TouchGraph has some cool stuff, though very non-linear (many others on this theme) http://www.touchgraph.com/TGGoogleBrowser.html http://www.touchgraph.com/navigator.html Cool articles on the subject: (some examples now offline) http://www.cs.umd.edu/class/spring2005/cmsc838s/viz4all/viz4all_a.html -- Mark Bennett / New Idea Engineering, Inc. / mbenn...@ideaeng.com Direct: 408-733-0387 / Main: 866-IDEA-ENG / Cell: 408-829-6513
Does SOLR Allow q= (A or B) AND (C or D)?
Hi all, I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B A C B C B D Can anyone provide guidance as to how to implement this in the query string? thanks Brad
Re: Sites with Innovative Presentation of Tags and Facets
On 27.05.2010, at 23:32, Geert-Jan Brits wrote: Something like sliders perhaps? Of course only numerical ranges can be put into sliders. (or a concept that may be logically presented as some sort of ordening, such as bad, hmm, good, great Use Solr's Statscomponent to show the min and max values Have a look at tripadvisor.com for good uses/implementation of sliders (price, and reviewscore are presented as sliders) my 2c: try to make the possible input values discrete (like at tripadvisor) which gives a better user experience and limits the potential nr of queries (cache-wise advantage) yeah i have been pondering something similar. but i now realized that this way the user doesnt get an overview of the distribution without actually applying the filter. that being said, it would be nice to display 3 numbers with the silders, the count of items that were filtered out on the lower and upper boundaries as well as the number of items still left (*). aside from this i just put a little tweak to my facetting online: http://search.un-informed.org/search?q=malariatm=anys=Search if you deselect any of the checkboxes, it updates the counts. however i display both the count without and with those additional checkbox filters applied (actually i only display two numbers of they are not the same): http://screencast.com/t/MWUzYWZkY2Yt regards, Lukas Kahwe Smith m...@pooteeweet.org (*) if anyone has a slider that can do the above i would love to integrate that and replace the adoption year checkboxes with that
Re: searching documents in solr
Leading wildcards don't work. word* is supported word? is supported word*x or word?x should be supported, but something strange happens involving boolean queries. On Wed, May 26, 2010 at 11:31 PM, dotriz muhammad.riz...@sigmatec.com.pk wrote: Here is my schema.xml file http://lucene.472066.n3.nabble.com/file/n847355/schema.xml schema.xml -- View this message in context: http://lucene.472066.n3.nabble.com/searching-documents-in-solr-tp844800p847355.html Sent from the Solr - User mailing list archive at Nabble.com. -- Lance Norskog goks...@gmail.com
Solr trunk and Jetty threadpool implementation problem
I'd like to warn people about the default configuration of Jetty in the Solr trunk release (not present in Solr 1.4 and prior). There is a difference in the jetty configuration which is for the latest Solr to use the QueuedThreadPool (as seen in jetty.xml). Previously, it had used a BoundedThreadPool implementation that I've heard is considered deprecated presently. I have a multi-core setup where Jetty is serving up lots of Solr cores 9+ and when our client does a distributed search (3 of them at a time actually), it triggers a condition in which the query takes 50 plus seconds to respond. During this time, the machine is effectively idle, seemingly waiting for something. To fix this, go back to the former BoundedThreadPool implementation or don't use Jetty. FWIW this has triggered us to swtich to Tomcat. Sorry but I have sunk so much resources into tracking down this nasty problem that I can't spend much more on further figuring out why QueuedThreadPool is failing us. ~ David Smiley Author: http://www.packtpub.com/solr-1-4-enterprise-search-server/
Re: Does SOLR Allow q= (A or B) AND (C or D)?
On Thu, May 27, 2010 at 5:34 PM, efr...@gmail.com efr...@gmail.com wrote: Hi all, I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B (sorry meant A D) A C B C B D Can anyone provide guidance as to how to implement this in the query string? thanks Brad
Re: Does SOLR Allow q= (A or B) AND (C or D)?
I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B A C B C B D Can anyone provide guidance as to how to implement this in the query string? It should be something like : q=+(A B) +(C D)q.op=OR
Re: Any realtime indexing plugin available for SOLR
Funny enough, I've been looking for my own solution too. The Zoie plugin does not work on multi-core setups, so that's bust for me. Once you commit something to index, you need to warm a new searcher (load all the data from disk into memory/cache) like Erik says. On a smaller index, this is very very quick, however on a larger index, not so much. Solr 1.5 will (hopefully) have a new feature that will allow for near real time searching. Check this out: http://wiki.apache.org/solr/NearRealtimeSearch On May 27, 2010, at 6:00 AM, Erik Hatcher wrote: On May 26, 2010, at 11:29 AM, Dennis Gearon wrote: I thought that if entries were COMMITed to the index, they were immediately visible? Is this true, or am I smoking Java coffee beans? They're visible after a commit AND warming are complete, yes. But there could be a potentially substantial delay between a commit message being sent and the new documents actually searchable. Erik --- Antonio Lobato Symplicity Corporation www.symplicity.com (703) 351-0200 x 8101 alob...@symplicity.com
Re: Sites with Innovative Presentation of Tags and Facets
Perhaps you could show the 'nr of items left' as a tooltip of sorts when the user actually drags the slider. If the user doesn't drag (or hovers over ) the slider 'nr of items left' isn't shown. Moreover, initially a slider doesn't limit the results so 'nr of items left' shown for the slider would be the same as the overall number of items left (thereby being redundant) I must say I haven't seen this been implemented but it would be rather easy to adapt a slider implementation, to show the nr on drag/ hover. (they exit for jquery, scriptaculous and a bunch of other libs) Geert-Jan 2010/5/27 Lukas Kahwe Smith m...@pooteeweet.org On 27.05.2010, at 23:32, Geert-Jan Brits wrote: Something like sliders perhaps? Of course only numerical ranges can be put into sliders. (or a concept that may be logically presented as some sort of ordening, such as bad, hmm, good, great Use Solr's Statscomponent to show the min and max values Have a look at tripadvisor.com for good uses/implementation of sliders (price, and reviewscore are presented as sliders) my 2c: try to make the possible input values discrete (like at tripadvisor) which gives a better user experience and limits the potential nr of queries (cache-wise advantage) yeah i have been pondering something similar. but i now realized that this way the user doesnt get an overview of the distribution without actually applying the filter. that being said, it would be nice to display 3 numbers with the silders, the count of items that were filtered out on the lower and upper boundaries as well as the number of items still left (*). aside from this i just put a little tweak to my facetting online: http://search.un-informed.org/search?q=malariatm=anys=Search if you deselect any of the checkboxes, it updates the counts. however i display both the count without and with those additional checkbox filters applied (actually i only display two numbers of they are not the same): http://screencast.com/t/MWUzYWZkY2Yt regards, Lukas Kahwe Smith m...@pooteeweet.org (*) if anyone has a slider that can do the above i would love to integrate that and replace the adoption year checkboxes with that
Re: Generic question on Query Analyzers
How do we make sure that when searches for terms like AM does not match docs which have some thing like 5a.m etc On analysis in admin page, it looks like WordDelimiterFilterFactory, is splitting on , how can i make it work so that i can use features of word delimiter as well make sure certain words like AM, DB etc does not split. With a custom FilterFactory http://search-lucene.com/m/q2RH1102fRb1/
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Thank you. That seems to be working well, except when I included a wild card for any of the terms, the wildcard term isn't being found out. My searches are actually: q=+(A A*) +(C C*)q.op=OR When I do a regular search on A* or C* I get matches but not in the context of the above query. The ability to use wildcards seems to get lost. This is all for the purposes of a live search in which we return matches as the user types, thus the wildcard. A and C represent two different terms a user has typed in the search box (where we are providing the live-search results). thanks Brad On Thu, May 27, 2010 at 5:47 PM, Ahmet Arslan iori...@yahoo.com wrote: I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B A C B C B D Can anyone provide guidance as to how to implement this in the query string? It should be something like : q=+(A B) +(C D)q.op=OR
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Thank you. That seems to be working well, except when I included a wild card for any of the terms, the wildcard term isn't being found out. My searches are actually: q=+(A A*) +(C C*)q.op=OR When I do a regular search on A* or C* I get matches but not in the context of the above query. The ability to use wildcards seems to get lost. This is all for the purposes of a live search in which we return matches as the user types, thus the wildcard. A and C represent two different terms a user has typed in the search box (where we are providing the live-search results). Looks like you are looking for auto-suggest/complete feature. As the user types something there will be ajax suggestions right? Queries A* or C* are not sorted by score/relevance. Can you explain in more detail what do you mean by search on A* or C* I get matches but not in the context of the above query
Re: Does SOLR Allow q= (A or B) AND (C or D)?
You can get a lot of mileage out of the admin analysis page and the full interface page, especially by turning on the debug option on the admin full interface page. It takes a bit of practice to read the debug output, but it's really, really, really worth it Best Erick On Thu, May 27, 2010 at 6:37 PM, efr...@gmail.com efr...@gmail.com wrote: Thank you. That seems to be working well, except when I included a wild card for any of the terms, the wildcard term isn't being found out. My searches are actually: q=+(A A*) +(C C*)q.op=OR When I do a regular search on A* or C* I get matches but not in the context of the above query. The ability to use wildcards seems to get lost. This is all for the purposes of a live search in which we return matches as the user types, thus the wildcard. A and C represent two different terms a user has typed in the search box (where we are providing the live-search results). thanks Brad On Thu, May 27, 2010 at 5:47 PM, Ahmet Arslan iori...@yahoo.com wrote: I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B A C B C B D Can anyone provide guidance as to how to implement this in the query string? It should be something like : q=+(A B) +(C D)q.op=OR
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Hi Ahmet, Thanks for the response again. The best way I could illustrate our live search feature is an example implementation: http://www.krop.com/ Notice when you search the word senior in the keywords field, the results filter down to just the job postings with that word in it. So it's not the same as an autocomplete type feature where as the user types in the search input box, their input is completed. We are just focusing on providing results with each key stroke. If the user types Ca, we will return anything with Cat in it. Thus we need the wildcard. As of now we send a query to solr of Ca*. However, solr can struggle with wildcards where it won't return a match on a word if there is a wildcard at the end of a fully-typed word. You have to leave off the last letter of that word and an asterisk to match it. We're attempting to do an OR search of the term OR term* anytime a user enters a term. Our need mix these or searches with an AND command is because if a user types two words, we are requiring both words be in the result to have a match. Your suggestion as how to do this worked beautifully, except for the fact that it didn't seem to be able to find wildcarded terms when indeed it should have. thanks Brad On Thu, May 27, 2010 at 6:57 PM, Ahmet Arslan iori...@yahoo.com wrote: Thank you. That seems to be working well, except when I included a wild card for any of the terms, the wildcard term isn't being found out. My searches are actually: q=+(A A*) +(C C*)q.op=OR When I do a regular search on A* or C* I get matches but not in the context of the above query. The ability to use wildcards seems to get lost. This is all for the purposes of a live search in which we return matches as the user types, thus the wildcard. A and C represent two different terms a user has typed in the search box (where we are providing the live-search results). Looks like you are looking for auto-suggest/complete feature. As the user types something there will be ajax suggestions right? Queries A* or C* are not sorted by score/relevance. Can you explain in more detail what do you mean by search on A* or C* I get matches but not in the context of the above query
highlighting broken for multivalued text fields?
Hi, I want to verify a bug if someone can help. I have a text field: field name=text_t type=textindexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true/ I use to store text that I highlight on. If the field contains more than one text value, highlighting does not seem to work. No highlights are returned, even though the text exists in one of the field values returned from the query. Am I missing a flag or is this a bug? thanks, Darren
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Thanks for the response again. The best way I could illustrate our live search feature is an example implementation: http://www.krop.com/ Notice when you search the word senior in the keywords field, the results filter down to just the job postings with that word in it. So it's not the same as an autocomplete type feature where as the user types in the search input box, their input is completed. We are just focusing on providing results with each key stroke. If the user types Ca, we will return anything with Cat in it. Thus we need the wildcard. As of now we send a query to solr of Ca*. However, solr can struggle with wildcards where it won't return a match on a word if there is a wildcard at the end of a fully-typed word. You have to leave off the last letter of that word and an asterisk to match it. Okey i was referring the same. Each keystroke will return results. There are many way to achieve this. Are you going to suggest from index/documents or from coming queries? I mean do you have a separate index to capture most popular searches? We're attempting to do an OR search of the term OR term* anytime a user enters a term. term* is super set of term so you need to include/OR term in your query. Our need mix these or searches with an AND command is because if a user types two words, we are requiring both words be in the result to have a match. generally two ways: using wildcards on shingles (ShingleFilterFactory) or using EdgeNGramFilterFactory can deal two or more words Do you mind the order of words use types? Suggestions should come in order that the user types?
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Thanks, I found full interface :) On Thu, May 27, 2010 at 7:12 PM, Erick Erickson erickerick...@gmail.comwrote: You can get a lot of mileage out of the admin analysis page and the full interface page, especially by turning on the debug option on the admin full interface page. It takes a bit of practice to read the debug output, but it's really, really, really worth it Best Erick On Thu, May 27, 2010 at 6:37 PM, efr...@gmail.com efr...@gmail.com wrote: Thank you. That seems to be working well, except when I included a wild card for any of the terms, the wildcard term isn't being found out. My searches are actually: q=+(A A*) +(C C*)q.op=OR When I do a regular search on A* or C* I get matches but not in the context of the above query. The ability to use wildcards seems to get lost. This is all for the purposes of a live search in which we return matches as the user types, thus the wildcard. A and C represent two different terms a user has typed in the search box (where we are providing the live-search results). thanks Brad On Thu, May 27, 2010 at 5:47 PM, Ahmet Arslan iori...@yahoo.com wrote: I have a query need that requires multiple OR conditions, and, there must be a match in each condition for the query to provide a result. The search would be * (A or B) AND (C or D)* and the only valid results it could turn up are: A B A C B C B D Can anyone provide guidance as to how to implement this in the query string? It should be something like : q=+(A B) +(C D)q.op=OR
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Responses in blue On Thu, May 27, 2010 at 7:32 PM, Ahmet Arslan iori...@yahoo.com wrote: Thanks for the response again. The best way I could illustrate our live search feature is an example implementation: http://www.krop.com/ Notice when you search the word senior in the keywords field, the results filter down to just the job postings with that word in it. So it's not the same as an autocomplete type feature where as the user types in the search input box, their input is completed. We are just focusing on providing results with each key stroke. If the user types Ca, we will return anything with Cat in it. Thus we need the wildcard. As of now we send a query to solr of Ca*. However, solr can struggle with wildcards where it won't return a match on a word if there is a wildcard at the end of a fully-typed word. You have to leave off the last letter of that word and an asterisk to match it. Okey i was referring the same. Each keystroke will return results. There are many way to achieve this. Are you going to suggest from index/documents or from coming queries? I mean do you have a separate index to capture most popular searches? We do not have a seperate index to capture most popular searches (is that coming queries?) We're attempting to do an OR search of the term OR term* anytime a user enters a term. term* is super set of term so you need to include/OR term in your query. Thanks... Our need mix these or searches with an AND command is because if a user types two words, we are requiring both words be in the result to have a match. generally two ways: using wildcards on shingles (ShingleFilterFactory) or using EdgeNGramFilterFactory can deal two or more words Do you mind the order of words use types? Suggestions should come in order that the user types? We don't mind the order of terms. We basically are sorting by two variables that are independent of relevency. So I would assume the order doesn't matter... we just need to make sure any results we filter down to (as you saw in the krop.com example) contain the words the user has typed.
Re: Does SOLR Allow q= (A or B) AND (C or D)?
We don't mind the order of terms. We basically are sorting by two variables that are independent of relevency. So I would assume the order doesn't matter... we just need to make sure any results we filter down to (as you saw in the krop.com example) contain the words the user has typed. Lets say you have short title field and you are going to give suggest/autocomplete using this field from index and order is not important. But in this ca fieldType name=prefix_full class=solr.TextField positionIncrementGap=1 analyzer type=index tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.TrimFilterFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=1 maxGramSize=20/ /analyzer analyzer type=query tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType fieldType name=prefix_token class=solr.TextField positionIncrementGap=1 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=1 maxGramSize=20/ /analyzer You can use these two fields, populate them from your short title field copyField source=Title dest=titlePrefix/ copyField source=Title dest=titlePrefixFull/ and use normal query, (not wildcard) as the user types words q=titlePrefix:(term1 te) titlePrefixFull:term1 tedefType=luceneq.op=ORfl=Title will return you suggestions. Does this satisfy your needs? In this case you are suggesting whole title field. Or do you want to use ShingleFilterFactory with wildcard query?
Re: highlighting broken for multivalued text fields?
(10/05/28 8:16), Darren Govoni wrote: Hi, I want to verify a bug if someone can help. I have a text field: field name=text_t type=textindexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true/ I use to store text that I highlight on. If the field contains more than one text value, highlighting does not seem to work. No highlights are returned, even though the text exists in one of the field values returned from the query. Am I missing a flag or is this a bug? As long as I see your setting above, no. If you can post more information such as how you set fieldType of your text field, how look like your sample data you want to highlight and query parameters your are using, we can help you. Koji -- http://www.rondhuit.com/en/
Re: highlighting broken for multivalued text fields?
Hi Koji, Well, its quite simple. Here is the field returned from my query: fox arr name=text_t str The bird flies in the sky. /str str The quick brown fox jumped over the fence. /str /arr lst name=highlighting lst name=doc1/ /lst No highlighting. If the field only has one value The quick brown fox jumped over the fence. It works. Interestingly, the first field value has no candidate highlight. But the second appears to not be checked. Seems either a bug or my expectation of behavior is wrong. Darren On Fri, 2010-05-28 at 09:59 +0900, Koji Sekiguchi wrote: (10/05/28 8:16), Darren Govoni wrote: Hi, I want to verify a bug if someone can help. I have a text field: field name=text_t type=textindexed=true stored=true multiValued=true termVectors=true termPositions=true termOffsets=true/ I use to store text that I highlight on. If the field contains more than one text value, highlighting does not seem to work. No highlights are returned, even though the text exists in one of the field values returned from the query. Am I missing a flag or is this a bug? As long as I see your setting above, no. If you can post more information such as how you set fieldType of your text field, how look like your sample data you want to highlight and query parameters your are using, we can help you. Koji
Re: Does SOLR Allow q= (A or B) AND (C or D)?
Hi Ahmet, Thanks again for the feedback. We will be searching several fields of each object in the index (title, description, tags). The matches on keywords need to be in any of these fields and there will be no different weights. Does this affect your solution? I'm trying to understand it as best I can as I didn't set up our solr nor am I directly managing its implementation. thanks Brad On Thu, May 27, 2010 at 8:12 PM, Ahmet Arslan iori...@yahoo.com wrote: We don't mind the order of terms. We basically are sorting by two variables that are independent of relevency. So I would assume the order doesn't matter... we just need to make sure any results we filter down to (as you saw in the krop.com example) contain the words the user has typed. Lets say you have short title field and you are going to give suggest/autocomplete using this field from index and order is not important. But in this ca fieldType name=prefix_full class=solr.TextField positionIncrementGap=1 analyzer type=index tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.TrimFilterFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=1 maxGramSize=20/ /analyzer analyzer type=query tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType fieldType name=prefix_token class=solr.TextField positionIncrementGap=1 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=1 maxGramSize=20/ /analyzer You can use these two fields, populate them from your short title field copyField source=Title dest=titlePrefix/ copyField source=Title dest=titlePrefixFull/ and use normal query, (not wildcard) as the user types words q=titlePrefix:(term1 te) titlePrefixFull:term1 tedefType=luceneq.op=ORfl=Title will return you suggestions. Does this satisfy your needs? In this case you are suggesting whole title field. Or do you want to use ShingleFilterFactory with wildcard query?
NoSuchFieldError: submap
Hi, I'm trying to build from source to apply the field collapsing patch. 'Ant dist' runs just fine, no errors, but at startup I get a NoSuchFieldError: submap exception (stack trace: http://pastebin.com/NXsf0KJS ). This is before sending any requests. I don't have any 'submap' field defined anywhere. Has anyone seen this? Any ideas? Thanks, Mauricio
Re: highlighting broken for multivalued text fields?
: Hi Koji, :Well, its quite simple. Here is the field returned from my query: : fox Actually what Koji was asking for was the fieldtype/ declaration for text (you posted the field/ but not the fieldtype/ so we only have half a picture of hte settings involved) That said: the subject of this thread caught my eye, because it sounds very familiar to a known bug in 1.4 that has been fixed in svn (which i just happend to be looking at because i was cleaning up Jira) ... https://issues.apache.org/jira/browse/SOLR-1624 -Hoss
