Re: Two instances of solr - the same datadir?

2013-07-04 Thread Roman Chyla
I have spent lot of time in the past day playing with this setup, and made it work finally, here are few bits of interest: - solr v40 - linux, java7, local filesystem - big index, 1 RW instance + 2 RO instances (sharing the same index) lock is acquired when solr is writing data - if you happen

[Solr 4.2] deleteInstanceDir is added to CoreAdminHandler but is not supported in Unload CoreAdminRequest

2013-07-04 Thread Lyuba Romanchuk
Hi, I need to unload core with deleting instance directory of the core. According to code of Solr4.2 I don't see the support for this parameter in solrj. Is there the fix or open issue for this? Best regards, Lyuba

Re: Joins with SolrCloud

2013-07-04 Thread slevytam
Hi Yonik, Thanks for the reply. It was very helpful. This may be a newb question but will this work on a individual rows of a query or do all the queries' results need to be on the same shard. ex. if the main query would return - user15 (shard 1) - user16 (shard 2) - user17 (shard 3) is it

Re: Simple Moving Average of Query Durations

2013-07-04 Thread Alan Woodward
I started some work on https://issues.apache.org/jira/browse/SOLR-4735, which may help here. Have been pulled away onto other things, but I want to get back to it soon. Alan Woodward www.flax.co.uk On 3 Jul 2013, at 23:54, Otis Gospodnetic wrote: Hi Jan,

Re: Advice for performance issues with group.facet=true

2013-07-04 Thread Daniel Bryant
Many thanks for your response Otis - I had feared as much, but it's good to have it confirmed. Best wishes, Daniel On 03/07/2013 17:05, Otis Gospodnetic wrote: Hi, I think nobody in the community is focused on field collapsing/grouping, so I suspect there won't be a fix until somebody gets

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Furkan KAMACI
Which version of Solr you are using? 2013/7/4 Ali, Saqib docbook@gmail.com We have single Solr instance with lot of indexed document. Now we would like to move to SolrCloud implementation. Can we move the existing index to SolrCloud? If so, how? Or do we need to reindex our data in

Re: PropagateServer Implementation for Solr

2013-07-04 Thread Daniel Collins
Ok, in the scenario where the calling app uses SolrJ and creates a CloudSolrServer to send all its requests in. In that case, yes I can see the logic that says CloudSolrServer shouldn't load balance that (its not that type of request), it should forward it on to all the servers in the cloud.

Surprising score?

2013-07-04 Thread Lochschmied, Alexander
Hi Solr people! querying for series:RCWP returns me the response below. Why does RCWP Moisture Resistant score worse than D/CRCW-P e3 with the field definition below? OK, we are ignoring dashes and spaces, but I would have expected that matches towards the beginning score better. Can I change

Re: Surprising score?

2013-07-04 Thread Jeroen Steggink
Hi Alexander, This is because you have length normalization enabled for that field. http://ir.dcs.gla.ac.uk/wiki/Length_Normalisation If you want it disabled set the following: fieldType name=series class=solr.TextField positionIncrementGap=100 omitNorms=true Jeroen On 4-7-2013 11:10,

Re: PropagateServer Implementation for Solr

2013-07-04 Thread Furkan KAMACI
Here is an example how I use PropagateServer inside CloudSolrServer: public static ListCloudStatistics customListStatistics(CloudSolrServer solrServer) { NamedListObject namedList = new SimpleOrderedMapObject(); try { namedList = solrServer.request(new LukeRequest()); } catch

SOLR 4.0 frequent admin problem

2013-07-04 Thread David Quarterman
Hi, About once a week the admin system comes up with SolrCore Initialization Failures. There's nothing in the logs and SOLR continues to work in the application it's supporting and in the 'direct access' mode (i.e. http://123.465.789.100:8080/solr/collection1/select?q=bingo:*). The cure is to

ClassNotFoundException regarding SolrInfoMBean under Tomcat 7

2013-07-04 Thread Michael Bakonyi
Hi everyone, I'm trying to get the CMS TYPO3 connected with Solr 3.6.2. By now I followed the installation at http://wiki.apache.org/solr/SolrTomcat except that I didn't copy the .war-file into the $SOLR_HOME but referencing to it at a different location via Tomcat Context fragment file.

Re: Surprising score?

2013-07-04 Thread Upayavira
And be sure to re-index your content. Upayavira On Thu, Jul 4, 2013, at 11:28 AM, Jeroen Steggink wrote: Hi Alexander, This is because you have length normalization enabled for that field. http://ir.dcs.gla.ac.uk/wiki/Length_Normalisation If you want it disabled set the following:

Find related words

2013-07-04 Thread Dotan Cohen
How might one find the top related words for a given word in a Solr index? For instance, given the following single-field documents: 1: I love chocolate 2: I love Solr 3: I eat chocolate cake 4: You will eat chocolate candy Thus, given the word Chocolate Solr might find these top words: I (3

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Ali, Saqib
Hello Furkan, We are using Solr 4.3 Thanks On Thu, Jul 4, 2013 at 1:43 AM, Furkan KAMACI furkankam...@gmail.comwrote: Which version of Solr you are using? 2013/7/4 Ali, Saqib docbook@gmail.com We have single Solr instance with lot of indexed document. Now we would like to move to

Re: Joins with SolrCloud

2013-07-04 Thread Yonik Seeley
Yes, joins support distributed search fine, provided that the individual documents that are joined reside on the same shard. For example, if you are modeling blogs and posts (one blog object as many posts) shard1 -- joe!blog_info joe!post1 shard2 --

Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
Hi , I have lots of crawled data, indexed in my Solr (4.3.0) and lets say user creates a search criteria 'X1' and he/she wants to know the occurrence of a specific term in the result set of that 'X1' search criteria. And then again he/she creates another search criteria 'X2' and he/she wants to

Solr Phonetic Search returning documents but not Highlight Information

2013-07-04 Thread snkar
We have a pretty simple Solr Schema: fields field name=DocId type=long indexed=true stored=true required=true / field name=DocTitle type=string indexed=true stored=true required=true / field name=Content type=text_general indexed=false stored=true required=true /

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Jack Krupansky
Sorry, but there is no such feature in Solr at this time - you would have to do it manually, either by retrieving all of the results or by writing a custom value source (function) that does the desired calculation within Solr. Feel free to file a Jira for suggesting such a new

Re: SOLR 4.0 frequent admin problem

2013-07-04 Thread Roman Chyla
Yes :-) see SOLR-118, seems an old issue... On 4 Jul 2013 06:43, David Quarterman da...@corexe.com wrote: Hi, About once a week the admin system comes up with SolrCore Initialization Failures. There's nothing in the logs and SOLR continues to work in the application it's supporting and in

Re: Find related words

2013-07-04 Thread Jack Krupansky
You can take a look at the MoreLikeThis/Find Similar feature. That gives you an approximation, but using documents rather than discrete terms. You would have to write a custom component of your own based on logic from MLT. -- Jack Krupansky -Original Message- From: Dotan Cohen Sent:

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Yonik Seeley
If you just want to retrieve those counts, this seems like simple faceting. q=something facet=true facet.query=product:hunger facet.query=product:games -Yonik http://lucidworks.com On Thu, Jul 4, 2013 at 9:45 AM, Tony Mullins tonymullins...@gmail.com wrote: Hi , I have lots of crawled data,

Re: Find related words

2013-07-04 Thread Koji Sekiguchi
You may want collocations a given word? I've implemented LUCENE-474 for Solr a while ago and I found it worked pretty well. https://issues.apache.org/jira/browse/LUCENE-474 Hope this helps. koji -- http://soleami.com/blog/automatically-acquiring-synonym-knowledge-from-wikipedia.html (13/07/04

Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
My solr config has : autoCommit maxTime15000/maxTime openSearcherfalse/openSearcher /autoCommit !-- softAutoCommit is like autoCommit except it causes a 'soft' commit which only ensures that changes are visible but does not ensure that data is synced

Re: Find related words

2013-07-04 Thread Dotan Cohen
Thank you Jack and Koji. I will take a look at MLT and also at the .zip files from LUCENE-474. Koji, did you have to modify the code for the latest Solr? -- Dotan Cohen http://gibberish.co.il http://what-is-what.com

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
Hi Yonik, With facet it didn't work. Please see the result set doc below

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Yonik Seeley
Ah, sorry - I thought you were after docfreq, not termfreq. -Yonik http://lucidworks.com On Thu, Jul 4, 2013 at 10:57 AM, Tony Mullins tonymullins...@gmail.com wrote: Hi Yonik, With facet it didn't work. Please see the result set doc below

RE: SOLR 4.0 frequent admin problem

2013-07-04 Thread David Quarterman
Cheers, Roman! It was a default Jetty set up so now added a 'work' directory and that's in use now. -Original Message- From: Roman Chyla [mailto:roman.ch...@gmail.com] Sent: 04 July 2013 15:00 To: solr-user@lucene.apache.org Subject: Re: SOLR 4.0 frequent admin problem Yes :-) see

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
So what is the workaround for this problem ? Can it be done without changing any source code ? Thanks, Tony On Thu, Jul 4, 2013 at 8:01 PM, Yonik Seeley yo...@lucidworks.com wrote: Ah, sorry - I thought you were after docfreq, not termfreq. -Yonik http://lucidworks.com On Thu, Jul 4, 2013

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Jack Krupansky
These statistics are use for determining document relevance or score for the query itself. As such, they are one of two things: 1) (per field) per document, or for the universe of documents in the collection. That's it, one of the two. You keep referring to ResultSet, but there is no such

Re: Auto Soft commit not working !!!

2013-07-04 Thread Daniel Collins
You should see the commit messages in the solr logs, do they come up at the expected frequency? On 4 July 2013 15:35, Rohit Kumar rohit.kku...@gmail.com wrote: My solr config has : autoCommit maxTime15000/maxTime openSearcherfalse/openSearcher /autoCommit !--

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread P Williams
Hi Tony, Have you seen the TermVectorComponenthttp://wiki.apache.org/solr/TermVectorComponent? It will return the TermVectors for the documents in your result set (note that the rows parameter matters if you want results for the whole set, the default is 10). TermVectors also must be stored for

Re: Find related words

2013-07-04 Thread Koji Sekiguchi
Hi Dotan, (13/07/04 23:51), Dotan Cohen wrote: Thank you Jack and Koji. I will take a look at MLT and also at the .zip files from LUCENE-474. Koji, did you have to modify the code for the latest Solr? Yes. As the Lucene APIs for accessing index have been changed, I had to modify the code.

Re: Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
I checked with the tomcat logs. Although the config says it to commit every 15000ms autoCommit maxTime15000/maxTime openSearcherfalse/openSearcher /autoCommit Strangely there are no commit logs. Did i miss anything?

Re: Auto Soft commit not working !!!

2013-07-04 Thread Jack Krupansky
1. Do you have an update processor chain that doesn't have RunUpdate in it? 2. Is the updateLog solrconfig directive missing? 3. Is _version_ missing from your schema? -- Jack Krupansky -Original Message- From: Rohit Kumar Sent: Thursday, July 04, 2013 9:22 PM To:

Re: Moving from single Solr instance to Solr Cloud

2013-07-04 Thread Otis Gospodnetic
Hello, In SolrCloud works Collections (logical indices) have shards and replicas, so you would probably want to create a new Collection with some number of shards and replicas and reindex into it. That would be the cleanest. Otis -- Solr ElasticSearch Support -- http://sematext.com/

Re: Auto Soft commit not working !!!

2013-07-04 Thread Rohit Kumar
1. Do you have an update processor chain that doesn't have RunUpdate in it?*- No * 2. Is the updateLog solrconfig directive missing? - *Bang On. It was still commented !!!* 3. Is _version_ missing from your schema? *Checked it. and its present * *I will test again and update soon . *

Early Access Release #2 for Solr 4.x Deep Dive book is now available for download on Lulu.com

2013-07-04 Thread Jack Krupansky
Okay, it’s hot off the e-presses: Solr 4.x Deep Dive, Early Access Release #2 is now available for purchase and download as an e-book for $9.99 on Lulu.com at: http://www.lulu.com/shop/jack-krupansky/solr-4x-deep-dive-early-access-release-1/ebook/product-21079719.html (That link says “1”, but

Re: Concurrent Modification Exception

2013-07-04 Thread Dmitry Kan
Can you repeat the test with for example jetty? In case jboss (?) has some issues in the case. What type of query was this? On 2 Jul 2013 19:27, adityab aditya_ba...@yahoo.com wrote: Anyone , any suggestion or pointers for this issue? -- View this message in context:

Re: Total Term Frequency per ResultSet in Solr 4.3 ?

2013-07-04 Thread Tony Mullins
OK. Thanks Tricia , Jack Yonik for your suggestions and time. Regards, Tony. On Fri, Jul 5, 2013 at 1:20 AM, P Williams williams.tricia.l...@gmail.comwrote: Hi Tony, Have you seen the TermVectorComponenthttp://wiki.apache.org/solr/TermVectorComponent? It will return the TermVectors for