Get cache statistics via rest

2014-10-13 Thread SolrUser1543
I want to monitor my solr cache efficiency : Filter cache , queryresultcache, fieldvaluecache. This information available on plugin/stats page for specific core. How can I get this information via Rest ? -- View this message in context:

Re: Shard not accessible after restarting

2014-10-13 Thread nabil Kouici
Hi Shawn, This gives me a good understanding. However, I think that slowness in start-up in my case is due to segmentation. Before restarting my index contains 42 segments with 30GB. After restarting, index is in one segment with 22GB. So, I think that shard unavailability is coming from

Re: Add multiple JSON documents with boost

2014-10-13 Thread Damian Luszczymak
Thanks, found the problem and fixed my writer 2014-10-09 2:00 GMT+02:00 Chris Hostetter hossman_luc...@fucit.org: : i try to add documents to the index and boost them (hole document) but i : get this error message: : : ERROR org.apache.solr.core.SolrCore – :

Using relative path for indexing in SOLR

2014-10-13 Thread bharath Raghavendran
Hi , I am currently using solr-4.9.0 to index my PDF's using the default post.jar , start.jar provided in the examples directory. However i would like to modify the indexed path from absolute location to relative path from the base folder. Example : Absolute Path :

Re: Using relative path for indexing in SOLR

2014-10-13 Thread Anurag Sharma
You can always give the relative path from your current working directory like below: ~/solr/example/exampledocs$ java -jar post.jar ./../sourcepdf/*.pdf This solves your issue? On Mon, Oct 13, 2014 at 3:58 PM, bharath Raghavendran bharat...@gmail.com wrote: Hi , I am currently using

best load balancer for solr cloud

2014-10-13 Thread Apoorva Gaurav
Hello All, Is it preferable to use CloudSolrServer or using an external load balancer like haproxy. We're currently channeling all our requests via haproxy but want to get rid of management hassles as well as additional network call but saw a significant degradation in latency on switching to

RE: best load balancer for solr cloud

2014-10-13 Thread Amey - codeinventory
Apoorva, I was facing same problem few days back when i started useing *CloudSolrServer*, it decreased my latency by almost 5 times than HttpSolrServer .. below are few things i did for performance improvement. + Start using ConcurrentUpdateSolrServer + LB also choking the n/w in high

Re: Solr Replication during Tomcat shutdown causes shutdown to hang/fail

2014-10-13 Thread Phil Black-Knight
I haven't seen any activity regarding this in Jira, just curious if it would be looked into anytime soon... On Thu, Oct 2, 2014 at 10:11 AM, Phil Black-Knight pblackkni...@globalgiving.org wrote: see the ticket here: https://issues.apache.org/jira/browse/SOLR-6579 including a patch to fix

Re: What happens if you don't set positionIncrementGap

2014-10-13 Thread Shawn Heisey
On 10/12/2014 8:33 PM, Alexandre Rafalovitch wrote: Thanks Jack, this makes sense for text. But what about for the ints, dates, and floats? The package web page does not seem to say anything. And your book (at least in my release 7) is also only talking about the text field. Yet, we seem to

Re: Get cache statistics via rest

2014-10-13 Thread Shawn Heisey
On 10/13/2014 12:54 AM, SolrUser1543 wrote: I want to monitor my solr cache efficiency : Filter cache , queryresultcache, fieldvaluecache. This information available on plugin/stats page for specific core. How can I get this information via Rest ? The same way the admin UI does. You

Re: Shard not accessible after restarting

2014-10-13 Thread Shawn Heisey
On 10/13/2014 1:15 AM, nabil Kouici wrote: This gives me a good understanding. However, I think that slowness in start-up in my case is due to segmentation. Before restarting my index contains 42 segments with 30GB. After restarting, index is in one segment with 22GB. So, I think that shard

Re: best load balancer for solr cloud

2014-10-13 Thread Shawn Heisey
On 10/13/2014 5:28 AM, Apoorva Gaurav wrote: Is it preferable to use CloudSolrServer or using an external load balancer like haproxy. We're currently channeling all our requests via haproxy but want to get rid of management hassles as well as additional network call but saw a significant

Re: What happens if you don't set positionIncrementGap

2014-10-13 Thread Alexandre Rafalovitch
On 13 October 2014 10:08, Shawn Heisey apa...@elyograg.org wrote: I don't think it needs to be defined, but it can be thought of as helpful to explicitly state a value in the example even if that value is in fact the default, so a new user doesn't have to wonder what the value is on those

Re: What happens if you don't set positionIncrementGap

2014-10-13 Thread Jack Krupansky
Interesting question - if you construct a multivalued field of non-tokenized values, can you use a Lucene phrase query to match sequences of numeric values? Seems like it should work! Although, you couldn't write a quoted phrase of numeric values in most of the query parsers since they depend

Re: eDisMax parser and special characters

2014-10-13 Thread Lanke,Aniruddha
Can the default behavior of - as a pre-fix operator be changed so it can be searched as a string? Thanks, On Oct 9, 2014, at 8:34 AM, Lanke,Aniruddha aniruddha.la...@cerner.com wrote: Is there a way to override this default behavior? — Lanke On Oct 8, 2014, at 4:55 PM, Jack Krupansky

Re: eDisMax parser and special characters

2014-10-13 Thread Jack Krupansky
Simply escape it with a backslash or enclose the term in quotes. Sure, it would be nice to be able to configure various operators to be disabled, but that's not fesible with query parser designed around static grammars and infleexible tools such as JFlex. -- Jack Krupansky -Original

Re: eDisMax parser and special characters

2014-10-13 Thread Lanke,Aniruddha
Thanks for a quick response Jack. Trying to escape it with a backslash, we also need to escape the whitespace. Is that a default behavior while escaping special characters? eg: Search query: pcta \- all No results returned str name=parsedquery_toString+(((name_starts_with:pcta^9.0 |

Re: What happens if you don't set positionIncrementGap

2014-10-13 Thread Ahmet Arslan
Hi, bq. setting non-zero for dates/ints/longs does not I am not 100% sure, but position increment gap is set to 1 for FieldMaskingSpanQuery to work. On Monday, October 13, 2014 5:37 PM, Alexandre Rafalovitch arafa...@gmail.com wrote: On 13 October 2014 10:08, Shawn Heisey apa...@elyograg.org

SOLR Boolean clause impact on memory/Performance

2014-10-13 Thread ankit gupta
hi, Can we quantify the impact on SOLR memory usage/performance if we increase the boolean clause. I am currently using lot of OR clauses in the query (close to 10K) and can see heap size growing. Thanks, Ankit

Re: import solr source to eclipse

2014-10-13 Thread Rajani Maski
Hi, The best tutorial for setting up Solr[solr 4.7] in eclipse/intellij is documented in Solr In Action book, Apendix A, *Working with the Solr codebase* On Mon, Oct 13, 2014 at 6:45 AM, Tomás Fernández Löbbe tomasflo...@gmail.com wrote: The way I do this: From a terminal: svn checkout

Re: SOLR Boolean clause impact on memory/Performance

2014-10-13 Thread Erick Erickson
Of course there will be performance and memory changes. The only real question is whether your situation can tolerate them. The whole point of maxBooleanClauses is exactly that going above that limit should be a conscious decision because it has implications for both memory and performance That

Re: Shard not accessible after restarting

2014-10-13 Thread nabil Kouici
Thank you for this replay. I don't understand why solr load my shard in physical memory before becoming available. Is it related to LRU cache management? Regards,Nabil. Le Lundi 13 octobre 2014 16h20, Shawn Heisey apa...@elyograg.org a écrit : On 10/13/2014 1:15 AM, nabil Kouici

Re: Shard not accessible after restarting

2014-10-13 Thread Shawn Heisey
On 10/13/2014 11:43 AM, nabil Kouici wrote: Thank you for this replay. I don't understand why solr load my shard in physical memory before becoming available. Is it related to LRU cache management? Just like with the optimize, this also sounds like something that Solr would never do. If you

Manual leader election in SolrCloud

2014-10-13 Thread Sachin Kale
Is it possible to elect the leader manually in SOLR Cloud 4.10.1? -Sachin-

Re: Manual leader election in SolrCloud

2014-10-13 Thread Erick Erickson
Not to my knowledge. There's quite a bit of work going on around leader balancing, see the umbrella issue at https://issues.apache.org/jira/browse/SOLR-6491. That work won't quite do what you want in the sense that you can't say nodeX you become the leader though. The way that set of operations

RE: does one need to reindex when changing similarity class

2014-10-13 Thread Markus Jelsma
Yes, if the replacing similarity has a different implementation on norms, you should reindex or gradually update all documents within decent time. -Original message- From:Ahmet Arslan iori...@yahoo.com.INVALID Sent: Thursday 9th October 2014 18:27 To: solr-user@lucene.apache.org

UnInvertedField implementation details

2014-10-13 Thread Kydryavtsev Andrey
Hi, I have a question about UnInvertedField internals. I use it for multi terms field faceting. And once got an exception Too many values for UnInvertedField faceting on field I googled it a bit (http://comments.gmane.org/gmane.comp.jakarta.lucene.solr.user/68000) and looked into the

ArrayIndexOutOfBoundsException in ToParentBlockJoinQuery

2014-10-13 Thread Faisal Mansoor
Hi, I am having problems running Parent Block Join Query in Solr. For some reasons the following query throws ArrayIndexOutOfBoundsException. {!type=parent which='type_s:(shirt) AND BRAND_s:(Puma)'} (type_s:(sku) AND SIZE_s:(XL)) The index I am using is not that big, only has a few hundred

SolrCloud: Meaning of SYNC state in ZkStateReader?

2014-10-13 Thread Martin Grotzke
Hi, can anybody tell me the meaning of ZkStateReader.SYNC? All other state related constants are clear to me, I'm only not sure about the semantics of SYNC. Background: I'm working on an async solr client (https://github.com/inoio/solrs) and want to add SolrCloud support - for this I'm reusing

Re: SolrCloud: Meaning of SYNC state in ZkStateReader?

2014-10-13 Thread Mark Miller
I think it's just cruft I left in and never ended up using anywhere. You can ignore it. - Mark On Oct 13, 2014, at 8:42 PM, Martin Grotzke martin.grot...@googlemail.com wrote: Hi, can anybody tell me the meaning of ZkStateReader.SYNC? All other state related constants are clear to

Re: ArrayIndexOutOfBoundsException in ToParentBlockJoinQuery

2014-10-13 Thread Erick Erickson
What version of Solr? For Block Join you need to index all the docs (parent/child) docs at once, and when they're updated they _all_ need to be updated AFAIK. Best, Erick On Mon, Oct 13, 2014 at 3:51 PM, Faisal Mansoor faisal.mans...@gmail.com wrote: Hi, I am having problems running Parent

Re: does one need to reindex when changing similarity class

2014-10-13 Thread Jack Krupansky
To correct myself, the selected Similarity class can have a computeNorm method that calculates the norm value that will be stored in the index when the document is indexed, so changing the Similarity class will require reindexing if the implementation of the computeNorm method is different.

Re: Manual leader election in SolrCloud

2014-10-13 Thread sachinpkale
Thanks for the info. I will wait for the next release then. Will it come with 4.10.2? -- View this message in context: http://lucene.472066.n3.nabble.com/Manual-leader-election-in-SolrCloud-tp4164047p4164115.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Index to Helio Search

2014-10-13 Thread Norgorn
*totalprovidencevideo It worked, thanks, u helped me to save nearly a week on reindexing and lot of nerves. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Index-to-Helio-Search-tp4163446p4164114.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: ArrayIndexOutOfBoundsException in ToParentBlockJoinQuery

2014-10-13 Thread Faisal Mansoor
Thanks Erick, I am using the 4.10.0 solr. To update any field, I first delete all existing documents matching _root_:id before inserting the updated version. So, I don't think that's causing the problem. Is there a way to validate the sanity of the index, are there any tools which can analyze the

Re: Manual leader election in SolrCloud

2014-10-13 Thread Erick Erickson
Unless some of the folks poke holes in my approach, all the pieces should be in the 5.0 release. It certainly will _not_ be in 4.10.2 (if there is one). Point releases like that are usually for major bugs (and, very occasionally) a must-have feature. This wouldn't make that cut On Mon, Oct

Re: ArrayIndexOutOfBoundsException in ToParentBlockJoinQuery

2014-10-13 Thread Erick Erickson
There's the CheckIndex tool, but I don't know whether it checks this case. Is there any way you could check this against 4.10.1? I know there were a couple of edge cases that were fixed in that release, but have no idea whether block joins were affected. But other than that, I'm clueless. Erick

Re: SolrCloud 4.7 not doing distributed search when querying from a load balancer.

2014-10-13 Thread S.L
Erick, I have upgraded to SolrCloud 4.10.1 with the same toplogy , 3 shards and 2 replication factor with six cores altogether. Unfortunately , I still see the issue of intermittently no results being returned.I am not able to figure out whats going on here, I have included the logging