Re: Highlighting content field problem when using JiebaTokenizerFactory

2015-10-28 Thread Zheng Lin Edwin Yeo
Hi Scott, I have tried to edit the SegToken.java file in the jieba-analysis-1.0.0 package with a +1 at both the startOffset and endOffset value (see code below), and now the tag of the content is shifted to the correct place at the content. However, this means that in the title and other fields w

Re: replica recovery

2015-10-28 Thread Shawn Heisey
On 10/27/2015 6:16 PM, Brian Scholl wrote: > - a shard replica is larger than 50% of the available disk This detail indicates a potential problem even without any of the other details. The bottom line here is that if you don't have enough disk space to hold your index three times, you can have pr

This item has been released from quarantine. (SYM:0104016882493714951067)

2015-10-28 Thread icwexccas03vg
This file, which was attached to the message titled "Re: Using books.json in solr" by "salon...@usc.edu" and was quarantined on 10/27/2015 2:04 PM, has been released. Note: If auto-protect scanning is enabled, then this restored attachment will be rescanned for risks and file filtering rules

Solr node removed from zookeeper

2015-10-28 Thread andreic9203
Hi. I have a big issue with the Solr Cloud environment. After developing a solution based on SolrCloud into a safe environment (safe means stable and fast internet connection, moderate number of documents, etc), the solution reached the production. Because in production we have a lack of hardwar

Re: Solr node removed from zookeeper

2015-10-28 Thread Charlie Hull
On 28/10/2015 13:21, andreic9203 wrote: Hi. I have a big issue with the Solr Cloud environment. After developing a solution based on SolrCloud into a safe environment (safe means stable and fast internet connection, moderate number of documents, etc), the solution reached the production. Becau

Re: Solr node removed from zookeeper

2015-10-28 Thread andreic9203
Thanks Charlie for the quick answer. What good for if I cannot hold the instances of Zookeeper on separate machines? Andrei -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-node-removed-from-zookeeper-tp4236931p4236936.html Sent from the Solr - User mailing list arch

Re: Solr node removed from zookeeper

2015-10-28 Thread Shawn Heisey
On 10/28/2015 7:21 AM, andreic9203 wrote: > Because in production we have a lack of hardware, our environment contains > the following: > 1 Zookeeper instance > 2 collections (collection1 and collection2) > 3 Sol'r nodes (node1, node2 and node3) > > collection1 is shared between node1 and node2 >

Re: Many mapping files

2015-10-28 Thread fabigol
Thank for your response. I have 7 files *.xml. I already worked with SOlr but i have an only file. My question is why in this project there's 7 files describing an entity. Here my files:

Autocomplete prototype using Velocity UI Browse - Solritas

2015-10-28 Thread Alessandro Benedetti
Hi guys, I was playing with the velocity Browse UI, to provide a simple prototype to be shown to not techie users. Unfortunately I am a super noob in reading/writing front end and Js code. I would like an advice from you. What I would like to do is to bypass the big autocomplete script and simply

Re: Autocomplete prototype using Velocity UI Browse - Solritas

2015-10-28 Thread Erik Hatcher
What version of Solr? Solr 5’s data driven configuration is set up to use a generic browse interface that does not have any auto-suggest wired in by default. How did you create your collection? You just want to turn off the terms suggest thing? — Erik Hatcher, Senior Solutions Architect htt

solr 5.3.0 master-slave: TWO segments after optimize

2015-10-28 Thread Andrii Berezhynskyi
Hi all! We have master-slave configuration. Slaves are replicated on optimize. Sometimes (not always) it happens that slave has two segments after replication. I always thought that optimize is all about having only one segment in your read replica. During this time when slave has two segments we

Re: Autocomplete prototype using Velocity UI Browse - Solritas

2015-10-28 Thread Alessandro Benedetti
I am using 5.3 . I was taking a look to the vm templates and Js scripts. My collection is a custom collection, and it is working ok. The browse interface is slightly customise and it is working properly. Everytime I click submit query , the proper results are returned. What i would like to do i

Re: solr 5.3.0 master-slave: TWO segments after optimize

2015-10-28 Thread Erick Erickson
Hmmm, do the segments go away when you reload the slave? Or do they hang around over even Solr restarts? If they're temporary then you may be seeing them held by one searcher while another one warms up. Best, Erick On Wed, Oct 28, 2015 at 9:27 AM, Andrii Berezhynskyi wrote: > Hi all! > > We have

Re: Autocomplete prototype using Velocity UI Browse - Solritas

2015-10-28 Thread Erik Hatcher
Ah… I did this once upon a time for techproducts, and put a branch of it here, see the couple of commits from me there: https://github.com/erikhatcher/lucene-solr/commits/instant_search But, even better is to look at Solr’s

RE: Solr.cmd cannot create collection in Solr 5.2.1

2015-10-28 Thread Adrian Liew
Hi Shawn, You are correct. It works when we don't include the conf folder. I guess it just something to take note of when uploading solrconfig.xml to Zookeeper. Thanks for the tip. - Adrian -Original Message- From: Shawn Heisey [mailto:apa...@elyograg.org] Sent: Tuesday, October 27, 2

Re: Possible bug with searchers and core swapping

2015-10-28 Thread Shawn Heisey
On 10/23/2015 5:27 PM, Shawn Heisey wrote: > Today I noticed this on my dev server running Solr 5.2.1: > > https://www.dropbox.com/s/bt81sv35acb7q2n/searcher-from-old-corename.png?dl=0 > On the index with the problem, I am using one third-party plugin with a > schema component and an update proc

Re: Facet queries blow out the filterCache

2015-10-28 Thread Jeff Wartes
FWIW, since it seemed like there was at least one bug here (and possibly more), I filed https://issues.apache.org/jira/browse/SOLR-8171 On 10/6/15, 3:58 PM, "Jeff Wartes" wrote: > >I dug far enough yesterday to find the GET_DOCSET, but not far enough to >find why. Thanks, a little context is

Re: Solr Pagination

2015-10-28 Thread Salman Ansari
I have already indexed all the documents in Solr and not indexing anymore. So the problem I am running in is after all the documents are indexed. I am using Solr cloud with two shards and two replicas for each shard but on the same machine. Is there anywhere I can look at the relation between index

Conditional Add/Overwrite a document

2015-10-28 Thread Gili Nachum
Hi, Is there a conditional Add operation in Solr? My documents have "my_int" field and when re-adding a document with the same ID, I would to overwrite the existing doc only if the new doc my_int value is higher than that of the existing doc. As a naive solution, I could first read the existing d

Using Nutch segments

2015-10-28 Thread Salonee Rege
We are directly using bin/nutch solrindex command to post our Nutch segments on Solr . How can we figure out what changes to make in the schema.xml from the content in our segments. Kindly help *Salonee Rege* USC Viterbi School of Engineering University of Southern California Master of Computer Sci

Commit Error

2015-10-28 Thread Rallavagu
Solr 4.6.1, cloud Seeing following commit errors. [commitScheduler-19-thread-1] ERROR org.apache.solr.update.CommitTracker – auto commit error...:java.lang.IllegalStateException: this writer hit an OutOfMemoryError; cannot commit at org.apache.lucene.index.IndexWriter.prepareCommitInternal(In

Re: solr 5.3.0 master-slave: TWO segments after optimize

2015-10-28 Thread Emir Arnautovic
Hi Andrii, Observed high CPU is on master or slave? If on slave, is it on all slaves? Can you do thread dump and see if what is running. Based on numbers this seems like small index and one segment is flush with only 160 doc. Anyway, this is small and something is really wrong if you notice i

Re: Autocomplete prototype using Velocity UI Browse - Solritas

2015-10-28 Thread Alessandro Benedetti
Erick, thank you very much ! Just used the example in files, and it's perfect for my need ! Cheers On 28 October 2015 at 16:43, Erik Hatcher wrote: > Ah… I did this once upon a time for techproducts, and put a branch of it > here, see the couple of commits from me there: > > https://github.

Re: Using Nutch segments

2015-10-28 Thread Erik Hatcher
I can’t speak specifically as I’m not familiar with the details of Nutch’s solrindex command, but in general if I’ve got some data and want to feed it to Solr and iterate a bit on the schema as you’ll inevitably need to tinker with, I do these things: $ # set up initial or adjust schema/config

firstSearcher and newSearcher loading external files

2015-10-28 Thread Summer Shire
Hi All, I use value source parser to load external file that contains popularity values. The way I use it is by passing a "signals" param in the query now I want to warm up this external cache in solr before the actual traffic starts coming in. What is happening is that the cache does not get

org.apache.solr.common.SolrException: Document is missing mandatory uniqueKey field: id

2015-10-28 Thread fabigol
Hi, i have a big problem. Solr doesn't index and i have following error: org.apache.solr.common.SolrException: Document is missing mandatory uniqueKey field: ID here my files:

Re: Stem Words Highlighted - Keyword Not Highlighted

2015-10-28 Thread Ann B
I removed the highlight specification before going to production. The results have the expected words. Example: (search term stocks) Includes free access to stock charts and instruction about using stock charts in technical analysis of stocks. Paid subscriptions provide access to more informatio

Re: Conditional Add/Overwrite a document

2015-10-28 Thread Brendan Humphreys
Hi Gili, It sounds like Solr's DocBasedVersionConstraintsProcessor is what you are looking for: https://cwiki.apache.org/confluence/display/solr/Updating+Parts+of+Documents#UpdatingPartsofDocuments-DocumentCentricVersioningConstraints Cheers, -Brendan On 29 October 2015 at 06:33, Gili Nachum w

Re: Commit Error

2015-10-28 Thread Shawn Heisey
On 10/28/2015 2:06 PM, Rallavagu wrote: > Solr 4.6.1, cloud > > Seeing following commit errors. > > [commitScheduler-19-thread-1] ERROR > org.apache.solr.update.CommitTracker – auto commit > error...:java.lang.IllegalStateException: this writer hit an > OutOfMemoryError; cannot commit at > org.apac

Securing field level access permission by filtering the query itself

2015-10-28 Thread Douglas McGilvray
Hi all, First I’d like to say the nested facets and the json facet api in particular have made my world much better, I thank everyone involved, you are all awesome. In my implementation has much of the solr query building working on the browser, solr is behind a php server which acts as “proxy”

Re: Commit Error

2015-10-28 Thread Rallavagu
Thanks Shawn for the response. Seeing very high CPU during this time and very high warmup times. During this time, there were plenty of these errors logged. So, trying to find out possible causes for this to occur. Could it be disk I/O issues or something else as it is related to commit (writi

Re: Commit Error

2015-10-28 Thread Rallavagu
Also, is this thread that went OOM and what could cause it? The heap was doing fine and server was live and running. On 10/28/15 3:57 PM, Shawn Heisey wrote: On 10/28/2015 2:06 PM, Rallavagu wrote: Solr 4.6.1, cloud Seeing following commit errors. [commitScheduler-19-thread-1] ERROR org.apac

Closing Windows CMD kills Solr

2015-10-28 Thread Steven White
Hi Folks, I don't understand if this is an expected behavior or not. On Windows, I start Solr from a command prompt like so: bin\solr start -p 8983 -s C:\MySolrIndex Now, once I close the command prompt the Java process that started Solr is killed. is this expected? How do I keep Solr ali

Re: Commit Error

2015-10-28 Thread Shawn Heisey
On 10/28/2015 5:11 PM, Rallavagu wrote: > Seeing very high CPU during this time and very high warmup times. During > this time, there were plenty of these errors logged. So, trying to find > out possible causes for this to occur. Could it be disk I/O issues or > something else as it is related to c

Re: Commit Error

2015-10-28 Thread Rallavagu
On 10/28/15 5:41 PM, Shawn Heisey wrote: On 10/28/2015 5:11 PM, Rallavagu wrote: Seeing very high CPU during this time and very high warmup times. During this time, there were plenty of these errors logged. So, trying to find out possible causes for this to occur. Could it be disk I/O issues o

Re: org.apache.solr.common.SolrException: Document is missing mandatory uniqueKey field: id

2015-10-28 Thread Erick Erickson
It's just what the error says. You must have a field labeled "id" in the doc sent to Solr. You can use a different field if you change your schema.xml entry to some other name that is the analog to the primary key in a DB. Or you can change your config to select an "id" field (case matters) for ea

Re: Solr Pagination

2015-10-28 Thread Erick Erickson
In a word, "no". I once doubled the JVM requirements by changing just the query. You have to prototype. Here's a blog on the subject: https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/ On Wed, Oct 28, 2015 at 11:06 AM, Salman Ansari wro