Re: Update to solr 5 - custom phrase query implementation issue

2016-02-03 Thread Gerald Reinhart
On 02/02/2016 03:20 PM, Erik Hatcher wrote: On Feb 2, 2016, at 8:57 AM, Elodie Sannier wrote: Hello, We are using solr 4.10.4 and we want to update to 5.4.1. With solr 4.10.4: - we extend PhraseQuery with a custom class in order to remove some terms from phrase

Re: Solr segment merging in different replica

2016-02-03 Thread Emir Arnautovic
Hi Edwin, Master-Slave's main (maybe only) advantage is simpler infrastructure - it does not use ZK. Also, it does assume you don't need NRT search since there has to be longer periods between replicating master changes to slaves. Regards, Emir On 03.02.2016 04:48, Zheng Lin Edwin Yeo wrote:

Re: plugging an analyzer

2016-02-03 Thread Roxana Danger
Hi Scott, I have everything well configured but no parameters can be passed to an Analyzer (FieldTypePluginLoader just calls the constructor without parameters). So, the quick solution is to create a TokenizerFactory instead. Thanks, Roxana On 2 February 2016 at 16:29, Scott Stults

RE: Using Tika that comes with Solr 5.2

2016-02-03 Thread Allison, Timothy B.
Right. Thank you for reporting the solution. Be aware, though, that some parser dependencies are not included with the Solr distribution, and, because of the way that Tika currently works, you'll silently get no text/metadata from those file types (e.g. sqlite files and others). See [1]

Re: Data Import Handler takes different time on different machines

2016-02-03 Thread Troy Edwards
While researching the space on the servers, I found that log files from Sept 2015 are still there. These are solr_gc_log_datetime and solr_log_datetime. Is the default logging for Solr ok for production systems or does it need to be changed/tuned? Thanks, On Tue, Feb 2, 2016 at 2:04 PM, Troy

Re: Tutorial or Code Samples to explain how to Write Solr Plugins

2016-02-03 Thread Charlie Hull
Here's one we wrote recently for indexing ontologies with Solr as part of the BioSolr project: https://github.com/flaxsearch/BioSolr/tree/master/ontology/solr and a presentation on how it works (explained in the second half of the talk) https://www.youtube.com/watch?v=v1qKNX_axdI - hope this

Re: "I was asked to wait on state recovering for shard.... but I still do not see the request state"

2016-02-03 Thread hawk
I have a similar issue on 4.10.1 160131 21:07:36.932 http-bio-8082-exec-2802 org.apache.solr.common.SolrException: I was asked to wait on state recovering for shard2 in my_cases on localhost2:8080_solr but I still do not see the requested state. I see state: recovering live:true leader from ZK:

Solr Math Function floats

2016-02-03 Thread Curtis Fehr
Hey there guys and gals, I'm trying to devise a mathematical checksum in solr, so that I can quickly check the records against the authoritative source. The problem I'm running into, is that all the math functions I want to use in solr are 32 bit floats, and my checksum values are 64 bit

Re: Update to solr 5 - custom phrase query implementation issue

2016-02-03 Thread Erik Hatcher
Gerald - I don’t quite understand, sorry - perhaps best if you could post your code (or some test version you can work with and share here) so we can see what exactly you’re trying to do.Maybe there’s other ways to achieve what you want, maybe with somehow leveraging a StopFilter-like

Re: Update to solr 5 - custom phrase query implementation issue

2016-02-03 Thread Gerald Reinhart
Erik, here is some context : - migration from solr 4.10.4 to 5.4.1. - we have our own synonym implementation that do not use solr synonym mechanism: at the time, we needed to manage multi token synonym and it wasn't covered by the Lucene features. So basically we - let' say

Re: Tutorial or Code Samples to explain how to Write Solr Plugins

2016-02-03 Thread Alexandre Rafalovitch
There is a framework to help write them: https://github.com/leonardofoderaro/alba Also, some recent plugins were released at the Revolution conference, maybe they have something useful: https://github.com/DiceTechJobs/SolrPlugins Regards, Alex. Newsletter and resources for Solr beginners

Re: "I was asked to wait on state recovering for shard.... but I still do not see the request state"

2016-02-03 Thread Mark Miller
You get this when the Overseer is either bogged down or not processing events generally. The Overseer is way, way faster at processing events in 5x. If you search your logs for .Overseer you can see what it's doing. Either nothing at the time, or bogged down processing state updates probably.

Re: "I was asked to wait on state recovering for shard.... but I still do not see the request state"

2016-02-03 Thread hawk
Here are more details around the event. 160201 11:57:22.272 http-bio-8082-exec-18 [] webapp=/solr path=/update params={waitSearcher=true=http://x:x/solr//=FROMLEADER=true=true=javabin=false_end_point=true=2=false} {commit=} 0 134 160201 11:57:25.993 RecoveryThread Error while trying to

Re: "I was asked to wait on state recovering for shard.... but I still do not see the request state"

2016-02-03 Thread hawk
Thanks Mark. I was able to search "Overseer" in the solr logs around the time frame of the condition. This particular message was from the leader node of the shard. 160201 11:26:36.380 localhost-startStop-1 Overseer (id=null) closing Also I found this message in the zookeeper logs.

Re: Tutorial or Code Samples to explain how to Write Solr Plugins

2016-02-03 Thread Binoy Dalal
Here's a couple of links you can follow to get started: https://www.slideshare.net/mobile/searchbox-com/tutorial-on-developin-a-solr-search-component-plugin https://www.slideshare.net/mobile/searchbox-com/develop-a-solr-request-handler-plugin These are to write a search component and a request

Tutorial or Code Samples to explain how to Write Solr Plugins

2016-02-03 Thread Gian Maria Ricci - aka Alkampfer
Hi, I wonder if there is some code samples or tutorial (updated to work with version 5) to help users writing plugins. I've found lots of difficulties on the past to find such kind of information when I needed to write some plugins, and I wonder if I missed some site or link that does a

Re: Handling fields used for both display & index

2016-02-03 Thread Jay Potharaju
Thanks for the response Sameer & Binoy. Jay On Sun, Jan 31, 2016 at 6:13 PM, Binoy Dalal wrote: > Adding to sameer's answer, use string types when you want exact matches, > both in terms of query and case. > In case you want to perform additional operations on the input,

Re: Solr for real time analytics system

2016-02-03 Thread CKReddy Bhimavarapu
Hello Rohit, You can use the Banana project which was forked from Kibana , and works with all kinds of time series (and non-time series) data stored in Apache Solr . It uses Kibana's powerful dashboard configuration capabilities,

AW: Hard commits, soft commits and transaction logs

2016-02-03 Thread Clemens Wyss DEV
Sorry for coming back to this topic: You (Erick) mention "By and large, do not issue commits from any client indexing to Solr" In ordert o achieve NRT, I for example test 18 true 1 For (unit)testing purposes 1000

Out of memory error during full import

2016-02-03 Thread Srinivas Kashyap
Hello, I have implemented 'SortedMapBackedCache' in my SqlEntityProcessor for the child entities in data-config.xml. When i try to do full import, i'm getting OutOfMemory error(Java Heap Space). I increased the HEAP allocation to the maximum extent possible. Is there a workaround to do initial

Solr for real time analytics system

2016-02-03 Thread Rohit Kumar
Hi I am quite new to Solr. I have to build a real time analytics system which displays metrics based on multiple filters over a huge data set (~50million documents with ~100 fileds ). I would need mostly aggregation queries like sum/average/groupby etc, but data set is quite huge. The

Re: sorry, no dataimport-handler defined!

2016-02-03 Thread kostali hassan
in request data import handler for solrconfig.xml do : tika-data-config.xml and define your file tika-data-config.xml and put this file in the directory config from your core. 2016-02-02 17:35 GMT+00:00 Jean-Jacques Monot : > Exact. Newbie user ! > > OK i

Re: Solr segment merging in different replica

2016-02-03 Thread Alessandro Benedetti
Master/Slave is the old legacy way to obtain a resilient system. It's easier to setup, but if you are already on SolrCloud I can not see any advantage in moving back. Related the networking part, I am not a network expert. The only think I can tell you is that the inter-nodes communication is

RE: Using Tika that comes with Solr 5.2

2016-02-03 Thread Allison, Timothy B.
>Be aware, though, that some parser dependencies are not included with the Solr >distribution, and, because of the way that Tika currently works, you'll >silently >get no text/metadata from those file types (e.g. sqlite files and >others). See [1] for some discussion of this. If you want the

Re: possible to dump "routing table" from a single Solr node?

2016-02-03 Thread Shawn Heisey
On 2/3/2016 11:49 AM, Ian Rose wrote: > I'm having a situation where our SolrCloud cluster often gets into a bad > state where our solr nodes frequently respond with "no servers hosting > shard" even though the node that hosts that shard is clearly up. We > suspect that this is a state bug where

Re: Tutorial or Code Samples to explain how to Write Solr Plugins

2016-02-03 Thread Upayavira
Not a tutorial as such, but here's some simple infrastructure for building Solr components alongside Solr: https://github.com/upayavira/custom-solr-components I suspect you're past that stage already though. Upayavira On Wed, Feb 3, 2016, at 04:45 PM, Binoy Dalal wrote: > Here's a couple of

possible to dump "routing table" from a single Solr node?

2016-02-03 Thread Ian Rose
Hi all, I'm having a situation where our SolrCloud cluster often gets into a bad state where our solr nodes frequently respond with "no servers hosting shard" even though the node that hosts that shard is clearly up. We suspect that this is a state bug where some servers are somehow ending up