RE: including a minus sign "-" in the token

2017-06-09 Thread Phil Scadden
So, the field I am using for search has type of: You are saying "wainui-8" will indexed as one token? But I should add a worddelimiterfilter to the analyser to prevent it being split? Or I guess the

RE: Highlighter not working on some documents

2017-06-09 Thread Phil Scadden
Tried hard to find difference between pdfs returning no highlighter and ones that do for same search term. Includes pdfs that have been OCRed and ones that were text to begin with. Head scratching to me. -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent:

RE: Highlighter not working on some documents

2017-06-09 Thread Phil Scadden
Managed-schema attached (not a default) and the solrconfig.xml. _text_ is stored. (not sure how else highlighting could work??). The indexer puts the body text of the pdf into _text_ field. What the value be in putting it into a different field and then using copyField?? Ie

Re: Failure to load shards

2017-06-09 Thread John Bickerstaff
Thanks Eric! It's very likely that the auto scale groups spinning up new Solrs hit zookeeper harder than our initial deploy... Just due to the way things get staggered during the deploy. Unfortunately, I don't think there's a way to stagger the auto scale group's work of bringing up Solr boxes

Re: Highlighter not working on some documents

2017-06-09 Thread Erick Erickson
Need lots more information. I.e. schema definitions, query you use, handler configuration and the like. Note that highlighted fields must have stored="true" set and likely the _text_ field doesn't. At least in the default schemas stored is set to false for the catch-all field. And you don't want

Re: Failure to load shards

2017-06-09 Thread Erick Erickson
John: First place I'd look is the ZooKeeper Overseer queue. Prior to 6.6 there were some inefficiencies in how those messages were processed and that queue would get very, very large when lots of replicas came up all at once, and that would gum up the works. See: SOLR-10524. The quick check

Re: IgnoreCommitOptimizeUpdateProcessorFactory

2017-06-09 Thread Erick Erickson
Not that I see. I think you can specify ignoreOptimizeOnly when you configure it, but that would still allow hard commits through. On Fri, Jun 9, 2017 at 3:25 AM, Neeraj Bhatt wrote: > Hi All > > We want to use IgnoreCommitOptimizeUpdateProcessorFactory so that we can

Failure to load shards

2017-06-09 Thread John Bickerstaff
Hi all, Here's my situation... In AWS with zookeeper / solr. When trying to spin up additional Solr boxes from an "auto scaling group" I get this failure. The code used is exactly the same code that successfully spun up the first 3 or 4 solr boxes in each "auto scaling group" Below is a copy

Re: Solr 6.6 UNLOAD core broken?

2017-06-09 Thread Erick Erickson
Digging. Likely a result of SOLR-10007 and associated. On Fri, Jun 9, 2017 at 7:30 AM, Mikhail Khludnev wrote: > Hello, > > Reproduced and raised https://issues.apache.org/jira/browse/SOLR-10857 > Have no workaround, besides of request delete index dir on UNLOAD. > Thanks for

Re: international characters in facet.prefix

2017-06-09 Thread arik
Thanks for the guidance. I have a reasonable "middle ground" blend of client-side and server side tweaks working now. In solr I copied my field into a duplicate field sans folding filters, so that I essentially have "myfield_raw" and "myfield_analyzed". Then on the client side include both

Re: Bringing down ZK without Solr

2017-06-09 Thread Vivek Pathak
Why need to bring down. How about bring down network access e.g. by adding a temp firewall rule. Or just send a stop signal to zookeeper process. On test done send a continue Sent from my iPhone > On Jun 9, 2017, at 9:33 AM, Venkateswarlu Bommineni wrote: > > Thanks for

Re: Solr 6.6 UNLOAD core broken?

2017-06-09 Thread Mikhail Khludnev
Hello, Reproduced and raised https://issues.apache.org/jira/browse/SOLR-10857 Have no workaround, besides of request delete index dir on UNLOAD. Thanks for head up. On Fri, Jun 9, 2017 at 4:05 PM, simon wrote: > I'm seeing the same behavior. The CoreAdminAPI call (as

Re: Bringing down ZK without Solr

2017-06-09 Thread Venkateswarlu Bommineni
Thanks for your reply Eric. The use case is We have a script that will send a mail when Solr and ZK don't talk to each other. so we want to just replicate the issue and test that script. but actually, we don't want to bring down Solr and ZK nodes but want to just try by disconnecting both of

Re: Solr 6.6 UNLOAD core broken?

2017-06-09 Thread simon
I'm seeing the same behavior. The CoreAdminAPI call (as generated by the Admin UI) looks correct, and the core.properties file is removed. I don't see anything in the CHANGES.txt for this release which would imply such a change in behavior, nor anything in the 6.6 reference guide, so it looks

Re: including a minus sign "-" in the token

2017-06-09 Thread Shawn Heisey
On 6/8/2017 8:39 PM, Phil Scadden wrote: > We have important entities referenced in indexed documents which have > convention naming of geographicname-number. Eg Wainui-8 > I want the tokenizer to treat it as Wainui-8 when indexing, and when I search > I want to a q of Wainui-8 (must it be

Re: including a minus sign "-" in the token

2017-06-09 Thread Susheel Kumar
Hi Phil, The WordDelimiterFilterFactory ( https://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.WordDelimiterFilterFactory) can be used to avoid splitting at hypen etc along with WhiteSpaceTokenizerFactory. Use generateWordParts="0"... Thnx On Thu, Jun 8, 2017 at 10:39 PM, Phil

Re: Will Solr support google like organic search ?

2017-06-09 Thread Toke Eskildsen
On Fri, 2017-06-09 at 03:51 -0700, Geepalem wrote: > We have been asked by client to implement Organic Search like Google. [...] > Could you please answer below questions ASAP? > • How Organic Search is different from the Free text search > • Provide an example organic search what you

Will Solr support google like organic search ?

2017-06-09 Thread Geepalem
Hi Guys, We have been asked by client to implement Organic Search like Google. As, we are using Solr for Search implementation in project, I am trying to find out whether its possible to implement Organic Search with Solr or not. Could you please answer below questions ASAP? • Will Solr

IgnoreCommitOptimizeUpdateProcessorFactory

2017-06-09 Thread Neeraj Bhatt
Hi All We want to use IgnoreCommitOptimizeUpdateProcessorFactory so that we can ignore commits from client But we want to give freedom to client to do a soft commit instead So is there a way so that IgnoreCommitOptimizeUpdateProcessorFactory works only on hard commit Thanks Neeraj

Solr 6.6 UNLOAD core broken?

2017-06-09 Thread Andreas Hubold
Hi, I just tried to update from Solr 6.5.1 to Solr 6.6.0 and observed a changed behaviour with regard to unloading cores in Solr standalone mode. After unloading a core using the CoreAdmin API (e.g. via Admin UI), I still get search results for that core. It seems, the search request

Re: JMX property keys

2017-06-09 Thread Emir Arnautovic
Hi Ari, It is common that way app is reporting metric is not monitoring friendly. It is not just how it is named but also some metrics require you to create statefull monitoring agent in order to be able to display them on time axis. I am not aware that this can be overridden for Solr, but

Re: Configuration of parallel indexing threads

2017-06-09 Thread gigo314
Thanks a lot! -- View this message in context: http://lucene.472066.n3.nabble.com/Configuration-of-parallel-indexing-threads-tp4338466p4339792.html Sent from the Solr - User mailing list archive at Nabble.com.