AW: Occasionally getting error in solr suggester component.

2015-06-01 Thread Clemens Wyss DEV
Lucene 5.1: I am (also) facing java.lang.IllegalStateException: suggester was not built At the very moment no new documents seem tob e added to the index/core. Will a reboot sanitize the index/core? I (still) have str name=buildOnCommittrue/str How can I tell Solr to peridoically update the

Synonyms within FQ

2015-06-01 Thread John Blythe
morning everyone, i'm attempting to find related documents based on a manufacturer's competitor. as such i'm querying against the 'description' field with manufacturer1's product description but running a filter query with manufacturer2's name against the 'mfgname' field. one of the ways that we

Re: Synonyms within FQ

2015-06-01 Thread John Blythe
after further investigation it looks like the synonym i was testing against was only associated with one of their multiple divisions (despite being the most common name for them!). it looks like this may clear the issue up, but thanks anyway! -- *John Blythe* Product Manager Lead Developer

UI Admin - and stored=false fields

2015-06-01 Thread Sznajder ForMailingList
Hi I am indexing some content under text field. In the schema.xml text field is defined as : field name=text type=text_general indexed=true stored=false multiValued=true/ However, when I am looking to the documents via the UI http://localhost:8983/solr/#/sec_600b/query I see the text

Re: Number of clustering labels to show

2015-06-01 Thread Alessandro Benedetti
Only to clarify the initial mail, The carrot.fragSize has nothing to do with the number of clusters produced. When you select to work with field summary ( you will work only on snippets from the original content, snippets produced by the highlight of the query in the content), the fragSize will

Re: Deleting Fields

2015-06-01 Thread Charlie Hull
On 30/05/2015 00:30, Shawn Heisey wrote: On 5/29/2015 5:08 PM, Joseph Obernberger wrote: Hi All - I have a lot of fields to delete, but noticed that once I started deleting them, I quickly ran out of heap space. Is delete-field a memory intensive operation? Should I delete one field, wait a

Best strategy for logging security

2015-06-01 Thread Vishal Swaroop
It will be great if you can provide your valuable inputs on strategy for logging security... Thanks a lot in advance... Logging : - Is there a way to implement logging for each cores separately. - What will be the best strategy to log every query details (like source IP, search query,

Re: UI Admin - and stored=false fields

2015-06-01 Thread Erick Erickson
That's the whole point of having a true/false option for stored. Stored=true implies that those fields are available for display to the user in results lists. stored=false and they're not. Best, Erick On Mon, Jun 1, 2015 at 4:34 AM, Sznajder ForMailingList bs4mailingl...@gmail.com wrote: Hi I

Re: Synonyms within FQ

2015-06-01 Thread John Blythe
Thanks Erick! On Mon, Jun 1, 2015 at 11:29 AM, Erick Erickson erickerick...@gmail.com wrote: For future reference, fq clauses are parsed just like the q clause; they can be arbitrarily complex. Best, Erick On Mon, Jun 1, 2015 at 5:52 AM, John Blythe j...@curvolabs.com wrote: after further

Re: Occasionally getting error in solr suggester component.

2015-06-01 Thread Erick Erickson
Attach suggester.build=true or suggester.buildAll=true to any request to suggester to rebuild. OR add buildOnStartup or buildOnCommit or buildOnOptimize to the definition in solrConfig. BUT: building can be a _very_ expensive operation. For document-based indexes, the build process reads through

Re: Sorting in Solr

2015-06-01 Thread Shawn Heisey
On 6/1/2015 9:29 AM, Steven White wrote: I need to be able to sot in Solr. Obviously, I need to do this in a way sorting won't cause OOM when a result may contain 1000's of hits if not millions. Can you guide me on how I can do this? Is there a way to tell Solr sort top N results

Re: Synonyms within FQ

2015-06-01 Thread Erick Erickson
For future reference, fq clauses are parsed just like the q clause; they can be arbitrarily complex. Best, Erick On Mon, Jun 1, 2015 at 5:52 AM, John Blythe j...@curvolabs.com wrote: after further investigation it looks like the synonym i was testing against was only associated with one of

Sorting in Solr

2015-06-01 Thread Steven White
Hi everyone, I need to be able to sot in Solr. Obviously, I need to do this in a way sorting won't cause OOM when a result may contain 1000's of hits if not millions. Can you guide me on how I can do this? Is there a way to tell Solr sort top N results (discarding everything else) or must such

Re: UI Admin - and stored=false fields

2015-06-01 Thread Erik Hatcher
Did you happen to change the field type definition without reindexing? (it requires reindexing to “unstore” them if they were originally stored) If you’re seeing a field value in a document result (not facets, those are driven by indexed terms) when stored=“false” then something is wrong and

Re: UI Admin - and stored=false fields

2015-06-01 Thread Erick Erickson
Reset, pay attention to Erik. I didn't read it all the way through. Erick On Mon, Jun 1, 2015 at 8:27 AM, Erick Erickson erickerick...@gmail.com wrote: That's the whole point of having a true/false option for stored. Stored=true implies that those fields are available for display to the user

Re: Sorting in Solr

2015-06-01 Thread Erick Erickson
Steve: Surprisingly, the number of hits is completely irrelevant for the memory requirements for sorting. The base memory size is, AFAIK, an array of maxDoc ints (you can find maxDoc on the admin screen). There's some additional overhead, but that's the base size. If you sue DocValues, much of

Re: fq and defType

2015-06-01 Thread Shawn Heisey
On 6/1/2015 10:44 AM, david.dav...@correo.aeat.es wrote: I need to parse some complicated queries that only works properly with the edismax query parser, in q and fq parameters. I am testing with defType=edismax, but it seems that this clause only affects to the q parameter. Is there any

fq and defType

2015-06-01 Thread david . davila
Hello, I need to parse some complicated queries that only works properly with the edismax query parser, in q and fq parameters. I am testing with defType=edismax, but it seems that this clause only affects to the q parameter. Is there any way to set edismax to the fq parameter? Thank you very

Re: Deleting Fields

2015-06-01 Thread Joseph Obernberger
Hi - we are using 64bit OS and 64bit JVM. The JVM settings are currently: - -DSTOP.KEY=solrrocks -DSTOP.PORT=8100 -Dhost=helios -Djava.net.preferIPv4Stack=true -Djetty.port=9100 -DnumShards=27 -Dsolr.clustering.enabled=true -Dsolr.install.dir=/opt/solr

Re: fq and defType

2015-06-01 Thread david . davila
Thank you! David De: Shawn Heisey apa...@elyograg.org Para: solr-user@lucene.apache.org, Fecha: 01/06/2015 18:53 Asunto: Re: fq and defType On 6/1/2015 10:44 AM, david.dav...@correo.aeat.es wrote: I need to parse some complicated queries that only works properly with the edismax

Chef recipes for Solr

2015-06-01 Thread Walter Underwood
Anyone have Chef recipes they like for deploying Solr? I’d especially appreciate one for uploading the configs directly to a Zookeeper ensemble. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog)

Re: Best strategy for logging security

2015-06-01 Thread Rajesh Hazari
Logging : Just use logstash to a parse your logs for all collection and logstash forwarder and lumberjack at your solr replicas in your solr cloud to send the log events to you central logstash server and send it to back to solr (either the same or different instance) to a different collection.

Multiple Word Synonyms with Autophrasing

2015-06-01 Thread Chris Morley
Hello everyone @ solr-user, At Wayfair, I have implemented multiple word synonyms in a clean and efficient way in conjunction with with a slightly modified version of the LucidWorks' Autophrasing plugin by also tacking on a modified version of edismax. It is not released or on use on our

Re: Best strategy for logging security

2015-06-01 Thread Vishal Swaroop
Thanks Rajesh... just trying to figure out if *logstash *is opensource and free ? On Mon, Jun 1, 2015 at 2:13 PM, Rajesh Hazari rajeshhaz...@gmail.com wrote: Logging : Just use logstash to a parse your logs for all collection and logstash forwarder and lumberjack at your solr replicas in

Re: fq and defType

2015-06-01 Thread Mikhail Khludnev
fq={!edismax}you are welome On Mon, Jun 1, 2015 at 6:44 PM, david.dav...@correo.aeat.es wrote: Hello, I need to parse some complicated queries that only works properly with the edismax query parser, in q and fq parameters. I am testing with defType=edismax, but it seems that this clause

Re: solr uima and opennlp

2015-06-01 Thread Tommaso Teofili
yeah, I think you'd rather post it to d...@uima.apache.org . Regards, Tommaso 2015-05-28 15:19 GMT+02:00 hossmaa andreea.hossm...@gmail.com: Hi Tommaso Thanks for the quick reply! I have another question about using the Dictionary Annotator, but I guess it's better to post it separately.

SolrCloud 5.1 startup looking for standalone config

2015-06-01 Thread tuxedomoon
I followed these steps and I am unable to launch in cloud mode. 1. created / started 3 external Zookeeper hosts: zk1, zk2, zk3 2. installed Solr 5.1 as a service called solrsvc on two hosts: s1, s2 3. uploaded a configset to zk1 (solr home is /volume/solr/data)

Derive suggestions across multiple fields

2015-06-01 Thread Zheng Lin Edwin Yeo
Hi, Does anyone knows if we can derive suggestions across multiple fields? I tried to set something like this in my field in suggest searchComponents in solrconfig.xml, but nothing is returned. It only works when I set a single field, and not multiple field. searchComponent

Re: Chef recipes for Solr

2015-06-01 Thread Walter Underwood
That sounds great. Someone else here will be making the recipes, so I’ll put him in touch with you. As always, this is a really helpful list. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) On Jun 1, 2015, at 10:20 PM, Upayavira u...@odoko.co.uk wrote:

Re: SolrCloud 5.1 startup looking for standalone config

2015-06-01 Thread Erick Erickson
bq: but aren't the config files supposed to be in Zookeeper Yes, but you haven't done anything to tell Solr that the nodes you've created are part of SolrCloud! You're confusing, I think, core discovery with creating collections. Basically you were pretty much OK up until step 5 (although I'm

Re: Number of clustering labels to show

2015-06-01 Thread Zheng Lin Edwin Yeo
Thank you so much Alessandro. But i do not find any difference with the quality of the clustering results when I change the hl.fragszie to a even though I've set my carrot.produceSummary to true. Regards, Edwin On 1 June 2015 at 17:31, Alessandro Benedetti benedetti.ale...@gmail.com wrote:

Re: Chef recipes for Solr

2015-06-01 Thread Upayavira
I have many. My SolrCloud code has the app push configs to zookeeper. I am afk at the mo. Feel free to bug me about it! Upayavira On Mon, Jun 1, 2015, at 07:29 PM, Walter Underwood wrote: Anyone have Chef recipes they like for deploying Solr? I’d especially appreciate one for uploading