Re: Use case for storing positions and offsets in index?
Thanks Jack Jason - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Use-case-for-storing-positions-and-offsets-in-index-tp4061376p4061890.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr 1.4 - Proximity Search - Where is configuration for storing positions?
I have an index built using Solr 1.4 with one field. I was able to run proximity search (Ex: word1 within5 word2) but no where in the configuration I see any information about storing/indexing the positions or offsets of the terms. My understanding is that we need to store/index termvectors positions/offsets for proximity search to work. Can someone please tell if positions are indexed by default in Solr 1.4? FYI, Here is the configuration of field in schema.xml (to keep it simple I am only adding fieldType and field definition from schema.xml here) fieldtype class=solr.TextField name=string omitNorms=true sortMissingLast=true analyzer type=index tokenizer class=solr.StandardTokenizerFactory / filter class=solr.LowerCaseFilterFactory / filter class=solr.StopFilterFactory enablePositionIncrements=true ignoreCase=true words=stop-words.txt / /analyzer /fieldtype field indexed=true multiValued=false name=contents stored=true type=string / Thanks -kRider - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-1-4-Proximity-Search-Where-is-configuration-for-storing-positions-tp4061315.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Solr 1.4 - Proximity Search - Where is configuration for storing positions?
Thanks Markus. - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-1-4-Proximity-Search-Where-is-configuration-for-storing-positions-tp4061315p4061325.html Sent from the Solr - User mailing list archive at Nabble.com.
Storing positions and offsets vs FieldType IndexOptions DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
I see that Lucene 4.x has FieldInfo.IndexOptions that can be used to tell lucene whether to Index Documents/Frequencies/Positions/Offsets. We are in the process of upgrading from Lucene 2.9 to Lucene 4.x and I was wondering if there was a way to tell lucene whether to index docs/freqs/pos/offsets or not in the older versions (2.9) or did it always index positions and offsets by default? Also I see that Lucene 4.x has FieldType.setStoreTermVectorPositions and FieldType.setStoreTermVectorOffsets. Can someone please tell me a usecase for storing positions and offsets in index? Is it necessary to store termvector positions and offsets when using IndexOptions.DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS? Thanks -kRider - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-positions-and-offsets-vs-FieldType-IndexOptions-DOCS-AND-FREQS-AND-POSITIONS-AND-OFFSETS-tp4061354.html Sent from the Solr - User mailing list archive at Nabble.com.
Use case for storing positions and offsets in index?
Can someone please tell me the usecase for storing term positions and offsets in the index? I am trying to understand the difference between storing positions/offsets vs indexing positions/offsets. Thanks KR - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Use-case-for-storing-positions-and-offsets-in-index-tp4061376.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Storing positions and offsets vs FieldType IndexOptions DOCS_AND_FREQS_AND_POSITIONS_AND_OFFSETS
Thanks Shawn. I'll reach out to Lucene discussion group. - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Storing-positions-and-offsets-vs-FieldType-IndexOptions-DOCS-AND-FREQS-AND-POSITIONS-AND-OFFSETS-tp4061354p4061457.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr - Index Concurrency - Is it possible to have multiple threads write to same index?
Thanks for the Reply Lance. From your post my understanding is that Solr commiters are more focussed on http solr than EmbeddedSolrServer and EmbeddedSolrServer may not be tested for all features supported by http solr. Said that, can you please tell if there is any justification/usecase for using EmbeddedSolrServer? Reason am asking is if EmbeddedSolrServer is not advised by Solr committers than why don't they deprecate it and force users to go http solr route instead of EmbeddedSolrServer. Just trying to understand if there is any valid use-case for using EmbeddedSolrServer. We currently have EmbeddedSolrServer with multi-core setup (one core per client and size of each core/index is in the range of 20G-70G) integrated in our web application and it has been working fine for us but after reading the responses I am now wondering if we should be moving towards Http Solr and what benefit we might get if EmbeddedSolrServer is replaced with Http Solr. For replication we have been using rsync tool and it has been working fine for us. Also for our needs (below) do you suggest Http Solr or EmbeddedSolrServer. 1) Indexing Speed is more important than flexibility 2) Have huge text articles/blog files (2 MB) that needs to be parsed from filesystem and indexed. Our index size will be in the range of 20 GB - 70 GB per core. And there is a core for each client. 3) Need to store all the data in the index because we absolutely need the highlighter feature working and reading through Solr documentation I found that Highlighter can be used only when data is stored. 4) We also need to store positions and offsets because we need to be able to use phrase queries and also need the position of the terms in search result documents. Thanks K'Rider - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Index-Concurrency-Is-it-possible-to-have-multiple-threads-write-to-same-index-tp4002544p4003622.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr - Index Concurrency - Is it possible to have multiple threads write to same index?
One other thing i forgot to mention is - multicore setup we have requires us to be able to add cores dynamically and i am not sure if thats supported by http solr out-of-the-box. - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Index-Concurrency-Is-it-possible-to-have-multiple-threads-write-to-same-index-tp4002544p4003623.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Custom Filter Factory - How to pass parameters?
Can someone please point to some samples on how to implement custom SolrEventListeners? Whats the default behavior of Solr when no SolrEventListeners are configured in solrconfig.xml. I am trying to understand how does custom listener fit in with default listeners (if there are any) Thanks -K'Rider - Thanks -K'Rider -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Custom-Filter-Factory-How-to-pass-parameters-handle-PostProcessing-tp4002217p4003014.html Sent from the Solr - User mailing list archive at Nabble.com.
