Removing SOLR fields from schema

Hi, We use SOLR 5.x in cloud mode and have huge set of fields. We now want to remove some 50 fields from Index/schema itself so that indexing & querying will be faster. Is there a way to do that without losing existing data on other fields? We don't want to do full re-indexing. -- Regards,

RE: SolrCloud setup

HI, For starters, the below blog looks good for Windows installation. http://blog.thedigitalgroup.com/susheelk/2015/08/03/solrcloud-2-nodes-solr-1-node-zk-setup/ Thanks and Regards, Preeti -Original Message- From: John Bickerstaff [mailto:j...@johnbickerstaff.com] Sent: Thursday,

Re: SolrCloud setup

I found it to be way less than intuitive when I first started to get going. I wished for an example or step by step (including zookeeper) Pulling it all together from the docs wasn't straightforward although I guess the info is still there. I'll send you my rough notes in case they're

Re: SolrCloud setup

Setting up SolrCloud on multiple hosts is exactly the same as a single host. You just install Solr on all the hosts you care about and start it up. As long as the hosts can talk to each other via HTTP, it's all magic. The "glue" is Zookeeper. All the Solrs are started up with the same ZK ensemble

Re: SOLR Disk Access Latency Problem

That sounds like some SAN vendor BS if you ask me. Breaking up 300gb into smaller chunks would only be relevant if they were caching entire files not blocks and I find that hard to believe. Would be interested to know more about the specifics of the problem as the vendor sees it. As Shawn said

solr index in hdfs perfomance

Hi, I am learning solr rencently, and I have some problems. Please help me and I will thank you very much. I stored indexes in HDFS directory, the update performance I got with solrmeter showed that: (1) the perfomance that storing index in local filesystem is about 7

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

Could you share the field and type definition and the type of query you are doing. Under the covers, multi valued fields are mostly the same as multi term strings, just with large gaps between term positions. And if you return the same set of fields, rehydration of the document should be the

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

I did 3 sets of query as followed: - multi-value field only : slow - single field value: fast - multi-value and single field combine: slow So yes, the difference is base on which field you search against. I'm experiencing the same issue described here:

SolrCloud setup

Can someone point me to a tutorial or blog to setup SolrCloud on multiple hosts? LucidWorks just have a trivial single host example. I searched around but only found some blogs for older versions (2014 or earlier). thanks.

Re: SOLR Disk Access Latency Problem

On 9/21/2016 7:52 AM, Kyle Daving wrote: > We are currently running solr 5.2.1 and attempted to upgrade to 6.2.1. > We attempted this last week but ran into disk access latency problems > so reverted back to 5.2.1. We found that after upgrading we overran > the NVRAM on our SAN and caused a fairly

Re: leader/replica update error + client "expected mime type/stale state" error

On 9/21/2016 10:48 AM, Brent wrote: > Okay, I'll try to figure out how to making using to the latest feasible... my > situation is that I need to be able to talk to both DSE and Solr from the > same application, and 5.4.1 is the latest version that works with DSE. > > But this issue appears to be

Re: Very Slow Commits After Solr Index Optimization

On 9/20/2016 4:13 PM, vsolakhian wrote: > We knew that optimization is not a good idea and it was discussed in forums > that it should be completely removed from API and Solr Admin, but discussing > is one thing and doing it is another. To make the story short, we tried to > optimize through Solr

Re: Performance Issue when querying Multivalued fields [SOLR 6.1.0]

Do you _return_ the same set of fields in both queries? Is the difference truly just which field you search against? Regards, Alex On 22 Sep 2016 3:03 AM, "slee" wrote: > I've been doing a lot of reading on this forum with regards to performance > on > multivalued

Performance Issue when querying Multivalued fields [SOLR 6.1.0]

I've been doing a lot of reading on this forum with regards to performance on multivalued fields, and nothing helps. When I query on singlie fields, the response time is fairly quick (typically < 1sec). However, when I query on multivalued fields, the response is > 2 mins ~ 3 mins. Here's my

Re: solr-5.2.1: All folders in solr box(Linux) are sitting in RAM

Hi Eric, Thanks a lot. Got the point. On Sep 21, 2016 10:18 PM, "Erick Erickson" wrote: > Why do you want to avoid this? Having the index in RAM (either the JVM or > OS) > is essential to fast querying. Perhaps you're being mislead by the > MMapDirectory's >

Re: Tutorial not working for me

: FWIW, my next step was to work with the movie example file, which worked : perfectly and was a much, much better "getting started" intro. You could do : worse than to build a new tutorial/getting started from this example. : Dataset is way more fun, too -- a quality that should never be :

Re: Hackday next month

I know a bunch of folks who would be likely attend the hackday (including committers) will have some other meetings on Wednesday before the conference, so I think that Tuesday is actually a pretty good time to have this. My 2 cents, Trey Grainger SVP of Engineering @ Lucidworks Co-author, Solr

Re: Hackday next month

This is good but is there a way to instead do this on Wednesday? Considering that the conference starts on Thursday, perhaps it makes sense to do it just a day before ? Not sure about others but it certainly would work much better for me. -Anshum On Wed, Sep 21, 2016 at 2:18 PM Charlie Hull

Re: leader/replica update error + client "expected mime type/stale state" error

Okay, I'll try to figure out how to making using to the latest feasible... my situation is that I need to be able to talk to both DSE and Solr from the same application, and 5.4.1 is the latest version that works with DSE. But this issue appears to be stemming from the Solr side. The client logs

Re: solr-5.2.1: All folders in solr box(Linux) are sitting in RAM

Why do you want to avoid this? Having the index in RAM (either the JVM or OS) is essential to fast querying. Perhaps you're being mislead by the MMapDirectory's consumption of the OS memory? See Uwe's excellent article here: http://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html

Re: leader/replica update error + client "expected mime type/stale state" error

On 9/20/2016 9:40 PM, Brent P wrote: > I'm running Solr Cloud 6.1.0, with a Java client using SolrJ 5.4.1. Don't do that. To successfully run mis-matched versions with SolrCloud, SolrJ should be *newer* than Solr. SolrCloud is evolving so rapidly that mixing SolrJ and Solr versions isn't

RE: Solrcloud with rest api

My understanding is if you use solrj, it can connect to zookeeper and then zookeeper will tell soljr client which solrcloud node (or possibly nodes) to make requests to. So it achieves load balancing but it isn't a load balancer in the same sense that something like HAProxy is. To make search

Re: Solrcloud with rest api

This link has more info http://lucene.472066.n3.nabble.com/Configure-SolrCloud-for-Loadbalance-for-net-client-td4280074.html Another suggestion to consider. If you are able to use Java for developing the search API/service/client then please explore this option since that will make life easier

Issues with setting RequestHandler via qt

Hello, I am writing this question in reference to the stackoverflow question http://stackoverflow.com/questions/39596832/solrj-not-setting-request-handler. There were no solutions there and it was recommended that I email this list for a possible solution. See that question for screenshots

Re: Tutorial not working for me

FWIW, my next step was to work with the movie example file, which worked perfectly and was a much, much better "getting started" intro. You could do worse than to build a new tutorial/getting started from this example. Dataset is way more fun, too -- a quality that should never be underestimated

RE: Solrcloud with rest api

Hi Jon, Thanks for quick reply. I have below questions: 1) zookeeper acts as load balancer right? 2)Do we need to setup separate load balancer to access the zookeeper for .net? Thanks, Preeti Sent from my Windows Phone From: Jon

Re: Alternative to REST Interface?

On Wed, 2016-09-21 at 13:05 +, Veit, Marcus (marcus.veit@uni- graz.at) wrote: > My Questeion: Is there an Alternative to "REST/HTTP GET" in solr? > E.g. POST or something else? The answer is simply that: Use POST. You can test it with 'curl -d'. I seem to remember the default POST limit for

SOLR Disk Access Latency Problem

Hi All, We are currently running solr 5.2.1 and attempted to upgrade to 6.2.1. We attempted this last week but ran into disk access latency problems so reverted back to 5.2.1. We found that after upgrading we overran the NVRAM on our SAN and caused a fairly large queue depth for disk access

Re: Hackday next month

This is great, I'll try to make it up to Boston a day earlier for this. Joel Bernstein http://joelsolr.blogspot.com/ On Wed, Sep 21, 2016 at 8:17 AM, Charlie Hull wrote: > Hi all, > > If you're coming to Lucene Revolution next month in Boston, we're running > a

RE: Solrcloud with rest api

Things may have changed but a couple of months ago when my colleague was working on something similar he reported that SolrNet was not able to talk to solrCloud via zookeeper, so we had to set up a load balancer so that our SolrNet client applications could send updates to our solrCloud

Solrcloud with rest api

Hi All, We are trying to access the solrcloud using rest API in .net. But we are not sure how to access the zookeeper setup here. Could someone please guide us Thanks, Preeti Sent from my Windows Phone NOTICE TO RECIPIENTS: This communication may contain confidential and/or privileged

Alternative to REST Interface?

Hi list, I am using Solr 4.6.1 and the REST Interface () Using fq and field.facets the query string is growing more and more. E.g.: fq=(field_1:"abc" OR field_1:"def") AND (field2:"ghi")" and so forth... If the request comes up to 8192 bytes, I get an error. Ok it is the limit of the

Hackday next month

Hi all, If you're coming to Lucene Revolution next month in Boston, we're running a Lucene-focused hackday (Lucene, Solr, Elasticsearch) kindly hosted by BA Insight. There will be Lucene committers there, it's free to attend and we also need ideas on what to do! Come and join us.

Re: Search with the start of field

Thanks all, I think SpapnFirstQuery will solve my problem. But does Solr 4.8 supports xmlparser to use it? and does SpanFirst supports phrase search instead of single term? Thanks, Mahmoud On Wed, Sep 21, 2016 at 10:45 AM, Markus Jelsma wrote: > Yes, definately

Re: JNDI settings

On 13/09/2016 1:29am, Aristedes Maniatis wrote: > I am using Solr 5.5 and wanting to add JNDI settings to Solr (for data > import). I'm new to Solr Cloud setup (previously I was running Solr running > as a custom bundled war) so I can't figure where to put the JNDI settings > with user/pass

Solr : DataImport failed from Cassandra due to TimedOut Exception

Hi I am new to solr just exploring how the solr is working . I did the import from cassandra database to solr . It imported successfully for 500 records(i.e one records = 36 doc in solr) .For next 100 records it is throwing"java.sql.SQLTransientConnectionException: TimedOutException()" Below

RE: Search with the start of field

Yes, definately SpanFirstQuery! But i didn't know you can invoke it via XMLQueryParser, thank Mikhail for that! There is a tiny drawback to SpanFirst, there is no gradient boosting depending on distance from the beginning. Markus -Original message- > From:Mikhail Khludnev

solr-5.2.1: All folders in solr box(Linux) are sitting in RAM

Hi all, i have a linux box with 48GB RAM . In this box i have solr and jdk installed. i have few other folders as well. [solruser@server1 ~]$ du -sh * 4.0Kclusterstate.json 1.5MConf 15G jdk1.8.0_25 151Mjdk_old 262Mjvm_1.7 538Mscripts 11G solrhome My actual index

Re: JSON Facet API

Thanks a lot, Bram. I will try that ...  SRK On Wednesday, September 21, 2016 11:57 AM, Bram Van Dam wrote: On 21/09/16 05:40, Sandeep Khanzode wrote: > How can I specify JSON Facets in SolrJ? The below facet query for example ... SolrQuery query = new

Re: Search with the start of field

You could do a hack with the field type similar to this text_lower_exact type: https://github.com/cominvent/exactmatch/blob/master/conf/schema.xml But if you only do the hack on the “index” side of analysis, you are free to do

Re: Search with the start of field

You can experiment with {!xmlparser}.. see https://cwiki.apache.org/confluence/display/solr/Other+Parsers#OtherParsers-XMLQueryParser On Wed, Sep 21, 2016 at 9:06 AM, Mahmoud Almokadem wrote: > Hello, > > What is the best way to search with the start token of field? > >

request SOLR - spatial field with Intersect and Contains functions

Hi list, I am trying spatial search in SOLR 5.0 and I don't know how to implement a solution for the problem I will try to explain. On a SOLR server I have indexed a collection of objects that contains spacial field : multiValued="true" /> class="solr.SpatialRecursivePrefixTreeFieldType"

Re: Month facet - possible bucket values are Jan, Feb, Mar,…. Nov, Dec

Extending on Erik’s proposal with facet.query, you could of course develop a custom Function which takes a date field as input and returns the month number between 1-12. When used in a facet you would need to select only one month value at a time, and frange QParser could be used for that. It

Re: JSON Facet API

On 21/09/16 05:40, Sandeep Khanzode wrote: > How can I specify JSON Facets in SolrJ? The below facet query for example ... SolrQuery query = new SolrQuery(); query.add("json.facet", jsonStringGoesHere); - Bram

Re: Search with the start of field

Show us the FieldType and Field definitions. On Wed, Sep 21, 2016 at 12:06 AM, Mahmoud Almokadem wrote: > Hello, > > What is the best way to search with the start token of field? > > For example: the field contains these values > > Document1: ABC DEF GHI > Document2:

Search with the start of field

Hello, What is the best way to search with the start token of field? For example: the field contains these values Document1: ABC DEF GHI Document2: DEF GHI JKL when I search with DEF, I want to get Document2 only. Is that possible? Thanks, Mahmoud