Re: Large Number of Collections takes down Solr 7.3

2019-01-28 Thread Gus Heck
Does it all have to be in a single cloud? On Mon, Jan 28, 2019, 10:34 PM Shawn Heisey On 1/28/2019 8:12 PM, Monica Skidmore wrote: > > I would have to negotiate with the middle-ware teams - but, we've used a > core per customer in master-slave mode for about 3 years now, with great > success.

Re: Large Number of Collections takes down Solr 7.3

2019-01-28 Thread Shawn Heisey
On 1/28/2019 8:12 PM, Monica Skidmore wrote: I would have to negotiate with the middle-ware teams - but, we've used a core per customer in master-slave mode for about 3 years now, with great success. Our pool of data is very large, so limiting a customer's searches to just their core keeps

Solrcloud TimeoutException: Idle timeout expired

2019-01-28 Thread Schaum Mallik
I am seeing this error in our logs. Our Solr heap is set to more than 10G. Any clues which anyone can provide will be very helpful. Thank you null:java.io.IOException: java.util.concurrent.TimeoutException: Idle timeout expired: 12/12 ms at

Re: Large Number of Collections takes down Solr 7.3

2019-01-28 Thread Monica Skidmore
I would have to negotiate with the middle-ware teams - but, we've used a core per customer in master-slave mode for about 3 years now, with great success. Our pool of data is very large, so limiting a customer's searches to just their core keeps query times fast (or at least reduces the

Solr 5.2.1 replication hangs possibly during segment merge after a delete operation

2019-01-28 Thread Ravi Prakash
I have a situation where I am trying to setup a once daily cron job on the master node to delete old documents from the index based on our retention policy. I delete only 1days worth of data based on my schema which deletes couple of 1000 docs and not more. This is a test cluster and the doc

Zookeeper restart on solr basic authentication password change

2019-01-28 Thread Schaum Mallik
I recently updated the password on our 3 node solr cloud. We have 3 zookeeper ensemble serving it. I have one question. Do I need to restart the zookeeper ensemble after password change? Thank you

Re: Bad type on operand stack: SolrInputDocument not assignable to SolrDocumentBase

2019-01-28 Thread Shawn Heisey
On 1/28/2019 7:45 AM, Will Martin wrote: We are deployed across the globe in many regions with different use patterns. Spring-data-solr is front and center for us and has proven pretty darn stable. "There can be some very strange problems when trying to use SolrJ with Spring.” I'll start

Re: Active node "kicked out" when starting a new node

2019-01-28 Thread Erick Erickson
Also, the core name is presumed to be a unique identifier. So when you say you "cloned" the machine, did you also clone the entire replica's directory? Ss Scott says, the core.properties file contains, among other things, the coreNodeName of which there should be one and only one per collection.

Re: PatternReplaceFilterFactory problem

2019-01-28 Thread Alexandre Rafalovitch
In Admin UI, there is an Analysis screen. You can enter your text and your query there and see what happens to it at every step of the processing pipeline. This should tell you whether the problem is in indexing, query, or somewhere else entirely (e.g. you are querying a different field as Scott

Number of segments in collection is more than what is set in TieredMergePolicyFactory

2019-01-28 Thread Zheng Lin Edwin Yeo
Hi, We have the following TieredMergePolicyFactory configuration in our solrconfig,xml 10 10 10 10 5120 0.1 2048 10.0 However, when we index data to the collection, the number of segments that we are getting does not match what we

MLT - unexpected design choice

2019-01-28 Thread Maria Mestre
Hi all, First of all, I’m not a Java developer, and a SolR newbie. I have worked with Elasticsearch for some years (not contributing, just as a user), so I think I have the basics of text search engines covered. I am always learning new things though! I created an index in SolR and used

Re: Bad type on operand stack: SolrInputDocument not assignable to SolrDocumentBase

2019-01-28 Thread Will Martin
Hi Shawn: We are deployed across the globe in many regions with different use patterns.Spring-data-solr is front and center for us and has proven pretty darn stable. "There can be some very strange problems when trying to use SolrJ with Spring.”Could you expand on this, so that we might know what

Re: PatternReplaceFilterFactory problem

2019-01-28 Thread Scott Stults
Hi Chris, You've included the field definition of type text_en, but in your queries you're searching the field "text", which is of type text_general. That may be the source of your problem, but if looking into that doesn't help send the definition of text_general as well. Hope that helps!

Re: Aggregate functions

2019-01-28 Thread Scott Stults
Yes. Have a look at the Facet API: https://lucene.apache.org/solr/guide/7_5/json-facet-api.html On Mon, Jan 28, 2019 at 6:07 AM naga pradeep dhulipalla < naga.prade...@gmail.com> wrote: > Hi Team, > > > > Can we use SUM aggregate function in our SOLR queries. If not is there an > alternative to

Aggregate functions

2019-01-28 Thread naga pradeep dhulipalla
Hi Team, Can we use SUM aggregate function in our SOLR queries. If not is there an alternative to achieve this. My sample query looks like this as mentioned below. Select duration from tableName where solr_query='{"q":"(appName:\"test\")"}' I need the aggregate SUM value of duration

PatternReplaceFilterFactory problem

2019-01-28 Thread Chris Wareham
I'm trying to index some data which often includes domain names. I'd like to remove the .com TLD, so I have modified the text_en field type by adding a PatternReplaceFilterFactory filter. However, it doesn't appear to be working as a search for "text:(mydomain.com)" matches records but

Re: Region wise query routing with solr

2019-01-28 Thread Scott Stults
Hi Shruti, Solr clusters should NOT span regions, so when a query hits a particular cluster in a region that query should be handled by nodes in that region and not forwarded to another. My recommendation is to check out cross-datacenter replication and route requests to the correct region (with

Re: Active node "kicked out" when starting a new node

2019-01-28 Thread Scott Stults
Hi Teddie, Take a look at the core.properties file on the cloned or clone. I suspect there's info in it that describes which collection and shard that node is responsible for. Zookeeper maintains a mapping of node addresses to cores and you can lock a node out of the cluster if you're not

Re: Log Statements: Collection, Shard, Replica, and Core Info Missing

2019-01-28 Thread Scott Stults
Hi Alicia, You've probably already tried this but just to check all the basics, verify that each log4j2.xml file is the same on all of your servers. Then go to the logging config admin page on each machine and verify that none of the overrides have been enabled. The overrides there are temporary,

Re: SPLITSHARD not working as expected

2019-01-28 Thread Jan Høydahl
This is normal. Please read https://lucene.apache.org/solr/guide/7_6/collections-api.html#splitshard PS: Images won't make it to the list, but don't think you need a screenshot here, what you describe is the default behaviour. -- Jan Høydahl, search solution architect Cominvent AS -

SPLITSHARD not working as expected

2019-01-28 Thread Rahul Goswami
Hello, I am using Solr 7.2.1. I created a two node example collection on the same machine. Two shards with two replicas each. I then called SPLITSHARD on shard2 and expected the split shards to have one replica on each node. However I see that for shard2_1, both replicas reside on the same node.