Re: Group by and filtering on child documents.

2019-06-04 Thread Jai Jamba
Hello Mikhail, I am sorry, I forgot to include below in my main query json (*"fields": "* [child limit=-1]"*) . I am extracting all the fields along with its nested docs. So I want as a part of results and not part of facet. I would expect out of the docs that i listed, it should return only

Re: Solr Heap Usage

2019-06-04 Thread Greg Harris
Just a couple of points I’d make here. I did some testing a while back in which if no commit is made, (hard or soft) there are internal memory structures holding tlogs and it will continue to get worse the more docs that come in. I don’t know if that’s changed in further versions. I’d recommend

Re: Copy index from lower environment to Production | SolrCloud

2019-06-04 Thread Rohan Kasat
Thank you so much Erick. Will check these out. Regards, Rohan Kasat On Tue, Jun 4, 2019 at 12:54 PM Erick Erickson wrote: > > (t’s usually far easier to create a new collection in your upper > environment and index to _that_. Once the indexing is done, use the > Collections API CREATEALIAS

Re: NullPointerException with ExpandComponent on Collapsed Null Values

2019-06-04 Thread Joel Bernstein
This should be considered a bug. Feel free file jira for this. Joel Bernstein http://joelsolr.blogspot.com/ On Tue, Jun 4, 2019 at 9:16 AM aus...@3bx.org.INVALID wrote: > Just wanted to provide a bit more information on this issue after > experimenting a bit more. > > The error I've

Re: Solr test framework not able to upload configuration to zk and fails with KeeperException

2019-06-04 Thread Angie Rabelero
For what I know the configuration files need to be already in the test/resource directory before runnin. I copy them to the directory using a maven maven-antrun-plugin in the generate-test-sources phase. And the framework can "create a collection” without the configfiles, but it will obviously

No files to download for index generation

2019-06-04 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
We have occasionally been seeing an error such as the following: 2019-06-03 23:32:45.583 INFO (indexFetcher-45-thread-1) [ ] o.a.s.h.IndexFetcher Master's generation: 1424625 2019-06-03 23:32:45.583 INFO (indexFetcher-45-thread-1) [ ] o.a.s.h.IndexFetcher Master's version: 1559619115480

Re: Solr test framework not able to upload configuration to zk and fails with KeeperException

2019-06-04 Thread Erick Erickson
On the surface, this znode already exists: /solr/configs/collection2 So it looks like somehow you're > On Jun 4, 2019, at 12:29 PM, Pratik Patel wrote: > > /solr/configs/collection2

Re: Copy index from lower environment to Production | SolrCloud

2019-06-04 Thread Erick Erickson
(t’s usually far easier to create a new collection in your upper environment and index to _that_. Once the indexing is done, use the Collections API CREATEALIAS command to point traffic to the new collection. You can then use the old one to index to and use CREATEALIAS to point to that one,

Solr test framework not able to upload configuration to zk and fails with KeeperException

2019-06-04 Thread Pratik Patel
Hello Everyone, I am trying to run a simple unit test using solr test framework. At this point, all I am trying to achieve is to be able to upload some configuration and create a collection using solr test framework. Following is the simple code which I am trying to run. private static final

Copy index from lower environment to Production | SolrCloud

2019-06-04 Thread Rohan Kasat
Hi, In our setup we have two SolrCloud environments running Solr 7.5 version. Specific to the question - We have one collection with 3 shards and 3 replicas on the lower environment and a newly created mirrored collection on Production. Wanted to know on approaches to copy the index for

Re: Solr Heap Usage

2019-06-04 Thread John Davis
You might want to test with softcommit of hours vs 5m for heavy indexing + light query -- even though there is internal memory structure overhead for no soft commits, in our testing a 5m soft commit (via commitWithin) has resulted in a very very large heap usage which I suspect is because of other

Custom cache for Solr Cloud mode

2019-06-04 Thread Abhishek Dnyate
Hi, I am trying make use of User Defined cache functionality to optimise a particular workflow. We are using Solr 7.4. Step 1. I noticed, first we would have to add Custom Cache entry in solrconfig.xml. What’s its Config API alternative for solrCould ? I couldn’t find one at,

Re: not able to optimize

2019-06-04 Thread Walter Underwood
Correct, do not optimize. “Optimize” was a bad choice for this action. It is a forced merge. With master/slave, it means the slaves must always copy the entire 400 GB index. Without optimize, they would only need to copy the changed segments. Solr automatically merges segments for you. wunder

Re: Group by and filtering on child documents.

2019-06-04 Thread Mikhail Khludnev
Hello, Jai. I'm not sure I understand. Where do you need that max child price, at parent results or at the facet? On Tue, Jun 4, 2019 at 11:12 AM Jai Jamba wrote: > Hi, > Below is my document structure and underneath I have mentioned my multi > select facet query. I have one query related to

Re: Slow soft-commit

2019-06-04 Thread Erick Erickson
Thanks for letting us know. Yeah, many thousands of fields is an anti-pattern. At some point I’d like to put in a limit or log warning or something so people would get warning when something like this happens. And to make matters more “interesting”, the meta-data associated with the fields

Re: Solr Heap Usage

2019-06-04 Thread Erick Erickson
I need to update that, didn’t understand the bits about retaining internal memory structures at the time. > On Jun 4, 2019, at 2:10 AM, John Davis wrote: > > Erick - These conflict, what's changed? > > So if I were going to recommend settings, they’d be something like this: > Do a hard commit

Re: not able to optimize

2019-06-04 Thread Gus Heck
Hi Midas, Your question will probably attract more useful answers if you provide better details. What version of solr, How many nodes, and any associated error messages from the logs. I see you asking questions that nobody can answer because we don't know the details of your system, or why you

Re: NullPointerException with ExpandComponent on Collapsed Null Values

2019-06-04 Thread aus...@3bx.org.INVALID
Just wanted to provide a bit more information on this issue after experimenting a bit more. The error I've described below only seems to occur when I'm collapsing/expanding on an integer field. If I switch the field type to a string, no errors occur if there are missing field values within the

Re: Intermittent error 401 with JSON Facet query to retrieve count all collections

2019-06-04 Thread Jason Gerlowski
Hi Edwin, Thanks for the additional datapoint. It seemed to work for me, but we don't really understand the problem yet, so maybe it's not a solid work around like I'd hoped. I'm curious to hear whether it works for Colvin. To double check though: forwardCredentials is only supported in Solr >

Re: alias read access impossible for anyone other than admin?

2019-06-04 Thread Jason Gerlowski
Hi Sotiris, First off, forget what I said earlier about the "all" permission. What I said is mostly correct, but I had forgotten about some of the other behavior here that complicates things some. I replicated the behavior you're seeing and spent a bit of time tracing things through on the Solr

Re: not able to optimize

2019-06-04 Thread Midas A
400GB index is good ? Are we should shard it .? When we should start caring about inex size .? On Tue, Jun 4, 2019 at 3:04 PM Midas A wrote: > So we should not optimize our index ? > > On Tue, Jun 4, 2019 at 2:37 PM Toke Eskildsen wrote: > >> On Tue, 2019-06-04 at 11:48 +0530, Midas A wrote:

Re: not able to optimize

2019-06-04 Thread Midas A
So we should not optimize our index ? On Tue, Jun 4, 2019 at 2:37 PM Toke Eskildsen wrote: > On Tue, 2019-06-04 at 11:48 +0530, Midas A wrote: > > Index size is 400GB. we used master slave architecture . > > > > commit is taking time while not able to perform optimize . > > Why do you want to

Re: Solr Heap Usage

2019-06-04 Thread John Davis
Erick - These conflict, what's changed? So if I were going to recommend settings, they’d be something like this: Do a hard commit with openSearcher=false every 60 seconds. Do a soft commit every 5 minutes. vs Index-heavy, Query-light Set your soft commit interval quite long, up to the maximum

Re: not able to optimize

2019-06-04 Thread Toke Eskildsen
On Tue, 2019-06-04 at 11:48 +0530, Midas A wrote: > Index size is 400GB. we used master slave architecture . > > commit is taking time while not able to perform optimize . Why do you want to optimize in the first place? What are you hoping to achieve? There should be an error message in your

Re: highlighting not working as expected

2019-06-04 Thread Zheng Lin Edwin Yeo
Hi Martin, What fieldType are you using for the field “Sagstitel”? Is it the same as other fields? Regards, Edwin On Mon, 3 Jun 2019 at 16:06, Martin Frank Hansen (MHQ) wrote: > Hi, > > I am having some difficulties making highlighting work. For some reason > the highlighting feature only

Group by and filtering on child documents.

2019-06-04 Thread Jai Jamba
Hi, Below is my document structure and underneath I have mentioned my multi select facet query. I have one query related to filtering where I am not sure how can I get the child documents having some field value equivalent to maximum value of that field in the available child docs ("Price" field

Re: Slow soft-commit

2019-06-04 Thread André Widhani
almost forgot to report back, maybe it helps somebody else it turned out to be caused by a feature in our software being used in a way we did not anticipate. That resulted in a lot (> 100.000) of different dynamic fields which probably is an anti-pattern on its own, but the slow commits

Re: Intermittent error 401 with JSON Facet query to retrieve count all collections

2019-06-04 Thread Zheng Lin Edwin Yeo
Hi Jason, Thanks for your reply. I have tried to add the "forwardCredentials": true in the security.json, but I still get the same error. Regards, Edwin On Mon, 3 Jun 2019 at 22:19, Colvin Cowie wrote: > Hi, thanks I'll give that a go when I get a chance. > > I was trying to reply to an

not able to optimize

2019-06-04 Thread Midas A
Hi , Index size is 400GB. we used master slave architecture . commit is taking time while not able to perform optimize . what should i do .

AW: WG: SolrException: Can't determine a Sort Order with Solr 6.6

2019-06-04 Thread Schwank , Désirée
Hmh, first thought was that I can't influence that cause my fellow colleauges are responsible for servers and hardware. But of course I will be able to tell them to change the network location. Thanks, I will give it a hard try. Greets Desiree -Ursprüngliche Nachricht- Von: Shawn