Re: Atomic updates too slow in Solr 8 vs Solr 7

Sure, I can do that. Let me create an index with a few million docs, call RTG with a few million iterations on it and note the times between 7.x and 8.x. I assume this should be sufficient (?) On Wed, May 31, 2023 at 5:19 PM Jan Høydahl wrote: > Would be nice to determine whether RTG is orders

Re: Atomic updates too slow in Solr 8 vs Solr 7

Would be nice to determine whether RTG is orders of magnitude slower in 8.x than 7.x and is the main culprit. Then we could isolate the testing to RTG only and not involce Atomic Update? Jan > 31. mai 2023 kl. 21:33 skrev Rahul Goswami : > > I don’t have any nested documents. And the results

Re: SolrJ client question

Thanks Shawn and Eric! On Tue, May 30, 2023 at 2:57 PM Eric Pugh wrote: > I think that creating it when you run it and closing it will be just > fine. As Shawn said, it’ll be “well under a second” ;-)./ > > > On May 30, 2023, at 2:01 PM, Shawn Heisey wrote: > > > > On 5/30/23 11:13, mtn

Re: Atomic updates too slow in Solr 8 vs Solr 7

Lots of work has been done in this area in 8.x. See https://issues.apache.org/jira/browse/SOLR-12638 as an example (Support atomic updates of nested/child documents for nested-enabled schema, fixed in 8.1), which adds support for atomic update of nested docs. Touching all that code may of

Re: Atomic updates too slow in Solr 8 vs Solr 7

I don’t have any nested documents. And the results are consistent across multiple runs. I tried looking for similar issues in the mailing list, but couldn’t find anything relevant . So if you do happen to find any JIRAs addressing it that would be really helpful (thanks!). To Jan’s question about

Re: Streaming expr as LTR feature

The select function is documented here: https://solr.apache.org/guide/solr/latest/query-guide/transform.html Joel Bernstein http://joelsolr.blogspot.com/ On Wed, May 31, 2023 at 1:51 PM Joel Bernstein wrote: > The array function doesn't operate in the way its being used here. Here > are the

Re: Streaming expr as LTR feature

The array function doesn't operate in the way its being used here. Here are the docs on arrays: https://solr.apache.org/guide/solr/latest/query-guide/vector-math.html#arrays Using a multi-valued field you could do something like this where test_fs is a multi-valued float field. The select

Re: Streaming expr as LTR feature

Hi, we are working on contributing the possibility of having vector-similarity features, in Apache Solr Learning To Rank. We are starting from the Lucene contribution of related function queries, which we are close to merging. Then we'll do the Solr part. What you are trying to do has not been

Re: Atomic updates too slow in Solr 8 vs Solr 7

I would love some profiling as well. I know 8.8 or 8.9 had some performance problems with atomic update but this was later addressed. I cant find the jira atm though. Also I am on 8.11.1 and atomic update is not an issue for me. By the way, do you happen to have nested docs? On Wed, May 31,

Re: Atomic updates too slow in Solr 8 vs Solr 7

Hi MMap is most important for searching. Indexing bypasses the cache by using direct IO. I have noticed slow real time get on Solr 8.x during atomic update myself. Would be interesting with a comparison with profiling. RTG gets the document from transaction log I believe? Could there be some

Re: Streaming expr as LTR feature

Validating the expression to begin with, it doesn't work. Vector math supports reading from an array of values so I tried the following expression. dotProduct(array(search(v9, q="id:1", fl="numeric_field_dfd",

Re: Atomic updates too slow in Solr 8 vs Solr 7

Thanks for the response Shawn. We are using Windows server with pretty huge indexes (multiple TB cores). With Mmap, I have observed that the machine just completely freezes with high CPU and memory usage to a point where it becomes impossible to even connect to it. SimpleFS works out well for us

Re: Issue in connecting zookeeper host from node js service

Hi, It is safe to talk to any of the Solr nodes directly. Inside of GKE cluster, you will have a Service name for Solr that clients can connect to, and it will only forward traffic to healthy nodes. Besides, if a replica on a certain POD is e.g. in recovery mode, requests sent to that node

RE: Issue in connecting zookeeper host from node js service

Classification: Public Thanks for the quick response. As far as ZK connection string is concerned it is valid and accessible and with the same I can successfully connect to the java service (via Solrj library - CloudSolrCleint) We are using external zookeeper in our solr cloud setup in

Re: Issue in connecting zookeeper host from node js service

If you're using Solr in Kubernetes, you can continue connecting to Solr pods without connecting to ZK. We don't have any officially supported Solr client for NodeJS, but the HTTP endpoints of Solr are supported and can be used directly. If you're having trouble connecting to ZK via a third party

RE: Issue in connecting zookeeper host from node js service

Classification: Public Hi Ishan, Sorry for the confusion. I was using my organization outlook client that may added the default footnote and classification. I confirm that it is not confidential and seeking for the feedback and inputs for the problem I am facing. Thanks for your input.

Re: Issue in connecting zookeeper host from node js service

Hi Manoj, Your message body contains a footnote "Any form of reproduction, dissemination, copying, disclosure, modification, distribution and / or publication of this message without the prior written consent of authorized representative of HCL is strictly prohibited. " It is also classified as