Some mitigation strategies to at least /reduce/ the frequency/volume of such screams are:

a. measure relevance (use judgments, perhaps with Quepid) for each system for 50 or so queries https://opensourceconnections.com/blog/2022/10/13/how-to-succeed-with-explicit-relevance-evaluation-using-probability-proportional-to-size-sampling/ b. use Jaccard similarity to compare each system https://opensourceconnections.com/blog/2021/07/23/jaccard-index-for-search-regression-testing/ c. prepare your users & business for the fact that search results will be *different* on 8.11.2 - remember they may be conditioned to seeing certain bad results from the old system and thus be surprised if these improve!

Best

Charlie

On 03/11/2022 14:59, dmitri maziuk wrote:
On 2022-10-31 6:05 AM, Jaivik Patel wrote:
...
Is there any faster way to upgrade the solr version from 5.4.1 to 8.11.2
without affecting my production?

1. Spin up an instance of 8.11.2.
2. Import the data.
3. Re-point your proxy from 5.4.1. to 8.11.2.
4. Wait for the screams.

But you knew that.

Dima

--
Charlie Hull - Managing Consultant at OpenSource Connections Limited
Founding member of The Search Network <http://www.thesearchnetwork.com> and co-author of Searching the Enterprise <https://opensourceconnections.com/wp-content/uploads/2020/08/ES_book_final_journal_version.pdf>
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828

OpenSource Connections Europe GmbH | Pappelallee 78/79 | 10437 Berlin
Amtsgericht Charlottenburg | HRB 230712 B
Geschäftsführer: John M. Woodell | David E. Pugh
Finanzamt: Berlin Finanzamt für Körperschaften II

Reply via email to