Hi Sachin, I executed the same set of learning to rank queries (50 queries) with and without feature extraction on the same Solr collection and on three different Solr versions: 8.2, 8.7, and 8.8. Here are the obtained results: [image: image.png]
Since I cannot reproduce the degradation you are referring to, could you give me some further information about the schema, documents, models/features, and queries you are using? It would really help. Thank you, *Anna Ruggero* R&D Machine Learning / Software Engineer, Search Consultant e-mail: [email protected] *Sease* - Information Retrieval Applied Consulting | Training | Open Source Sease.io <http://sease.io/> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter <https://twitter.com/seaseltd> | Youtube <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github <https://github.com/seaseltd> On Wed, Sep 28, 2022 at 12:45 PM Alessandro Benedetti <[email protected]> wrote: > Hi Sachin, you didn't reply to the whole mailing list, just did, Anna will > follow up with some investigation and reproduction we are trying. > > Cheers > -------------------------- > *Alessandro Benedetti* > Director @ Sease Ltd. > *Apache Lucene/Solr Committer* > *Apache Solr PMC Member* > > e-mail: [email protected] > > > *Sease* - Information Retrieval Applied > Consulting | Training | Open Source > > Website: Sease.io <http://sease.io/> > LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter > <https://twitter.com/seaseltd> | Youtube > <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github > <https://github.com/seaseltd> > > > On Tue, 27 Sept 2022 at 18:30, sachin gk <[email protected]> wrote: > >> Hi Alessandro, >> >> Please find my analysis attached. I didn't try it on 8.7. we were more >> intrested in avg time than p95. >> >> Regards, >> Sachin >> >> On Tue, 27 Sep, 2022, 21:31 Alessandro Benedetti, <[email protected]> >> wrote: >> >>> So you noticed that the degradation was also there pre 8.8 (<8.8)? >>> Have you identified the first version having the regression? >>> Was it there with 8.7, this information would help a lot! >>> >>> Cheers >>> -------------------------- >>> *Alessandro Benedetti* >>> Director @ Sease Ltd. >>> *Apache Lucene/Solr Committer* >>> *Apache Solr PMC Member* >>> >>> e-mail: [email protected] >>> >>> >>> *Sease* - Information Retrieval Applied >>> Consulting | Training | Open Source >>> >>> Website: Sease.io <http://sease.io/> >>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter >>> <https://twitter.com/seaseltd> | Youtube >>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github >>> <https://github.com/seaseltd> >>> >>> >>> On Tue, 27 Sept 2022 at 12:27, sachin gk <[email protected]> wrote: >>> >>>> Hi Alessandro, >>>> >>>> Sorry Missed the mail , the degradation continued to exist with various >>>> higher versions. So we dropped the upgrade idea as we are in 8.2 version >>>> solr. >>>> >>>> Thanks >>>> >>>> >>>> On Mon, 26 Sep, 2022, 19:21 Alessandro Benedetti, <[email protected]> >>>> wrote: >>>> >>>>> Hi Sachin, >>>>> We didn't get any update on this. >>>>> As an Apache Solr committer, I deeply care to provide the best >>>>> software possible to our users. >>>>> As a user, you can do your part in helping us understand possible bugs >>>>> and regressions. >>>>> Let us know and we can try to identify the regression and fix it! >>>>> >>>>> Cheers >>>>> -------------------------- >>>>> *Alessandro Benedetti* >>>>> Director @ Sease Ltd. >>>>> *Apache Lucene/Solr Committer* >>>>> *Apache Solr PMC Member* >>>>> >>>>> e-mail: [email protected] >>>>> >>>>> >>>>> *Sease* - Information Retrieval Applied >>>>> Consulting | Training | Open Source >>>>> >>>>> Website: Sease.io <http://sease.io/> >>>>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter >>>>> <https://twitter.com/seaseltd> | Youtube >>>>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github >>>>> <https://github.com/seaseltd> >>>>> >>>>> >>>>> On Fri, 17 Jun 2022 at 12:22, Alessandro Benedetti < >>>>> [email protected]> wrote: >>>>> >>>>>> Hi Sachin, >>>>>> Any update on this? >>>>>> This could be very important for the community. >>>>>> >>>>>> We may end up discovering and fixing a bug, so please get in touch >>>>>> with all the info you have! >>>>>> >>>>>> Cheers >>>>>> -------------------------- >>>>>> *Alessandro Benedetti* >>>>>> CEO @ Sease Ltd. >>>>>> *Apache Lucene/Solr Committer* >>>>>> *Apache Solr PMC Member* >>>>>> >>>>>> e-mail: [email protected] >>>>>> >>>>>> >>>>>> *Sease* - Information Retrieval Applied >>>>>> Consulting | Training | Open Source >>>>>> >>>>>> Website: Sease.io <http://sease.io/> >>>>>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter >>>>>> <https://twitter.com/seaseltd> | Youtube >>>>>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github >>>>>> <https://github.com/seaseltd> >>>>>> >>>>>> >>>>>> On Tue, 24 May 2022 at 15:39, Alessandro Benedetti < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Hi Sachin, >>>>>>> can you try also Solr 8.7 and Solr 8.8? >>>>>>> In 8.8 has been introduced new functionality in LTR which is >>>>>>> Interleaving. >>>>>>> It shouldn't affect performance though, so we need to understand >>>>>>> when the regression happened, to fix it. >>>>>>> Your help is much appreciated, >>>>>>> Cheers >>>>>>> >>>>>>> >>>>>>> -------------------------- >>>>>>> *Alessandro Benedetti* >>>>>>> CEO @ Sease Ltd. >>>>>>> *Apache Lucene/Solr Committer* >>>>>>> *Apache Solr PMC Member* >>>>>>> >>>>>>> e-mail: [email protected] >>>>>>> >>>>>>> >>>>>>> *Sease* - Information Retrieval Applied >>>>>>> Consulting | Training | Open Source >>>>>>> >>>>>>> Website: Sease.io <http://sease.io/> >>>>>>> LinkedIn <https://linkedin.com/company/sease-ltd> | Twitter >>>>>>> <https://twitter.com/seaseltd> | Youtube >>>>>>> <https://www.youtube.com/channel/UCDx86ZKLYNpI3gzMercM7BQ> | Github >>>>>>> <https://github.com/seaseltd> >>>>>>> >>>>>>> >>>>>>> On Tue, 24 May 2022 at 13:26, sachin gk <[email protected]> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi All, >>>>>>>> >>>>>>>> We have recently upgraded the solr from 8.2.0 to 8.8.2. During the >>>>>>>> performance testing it was observed that Response time for the LTR >>>>>>>> is >>>>>>>> degraded by 35%. >>>>>>>> >>>>>>>> LTR Implementation details: >>>>>>>> Model class : MultipleAdditiveTreesModel >>>>>>>> >>>>>>>> Out of the box classes are used for the implementation, we are >>>>>>>> unable to >>>>>>>> pin point what is causing the degradation as it is internal to solr. >>>>>>>> >>>>>>>> Is there a configuration that needs to be taken care ? any ponter >>>>>>>> regarding >>>>>>>> this wil be. of great help >>>>>>>> >>>>>>>> -- >>>>>>>> Regards, >>>>>>>> Sachin >>>>>>>> >>>>>>>
