Hi Shawn, Thanks for the prompt response.
1. date type def - <fieldType name="date" class="solr.DatePointField" positionIncrementGap="0" /> 2. The field is brand new. I added it to schema.xml, uploaded to ZK & reloaded the collection. After that we started indexing the few thousand. Did we still need to do a full reindex to a fresh collection? 3. It is the only difference. I am testing the raw URL call timing difference with and without the extra sort. Hope this helps, Regards, Ash On Mon, May 20, 2019 at 11:17 PM Shawn Heisey <[email protected]> wrote: > On 5/20/2019 6:25 AM, Ashwin Ramesh wrote: > > Hoping to get advice on a specific issue - We have a collection of 50M > > documents. We recently added a featuredAt field defined as such - > > > > <field name="featuredAt" type="date" indexed="true" stored="false" > > required="false" > > multiValued="false" docValues="true"/> > > What is the fieldType definition for "date"? We cannot assume that you > have left this the same as Solr's sample configs. > > > This field is sparely populated such that only a small subset (3-5 > thousand > > currently) have been tagged with that field. > > Did you completely reindex, or just index those few thousand records? > When changing fields related to docValues, you must completely delete > the old index and reindex. That's just how docValues works. > > > We have a business case where we want to order this content by most > > recently featured -> least recently featured -> the rest of the content > in > > any order. However adding the `sort=featuredAt desc` param results in > qTime > >> 5000 (our hard timeout is 5000). > > Is the definition of the sort parameter the ONLY difference? Are you > querying on the new field? Can you share the entire query URL, or the > code that produced it if you're using a Solr client? What is the before > QTime? > > Thanks, > Shawn > -- *P.S. We've launched a new blog to share the latest ideas and case studies from our team. Check it out here: product.canva.com <https://product.canva.com/>. *** ** <https://www.canva.com/>Empowering the world to design Also, we're hiring. Apply here! <https://about.canva.com/careers/> <https://twitter.com/canva> <https://facebook.com/canva> <https://au.linkedin.com/company/canva> <https://twitter.com/canva> <https://facebook.com/canva> <https://au.linkedin.com/company/canva> <https://instagram.com/canva>
