Re: Sort on docValue field is slow.

2019-05-20 Thread Erick Erickson
Shawn’s right. You have a mixed index, some segments have docValues and some don’t. So yes, you do need to reindex everything before drawing conclusions. To make matters worse, when you start indexing documents new segments with docvalues will eventually be merged with segments that don’t have

Re: Sort on docValue field is slow.

2019-05-20 Thread Shawn Heisey
On 5/20/2019 8:59 AM, Ashwin Ramesh wrote: Hi Shawn, Thanks for the prompt response. 1. date type def - 2. The field is brand new. I added it to schema.xml, uploaded to ZK & reloaded the collection. After that we started indexing the few thousand. Did we still need to do a full reindex to a

Re: Sort on docValue field is slow.

2019-05-20 Thread Ashwin Ramesh
Hi Shawn, Thanks for the prompt response. 1. date type def - 2. The field is brand new. I added it to schema.xml, uploaded to ZK & reloaded the collection. After that we started indexing the few thousand. Did we still need to do a full reindex to a fresh collection? 3. It is the only

Re: Sort on docValue field is slow.

2019-05-20 Thread Shawn Heisey
On 5/20/2019 6:25 AM, Ashwin Ramesh wrote: Hoping to get advice on a specific issue - We have a collection of 50M documents. We recently added a featuredAt field defined as such - What is the fieldType definition for "date"? We cannot assume that you have left this the same as Solr's

Sort on docValue field is slow.

2019-05-20 Thread Ashwin Ramesh
Hello everybody, Hoping to get advice on a specific issue - We have a collection of 50M documents. We recently added a featuredAt field defined as such - This field is sparely populated such that only a small subset (3-5 thousand currently) have been tagged with that field. We have a business