Re: Store arrays in DocValues and keep the original order

2022-06-30 Thread Greg Miller
You're correct that these doc value fields are primarily meant for sorting, as well as some other use-cases like faceting. And what you're discovered is also correct, that these fields don't maintain the original ordering, and SORTED_SET dedupes values (

Re: Store arrays in DocValues and keep the original order

2022-06-28 Thread Shai Erera
Depending on what you use the field for, you can use BinaryDocValuesField which encodes a byte[] and lets you store the data however you want. But how are you using these fields later at search time? On Tue, Jun 28, 2022 at 3:46 PM linfeng lu wrote: > Hi~ > > We are trying to build an OLAP

Store arrays in DocValues and keep the original order

2022-06-28 Thread linfeng lu
Hi~ We are trying to build an OLAP database based on lucene, and we heavily use lucene's DocValues (as our column store). We try to use DocValues to store the array type field. For example, if we want to store the field1 and feild2 in this json document into DocValues respectively,