Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-01 Thread Chetan Mehrotra
ldNames per document. Questions -- 1. Any way to map field names (not the values) associated with a given document 2. Any other way to logically compare the index data between 2 indexes which are generated using different approach but index same content. Chetan Mehrotra [1] https://is

Re: Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-02 Thread Chetan Mehrotra
API? Chetan Mehrotra On Tue, Jan 2, 2018 at 1:03 PM, Dawid Weiss wrote: > How about the quickest solution: dump the content of both indexes to a > document-per-line text > file, sort, diff? > > Even if your indexes are large, if you have large spare disk, this > will be super fast.

Re: Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-02 Thread Chetan Mehrotra
ing for way where I can map all fieldNames for a given document. Actual indexed content would be same if both index have "status" field indexed so we only need to validate fieldnames per document. Something like Thanks for reading all this if you have read so far :) Chetan Mehrotra [1] http

Re: Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-03 Thread Chetan Mehrotra
> perhaps that could give you some pointers. I think you can pull > the older branch from here: > https://github.com/DmitryKey/luke Thanks for the pointer. It has support for reconstructing the Document which should be having logic to retrieve non stored field names. Would have a look.

Re: Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-03 Thread Chetan Mehrotra
of index content to get that kind of data Chetan Mehrotra On Wed, Jan 3, 2018 at 2:47 PM, Dawid Weiss wrote: >> That helps and explains why there is no support in std api > > This isn't an API problem. This is by design -- this is how it works. > If you wish > to retrieve fie

Re: Comparing two indexes for equality - Finding non stored fieldNames per document

2018-01-05 Thread Chetan Mehrotra
for docId : $docId" di.fieldIds << getFieldId(fieldName) } } } } Thanks for the all the help! Chetan Mehrotra [1] https://issues.apache.org/jira/browse/OAK-7122 [2] https://github.com/chetanmeh/oak-console-scripts/tree/