Re: Incremental export of a huge collection

Hey Mikhail, Isn't _version_ a timestamp of insertion by default? I think yes. From a similar query on SE : You can sort by _version_ field in descending order. AFAIK, _version_ field > is a epoch timestamp

Re: Incremental export of a huge collection

This will do what you describe: https://lucene.apache.org/solr/guide/8_1/stream-source-reference.html#topic Joel Bernstein http://joelsolr.blogspot.com/ On Mon, Sep 9, 2019 at 4:18 PM Mikhail Khludnev wrote: > Isn't _version_ a timestamp of insertion by default? > > On Mon, Sep 9, 2019 at

Re: Incremental export of a huge collection

Isn't _version_ a timestamp of insertion by default? On Mon, Sep 9, 2019 at 9:47 PM Vidit Asthana wrote: > Hi, > > I am building a service where I have to continously read data from a Solr > collection and insert it into another database. Collection will receive > daily updates. Initial size of

Re: Incremental export of a huge collection

Vidit Asthana wrote: > My documents don't have anything like timestamp which I can use to fetch > "only newly added" documents after a certain point. Is there any internal > field which I can use to create this checkpoint and then later use that to > fetch "only incremental updates" from that

Incremental export of a huge collection

Hi, I am building a service where I have to continously read data from a Solr collection and insert it into another database. Collection will receive daily updates. Initial size of collection is very large. After I have indexed whole data(through cursor mark), on daily basis I want to only do