Hi Vinay, Dynamic rescan is meant for web-crawling and revisits already crawled documents based on how often they have changed in the past. It is therefore wholly inappropriate for something like a file crawl, since directory contents (one of the kinds of documents there are in a file crawl) change very infrequently.
Instead, I recommend that you run complete crawls, non-dynamic. You can even run minimal crawls fairly often, which will pick up new and changed documents, and run non-minimal crawls on a less frequent schedule to capture deletions. Thanks, Karl On Tue, Jul 31, 2018 at 4:05 AM VINAY Bengaluru <[email protected]> wrote: > Hi Karl, > We have set up a scheduler for our jobs with input > connector as file system and output connector as Solr. > We have set up a scheduler as follows : > Schedule type: Rescan documents dynamically > Recrawl interval: blank > Schedule time: appropriate times with job invocation as complete. > > We see that the job is not picking up documents at the scheduled intervals. > > Why the job doesn't pickup new docs at the scheduled interval? Anything > wrong with our job configuration or our understanding? > > Thanks and regards, > Vinay > >
