Hi, I am having a problem with a file system crawl where i have about 600 urls text files in a folder and only 100 of them are getting fetched and indexed.
i have +^file://* in my regex.urlfilter.txt and crawl.urlfilter.txt so every file should be picked up. i have created my own text parser and Indexingfilter plugins as well. Not sure if this could have something to do with this problem or not. I dont think it does. I can see that the QueueFeeder only contains 100 records only but doesnt replenish; Any leads? Thanks, Fadzi
