Hello. I have a problem when crawling of pages with a lot of PDF documents (like 200). It fetches all of the documents and it does not show errors during the fetch process, but when I try to index the fetched documents it just ignores some of them without a clear reason.
I crawled using the same base urls and it ignores different documents in different crawls, so I think this error is not related with url filters. I have set the maximum number of links per page in 2000, so I think that the problem is neither there
