The most likely scenario is that your links are getting filtered. Try
adding the dont_filter=True inside your Request instances.
yield scrapy.Request(u, callback=self.parse_company, dont_filter=True)
On Sunday, September 18, 2016 at 12:26:50 PM UTC-7, Raf Roger wrote:
>
> Hi,
>
> i
Hi,
i have a behavior i need to understand.
My scrapy script request 53 urls (and i check on the webpages, there are 53
urls corresponding to my request) but it returns only 43 items scrapped.
if my code is:
allowed_domains = ['vsetkyfirmy.sk']
start_urls = [
