Hi Markus, Assuming you have HTTPCACHE_ENABLED set to True, (thus activating caching, which is not on by default,) you can set "dont_cache" to True in Request's meta dict to not cache some http pages See http://doc.scrapy.org/en/latest/topics/downloader-middleware.html?#module-scrapy.downloadermiddlewares.httpcache http://doc.scrapy.org/en/latest/topics/request-response.html?highlight=dont_cache#request-meta-special-keys
Hope this helps Paul. Hi, is there a way that I can make Scrapy cache only certain pages? Let's say I do not want to cache index pages, but only details pages (pages that won't change), is that possible? If yes, how? Thanks, Markus -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
