I have a strange problem and i could not find a solution for it. When i use scrapy crawl command for a single URL and i have process time about 1 sec. When i use scrapyd to process the same URL then I got 5 secs process time without HTTPCACHE_ENABLED and 3.5 secs with HTTPCACHE_ENABLED True( i saw same results both from console log and web UI runtime column). Keep in mind that i have (?) all relatives settings to lowest ( DOWNLOAD_DELAY=0, poll_interval=0, concurrent high values, etc). Any idea why I have so strange process time?
-- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
