I am using the Scrapy 1.0.3 on Ubuntu 15.04 with scrapyd 1.1.0 I am deploying the 5 spiders in Scrapyd. and each spider are scheduled to run once / hour. I am using set of 10 proxies. Often I am getting 111: Connection Refused as response. May be i suspect:
1) Proxy server can`t able to establish connection with that Proxy 2) May be scrapy throws error. Any help? -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.