Currently HttpProxyMiddleware uses the standard linux http_proxy environment variable. The problem with that is that it means I have to set a proxy on the entire server to set a proxy on scrapy. This is a major inconvenience as scraping is obviously a task that requires more proxies than most other activities.
I want to change HttpProxyMiddleware to use an HTTP_PROXY setting instead of (or in adition to) the env var. What do you think about it? is it a positive change you would accept and want to see added? -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
