have u solved this issue? i have a same problem on my computer. i found the problem is that i set the http_proxy. after i disable the http_proxy, it works normally. by using "export http_proxy=" to disable http_proxy i hope that will help u.
On Saturday, July 19, 2014 12:52:14 AM UTC+9, Moataz Elmasry wrote: > > Hello everyone, > > I am trying to run scrapy's bench command but sadly I am facing problems. > I had an earlier discussion through github issues here > <https://github.com/scrapy/scrapy/issues/808#issuecomment-49437740>. > > The following is what I am getting so far: > > 2014-07-18 12:24:29+0100 [scrapy] DEBUG: Web service listening on > 127.0.0.1:6080 > 2014-07-18 12:24:29+0100 [follow] DEBUG: Retrying <GET > http://localhost:8998/follow?total=100000&order=rand&maxlatency=0.0&show=20> > (failed 1 times): 504 Gateway Time-out > 2014-07-18 12:24:29+0100 [follow] DEBUG: Retrying <GET > http://localhost:8998/follow?total=100000&order=rand&maxlatency=0.0&show=20> > (failed 2 times): 504 Gateway Time-out > 2014-07-18 12:24:29+0100 [follow] DEBUG: Gave up retrying <GET > http://localhost:8998/follow?total=100000&order=rand&maxlatency=0.0&show=20> > (failed 3 times): 504 Gateway Time-out > 2014-07-18 12:24:29+0100 [follow] DEBUG: Crawled (504) <GET > http://localhost:8998/follow?total=100000&order=rand&maxlatency=0.0&show=20> > (referer: None) > 2014-07-18 12:24:29+0100 [follow] DEBUG: Ignoring response <504 > http://localhost:8998/follow?total=100000&order=rand&maxlatency=0.0&show=20>: > HTTP status code is not handled or not allowed > 2014-07-18 12:24:29+0100 [follow] INFO: Closing spider (finished) > 2014-07-18 12:24:29+0100 [follow] INFO: Dumping Scrapy stats: > > > > Thanks. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.