Looks related to your user agent, try changing it. El miércoles, 6 de agosto de 2014 08:29:12 UTC-3, Tapasweni Pathak escribió: > > Hi, > > I am scraping Zara <http://www.zara.com/in/>. As soon as I start my > crawler it gives me 404 for very first link. > > Here is my items.py <http://pastebin.com/KbLQaTFb>, spider.py > <http://pastebin.com/vYc2Wfdi>, settings.py <http://pastebin.com/8g3FkuPy> > . > > Why is scrapy giving me 404? > > > Thanks, > > >
-- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
