Hi all, I'm a computer engineering undergrad studying at the National University of Singapore <http://www.nus.edu.sg/>. Scrapy is a library which I'd like to contribute to for the upcoming GSOC 2015.
As a newbie in open source development, I intend to start getting involved now to gain experience. Things I've done so far with regards to scrapy: - Wrote a couple of spiders to scrape stuff - Browse scrapy projects which others have done online My next step is to begin helping out with some simple issues, and have chosen *process_spider_exception() not invoked for generators <https://github.com/scrapy/scrapy/issues/220> *to start with. Already read up on middlewares and scrapy architecture. After forking the project and poking around the code a bit, I am not sure how to proceed. It would be great if someone can point me in the right direction, especially for the following points! 1. How do I run scrapy from source after forking the project? The "INSTALL" text file simply points me to the online documentation for standard installation. Makefile.buildbot has a section saying python extras/makedeb.py build. Tried to run makedeb.py build but I got an error saying no module named scrapy. Not sure why the scrapy source has scrapy as a dependency. 2. I could not find process_spider_exception() method in master/scrapy/middleware.py. Am I looking in the wrong place? 3. How do I begin fixing this bug? A few tips on the direction I'd need to take would be great. Thanks :) -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
