Hi Alex, понедельник, 9 марта 2015 г., 11:12:40 UTC+5 пользователь Alex Jiao написал: > > Hi guys, I'm a third year computer science student studying in National > University of Singapore. Although, I have not used Scrapy before, but I'm > familiar with how web crawlers work as I have built a search engine before. > I am particularly interested in the project 'New Scrapy signal dispatching' > as it is a good fit for open-source beginners like me. I also hope to > improve my command of Python through this project. > > I'd like to have more information regarding the new signal dispatcher that > you guys are planning to use. Is it going to be built in-house or an > existing open-source library that is more performant than pydispatcher? >
I guess we should explore both options. For me it looks like an existing open-source library is preferred, but we should be picky. > > In addition, I'd appreciate it if you guys can guide me to resources that > can aid my understanding of signal dispatching in Scrapy works (parts of > codebases, tutorials, your own explanations etc). > There are some docs on Scrapy signals here: http://doc.scrapy.org/en/latest/topics/signals.html. A bundled copy of pydispatch is here: https://github.com/scrapy/scrapy/tree/master/scrapy/xlib - you can grep the source code to find its usages. I'm not sure, but commit history for django's signal dispatcher can be also helpful - see https://github.com/django/django/tree/master/django/dispatch. > > Thank you! > > Regards, > Alex > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
