Hello Chau Tung Lam, It's great to hear that you are interested in participating in GSoC 2017 with Scrapy!
As for the projects that you find interesting, For the HTTP/1.1 downloader, I personally think that it has lost a bit of its substance because of recent fixes in Twisted and Scrapy. Please read the recent messages on the mailing list: https://groups.google.com/d/msg/scrapy-users/UN5P1AJMKxk/9DB0zRfLAAAJ and subsequent discussion HTTP/2 support looks more valuable, and it could mean workin with the Twisted team too (which I don't know if they are in GSoC). Regarding scrapy Integration Tests, I believe the description in http://gsoc2017.scrapinghub.com/ideas/#integration-tests already gives a good idea of what the project should achieve. I think the main idea is to run scrapy within an environment where the whole network is under control, where you can play with slow websites, or where DNS failures are frequent... I'm not familiar with the existing tools that can be used for this, but I'm sure there are plenty, and it's certainly not a project to re-create a network emulation tool. The listen mentor is Daniel Grana (http://gsoc2017.scrapinghub.com/mentors/) Have you contacted him? Best, Paul. On Monday, March 13, 2017 at 3:09:11 PM UTC+1, Chau Tung Lam Nguyen wrote: > > Hi, > > My name is Chau Tung Lam, currently a sophomore majoring in Computer > Science in SUNY Plattsburgh, NY. After researching about the organizations > participating in GSoC 2017, I am interested in contributing to Scrapy > project. In detail, I am interested in Scrapy Integration Tests and the New > HTTP/1.1 download handler. Therefore, can you guys help me with getting to > know more about the project ideas? > > Thank you so much. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
