Hey Atul, I'm afraid I haven't looked at all at HTTP/2 support in Twisted (nor am I familiar enough with HTTP/2 in general) Here's the open issue on GitHub for scrapy: https://github.com/scrapy/scrapy/issues/1854
There's an example from hyper-h2 showing how to use the library with Twisted: https://python-hyper.org/projects/h2/en/stable/twisted-post-example.html You can have a look at how download handlers are implemented in Scrapy to see how that would fit in: https://github.com/scrapy/scrapy/tree/master/scrapy/core/downloader/handlers Hope this helps, Paul. On Fri, Mar 10, 2017 at 10:17 AM, Atul Krishna <atultheraj...@gmail.com> wrote: > Hi Paul, > This is Atul Krishna, a undergraduate from computer science department, > MAKAUT, India. I am also interested in "new HTTP/1.1 downloader handler" in > scrapy project ideas. I would love to work on "adding HTTP/2 support to > Scrapy". Since i am a newbie it would be great if you guide on how to start > with HTTP/2 support to Scrapy. > Regards, > Atul Krishna > > > On Monday, March 6, 2017 at 11:57:35 PM UTC+5:30, Paul Tremberth wrote: >> >> Hi Anshul, >> >> Indeed you can present a GSoC application around adding HTTP/2 support to >> Scrapy. >> >> The ideas page that is currently online is just a list of proposals, >> and you can certainly come up with another idea altogether. >> >> Don't hesitate to interact here or open an issue on GitHub to discuss >> design options. >> >> Best, >> Paul. >> >> On Mon, Mar 6, 2017 at 7:20 PM, Anshul Malik <malika...@gmail.com> wrote: >> >>> Hi Paul, >>> >>> So can we think of HTTP/2 support for scrapy as a GSoC project? >>> >>> Thanks >>> >>> On Mon, Mar 6, 2017 at 11:00 AM, Paul Tremberth <paul.tr...@gmail.com> >>> wrote: >>> >>>> Hi Anshul, >>>> hi Shankar >>>> >>>> Twisted recently fixed one of the issues Scrapy had with the standard >>>> HTTP/1.1 downloader, >>>> namely to handle HTTP responses without a reason phrase: >>>> https://github.com/twisted/twisted/pull/723 >>>> >>>> Rolando also fixed a couple of issues related to HTTP responses: >>>> - https://github.com/scrapy/scrapy/pull/2590 >>>> - https://github.com/scrapy/scrapy/pull/2622 >>>> >>>> The tests have also been improved a bit for these cases. >>>> >>>> There's still for example an issue with HTTP 100 responses ( >>>> https://github.com/scrapy/scrapy/issues/544) >>>> but it also looks like the new HTTP/1.1 downloader idea is loosing some >>>> of it substance. >>>> Maybe the focus for GSoC should be on HTTP/2 support. I'm not sure. >>>> >>>> Regards, >>>> Paul. >>>> >>>> On Saturday, March 4, 2017 at 10:59:00 AM UTC+1, Anshul Malik wrote: >>>>> >>>>> Hey there! >>>>> >>>>> I am Anshul studying Computer Engineering in India. I am also planning >>>>> to work on "New HTTP/1.1 download handler" project. >>>>> I have already read the guidelines mentioned by Paul. So I am now >>>>> working on outlining the plan. >>>>> >>>>> Is there anything that I need to know or would be best for me If I do >>>>> check that out? >>>>> >>>>> Thanks >>>>> Anshul >>>>> >>>>> On Sunday, February 26, 2017 at 3:28:12 AM UTC+5:30, SHANKAR JHA wrote: >>>>>> >>>>>> Hi Scrapians, >>>>>> >>>>>> I am studying computer science and newbie in GSoC. I always want to >>>>>> contribute to open source project. >>>>>> >>>>>> I just found "*new HTTP/1.1 downloader handler" *in scrapy project >>>>>> ideas and I am very excited to work on this. >>>>>> I am good in python and HTTP but never worked on twisted. >>>>>> >>>>>> Can anyone help me and show me the direction, So that I can start >>>>>> working on my project. >>>>>> >>>>>> With Due Regards, >>>>>> Shankar Jha >>>>>> >>>>>> >>>>>> >>>>>> -- >>>> You received this message because you are subscribed to a topic in the >>>> Google Groups "scrapy-users" group. >>>> To unsubscribe from this topic, visit https://groups.google.com/d/to >>>> pic/scrapy-users/UN5P1AJMKxk/unsubscribe. >>>> To unsubscribe from this group and all its topics, send an email to >>>> scrapy-users...@googlegroups.com. >>>> To post to this group, send email to scrapy...@googlegroups.com. >>>> Visit this group at https://groups.google.com/group/scrapy-users. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "scrapy-users" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to scrapy-users...@googlegroups.com. >>> To post to this group, send email to scrapy...@googlegroups.com. >>> Visit this group at https://groups.google.com/group/scrapy-users. >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > You received this message because you are subscribed to the Google Groups > "scrapy-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to scrapy-users+unsubscr...@googlegroups.com. > To post to this group, send email to scrapy-users@googlegroups.com. > Visit this group at https://groups.google.com/group/scrapy-users. > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
