Hi Shubham, It's great you're interested in doing something with Scrapy for the GSoC.
I think there are some guides online worth reading, e.g: https://wiki.python.org/moin/SummerOfCode/2014 https://wiki.python.org/moin/SummerOfCode/Expectations http://en.flossmanuals.net/GSoCStudentGuide/ As for the HTTP API, I think it's worth learning how Scrapy spiders work and how they interact with the Scrapy framework. If you were to define a python API for the same use case, what would it look like and how would you implement it? If you're interested in learning more about HTTP API design, there are a few guides and best practices online. Scrapy already makes heavy use of JSON, so I think that's probably a good idea for the API. If you have any specific questions, we're here to answer them! Shane On 19 February 2014 03:11, Shubham Tomar <[email protected]> wrote: > Hi all, > > I'm Shubham Singh Tomar. I'm a 2nd year engineering student. I would like > to work on HTTP API for Scrapy > spiders<https://github.com/scrapy/scrapy/wiki/GSoC-2014-Ideas#wiki-http-api-for-scrapy-spiders> > project. > I'm interested in Data Science (especially data wrangling and > visualization) and Machine learning. I took quite a few online courses > (MOOCs) and in nearly all of them scrapy came in handy. I have interned at > a startup working in the field of data science and ML and am developing a > gamified > Introduction to Computer Science > course<http://vtc.internshala.com/signup/course_details.php?course=python101> > using > Python. > PFA my resume` and some certificates for courses I took where I used > Scrapy. > Though I have worked with HTTP APIs, I haven't really worked on developing > one. > > Where should I get started ? Any help would be highly appreciated. > > > Thanks and Regards, > Shubham > > -- > You received this message because you are subscribed to the Google Groups > "scrapy-users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To post to this group, send email to [email protected]. > Visit this group at http://groups.google.com/group/scrapy-users. > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
