Thanks a lot for replying positively Paul. I wanted to get working on my proposal and it would be great if I could contact Mr. Daniel.
Thank you. On Friday, 10 March 2017 17:23:30 UTC+5:30, Paul Tremberth wrote: > > I cannot speak for the mentor(s) (and I can't get hold of Daniel right > now), > but I would say that the benchmarking suite is a good project for GSoC as > Scrapy does not have much right now, and there's not way to compare > performance in CPU and memory between releases. > Some project do some profiling within their continuous integration > pipeline and the outcome of this project could help to do the same. > > Best, > Paul. > > On Fri, Mar 10, 2017 at 12:42 PM, Parth Verma <vermap...@gmail.com > <javascript:>> wrote: > >> Hi Paul, >> >> No I didn't mean that. I was asking about Scrapy benchmarking and memory >> management. It's because Mr. Daniel Grana is not replying and even though >> I've opened an issue and tagged him, I see no comments. >> >> It's just that I'm interested a lot in the project, so I want some >> feedback from the mentors. >> >> Thanks. >> >> On Friday, 10 March 2017 17:08:01 UTC+5:30, Paul Tremberth wrote: >>> >>> Hi Parth, >>> >>> Do you mean this idea? >>> "A new section in the official documentation could be added where people >>> could share their configuration files that they used to successfully scrape >>> data from a specific website " >>> >>> If that is what you meant, then no, I don't think it would qualify for a >>> GSoC project, as it is mostly about documenting settings, which is quite >>> far from programming work. >>> >>> Let me know if you meant something else. >>> >>> Best, >>> Paul. >>> >>> On Fri, Mar 10, 2017 at 12:28 PM, Parth Verma <vermap...@gmail.com> >>> wrote: >>> >>>> I wanted to know if this would be considered for a GSoC project. >>>> Waiting for your reply. >>>> >>>> On Saturday, 11 February 2017 21:20:19 UTC+5:30, Parth Verma wrote: >>>> >>>>> Hi, >>>>> >>>>> I am Parth Verma, a second year undergraduate pursuing MSc. in >>>>> Mathematics and Computing at IIT Kharagpur, India. >>>>> I have been doing open-source programming for a year. My github >>>>> profile is https://github.com/Parth-Vader. >>>>> My programming knowledge includes Python (Intermediate) , C >>>>> (Intermediate) , C++(Intermediate), HTML/CSS (basic) and Bash. I use >>>>> Ubuntu >>>>> 16.04 as my main operating system and Windows 8 for gaming. >>>>> I have been doing Data Analytics, and for that, I need to collect data >>>>> from various online sources and that's why I used Scrapy. >>>>> >>>>> I am interested in Scrapy benchmarking suite, since I have prior >>>>> knowledge of various algorithms and I want to learn memory management in >>>>> CPUs. What should be my next steps? >>>>> >>>>> Furthermore, I would like to suggest an idea. >>>>> >>>>> A new section in the official documentation could be added where >>>>> people could share their configuration files that they used to >>>>> successfully >>>>> scrape data from a specific website (by successful, I mean not getting >>>>> banned and getting a good speed.) This way, I believe , it would be >>>>> easier >>>>> for people without any prior knowledge of HTML, Python or Shell, could >>>>> easily use scrapy to get data from those specific sites. >>>>> In addition, we could create benchmarking for those sites as well. >>>>> >>>>> Thanks. >>>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups "scrapy-users" group. >>>> To unsubscribe from this group and stop receiving emails from it, send >>>> an email to scrapy-users...@googlegroups.com. >>>> To post to this group, send email to scrapy...@googlegroups.com. >>>> Visit this group at https://groups.google.com/group/scrapy-users. >>>> For more options, visit https://groups.google.com/d/optout. >>>> >>> >>> -- >> You received this message because you are subscribed to the Google Groups >> "scrapy-users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to scrapy-users...@googlegroups.com <javascript:>. >> To post to this group, send email to scrapy...@googlegroups.com >> <javascript:>. >> Visit this group at https://groups.google.com/group/scrapy-users. >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to scrapy-users+unsubscr...@googlegroups.com. To post to this group, send email to scrapy-users@googlegroups.com. Visit this group at https://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
