Hey all. I've been meaning to get into web scraping and was pointed to the directions of lxml (library) and scrapy (framework). Can I ask in terms of web scraping, what's the difference between a library and a framework? Surely everyone should use a framework but I get the idea more people use the available libraries like lxml over scrapy. Any advantages or disadvantages for each? And which do you use out of the 2?
I also have another question due to reading this: "[Tutor] HTML Parsing" . It seems some experienced coders don't find scraping as useful since web sites offer apis for their data. Is the idea/concept here the same as scraping? And is there any use of scraping anymore when sites are now offering their data? _______________________________________________ Tutor maillist - Tutor@python.org To unsubscribe or change subscription options: https://mail.python.org/mailman/listinfo/tutor