Hello I am new in python and scrapy, therefore I can not find the way to answer a question, I tried to search for hours on the internet before asking on the list.
I have a website I want to extract data that contains text with accents (á, é, ö,...) and when scrapy saves me the data (-o json) does so in unicode format, so these characters contain \u00f3, \u00e9, and other characters. With package htmlentitydefs and codepoint2name I have managed to get the html entity name, but I want to get the text in text format, as the website has it. How I can fix it? And when I want to get the html entity name. There is some parameter that is passed to scrapy (or configurred in settings.py) to do so without duplicate resources with a new function as have I done? Thanks a lot. Best regards -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/d/optout.
