Hi Guys, I am new to scrappy and writing in a scrapper for a website. this website( http://www.codecheck.info/essen.kat) has many categories (pages) and sub categories (pages inside pages) Now I want to drill down the product page and want to grad some information from it.
Would someone let me know how to write the rules from this, i tried as mention below however it's not working . start_urls = ['http://www.codecheck.info/essen.kat'] rules = ( Rule(SgmlLinkExtractor(allow=('baguette\.kat', ),)), Rule(SgmlLinkExtractor(allow=('/ean_\*.*\/id_\*.*\/M_\*.*\.pro', )), callback='parse_item'), ) -- You received this message because you are subscribed to the Google Groups "scrapy-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/scrapy-users. For more options, visit https://groups.google.com/groups/opt_out.
