>I believe this and the other crash are a result of a bug >in BeautifulSoup. I have reassigned the bug report to that package. > >Anyway the SVN version of webcheck has been "fixed" to catch errors >while parsing the page log them and otherwise ignore the page.
Unfortunately I fear that the fix is not enough. I downloaded webcheck 1.10.2 from the author's site, built and installed a new Debian package. I have beautifulsoup 3.0.4-1, and the bug surfaces still: webcheck: http://www.garanteprivacy.it/garante/navig/jsp/index.jsp Traceback (most recent call last): File "/usr/bin/webcheck", line 262, in <module> main(site) File "/usr/bin/webcheck", line 224, in main site.crawl(fp) # this will take a while File "/usr/share/webcheck/crawler.py", line 222, in crawl link.fetch() File "/usr/share/webcheck/crawler.py", line 544, in fetch parsermodule.parse(content, self) File "/usr/share/webcheck/parsers/html/beautifulsoup.py", line 50, in parse fromEncoding=str(link.encoding)) File "/var/lib/python-support/python2.5/BeautifulSoup.py", line 1282, in __init__ BeautifulStoneSoup.__init__(self, *args, **kwargs) File "/var/lib/python-support/python2.5/BeautifulSoup.py", line 946, in __init__ self._feed() File "/var/lib/python-support/python2.5/BeautifulSoup.py", line 971, in _feed SGMLParser.feed(self, markup) File "/usr/lib/python2.5/sgmllib.py", line 99, in feed self.goahead(0) File "/usr/lib/python2.5/sgmllib.py", line 133, in goahead k = self.parse_starttag(i) File "/usr/lib/python2.5/sgmllib.py", line 291, in parse_starttag self.finish_starttag(tag, attrs) File "/usr/lib/python2.5/sgmllib.py", line 340, in finish_starttag self.handle_starttag(tag, method, attrs) File "/usr/lib/python2.5/sgmllib.py", line 376, in handle_starttag method(attrs) File "/var/lib/python-support/python2.5/BeautifulSoup.py", line 1372, in start_meta self._feed(self.declaredHTMLEncoding) File "/var/lib/python-support/python2.5/BeautifulSoup.py", line 971, in _feed SGMLParser.feed(self, markup) File "/usr/lib/python2.5/sgmllib.py", line 99, in feed self.goahead(0) File "/usr/lib/python2.5/sgmllib.py", line 133, in goahead k = self.parse_starttag(i) File "/usr/lib/python2.5/sgmllib.py", line 285, in parse_starttag self._convert_ref, attrvalue) UnicodeDecodeError: 'ascii' codec can't decode byte 0xf9 in position 0: ordinal not in range(128) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
