On Mon, Sep 24, 2012 at 9:38 AM, Robert Muir <rcm...@gmail.com> wrote: > On Mon, Sep 24, 2012 at 8:31 AM, <mikemcc...@apache.org> wrote: >> import tarfile >> import threading >> +import traceback >> import subprocess >> import signal > ... >> @@ -112,7 +113,14 @@ def getHREFs(urlString): >> break >> >> links = [] >> - for subUrl, text in >> reHREF.findall(urllib.request.urlopen(urlString).read().decode('UTF-8')): >> + try: >> + html = urllib.request.urlopen(urlString).read().decode('UTF-8') >> + except: >> + print('\nFAILED to open url %s' % urlString) >> + tracekback.print_exc() >> + raise > > This is a tpyo right? you meant traceback not tracekback ?
Woops yes :) I'll fix. Thanks. Mike McCandless http://blog.mikemccandless.com --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org