On Mon, 2010-10-11 at 21:45 -0400, John Reese wrote:
> Hello,
>
> I apologize if I'm asking questions that have answers elsewhere, but looking
> at
> the documentation and google searching has not helped. I'm trying to migrate
> from using Python's urllib2 module to urlgrabber, for both the progress bar
> feature and the simple urlgrab() function. However, I've come across two
> problems, and am hoping someone on this list might be able to point me in the
> right directions.
>
> For context, I'm running Ubuntu 10.10 with the default 'python' (2.6.6) and
> 'python-urlgrabber' (3.1.0) packages.
urlgrabber-3.1.0 is pretty old now, and is still using urilib2.
> 1. First, when dealing with the progress bar, I seem to have a problem where
> the
> progress bar only shows up *after* the file has been completely downloaded and
> the file handle has been close()'d. Even trying to use it in a basic context
> seems to prove unhelpful:
>
> po = urlgrabber.progress.TextMeter()
> f = urlgrabber.urlgrab("...", progress_obj=po)
That should work. Is sys.stdout anything weird? Does
"running" /usr/lib/python2.6/site-packages/urlgrabber/progress.py show
progress output?
Does running the urlgrabber command with -p show progress?
> 2. Urlgrabber requests throw a nasty exception/stack trace when requesting
> anything over HTTPS/SSL: http://pastebin.com/Ku3PyJze -- is there a
> fix/workaround for this, or should I use a different version of the module?
> Or
> am I missing something again?
I'd upgrade to a newer urlgrabber which uses pycurl.
_______________________________________________
Yum-devel mailing list
Yum-devel@lists.baseurl.org
http://lists.baseurl.org/mailman/listinfo/yum-devel
