Err, well, thanks for that discussion gents... As it happens I do know how to use a database, but I regard it as overkill for what I am trying to do here. I think a combination of hashing the URL, and using a suffix to indicate the result of previous downloaded attempts, will work adequately for my needs.
Thanks again
Jon N
--
https://mail.python.org/mailman/listinfo/python-list
