Thanks for cc-ing me Steve.
I may be able to help jump-start this a bit and provide a platform for this to
run on. I deployed a small service that scans PyPI to figure out statistics on
Python 2 vs Python 3 support using PyPI Classifiers. The source is on GitHub:
I'm interested, and potentially in a position to provide funded infrastructure
for this (though perhaps not as soon as you'd like, since things can move
slowly at my end).
My personal preference would be to download a full list. This is slow moving
data that will gzip nicely, and my uses (in
For a variety of reasons, I would like to build an index of what
modules/packages are contained in which distributions ('packages') on
PyPI. For instance:
- Identifying requirements by static analysis of code: 'import zmq' ->
requires pyzmq
- Finding corresponding packages from different
