On 23 May 2011 22:55, Reinout van Rees <[email protected]> wrote: > On 23-05-11 16:41, Bruno Binet wrote: >> >> As you can see, eggproxy will scan the configobj index multiple times >> which causes the timeout. >> After digging in the code, I've found that the problem comes from >> download urls of that form: >> >> http://www.voidspace.org.uk/cgi-bin/voidspace/downman.py?file=configobj-4.4.0.zip >> The urls ending with ".py" are interpreted as special urls by >> setuptools/distribute and requires to scan the index again, but I >> can't say why. >> >> Any idea how we can fix this in collective.eggproxy? >> I've thought of introducing a short time during which we won't scan >> again the same index instead of always refresh. >> > Why don't people just upload to pypi... It is always the externally hosted > packages that are a problem. > > Anyway: > > - Feel free to introduce a workaround. > > - You make it sound like this is an setuptools bug or so. Perhaps even just > work around the .py problem? > > - Rescanning: perhaps just keep a list of already-scanned urls during the > current run? And omitting reading them a second time during the same run? > Would that already help?
Thanks for your answer, I will make a patch and submit it back to you. I will also try to patch eggproxy to support augmenting the index from pypi with the old packages that have been saved in the cache and that would have been deleted on pypi.python.org. With that change, we will be able to serve packages coming from both our eggproxy cache and the pypi.python.org server. > Reinout > > -- > Reinout van Rees [email protected] > http://reinout.vanrees.org/ > "The most absolute lie is the presentation of an irrefutable > fact based on unassailable numbers -- L.E. Modesitt jr." > > -- Bruno Binet Camptocamp France SAS Savoie Technolac, BP 352 73377 Le Bourget du Lac, Cedex Mail : [email protected] http://www.camptocamp.com _______________________________________________ Product-Developers mailing list [email protected] https://lists.plone.org/mailman/listinfo/plone-product-developers
