----- Forwarded by Bob Hansen/Endicott/IBM on 05/11/2016 05:33 PM -----
From: Bob Hansen/Endicott/IBM To: Jeremy Stanley <[email protected]> Date: 05/11/2016 05:18 PM Subject: Re: [OpenStack-Infra] Correct URL to synch local pypi mirror from Jeremy Stanley <[email protected]> wrote on 05/11/2016 04:46:10 PM: Thanks Jeremy, > From: Jeremy Stanley <[email protected]> > To: Bob Hansen/Endicott/IBM@IBMUS > Cc: [email protected] > Date: 05/11/2016 04:46 PM > Subject: Re: [OpenStack-Infra] Correct URL to synch local pypi mirror from > > On 2016-05-11 16:31:48 -0400 (-0400), Bob Hansen wrote: > [...] > > I have a bandersnatch mirror, that mirrors from pypi.python.org > > every few hours, but during a run it can't find packages that have > > been updated in various requirements.txt files and not on > > pypi.python.org. > [...] > > Update latency could be one possible issue. We update our mirrors > every 5 minutes, so it's possible you're seeing constraints updates > landing and specifying versions of things which are not yet in your > mirror. ok, I've been doing it every hour. > > > Recently there was a change made to the oslo.config and oslo.concurrency > > versions that are not on my mirror and are not on pypi.python.org. > [...] > > A check on pypi (and my mirror) shows the most recent version is > > oslo.config 3.4.0 > > I wonder why you think 3.4.0 is the latest version... at > https://pypi.python.org/simple/oslo.config/ I see both > oslo.config-3.9.0.tar.gz and oslo.config-3.9.0-py2.py3-none-any.whl > linked. Looked at your link, I was using the search box on pypi. Not sure why search doesn't return all the versions which is a bit concerning, but I'll ignore that. If I do a pip search using my mirror I get 3.4.0, if I poke around in .../simple/oslo.config on my mirror I see the 3.9.0 tar file. I guess my mirror is messed up, not sure why as it's been running for several months now with only a few burps. I'm going to rebuild the entire mirror again, and see if that fixes it up. > > > Questions: > > 1.What is the proper URL to synch my mirror from? > > We use mirror.master=https://pypi.python.org in our bandersnatch > configuration, as indicated here: > <URL: http://git.openstack.org/cgit/openstack-infra/puppet- > bandersnatch/tree/templates/bandersnatch.conf.erb#n8 > > > > 2.See many references to per-reqion openstack pypi mirrors, should I be > > using them? If so, what are the URLs, or where can I find them? Seems I was on the correct path with pypi.python anyway. Based on your response this option should be discarded. > > No, those are local mirrors in our various CI environments. We don't > recommend their use outside our upstream CI jobs/workers for a > variety of reasons (they're unofficial/non-canonical, we frequently > rename or reorganize them in opaque and disruptive ways, may have > them down for unannounced maintenance, et cetera). > -- > Jeremy Stanley > Bob Hansen z/VM OpenStack Enablement
_______________________________________________ OpenStack-Infra mailing list [email protected] http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
