Am 15.07.2014 00:50, schrieb Ryan Kelly:
> On 14/07/2014 7:08 PM, [email protected] wrote:
>> Am 14.07.2014 04:54, schrieb Ryan Kelly:
>>> You could try editing the Makefile to pass the --timeout option directly
>>> to pip. Where we currently have:
>>>
>>> INSTALL = $(ENV)/bin/pip install
>>>
>>> Add an argument to it like so:
>>>
>>> INSTALL = $(ENV)/bin/pip install --timeout=60
>>>
>>> Pip also appears to have a --proxy option which may be useful for you,
>>> try adding it in the Makefile like:
>>>
>>> INSTALL = $(ENV)/bin/pip install --proxy="user:[email protected]:port"
>>>
>> Thank You for the reply.
>>
>> No, this helped not - nothing changed. When I added the environment
>> variable PIP_DEFAULT_TIMEOUT of 60 seconds the timeout changed from 15
>> seconds to about 20 seconds. So it's obvious that the timeout parameter
>> to pip has it's effect, but there must be another timeout of 20 seconds
>> (from which component?) that overrules the 60 seconds of pip.
>>
>> The proxy server is successfully used, I see that in the logilfe.
>>
>> Which component could overrule the 60 second timeout of pip with these
>> 20 seconds?
> I can't think of anything off the top of my head. Please attach the
> full output from the `make build` command and I'll dig through to see
> what I can find.
If done some more testing and found, that timeouts from 1 second up to
20.9 seconds are working as expected.
The output is in this case:
raise Timeout(e, request=request)
Timeout:
(<pip._vendor.requests.packages.urllib3.connection.VerifiedHTTPSConnection
object at 0x1a44a90>, 'Connection to pypi.python.org timed out. (connect
timeout=20.9)')
If the timeout is more than these about 21 seconds the last lines are:
raise ProxyError(e)
ProxyError: ('Cannot connect to proxy.', error(110, 'Connection timed out'))
So, the first timeout is from pip, the second timeout is some other
component. Mutually it's this bug:
https://tickets.opscode.com/browse/COOK-1695
But, with the logfile of the proxy server the connection from the client
retrieving the file is always successful. From the proxy server point
of view the client, i.e. pip urllib3 has always received the whole
file. The retrieving of the file takes about 6 seconds.
In most cases it fails on packet zope.interface, but sometimes on others.
In a single case all downloads where successful but make failed because
of dependencies of g++.
Is there an option to keep alreay downloaded files rsp. is there an
option that I must not call "make clean" in front of "make build"?
If I don't do "make clean" the "make build" states "nothing to do" even
if "make build" failed before.
The full output is:
virtualenv --python=`which python2 python | head -n 1`
--no-site-packages ./local
Running virtualenv with interpreter /usr/local/bin/python2
New python executable in ./local/bin/python2
Also creating executable in ./local/bin/python
Installing setuptools, pip...done.
ARCHFLAGS=-Wno-error=unused-command-line-argument-hard-error-in-future
./local/bin/pip install -r requirements.txt
Downloading/unpacking
http://github.com/mozilla-services/mozservices/archive/5fabece891bbd3bd2c9528cb3bf0562b3efb4af1.zip
(from -r requirements.txt (line 7))
Downloading 5fabece891bbd3bd2c9528cb3bf0562b3efb4af1.zip (52kB): 52kB
downloaded
Running setup.py (path:/tmp/pip-3SfRF5-build/setup.py) egg_info for
package from
http://github.com/mozilla-services/mozservices/archive/5fabece891bbd3bd2c9528cb3bf0562b3efb4af1.zip
/usr/local/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'paster_plugins'
warnings.warn(msg)
Downloading/unpacking
https://github.com/mozilla-services/tokenserver/archive/d7e513e8a4f5c588b70d685a8df1d2e508c341c0.zip
(from -r requirements.txt (line 8))
Downloading d7e513e8a4f5c588b70d685a8df1d2e508c341c0.zip (322kB):
322kB downloaded
Running setup.py (path:/tmp/pip-IHzIND-build/setup.py) egg_info for
package from
https://github.com/mozilla-services/tokenserver/archive/d7e513e8a4f5c588b70d685a8df1d2e508c341c0.zip
warning: no files found matching '*.spec'
warning: no files found matching '*.json' under directory 'tokenserver'
Downloading/unpacking
http://github.com/mozilla-services/server-syncstorage/archive/1.5.5.zip
(from -r requirements.txt (line 9))
Downloading 1.5.5.zip (110kB): 110kB downloaded
Running setup.py (path:/tmp/pip-ILd5s_-build/setup.py) egg_info for
package from
http://github.com/mozilla-services/server-syncstorage/archive/1.5.5.zip
Downloading/unpacking cornice==0.16.2 (from -r requirements.txt (line 1))
Downloading cornice-0.16.2.tar.gz (45kB): 45kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/cornice/setup.py)
egg_info for package cornice
/usr/local/lib/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'paster_plugins'
warnings.warn(msg)
Downloading/unpacking pyramid==1.5 (from -r requirements.txt (line 2))
Downloading pyramid-1.5.tar.gz (2.4MB): 2.4MB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/pyramid/setup.py)
egg_info for package pyramid
Downloading/unpacking requests==2.2.1 (from -r requirements.txt (line 3))
Downloading requests-2.2.1-py2.py3-none-any.whl (625kB): 625kB downloaded
Downloading/unpacking simplejson==3.4 (from -r requirements.txt (line 4))
Downloading simplejson-3.4.0.tar.gz (68kB): 68kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/simplejson/setup.py)
egg_info for package simplejson
Downloading/unpacking SQLAlchemy==0.9.4 (from -r requirements.txt (line 5))
Downloading SQLAlchemy-0.9.4.tar.gz (4.5MB): 4.5MB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/SQLAlchemy/setup.py)
egg_info for package SQLAlchemy
warning: no files found matching '*.jpg' under directory 'doc'
warning: no files found matching 'distribute_setup.py'
warning: no files found matching 'sa2to3.py'
warning: no files found matching 'ez_setup.py'
no previously-included directories found matching 'doc/build/output'
Downloading/unpacking unittest2==0.5.1 (from -r requirements.txt (line 6))
Downloading unittest2-0.5.1.tar.gz (62kB): 62kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/unittest2/setup.py)
egg_info for package unittest2
Downloading/unpacking konfig (from mozsvc==0.8->-r requirements.txt
(line 7))
Downloading konfig-0.9.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/konfig/setup.py)
egg_info for package konfig
Downloading/unpacking PyBrowserID (from tokenserver==1.2.7->-r
requirements.txt (line 8))
Downloading PyBrowserID-0.9.2.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/PyBrowserID/setup.py)
egg_info for package PyBrowserID
Downloading/unpacking testfixtures (from tokenserver==1.2.7->-r
requirements.txt (line 8))
Downloading testfixtures-3.0.2.tar.gz (77kB): 77kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/testfixtures/setup.py)
egg_info for package testfixtures
Downloading/unpacking pyramid-hawkauth (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading pyramid_hawkauth-0.1.0.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/pyramid-hawkauth/setup.py)
egg_info for package pyramid-hawkauth
Downloading/unpacking PyMySQL (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading PyMySQL-0.6.2-py2.py3-none-any.whl (63kB): 63kB downloaded
Downloading/unpacking pymysql-sa (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading pymysql_sa-1.0.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/pymysql-sa/setup.py)
egg_info for package pymysql-sa
Downloading/unpacking umemcache (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading umemcache-1.6.3.zip
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/umemcache/setup.py)
egg_info for package umemcache
Downloading/unpacking wsgiproxy (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading WSGIProxy-0.2.2.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/wsgiproxy/setup.py)
egg_info for package wsgiproxy
Downloading/unpacking webtest (from SyncStorage==1.5.5->-r
requirements.txt (line 9))
Downloading WebTest-2.0.15.zip (86kB): 86kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/webtest/setup.py)
egg_info for package webtest
no previously-included directories found matching 'docs/_build'
warning: no previously-included files matching '*.pyc' found
anywhere in distribution
warning: no previously-included files matching '__pycache__' found
anywhere in distribution
Requirement already satisfied (use --upgrade to upgrade): setuptools in
./local/lib/python2.7/site-packages (from pyramid==1.5->-r
requirements.txt (line 2))
Downloading/unpacking WebOb>=1.3.1 (from pyramid==1.5->-r
requirements.txt (line 2))
Downloading WebOb-1.4.tar.gz (633kB): 633kB downloaded
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/WebOb/setup.py)
egg_info
for package WebOb
no previously-included directories found matching '*.pyc'
no previously-included directories found matching '*.pyo'
Downloading/unpacking repoze.lru>=0.4 (from pyramid==1.5->-r
requirements.txt (line 2))
Downloading repoze.lru-0.6.tar.gz
Running setup.py
(path:/root/mysources/repositories/syncserver/local/build/repoze.lru/setup.py)
egg_info for package repoze.lru
Downloading/unpacking zope.interface>=3.8.0 (from pyramid==1.5->-r
requirements.txt (line 2))
Cleaning up...
Exception:
Traceback (most recent call last):
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/basecommand.py",
line 122, in main
status = self.run(options, args)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/commands/install.py",
line 278, in run
requirement_set.prepare_files(finder,
force_root_egg_info=self.bundle, bundle=self.bundle)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/req.py",
line 1197, in prepare_files
do_download,
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/req.py",
line 1375, in unpack_url
self.session,
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/download.py",
line 546, in unpack_http_url
resp = session.get(target_url, stream=True)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py",
line 468, in get
return self.request('GET', url, **kwargs)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/download.py",
line 237, in request
return super(PipSession, self).request(method, url, *args, **kwargs)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py",
line 456, in request
resp = self.send(prep, **send_kwargs)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/_vendor/requests/sessions.py",
line 559, in send
r = adapter.send(request, **kwargs)
File
"/root/mysources/repositories/syncserver/local/lib/python2.7/site-packages/pip/_vendor/requests/adapters.py",
line 378, in send
raise ProxyError(e)
ProxyError: ('Cannot connect to proxy.', error(110, 'Connection timed out'))
Storing debug log for failure in /root/.pip/pip.log
make: *** [local] Error 2
Your help is very appreciated
Uwe
> Cheers,
>
> Ryan
>
> _______________________________________________
> Sync-dev mailing list
> [email protected]
> https://mail.mozilla.org/listinfo/sync-dev
_______________________________________________
Sync-dev mailing list
[email protected]
https://mail.mozilla.org/listinfo/sync-dev
