[
https://issues.apache.org/jira/browse/CLIMATE-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16410514#comment-16410514
]
ASF GitHub Bot commented on CLIMATE-948:
----------------------------------------
Github user agoodm commented on the issue:
https://github.com/apache/climate/pull/504
Looks like requests `podaac.jpl.nasa.gov` are inconsistently timing out:
```
======================================================================
ERROR: test suite for <class 'ocw.tests.test_podaac.TestPodaacDataSource'>
----------------------------------------------------------------------
Traceback (most recent call last):
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
line 210, in run
self.setUp()
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
line 293, in setUp
self.setupContext(ancestor)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
line 316, in setupContext
try_run(context, names)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/util.py",
line 471, in try_run
return func()
File "/home/travis/build/apache/climate/ocw/tests/test_podaac.py", line
35, in setUpClass
cls.dataset = podaac.extract_l4_granule(cls.variable, cls.datasetId,
cls.name)
File
"/home/travis/build/apache/climate/ocw/data_source/podaac_datasource.py", line
113, in extract_l4_granule
dataset_id=dataset_id, path=path)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/podaac/podaac.py",
line 599, in extract_l4_granule
urlretrieve(url, path)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 188, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 163, in urlopen
return opener.open(url, data, timeout)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 466, in open
response = self._open(req, data)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 484, in _open
'_open', req)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 444, in _call_chain
result = func(*args)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 1488, in ftp_open
raise exc.with_traceback(sys.exc_info()[2])
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 1477, in ftp_open
fp, retrlen = fw.retrfile(file, type)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py",
line 2342, in retrfile
conn, retrlen = self.ftp.ntransfercmd(cmd)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/ftplib.py", line
362, in ntransfercmd
source_address=self.source_address)
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line
712, in create_connection
raise err
File
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line
703, in create_connection
sock.connect(sa)
urllib.error.URLError: <urlopen error ftp error: TimeoutError(110,
'Connection timed out')>
-------------------- >> begin captured logging << --------------------
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1):
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: http://podaac.jpl.nasa.gov:80 "GET
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02&startIndex=1&sortBy=timeAsc&itemsPerPage=7&format=atom&pretty=True
HTTP/1.1" 302 346
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1):
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: https://podaac.jpl.nasa.gov:443 "GET
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02&startIndex=1&sortBy=timeAsc&itemsPerPage=7&format=atom&pretty=True
HTTP/1.1" 200 None
--------------------- >> end captured logging << ---------------------
```
> cleanup podaac_datasource to accomodate Podaacpy 2.1.0
> ------------------------------------------------------
>
> Key: CLIMATE-948
> URL: https://issues.apache.org/jira/browse/CLIMATE-948
> Project: Apache Open Climate Workbench
> Issue Type: Improvement
> Components: data sources
> Affects Versions: 1.3.0
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.3.0
>
>
> I just released [Podaacpy 2.1.0|https://pypi.python.org/pypi/podaacpy], there
> are a few changes to be made to OCW's
> [podaac_datasource.py|https://github.com/apache/climate/blob/master/ocw/data_source/podaac_datasource.py]
> to accomodate some new Podaacpy utility API's.
> PR coming up.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
