[jira] [Commented] (CLIMATE-948) cleanup podaac_datasource to accomodate Podaacpy 2.1.0

2018-03-22 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410514#comment-16410514
 ] 

ASF GitHub Bot commented on CLIMATE-948:


Github user agoodm commented on the issue:

https://github.com/apache/climate/pull/504
  
Looks like requests `podaac.jpl.nasa.gov` are inconsistently timing out:

```
==
ERROR: test suite for 
--
Traceback (most recent call last):
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 210, in run
self.setUp()
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 293, in setUp
self.setupContext(ancestor)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 316, in setupContext
try_run(context, names)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/util.py",
 line 471, in try_run
return func()
  File "/home/travis/build/apache/climate/ocw/tests/test_podaac.py", line 
35, in setUpClass
cls.dataset = podaac.extract_l4_granule(cls.variable, cls.datasetId, 
cls.name)
  File 
"/home/travis/build/apache/climate/ocw/data_source/podaac_datasource.py", line 
113, in extract_l4_granule
dataset_id=dataset_id, path=path)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/podaac/podaac.py",
 line 599, in extract_l4_granule
urlretrieve(url, path)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 188, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 163, in urlopen
return opener.open(url, data, timeout)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 466, in open
response = self._open(req, data)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 484, in _open
'_open', req)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 444, in _call_chain
result = func(*args)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 1488, in ftp_open
raise exc.with_traceback(sys.exc_info()[2])
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 1477, in ftp_open
fp, retrlen = fw.retrfile(file, type)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 2342, in retrfile
conn, retrlen = self.ftp.ntransfercmd(cmd)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/ftplib.py", line 
362, in ntransfercmd
source_address=self.source_address)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line 
712, in create_connection
raise err
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line 
703, in create_connection
sock.connect(sa)
urllib.error.URLError: 
 >> begin captured logging << 
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: http://podaac.jpl.nasa.gov:80 "GET 
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02=1=timeAsc=7=atom=True
 HTTP/1.1" 302 346
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: https://podaac.jpl.nasa.gov:443 "GET 
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02=1=timeAsc=7=atom=True
 HTTP/1.1" 200 None
- >> end captured logging << -
```


> cleanup podaac_datasource to accomodate Podaacpy 2.1.0
> --
>
> Key: CLIMATE-948
> URL: https://issues.apache.org/jira/browse/CLIMATE-948
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: data sources
>Affects Versions: 1.3.0
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Major
> Fix For: 1.3.0
>
>
> I just released [Podaacpy 2.1.0|https://pypi.python.org/pypi/podaacpy], there 
> are a few changes to be made to OCW's 
> [podaac_datasource.py|https://github.com/apache/climate/blob/master/ocw/data_source/podaac_datasource.py]
>  to accomodate some new Podaacpy utility API's.
> PR coming up.



--
This message 

[GitHub] climate issue #504: CLIMATE-948 cleanup podaac_datasource to accomodate Poda...

2018-03-22 Thread agoodm
Github user agoodm commented on the issue:

https://github.com/apache/climate/pull/504
  
Looks like requests `podaac.jpl.nasa.gov` are inconsistently timing out:

```
==
ERROR: test suite for 
--
Traceback (most recent call last):
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 210, in run
self.setUp()
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 293, in setUp
self.setupContext(ancestor)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/suite.py",
 line 316, in setupContext
try_run(context, names)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/nose/util.py",
 line 471, in try_run
return func()
  File "/home/travis/build/apache/climate/ocw/tests/test_podaac.py", line 
35, in setUpClass
cls.dataset = podaac.extract_l4_granule(cls.variable, cls.datasetId, 
cls.name)
  File 
"/home/travis/build/apache/climate/ocw/data_source/podaac_datasource.py", line 
113, in extract_l4_granule
dataset_id=dataset_id, path=path)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/site-packages/podaac/podaac.py",
 line 599, in extract_l4_granule
urlretrieve(url, path)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 188, in urlretrieve
with contextlib.closing(urlopen(url, data)) as fp:
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 163, in urlopen
return opener.open(url, data, timeout)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 466, in open
response = self._open(req, data)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 484, in _open
'_open', req)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 444, in _call_chain
result = func(*args)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 1488, in ftp_open
raise exc.with_traceback(sys.exc_info()[2])
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 1477, in ftp_open
fp, retrlen = fw.retrfile(file, type)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/urllib/request.py", 
line 2342, in retrfile
conn, retrlen = self.ftp.ntransfercmd(cmd)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/ftplib.py", line 
362, in ntransfercmd
source_address=self.source_address)
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line 
712, in create_connection
raise err
  File 
"/home/travis/miniconda/envs/test-environment/lib/python3.5/socket.py", line 
703, in create_connection
sock.connect(sa)
urllib.error.URLError: 
 >> begin captured logging << 
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: http://podaac.jpl.nasa.gov:80 "GET 
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02=1=timeAsc=7=atom=True
 HTTP/1.1" 302 346
urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 
podaac.jpl.nasa.gov
urllib3.connectionpool: DEBUG: https://podaac.jpl.nasa.gov:443 "GET 
/ws/search/granule/?datasetId=PODAAC-GHCMC-4FM02=1=timeAsc=7=atom=True
 HTTP/1.1" 200 None
- >> end captured logging << -
```


---


[jira] [Commented] (CLIMATE-948) cleanup podaac_datasource to accomodate Podaacpy 2.1.0

2018-03-22 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410329#comment-16410329
 ] 

ASF GitHub Bot commented on CLIMATE-948:


Github user lewismc commented on the issue:

https://github.com/apache/climate/pull/504
  
I am not quite sure why the tests are failing with Python 3.5 and 2.7. Can 
anyone else have a look?
I a running Python 3.6.1 :: Continuum Analytics, Inc.


> cleanup podaac_datasource to accomodate Podaacpy 2.1.0
> --
>
> Key: CLIMATE-948
> URL: https://issues.apache.org/jira/browse/CLIMATE-948
> Project: Apache Open Climate Workbench
>  Issue Type: Improvement
>  Components: data sources
>Affects Versions: 1.3.0
>Reporter: Lewis John McGibbney
>Assignee: Lewis John McGibbney
>Priority: Major
> Fix For: 1.3.0
>
>
> I just released [Podaacpy 2.1.0|https://pypi.python.org/pypi/podaacpy], there 
> are a few changes to be made to OCW's 
> [podaac_datasource.py|https://github.com/apache/climate/blob/master/ocw/data_source/podaac_datasource.py]
>  to accomodate some new Podaacpy utility API's.
> PR coming up.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] climate issue #504: CLIMATE-948 cleanup podaac_datasource to accomodate Poda...

2018-03-22 Thread lewismc
Github user lewismc commented on the issue:

https://github.com/apache/climate/pull/504
  
I am not quite sure why the tests are failing with Python 3.5 and 2.7. Can 
anyone else have a look?
I a running Python 3.6.1 :: Continuum Analytics, Inc.


---


[jira] [Resolved] (CLIMATE-891) Make (non-ESGF and pydap) examples script python 3 compatible

2018-03-22 Thread Lewis John McGibbney (JIRA)

 [ 
https://issues.apache.org/jira/browse/CLIMATE-891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Lewis John McGibbney resolved CLIMATE-891.
--
Resolution: Fixed

Thank you [~michael.arthur.ander...@gmail.com]

> Make (non-ESGF and pydap) examples script python 3 compatible
> -
>
> Key: CLIMATE-891
> URL: https://issues.apache.org/jira/browse/CLIMATE-891
> Project: Apache Open Climate Workbench
>  Issue Type: Bug
>Affects Versions: 1.1.0
>Reporter: Alex Goodman
>Assignee: Michael Anderson
>Priority: Major
> Fix For: 1.3.0
>
>
> The example scripts should be updated to ensure that they can run with python 
> 3. This should be possible for all of them except those which use ESGF and 
> pydap loaders, which currently do not support python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (CLIMATE-891) Make (non-ESGF and pydap) examples script python 3 compatible

2018-03-22 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/CLIMATE-891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410325#comment-16410325
 ] 

ASF GitHub Bot commented on CLIMATE-891:


Github user asfgit closed the pull request at:

https://github.com/apache/climate/pull/501


> Make (non-ESGF and pydap) examples script python 3 compatible
> -
>
> Key: CLIMATE-891
> URL: https://issues.apache.org/jira/browse/CLIMATE-891
> Project: Apache Open Climate Workbench
>  Issue Type: Bug
>Affects Versions: 1.1.0
>Reporter: Alex Goodman
>Assignee: Michael Anderson
>Priority: Major
> Fix For: 1.3.0
>
>
> The example scripts should be updated to ensure that they can run with python 
> 3. This should be possible for all of them except those which use ESGF and 
> pydap loaders, which currently do not support python 3.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] climate pull request #501: CLIMATE-891 Make (non-ESGF and pydap) examples sc...

2018-03-22 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/climate/pull/501


---