So I looked at the two tests that were causing problems and I can't figure out why. They don't fail on my system (the OpenDAP one still does of course). They're both failing on lat/lon value normalization, which is run when a new dataset is made to make sure the initial grid is close to the expected format for what we're doing. However, none of the other tests seem to be having a problem here.
Can someone else confirm if they're running into a similar problem? -- Joyce On Tue, Sep 9, 2014 at 10:01 AM, Michael Joyce <[email protected]> wrote: > Hay Paul, > > It looks like the normal OpenDAP test is failing as expected but I'm not > certain why these other tests are failing. I haven't seen anything on > Jenkins lately for this. I'll poke around and see if I can figure out > what's up. > > > > > -- Joyce > > On Tue, Sep 9, 2014 at 8:57 AM, Ramirez, Paul M (398J) < > [email protected]> wrote: > >> +1 see below for details of release check. Thanks for picking this up! >> Although 3 tests failed it appeared to be an OpenDAP endpoint issue. >> >> Notes (for future releases): >> - Add a reference to the release procedure in the vote email >> - KEYS file available at the top level, this is just a nicety as there is >> no need to untar and unzip to verify sigs >> >> >> Details of Release Check >> ==================== >> >> balrog:test-release pramirez$ wget -r -l1 --no-parent >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/ >> --2014-09-09 >> <https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/--2014-09-09> >> 08:12:55-- https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/ >> Resolving dist.apache.org... 140.211.11.4 >> Connecting to dist.apache.org|140.211.11.4|:443... connected. >> HTTP request sent, awaiting response... 200 OK >> Length: 739 [text/html] >> Saving to: ‘dist.apache.org/repos/dist/dev/climate/0.4_rc2/index.html’ >> >> 100%[==============================================================================>] >> 739 --.-K/s in 0s >> >> 2014-09-09 08:12:55 (17.2 MB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/index.html’ saved >> [739/739] >> >> Loading robots.txt; please ignore errors. >> --2014-09-09 08:12:55-- https://dist.apache.org/robots.txt >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 404 Not Found >> 2014-09-09 08:12:55 ERROR 404: Not Found. >> >> --2014-09-09 08:12:55-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 826653 (807K) [application/octet-stream] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz’ >> >> 100%[==============================================================================>] >> 826,653 766KB/s in 1.1s >> >> 2014-09-09 08:12:57 (766 KB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz’ >> saved [826653/826653] >> >> --2014-09-09 08:12:57-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.asc >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 819 [text/plain] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.asc’ >> >> 100%[==============================================================================>] >> 819 --.-K/s in 0s >> >> 2014-09-09 08:12:57 (15.9 MB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.asc’ >> saved [819/819] >> >> --2014-09-09 08:12:57-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.md5 >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 61 [text/plain] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.md5’ >> >> 100%[==============================================================================>] >> 61 --.-K/s in 0s >> >> 2014-09-09 08:12:57 (1.94 MB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.tgz.md5’ >> saved [61/61] >> >> --2014-09-09 08:12:57-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 963476 (941K) [application/octet-stream] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip’ >> >> 100%[==============================================================================>] >> 963,476 801KB/s in 1.2s >> >> 2014-09-09 08:12:58 (801 KB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip’ >> saved [963476/963476] >> >> --2014-09-09 08:12:58-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.asc >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 819 [text/plain] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.asc’ >> >> 100%[==============================================================================>] >> 819 --.-K/s in 0s >> >> 2014-09-09 08:12:58 (20.0 MB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.asc’ >> saved [819/819] >> >> --2014-09-09 08:12:58-- >> https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.md5 >> Reusing existing connection to dist.apache.org:443. >> HTTP request sent, awaiting response... 200 OK >> Length: 61 [text/plain] >> Saving to: ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.md5’ >> >> 100%[==============================================================================>] >> 61 --.-K/s in 0s >> >> 2014-09-09 08:12:58 (2.15 MB/s) - ‘ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/climate-0.4-rc2.zip.md5’ >> saved [61/61] >> >> FINISHED --2014-09-09 08:12:58-- >> Total wall clock time: 2.9s >> Downloaded: 7 files, 1.7M in 2.2s (785 KB/s) >> >> balrog:test-release pramirez$ cd >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/ >> >> balrog:0.4_rc2 pramirez$ mkdir tgz-build >> >> balrog:0.4_rc2 pramirez$ tar -xzvf climate-0.4-rc2.tgz -C tgz-build/ >> >> balrog:0.4_rc2 pramirez$ gpg --import tgz-build/KEYS >> gpg: key 58EBE86D: public key "Cameron Goodale (FOR CODE SIGNING) < >> [email protected]>" imported >> gpg: key 2C47D568: "Paul Michael Ramirez (CODE SIGNING KEY) < >> [email protected]>" not changed >> gpg: key 97E49CC0: public key "Michael Joyce (ASF Code Signing Key) < >> [email protected]>" imported >> gpg: Total number processed: 3 >> gpg: imported: 2 (RSA: 2) >> gpg: unchanged: 1 >> >> balrog:0.4_rc2 pramirez$ gpg --verify climate-0.4-rc2.tgz.asc >> gpg: Signature made Mon Sep 8 13:34:53 2014 PDT using RSA key ID 97E49CC0 >> gpg: Good signature from "Michael Joyce (ASF Code Signing Key) < >> [email protected]>" >> gpg: WARNING: This key is not certified with a trusted signature! >> gpg: There is no indication that the signature belongs to the >> owner. >> Primary key fingerprint: E910 C12D 9A7C 14CC ACCE D243 CB78 9D49 97E4 >> 9CC0 >> >> balrog:0.4_rc2 pramirez$ gpg --verify climate-0.4-rc2.zip.asc >> gpg: Signature made Mon Sep 8 13:34:37 2014 PDT using RSA key ID 97E49CC0 >> gpg: Good signature from "Michael Joyce (ASF Code Signing Key) < >> [email protected]>" >> gpg: WARNING: This key is not certified with a trusted signature! >> gpg: There is no indication that the signature belongs to the >> owner. >> Primary key fingerprint: E910 C12D 9A7C 14CC ACCE D243 CB78 9D49 97E4 >> 9CC0 >> >> balrog:0.4_rc2 pramirez$ md5 climate-0.4-rc2.tgz >> MD5 (climate-0.4-rc2.tgz) = caf71a68596fa29f31900825646a8c1b >> balrog:0.4_rc2 pramirez$ more climate-0.4-rc2.tgz.md5 >> MD5 (climate-0.4-rc2.tgz) = caf71a68596fa29f31900825646a8c1b >> >> balrog:0.4_rc2 pramirez$ md5 climate-0.4-rc2.zip >> MD5 (climate-0.4-rc2.zip) = 36f0ad3c843d4f32fee242fd5b381ea9 >> balrog:0.4_rc2 pramirez$ more climate-0.4-rc2.zip.md5 >> MD5 (climate-0.4-rc2.zip) = 36f0ad3c843d4f32fee242fd5b381ea9 >> >> (rcmes)balrog:ocw pramirez$ nosetests >> >> E......................E.....................................................................E........... >> ====================================================================== >> ERROR: test suite for <class 'ocw.tests.test_dap.TestDap'> >> ---------------------------------------------------------------------- >> Traceback (most recent call last): >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/nose/suite.py", >> line 208, in run >> self.setUp() >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/nose/suite.py", >> line 291, in setUp >> self.setupContext(ancestor) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/nose/suite.py", >> line 314, in setupContext >> try_run(context, names) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/nose/util.py", >> line 469, in try_run >> return func() >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/tests/test_dap.py", >> line 26, in setup_class >> dataset = dap.load(' >> http://test.opendap.org/dap/data/nc/sst.mnmean.nc.gz', 'sst') >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/data_source/dap.py", >> line 38, in load >> d = open_url(url) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/pydap/client.py", >> line 60, in open_url >> dataset = response(url) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/pydap/client.py", >> line 210, in _ddsdas >> dataset = DDSParser(dds).parse() >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/pydap/parsers/dds.py", >> line 26, in _dataset >> self.consume('dataset') >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/pydap/parsers/dds.py", >> line 19, in consume >> token = SimpleParser.consume(self, regexp) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/pydap/parsers/__init__.py", >> line 25, in consume >> raise Exception("Unable to parse token: %s" % self.buffer[:10]) >> Exception: Unable to parse token: <!DOCTYPE >> -------------------- >> begin captured logging << -------------------- >> pydap: INFO: Opening >> http://test.opendap.org/dap/data/nc/sst.mnmean.nc.gz.dds >> pydap: INFO: Opening >> http://test.opendap.org/dap/data/nc/sst.mnmean.nc.gz.das >> --------------------- >> end captured logging << --------------------- >> >> ====================================================================== >> ERROR: test_lons_values_incorrectly_gridded >> (ocw.tests.test_dataset.TestInvalidDatasetInit) >> ---------------------------------------------------------------------- >> Traceback (most recent call last): >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/tests/test_dataset.py", >> line 98, in test_lons_values_incorrectly_gridded >> ds = Dataset(lats, bad_lons, times, values) >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/dataset.py", >> line 59, in __init__ >> lats, lons, values = utils.normalize_lat_lon_values(lats, lons, >> values) >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/utils.py", >> line 214, in normalize_lat_lon_values >> data_out, lons_out = shiftgrid(180, data_out, lons_out, start=False) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/mpl_toolkits/basemap/__init__.py", >> line 4966, in shiftgrid >> raise ValueError('data must be 1d or 2d with longitude as 2nd dim') >> ValueError: data must be 1d or 2d with longitude as 2nd dim >> >> ====================================================================== >> ERROR: test_full_lons_shift >> (ocw.tests.test_utils.TestNormalizeLatLonValues) >> ---------------------------------------------------------------------- >> Traceback (most recent call last): >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/tests/test_utils.py", >> line 105, in test_full_lons_shift >> self.values) >> File "/Users/pramirez/test-release/ >> dist.apache.org/repos/dist/dev/climate/0.4_rc2/tgz-build/ocw/utils.py", >> line 214, in normalize_lat_lon_values >> data_out, lons_out = shiftgrid(180, data_out, lons_out, start=False) >> File >> "/Users/pramirez/.virtualenvs/rcmes/lib/python2.7/site-packages/mpl_toolkits/basemap/__init__.py", >> line 4966, in shiftgrid >> raise ValueError('data must be 1d or 2d with longitude as 2nd dim') >> ValueError: data must be 1d or 2d with longitude as 2nd dim >> >> ---------------------------------------------------------------------- >> Ran 104 tests in 422.091s >> >> FAILED (errors=3) >> >> Thanks, >> Paul >> >> On Sep 8, 2014, at 2:42 PM, Michael Joyce <[email protected]> >> wrote: >> >> > Hi all, >> > >> > The second release candidate for Apache Open Climate Workbench 0.4 is >> now >> > available. >> > >> > The tag for this release is available at: >> > http://s.apache.org/anr >> > >> > Release artifacts are available for review at: >> > https://dist.apache.org/repos/dist/dev/climate/0.4_rc2/ >> > >> > Please vote on releasing these packages as Apache OCW 0.4. The vote is >> > open for the next 72 hours >> > >> > Only votes from Apache OCW PMC are binding, but folks are welcome to >> check >> > the >> > release candidate and voice their approval or disapproval. The vote >> passes >> > if at least three binding +1 votes are cast. >> > >> > [ ] +1 Release the packages as Apache OCW 0.4 >> > >> > [ ] -1 Do not release the packages because... >> > >> > >> > --- >> > >> > >> > +1 from me >> > >> > >> > -- Joyce >> >> >
