I'm trying to bump the version of commons-io from 2.6 to 2.10 (or any other
value for now) and all is fine except for
`org.geotools.coverage.io.netcdf.NetCDFMosaicReaderTest.testReHarvest()` on
a Windows machine which fails by not reading the 2 new granules added to
the NC file. I've checked the obvious things like files being held open or
not overwritten etc and it isn't anything obvious that I can see (I'm sure
it will be obvious once someone points it out :-) ). I've compared the log
files of a linux and windows run but nothing jumps out at me.


16c16
< INFO: ACCEPTED: /tmp/junit8062632297122653609/nc_harvest4/
polyphemus_20130301_test.nc
---
> INFO: ACCEPTED:
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\
polyphemus_20130301_test.nc
24c24
< INFO: found /tmp/junit8062632297122653609/nc_harvest4/datastore.properties
---
> INFO: found
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\datastore.properties

the file names are different!

36a37,38
> org.geotools.gce.imagemosaic.Utils loadMosaicProperties
> INFO: Required key Levels not found.

Windows seems to loop through this one more time (I suspect it is just a
timing thing as my windows VM is slower)

38c40
< INFO: found /tmp/junit8062632297122653609/nc_harvest4/datastore.properties
---
> INFO: found
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\datastore.properties
45c47
< target /tmp/junit8062632297122653609/nc_harvest4/
polyphemus_20130301_test.nc
---
> target
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\
polyphemus_20130301_test.nc
47,48c49,50
< /tmp/junit8062632297122653609/nc_harvest4/polyphemus_20130301_test.nc.bak
exists? true
< nc2
/home/ian/code/geotools/modules/plugin/coverage-multidim/netcdf/target/test-classes/org/geotools/coverage/io/netcdf/test-data/
polyphemus_20130301_test_more_times.nc
---
>
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\polyphemus_20130301_test.nc.bak
exists? true
> nc2
X:\geotools\modules\plugin\coverage-multidim\netcdf\target\test-classes\org\geotools\coverage\io\netcdf\test-data\
polyphemus_20130301_test_more_times.nc
51,52d52
< org.geotools.jdbc.JDBCDataStore getSQLTypeNames
< WARNING: Fetching fields from Database

Linux makes an extra (?) call to get the SQLTypeNames

54c54
< INFO: ACCEPTED: /tmp/junit8062632297122653609/nc_harvest4/
polyphemus_20130301_test.nc
---
> INFO: ACCEPTED:
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\
polyphemus_20130301_test.nc

Linux has 4 granules rather than windows 2:

59,60d58
< SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom
id=O3.5>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875,
14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute:
location<location id=O3.5>=polyphemus_20130301_test.nc,
SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.5>=2,
SimpleFeatureImpl.Attribute: time<time id=O3.5>=2013-03-01 02:00:00.0]
< SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom
id=O3.6>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875,
14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute:
location<location id=O3.6>=polyphemus_20130301_test.nc,
SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.6>=3,
SimpleFeatureImpl.Attribute: time<time id=O3.6>=2013-03-01 03:00:00.0]

I've attached the full logs if anyone else wants to look. I'm completely
stumped by this but I don't really understand what the test is doing or
what subtle failures it could have?

Ian
-- 
Ian Turton
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
log4j:WARN No appenders could be found for logger (org.apache.commons.beanutils.converters.BooleanConverter).
log4j:WARN Please initialize the log4j system properly.
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file indexer.properties
org.geotools.imageio.netcdf.utilities.NetCDFUtilities <clinit>
INFO: Value of Check Coordinate Plugins:null
org.geotools.imageio.netcdf.utilities.NetCDFUtilities <clinit>
INFO: Should check for coordinate handler plugins:false
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file polyphemus_20130301_test.nc
org.geotools.jdbc.JDBCDataStore getSQLTypeNames
WARNING: Fetching fields from Database
org.geotools.coverage.io.netcdf.NetCDFReader <init>
INFO: ACCEPTED: /tmp/junit8062632297122653609/nc_harvest4/polyphemus_20130301_test.nc
org.geotools.jdbc.JDBCDataStore getSQLTypeNames
WARNING: Fetching fields from Database
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Creating final properties file 
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: found /tmp/junit8062632297122653609/nc_harvest4/datastore.properties
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: filenameFilter AndFileFilter(NOT (NameFileFilter(indexer.properties)),AndFileFilter(NOT (NameFileFilter(datastore.properties)),AndFileFilter(FileFileFilter,SuffixFileFilter(.properties))))
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: found /tmp/junit8062632297122653609/nc_harvest4/datastore.properties
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: filenameFilter AndFileFilter(NOT (NameFileFilter(indexer.properties)),AndFileFilter(NOT (NameFileFilter(datastore.properties)),AndFileFilter(FileFileFilter,SuffixFileFilter(.properties))))
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
target /tmp/junit8062632297122653609/nc_harvest4/polyphemus_20130301_test.nc
renamed? true
/tmp/junit8062632297122653609/nc_harvest4/polyphemus_20130301_test.nc.bak exists? true
nc2 /home/ian/code/geotools/modules/plugin/coverage-multidim/netcdf/target/test-classes/org/geotools/coverage/io/netcdf/test-data/polyphemus_20130301_test_more_times.nc
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file polyphemus_20130301_test.nc
org.geotools.jdbc.JDBCDataStore getSQLTypeNames
WARNING: Fetching fields from Database
org.geotools.coverage.io.netcdf.NetCDFReader <init>
INFO: ACCEPTED: /tmp/junit8062632297122653609/nc_harvest4/polyphemus_20130301_test.nc
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Creating final properties file 
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.3>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.3>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.3>=0, SimpleFeatureImpl.Attribute: time<time id=O3.3>=2013-03-01 00:00:00.0]
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.4>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.4>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.4>=1, SimpleFeatureImpl.Attribute: time<time id=O3.4>=2013-03-01 01:00:00.0]
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.5>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.5>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.5>=2, SimpleFeatureImpl.Attribute: time<time id=O3.5>=2013-03-01 02:00:00.0]
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.6>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.6>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.6>=3, SimpleFeatureImpl.Attribute: time<time id=O3.6>=2013-03-01 03:00:00.0]
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
log4j:WARN No appenders could be found for logger (org.apache.commons.beanutils.converters.BooleanConverter).
log4j:WARN Please initialize the log4j system properly.
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file indexer.properties
org.geotools.imageio.netcdf.utilities.NetCDFUtilities <clinit>
INFO: Value of Check Coordinate Plugins:null
org.geotools.imageio.netcdf.utilities.NetCDFUtilities <clinit>
INFO: Should check for coordinate handler plugins:false
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file polyphemus_20130301_test.nc
org.geotools.jdbc.JDBCDataStore getSQLTypeNames
WARNING: Fetching fields from Database
org.geotools.coverage.io.netcdf.NetCDFReader <init>
INFO: ACCEPTED: C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\polyphemus_20130301_test.nc
org.geotools.jdbc.JDBCDataStore getSQLTypeNames
WARNING: Fetching fields from Database
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Creating final properties file 
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: found C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\datastore.properties
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: filenameFilter AndFileFilter(NOT (NameFileFilter(indexer.properties)),AndFileFilter(NOT (NameFileFilter(datastore.properties)),AndFileFilter(FileFileFilter,SuffixFileFilter(.properties))))
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: found C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\datastore.properties
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
org.geotools.gce.imagemosaic.ImageMosaicReader initReaderFromURL
INFO: filenameFilter AndFileFilter(NOT (NameFileFilter(indexer.properties)),AndFileFilter(NOT (NameFileFilter(datastore.properties)),AndFileFilter(FileFileFilter,SuffixFileFilter(.properties))))
org.geotools.gce.imagemosaic.Utils loadMosaicProperties
INFO: Required key Levels not found.
target C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\polyphemus_20130301_test.nc
renamed? true
C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\polyphemus_20130301_test.nc.bak exists? true
nc2 X:\geotools\modules\plugin\coverage-multidim\netcdf\target\test-classes\org\geotools\coverage\io\netcdf\test-data\polyphemus_20130301_test_more_times.nc
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Now indexing file polyphemus_20130301_test.nc
org.geotools.coverage.io.netcdf.NetCDFReader <init>
INFO: ACCEPTED: C:\Users\ian\AppData\Local\Temp\junit17289880738954782938\nc_harvest4\polyphemus_20130301_test.nc
org.geotools.gce.imagemosaic.ImageMosaicEventHandlers fireEvent
INFO: Creating final properties file 
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.3>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.3>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.3>=0, SimpleFeatureImpl.Attribute: time<time id=O3.3>=2013-03-01 00:00:00.0]
SimpleFeatureImpl:O3=[SimpleFeatureImpl.Attribute: the_geom<the_geom id=O3.4>=POLYGON ((4.9375 44.96875, 4.9375 50.96875, 14.9375 50.96875, 14.9375 44.96875, 4.9375 44.96875)), SimpleFeatureImpl.Attribute: location<location id=O3.4>=polyphemus_20130301_test.nc, SimpleFeatureImpl.Attribute: imageindex<imageindex id=O3.4>=1, SimpleFeatureImpl.Attribute: time<time id=O3.4>=2013-03-01 01:00:00.0]
_______________________________________________
GeoTools-Devel mailing list
GeoTools-Devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geotools-devel

Reply via email to