Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-13 Thread Arnaud L. 
Le 13/04/2017 à 11:49, Andrea Aime a écrit :
> Ideally, try to setup a new mosaic with just 2 granules, with a
> shapefile index, and see if you can reproduce the problem.
> Increase the number of granules until you can, then pack everything into
> a zip file and attach it to an issue in Jira.

OK, I'll do that ASAP. Probably not this week though.

> Just to be sure, are you reprojecting the data? If you are, it would be
> sort of normal to have such jump every now and then.

AFAIK, no. I'm trying very hard not to reproject, but indeed this does 
looks like a reprojection jump.

The tif is in EPSG:32631 (but it has no .prf file, only a .tfw file), 
the imagemosaic is configured with native src EPSG:32631 and data src 
EPSG:32631.
I am querying this layer via wms and specifying CRS=EPSG:32631.

That's all I can think of. The only problem I see is that the tif have 
no prj files, but since the mosaic is defined with the correct data src 
I think it should not matter, right ?

Regards

--
Arnaud

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-13 Thread Andrea Aime 
On Thu, Apr 13, 2017 at 11:25 AM, Arnaud L.  wrote:

> I'd be glad to help you with this.
> What should I provide to make it easy to replicate this ?
>

Ideally, try to setup a new mosaic with just 2 granules, with a shapefile
index, and see if you can reproduce the problem.
Increase the number of granules until you can, then pack everything into a
zip file and attach it to an issue in Jira.

Just to be sure, are you reprojecting the data? If you are, it would be
sort of normal to have such jump every now and then.
It could be improved I believe, but definitely not trivial (be prepared to
sponsor some development or in that case).

Cheers
Andrea

-- 
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39  339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.



The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility  for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

---
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-13 Thread Arnaud L. 
Le 13/04/2017 à 10:09, Andrea Aime a écrit :
> On Wed, Apr 12, 2017 at 2:12 PM, Arnaud L.  > wrote:
>
> Trying to make a sample dataset I realized that this was not a
> stitching problem, because the glitch is inside a tile, not on a
> border between tiles.
> So this is something totally different I believe... or is it not ?
>
>
> It may be, hard to tell what is it without actually looking into it

I'd be glad to help you with this.
What should I provide to make it easy to replicate this ?
I can provide the corresponding tiff with its world file, but will it be 
enough ? The index is in a postgis database, so I could dump the 
appropriate line ?


Regards

--
Arnaud

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-13 Thread Andrea Aime 
On Wed, Apr 12, 2017 at 2:12 PM, Arnaud L.  wrote:

> Trying to make a sample dataset I realized that this was not a stitching
> problem, because the glitch is inside a tile, not on a border between tiles.
> So this is something totally different I believe... or is it not ?
>

It may be, hard to tell what is it without actually looking into it

Cheers
Andrea


-- 
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39  339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.



The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility  for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

---
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Arnaud L. 
Le 12/04/2017 à 13:59, Andrea Aime a écrit :
> That setting is used only while reprojecting, has no control over stitching.
> For the residual issues, plan B, "open a ticket in the bug tracker with
> sample data and
> requests showing the issue, so that developers can debug it on their own
> machine"

Trying to make a sample dataset I realized that this was not a stitching 
problem, because the glitch is inside a tile, not on a border between tiles.
So this is something totally different I believe... or is it not ?

PS : Of course I checked the tile itself and it looks good, the glitch 
is only on the WMS representation.


Regards

--
Arnaud


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Andrea Aime 
On Wed, Apr 12, 2017 at 1:17 PM, Arnaud L.  wrote:

> 2.11.0 does help, thanks ! I don't have black lines anymore.
>
> I still do have some stitching problems though, as illustrated here :
> http://i.imgur.com/0VUlYWU.png
> I tries with both "accurate resolution computation" on and off, but this
> setting has no effect on the problem.
>

That setting is used only while reprojecting, has no control over stitching.
For the residual issues, plan B, "open a ticket in the bug tracker with
sample data and
requests showing the issue, so that developers can debug it on their own
machine"

Cheers
Andrea


-- 
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39  339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.



The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility  for changes
made after they were sent or for other risks which arise as a result of
e-mail transmission, viruses, etc.

---
--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Arnaud L. 
Le 12/04/2017 à 10:35, Arnaud L. a écrit :
> Le 12/04/2017 à 10:28, Andrea Aime a écrit :
>> I've recently made a change that _might_
>> help: https://osgeo-org.atlassian.net/browse/GEOT-5615
>> The fix is present in GeoServer 2.10.2 and 2.11.0. If you are not using
>> them, I'd suggest to upgrade and
>> see if that helps,
>
> Indeed, I'm still on 2.8.4. I'll give 2.11.0 a try ASAP, hoping that the
> upgrade will go smoothly.

2.11.0 does help, thanks ! I don't have black lines anymore.

I still do have some stitching problems though, as illustrated here : 
http://i.imgur.com/0VUlYWU.png
I tries with both "accurate resolution computation" on and off, but this 
setting has no effect on the problem.

BTW, 2.8.4 was running without JAI (it was a mistake, because of an 
update of the JRE), and 2.11.0 is running with JAI. I don't know if this 
alone could explain the difference. Also I am running with 
multithreading on and therefore JAI ImageRead off, so I'm not sure that 
JAI is used anyway.

Regards

--
Arnaud

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Arnaud L. 
Hi Aime, thanks a lot for the quick answer !

Le 12/04/2017 à 10:28, Andrea Aime a écrit :
> I've recently made a change that _might_
> help: https://osgeo-org.atlassian.net/browse/GEOT-5615
> The fix is present in GeoServer 2.10.2 and 2.11.0. If you are not using
> them, I'd suggest to upgrade and
> see if that helps,

Indeed, I'm still on 2.8.4. I'll give 2.11.0 a try ASAP, hoping that the 
upgrade will go smoothly.

I'll keep you informed, and I'll have a look at the tracker anyway.

Thanks again !

--
Arnaud


--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users

Re: [Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Andrea Aime 
Hi Arnaud,
honestly I don't know, seems like an arithmetic issue happening somewhere
in the
mosaicking code.
I've recently made a change that _might_ help:
https://osgeo-org.atlassian.net/browse/GEOT-5615

The fix is present in GeoServer 2.10.2 and 2.11.0. If you are not using
them, I'd suggest to upgrade and
see if that helps, if you're already there instead, open a ticket in the
bug tracker with sample data and
requests showing the issue, so that developers can debug it on their own
machine

Cheers
Andrea


On Wed, Apr 12, 2017 at 9:39 AM, Arnaud L.  wrote:

> Hi all,
>
> I have set up an ImageMosaic store with existing TIFF tiles. They are
> not GeoTIFFs, but regular TIFF files with worldfiles.
> The index is stored in PostGIS (the information was already present
> there, I only had to create a view to match the index schema).
>
> In some cases, the stitching of rasters is not perfect and a black line
> appears between tiles.
>
> The rasters are in EPSG:32631, and I am also querying GeoServer's WMS in
> EPSG:32631, so no reprojection is done.
> The rasters are all 1000 pixels in widht and height, the resolution is
> 0.15875 (in EPSG 32631, so 0.15875 m/pix), so each raster is 158.75m in
> width and height.
>
> Here is an example request, and the resulting raster :
> WMS url :
> http://localhost/geoserver/dev/wms?SERVICE=WMS&VERSION=1.
> 3.0&REQUEST=GetMap&FORMAT=image%2Fpng&TRANSPARENT=true&
> LAYERS=dev%3Ageorasters_test&CRS=EPSG%3A32631&STYLES&WIDTH=
> 1920&HEIGHT=1349&BBOX=742405.64625%2C5087266.7415625%
> 2C742710.44625%2C5087480.895312501
> Raster : http://i.imgur.com/pE2H4QJ.png
>
> Slightly changing the bbox fixes things up (1 meter to the east) :
> WMS url :
> http://localhost/geoserver/dev/wms?SERVICE=WMS&VERSION=1.
> 3.0&REQUEST=GetMap&FORMAT=image%2Fpng&TRANSPARENT=true&
> LAYERS=dev%3Ageorasters_test&CRS=EPSG%3A32631&STYLES&WIDTH=
> 1920&HEIGHT=1349&BBOX=742406.64625%2C5087266.741562501%
> 2C742711.44625%2C5087480.895312501
> Raster : http://i.imgur.com/PjflMLd.png
>
> In my GeoServer layer's configuration, I have tried with "Accurate
> resolution computation" to true and false, to no avail (both examples
> above are with this setting set to true).
>
> Is there any other setting controlling the stitching mechanism ?
> Where could be the problem here ? In the index, or in the data ? Both
> are supposed to be 100% accurate, and indeed the both work without
> problem with another stitching library (no idea what it is exactly, it's
> a custom dll developed by a third party in .NET).
>
> Thanks a lot for your help !
>
> --
> Arnaud
>
> 
> --
> Check out the vibrant tech community on one of the world's most
> engaging tech sites, Slashdot.org! http://sdm.link/slashdot
> ___
> Geoserver-users mailing list
> Geoserver-users@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/geoserver-users
>



-- 
==
GeoServer Professional Services from the experts! Visit
http://goo.gl/it488V for more information.
==

Ing. Andrea Aime
@geowolf
Technical Lead

GeoSolutions S.A.S.
Via di Montramito 3/A
55054  Massarosa (LU)
phone: +39 0584 962313
fax: +39 0584 1660272
mob: +39  339 8844549

http://www.geo-solutions.it
http://twitter.com/geosolutions_it

*AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*

Le informazioni contenute in questo messaggio di posta elettronica e/o
nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
loro utilizzo è consentito esclusivamente al destinatario del messaggio,
per le finalità indicate nel messaggio stesso. Qualora riceviate questo
messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
darcene notizia via e-mail e di procedere alla distruzione del messaggio
stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
utilizzarlo per finalità diverse, costituisce comportamento contrario ai
principi dettati dal D.Lgs. 196/2003.



The information in this message and/or attachments, is intended solely for
the attention and use of the named addressee(s) and may be confidential or
proprietary in nature or covered by the provisions of privacy act
(Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
Code).Any use not in accord with its purpose, any disclosure, reproduction,
copying, distribution, or either dissemination, either whole or partial, is
strictly forbidden except previous formal approval of the named
addressee(s). If you are not the intended recipient, please contact
immediately the sender by telephone, fax or e-mail and delete the
information in this message that has been received in error. The sender
does not give any warranty or accept liability as the content, accuracy or
completeness of sent messages and accepts no responsibility  for changes
made after they were sent or for other risks which arise as a result

[Geoserver-users] ImageMosaic stitching precision

2017-04-12 Thread Arnaud L. 
Hi all,

I have set up an ImageMosaic store with existing TIFF tiles. They are 
not GeoTIFFs, but regular TIFF files with worldfiles.
The index is stored in PostGIS (the information was already present 
there, I only had to create a view to match the index schema).

In some cases, the stitching of rasters is not perfect and a black line 
appears between tiles.

The rasters are in EPSG:32631, and I am also querying GeoServer's WMS in 
EPSG:32631, so no reprojection is done.
The rasters are all 1000 pixels in widht and height, the resolution is 
0.15875 (in EPSG 32631, so 0.15875 m/pix), so each raster is 158.75m in 
width and height.

Here is an example request, and the resulting raster :
WMS url : 
http://localhost/geoserver/dev/wms?SERVICE=WMS&VERSION=1.3.0&REQUEST=GetMap&FORMAT=image%2Fpng&TRANSPARENT=true&LAYERS=dev%3Ageorasters_test&CRS=EPSG%3A32631&STYLES&WIDTH=1920&HEIGHT=1349&BBOX=742405.64625%2C5087266.7415625%2C742710.44625%2C5087480.895312501
Raster : http://i.imgur.com/pE2H4QJ.png

Slightly changing the bbox fixes things up (1 meter to the east) :
WMS url : 
http://localhost/geoserver/dev/wms?SERVICE=WMS&VERSION=1.3.0&REQUEST=GetMap&FORMAT=image%2Fpng&TRANSPARENT=true&LAYERS=dev%3Ageorasters_test&CRS=EPSG%3A32631&STYLES&WIDTH=1920&HEIGHT=1349&BBOX=742406.64625%2C5087266.741562501%2C742711.44625%2C5087480.895312501
Raster : http://i.imgur.com/PjflMLd.png

In my GeoServer layer's configuration, I have tried with "Accurate 
resolution computation" to true and false, to no avail (both examples 
above are with this setting set to true).

Is there any other setting controlling the stitching mechanism ?
Where could be the problem here ? In the index, or in the data ? Both 
are supposed to be 100% accurate, and indeed the both work without 
problem with another stitching library (no idea what it is exactly, it's 
a custom dll developed by a third party in .NET).

Thanks a lot for your help !

--
Arnaud

--
Check out the vibrant tech community on one of the world's most
engaging tech sites, Slashdot.org! http://sdm.link/slashdot
___
Geoserver-users mailing list
Geoserver-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-users