>
> in the particular case of S3 storage, make one that has good performance:
> S3 is a storage system with high latency
How would S3's latency compare with a JDBC connection to a database
(gt-imagemosaic-jdbc)? I would think they'd be about the same.
That also implies you have to load your imagery and overviews in some way
> that optimizes
> for data extraction performance
I was thinking one could use gdal_translate with -co "TILED=YES" so that
the GeoTIFF is internally tiled. In theory only the tile of interest would
be loaded into memory.
Thanks, Steve
On Wed, Feb 24, 2016 at 9:35 AM, Andrea Aime <[email protected]>
wrote:
> Hi Steve,
> the reason why nobody has attempted it so far is, I believe, that it's not
> so trivial to make
> a mosaicking plugin to start with (check how big the existing ones are),
> and in the particular case of S3 storage, make one that has good
> performance:
> S3 is a storage system with high latency, so one has to find ways to
> offset this
> latency in order to get good response times for a mosaicked request.
>
> That also implies you have to load your imagery and overviews in some way
> that optimizes
> for data extraction performance, which is another sub-system to think
> about and
> build.
>
> That said, it would be something quite cool to work on :-)
>
> Cheers
> Andrea
>
>
> On Wed, Feb 24, 2016 at 2:20 AM, Steve Kuo <[email protected]> wrote:
>
>> Hello,
>>
>> GeoServer uses GeoTool's Image Mosaic plugin (and corresponding Image
>> Mosaic JDBC plugin) to facilitate creating a layer made up of several files
>> (e.g. GeoTIFF). Currently the only two choices for mosaicing are 1) from a
>> directory, or 2) a JDBC connected database. Has anyone attempting to create
>> an Amazon Simple Storage Service (S3) based Image Mosaic plugin? Such a
>> plugin would depend on Amazon's Java AmazonS3Client, which allows for
>> iterating over all objects and fetching of the objects. Each object would
>> be a file (e.g. GeoTIFF). Such a plugin's logic would be almost identical
>> to Image Mosaic plugin, except that instead of getting files in a
>> directory, it would get S3 objects from a S3 bucket. I envision that such a
>> S3 based plugin would be valuable as it allows one to create a mosaiced
>> GeoServer layer backed by cloud storage. Does this idea make sense? Is
>> there some reason why no one has attempted this?
>>
>> Thanks, Steve
>>
>>
>> ------------------------------------------------------------------------------
>> Site24x7 APM Insight: Get Deep Visibility into Application Performance
>> APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
>> Monitor end-to-end web transactions and take corrective actions now
>> Troubleshoot faster and improve end-user experience. Signup Now!
>> http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
>> _______________________________________________
>> GeoTools-GT2-Users mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/geotools-gt2-users
>>
>>
>
>
> --
> ==
> GeoServer Professional Services from the experts! Visit
> http://goo.gl/it488V for more information.
> ==
>
> Ing. Andrea Aime
> @geowolf
> Technical Lead
>
> GeoSolutions S.A.S.
> Via di Montramito 3/A
> 55054 Massarosa (LU)
> phone: +39 0584 962313
> fax: +39 0584 1660272
> mob: +39 339 8844549
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
>
> *AVVERTENZE AI SENSI DEL D.Lgs. 196/2003*
>
> Le informazioni contenute in questo messaggio di posta elettronica e/o
> nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il
> loro utilizzo è consentito esclusivamente al destinatario del messaggio,
> per le finalità indicate nel messaggio stesso. Qualora riceviate questo
> messaggio senza esserne il destinatario, Vi preghiamo cortesemente di
> darcene notizia via e-mail e di procedere alla distruzione del messaggio
> stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso,
> divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od
> utilizzarlo per finalità diverse, costituisce comportamento contrario ai
> principi dettati dal D.Lgs. 196/2003.
>
>
>
> The information in this message and/or attachments, is intended solely for
> the attention and use of the named addressee(s) and may be confidential or
> proprietary in nature or covered by the provisions of privacy act
> (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection
> Code).Any use not in accord with its purpose, any disclosure, reproduction,
> copying, distribution, or either dissemination, either whole or partial, is
> strictly forbidden except previous formal approval of the named
> addressee(s). If you are not the intended recipient, please contact
> immediately the sender by telephone, fax or e-mail and delete the
> information in this message that has been received in error. The sender
> does not give any warranty or accept liability as the content, accuracy or
> completeness of sent messages and accepts no responsibility for changes
> made after they were sent or for other risks which arise as a result of
> e-mail transmission, viruses, etc.
>
> -------------------------------------------------------
>
------------------------------------------------------------------------------
Site24x7 APM Insight: Get Deep Visibility into Application Performance
APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month
Monitor end-to-end web transactions and take corrective actions now
Troubleshoot faster and improve end-user experience. Signup Now!
http://pubads.g.doubleclick.net/gampad/clk?id=272487151&iu=/4140
_______________________________________________
GeoTools-GT2-Users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/geotools-gt2-users
