I haven't tried the latest RC, I believe we are using 2.14 at the moment,
so I will check it out (if memory usage is improved I will do backflips).

The store is NetCDF, and in particular NetCDF aggregations using the
NCML/FMRC XML formats (this prevents making use of the Direct Download
feature in CSW, unfortunately).


On Tue, Jan 29, 2019 at 4:28 AM Daniele Romagnoli <
daniele.romagn...@geo-solutions.it> wrote:

> Hi Clifford,
> I have a couple of questions on your use case for some feedbacks:
> 1) which GeoServer version are you using? (did you already tried with the
> latest RC?)
> 2) which store are you using to configure your input data? Is it a NetCDF
> store OR an ImageMosaic one?
>
> Please,
> let us know.
>
> On Tue, Jan 29, 2019 at 7:22 AM Clifford Harms <clifford.ha...@gmail.com>
> wrote:
>
>> I've run into a problem with the memory footprint using the netcdf-output
>> plugin with n-dimensional datasets.  Consider a WCS 2.0.1 request that
>> wants multiple times and elevations in netcdf format.  The WCS GetCoverage
>> operation slices this request into 2D slices, and loads these slices into a
>> GranuleStack, which allows the netcdf output module (and presumably other
>> n-dimensional output formats in the future) to stitch them back together in
>> the desired format.
>>
>> The problem arises when the number of 2D slices are large, as they are
>> completely held in memory.  I'm trying to find a solution to this, to
>> substantially increase the size of datasets that can be requested in netcdf
>> format.
>>
>> My initial stab was setting up a deferred read by implementing a quick
>> GridCoverage2D wrapper, that basically encapsulated all of the GetCoverage
>> work and only performs the read when the image data is accessed, while
>> modifying netcdf-out to work with only one slice at a time.  This isn't
>> working so well, because it is hard to separate the image from the rest of
>> the non-pixel data related calls in the GridCoverage2D.
>>
>> I was curious before I went further down this route if there is a more
>> obvious solution then basically extending and heavily modifying
>> GridCoverage2D in addition to changing the netcdf output encoder itself, or
>> utilizing some type of file buffered Image implementation.
>>
>> Thanks.
>>
>> --
>> Clifford M. Harms
>> _______________________________________________
>> Geoserver-devel mailing list
>> Geoserver-devel@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/geoserver-devel
>>
>
>
> --
> Regards,
> Daniele Romagnoli
> ==
> GeoServer Professional Services from the experts! Visit
> http://goo.gl/it488V for more information.
> ==
>
> Ing. Daniele Romagnoli
> Senior Software Engineer
>
> GeoSolutions S.A.S.
> Via di Montramito 3/A
> 55054  Massarosa (LU)
> Italy
> phone: +39 0584 962313
> fax:      +39 0584 1660272
>
> http://www.geo-solutions.it
> http://twitter.com/geosolutions_it
>
> -------------------------------------------------------
>
> Con riferimento alla normativa sul trattamento dei dati personali (Reg. UE
> 2016/679 - Regolamento generale sulla protezione dei dati “GDPR”), si
> precisa che ogni circostanza inerente alla presente email (il suo
> contenuto, gli eventuali allegati, etc.) è un dato la cui conoscenza è
> riservata al/i solo/i destinatario/i indicati dallo scrivente. Se il
> messaggio Le è giunto per errore, è tenuta/o a cancellarlo, ogni altra
> operazione è illecita. Le sarei comunque grato se potesse darmene notizia.
>
> This email is intended only for the person or entity to which it is
> addressed and may contain information that is privileged, confidential or
> otherwise protected from disclosure. We remind that - as provided by
> European Regulation 2016/679 “GDPR” - copying, dissemination or use of this
> e-mail or the information herein by anyone other than the intended
> recipient is prohibited. If you have received this email by mistake, please
> notify us immediately by telephone or e-mail.
>


-- 
Clifford M. Harms
_______________________________________________
Geoserver-devel mailing list
Geoserver-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/geoserver-devel

Reply via email to