paleolimbot opened a new issue, #1224: URL: https://github.com/apache/sedona-db/issues/1224
The current raster loader (or any of the implementations) make no attempt to cache multiple requests to the same object, or any version of a cache (except possibly a dataset cache in the GDAL layer, whose details I forget). In Sedona Spark I believe there are at least two levels of caching, although the per-row execution may be better suited to effectively using it (as opposed to the current execution that loops through potentially 8000 rasters before circling back to a new expression evaluation). We should implement some version of a cache before we get too far into evaluation to make sure the APIs between the loader and their implementations effectively capture an effective cache scheme. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
