paleolimbot opened a new issue, #1222: URL: https://github.com/apache/sedona-db/issues/1222
In https://github.com/apache/sedona-db/pull/916, the raster loader is used to inject Zarr support into the engine for inline loading when required. In the PR, the interface allows for issuing multiple requests at once; however, some implementations still only issue one request at time. This is inefficient because often load requests can be issued in batches and waited on in serial (although, there would be one serial loop in each partition). For Zarr in particular, it is particularly inefficient if multiple bands are getting fetched that happen to come from the same chunk. At the very least, issuing all band load requests at once for a single raster will probably help quite a bit and reduce the reliance on caches. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
