jiayuasu commented on issue #1047: URL: https://github.com/apache/sedona/issues/1047#issuecomment-1780359776
@JimShady This is actually quite big because the `pivot` function essentially merges all the tiff image to a giant row which is 1.6GB in total, which means the executor which gets assigned of this image needs to be prepared for this huge image. And, geotiff images are in compressed format on disk. So once they are loaded to the memory, its in-memory size is probably 10X larger than before. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
