paleolimbot commented on PR #1074: URL: https://github.com/apache/sedona-db/pull/1074#issuecomment-5071038081
> I would rather keep the current behavior as it uses statistics to detect the best side to be the probe side. I'll note that we've had a lot of trouble with our current heuristic, which only uses row count or byte size to determine the best probe side. We should use more advanced stats to choose this but we don't. In fact, the only non-committer contributions to the spatial join have been to add an option to disable our heuristic 🙂 The current heuristic is to pick the smallest side to index, on the bet that the largest side will have to spill and therefore be slower. On those grounds, we should always be indexing the raster side. A better heuristic is probably to index the geometry side, because those geometries are likely to be more complex and benefit from preparation. It sounds like indexing on the geometry side is also better for the case where we have materialized rasters. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
