petern48 opened a new issue, #2050: URL: https://github.com/apache/sedona/issues/2050
As mentioned in [#2038](https://github.com/apache/sedona/pull/2038), `align=False` is not yet supported. It seems like Pandas on Pyspark maintains an artificial "natural order column" that's based on `F.monotonically_increasing_id()`, so we should try to use that to perform the align=False behavior. It's not immediately clear whether this will match the geopandas ordering. ``` NATURAL_ORDER_COLUMN_NAME = "__natural_order__" HIDDEN_COLUMNS = {NATURAL_ORDER_COLUMN_NAME} ``` https://github.com/apache/spark/blob/a1e628574b7d9cdf89472fa550ecc41f8a871b98/python/pyspark/pandas/internal.py#L77-L79 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
