[
https://issues.apache.org/jira/browse/SPARK-36210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
L. C. Hsieh resolved SPARK-36210.
---------------------------------
Fix Version/s: 3.1.3
3.2.0
3.0.4
Resolution: Fixed
Issue resolved by pull request 33423
[https://github.com/apache/spark/pull/33423]
> Preserve column insertion order in Dataset.withColumns
> ------------------------------------------------------
>
> Key: SPARK-36210
> URL: https://issues.apache.org/jira/browse/SPARK-36210
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.2
> Reporter: koert kuipers
> Assignee: koert kuipers
> Priority: Minor
> Fix For: 3.0.4, 3.2.0, 3.1.3
>
>
> Dataset.withColumns uses a Map (columnMap) to store the mapping of column
> name to column. however this loses the order of the columns. also none of the
> operations used on the Map (find and filter) benefits from the map's lookup
> features. so it seems simpler to use a Seq instead, which also preserves the
> insertion order.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
