koert kuipers created SPARK-36210:
-------------------------------------
Summary: Preserve column insertion order in Dataset.withColumns
Key: SPARK-36210
URL: https://issues.apache.org/jira/browse/SPARK-36210
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.1.2
Reporter: koert kuipers
Dataset.withColumns uses a Map (columnMap) to store the mapping of column name
to column. however this loses the order of the columns. also none of the
operations used on the Map (find and filter) benefits from the map's lookup
features. so it seems simpler to use a Seq instead, which also preserves the
insertion order.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]