[
https://issues.apache.org/jira/browse/SPARK-42022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-42022:
------------------------------------
Assignee: Apache Spark
> createDataFrame should autogenerate missing column names
> --------------------------------------------------------
>
> Key: SPARK-42022
> URL: https://issues.apache.org/jira/browse/SPARK-42022
> Project: Spark
> Issue Type: Sub-task
> Components: Connect
> Affects Versions: 3.4.0
> Reporter: Hyukjin Kwon
> Assignee: Apache Spark
> Priority: Major
>
> {code}
> pyspark/sql/tests/test_types.py:233
> (TypesParityTests.test_infer_schema_not_enough_names)
> ['col1', '_2'] != ['col1']
> Expected :['col1']
> Actual :['col1', '_2']
> <Click to see difference>
> self = <pyspark.sql.tests.connect.test_parity_types.TypesParityTests
> testMethod=test_infer_schema_not_enough_names>
> def test_infer_schema_not_enough_names(self):
> df = self.spark.createDataFrame([["a", "b"]], ["col1"])
> > self.assertEqual(df.columns, ["col1", "_2"])
> ../test_types.py:236: AssertionError
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
