[
https://issues.apache.org/jira/browse/SPARK-43330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
KyungWon Park updated SPARK-43330:
----------------------------------
Description:
There is a minor typo in [sql-migration-guide.md|#L154]]
| - In Spark 3.2, `TRANSFORM` operator can support
`ArrayType/MapType/StructType` without Hive SerDe, in this mode, we use
`StructsToJosn` to convert `ArrayType/MapType/StructType` column to `STRING`
and use `JsonToStructs` to parse `STRING` to `ArrayType/MapType/StructType`. In
Spark 3.1, Spark just support case `ArrayType/MapType/StructType` column as
`STRING` but can't support parse `STRING` to `ArrayType/MapType/StructType`
output columns.|
StructToJosn -> StructToJson
was:
There is a minor typo in
[sql-migration-guide.md|[https://github.com/apache/spark/blob/master/docs/sql-migration-guide.md?plain=1#L154]]
```
|- In Spark 3.2, `TRANSFORM` operator can support
`ArrayType/MapType/StructType` without Hive SerDe, in this mode, we use
`StructsToJosn` to convert `ArrayType/MapType/StructType` column to `STRING`
and use `JsonToStructs` to parse `STRING` to `ArrayType/MapType/StructType`. In
Spark 3.1, Spark just support case `ArrayType/MapType/StructType` column as
`STRING` but can't support parse `STRING` to `ArrayType/MapType/StructType`
output columns.|
||
```
StructToJosn -> StructToJson
> Typo in sql-migration-guide.md
> ------------------------------
>
> Key: SPARK-43330
> URL: https://issues.apache.org/jira/browse/SPARK-43330
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 3.2.0
> Reporter: KyungWon Park
> Priority: Major
>
> There is a minor typo in [sql-migration-guide.md|#L154]]
>
> | - In Spark 3.2, `TRANSFORM` operator can support
> `ArrayType/MapType/StructType` without Hive SerDe, in this mode, we use
> `StructsToJosn` to convert `ArrayType/MapType/StructType` column to `STRING`
> and use `JsonToStructs` to parse `STRING` to `ArrayType/MapType/StructType`.
> In Spark 3.1, Spark just support case `ArrayType/MapType/StructType` column
> as `STRING` but can't support parse `STRING` to
> `ArrayType/MapType/StructType` output columns.|
>
> StructToJosn -> StructToJson
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
