cloud-fan commented on a change in pull request #30421:
URL: https://github.com/apache/spark/pull/30421#discussion_r584881851
##########
File path: docs/sql-migration-guide.md
##########
@@ -65,6 +65,8 @@ license: |
- In Spark 3.2, the output schema of `SHOW TBLPROPERTIES` becomes `key:
string, value: string` whether you specify the table property key or not. In
Spark 3.1 and earlier, the output schema of `SHOW TBLPROPERTIES` is `value:
string` when you specify the table property key. To restore the old schema with
the builtin catalog, you can set `spark.sql.legacy.keepCommandOutputSchema` to
`true`.
+ - In Spark 3.2, we support a typed literal for a partition constant value in
a partition spec clause. For example, a right-side constant value in `PARTITION
(dt = date'2020-01-01')` is parsed as a date-typed literal in the partition
spec. In Spark 3.1 and earlier, the partition value will be treated as string
value `date '2020-01-01'` and it's a illegal date type string value and will be
converted to `__HIVE_DEFAULT_PARTITION__`.
Review comment:
```
In Spark 3.2, we support typed literals in the partition spec of INSERT and
ADD/DROP/RENAME PARTITION.
For example, `ADD PARTITION(dt = date'2020-01-01')` adds a partition with
date value `2020-01-01`.
In Spark 3.1 and earlier, the partition value will be parsed as string value
`date '2020-01-01', which is
an illegal date value and we add a partition with null value at the end.
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
