anchovYu commented on code in PR #38257:
URL: https://github.com/apache/spark/pull/38257#discussion_r1023195030
##########
docs/sql-migration-guide.md:
##########
@@ -34,6 +34,7 @@ license: |
- Valid hexadecimal strings should include only allowed symbols
(0-9A-Fa-f).
- Valid values for `fmt` are case-insensitive `hex`, `base64`, `utf-8`,
`utf8`.
- Since Spark 3.4, Spark throws only `PartitionsAlreadyExistException` when
it creates partitions but some of them exist already. In Spark 3.3 or earlier,
Spark can throw either `PartitionsAlreadyExistException` or
`PartitionAlreadyExistsException`.
+ - Since Spark 3.4, Spark will do validation for partition spec in ALTER
PARTITION to follow the behavior of `spark.sql.storeAssignmentPolicy` which may
cause an exception if type conversion fails, e.g. `ALTER TABLE .. ADD
PARTITION(p='a')` if column `p` is int type. To restore the legacy behavior,
set `spark.sql.legacy.skipPartitionSpecTypeValidation` to `true`.
Review Comment:
The conf should be `spark.sql.legacy.skipTypeValidationOnAlterPartition`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
