Gengliang Wang created SPARK-47696:
--------------------------------------
Summary: try_to_timestamp should handle SparkUpgradeException
Key: SPARK-47696
URL: https://issues.apache.org/jira/browse/SPARK-47696
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 4.0.0, 3.5.2, 3.4.3
Reporter: Gengliang Wang
Assignee: Gengliang Wang
Currently, try_to_timestamp will throw an exception on legacy timestamp input.
{code:java}
> SELECT try_to_timestamp('2016-12-1', 'yyyy-MM-dd')
org.apache.spark.SparkUpgradeException:
[INCONSISTENT_BEHAVIOR_CROSS_VERSION.PARSE_DATETIME_BY_NEW_PARSER] You may get
a different result due to the upgrading to Spark >= 3.0:
Fail to parse '2016-12-1' in the new parser.
You can set "spark.sql.legacy.timeParserPolicy" to "LEGACY" to restore the
behavior before Spark 3.0, or set to "CORRECTED" and treat it as an invalid
datetime string. SQLSTATE: 42K0B {code}
It should return null instead of error.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
