[
https://issues.apache.org/jira/browse/SPARK-32205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17152574#comment-17152574
]
JinxinTang commented on SPARK-32205:
------------------------------------
We can see from the doc in mysql Date type has 1000-01-01 00:00:00' to
'9999-12-31 23:59:59' range, while timestamp in mysql has '1970-01-01
00:00:01' UTC to '2038-01-19 03:14:07' range, in spark, we can use `sql("select
cast('1000-03-01 12:00:01' as
timestamp)").toDF("ts").write.mode("append").jdbc("jdbc:mysql://localhost:3306/test",
"ts_test4",prop)` to insert into mysql. Caution: the table is predefined, not
auto created by spark because auto create table has Timestamp column type, this
column in mysql predefined is Date type could accept this value.
> Writing timestamp in mysql gets fails
> --------------------------------------
>
> Key: SPARK-32205
> URL: https://issues.apache.org/jira/browse/SPARK-32205
> Project: Spark
> Issue Type: Bug
> Components: Java API
> Affects Versions: 2.3.4
> Reporter: Nilesh Patil
> Priority: Major
>
> When we are writing to mysql with TIMESTAMP column it supports only range
> '1970-01-01 00:00:01' UTC to '2038-01-19 03:14:07'. Mysql has DATETIME
> datatype which has 1000-01-01 00:00:00' to '9999-12-31 23:59:59' range.
> How to map spark timestamp datatype to mysql datetime datatype in order to
> use higher supporting range ?
> [https://dev.mysql.com/doc/refman/5.7/en/datetime.html]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
