Duc Hoa Nguyen created SPARK-34357:
--------------------------------------
Summary: Revert JDBC SQL TIME type to TimestampType with time
portion fixed regardless of timezone
Key: SPARK-34357
URL: https://issues.apache.org/jira/browse/SPARK-34357
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.2.0
Reporter: Duc Hoa Nguyen
Due to user-experience (confusing to Spark users - java.sql.Time using
milliseconds vs Spark using microseconds; and user losing useful functions like
hour(), minute(), etc on the column), we have decided to revert back to use
TimestampType but this time we will enforce the hour to be consistently across
system timezone (via offset manipulation)
Full Discussion with Wenchen Fan [~cloud_fan] regarding this ticket is here
https://github.com/apache/spark/pull/30902#discussion_r569186823
Related issues: [SPARK-33888|https://issues.apache.org/jira/browse/SPARK-33888]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
