[
https://issues.apache.org/jira/browse/SPARK-14057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-14057.
----------------------------------
Resolution: Duplicate
Apparently it seems fixed in SPARK-18936. If it refers other datasources or
functions when data is initially loaded, I think we can specify timezone in
time format in many places. Please reopen this if this still exists and I
misunderstood.
> sql time stamps do not respect time zones
> -----------------------------------------
>
> Key: SPARK-14057
> URL: https://issues.apache.org/jira/browse/SPARK-14057
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 1.6.0
> Reporter: Andrew Davidson
> Priority: Minor
>
> we have time stamp data. The time stamp data is UTC how ever when we load the
> data into spark data frames, the system assume the time stamps are in the
> local time zone. This causes problems for our data scientists. Often they
> pull data from our data center into their local macs. The data centers run
> UTC. There computers are typically in PST or EST.
> It is possible to hack around this problem
> This cause a lot of errors in their analysis
> A complete description of this issue can be found in the following mail msg
> https://www.mail-archive.com/[email protected]/msg48121.html
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
