srowen commented on issue #24195: [SPARK-25496][SQL] Deprecate from_utc_timestamp and to_utc_timestamp URL: https://github.com/apache/spark/pull/24195#issuecomment-476824278 I think this is what is happening: 1. At '2011-12-25 09:00:00' UTC, the time was '2011-12-25 18:00:00' in Asia/Tokyo (GMT+9) 1. '2011-12-25 18:00:00' results in a timestamp w.r.t. the session timezone of GMT-11, a point in time which was also '2011-12-26 05:00:00' UTC 1. HOUR returns '5' Not 100% sure but that explains the result. It's weird and confusing, but is it the from_utc_timestamp part? Seems like step 2 is the problem. I 'give in' on disabling the confusing function in step 1; its semantics are something even I have to think about 3 times and I even tried to fix the docs once. But is my analysis right and are your other changes helping improve or fix the rest of it?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
