Github user BryanCutler commented on a diff in the pull request:
https://github.com/apache/spark/pull/20537#discussion_r166810415
--- Diff: python/pyspark/sql/types.py ---
@@ -1730,7 +1730,28 @@ def _check_series_convert_timestamps_internal(s,
timezone):
# TODO: handle nested timestamps, such as ArrayType(TimestampType())?
if is_datetime64_dtype(s.dtype):
tz = timezone or 'tzlocal()'
- return s.dt.tz_localize(tz).dt.tz_convert('UTC')
+ """
+ tz_localize with ambiguous=False has the same behavior of
pytz.localize
--- End diff --
I'm not sure we want this doctest
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
