Github user icexelloss commented on the issue:
https://github.com/apache/spark/pull/18664
Excited to see this being worked on.
> SQLConf.SESSION_LOCAL_TIMEZONE
I like this the best. This presents timestamp in local time which is
compatible with the existing `toPandas()` and `collect()`. If we really want
to have the result exactly the same as the non-arrow version of toPandas, we
can do sth like `df[col] = df[col].dt.tz_localize(None)` after getting the
`pandas.DataFrame` from arrow.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
