Github user gatorsmile commented on a diff in the pull request:
https://github.com/apache/spark/pull/18933#discussion_r145888158
--- Diff: python/pyspark/sql/dataframe.py ---
@@ -1760,6 +1760,17 @@ def toPandas(self):
for f, t in dtype.items():
pdf[f] = pdf[f].astype(t, copy=False)
+
+ if
self.sql_ctx.getConf("spark.sql.execution.pandas.timeZoneAware",
"false").lower() \
--- End diff --
We still need a conf, even if it is a bug. This is just to avoid breaking
any existing app. We can remove the conf in Spark 3.x.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
