stevomitric commented on code in PR #58418:
URL: https://github.com/apache/spark/pull/58418#discussion_r3944409288
##########
python/pyspark/sql/pandas/conversion.py:
##########
@@ -632,6 +639,16 @@ def createDataFrame( # type: ignore[misc]
selfcheck = arrowSafeTypeConversion == "true"
infer_pandas_dict_as_map = inferPandasDictAsMap == "true"
+ # Building a DataFrame from pandas/PyArrow data goes through Arrow,
whose nanosecond
+ # timestamp value conversion is a pending follow-up; fail
deterministically for an
+ # explicit nanosecond-typed schema rather than silently mis-handle the
values. Covers a
+ # bare atomic DataType schema as well as a StructType (a DDL string /
list of names cannot
Review Comment:
corrected comment
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
