Hyukjin Kwon created SPARK-42014: ------------------------------------ Summary: Support aware datetimes Key: SPARK-42014 URL: https://issues.apache.org/jira/browse/SPARK-42014 Project: Spark Issue Type: Sub-task Components: Connect Affects Versions: 3.4.0 Reporter: Hyukjin Kwon
{code} pyspark/sql/tests/test_serde.py:71 (SerdeParityTests.test_filter_with_datetime_timezone) self = <pyspark.sql.tests.connect.test_parity_serde.SerdeParityTests testMethod=test_filter_with_datetime_timezone> def test_filter_with_datetime_timezone(self): dt1 = datetime.datetime(2015, 4, 17, 23, 1, 2, 3000, tzinfo=UTCOffsetTimezone(0)) dt2 = datetime.datetime(2015, 4, 17, 23, 1, 2, 3000, tzinfo=UTCOffsetTimezone(1)) row = Row(date=dt1) > df = self.spark.createDataFrame([row]) ../test_serde.py:76: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../../connect/session.py:278: in createDataFrame _table = pa.Table.from_pylist([row.asDict(recursive=True) for row in _data]) pyarrow/table.pxi:3700: in pyarrow.lib.Table.from_pylist ??? pyarrow/table.pxi:5221: in pyarrow.lib._from_pylist ??? pyarrow/table.pxi:3575: in pyarrow.lib.Table.from_arrays ??? pyarrow/table.pxi:1383: in pyarrow.lib._sanitize_arrays ??? pyarrow/table.pxi:1364: in pyarrow.lib._schema_from_arrays ??? pyarrow/array.pxi:320: in pyarrow.lib.array ??? pyarrow/array.pxi:39: in pyarrow.lib._sequence_to_array ??? _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > ??? E NotImplementedError: a tzinfo subclass must implement tzname() pyarrow/error.pxi:144: NotImplementedError {code} -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org