[
https://issues.apache.org/jira/browse/ARROW-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17393237#comment-17393237
]
Krisztian Szucs edited comment on ARROW-3448 at 8/4/21, 2:49 PM:
-----------------------------------------------------------------
I can't recall the original error, but it's more about keeping the dataframes
equal before and after the roundtrip. Perhaps pandas has changed the semantics
of checking equality of numpy arrays with datetime objects, for older pandas
version the roundtrip fails:
https://github.com/apache/arrow/pull/10866/checks?check_run_id=3242074723#step:8:7795
So {{assert_series_equal(pa.table(df).to_pandas(), df)}} wan't true previously.
was (Author: kszucs):
I can't recall the original error, but it's more about keeping the dataframes
equal before and after the roundtrip. Perhaps pandas has changed the semantics
of checking equality of numpy arrays with datetime objects, for older pandas
version the roundtrip fails:
https://github.com/apache/arrow/pull/10866/checks?check_run_id=3242074723#step:8:7795
> [Python] Pandas roundtrip doesn't preserve list of datetime objects
> -------------------------------------------------------------------
>
> Key: ARROW-3448
> URL: https://issues.apache.org/jira/browse/ARROW-3448
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Krisztian Szucs
> Priority: Major
> Labels: pull-request-available
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Adding the following to the pandas_example.py::dataframe_with_lists functionn:
> {code:python}
> datetime_data = [
> [datetime(2015, 1, 5, 12, 0, 0), datetime(2020, 8, 22, 10, 5, 0)],
> [datetime(2024, 5, 5, 5, 49, 1), datetime(2015, 12, 24, 22, 10, 17)],
> [datetime(1996, 4, 30, 2, 38, 11)],
> None,
> [datetime(1987, 1, 27, 8, 21, 59)]
> ]
> type = pa.timestamp('s'|'ms'|'us'|'ns')
> {code}
> breaks the tests cases, because the roundtrip doesn't preserve the object
> type.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
