[
https://issues.apache.org/jira/browse/PARQUET-1274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16442274#comment-16442274
]
ASF GitHub Bot commented on PARQUET-1274:
-----------------------------------------
xhochy commented on issue #456: PARQUET-1274: Prevent segfault that was
occurring when writing a nanosecond timestamp with arrow writer properties set
to coerce timestamps and support deprecated int96 timestamps.
URL: https://github.com/apache/parquet-cpp/pull/456#issuecomment-382347711
Thanks @joshuastorck
I moved the ARROW issue over to the PARQUET tracker and also gave you karma
to assign issues to yourself there, too.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> [Python] SegFault in pyarrow.parquet.write_table with specific options
> ----------------------------------------------------------------------
>
> Key: PARQUET-1274
> URL: https://issues.apache.org/jira/browse/PARQUET-1274
> Project: Parquet
> Issue Type: Bug
> Components: parquet-cpp
> Environment: tested on MacOS High Sierra with python 3.6 and Ubuntu
> Xenial (Python 3.5)
> Reporter: Clément Bouscasse
> Assignee: Joshua Storck
> Priority: Major
> Labels: pull-request-available
> Fix For: cpp-1.5.0
>
>
> I originally filed an issue in the pandas project but we've tracked it down
> to arrow itself, when called via pandas in specific circumstances:
> [https://github.com/pandas-dev/pandas/issues/19493]
> basically using
> {code:java}
> df.to_parquet('filename.parquet', flavor='spark'){code}
> gives a seg fault if `df` contains a datetime column.
> Under the covers, pandas translates this to the following call:
> {code:java}
> pq.write_table(table, 'output.parquet', flavor='spark', compression='snappy',
> coerce_timestamps='ms')
> {code}
> which gives me an instant crash.
> There is a repro on the github ticket.
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
