Clément Bouscasse created ARROW-2082:

             Summary: SegFault in pyarrow.parquet.write_table with specific 
                 Key: ARROW-2082
             Project: Apache Arrow
          Issue Type: Bug
          Components: Python
    Affects Versions: 0.8.0
         Environment: tested on MacOS High Sierra with python 3.6 and Ubuntu 
Xenial (Python 3.5)
            Reporter: Clément Bouscasse

I originally filed an issue in the pandas project but we've tracked it down to 
arrow itself, when called via pandas in specific circumstances:


basically using
 df.to_parquet('filename.parquet', flavor='spark'){code}
gives a seg fault if `df` contains a datetime column.

Under the covers,  pandas translates this to the following call:
pq.write_table(table, 'output.parquet', flavor='spark', compression='snappy', 
which gives me an instant crash.

There is a repo on the github ticket.



This message was sent by Atlassian JIRA

Reply via email to