[
https://issues.apache.org/jira/browse/ARROW-9906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Arrow JIRA Bot reassigned ARROW-9906:
--------------------------------------------
Assignee: Antoine Pitrou (was: Apache Arrow JIRA Bot)
> [Python] Crash in test_parquet.py::test_parquet_writer_filesystem_s3_uri
> (closing NativeFile from S3FileSystem)
> ---------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-9906
> URL: https://issues.apache.org/jira/browse/ARROW-9906
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++, Python
> Reporter: Joris Van den Bossche
> Assignee: Antoine Pitrou
> Priority: Major
> Labels: filesystem, pull-request-available
> Fix For: 2.0.0
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> See https://github.com/apache/arrow/pull/7991#discussion_r481247263 and the
> commented out test added in that PR.
> It doesn't give any clarifying traceback or crash message, but it segfaults
> when closing the {{NativeFile}} returned from
> {{S3FileSystem.open_output_stream}} in {{ParquetWriter.close()}}.
> With {{gdb}} I get a bit more context:
> {code}
> Thread 1 "python" received signal SIGSEGV, Segmentation fault.
> 0x00007fa1a39df8f2 in arrow::fs::(anonymous
> namespace)::ObjectOutputStream::UploadPart (this=0x5619a95ce820,
> data=0x7fa197641ec0, nbytes=15671, owned_buffer=...) at
> ../src/arrow/filesystem/s3fs.cc:806
> 806 client_->UploadPartAsync(req, handler);
> {code}
> Another S3 crash in the parquet tests: ARROW-9814 (although it doesn't seem
> fully related)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)