[
https://issues.apache.org/jira/browse/ARROW-3324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16729131#comment-16729131
]
Tanya Schlusser commented on ARROW-3324:
----------------------------------------
The file
[arrow_3324_leak_on_write.py|https://issues.apache.org/jira/secure/attachment/12953078/arrow_3324_leak_on_write.py]
contains a modified version of the stackoverflow post in Wes's comment above,
with {{memory_profiler}} to show the memory use. The memory use does increase
as the code cycles through multiple calls to {{write_table}}.
> [Python] Users reporting memory leaks using pa.pq.ParquetDataset
> ----------------------------------------------------------------
>
> Key: ARROW-3324
> URL: https://issues.apache.org/jira/browse/ARROW-3324
> Project: Apache Arrow
> Issue Type: Bug
> Components: Python
> Reporter: Wes McKinney
> Priority: Major
> Labels: parquet, pull-request-available
> Fix For: 0.12.0
>
> Attachments: arrow_3324_leak_on_write.py
>
> Time Spent: 50m
> Remaining Estimate: 0h
>
> See:
> * https://github.com/apache/arrow/issues/2614
> * https://github.com/apache/arrow/issues/2624
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
