Wes McKinney created ARROW-3789: ----------------------------------- Summary: [Python] Enable calling object in Table.to_pandas to "self-destruct" for improved memory use Key: ARROW-3789 URL: https://issues.apache.org/jira/browse/ARROW-3789 Project: Apache Arrow Issue Type: Improvement Components: Python Reporter: Wes McKinney Fix For: 0.13.0
One issue with using {{Table.to_pandas}} is that it results in a memory doubling (at least, more if there are a lot of Python objects created). It would be useful if there was an option to destroy the {{arrow::Column}} references once they've been transferred into the target data frame. This would render the {{pyarrow.Table}} object useless afterward -- This message was sent by Atlassian JIRA (v7.6.3#76005)