kimotorc commented on issue #10965: URL: https://github.com/apache/arrow/issues/10965#issuecomment-905967966
Thanks, I've filed a JIRA ([ARROW-13763](https://issues.apache.org/jira/browse/ARROW-13763)) with some minimal code attached to demonstrate how the files are closed. I've tried with both `use_legacy_dataset=False` and `True`. In both cases the files opened for read are never explicitly closed (called with `close()` or `__exit__()`). Though, they don't stay open when using `lsof`. I'm pretty sure the python gc is cleaning up the opened files. Currently I have a workaround by adding a `__del__()` in my filesystem file object to catch these. But I'm reading that the use of `__del__` is discouraged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
