collimarco opened a new issue, #36001:
URL: https://github.com/apache/arrow/issues/36001
### Describe the usage question you have. Please include as many useful
details as possible.
I have a line like this:
```ruby
table = Arrow::Table.load('data.parquet', format: :parquet)
```
The problem is that I wonder what happens if I use this command when the
file size exceeds the RAM available. For example, that command may run on a
Kubernetes pod that has a memory limit of 1GB, but the file can be 2GB.
1. Is there a way to tell Arrow to use at most 500MB-800MB of RAM?
2. Otherwise, is there a way to read and query the file piece by piece
without loading it entirely on RAM?
### Component(s)
Ruby
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
