[
https://issues.apache.org/jira/browse/ARROW-14330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neal Richardson updated ARROW-14330:
------------------------------------
Affects Version/s: (was: 7.0.0)
> [C++] Create DataHolder that can be used for caching during exec plans
> ----------------------------------------------------------------------
>
> Key: ARROW-14330
> URL: https://issues.apache.org/jira/browse/ARROW-14330
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Alexander Ocsa
> Assignee: Alexander Ocsa
> Priority: Major
> Labels: query-engine
>
> The purpose of this task is to make an ExecNode that can provide the
> following functionality.
> # Be able to obtain heuristics about our memory consumption and have a
> memory consumption threshold
> # Be able to write incoming ExecBatch to disk if memory consumption is above
> the threshold, stores either the ExecBatch or a handle to file in a queue.
> # Provide an api for pulling an ExecBatch from the queue. It should favor
> pulling all of the batches that are in memory first and then the ones that
> are handles to files.
>
> PRs to reference
> [https://github.com/apache/arrow/pull/11017/]
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
