[
https://issues.apache.org/jira/browse/ARROW-11930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ben Kietzman updated ARROW-11930:
---------------------------------
Description:
Per discussion on
https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
Once Datasets can be streamed from efficiently (ARROW-7001), they can be
wrapped in ScanNodes which push scanned batches into an ExecNode graph.
Filtering and Projection should then be handled by subsequent nodes in that
graph.
was:
Per discussion on
https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
Once Datasets can be streamed from efficiently (ARROW-7001), they can be
wrapped in ScanNodes which push scanned batches into the pipeline.
> [C++][Dataset][Compute] Refactor Dataset scans to use an ExecNode graph
> -----------------------------------------------------------------------
>
> Key: ARROW-11930
> URL: https://issues.apache.org/jira/browse/ARROW-11930
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Ben Kietzman
> Assignee: Ben Kietzman
> Priority: Major
> Labels: compute, dataset
>
> Per discussion on
> https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ
> Once Datasets can be streamed from efficiently (ARROW-7001), they can be
> wrapped in ScanNodes which push scanned batches into an ExecNode graph.
> Filtering and Projection should then be handled by subsequent nodes in that
> graph.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
