[
https://issues.apache.org/jira/browse/ARROW-13155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated ARROW-13155:
-----------------------------------
Labels: pull-request-available (was: )
> [C++] MapGenerator should optionally forward reentrant pressure
> ---------------------------------------------------------------
>
> Key: ARROW-13155
> URL: https://issues.apache.org/jira/browse/ARROW-13155
> Project: Apache Arrow
> Issue Type: Bug
> Components: C++
> Reporter: Weston Pace
> Assignee: Weston Pace
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Currently the map generator will allow the map function to run in parallel
> but it will not forward reentrant pressure onto the source generator.
> Instead it queues requests.
> In some cases this is the right decision (if source is not async reentrant)
> but in some cases we want it to forward the pressure (so that the entire
> chain can run in parallel).
> By making it an option when the mapped generator is created we can allow
> pressure to be forwarded where appropriate.
>
> Phrasing it another way. If we have source, map function A, map function B,
> map function C, and then a reentrant pull we would currently only run C in
> parallel.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
