[
https://issues.apache.org/jira/browse/ARROW-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacob Wujciak-Jens updated ARROW-14367:
---------------------------------------
Component/s: C++
Python
> [C++][Python] Add some kind of user-visible signal when backpressure is
> applied
> -------------------------------------------------------------------------------
>
> Key: ARROW-14367
> URL: https://issues.apache.org/jira/browse/ARROW-14367
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, Python
> Reporter: Weston Pace
> Priority: Major
>
> Initially this will be specific to datasets (since we have don't have well
> defined backpressure in the plan itself yet) but there should be a way for a
> consumer to inspect an executing datasets operation to know if backpressure
> is being applied because they are consuming the data too slowly.
> A simple implementation might be a callback that is triggered each time
> backpressure is applied. Longer term we might want something with more
> extensive visibility into a running query that is integrated with any tracing
> utilities.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
