David Li created ARROW-4858:
-------------------------------
Summary: [Flight][Python] Enable custom FlightDataStream in Python
Key: ARROW-4858
URL: https://issues.apache.org/jira/browse/ARROW-4858
Project: Apache Arrow
Issue Type: Improvement
Components: FlightRPC, Python
Reporter: David Li
Assignee: David Li
Fix For: 0.14.0
We should be able to provide a custom data stream as the result of Flight
do_get in Python. In particular, when returning data produced on the fly, or
when returning a large Pandas DataFrame, it'd be nice to provide data in chunks
as it becomes available, rather than having to copy everything into a Table
first.
On the Python side, a FlightDataStream wrapper that accepts RecordBatches from
a Python generator should suffice.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
