[
https://issues.apache.org/jira/browse/ARROW-501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16593028#comment-16593028
]
Wes McKinney commented on ARROW-501:
------------------------------------
I was thinking we could use {{std::future}} to implement this, but it seems
that there is quite a bit of overhead associated with this in many cases (see
e.g. https://www.quora.com/Why-is-C++11-std-future-so-slow). It may be better
to spawn a single thread that blocks on a condition variable so that it can be
notified when {{Next}} is called to begin reading the next chunk
> [C++] Implement concurrent / buffering InputStream for streaming data use
> cases
> -------------------------------------------------------------------------------
>
> Key: ARROW-501
> URL: https://issues.apache.org/jira/browse/ARROW-501
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++
> Reporter: Wes McKinney
> Priority: Major
> Fix For: 0.13.0
>
>
> Related to ARROW-500, when processing an input data stream, we may wish to
> continue buffering input (up to an maximum buffer size) in between
> synchronous Read calls
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
