[
https://issues.apache.org/jira/browse/AVRO-406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12830463#action_12830463
]
Philip Zeyliger commented on AVRO-406:
--------------------------------------
We support blocking for complex types (arrays and maps) on the wire. But, the
way all the APIs are right now, the RPC client would have to be able to put the
whole thing in memory, which often doesn't make sense. That's what Todd's
approach is suggesting. You should be able to have a meaningful
"sendMeFiveHundredMegabytes()" command that can be used by a client with only a
modicum of clever handling.
> Support streaming RPC calls
> ---------------------------
>
> Key: AVRO-406
> URL: https://issues.apache.org/jira/browse/AVRO-406
> Project: Avro
> Issue Type: New Feature
> Components: java, spec
> Reporter: Todd Lipcon
>
> Avro nicely supports chunking of container types into multiple frames. We
> need to expose this to RPC layer to facilitate use cases like the Hadoop
> Datanode where a single "RPC" can yield far more data than should be buffered
> in memory.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
